You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 03:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot6.osadl.org (updated Fri Jul 26, 2024 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1791911930,5ptp4l401ktimersoftd/310:12:463
2382621560,5sleep2529199cyclictest14:37:372
179191770,1ptp4l401ktimersoftd/312:32:133
179191710,1ptp4l401ktimersoftd/314:26:453
179191650,9ptp4l401ktimersoftd/313:10:583
111242650,1sleep30-21swapper/315:32:473
111242650,1sleep30-21swapper/315:32:473
180642600,2sleep10-21swapper/113:55:051
171662590,1sleep10-21swapper/113:16:101
152662580,4sleep215270-21cpuspeed_turbos13:52:412
179191560,1ptp4l401ktimersoftd/314:34:173
49402544,38sleep10-21swapper/110:14:191
179191540,1ptp4l401ktimersoftd/312:19:443
5291995244,4cyclictest33-21ksoftirqd/213:42:412
5291995244,4cyclictest33-21ksoftirqd/213:42:412
5291995244,4cyclictest33-21ksoftirqd/211:42:382
179191520,1ptp4l401ktimersoftd/313:52:073
179191520,1ptp4l401ktimersoftd/313:52:073
5291995115,33cyclictest33-21ksoftirqd/212:39:212
254152510,2sleep00-21swapper/014:02:510
297002500,2sleep00-21swapper/014:42:490
179191500,1ptp4l401ktimersoftd/315:23:253
179191490,16ptp4l30239-21kworker/3:014:17:393
5291994840,5cyclictest33-21ksoftirqd/213:17:392
5291994825,3cyclictest33-21ksoftirqd/210:32:402
179191470,0ptp4l401ktimersoftd/310:47:263
96742460,2sleep09676-21latency_hist14:22:300
88742460,1sleep10-21swapper/113:06:271
5291994638,4cyclictest33-21ksoftirqd/214:52:352
5291994637,4cyclictest33-21ksoftirqd/211:37:362
179191460,1ptp4l401ktimersoftd/311:40:253
5291994522,20cyclictest33-21ksoftirqd/214:32:402
179191440,1ptp4l401ktimersoftd/313:23:553
5291994332,5cyclictest33-21ksoftirqd/214:22:402
5291994332,4cyclictest33-21ksoftirqd/213:47:382
5291994332,4cyclictest33-21ksoftirqd/213:47:382
529199430,36cyclictest33-21ksoftirqd/215:25:302
5291994218,4cyclictest33-21ksoftirqd/211:12:532
5291994213,26cyclictest33-21ksoftirqd/215:38:022
41462423,24sleep04239-21/usr/sbin/munin10:12:490
179191420,2ptp4l19506-21kworker/3:115:12:343
5291994131,4cyclictest33-21ksoftirqd/210:22:352
5291994116,7cyclictest33-21ksoftirqd/211:17:502
5291994035,2cyclictest321ktimersoftd/215:17:422
5291994016,4cyclictest33-21ksoftirqd/212:22:382
179191400,2ptp4l18395-21kworker/3:013:53:033
179191400,1ptp4l401ktimersoftd/313:42:433
179191400,1ptp4l401ktimersoftd/313:42:433
5291993928,3cyclictest33-21ksoftirqd/211:57:532
5291993917,3cyclictest33-21ksoftirqd/211:22:442
5291993914,4cyclictest33-21ksoftirqd/213:57:542
5291993913,4cyclictest33-21ksoftirqd/215:34:092
5291993913,4cyclictest33-21ksoftirqd/215:34:092
179191390,2ptp4l18395-21kworker/3:011:12:343
179191390,1ptp4l401ktimersoftd/315:46:363
179191390,1ptp4l401ktimersoftd/314:53:223
179191390,1ptp4l401ktimersoftd/313:07:083
179191390,1ptp4l401ktimersoftd/312:59:203
179191390,1ptp4l401ktimersoftd/310:37:383
5291993830,4cyclictest33-21ksoftirqd/212:32:382
5291993826,10cyclictest33-21ksoftirqd/212:27:402
529199382,3cyclictest121rcu_preempt10:22:242
5291993822,13cyclictest33-21ksoftirqd/214:27:482
5291993815,7cyclictest33-21ksoftirqd/213:38:002
5291993813,4cyclictest33-21ksoftirqd/212:47:562
5291993810,24cyclictest33-21ksoftirqd/212:12:462
179191380,1ptp4l401ktimersoftd/315:09:493
179191380,1ptp4l401ktimersoftd/314:05:053
179191380,1ptp4l401ktimersoftd/313:57:303
179191380,0ptp4l401ktimersoftd/314:38:043
179191380,0ptp4l401ktimersoftd/312:38:453
5291993725,9cyclictest33-21ksoftirqd/211:02:562
5291993723,6cyclictest33-21ksoftirqd/213:22:392
5291993722,12cyclictest33-21ksoftirqd/211:07:562
5291993719,10cyclictest33-21ksoftirqd/213:32:502
5291993715,7cyclictest33-21ksoftirqd/215:02:412
5291993714,20cyclictest33-21ksoftirqd/214:42:412
529199371,3cyclictest121rcu_preempt15:45:372
5291993713,4cyclictest33-21ksoftirqd/212:17:402
5291993711,6cyclictest33-21ksoftirqd/215:27:532
5291993711,4cyclictest33-21ksoftirqd/210:37:372
179191370,1ptp4l401ktimersoftd/315:37:533
179191370,1ptp4l401ktimersoftd/314:46:393
179191370,1ptp4l401ktimersoftd/314:08:383
179191370,1ptp4l401ktimersoftd/313:27:543
179191370,0ptp4l401ktimersoftd/315:04:273
179191370,0ptp4l401ktimersoftd/315:02:263
179191370,0ptp4l401ktimersoftd/312:51:463
5291993630,3cyclictest33-21ksoftirqd/214:17:302
5291993630,3cyclictest33-21ksoftirqd/214:02:462
5291993630,3cyclictest33-21ksoftirqd/212:57:462
5291993625,9cyclictest33-21ksoftirqd/213:12:472
5291993623,10cyclictest33-21ksoftirqd/212:02:492
5291993623,10cyclictest33-21ksoftirqd/212:02:492
5291993613,19cyclictest33-21ksoftirqd/212:07:412
5291993613,19cyclictest33-21ksoftirqd/212:07:412
5291993610,4cyclictest33-21ksoftirqd/215:11:202
179191360,1ptp4l401ktimersoftd/315:29:063
179191360,1ptp4l401ktimersoftd/313:41:343
179191360,1ptp4l401ktimersoftd/312:25:433
179191360,0ptp4l401ktimersoftd/312:53:493
5291993530,3cyclictest33-21ksoftirqd/210:17:242
5291993529,3cyclictest33-21ksoftirqd/213:02:422
5291993529,3cyclictest33-21ksoftirqd/211:02:252
5291993528,3cyclictest33-21ksoftirqd/214:17:542
5291993518,14cyclictest33-21ksoftirqd/213:27:582
179191350,2ptp4l18395-21kworker/3:010:22:383
179191350,1ptp4l401ktimersoftd/310:57:443
179191350,0ptp4l401ktimersoftd/314:13:123
5291993428,3cyclictest33-21ksoftirqd/214:52:302
5291993428,3cyclictest33-21ksoftirqd/210:42:422
5291993427,4cyclictest33-21ksoftirqd/210:27:282
5291993418,4cyclictest33-21ksoftirqd/213:09:442
5291993414,7cyclictest33-21ksoftirqd/214:07:502
179191340,1ptp4l401ktimersoftd/314:48:463
5291993328,3cyclictest33-21ksoftirqd/215:17:302
5291993327,4cyclictest33-21ksoftirqd/212:52:482
5291993326,3cyclictest33-21ksoftirqd/211:47:402
5291993319,11cyclictest33-21ksoftirqd/212:42:382
179191330,1ptp4l401ktimersoftd/315:19:233
179191330,1ptp4l401ktimersoftd/314:27:433
179191330,1ptp4l401ktimersoftd/311:50:103
81252320,2sleep20-21swapper/211:27:482
529199328,4cyclictest33-21ksoftirqd/211:32:482
529199324,4cyclictest121rcu_preempt11:52:392
5291993226,3cyclictest33-21ksoftirqd/214:57:542
5291993226,3cyclictest33-21ksoftirqd/210:47:562
5281993224,5cyclictest9-21ksoftirqd/014:38:250
179191320,0ptp4l401ktimersoftd/313:36:303
5281993126,3cyclictest9-21ksoftirqd/015:22:570
179191310,1ptp4l401ktimersoftd/313:16:303
179191310,1ptp4l401ktimersoftd/312:00:453
179191310,0ptp4l401ktimersoftd/312:46:053
179191310,0ptp4l401ktimersoftd/311:29:013
529199301,26cyclictest33-21ksoftirqd/210:52:412
5287993023,4cyclictest25-21ksoftirqd/113:01:211
5281993025,3cyclictest9-21ksoftirqd/014:37:300
179191300,1ptp4l401ktimersoftd/313:19:403
179191300,1ptp4l401ktimersoftd/311:05:513
179191300,0ptp4l401ktimersoftd/312:15:573
179191300,0ptp4l401ktimersoftd/312:10:093
179191300,0ptp4l401ktimersoftd/312:10:093
179191300,0ptp4l401ktimersoftd/312:04:123
179191300,0ptp4l401ktimersoftd/312:04:123
5287992923,3cyclictest25-21ksoftirqd/113:23:531
5281992922,4cyclictest9-21ksoftirqd/015:39:140
49342290,3sleep04932-21sed13:02:280
191292290,2sleep10-21swapper/115:07:191
179191290,1ptp4l401ktimersoftd/311:56:083
179191290,0ptp4l401ktimersoftd/311:43:493
529999282,3cyclictest121rcu_preempt10:22:243
5287992823,3cyclictest25-21ksoftirqd/115:29:011
5287992822,3cyclictest25-21ksoftirqd/112:10:171
5287992822,3cyclictest25-21ksoftirqd/112:10:171
5287992821,4cyclictest25-21ksoftirqd/113:34:211
327192281,23sleep032722-21rm13:33:330
5299992720,4cyclictest41-21ksoftirqd/311:19:543
5287992721,3cyclictest25-21ksoftirqd/111:50:091
5287992720,4cyclictest25-21ksoftirqd/111:33:131
5287992720,4cyclictest25-21ksoftirqd/111:09:241
5281992723,3cyclictest9-21ksoftirqd/014:57:310
5281992721,3cyclictest9-21ksoftirqd/011:02:440
5281992720,4cyclictest9-21ksoftirqd/014:50:160
5281992720,4cyclictest9-21ksoftirqd/012:05:510
5281992720,4cyclictest9-21ksoftirqd/012:05:510
5299992620,5cyclictest41-21ksoftirqd/311:22:533
5287992620,4cyclictest27306-21sh12:49:471
5287992620,3cyclictest25-21ksoftirqd/110:19:381
5287992619,4cyclictest25-21ksoftirqd/111:55:051
5287992619,4cyclictest25-21ksoftirqd/111:32:201
5287992619,4cyclictest25-21ksoftirqd/111:20:041
5287992619,4cyclictest25-21ksoftirqd/110:44:111
5281992620,3cyclictest9-21ksoftirqd/011:07:310
5281992619,4cyclictest9-21ksoftirqd/011:14:450
5281992619,4cyclictest9-21ksoftirqd/010:46:190
5281992619,4cyclictest9-21ksoftirqd/010:27:240
5281992619,4cyclictest13261-21snmp_o5powerctl11:37:520
5299992519,4cyclictest41-21ksoftirqd/310:54:043
5287992520,3cyclictest25-21ksoftirqd/112:02:391
5287992520,3cyclictest25-21ksoftirqd/112:02:391
5287992519,3cyclictest25-21ksoftirqd/111:13:441
5287992518,4cyclictest25-21ksoftirqd/114:06:251
5287992518,4cyclictest25-21ksoftirqd/112:12:311
5281992520,3cyclictest9-21ksoftirqd/015:17:500
5281992519,3cyclictest9-21ksoftirqd/015:15:380
5281992519,3cyclictest9-21ksoftirqd/011:48:040
5281992518,4cyclictest9-21ksoftirqd/013:38:460
5281992518,4cyclictest9-21ksoftirqd/010:35:350
179191250,1ptp4l401ktimersoftd/310:27:583
179191250,0ptp4l401ktimersoftd/311:33:133
179191250,0ptp4l401ktimersoftd/310:43:173
5287992418,4cyclictest25-21ksoftirqd/115:42:411
5287992418,3cyclictest25-21ksoftirqd/111:00:081
5287992417,4cyclictest25-21ksoftirqd/112:40:411
5281992419,3cyclictest9-21ksoftirqd/011:47:250
5281992418,3cyclictest9-21ksoftirqd/014:25:590
528199240,3cyclictest121rcu_preempt13:07:390
179191240,1ptp4l401ktimersoftd/312:32:373
179191240,1ptp4l401ktimersoftd/311:07:453
148772240,2sleep30-21swapper/310:32:543
91982231,18sleep19452-21irqstats10:22:441
5287992318,3cyclictest25-21ksoftirqd/110:54:441
5287992317,3cyclictest25-21ksoftirqd/114:21:221
5287992317,3cyclictest25-21ksoftirqd/114:08:341
5287992317,3cyclictest10648-21cron13:47:281
5287992317,3cyclictest10648-21cron13:47:281
5287992316,4cyclictest25-21ksoftirqd/113:48:181
5287992316,4cyclictest25-21ksoftirqd/113:48:181
5287992310,3cyclictest28207-21latency_hist14:42:311
5281992317,3cyclictest9-21ksoftirqd/013:53:470
5281992317,3cyclictest9-21ksoftirqd/013:17:580
5281992317,3cyclictest9-21ksoftirqd/013:02:300
5281992317,3cyclictest9-21ksoftirqd/010:47:310
5281992316,4cyclictest9-21ksoftirqd/012:16:230
5281992316,4cyclictest9-21ksoftirqd/011:25:330
5281992316,4cyclictest9-21ksoftirqd/010:17:560
5281992316,4cyclictest7759-21tune2fs12:27:430
5281992316,4cyclictest30390-21sh12:52:590
5281992314,7cyclictest9-21ksoftirqd/013:47:470
5281992314,7cyclictest9-21ksoftirqd/013:47:470
5281992314,5cyclictest0-21swapper/014:12:400
528799222,17cyclictest19687-21grep14:32:461
5287992217,3cyclictest25-21ksoftirqd/111:07:251
5287992215,4cyclictest25-21ksoftirqd/110:31:061
528799221,19cyclictest3025-21kworker/1:110:41:371
5281992217,3cyclictest9-21ksoftirqd/013:24:270
5281992217,3cyclictest9-21ksoftirqd/012:23:170
5281992216,3cyclictest9-21ksoftirqd/015:36:410
5281992216,3cyclictest9-21ksoftirqd/015:36:410
5281992215,4cyclictest9-21ksoftirqd/015:03:210
5281992215,4cyclictest9-21ksoftirqd/012:00:420
5281992215,4cyclictest9-21ksoftirqd/011:53:270
5281992215,4cyclictest9-21ksoftirqd/011:33:240
5281992215,4cyclictest9-21ksoftirqd/010:54:250
5281992214,5cyclictest16803-21irqrtprio12:37:490
5281992214,5cyclictest10429-21grep14:57:430
5281992213,5cyclictest19834-21cstates15:07:440
528799214,15cyclictest29395-21tail12:52:451
528799212,16cyclictest31588-21gltestperf12:17:421
5287992116,3cyclictest3025-21kworker/1:111:46:141
5287992116,3cyclictest28255-21kworker/1:212:44:561
5287992116,3cyclictest25-21ksoftirqd/114:01:081
5287992114,4cyclictest3844-21ssh15:24:261
5287992114,4cyclictest1779-21runrttasks14:12:501
5281992116,3cyclictest9-21ksoftirqd/011:17:420
5281992115,3cyclictest9-21ksoftirqd/014:00:580
5281992115,3cyclictest9-21ksoftirqd/010:42:050
5281992115,3cyclictest14705-21grep13:12:480
5281992115,3cyclictest12574-21latency12:32:460
5281992114,4cyclictest9-21ksoftirqd/012:10:240
5281992114,4cyclictest9-21ksoftirqd/012:10:240
5281992114,4cyclictest9-21ksoftirqd/011:31:390
5281992114,4cyclictest7071-21grep13:42:450
5281992114,4cyclictest7071-21grep13:42:450
5281992110,3cyclictest101ktimersoftd/015:32:210
528799203,9cyclictest26544-21ssh13:27:381
5287992016,2cyclictest25-21ksoftirqd/111:58:101
5287992015,3cyclictest32703-21kworker/1:114:52:191
5287992015,3cyclictest3025-21kworker/1:110:47:451
5287992015,3cyclictest25-21ksoftirqd/111:39:471
5287992014,3cyclictest3224-21sed13:37:471
5287992014,3cyclictest30781-21diskmemload14:31:201
5287992014,3cyclictest28255-21kworker/1:212:22:571
5287992014,3cyclictest25-21ksoftirqd/115:37:241
5287992014,3cyclictest25-21ksoftirqd/115:37:241
5287992014,3cyclictest25-21ksoftirqd/111:25:401
5287992014,3cyclictest19493-21latency_hist15:42:311
5287992013,4cyclictest8893-21switchtime12:27:571
5287992013,4cyclictest5614-21sh14:52:371
5287992013,4cyclictest24767-21grep15:12:461
5287992013,4cyclictest21854-21sh15:08:401
5287992013,4cyclictest12927-21find12:32:511
5287992013,4cyclictest11086-21sed14:57:491
528799201,17cyclictest32703-21kworker/1:114:24:041
5287992011,6cyclictest31381-21sh15:19:021
528199204,10cyclictest26541-21apt-get13:27:390
5281992015,3cyclictest9-21ksoftirqd/012:42:470
5281992013,4cyclictest20191-21fschecks_count15:42:450
5281992012,5cyclictest32671-21cron14:12:290
528199200,18cyclictest0-21swapper/010:28:240
5287991914,3cyclictest20213-21sh13:18:291
5287991913,3cyclictest10240-21ls13:07:441
528799191,15cyclictest29027-21grep14:42:441
5281991913,3cyclictest32160-21sh12:17:450
5281991912,4cyclictest25035-21gltestperf12:47:440
528199191,16cyclictest0-21swapper/014:30:500
528199190,17cyclictest0-21swapper/010:57:530
528799181,14cyclictest3025-21kworker/1:110:32:531
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional