You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 13:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Mon Dec 01, 2025 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
722621850,5sleep22049299cyclictest22:49:512
1773911780,5ptp4l401ktimersoftd/320:18:523
3113521590,5sleep32050199cyclictest21:47:453
82142840,5sleep18209-21apt-get23:27:321
177391810,1ptp4l401ktimersoftd/300:01:453
177391750,9ptp4l401ktimersoftd/322:53:213
177391730,9ptp4l401ktimersoftd/321:03:223
177391730,1ptp4l401ktimersoftd/321:33:373
177391720,1ptp4l401ktimersoftd/323:50:483
177391700,9ptp4l401ktimersoftd/300:15:353
177391700,9ptp4l401ktimersoftd/300:15:353
177391700,1ptp4l401ktimersoftd/323:31:133
177391650,1ptp4l401ktimersoftd/323:05:463
177391650,1ptp4l28246-21kworker/3:023:56:563
307842640,1sleep00-21swapper/021:47:380
20488996013,4cyclictest25-21ksoftirqd/122:52:351
177391590,1ptp4l401ktimersoftd/301:13:193
229892580,1sleep20-21swapper/222:32:172
177391580,1ptp4l401ktimersoftd/323:20:003
20488995723,4cyclictest25-21ksoftirqd/123:22:181
177391570,1ptp4l401ktimersoftd/301:07:563
216352560,2sleep20-21swapper/223:42:312
177391560,1ptp4l401ktimersoftd/300:56:573
177391560,1ptp4l401ktimersoftd/300:28:083
20488995511,10cyclictest25-21ksoftirqd/123:37:371
20483995527,4cyclictest9-21ksoftirqd/001:17:210
20483995523,4cyclictest9-21ksoftirqd/001:37:320
203532554,40sleep00-21swapper/020:21:520
20488995327,3cyclictest25-21ksoftirqd/100:17:341
20488995325,4cyclictest25-21ksoftirqd/123:37:191
20483995327,4cyclictest9-21ksoftirqd/022:42:340
20483995320,13cyclictest9-21ksoftirqd/000:00:100
177391530,2ptp4l11426-21kworker/3:222:37:503
20488995231,7cyclictest25-21ksoftirqd/101:22:301
20488995225,4cyclictest25-21ksoftirqd/122:42:461
20488995223,7cyclictest25-21ksoftirqd/101:02:371
20488995218,4cyclictest25-21ksoftirqd/123:08:311
20488995216,10cyclictest25-21ksoftirqd/120:27:431
20483995226,8cyclictest9-21ksoftirqd/020:27:330
20483995226,4cyclictest9-21ksoftirqd/022:57:360
20483995224,15cyclictest9-21ksoftirqd/001:27:470
20483995222,6cyclictest9-21ksoftirqd/001:22:300
2049299516,6cyclictest0-21swapper/223:17:352
20488995125,4cyclictest25-21ksoftirqd/100:52:351
20488995125,3cyclictest25-21ksoftirqd/123:57:411
20488995125,3cyclictest25-21ksoftirqd/122:57:361
2048399515,3cyclictest121rcu_preempt00:57:370
2048399512,7cyclictest9-21ksoftirqd/000:37:400
20483995127,3cyclictest9-21ksoftirqd/021:17:360
20483995125,4cyclictest9-21ksoftirqd/000:07:380
20483995125,4cyclictest9-21ksoftirqd/000:07:380
20483995125,3cyclictest9-21ksoftirqd/001:32:420
2048899501,7cyclictest31796-21munin-run21:52:151
2048399509,6cyclictest9-21ksoftirqd/021:12:380
20483995026,10cyclictest9-21ksoftirqd/023:07:500
20483995025,4cyclictest9-21ksoftirqd/022:26:580
20483995025,4cyclictest9-21ksoftirqd/022:26:580
20483995024,4cyclictest9-21ksoftirqd/023:56:090
20483995024,4cyclictest9-21ksoftirqd/023:27:430
20483995024,4cyclictest9-21ksoftirqd/022:02:160
20483995024,4cyclictest9-21ksoftirqd/021:52:340
20483995023,8cyclictest9-21ksoftirqd/022:12:350
20483995022,5cyclictest9-21ksoftirqd/023:06:290
2049299496,8cyclictest20696-21irqrtprio21:27:342
2049299496,6cyclictest3710-21sed23:57:382
2049299495,7cyclictest1591-21cpuspeed_turbos01:07:342
20488994932,3cyclictest25-21ksoftirqd/100:42:331
20488994924,3cyclictest25-21ksoftirqd/121:07:371
20488994924,3cyclictest25-21ksoftirqd/100:32:311
20483994938,4cyclictest9-21ksoftirqd/001:42:370
20483994925,4cyclictest9-21ksoftirqd/020:47:440
20483994925,3cyclictest9-21ksoftirqd/000:49:250
20483994923,4cyclictest9-21ksoftirqd/023:47:460
20483994921,13cyclictest9-21ksoftirqd/000:52:340
20483994911,4cyclictest9-21ksoftirqd/023:16:290
2049299484,7cyclictest16779-21ssh00:47:422
2048899488,9cyclictest25-21ksoftirqd/101:12:211
20488994823,3cyclictest25-21ksoftirqd/101:28:231
20488994822,3cyclictest25-21ksoftirqd/100:58:191
20488994822,3cyclictest25-21ksoftirqd/100:02:321
20488994814,9cyclictest25-21ksoftirqd/100:28:501
20483994838,3cyclictest9-21ksoftirqd/023:17:420
20483994836,4cyclictest9-21ksoftirqd/021:07:320
2048399482,7cyclictest9-21ksoftirqd/022:27:470
20483994824,4cyclictest9-21ksoftirqd/020:22:330
20483994823,4cyclictest9-21ksoftirqd/022:02:460
20483994823,4cyclictest9-21ksoftirqd/000:03:360
20483994822,4cyclictest9-21ksoftirqd/022:48:420
20483994822,4cyclictest9-21ksoftirqd/020:42:360
20483994822,4cyclictest9-21ksoftirqd/001:06:590
20483994822,4cyclictest9-21ksoftirqd/000:33:560
20483994820,4cyclictest9-21ksoftirqd/020:37:140
2048399481,8cyclictest23249-21apt-get22:32:280
177391480,2ptp4l11938-21kworker/3:001:48:353
2049299475,7cyclictest4795-21fschecks_time22:02:342
2049299474,7cyclictest13724-21cpuspeed_turbos22:57:312
2049299472,7cyclictest0-21swapper/200:17:412
2048899476,6cyclictest25-21ksoftirqd/100:12:431
2048899476,6cyclictest25-21ksoftirqd/100:12:431
2048899474,10cyclictest25-21ksoftirqd/123:55:581
20488994732,4cyclictest25-21ksoftirqd/101:36:011
20488994730,3cyclictest25-21ksoftirqd/123:23:211
2048899472,9cyclictest25-21ksoftirqd/123:12:481
20488994722,3cyclictest25-21ksoftirqd/121:12:291
20488994710,3cyclictest121rcu_preempt21:37:151
20483994737,3cyclictest9-21ksoftirqd/021:22:450
20483994724,3cyclictest9-21ksoftirqd/000:23:480
20483994723,3cyclictest9-21ksoftirqd/020:52:370
20483994722,4cyclictest9-21ksoftirqd/023:45:140
20483994722,4cyclictest9-21ksoftirqd/023:40:280
20483994722,4cyclictest9-21ksoftirqd/000:31:400
2049299466,7cyclictest4236-21cut22:02:162
2049299466,7cyclictest27961-21grep23:47:512
2049299464,12cyclictest22969-21munin-node20:27:172
20488994632,3cyclictest25-21ksoftirqd/122:22:301
20488994632,3cyclictest25-21ksoftirqd/122:22:301
20488994631,3cyclictest25-21ksoftirqd/100:12:191
20488994631,3cyclictest25-21ksoftirqd/100:12:191
20488994628,3cyclictest25-21ksoftirqd/122:34:591
20488994628,3cyclictest25-21ksoftirqd/101:50:471
20488994622,3cyclictest25-21ksoftirqd/100:39:031
2048399467,9cyclictest9-21ksoftirqd/022:12:160
2048399466,3cyclictest9-21ksoftirqd/000:17:350
20483994637,3cyclictest9-21ksoftirqd/021:27:420
20483994631,3cyclictest9-21ksoftirqd/023:37:040
20483994629,8cyclictest9-21ksoftirqd/020:37:280
20483994629,8cyclictest9-21ksoftirqd/020:37:280
20483994622,4cyclictest9-21ksoftirqd/000:45:000
20483994621,4cyclictest9-21ksoftirqd/023:22:310
20483994621,4cyclictest9-21ksoftirqd/001:51:020
20483994620,4cyclictest9-21ksoftirqd/022:17:390
20483994620,4cyclictest9-21ksoftirqd/021:42:470
20483994620,4cyclictest9-21ksoftirqd/021:42:160
177391460,1ptp4l401ktimersoftd/300:05:493
177391460,1ptp4l11938-21kworker/3:001:46:513
2049299456,6cyclictest19825-21ssh01:27:412
2048899454,8cyclictest25-21ksoftirqd/100:47:441
20488994530,3cyclictest25-21ksoftirqd/122:29:541
20488994528,3cyclictest25-21ksoftirqd/120:57:301
20488994519,10cyclictest25-21ksoftirqd/123:42:371
20488994512,6cyclictest25-21ksoftirqd/122:02:361
2048899450,8cyclictest25-21ksoftirqd/100:22:481
2048399456,8cyclictest9-21ksoftirqd/001:07:460
20483994532,3cyclictest9-21ksoftirqd/022:38:090
20483994530,3cyclictest9-21ksoftirqd/022:54:440
20483994522,3cyclictest9-21ksoftirqd/001:20:230
177391450,1ptp4l28246-21kworker/3:023:25:133
2049299444,7cyclictest17885-21snmp_o5powerctl00:12:442
2049299444,7cyclictest17885-21snmp_o5powerctl00:12:442
2049299442,7cyclictest3086-21sed00:32:402
2049299442,7cyclictest13825-21diskmemload23:07:272
2048899447,9cyclictest25-21ksoftirqd/101:12:351
2048899445,5cyclictest25-21ksoftirqd/120:22:341
2048899445,10cyclictest29211-21apt-get21:47:161
2048899443,3cyclictest121rcu_preempt21:37:451
2048899443,3cyclictest121rcu_preempt20:42:361
20488994429,4cyclictest25-21ksoftirqd/122:49:031
20488994429,3cyclictest25-21ksoftirqd/121:57:361
20488994429,3cyclictest25-21ksoftirqd/121:52:461
20488994428,3cyclictest25-21ksoftirqd/122:09:441
2048899441,9cyclictest25-21ksoftirqd/123:47:511
2048899440,7cyclictest25-21ksoftirqd/122:37:361
20483994437,4cyclictest9-21ksoftirqd/021:02:190
20483994422,3cyclictest9-21ksoftirqd/000:12:420
20483994422,3cyclictest9-21ksoftirqd/000:12:420
2049299434,7cyclictest6982-21cstates22:07:312
2049299433,7cyclictest4202-21cat01:47:372
2049299432,8cyclictest1160-21python01:42:472
2049299432,7cyclictest18144-21ssh01:27:202
2049299432,7cyclictest13825-21diskmemload23:56:422
2049299431,6cyclictest9608-21mailstats23:27:432
2048899437,9cyclictest25-21ksoftirqd/122:12:301
20488994337,3cyclictest241ktimersoftd/120:47:341
2048899433,10cyclictest25-21ksoftirqd/101:42:361
20488994328,3cyclictest25-21ksoftirqd/123:02:331
20488994327,3cyclictest25-21ksoftirqd/120:37:261
20488994327,3cyclictest25-21ksoftirqd/120:37:261
20488994327,3cyclictest25-21ksoftirqd/101:39:001
20488994310,7cyclictest121rcu_preempt01:19:341
2048899430,8cyclictest25-21ksoftirqd/120:32:301
2048899430,7cyclictest25-21ksoftirqd/122:17:341
177391430,8ptp4l401ktimersoftd/301:29:443
2049299426,5cyclictest33-21ksoftirqd/223:32:302
2049299422,6cyclictest29357-21acpi01:02:332
2049299421,7cyclictest28523-21irqrtprio01:37:402
2049299421,7cyclictest11850-21/usr/sbin/munin00:07:362
2049299421,7cyclictest11850-21/usr/sbin/munin00:07:362
20492994217,4cyclictest33-21ksoftirqd/200:23:362
2049299420,6cyclictest0-21swapper/200:37:392
2048899420,8cyclictest25-21ksoftirqd/121:17:321
2049299412,6cyclictest1355-21sed21:52:462
2049299411,6cyclictest29008-21latency_hist01:02:212
2049299410,6cyclictest31125-21sshd00:27:412
2048899417,7cyclictest25-21ksoftirqd/120:52:271
2048899416,3cyclictest25-21ksoftirqd/121:02:461
20483994125,5cyclictest9-21ksoftirqd/020:57:320
2049299404,6cyclictest33-21ksoftirqd/201:14:512
2049299404,5cyclictest33-21ksoftirqd/201:21:452
2049299403,5cyclictest33-21ksoftirqd/222:23:462
2049299403,5cyclictest33-21ksoftirqd/222:23:462
2049299402,7cyclictest1-21systemd21:16:362
2048899408,8cyclictest121rcu_preempt21:27:321
2048899403,6cyclictest121rcu_preempt21:22:311
20483994025,4cyclictest9-21ksoftirqd/021:32:460
2049299396,5cyclictest33-21ksoftirqd/222:45:312
2049299395,5cyclictest33-21ksoftirqd/223:40:532
2049299394,5cyclictest33-21ksoftirqd/201:34:462
2049299390,7cyclictest0-21swapper/221:17:332
177391390,0ptp4l401ktimersoftd/301:37:543
177391390,0ptp4l401ktimersoftd/300:49:343
2049299383,4cyclictest33-21ksoftirqd/223:24:422
20492993819,9cyclictest33-21ksoftirqd/222:17:442
20492993818,7cyclictest33-21ksoftirqd/223:12:432
177391380,1ptp4l401ktimersoftd/323:41:573
177391380,1ptp4l401ktimersoftd/322:52:083
177391380,1ptp4l401ktimersoftd/322:46:473
177391380,1ptp4l401ktimersoftd/322:33:273
177391380,1ptp4l401ktimersoftd/301:07:093
177391380,1ptp4l401ktimersoftd/300:19:173
177391380,1ptp4l401ktimersoftd/300:11:073
177391380,1ptp4l401ktimersoftd/300:11:073
177391380,0ptp4l401ktimersoftd/321:13:353
177391380,0ptp4l401ktimersoftd/301:20:493
2049299375,6cyclictest24500-21awk21:37:162
2049299374,6cyclictest9402-21grep22:12:292
2049299374,5cyclictest33-21ksoftirqd/200:44:012
177391370,1ptp4l401ktimersoftd/323:44:153
177391370,1ptp4l401ktimersoftd/301:01:383
177391370,1ptp4l401ktimersoftd/300:25:143
177391370,0ptp4l401ktimersoftd/322:23:073
177391370,0ptp4l401ktimersoftd/322:23:073
2049299366,5cyclictest33-21ksoftirqd/222:42:072
177391360,1ptp4l401ktimersoftd/300:45:363
177391360,1ptp4l401ktimersoftd/300:35:083
177391360,0ptp4l401ktimersoftd/321:38:113
2049299352,6cyclictest321ktimersoftd/222:52:462
2049299350,5cyclictest321ktimersoftd/200:56:352
177391350,2ptp4l11426-21kworker/3:222:59:213
177391350,1ptp4l401ktimersoftd/301:23:373
177391350,1ptp4l28246-21kworker/3:023:36:313
2049299341,6cyclictest321ktimersoftd/222:32:292
177391340,1ptp4l401ktimersoftd/320:59:533
20501993325,5cyclictest2895-21cron20:52:143
20488993327,3cyclictest241ktimersoftd/120:22:131
20492993213,8cyclictest33-21ksoftirqd/220:43:292
177391320,1ptp4l401ktimersoftd/322:31:563
177391320,1ptp4l401ktimersoftd/300:41:263
177391320,10ptp4l401ktimersoftd/322:05:263
177391320,0ptp4l401ktimersoftd/321:29:363
2049299313,5cyclictest33-21ksoftirqd/220:24:282
20492993127,2cyclictest311rcuc/220:52:542
177391310,1ptp4l401ktimersoftd/320:46:043
177391310,1ptp4l401ktimersoftd/320:33:093
177391310,0ptp4l401ktimersoftd/322:17:253
177391310,0ptp4l401ktimersoftd/321:59:583
2049299305,6cyclictest33-21ksoftirqd/200:05:142
20492993027,2cyclictest311rcuc/220:50:012
20492993026,2cyclictest311rcuc/221:40:592
20492993026,2cyclictest311rcuc/220:35:392
20492993011,7cyclictest33-21ksoftirqd/223:04:312
2049299300,8cyclictest321ktimersoftd/220:37:322
2049299300,8cyclictest321ktimersoftd/220:37:322
2049299300,6cyclictest28035-21irqstats21:42:362
177391300,1ptp4l401ktimersoftd/323:14:293
177391300,1ptp4l401ktimersoftd/323:10:403
177391300,1ptp4l401ktimersoftd/321:24:543
182512295,10sleep20-21swapper/220:17:262
177391290,1ptp4l401ktimersoftd/321:22:133
20501992821,4cyclictest41-21ksoftirqd/320:22:473
2049299285,8cyclictest33-21ksoftirqd/221:11:272
20492992814,4cyclictest33-21ksoftirqd/221:05:522
177391280,1ptp4l401ktimersoftd/322:10:313
20501992720,4cyclictest41-21ksoftirqd/320:41:413
20501992720,4cyclictest41-21ksoftirqd/320:41:413
20492992722,3cyclictest33-21ksoftirqd/221:22:352
20492992722,3cyclictest33-21ksoftirqd/220:57:312
177391270,1ptp4l401ktimersoftd/321:07:353
20501992619,4cyclictest41-21ksoftirqd/321:42:523
20501992519,4cyclictest41-21ksoftirqd/320:56:513
20501992519,3cyclictest41-21ksoftirqd/320:27:593
20492992521,2cyclictest311rcuc/221:47:442
177391250,1ptp4l401ktimersoftd/321:52:303
177391250,0ptp4l401ktimersoftd/322:14:043
177391240,1ptp4l401ktimersoftd/301:32:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional