You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 10:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Wed Nov 26, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1589723110,3sleep00-21swapper/020:14:490
3269821560,5sleep11700599cyclictest01:14:511
177391980,4ptp4l401ktimersoftd/320:17:223
85042840,3sleep0101ktimersoftd/021:04:500
198322830,4sleep219834-21gltestperf21:29:452
44282640,3sleep20-21swapper/200:04:462
251562620,3sleep30-21swapper/301:44:523
224232570,2sleep20-21swapper/200:24:532
1687025635,9sleep10-21swapper/120:19:031
240452520,1sleep224043-21sh01:43:422
1700599522,13cyclictest25165-21sed01:05:031
1700599522,13cyclictest25165-21sed01:05:031
314092510,2sleep00-21swapper/001:13:450
314092510,2sleep00-21swapper/001:13:450
1700599502,13cyclictest23396-21taskset23:09:561
10752500,2sleep30-21swapper/300:38:473
167412494,32sleep20-21swapper/220:17:232
127722490,1sleep30-21swapper/321:14:453
22032440,19sleep2321ktimersoftd/200:39:472
1700599441,18cyclictest20218-21/usr/sbin/munin20:24:441
17005994333,6cyclictest25-21ksoftirqd/101:39:461
17015994118,20cyclictest24432-21munin-run01:44:353
1700599417,5cyclictest25-21ksoftirqd/121:35:461
1700599417,5cyclictest25-21ksoftirqd/121:35:461
1700599414,5cyclictest0-21swapper/122:22:531
1700599413,6cyclictest0-21swapper/122:39:391
1700599400,14cyclictest8464-21ssh00:45:561
1700599391,8cyclictest6244-21snmp_o5powerctl20:59:531
29992380,2sleep00-21swapper/000:39:530
177391380,1ptp4l401ktimersoftd/323:51:553
177391380,1ptp4l401ktimersoftd/323:45:283
177391380,1ptp4l401ktimersoftd/323:35:083
177391380,1ptp4l401ktimersoftd/323:34:243
177391380,1ptp4l401ktimersoftd/322:40:443
177391380,1ptp4l401ktimersoftd/322:23:333
177391380,1ptp4l401ktimersoftd/301:13:523
177391380,1ptp4l401ktimersoftd/301:13:523
177391380,1ptp4l401ktimersoftd/300:34:193
1701599383,29cyclictest12840-21ssh01:29:473
17015993816,19cyclictest2195-21tr00:39:473
87782370,1sleep10-21swapper/100:09:471
177391370,1ptp4l401ktimersoftd/323:54:353
177391370,1ptp4l401ktimersoftd/322:54:493
177391370,1ptp4l401ktimersoftd/322:50:243
177391370,1ptp4l401ktimersoftd/322:33:513
177391370,1ptp4l401ktimersoftd/321:45:213
177391370,1ptp4l401ktimersoftd/301:37:363
177391370,1ptp4l401ktimersoftd/301:24:363
177391370,1ptp4l401ktimersoftd/301:05:473
177391370,1ptp4l401ktimersoftd/301:05:473
177391370,1ptp4l401ktimersoftd/300:11:213
177391370,1ptp4l401ktimersoftd/300:09:233
177391370,0ptp4l401ktimersoftd/323:11:123
177391360,1ptp4l401ktimersoftd/323:14:473
177391360,1ptp4l401ktimersoftd/321:56:133
177391360,1ptp4l401ktimersoftd/320:42:583
177391360,1ptp4l401ktimersoftd/300:29:173
177391360,1ptp4l401ktimersoftd/300:22:483
177391360,1ptp4l401ktimersoftd/300:14:373
177391360,1ptp4l401ktimersoftd/300:03:233
177391360,0ptp4l401ktimersoftd/323:28:523
177391360,0ptp4l401ktimersoftd/301:15:293
1701599353,5cyclictest0-21swapper/321:04:403
1701199353,2cyclictest121rcu_preempt23:19:532
1701199353,2cyclictest121rcu_preempt23:19:532
1700599357,5cyclictest25-21ksoftirqd/101:37:101
1700599357,5cyclictest25-21ksoftirqd/100:35:561
1701599349,4cyclictest1322-21cat21:59:443
1701599342,6cyclictest0-21swapper/320:29:393
17015993412,19cyclictest17439-21sh23:41:013
17015993410,4cyclictest14978-21fschecks_time21:19:493
1701199343,3cyclictest121rcu_preempt22:55:012
1701199341,3cyclictest121rcu_preempt21:14:282
177391330,0ptp4l401ktimersoftd/301:00:253
1701599338,3cyclictest2199-21cat20:54:293
1701599336,4cyclictest22459-21ls20:29:283
17015993312,18cyclictest932-21sh23:22:123
17015993312,18cyclictest932-21sh23:22:123
17015993312,18cyclictest20686-21sh23:07:393
17015993311,4cyclictest15845-21cat00:54:533
17011993329,2cyclictest33-21ksoftirqd/201:39:352
17011993327,3cyclictest33-21ksoftirqd/201:44:502
17011993325,6cyclictest33-21ksoftirqd/223:44:502
1701599329,3cyclictest19041-21sh22:28:573
1701599328,3cyclictest17365-21tune2fs21:24:463
1701599326,6cyclictest19711-21fschecks_time21:29:453
1701599321,11cyclictest7301-21grep00:44:543
17015993210,4cyclictest13619-21sh00:52:463
1700599326,6cyclictest25-21ksoftirqd/122:24:521
1700599324,10cyclictest4941-21apt-get22:49:441
1700599323,17cyclictest13502-21awk22:59:461
1700599323,15cyclictest11939-21snmp_o5powerctl00:49:581
1701599316,4cyclictest30506-21cat20:44:473
1701599311,9cyclictest2650-21tr20:54:423
17015993110,3cyclictest401ktimersoftd/301:19:553
17011993124,4cyclictest33-21ksoftirqd/220:34:412
17011993118,8cyclictest33-21ksoftirqd/222:24:422
1700599313,16cyclictest14232-21/usr/sbin/munin01:29:591
17005993124,4cyclictest25-21ksoftirqd/100:18:301
1700599312,17cyclictest10569-21diskmemload23:42:301
1701599309,3cyclictest27075-21sh22:36:473
1701599308,3cyclictest8602-21cpuspeed_turbos22:14:433
1701599307,3cyclictest5557-21irqrtprio20:59:473
1701599306,4cyclictest23033-21grep21:34:533
1701599306,4cyclictest23033-21grep21:34:533
1701599303,6cyclictest3743-21apt22:04:433
17011993025,3cyclictest33-21ksoftirqd/223:54:502
17011993025,3cyclictest33-21ksoftirqd/223:34:502
17011993025,3cyclictest33-21ksoftirqd/200:29:482
17011993024,3cyclictest33-21ksoftirqd/223:49:532
17011993024,3cyclictest33-21ksoftirqd/222:04:302
1700599303,15cyclictest27597-21phc2sys-jitter21:44:531
1700599303,14cyclictest1209-21proc_pri23:59:521
1700599303,10cyclictest25442-21snmp_o5powerctl21:39:551
17001993024,4cyclictest9-21ksoftirqd/000:45:070
17001993024,3cyclictest9-21ksoftirqd/022:09:300
1701599295,3cyclictest30215-21wc21:49:573
1701599291,6cyclictest1692-21/usr/sbin/munin22:44:543
17011992924,3cyclictest33-21ksoftirqd/201:09:572
17011992924,3cyclictest33-21ksoftirqd/201:09:572
17011992923,3cyclictest24011-21kworker/2:201:29:462
1700599292,14cyclictest11856-21ssh22:56:481
1700599291,16cyclictest10569-21diskmemload00:32:331
17001992924,3cyclictest9-21ksoftirqd/020:54:510
17001992924,3cyclictest9-21ksoftirqd/001:24:340
17001992924,3cyclictest9-21ksoftirqd/000:34:330
17001992923,3cyclictest9-21ksoftirqd/022:44:320
17001992923,3cyclictest9-21ksoftirqd/020:44:430
17001992923,3cyclictest9-21ksoftirqd/020:24:280
17011992823,3cyclictest33-21ksoftirqd/222:41:182
17011992823,3cyclictest33-21ksoftirqd/222:09:502
17011992822,3cyclictest33-21ksoftirqd/222:29:522
17011992821,4cyclictest33-21ksoftirqd/221:46:352
17011992821,4cyclictest33-21ksoftirqd/221:14:472
17011992821,4cyclictest33-21ksoftirqd/200:20:082
1700599287,5cyclictest25-21ksoftirqd/123:36:591
1700599286,6cyclictest0-21swapper/121:19:501
1700599282,6cyclictest25-21ksoftirqd/122:34:421
1700599282,5cyclictest0-21swapper/123:24:571
17005992823,3cyclictest25-21ksoftirqd/122:34:261
17005992816,7cyclictest2056-21apt-get00:39:451
17005992815,6cyclictest28065-21apt-get23:54:431
17001992823,3cyclictest9-21ksoftirqd/000:34:530
17001992823,3cyclictest9-21ksoftirqd/000:09:330
17001992822,4cyclictest9-21ksoftirqd/001:42:520
17001992822,3cyclictest9-21ksoftirqd/023:39:500
17001992821,5cyclictest9-21ksoftirqd/001:14:460
17001992821,4cyclictest9-21ksoftirqd/021:40:510
1701599277,4cyclictest26680-21switchtime20:34:573
17015992720,4cyclictest41-21ksoftirqd/321:14:003
17011992722,3cyclictest33-21ksoftirqd/201:19:342
17011992722,3cyclictest33-21ksoftirqd/200:56:132
17011992722,3cyclictest33-21ksoftirqd/200:39:332
17011992721,3cyclictest33-21ksoftirqd/221:54:492
17011992721,3cyclictest33-21ksoftirqd/201:24:532
17011992720,5cyclictest33-21ksoftirqd/223:09:502
17011992720,4cyclictest33-21ksoftirqd/220:52:482
17011992716,6cyclictest33-21ksoftirqd/220:54:402
1700599272,9cyclictest10498-21ssh01:25:131
17005992722,3cyclictest25-21ksoftirqd/122:04:461
17005992721,3cyclictest25-21ksoftirqd/121:55:581
1700599272,12cyclictest4946-21cat00:04:501
17005992717,7cyclictest23428-21ssh00:25:251
17001992722,3cyclictest9-21ksoftirqd/023:24:500
17001992722,3cyclictest9-21ksoftirqd/021:04:280
17001992722,3cyclictest9-21ksoftirqd/001:04:330
17001992722,3cyclictest9-21ksoftirqd/000:49:480
17001992722,3cyclictest9-21ksoftirqd/000:24:530
17001992721,3cyclictest9-21ksoftirqd/023:04:500
17001992721,3cyclictest9-21ksoftirqd/022:44:460
17001992721,3cyclictest9-21ksoftirqd/001:29:340
17001992720,4cyclictest9-21ksoftirqd/022:16:480
17001992720,4cyclictest9-21ksoftirqd/020:30:020
17001992720,4cyclictest9-21ksoftirqd/020:25:120
1701599267,4cyclictest18566-21sendmail_mailtr20:19:523
17015992620,3cyclictest41-21ksoftirqd/323:03:373
17015992620,3cyclictest41-21ksoftirqd/321:43:163
17011992621,3cyclictest33-21ksoftirqd/223:59:432
17011992621,3cyclictest33-21ksoftirqd/222:15:342
17011992621,3cyclictest33-21ksoftirqd/221:43:122
17011992621,3cyclictest33-21ksoftirqd/220:44:432
17011992621,3cyclictest33-21ksoftirqd/220:24:442
17011992621,3cyclictest33-21ksoftirqd/200:54:332
17011992620,4cyclictest33-21ksoftirqd/220:42:162
17011992620,4cyclictest33-21ksoftirqd/220:20:202
17011992620,3cyclictest33-21ksoftirqd/221:36:282
17011992620,3cyclictest33-21ksoftirqd/221:36:282
17011992620,3cyclictest33-21ksoftirqd/221:19:512
17011992620,3cyclictest33-21ksoftirqd/200:48:592
17011992619,4cyclictest33-21ksoftirqd/221:50:452
17011992618,5cyclictest23459-21apt-get01:04:472
17011992618,5cyclictest23459-21apt-get01:04:472
1700599269,5cyclictest25-21ksoftirqd/123:20:021
1700599269,5cyclictest25-21ksoftirqd/123:20:021
17005992621,3cyclictest25-21ksoftirqd/123:05:511
17005992619,4cyclictest25-21ksoftirqd/121:54:091
17005992614,8cyclictest23755-21rm23:49:461
1700599260,6cyclictest25-21ksoftirqd/101:02:261
17001992621,3cyclictest9-21ksoftirqd/023:15:030
17001992621,3cyclictest9-21ksoftirqd/023:14:310
17001992621,3cyclictest9-21ksoftirqd/022:54:490
17001992621,3cyclictest9-21ksoftirqd/022:34:480
17001992621,3cyclictest9-21ksoftirqd/021:44:500
17001992621,3cyclictest9-21ksoftirqd/021:34:290
17001992621,3cyclictest9-21ksoftirqd/000:55:070
17001992620,3cyclictest9-21ksoftirqd/000:14:540
17001992619,4cyclictest9-21ksoftirqd/022:01:510
17001992619,4cyclictest9-21ksoftirqd/021:54:400
17001992619,4cyclictest9-21ksoftirqd/021:15:220
1562522619,3sleep09-21ksoftirqd/001:32:450
17011992521,2cyclictest33-21ksoftirqd/223:44:322
17011992519,4cyclictest33-21ksoftirqd/222:53:202
1700599257,14cyclictest10569-21diskmemload00:20:041
1700599253,8cyclictest19725-21df_inode23:44:471
1700599252,13cyclictest14836-21ssh00:54:461
17005992520,3cyclictest25-21ksoftirqd/120:34:431
17005992519,4cyclictest25-21ksoftirqd/122:45:121
17005992519,3cyclictest25-21ksoftirqd/122:18:241
17005992518,4cyclictest25-21ksoftirqd/121:04:311
17001992520,3cyclictest9-21ksoftirqd/023:34:320
17001992520,3cyclictest9-21ksoftirqd/023:19:530
17001992520,3cyclictest9-21ksoftirqd/023:19:530
17001992520,3cyclictest9-21ksoftirqd/021:34:480
17001992520,3cyclictest9-21ksoftirqd/021:34:480
17001992520,3cyclictest9-21ksoftirqd/021:24:430
17001992520,3cyclictest18163-1kworker/u9:123:53:120
17001992519,3cyclictest9-21ksoftirqd/020:37:560
17001992519,3cyclictest9-21ksoftirqd/001:34:540
17001992519,3cyclictest9-21ksoftirqd/001:09:010
17001992519,3cyclictest9-21ksoftirqd/001:09:010
17001992518,4cyclictest9-21ksoftirqd/021:53:560
177391240,1ptp4l401ktimersoftd/322:09:513
17011992419,3cyclictest33-21ksoftirqd/223:25:192
17011992419,3cyclictest33-21ksoftirqd/221:04:472
17011992419,3cyclictest33-21ksoftirqd/220:59:422
17011992418,3cyclictest33-21ksoftirqd/222:22:012
17011992417,4cyclictest9116-21sed00:09:502
17011992417,4cyclictest33-21ksoftirqd/222:44:522
1700599249,10cyclictest0-21swapper/101:09:511
1700599249,10cyclictest0-21swapper/101:09:511
1700599248,11cyclictest0-21swapper/120:44:421
17005992417,4cyclictest25-21ksoftirqd/120:31:351
17005992411,7cyclictest6665-21apt-get23:29:451
1700599240,5cyclictest25-21ksoftirqd/123:19:241
17001992419,3cyclictest9-21ksoftirqd/023:59:470
17001992419,3cyclictest9-21ksoftirqd/023:57:100
17001992419,3cyclictest9-21ksoftirqd/023:44:500
17001992419,3cyclictest9-21ksoftirqd/022:09:500
17001992418,3cyclictest9-21ksoftirqd/023:03:260
17001992418,3cyclictest9-21ksoftirqd/022:24:490
17011992318,3cyclictest33-21ksoftirqd/223:09:312
17011992318,3cyclictest33-21ksoftirqd/222:04:592
17011992318,3cyclictest33-21ksoftirqd/200:14:542
1700599239,10cyclictest0-21swapper/101:19:481
1700599237,11cyclictest0-21swapper/122:09:431
1700599235,8cyclictest26266-21sed01:45:071
1700599232,4cyclictest0-21swapper/121:24:441
17005992318,3cyclictest25-21ksoftirqd/120:39:441
17005992316,4cyclictest25-21ksoftirqd/120:21:481
17001992318,3cyclictest9-21ksoftirqd/023:34:500
17001992318,3cyclictest9-21ksoftirqd/021:19:460
17001992317,3cyclictest9-21ksoftirqd/021:12:280
17001992317,3cyclictest9-21ksoftirqd/000:24:340
17001992316,4cyclictest9-21ksoftirqd/020:50:090
17011992217,3cyclictest33-21ksoftirqd/223:29:522
17011992217,3cyclictest33-21ksoftirqd/222:34:452
17011992217,3cyclictest33-21ksoftirqd/201:19:512
1700599222,5cyclictest0-21swapper/120:54:301
17005992216,4cyclictest25-21ksoftirqd/121:13:581
17005992215,4cyclictest25-21ksoftirqd/122:02:241
17001992217,3cyclictest9-21ksoftirqd/000:13:040
17001992216,3cyclictest9-21ksoftirqd/022:19:500
17001992213,7cyclictest9-21ksoftirqd/001:49:350
17011992116,3cyclictest33-21ksoftirqd/223:04:312
17011992115,4cyclictest33-21ksoftirqd/221:27:002
17005992114,4cyclictest25-21ksoftirqd/120:54:031
17005992111,7cyclictest13085-21sed21:14:471
17001992116,3cyclictest9-21ksoftirqd/022:34:310
17001992114,4cyclictest29251-21sed20:39:580
17011992013,4cyclictest28033-21unixbench_multi23:15:032
1700599208,8cyclictest19823-21head21:29:451
17001992014,3cyclictest10569-21diskmemload22:49:480
17011991914,3cyclictest33-21ksoftirqd/220:32:402
17011991912,4cyclictest19000-21/usr/sbin/munin00:59:502
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional