You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 19:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Thu Sep 24, 2026 12:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
253139910531049,3cyclictest27309-21turbostat10:49:553
253069910451043,2cyclictest23631-21kworker/1:0+events12:32:341
252989910451044,1cyclictest9599-21kworker/0:1+events07:57:380
252989910431040,3cyclictest29665-21turbostat08:44:550
252989910361035,1cyclictest21008-21kworker/0:0+events07:30:540
253139910351034,1cyclictest1839-21kworker/3:1+events11:37:013
253069910331031,2cyclictest13005-21kworker/1:1+events12:22:141
252989910331032,1cyclictest14744-21kworker/0:2+events08:28:190
252989910331032,1cyclictest14744-21kworker/0:2+events08:28:190
253139910321030,2cyclictest25599-21kworker/3:2+events10:06:263
253109910291028,1cyclictest26443-21kworker/2:1+events11:22:012
253139910271026,1cyclictest7473-21kworker/3:1+events09:11:153
253139910241022,2cyclictest9520-21kworker/3:0+events11:30:223
253139910211020,1cyclictest9520-21kworker/3:0+events09:23:153
253069910201018,2cyclictest21278-21turbostat11:19:551
253069910191017,2cyclictest1020-21kworker/1:0+events09:38:061
253139910181016,2cyclictest31660-21kworker/3:1+events08:54:363
252989910161013,3cyclictest5005-21turbostat07:44:550
253139910131010,3cyclictest27635-21turbostat08:39:553
253139910121011,1cyclictest9520-21kworker/3:0+events10:26:073
253139910111009,2cyclictest4454-21turbostat12:14:553
253109910111010,1cyclictest25002-21kworker/2:2+events10:45:212
253069910111007,2cyclictest18235-21kworker/1:2+events12:26:301
252989910101008,2cyclictest19268-21kworker/0:1+pm08:24:340
253069910091006,1cyclictest13005-21kworker/1:1+events12:37:341
253069910061005,1cyclictest18775-21kworker/1:1+events09:32:341
253139910041003,1cyclictest17572-21kworker/3:0+events12:01:073
253109910011000,1cyclictest8232-21kworker/2:2+events09:52:532
2529899997994,3cyclictest6643-21turbostat11:39:550
2531399995994,1cyclictest7473-21kworker/3:1+events09:18:333
2531099995994,1cyclictest26443-21kworker/2:1+events11:28:402
2531099995994,1cyclictest14243-21kworker/2:1+events10:59:372
2529899994993,1cyclictest22078-21kworker/0:2+events11:17:010
2531099993992,1cyclictest14243-21kworker/2:1+events10:30:442
2531099993992,1cyclictest13955-21kworker/2:0+events10:37:142
2531399990988,2cyclictest13081-21kworker/3:2+events11:42:003
2529899990989,1cyclictest14744-21kworker/0:2+events08:07:570
2529899983981,2cyclictest21008-21kworker/0:0+events07:39:440
2531399982980,2cyclictest9520-21kworker/3:0+events10:24:223
2531099982979,3cyclictest20681-21turbostat10:04:562
2531099966965,1cyclictest26443-21kworker/2:1+events12:16:462
2531399961960,1cyclictest22188-21kworker/3:1+events11:52:333
2529899961959,2cyclictest1301-21turbostat10:19:550
2530699948946,2cyclictest31682-21turbostat08:49:551
2531399945944,1cyclictest32231-21kworker/3:1+events12:08:473
2531399945942,1cyclictest9520-21kworker/3:0+events09:29:143
2531399944943,1cyclictest9520-21kworker/3:0+events10:12:543
2531399944943,1cyclictest5412-21kworker/3:0+events08:59:133
2531399944943,1cyclictest31660-21kworker/3:1+events08:46:273
2531399941940,1cyclictest25599-21kworker/3:2+events10:16:053
2531399938937,1cyclictest17572-21kworker/3:0+events11:58:163
2531099937935,2cyclictest9922-21kworker/2:3+events11:05:322
2531099936935,1cyclictest25002-21kworker/2:2+events10:41:072
2531399935935,0cyclictest5412-21kworker/3:0+events09:00:223
2531399935934,1cyclictest8800-21kworker/3:0+events07:47:433
2531099935935,0cyclictest8232-21kworker/2:2+events09:58:052
2529899935934,1cyclictest29700-21kworker/0:1+events07:25:220
2531399933932,1cyclictest13081-21kworker/3:2+events11:47:113
2531099932931,1cyclictest1771-21kworker/2:2+events11:00:222
2529899932931,1cyclictest19268-21kworker/0:1+events08:37:210
2531099929926,1cyclictest8232-21kworker/2:2+events09:47:422
2529899929928,1cyclictest21008-21kworker/0:0+events07:52:440
2529899928927,1cyclictest14744-21kworker/0:2+events08:30:230
2531099927926,1cyclictest3259-21kworker/2:0+events09:42:102
2531399926925,1cyclictest8453-21kworker/3:2+events09:05:213
2531099925924,1cyclictest26961-21kworker/2:0+events07:12:132
2529899925924,1cyclictest9599-21kworker/0:1+events08:02:570
2529899924923,1cyclictest16922-21kworker/0:1+events11:11:590
2529899923922,1cyclictest14744-21kworker/0:2+events08:18:180
2531099922921,1cyclictest26961-21kworker/2:0+events07:18:072
2529899922921,1cyclictest19268-21kworker/0:1+events08:14:020
2531099919918,1cyclictest16860-21kworker/2:2+events08:42:232
2531099917916,1cyclictest14243-21kworker/2:1+events10:51:062
2529899917916,1cyclictest29700-21kworker/0:1+events07:24:210
2531399916914,2cyclictest3568-21turbostat10:59:553
2531399903901,2cyclictest27244-21turbostat07:19:553
2531099902900,2cyclictest1296-21turbostat08:54:552
2530699899897,2cyclictest9785-21turbostat09:14:541
2531399883881,2cyclictest31412-21turbostat09:39:553
2530699882880,2cyclictest29989-21turbostat11:29:551
2530699868864,4cyclictest22818-21turbostat09:29:551
2531399867866,1cyclictest12692-21turbostat11:09:553
2531399857855,2cyclictest26054-21turbostat12:39:553
2531099855852,3cyclictest3740-21turbostat08:59:552
2529899644641,3cyclictest27244-21turbostat07:19:550
2529899632630,2cyclictest7033-21turbostat07:49:550
2531099631628,2cyclictest31412-21turbostat09:39:552
2531399611609,2cyclictest29665-21turbostat08:44:553
2529899607605,2cyclictest12692-21turbostat11:09:550
2531399584583,1cyclictest5005-21turbostat07:44:553
2531399571570,1cyclictest29989-21turbostat11:29:553
2531099557555,2cyclictest4454-21turbostat12:14:552
2531099556555,1cyclictest27635-21turbostat08:39:552
2531099552551,1cyclictest9982-21turbostat10:29:552
2531399544543,1cyclictest20681-21turbostat10:04:563
2530699533531,2cyclictest8760-21turbostat12:19:551
2531099502499,3cyclictest21278-21turbostat11:19:552
25306991918,1cyclictest67750irq/123-lan12:14:141
25306991918,1cyclictest67750irq/123-lan12:00:131
25306991918,1cyclictest67750irq/123-lan11:55:111
25306991918,1cyclictest67750irq/123-lan10:11:041
25306991818,0cyclictest784-21snmpd10:53:271
25306991818,0cyclictest67750irq/123-lan11:53:001
25306991818,0cyclictest67750irq/123-lan11:34:251
25306991818,0cyclictest67750irq/123-lan11:21:351
25306991818,0cyclictest67750irq/123-lan10:29:061
25306991818,0cyclictest67750irq/123-lan10:20:361
25306991818,0cyclictest67750irq/123-lan09:54:231
25306991817,1cyclictest67750irq/123-lan10:42:401
25306991817,1cyclictest67750irq/123-lan10:35:151
25306991817,1cyclictest67750irq/123-lan10:00:211
25306991817,1cyclictest67750irq/123-lan09:55:131
25306991817,1cyclictest67750irq/123-lan09:49:261
25306991817,1cyclictest67750irq/123-lan07:35:141
25306991717,0cyclictest784-21snmpd09:01:261
25306991717,0cyclictest784-21snmpd08:51:201
25306991717,0cyclictest67750irq/123-lan12:07:451
25306991717,0cyclictest67750irq/123-lan11:48:331
25306991717,0cyclictest67750irq/123-lan11:13:291
25306991717,0cyclictest67750irq/123-lan11:05:161
25306991717,0cyclictest67750irq/123-lan10:55:011
25306991717,0cyclictest67750irq/123-lan10:06:311
25306991717,0cyclictest67750irq/123-lan09:21:121
25306991717,0cyclictest67750irq/123-lan09:16:391
25306991716,1cyclictest67750irq/123-lan11:35:151
25306991716,1cyclictest67750irq/123-lan10:49:331
25306991716,1cyclictest67750irq/123-lan08:40:131
25306991716,1cyclictest67750irq/123-lan08:10:201
25306991716,1cyclictest67750irq/123-lan08:01:301
25306991616,0cyclictest8472-21cat09:05:151
25306991616,0cyclictest67750irq/123-lan11:03:231
25306991616,0cyclictest67750irq/123-lan10:30:151
25306991616,0cyclictest67750irq/123-lan10:15:271
25306991616,0cyclictest67750irq/123-lan09:41:001
25306991616,0cyclictest67750irq/123-lan08:26:131
25306991616,0cyclictest67750irq/123-lan08:26:131
25306991616,0cyclictest67750irq/123-lan07:50:191
25306991616,0cyclictest67750irq/123-lan07:40:181
25306991615,1cyclictest67750irq/123-lan08:58:391
25306991515,0cyclictest67750irq/123-lan08:05:101
25306991515,0cyclictest67750irq/123-lan07:23:131
25306991515,0cyclictest1020-21kworker/1:0+events_freezable11:40:091
25306991514,1cyclictest67750irq/123-lan07:45:171
25306991414,0cyclictest67750irq/123-lan08:35:131
25306991414,0cyclictest67750irq/123-lan08:30:171
25306991414,0cyclictest67750irq/123-lan08:24:231
25306991414,0cyclictest67750irq/123-lan08:19:141
25306991414,0cyclictest67750irq/123-lan07:10:151
25306991212,0cyclictest18775-21kworker/1:1+events_freezable07:56:491
25306991212,0cyclictest18775-21kworker/1:1+events_freezable07:30:191
25306991212,0cyclictest18775-21kworker/1:1+events_freezable07:25:141
25306991110,1cyclictest67750irq/123-lan07:15:181
253139999,0cyclictest526-21avahi-daemon08:04:143
253109998,1cyclictest784-21snmpd10:10:222
253109998,1cyclictest782-21lldpd07:35:352
253109998,1cyclictest20566-21ntp_kernel_pll_08:15:152
253139988,0cyclictest782-21lldpd12:26:403
253139987,1cyclictest784-21snmpd07:33:293
253139987,1cyclictest782-21lldpd09:41:383
253109988,0cyclictest784-21snmpd12:20:412
253109988,0cyclictest784-21snmpd08:29:522
253109988,0cyclictest784-21snmpd08:29:522
253109988,0cyclictest782-21lldpd08:20:572
253109988,0cyclictest782-21lldpd07:46:132
253109988,0cyclictest782-21lldpd07:27:092
253109987,1cyclictest784-21snmpd07:42:062
253109987,1cyclictest784-21snmpd07:20:592
253109987,1cyclictest782-21lldpd09:06:242
253109987,1cyclictest574-21rs:main2
253109986,2cyclictest784-21snmpd11:54:322
253109986,2cyclictest784-21snmpd07:52:452
252989987,1cyclictest762-21ntpd10:29:280
252989986,2cyclictest784-21snmpd11:40:410
252989986,2cyclictest784-21snmpd10:05:490
252989986,2cyclictest784-21snmpd08:54:480
253139977,0cyclictest784-21snmpd12:30:133
253139977,0cyclictest782-21lldpd12:20:353
253139977,0cyclictest782-21lldpd09:31:283
253139977,0cyclictest526-21avahi-daemon10:51:413
253139977,0cyclictest526-21avahi-daemon07:26:503
253139976,1cyclictest784-21snmpd09:56:403
253139976,1cyclictest782-21lldpd09:48:373
253139975,2cyclictest784-21snmpd11:20:343
253139975,2cyclictest784-21snmpd08:23:343
253139975,2cyclictest784-21snmpd07:38:023
253139975,2cyclictest784-21snmpd07:10:083
253139974,3cyclictest547-21NetworkManager10:34:523
253139974,2cyclictest245-20systemd-journal11:16:393
253139973,3cyclictest20108-21fw_packets08:15:123
253109977,0cyclictest784-21snmpd11:48:572
253109977,0cyclictest782-21lldpd11:12:152
253109977,0cyclictest782-21lldpd10:23:252
253109977,0cyclictest782-21lldpd10:08:532
253109977,0cyclictest782-21lldpd09:28:372
253109976,1cyclictest784-21snmpd11:59:482
253109976,1cyclictest784-21snmpd07:57:302
253109975,2cyclictest784-21snmpd08:10:092
253109975,2cyclictest784-21snmpd08:02:092
252989977,0cyclictest784-21snmpd11:01:570
252989977,0cyclictest784-21snmpd10:35:470
252989977,0cyclictest784-21snmpd10:22:060
252989977,0cyclictest784-21snmpd09:13:070
252989977,0cyclictest784-21snmpd09:00:050
252989977,0cyclictest782-21lldpd09:48:420
252989976,1cyclictest784-21snmpd10:51:390
252989976,1cyclictest784-21snmpd10:30:320
252989975,2cyclictest784-21snmpd12:21:310
252989975,2cyclictest784-21snmpd10:56:370
252989975,2cyclictest784-21snmpd10:46:060
252989975,2cyclictest20382-21cat11:50:140
252989973,3cyclictest15766-21diskstats11:45:110
253139966,0cyclictest784-21snmpd12:16:103
253139966,0cyclictest782-21lldpd09:50:253
253139966,0cyclictest782-21lldpd07:50:173
253139966,0cyclictest574-21rs:main3
253139965,1cyclictest526-21avahi-daemon11:10:123
253139965,1cyclictest526-21avahi-daemon10:37:213
253139964,2cyclictest784-21snmpd08:12:073
253139962,3cyclictest12151-21ssh11:04:013
253109966,0cyclictest784-21snmpd09:16:212
253109966,0cyclictest784-21snmpd08:33:312
253109965,1cyclictest526-21avahi-daemon11:40:272
253109964,2cyclictest1621-21cat07:30:132
253109963,3cyclictest6586-21memory09:00:172
253109962,3cyclictest4270-21ssh12:09:412
252989966,0cyclictest784-21snmpd09:43:370
252989966,0cyclictest782-21lldpd12:32:120
252989966,0cyclictest782-21lldpd12:15:060
252989966,0cyclictest526-21avahi-daemon10:40:170
252989965,1cyclictest784-21snmpd09:38:360
252989965,1cyclictest782-21lldpd11:27:180
252989965,1cyclictest24645-21gltestperf11:55:120
252989964,2cyclictest784-21snmpd09:06:530
252989964,2cyclictest784-21snmpd08:58:590
252989964,2cyclictest547-21NetworkManager10:10:420
252989963,2cyclictest4297-21ssh11:30:400
252989963,2cyclictest245-20systemd-journal09:52:240
252989963,2cyclictest21540-21ssh09:22:380
252989962,3cyclictest18686-21ssh09:56:190
253139954,1cyclictest24135-21ntp_kernel_pll_10:40:163
253139952,3cyclictest23924-21grep08:25:113
253139952,3cyclictest23924-21grep08:25:113
253139951,4cyclictest547-21NetworkManager08:06:243
253109954,1cyclictest782-21lldpd09:12:382
253109954,1cyclictest526-21avahi-daemon12:35:312
253109954,1cyclictest507-21systemd-resolve12:32:432
253109954,1cyclictest421ktimers/211:30:312
253109953,2cyclictest784-21snmpd08:07:032
253109952,2cyclictest7987-21ps11:35:182
253109952,2cyclictest29583-21ssh09:31:352
253109951,3cyclictest769-21grep08:45:192
253109951,3cyclictest20527-21ssh09:20:462
252989955,0cyclictest782-21lldpd10:01:550
252989955,0cyclictest762-21ntpd08:45:410
252989954,1cyclictest26202-21fschecks_count11:20:110
252989954,1cyclictest171ktimers/012:38:520
252989953,2cyclictest245-20systemd-journal09:30:270
252989953,2cyclictest1655250ssh09:16:280
252989952,3cyclictest446-21apt-get12:05:110
252989952,2cyclictest574-21rs:main0
252989952,2cyclictest4821-21ssh12:10:160
252989952,2cyclictest30692-21rm12:01:310
252989950,3cyclictest24667-20sshd09:25:270
253139942,2cyclictest12081-21ntpq07:55:163
253139941,2cyclictest26076-21cut08:30:133
253109944,0cyclictest28975-21head12:00:132
253109941,2cyclictest19497-21rm12:25:502
252989940,4cyclictest26259-21ntpq07:10:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional