You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-22 - 21:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Tue Sep 22, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
324019910531051,2cyclictest29926-21kworker/1:2+pm11:01:181
324019910481047,1cyclictest7744-21kworker/1:0+events11:28:381
324149910471045,2cyclictest25146-21turbostat11:14:543
324149910461045,1cyclictest20308-21kworker/3:0+events08:01:343
324149910431041,2cyclictest16491-21turbostat11:04:563
324149910411040,1cyclictest1968-21kworker/3:0+events08:37:333
324149910411039,2cyclictest4102-21kworker/3:1+events09:38:073
324149910351034,1cyclictest4709-21kworker/3:1+events12:23:043
324019910351034,1cyclictest29926-21kworker/1:2+events07:11:581
324019910351031,4cyclictest1925-21turbostat09:34:551
324149910331031,1cyclictest16094-21kworker/3:0+events10:22:343
324079910331030,3cyclictest8025-21turbostat07:34:552
324019910331030,3cyclictest19737-21turbostat09:54:561
324149910321028,4cyclictest32291-21turbostat07:14:553
324149910311029,2cyclictest4709-21kworker/3:1+events12:33:193
324019910251023,2cyclictest2383-21turbostat12:39:551
324149910241023,1cyclictest22301-21kworker/3:1+events07:20:223
324079910211018,3cyclictest29980-21turbostat09:29:552
324079910201017,3cyclictest3083-21turbostat10:49:562
324019910191018,1cyclictest29926-21kworker/1:2+events11:30:421
324079910181017,1cyclictest10956-21kworker/2:1+events12:10:222
324149910171016,1cyclictest21208-21kworker/3:2+events09:18:033
324149910081007,1cyclictest4709-21kworker/3:1+events12:39:113
323969910081005,3cyclictest29427-21turbostat11:19:540
323969910051004,1cyclictest6373-21kworker/0:0+events08:53:040
323969910051004,1cyclictest21156-21kworker/0:0+events11:44:140
324019910041003,1cyclictest29926-21kworker/1:2+events11:39:401
324149910031002,1cyclictest11503-21kworker/3:2+events10:25:233
324019910031001,2cyclictest29939-21kworker/1:1+events11:24:251
323969910031002,1cyclictest16451-21kworker/0:2+events10:02:450
324149910021001,1cyclictest10394-21kworker/3:0+events09:01:153
324019910021001,1cyclictest29926-21kworker/1:2+events10:57:331
323969910021001,1cyclictest24788-21kworker/0:1+events10:51:380
323969910021001,1cyclictest16451-21kworker/0:2+events09:59:480
32414991001999,2cyclictest18640-21turbostat11:44:553
323969910011000,1cyclictest21156-21kworker/0:0+events11:10:320
32396991000999,1cyclictest28052-21kworker/0:2+events07:33:410
3241499998997,1cyclictest4709-21kworker/3:1+events12:27:213
3241499998997,1cyclictest18305-21kworker/3:0+events10:10:223
3239699998997,1cyclictest6373-21kworker/0:0+events08:45:420
3239699998996,2cyclictest6257-21turbostat09:39:560
3241499995994,1cyclictest10436-21kworker/3:2+events07:46:493
3239699995994,1cyclictest6272-21kworker/0:0+events07:25:440
3240799994993,1cyclictest26482-21kworker/2:2+events11:51:592
3239699994993,1cyclictest6373-21kworker/0:0+events09:14:000
3240199993991,2cyclictest29926-21kworker/1:2+events11:18:051
3239699993991,2cyclictest26775-21turbostat10:39:550
3241499988987,1cyclictest25280-21kworker/3:0+events10:34:263
3239699988988,0cyclictest24788-21kworker/0:1+events11:06:050
3240199987986,1cyclictest1680-21kworker/1:1+events07:17:421
3240799986985,1cyclictest26482-21kworker/2:2+events11:55:442
3240799975973,2cyclictest23804-21kworker/2:0+events10:39:362
3241499974973,1cyclictest1968-21kworker/3:0+events08:31:053
3240799972970,2cyclictest23744-21kworker/2:0+events12:02:122
3240199971968,3cyclictest28776-21turbostat10:04:551
3240199971968,3cyclictest18116-21turbostat10:29:561
3241499969968,1cyclictest20308-21kworker/3:0+events08:21:513
3240199968965,3cyclictest8406-21turbostat08:54:551
3241499964963,1cyclictest4358-21turbostat08:44:563
3241499958957,1cyclictest678-21kworker/3:1+events10:06:583
3239699957955,2cyclictest10470-21turbostat07:39:540
3241499956955,1cyclictest11503-21kworker/3:2+events10:16:273
3239699954951,3cyclictest1951-21turbostat07:19:550
3241499953952,1cyclictest13768-21kworker/3:2+events09:42:343
3241499952951,1cyclictest14088-21kworker/3:1+events09:06:263
3241499951949,2cyclictest10436-21kworker/3:2+events07:58:523
3241499946945,1cyclictest31035-21kworker/3:2+events10:40:453
3241499943942,1cyclictest21208-21kworker/3:2+events09:24:023
3241499942941,1cyclictest4709-21kworker/3:1+events10:48:273
3241499940939,1cyclictest31897-21kworker/3:0+events09:31:473
3241499938937,1cyclictest28648-21kworker/3:2+events08:26:053
3240199938937,1cyclictest20590-21turbostat08:04:551
3241499937936,1cyclictest18305-21kworker/3:0+events09:53:143
3241499937936,1cyclictest10436-21kworker/3:2+events07:52:013
3241499936936,0cyclictest21208-21kworker/3:2+events09:27:553
3241499936935,1cyclictest3953-21kworker/3:0+events07:35:523
3241499931930,1cyclictest10436-21kworker/3:2+events07:41:043
3240799927926,1cyclictest23744-21kworker/2:0+events12:06:362
3241499926925,1cyclictest10394-21kworker/3:0+events08:56:243
3241499923922,1cyclictest13768-21kworker/3:2+events09:45:223
3240799923922,1cyclictest6375-21kworker/2:2+events12:16:492
3240799923922,1cyclictest23744-21kworker/2:0+events11:45:422
3240799923921,2cyclictest30444-21turbostat12:34:552
3239699914911,3cyclictest16573-21turbostat07:54:560
3240799913912,1cyclictest22603-21kworker/2:1+events08:10:222
3240799912911,1cyclictest23804-21kworker/2:0+events08:07:362
3240799907905,2cyclictest23804-21kworker/2:0+events08:18:102
3240799905902,3cyclictest31104-21turbostat10:44:552
3239699897894,3cyclictest26658-21turbostat08:19:550
3240799867863,3cyclictest14326-21turbostat11:39:542
3239699856854,2cyclictest9406-21turbostat10:19:550
3240199690687,3cyclictest7405-21turbostat10:54:551
3241499689688,1cyclictest26775-21turbostat10:39:553
3241499685682,3cyclictest17457-21turbostat12:19:553
3241499665664,1cyclictest28776-21turbostat10:04:553
3241499662660,2cyclictest8406-21turbostat08:54:553
3240199662658,4cyclictest25146-21turbostat11:14:541
3239699657653,4cyclictest16491-21turbostat11:04:550
3241499651648,3cyclictest1951-21turbostat07:19:543
3239699644642,2cyclictest3083-21turbostat10:49:560
3240799628625,3cyclictest22429-21turbostat10:34:562
3241499624621,3cyclictest16478-21turbostat09:14:553
3240799621619,2cyclictest20590-21turbostat08:04:552
3241499603599,3cyclictest8025-21turbostat07:34:553
3239699600597,3cyclictest3987-21turbostat07:24:540
3239699584583,1cyclictest19737-21turbostat09:54:550
3239699582577,3cyclictest4358-21turbostat08:44:560
3239699550547,3cyclictest14469-21turbostat09:09:550
3240799545541,4cyclictest18640-21turbostat11:44:552
3239699490487,3cyclictest14326-21turbostat11:39:540
3241499392391,1cyclictest26658-21turbostat08:19:553
32401991919,0cyclictest29926-21kworker/1:2+events_freezable09:59:011
32401991918,1cyclictest67750irq/123-lan12:05:191
32401991918,1cyclictest67750irq/123-lan10:17:001
32401991918,1cyclictest67750irq/123-lan08:28:391
32401991818,0cyclictest67750irq/123-lan12:21:341
32401991818,0cyclictest67750irq/123-lan12:11:571
32401991818,0cyclictest67750irq/123-lan11:47:121
32401991818,0cyclictest67750irq/123-lan09:12:061
32401991818,0cyclictest67750irq/123-lan07:35:151
32401991817,1cyclictest67750irq/123-lan10:35:161
32401991817,1cyclictest67750irq/123-lan10:11:301
32401991817,1cyclictest67750irq/123-lan10:05:161
32401991817,1cyclictest67750irq/123-lan09:40:431
32401991817,1cyclictest67750irq/123-lan07:30:001
32401991816,1cyclictest67750irq/123-lan08:15:141
32401991717,0cyclictest67750irq/123-lan11:51:501
32401991717,0cyclictest67750irq/123-lan11:40:141
32401991717,0cyclictest67750irq/123-lan11:07:101
32401991717,0cyclictest67750irq/123-lan10:44:551
32401991717,0cyclictest67750irq/123-lan09:35:191
32401991716,1cyclictest67750irq/123-lan12:31:221
32401991716,1cyclictest67750irq/123-lan12:00:131
32401991716,1cyclictest67750irq/123-lan11:57:091
32401991716,1cyclictest67750irq/123-lan10:22:521
32401991716,1cyclictest67750irq/123-lan08:55:181
32401991716,1cyclictest67750irq/123-lan08:47:321
32401991616,0cyclictest67750irq/123-lan12:26:221
32401991616,0cyclictest67750irq/123-lan12:19:041
32401991616,0cyclictest67750irq/123-lan09:47:581
32401991616,0cyclictest67750irq/123-lan09:25:161
32401991616,0cyclictest67750irq/123-lan09:22:051
32401991615,1cyclictest67750irq/123-lan10:31:131
32401991615,1cyclictest67750irq/123-lan09:18:421
32401991615,1cyclictest67750irq/123-lan09:05:361
32401991615,1cyclictest67750irq/123-lan07:55:221
32401991515,0cyclictest67750irq/123-lan10:45:051
32401991515,0cyclictest67750irq/123-lan09:01:241
32401991515,0cyclictest67750irq/123-lan08:35:461
32401991515,0cyclictest67750irq/123-lan08:30:141
32401991515,0cyclictest67750irq/123-lan08:10:361
32401991515,0cyclictest67750irq/123-lan07:51:371
32401991514,1cyclictest67750irq/123-lan07:30:131
32401991414,0cyclictest67750irq/123-lan07:40:111
32401991313,0cyclictest67750irq/123-lan08:05:191
32401991211,1cyclictest67750irq/123-lan08:40:151
32396991212,0cyclictest784-21snmpd10:06:050
3240199109,1cyclictest67750irq/123-lan08:20:361
324079998,1cyclictest784-21snmpd07:28:042
324019998,1cyclictest67750irq/123-lan07:20:201
323969998,1cyclictest784-21snmpd08:31:060
323969996,0cyclictest0-21swapper/012:35:110
324149988,0cyclictest784-21snmpd12:11:263
324149988,0cyclictest784-21snmpd12:00:343
324149988,0cyclictest784-21snmpd11:23:303
324149988,0cyclictest784-21snmpd08:12:533
324149987,1cyclictest784-21snmpd10:57:103
324149987,1cyclictest30458-21needreboot11:15:143
324149986,2cyclictest784-21snmpd11:30:233
324079988,0cyclictest784-21snmpd11:30:172
324079988,0cyclictest784-21snmpd11:22:152
324079988,0cyclictest784-21snmpd09:44:412
324079988,0cyclictest784-21snmpd09:06:552
324079988,0cyclictest782-21lldpd10:52:212
324079988,0cyclictest782-21lldpd10:06:482
324079987,1cyclictest507-21systemd-resolve10:23:392
324079986,2cyclictest784-21snmpd10:01:592
324079986,2cyclictest784-21snmpd07:48:472
324079986,2cyclictest13136-21cat09:00:152
323969988,0cyclictest782-21lldpd12:19:130
323969988,0cyclictest782-21lldpd07:43:340
323969987,1cyclictest784-21snmpd11:49:160
323969987,1cyclictest784-21snmpd09:04:590
323969987,1cyclictest507-21systemd-resolve10:25:190
323969986,2cyclictest784-21snmpd10:20:330
323969986,2cyclictest784-21snmpd09:22:070
323969986,2cyclictest784-21snmpd08:27:510
323969986,2cyclictest784-21snmpd08:21:590
323969986,2cyclictest762-21ntpd12:21:300
323969986,2cyclictest762-21ntpd10:34:440
323969986,2cyclictest762-21ntpd09:30:560
323969986,2cyclictest762-21ntpd09:17:450
323969986,2cyclictest762-21ntpd08:38:490
324149977,0cyclictest784-21snmpd08:08:273
324149975,2cyclictest9181-21cat12:05:143
324149975,2cyclictest784-21snmpd11:55:163
324149975,2cyclictest784-21snmpd11:09:243
324079977,0cyclictest784-21snmpd11:13:202
324079977,0cyclictest784-21snmpd09:47:352
324079977,0cyclictest784-21snmpd09:14:012
324079977,0cyclictest784-21snmpd07:43:552
324079977,0cyclictest782-21lldpd10:29:332
324079977,0cyclictest782-21lldpd08:39:372
324079977,0cyclictest782-21lldpd07:57:042
324079977,0cyclictest782-21lldpd07:12:392
324079976,1cyclictest784-21snmpd07:54:132
324079975,2cyclictest784-21snmpd11:17:142
324079975,2cyclictest784-21snmpd09:50:122
324079975,2cyclictest784-21snmpd09:35:022
324079975,2cyclictest784-21snmpd08:45:512
324079975,2cyclictest25279-21cat09:55:162
324079973,3cyclictest28127-21ssh12:25:412
323969977,0cyclictest784-21snmpd12:10:010
323969977,0cyclictest784-21snmpd08:00:050
323969977,0cyclictest5908-21cat10:10:180
323969976,1cyclictest784-21snmpd11:34:120
323969976,1cyclictest526-21avahi-daemon09:40:280
323969976,1cyclictest24640-21dump-pmu-power08:10:010
323969975,2cyclictest784-21snmpd11:22:170
323969975,2cyclictest784-21snmpd07:58:320
323969974,3cyclictest30773-21cat09:25:130
323969973,3cyclictest6450-21ssh12:01:280
324149966,0cyclictest784-21snmpd11:45:093
324149966,0cyclictest782-21lldpd07:25:553
324149966,0cyclictest507-21systemd-resolve08:47:023
324149962,3cyclictest7887-21ssh11:26:003
324149962,3cyclictest14574-21ssh11:35:043
324079966,0cyclictest782-21lldpd09:17:402
324079966,0cyclictest782-21lldpd08:51:232
324079965,1cyclictest784-21snmpd08:58:042
324079964,2cyclictest784-21snmpd12:38:302
324079964,2cyclictest784-21snmpd09:32:382
324079963,3cyclictest26321-21fw_packets09:20:142
324079963,2cyclictest574-21rs:main2
323969966,0cyclictest784-21snmpd07:11:360
323969963,2cyclictest8314-21ssh11:26:480
323969963,2cyclictest30365-21ssh11:51:490
323969963,2cyclictest26191-21kworker/u16:0+nfsiod10:59:330
323969963,2cyclictest1301-21ssh12:33:040
323969963,2cyclictest11697-21ssh12:08:070
323969963,2cyclictest1149-21ssh11:55:200
323969962,3cyclictest245-20systemd-journal12:26:110
324149952,3cyclictest547-21NetworkManager11:51:263
324149952,2cyclictest8449-21tune2fs10:50:163
324149952,2cyclictest28047-21ssh09:58:443
324079955,0cyclictest784-21snmpd08:26:142
324079955,0cyclictest782-21lldpd07:35:002
324079953,2cyclictest784-21snmpd10:15:332
324079953,2cyclictest784-21snmpd08:42:432
324079953,2cyclictest784-21snmpd07:24:372
324079952,2cyclictest7828-21seq11:25:542
324079952,2cyclictest7200-21rm10:10:562
324079952,2cyclictest17968-21cut11:00:202
324079951,3cyclictest2707-21wc07:15:162
324079951,3cyclictest21786-21memory11:05:172
324079950,4cyclictest29783-21ntp_states08:20:162
323969954,1cyclictest8662-21kworker/u16:3+nfsiod09:45:430
323969953,2cyclictest15509-21netstat07:45:160
323969952,2cyclictest31660-21cut10:40:100
323969952,2cyclictest25711-21ldconfig08:10:180
324079940,3cyclictest879-21perl08:30:132
323969943,1cyclictest0-21swapper/008:55:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional