You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 19:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Thu Sep 03, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
326679910501048,2cyclictest24653-21kworker/3:0+events08:19:343
326549910491047,2cyclictest1148-21kworker/0:0+events10:10:560
326549910481046,2cyclictest26655-21turbostat10:34:560
326679910471045,2cyclictest13869-21kworker/3:1+events12:34:363
326549910451041,4cyclictest31888-21turbostat11:14:550
326549910411039,2cyclictest4180-21turbostat12:29:560
326549910381035,3cyclictest6270-21turbostat07:29:550
326549910371036,1cyclictest3953-21kworker/0:1+events10:06:590
326679910361035,1cyclictest30820-21kworker/3:2+events08:23:293
326599910341032,2cyclictest10294-21turbostat07:39:551
326549910321031,1cyclictest15420-21kworker/0:2+events09:11:400
326549910311028,3cyclictest12369-21turbostat07:44:550
326549910271026,1cyclictest1148-21kworker/0:0+events09:28:370
326549910221021,1cyclictest19851-21kworker/0:1+events11:43:390
326679910211019,1cyclictest30820-21kworker/3:2+events08:31:283
326679910201019,1cyclictest2004-21kworker/3:2+events07:20:203
326679910201018,2cyclictest2004-21kworker/3:2+events07:59:013
326549910111010,1cyclictest19851-21kworker/0:1+events11:39:240
326549910111010,1cyclictest16301-21kworker/0:1+events09:04:210
326599910091008,1cyclictest4669-21kworker/1:1+events11:50:441
326679910041003,1cyclictest2004-21kworker/3:2+events08:03:323
326679910031002,1cyclictest11992-21kworker/3:1+events07:37:223
326679910021000,2cyclictest3442-21turbostat10:44:543
326599910021001,1cyclictest6413-21kworker/1:2+events08:52:361
326599910021000,2cyclictest13497-21turbostat12:04:541
326649910011000,1cyclictest28815-21kworker/2:1+events10:34:002
32659991000998,2cyclictest20863-21turbostat08:04:551
3265499999998,1cyclictest3953-21kworker/0:1+events11:09:250
3265499998997,1cyclictest23087-21kworker/0:0+events12:11:260
3265499998994,4cyclictest8749-21turbostat12:34:550
3265499996995,1cyclictest16301-21kworker/0:1+events09:23:390
3265499996994,2cyclictest28958-21turbostat08:24:550
3265499994993,1cyclictest1148-21kworker/0:0+events10:16:370
3266799990989,1cyclictest2004-21kworker/3:2+events07:30:213
3266499990989,1cyclictest24112-21kworker/2:1+events09:58:122
3266499990989,1cyclictest24112-21kworker/2:1+events09:58:122
3266799989988,1cyclictest8850-21kworker/3:0+events12:01:063
3266799985982,3cyclictest10708-21turbostat08:59:553
3265999980979,1cyclictest4331-21kworker/1:0+events08:40:441
3266799975971,4cyclictest8678-21turbostat11:24:543
3265499975972,3cyclictest3371-21turbostat09:34:550
3266799974970,4cyclictest31151-21turbostat09:29:553
3265999972970,1cyclictest12565-21kworker/1:0+events09:31:491
3265999969968,1cyclictest6413-21kworker/1:2+events08:57:091
3266499967965,2cyclictest13071-21kworker/2:2+events09:50:212
3265999967966,1cyclictest8459-21kworker/1:1+events08:49:471
3266799966963,3cyclictest12814-21turbostat10:19:553
3266799963962,1cyclictest11426-21kworker/3:1+events09:41:073
3266499960959,1cyclictest18406-21kworker/2:0+events09:47:552
3266499960959,1cyclictest17775-21kworker/2:2+events10:22:322
3266499960957,3cyclictest26927-21turbostat08:19:552
3265999960959,1cyclictest19126-21kworker/1:1+events08:38:421
3265999960959,1cyclictest12565-21kworker/1:0+events11:45:211
3266499956955,1cyclictest13071-21kworker/2:2+events07:42:112
3266499955954,1cyclictest18406-21kworker/2:0+events10:01:462
3266499949948,1cyclictest17775-21kworker/2:2+events10:25:412
3266799942940,2cyclictest13869-21kworker/3:1+events12:08:293
3266799939938,1cyclictest31382-21turbostat10:04:553
3266799933932,1cyclictest13869-21kworker/3:1+events12:39:143
3266799932930,2cyclictest8850-21kworker/3:0+events11:56:293
3266799922920,2cyclictest30820-21kworker/3:2+events10:35:543
3266799920919,1cyclictest11426-21kworker/3:1+events09:38:403
3266799919918,1cyclictest24653-21kworker/3:0+events08:12:323
3266799919918,1cyclictest2004-21kworker/3:2+events07:29:123
3265499919918,1cyclictest15420-21kworker/0:2+events09:17:240
3266799918917,1cyclictest32311-21kworker/3:0+events07:19:153
3266799918916,1cyclictest4025-21kworker/3:0+events11:15:423
3266799915914,1cyclictest22591-21kworker/3:1+events08:28:403
3266799914913,1cyclictest6269-21kworker/3:1+events07:10:233
3266799912911,1cyclictest2004-21kworker/3:2+events07:49:023
3265499910909,1cyclictest3953-21kworker/0:1+events10:52:130
3265499910909,1cyclictest23087-21kworker/0:0+events12:19:480
3265499909906,2cyclictest3953-21kworker/0:1+events10:59:540
3266799908907,1cyclictest2004-21kworker/3:2+events08:05:223
3265499908907,1cyclictest15420-21kworker/0:2+events09:09:250
3265499908907,1cyclictest13917-21kworker/0:0+events11:25:450
3265499904903,1cyclictest13917-21kworker/0:0+events11:30:210
3265499903902,1cyclictest3953-21kworker/0:1+events11:01:580
3266799902899,1cyclictest11992-21kworker/3:1+events07:50:223
3265499896895,1cyclictest19851-21kworker/0:1+events12:22:200
3265499894893,1cyclictest9271-21kworker/0:2+events10:49:230
3266799884881,3cyclictest27064-21turbostat11:44:553
3265499856854,2cyclictest568-21turbostat08:34:550
3265999695691,4cyclictest27064-21turbostat11:44:541
3266799693691,2cyclictest4321-21turbostat11:54:543
3265499689685,3cyclictest31382-21turbostat10:04:550
3265999675674,1cyclictest568-21turbostat08:34:551
3265499621620,1cyclictest18186-21turbostat12:09:560
3266799614610,4cyclictest26655-21turbostat10:34:553
3266799608605,3cyclictest31888-21turbostat11:14:543
3266799593592,1cyclictest12369-21turbostat07:44:553
3265999582580,2cyclictest31151-21turbostat09:29:551
3266499578576,1cyclictest10294-21turbostat07:39:552
3266499563561,2cyclictest12814-21turbostat10:19:552
3265499546545,1cyclictest3442-21turbostat10:44:540
3266799540536,4cyclictest3371-21turbostat09:34:553
3265499529527,2cyclictest10708-21turbostat08:59:550
3265999526523,3cyclictest13334-21turbostat12:39:551
3265499519516,3cyclictest8678-21turbostat11:24:540
3266499499499,0cyclictest12567-21turbostat09:44:552
3266799460457,3cyclictest4180-21turbostat12:29:553
32667991918,1cyclictest67750irq/123-lan12:10:153
32667991918,1cyclictest67750irq/123-lan11:25:203
32667991918,1cyclictest67750irq/123-lan09:45:153
32667991918,1cyclictest67750irq/123-lan09:00:023
32667991818,0cyclictest67750irq/123-lan09:55:193
32667991818,0cyclictest67750irq/123-lan09:55:183
32667991817,1cyclictest67750irq/123-lan11:35:203
32667991817,1cyclictest67750irq/123-lan11:00:133
32667991717,0cyclictest67750irq/123-lan11:31:103
32667991717,0cyclictest67750irq/123-lan09:10:163
32667991716,1cyclictest67750irq/123-lan12:15:103
32667991716,1cyclictest67750irq/123-lan11:07:503
32667991716,1cyclictest67750irq/123-lan10:50:113
32667991716,1cyclictest67750irq/123-lan10:48:553
32667991716,1cyclictest67750irq/123-lan10:05:143
32667991716,1cyclictest67750irq/123-lan09:53:353
32667991616,0cyclictest67750irq/123-lan12:20:123
32667991616,0cyclictest67750irq/123-lan10:58:183
32667991616,0cyclictest67750irq/123-lan10:20:103
32667991615,1cyclictest67750irq/123-lan11:45:123
32667991615,1cyclictest67750irq/123-lan10:10:203
32667991615,1cyclictest67750irq/123-lan09:15:203
32667991615,1cyclictest67750irq/123-lan09:05:153
32667991615,1cyclictest67750irq/123-lan08:35:203
32667991515,0cyclictest67750irq/123-lan10:26:033
32667991514,1cyclictest67750irq/123-lan09:20:163
32667991413,1cyclictest67750irq/123-lan08:45:163
32667991312,1cyclictest67750irq/123-lan08:50:153
326649998,1cyclictest784-21snmpd10:50:292
326599998,1cyclictest784-21snmpd07:54:501
326599998,1cyclictest526-21avahi-daemon10:29:381
326599998,1cyclictest507-21systemd-resolve10:11:401
326679988,0cyclictest67750irq/123-lan08:40:133
326649988,0cyclictest784-21snmpd07:57:532
326649988,0cyclictest782-21lldpd11:26:072
326649987,1cyclictest784-21snmpd11:47:112
326649987,1cyclictest784-21snmpd09:29:232
326649987,1cyclictest784-21snmpd07:28:552
326649987,1cyclictest23241-21cpuspeed_turbos08:05:112
326649986,2cyclictest784-21snmpd09:24:422
326649986,2cyclictest784-21snmpd08:46:402
326599988,0cyclictest784-21snmpd10:24:041
326599988,0cyclictest784-21snmpd09:47:181
326599988,0cyclictest782-21lldpd12:18:371
326599988,0cyclictest782-21lldpd11:21:381
326599988,0cyclictest782-21lldpd10:56:221
326599988,0cyclictest782-21lldpd10:15:131
326599987,1cyclictest784-21snmpd07:45:581
326599987,1cyclictest507-21systemd-resolve11:39:591
326599986,2cyclictest784-21snmpd09:09:521
326599986,2cyclictest784-21snmpd09:04:041
326549988,0cyclictest784-21snmpd09:49:270
326549988,0cyclictest782-21lldpd10:20:270
326549987,1cyclictest507-21systemd-resolve11:58:020
326549986,2cyclictest784-21snmpd12:36:210
326549986,2cyclictest784-21snmpd12:00:170
326549986,2cyclictest784-21snmpd08:26:010
326549984,3cyclictest22008-21ntp_states08:00:180
326649977,0cyclictest784-21snmpd07:16:452
326649977,0cyclictest782-21lldpd12:20:462
326649977,0cyclictest782-21lldpd12:10:512
326649977,0cyclictest782-21lldpd11:59:572
326649977,0cyclictest782-21lldpd10:41:462
326649977,0cyclictest782-21lldpd07:45:152
326649976,1cyclictest782-21lldpd12:16:232
326649976,1cyclictest526-21avahi-daemon08:03:102
326649976,1cyclictest24523-21unixbench_singl11:00:232
326649975,2cyclictest784-21snmpd11:54:142
326649975,2cyclictest784-21snmpd09:16:412
326649975,2cyclictest1056-21fschecks_count08:30:122
326599977,0cyclictest784-21snmpd12:09:151
326599977,0cyclictest784-21snmpd11:12:151
326599977,0cyclictest784-21snmpd11:05:031
326599977,0cyclictest784-21snmpd10:44:261
326599977,0cyclictest784-21snmpd09:52:001
326599977,0cyclictest784-21snmpd07:57:441
326599977,0cyclictest782-21lldpd09:12:361
326599977,0cyclictest782-21lldpd07:15:411
326599976,1cyclictest784-21snmpd09:44:251
326599976,1cyclictest782-21lldpd11:17:241
326599976,1cyclictest22319-21cpuspeed_turbos09:15:111
326599975,2cyclictest784-21snmpd10:34:031
326599975,2cyclictest784-21snmpd08:14:561
326599975,2cyclictest762-21ntpd12:30:221
326599975,2cyclictest752-21grep07:10:141
326599974,3cyclictest547-21NetworkManager11:31:311
326599974,2cyclictest245-20systemd-journal09:55:301
326599974,2cyclictest245-20systemd-journal09:55:291
326599973,3cyclictest10131-21ntp_states11:55:141
326549977,0cyclictest784-21snmpd10:27:490
326549977,0cyclictest782-21lldpd08:48:290
326549977,0cyclictest782-21lldpd08:35:380
326549977,0cyclictest782-21lldpd08:11:390
326549977,0cyclictest526-21avahi-daemon07:11:100
326549977,0cyclictest507-21systemd-resolve07:58:080
326549976,1cyclictest784-21snmpd10:38:020
326549975,2cyclictest784-21snmpd11:52:580
326649966,0cyclictest9466-21gltestperf11:20:122
326649966,0cyclictest782-21lldpd10:37:202
326649966,0cyclictest782-21lldpd09:10:042
326649966,0cyclictest782-21lldpd08:57:382
326649966,0cyclictest782-21lldpd08:53:122
326649964,2cyclictest784-21snmpd09:37:052
326649964,2cyclictest784-21snmpd09:06:342
326649964,2cyclictest784-21snmpd08:22:212
326649964,2cyclictest762-21ntpd11:35:112
326649963,3cyclictest547-21NetworkManager11:19:572
326649963,3cyclictest18896-21sed07:55:002
326649963,2cyclictest8384-21ssh12:29:242
326649962,4cyclictest547-21NetworkManager11:11:512
326649962,3cyclictest9015-21awk10:45:002
326649962,3cyclictest6153-21ssh09:31:582
326649962,3cyclictest31695-21ssh11:45:002
326599966,0cyclictest784-21snmpd07:31:041
326599965,1cyclictest784-21snmpd08:22:151
326599965,1cyclictest4953-21cat07:20:131
326599965,1cyclictest31450-21fschecks_count08:25:121
326599965,1cyclictest12877-21latency_hist09:40:001
326599964,2cyclictest784-21snmpd10:35:471
326599963,3cyclictest27411-21cat11:04:591
326599963,2cyclictest8016-21ssh12:28:471
326599963,2cyclictest6315-21ssh10:06:491
326549966,0cyclictest784-21snmpd09:55:190
326549966,0cyclictest784-21snmpd09:55:180
326549966,0cyclictest507-21systemd-resolve07:37:340
326549963,3cyclictest547-21NetworkManager09:41:410
326649955,0cyclictest782-21lldpd08:42:282
326649955,0cyclictest14504-21tail12:35:152
326649954,1cyclictest782-21lldpd08:38:022
326649954,1cyclictest421ktimers/210:14:512
326649953,2cyclictest762-21ntpd11:31:092
326649952,3cyclictest31515-21perl08:25:132
326649952,2cyclictest6920-21ssh10:07:502
326649952,2cyclictest574-21rs:main2
326649952,2cyclictest5675-21cat07:20:192
326649952,2cyclictest28601-21smartctl11:05:172
326649952,2cyclictest26795-21sshd08:13:322
326649952,2cyclictest18652-21grep12:05:122
326649952,2cyclictest18367-21ssh10:55:042
326649952,2cyclictest12551-21ssh12:33:412
326599955,0cyclictest784-21snmpd07:25:011
326599955,0cyclictest782-21lldpd10:01:271
326599955,0cyclictest526-21avahi-daemon07:44:521
326599953,2cyclictest784-21snmpd10:52:001
326599953,2cyclictest784-21snmpd08:07:301
326599953,2cyclictest547-21NetworkManager12:11:581
326599952,2cyclictest2263-21ssh12:21:471
326599952,2cyclictest11721-21ssh10:46:581
326599951,3cyclictest13986-21fw_packets11:25:131
326599950,4cyclictest27582-21tr09:20:161
326549955,0cyclictest784-21snmpd08:19:030
326549954,1cyclictest499-21cat11:45:130
326549954,1cyclictest171ktimers/009:35:530
326549953,2cyclictest784-21snmpd07:32:160
326549952,2cyclictest5983-21wc08:40:200
326549952,2cyclictest574-21rs:main0
326549952,2cyclictest574-21rs:main0
326549952,2cyclictest22864-21ssh09:50:160
326549951,3cyclictest17796-21netstat07:50:160
326549950,5cyclictest0-21swapper/008:05:190
326549950,4cyclictest5361-21ntpq11:15:160
326649941,2cyclictest14820-21ld12:00:182
326649941,2cyclictest1117-21grep07:10:162
326649940,4cyclictest13987-21memory09:00:152
326599940,3cyclictest28232-21grep08:15:191
326549941,2cyclictest9351-21smartctl08:50:140
326549941,2cyclictest15484-21smartctl07:45:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional