You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-02 - 03:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Wed Sep 02, 2026 00:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
260669910531049,3cyclictest25812-21kworker/0:0+events19:52:450
260669910521050,2cyclictest25812-21kworker/0:0+events23:38:370
260669910521050,2cyclictest15853-21kworker/0:0+events00:29:300
260669910521048,3cyclictest25812-21kworker/0:0+events19:57:110
260669910511049,2cyclictest25812-21kworker/0:0+events19:49:030
260669910511049,2cyclictest15853-21kworker/0:0+events00:30:540
260789910501049,1cyclictest19380-21kworker/3:1+events22:30:443
260669910501048,2cyclictest850-21kworker/0:2+events00:23:180
260669910491047,2cyclictest25812-21kworker/0:0+events23:40:430
260789910481047,1cyclictest20685-21kworker/3:2+events21:29:023
260669910461043,3cyclictest29879-21turbostat22:34:550
260789910401039,1cyclictest25027-21kworker/3:2+events22:22:343
260699910391037,2cyclictest16346-21kworker/1:0+events23:02:311
260699910381037,1cyclictest9437-21kworker/1:1+events22:12:571
260789910361034,2cyclictest20685-21kworker/3:2+events21:21:053
260789910301028,2cyclictest19582-21kworker/3:1+events21:51:293
260789910291028,1cyclictest26179-21kworker/3:0+events21:45:453
260699910291027,2cyclictest25994-21kworker/1:2+events23:30:211
260789910271025,2cyclictest19111-21kworker/3:0+events20:00:213
260789910261025,1cyclictest16857-21kworker/3:1+events00:18:083
260699910261025,1cyclictest25562-21kworker/1:3+events23:18:181
260789910241023,1cyclictest19582-21kworker/3:1+events22:03:063
260699910241022,1cyclictest17106-21kworker/1:0+events19:12:221
260789910211020,0cyclictest16857-21kworker/3:1+events23:55:433
260699910201019,1cyclictest6037-21kworker/1:2+events22:08:481
260699910201019,1cyclictest16346-21kworker/1:0+events23:08:151
260699910201017,3cyclictest20286-21turbostat20:19:551
260789910171016,1cyclictest10616-21kworker/3:0+events23:54:313
260789910131011,2cyclictest23476-21turbostat22:59:553
260789910121011,1cyclictest10539-21kworker/3:0+events22:42:343
260789910101009,1cyclictest15097-21kworker/3:1+events21:19:113
260789910081006,2cyclictest10616-21kworker/3:0+events00:01:513
260749910071004,3cyclictest25554-21turbostat00:34:552
260789910061006,0cyclictest15996-21kworker/3:1+events22:50:203
260789910061005,1cyclictest26179-21kworker/3:0+events21:31:053
260789910061005,1cyclictest21575-21kworker/3:2+events23:47:373
260789910061005,1cyclictest17908-21kworker/3:1+events20:39:313
260789910061004,2cyclictest32514-21kworker/3:2+events00:39:243
260789910061004,2cyclictest31864-21kworker/3:2+events22:46:273
260789910051005,0cyclictest19380-21kworker/3:1+events22:29:053
260789910051004,1cyclictest26179-21kworker/3:0+events21:43:593
260789910051004,1cyclictest26179-21kworker/3:0+events21:37:343
260789910051004,1cyclictest2093-21kworker/3:2+events21:00:223
260749910051002,3cyclictest27488-21turbostat23:34:552
260789910041003,1cyclictest2093-21kworker/3:2+events20:53:263
260789910031002,1cyclictest19582-21kworker/3:1+events21:57:113
260789910031002,1cyclictest17908-21kworker/3:1+events20:17:333
260789910021001,1cyclictest26442-21kworker/3:0+events20:32:343
260789910021001,1cyclictest19380-21kworker/3:1+events22:39:343
260789910011000,1cyclictest26442-21kworker/3:0+events20:48:283
26078991000999,1cyclictest2093-21kworker/3:2+events20:56:283
26078991000998,2cyclictest17908-21kworker/3:1+events20:40:223
2607899999998,1cyclictest19111-21kworker/3:0+events20:14:523
2607899997996,1cyclictest17908-21kworker/3:1+events20:23:413
2607899997995,2cyclictest2093-21kworker/3:2+events21:11:513
2606999996994,2cyclictest31412-21kworker/1:0+events00:10:211
2607899995994,1cyclictest32514-21kworker/3:2+events00:06:183
2607899995994,1cyclictest2093-21kworker/3:2+events21:09:213
2607899995994,1cyclictest17908-21kworker/3:1+events20:06:503
2606999995994,1cyclictest16346-21kworker/1:0+events22:56:031
2607899990989,1cyclictest26442-21kworker/3:0+events20:28:403
2606999989988,1cyclictest6037-21kworker/1:2+events19:41:021
2607899968966,2cyclictest6139-21turbostat19:44:553
2606699965962,3cyclictest9833-21turbostat21:44:550
2606999954953,1cyclictest17106-21kworker/1:0+events19:21:501
2606999952951,1cyclictest27724-21kworker/1:1+events19:19:471
2606999952951,1cyclictest25562-21kworker/1:3+events23:11:071
2606999951950,1cyclictest27724-21kworker/1:1+events19:29:501
2606999949948,1cyclictest25994-21kworker/1:2+events23:29:131
2606999947944,1cyclictest16346-21kworker/1:0+events22:17:321
2606999946945,1cyclictest27724-21kworker/1:1+events19:36:481
2606999941940,1cyclictest27724-21kworker/1:1+events19:30:441
2606999939939,0cyclictest25562-21kworker/1:3+events23:22:111
2606699932930,2cyclictest14245-21turbostat22:19:550
2606999930928,2cyclictest12201-21turbostat19:59:551
2607899923922,1cyclictest17065-21turbostat23:24:553
2606999915913,2cyclictest385-21turbostat20:49:551
2607899892889,3cyclictest30020-21turbostat19:24:563
2607499867864,3cyclictest4758-21turbostat00:14:552
2606999683680,3cyclictest31950-21turbostat00:09:561
2607899660655,5cyclictest5504-21turbostat23:44:553
2606699626625,1cyclictest9954-21turbostat00:19:550
2607899613612,1cyclictest14245-21turbostat22:19:553
2606699606605,1cyclictest27488-21turbostat23:34:550
2607899598595,3cyclictest4758-21turbostat00:14:553
2606699597593,4cyclictest6139-21turbostat19:44:540
2606999589585,4cyclictest18269-21turbostat22:54:551
2607899537535,2cyclictest25554-21turbostat00:34:553
2607899535534,1cyclictest12201-21turbostat19:59:553
2606999374371,3cyclictest31074-21turbostat22:04:551
26078992121,0cyclictest21575-21kworker/3:2+events_freezable23:17:083
26078992020,0cyclictest25027-21kworker/3:2+events_freezable22:06:073
26078991919,0cyclictest67750irq/123-lan23:06:093
26078991918,1cyclictest67750irq/123-lan00:25:123
26078991918,1cyclictest25027-21kworker/3:2+events_freezable22:13:213
26078991818,0cyclictest32514-21kworker/3:2+events_freezable00:24:483
26078991817,1cyclictest67750irq/123-lan23:40:003
26078991817,1cyclictest67750irq/123-lan23:30:133
26078991817,1cyclictest67750irq/123-lan23:13:093
26078991817,1cyclictest67750irq/123-lan23:00:143
26078991717,0cyclictest67750irq/123-lan19:10:223
26078991716,1cyclictest67750irq/123-lan23:28:443
26078991616,0cyclictest67750irq/123-lan19:15:163
26078991615,1cyclictest67750irq/123-lan19:54:113
26078991615,1cyclictest67750irq/123-lan19:25:193
26078991313,0cyclictest784-21snmpd19:33:133
26078991212,0cyclictest67750irq/123-lan19:45:103
2607499128,1cyclictest784-21snmpd22:23:582
26078991111,0cyclictest19111-21kworker/3:0+events_freezable19:35:193
2607499105,2cyclictest10868-21cat19:50:142
260749998,1cyclictest784-21snmpd23:40:422
260749998,1cyclictest784-21snmpd22:48:532
260749998,1cyclictest526-21avahi-daemon00:06:522
260749996,1cyclictest784-21snmpd22:31:192
260699998,1cyclictest784-21snmpd21:13:021
260699998,1cyclictest782-21lldpd21:03:061
260669998,1cyclictest784-21snmpd20:21:060
260669998,1cyclictest784-21snmpd19:28:310
260749988,0cyclictest784-21snmpd23:56:132
260749988,0cyclictest784-21snmpd23:23:212
260749988,0cyclictest782-21lldpd22:17:032
260749988,0cyclictest782-21lldpd19:20:232
260749987,1cyclictest526-21avahi-daemon23:12:072
260749987,1cyclictest526-21avahi-daemon22:56:292
260749986,2cyclictest784-21snmpd22:07:272
260699988,0cyclictest784-21snmpd22:30:141
260699988,0cyclictest782-21lldpd22:42:501
260699988,0cyclictest782-21lldpd20:42:561
260699988,0cyclictest782-21lldpd19:47:271
260699987,1cyclictest784-21snmpd22:26:011
260699987,1cyclictest784-21snmpd21:40:211
260699987,1cyclictest784-21snmpd21:32:051
260699987,1cyclictest782-21lldpd00:37:371
260699987,1cyclictest526-21avahi-daemon22:22:421
260699986,2cyclictest784-21snmpd21:15:171
260699986,2cyclictest784-21snmpd20:50:041
260699986,2cyclictest784-21snmpd00:34:051
260669988,0cyclictest784-21snmpd21:00:040
260669988,0cyclictest784-21snmpd20:46:550
260669988,0cyclictest784-21snmpd20:30:150
260669988,0cyclictest782-21lldpd22:24:470
260669987,1cyclictest782-21lldpd20:11:050
260669987,1cyclictest507-21systemd-resolve23:23:590
260669987,1cyclictest507-21systemd-resolve22:51:180
260669987,1cyclictest507-21systemd-resolve00:09:010
260669986,2cyclictest784-21snmpd23:00:590
260669986,2cyclictest784-21snmpd21:55:240
260669986,2cyclictest784-21snmpd21:37:260
260749977,0cyclictest784-21snmpd22:38:222
260749977,0cyclictest784-21snmpd22:26:522
260749977,0cyclictest784-21snmpd20:33:362
260749977,0cyclictest784-21snmpd20:29:482
260749977,0cyclictest784-21snmpd20:20:212
260749977,0cyclictest784-21snmpd19:11:102
260749977,0cyclictest782-21lldpd21:06:162
260749977,0cyclictest526-21avahi-daemon19:16:422
260749976,1cyclictest784-21snmpd21:02:342
260749976,1cyclictest784-21snmpd20:51:012
260749976,1cyclictest782-21lldpd20:03:112
260749976,1cyclictest507-21systemd-resolve22:11:002
260749975,2cyclictest784-21snmpd20:18:002
260749975,2cyclictest784-21snmpd00:19:382
260749975,2cyclictest27603-21cat00:00:142
260749975,2cyclictest17088-21cat21:15:172
260749975,2cyclictest1150-21cat23:35:142
260699977,0cyclictest784-21snmpd22:38:341
260699977,0cyclictest784-21snmpd21:53:331
260699977,0cyclictest784-21snmpd21:39:241
260699977,0cyclictest784-21snmpd21:29:531
260699977,0cyclictest784-21snmpd20:03:281
260699977,0cyclictest782-21lldpd21:09:121
260699976,1cyclictest782-21lldpd00:15:411
260699976,1cyclictest526-21avahi-daemon23:40:081
260699976,1cyclictest526-21avahi-daemon23:37:451
260699976,1cyclictest526-21avahi-daemon21:48:581
260699975,2cyclictest784-21snmpd20:26:331
260699975,2cyclictest784-21snmpd00:24:051
260699973,3cyclictest245-20systemd-journal00:26:091
260669977,0cyclictest784-21snmpd22:57:170
260669977,0cyclictest784-21snmpd21:51:120
260669977,0cyclictest784-21snmpd21:34:440
260669977,0cyclictest784-21snmpd20:37:210
260669977,0cyclictest782-21lldpd23:19:140
260669977,0cyclictest782-21lldpd22:37:480
260669977,0cyclictest782-21lldpd21:48:490
260669977,0cyclictest782-21lldpd20:53:260
260669977,0cyclictest782-21lldpd00:36:530
260669976,1cyclictest784-21snmpd20:05:230
260669976,1cyclictest784-21snmpd00:13:010
260669976,1cyclictest507-21systemd-resolve21:29:100
260669975,2cyclictest784-21snmpd20:29:000
260669975,2cyclictest784-21snmpd19:22:420
260669973,3cyclictest245-20systemd-journal22:45:510
260749966,0cyclictest784-21snmpd21:56:362
260749966,0cyclictest784-21snmpd21:44:452
260749966,0cyclictest782-21lldpd23:52:112
260749966,0cyclictest782-21lldpd21:35:202
260749966,0cyclictest782-21lldpd20:58:112
260749966,0cyclictest782-21lldpd19:55:332
260749966,0cyclictest782-21lldpd19:37:092
260749966,0cyclictest782-21lldpd19:34:412
260749966,0cyclictest380-21dump-pmu-power20:45:002
260749966,0cyclictest0-21swapper/221:10:052
260749965,1cyclictest784-21snmpd20:14:002
260749965,1cyclictest784-21snmpd00:27:142
260749965,1cyclictest411-21needreboot21:30:152
260749963,3cyclictest31335-21sshd23:01:272
260749963,3cyclictest27429-21ssh23:29:572
260749963,2cyclictest574-21rs:main2
260749963,2cyclictest574-21rs:main2
260749963,2cyclictest23852-21ssh21:21:102
260749963,2cyclictest18634-21ssh21:47:122
260749963,2cyclictest15577-21ssh23:17:572
260699966,0cyclictest782-21lldpd20:38:041
260699966,0cyclictest15900-21idleruntime-cro23:50:011
260699965,1cyclictest782-21lldpd20:59:301
260699965,1cyclictest526-21avahi-daemon20:33:591
260699964,2cyclictest784-21snmpd20:12:511
260699963,2cyclictest29763-21ssh00:01:581
260699963,2cyclictest25594-21ssh23:58:281
260699962,3cyclictest23799-21sed20:20:211
260669966,0cyclictest784-21snmpd23:12:010
260669966,0cyclictest784-21snmpd20:57:430
260669966,0cyclictest784-21snmpd20:15:090
260669966,0cyclictest782-21lldpd21:05:320
260669965,1cyclictest784-21snmpd19:12:340
260669964,2cyclictest13837-21sshd22:14:270
260669964,2cyclictest0-21swapper/023:28:510
260669963,3cyclictest547-21NetworkManager00:03:460
260669963,3cyclictest2518-21df19:30:130
260669963,2cyclictest2628-21ssh22:03:180
260669963,2cyclictest11823-21ssh23:45:160
260669963,0cyclictest20189-21ssh21:18:190
260669962,3cyclictest30039-21cut22:30:000
260669962,3cyclictest22889-21find21:20:190
260749954,1cyclictest29131-21cpuspeed_turbos20:35:112
260749954,1cyclictest1168-21irqstats20:45:162
260749953,2cyclictest784-21snmpd22:01:422
260749952,2cyclictest7112-21ntp_192.168.11419:40:152
260749952,2cyclictest29163-21ssh21:26:192
260749952,2cyclictest18473-21ssh00:22:242
260749952,2cyclictest11319-21cut23:45:142
260749951,3cyclictest17406-21pluginstate20:05:172
260749951,3cyclictest13011-21ssh22:44:562
260749950,4cyclictest25014-21ssh21:53:512
260699955,0cyclictest782-21lldpd21:22:251
260699954,1cyclictest526-21avahi-daemon19:50:001
260699954,1cyclictest26643-21gltestperf21:55:151
260699952,3cyclictest547-21NetworkManager22:45:491
260699951,3cyclictest16206-21apt-config23:50:001
260669955,0cyclictest784-21snmpd20:40:580
260669955,0cyclictest526-21avahi-daemon22:05:080
260669955,0cyclictest526-21avahi-daemon19:36:500
260669955,0cyclictest22589-21head23:55:140
260669953,2cyclictest784-21snmpd19:17:520
260669952,2cyclictest3530-21ssh23:05:370
260669952,2cyclictest245-20systemd-journal22:40:530
260669952,2cyclictest17368-21sed23:50:150
260669952,2cyclictest16435-21ls20:04:590
260669952,2cyclictest13050-21ssh21:10:400
260749942,2cyclictest31781-21grep00:35:162
260749940,3cyclictest8597-21diskstats19:45:122
260749940,3cyclictest607-21fw_forwarded_lo19:25:132
260699941,2cyclictest17209-21sh20:05:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional