You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 15:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Tue Sep 15, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
159369910531051,2cyclictest29738-21kworker/0:0+events07:47:470
159369910521050,2cyclictest29738-21kworker/0:0+events07:43:250
159369910521050,2cyclictest24297-21kworker/0:2+events07:36:060
159469910511049,2cyclictest7822-21kworker/2:2+events11:46:512
159469910511049,2cyclictest20752-21kworker/2:0+events10:46:242
159469910511049,2cyclictest15482-21kworker/2:2+events07:52:212
159369910511049,2cyclictest28456-21kworker/0:2+events12:04:320
159519910501048,2cyclictest5753-21turbostat11:09:543
159469910501048,2cyclictest24897-21kworker/2:1+events11:30:222
159469910501048,2cyclictest24897-21kworker/2:1+events11:28:402
159369910501048,2cyclictest23264-21kworker/0:0+events12:06:270
159469910491047,2cyclictest24897-21kworker/2:1+events11:41:512
159469910491047,2cyclictest12435-21kworker/2:0+events11:56:252
159369910491047,2cyclictest14536-21kworker/0:1+events07:31:040
159369910481046,2cyclictest16310-21kworker/0:1+events10:41:270
159469910471045,2cyclictest24897-21kworker/2:1+events11:51:502
159469910471045,2cyclictest24897-21kworker/2:1+events11:37:552
159419910471045,2cyclictest6079-21kworker/1:0+events09:52:361
159369910471045,2cyclictest6350-21kworker/0:1+events12:17:140
159369910461042,2cyclictest28456-21kworker/0:2+events12:12:270
159519910421039,3cyclictest7106-21turbostat10:34:543
159369910401038,2cyclictest6350-21kworker/0:1+events12:21:490
159519910381036,2cyclictest15942-21turbostat10:44:553
159419910381037,1cyclictest2801-21kworker/1:0+events08:05:221
159519910321031,1cyclictest7440-21kworker/3:1+events08:31:273
159419910301029,1cyclictest2801-21kworker/1:0+events07:58:411
159419910301028,2cyclictest28289-21kworker/1:2+events10:31:401
159419910301026,2cyclictest32542-21kworker/1:2+events09:25:441
159519910281025,3cyclictest11518-21turbostat10:39:543
159519910271026,1cyclictest7440-21kworker/3:1+events08:27:343
159519910271026,1cyclictest11457-21kworker/3:1+events12:33:073
159519910271025,2cyclictest11457-21kworker/3:1+events12:26:073
159519910261023,2cyclictest30600-21turbostat10:24:553
159419910251023,2cyclictest6079-21kworker/1:0+events09:57:131
159419910251022,3cyclictest30869-21turbostat09:09:551
159469910201017,3cyclictest8227-21turbostat12:24:542
159419910181016,1cyclictest25219-21kworker/1:1+events11:05:231
159419910171016,1cyclictest31293-21kworker/1:2+events10:58:501
159419910161015,1cyclictest32542-21kworker/1:2+events09:33:411
159419910141012,2cyclictest5359-21kworker/1:1+events09:19:431
159419910101008,2cyclictest25219-21kworker/1:1+events11:19:011
159519910081007,1cyclictest7440-21kworker/3:1+events08:18:573
159419910031002,1cyclictest6079-21kworker/1:0+events10:14:041
159419910031002,1cyclictest2801-21kworker/1:0+events08:10:451
159519910021001,1cyclictest11457-21kworker/3:1+events12:39:003
15941991002999,1cyclictest25219-21kworker/1:1+events11:22:321
159419910021002,0cyclictest11524-21kworker/1:0+events09:23:501
159419910021001,1cyclictest32393-21kworker/1:1+events09:48:261
159419910011000,1cyclictest15654-21kworker/1:2+events07:10:221
15941991000998,1cyclictest25219-21kworker/1:1+events10:50:451
1594199998997,1cyclictest17309-21kworker/1:1+events10:21:051
1594199997996,1cyclictest2801-21kworker/1:0+events08:54:221
1594199997996,1cyclictest25219-21kworker/1:1+events11:13:291
1595199996993,3cyclictest27603-21turbostat09:44:553
1593699996993,3cyclictest416-21turbostat09:14:550
1594199994993,1cyclictest21889-21kworker/1:0+events07:29:391
1594199993992,1cyclictest2801-21kworker/1:0+events08:03:371
1595199992990,2cyclictest8625-21turbostat08:14:553
1594199992992,0cyclictest3639-21kworker/1:0+events11:04:411
1594199992991,1cyclictest6079-21kworker/1:0+events10:09:391
1594199991990,1cyclictest27055-21kworker/1:2+events08:57:201
1594199991990,1cyclictest17747-21kworker/1:0+events07:18:411
1594199989988,1cyclictest2801-21kworker/1:0+events09:03:151
1594199989986,1cyclictest17309-21kworker/1:1+events10:18:041
1594199988987,1cyclictest11519-21kworker/1:1+events07:24:391
1594199986985,1cyclictest28289-21kworker/1:2+events10:26:491
1595199972970,2cyclictest31809-21turbostat12:14:553
1594199958956,2cyclictest22799-21turbostat08:49:551
1595199935933,2cyclictest12918-21kworker/3:0+events08:47:313
1595199924923,1cyclictest24571-21kworker/3:1+events09:11:063
1595199917916,1cyclictest23117-21kworker/3:0+events10:01:053
1595199917916,1cyclictest12918-21kworker/3:0+events08:41:273
1593699912910,2cyclictest32098-21turbostat07:54:550
1595199908905,1cyclictest7440-21kworker/3:1+events08:20:233
1595199907907,0cyclictest7440-21kworker/3:1+events08:39:263
1595199907906,1cyclictest24571-21kworker/3:1+events09:38:473
1595199905903,2cyclictest1307-21turbostat11:04:553
1595199900896,4cyclictest19886-21turbostat11:24:553
1595199900896,4cyclictest18504-21turbostat11:59:553
1595199899897,2cyclictest20426-21turbostat10:49:543
1593699875872,3cyclictest8477-21turbostat09:59:560
1595199865863,2cyclictest21944-21turbostat07:29:563
1593699865863,2cyclictest12687-21turbostat12:29:540
1593699854852,2cyclictest18348-21turbostat09:34:550
1594699686682,4cyclictest30087-21turbostat07:49:562
1595199671668,3cyclictest8477-21turbostat09:59:553
1594199670666,2cyclictest416-21turbostat09:14:551
1594199628624,4cyclictest27603-21turbostat09:44:551
1595199622618,4cyclictest8227-21turbostat12:24:543
1593699611610,1cyclictest18504-21turbostat11:59:550
1594699605604,1cyclictest19886-21turbostat11:24:552
1594199584581,3cyclictest32098-21turbostat07:54:551
1593699580577,3cyclictest21944-21turbostat07:29:550
1594699546544,2cyclictest15942-21turbostat10:44:542
1593699540538,2cyclictest11518-21turbostat10:39:540
1594199531528,2cyclictest20426-21turbostat10:49:551
1594199505503,2cyclictest12898-21turbostat10:04:551
1595199502501,1cyclictest30869-21turbostat09:09:553
15936993610,360cyclictest4862-21apt-get08:00:120
1595199345344,1cyclictest18348-21turbostat09:34:563
15936993131,0cyclictest28654-21fwupd11:29:480
15941992019,1cyclictest67750irq/123-lan11:58:591
15941992019,1cyclictest67750irq/123-lan07:35:171
15941991918,1cyclictest67750irq/123-lan11:50:161
15941991918,1cyclictest67750irq/123-lan11:47:021
15941991818,0cyclictest67750irq/123-lan12:33:491
15941991817,1cyclictest67750irq/123-lan12:05:181
15941991817,1cyclictest67750irq/123-lan08:25:131
15941991717,0cyclictest67750irq/123-lan12:25:141
15941991717,0cyclictest67750irq/123-lan12:18:451
15941991717,0cyclictest67750irq/123-lan12:10:241
15941991717,0cyclictest67750irq/123-lan12:00:041
15941991717,0cyclictest67750irq/123-lan11:35:131
15941991717,0cyclictest67750irq/123-lan10:40:121
15941991717,0cyclictest67750irq/123-lan09:38:351
15941991717,0cyclictest67750irq/123-lan08:40:201
15941991716,1cyclictest67750irq/123-lan12:35:191
15941991716,1cyclictest67750irq/123-lan11:40:181
15941991716,1cyclictest67750irq/123-lan11:29:251
15941991716,1cyclictest67750irq/123-lan10:35:151
15941991616,0cyclictest67750irq/123-lan08:20:371
15941991616,0cyclictest67750irq/123-lan07:40:161
15941991615,1cyclictest67750irq/123-lan12:24:271
15941991615,1cyclictest67750irq/123-lan08:15:161
15941991515,0cyclictest67750irq/123-lan11:31:281
15941991413,1cyclictest67750irq/123-lan08:30:191
15941991413,1cyclictest67750irq/123-lan07:30:151
15941991211,1cyclictest67750irq/123-lan08:35:191
1594199109,1cyclictest67750irq/123-lan07:45:161
159519998,1cyclictest784-21snmpd11:40:433
159519998,1cyclictest782-21lldpd12:03:573
159469998,1cyclictest784-21snmpd09:30:062
159369998,1cyclictest784-21snmpd08:36:550
159519988,0cyclictest784-21snmpd11:17:493
159519988,0cyclictest784-21snmpd09:50:583
159519988,0cyclictest784-21snmpd07:47:503
159519988,0cyclictest782-21lldpd07:10:373
159519987,1cyclictest6186-21ntp_kernel_pll_09:15:173
159519987,1cyclictest18417-21fschecks_time07:15:133
159519986,2cyclictest784-21snmpd11:45:063
159519986,2cyclictest784-21snmpd07:30:353
159519986,2cyclictest10259-21cat09:20:123
159469988,0cyclictest784-21snmpd10:31:492
159469988,0cyclictest784-21snmpd09:52:042
159469988,0cyclictest784-21snmpd07:41:412
159469988,0cyclictest782-21lldpd11:15:292
159469988,0cyclictest782-21lldpd10:16:552
159469987,1cyclictest782-21lldpd10:39:122
159469987,1cyclictest507-21systemd-resolve10:07:232
159469986,2cyclictest784-21snmpd09:08:502
159469986,2cyclictest784-21snmpd07:22:522
159369988,0cyclictest784-21snmpd11:05:480
159369988,0cyclictest784-21snmpd08:05:460
159369988,0cyclictest784-21snmpd07:56:380
159369988,0cyclictest782-21lldpd11:51:130
159369988,0cyclictest782-21lldpd09:07:550
159369987,1cyclictest784-21snmpd08:58:050
159369987,1cyclictest784-21snmpd07:15:100
159369987,1cyclictest782-21lldpd12:31:020
159369986,2cyclictest784-21snmpd11:21:220
159519977,0cyclictest784-21snmpd10:26:443
159519977,0cyclictest784-21snmpd09:48:513
159519977,0cyclictest784-21snmpd08:56:383
159519977,0cyclictest782-21lldpd08:06:383
159519977,0cyclictest507-21systemd-resolve10:50:433
159519976,1cyclictest784-21snmpd07:55:173
159519976,1cyclictest526-21avahi-daemon11:12:413
159519976,1cyclictest507-21systemd-resolve12:17:373
159519975,2cyclictest511ktimers/309:00:123
159469977,0cyclictest782-21lldpd10:11:182
159469977,0cyclictest782-21lldpd08:11:062
159469976,1cyclictest784-21snmpd08:46:582
159469976,1cyclictest784-21snmpd08:01:462
159469976,1cyclictest526-21avahi-daemon10:22:022
159469976,1cyclictest507-21systemd-resolve09:38:402
159469975,2cyclictest784-21snmpd09:02:202
159469975,2cyclictest784-21snmpd08:30:012
159469975,2cyclictest784-21snmpd07:10:042
159469973,3cyclictest245-20systemd-journal10:25:242
159369977,0cyclictest784-21snmpd10:33:560
159369977,0cyclictest784-21snmpd08:18:300
159369977,0cyclictest782-21lldpd08:45:320
159369977,0cyclictest782-21lldpd07:22:210
159369976,1cyclictest784-21snmpd09:20:440
159369976,1cyclictest5681-21cpuspeed_turbos11:40:130
159369976,1cyclictest526-21avahi-daemon07:11:250
159369976,1cyclictest23118-21ntp_kernel_pll_12:35:180
159369976,1cyclictest15146-21apt-key11:14:590
159369975,2cyclictest784-21snmpd10:25:040
159369973,3cyclictest14228-21ssh10:00:180
159519966,0cyclictest784-21snmpd11:34:243
159519966,0cyclictest784-21snmpd08:50:413
159519966,0cyclictest526-21avahi-daemon10:10:413
159519965,1cyclictest542-21systemd-logind11:53:293
159519965,1cyclictest542-21systemd-logind10:55:293
159519964,2cyclictest28761-21cat07:40:143
159519964,2cyclictest0-21swapper/310:15:123
159519963,3cyclictest17885-21diskstats10:05:123
159519963,2cyclictest30632-21ssh12:07:553
159519962,2cyclictest28997-21cat11:29:593
159469966,0cyclictest784-21snmpd09:56:092
159469966,0cyclictest784-21snmpd09:24:322
159469966,0cyclictest784-21snmpd08:27:092
159469966,0cyclictest782-21lldpd11:11:122
159469966,0cyclictest782-21lldpd10:58:002
159469966,0cyclictest782-21lldpd07:30:292
159469966,0cyclictest3816-21idleruntime-cro12:15:002
159469965,1cyclictest946-21cpuspeed_turbos09:10:132
159469965,1cyclictest784-21snmpd12:01:072
159469965,1cyclictest784-21snmpd10:53:532
159469965,1cyclictest6205-21cpuspeed_turbos11:05:132
159469965,1cyclictest526-21avahi-daemon07:16:082
159469965,1cyclictest13812-21ntp_kernel_err12:25:152
159469965,1cyclictest10976-21cpuspeed_turbos08:15:122
159469964,2cyclictest784-21snmpd10:02:302
159469964,2cyclictest784-21snmpd09:49:062
159469963,2cyclictest6331-21ssh09:15:192
159469962,3cyclictest8139-21ssh12:19:542
159369966,0cyclictest784-21snmpd10:45:150
159369966,0cyclictest784-21snmpd09:54:340
159369966,0cyclictest784-21snmpd09:03:080
159369966,0cyclictest782-21lldpd08:44:570
159369965,1cyclictest784-21snmpd09:18:360
159369965,1cyclictest507-21systemd-resolve09:49:200
159369963,3cyclictest3822-21ssh11:01:340
159369963,3cyclictest31947-21ssh11:32:480
159369963,3cyclictest30534-21ssh09:42:190
159369963,2cyclictest26852-21ssh10:50:420
159369962,3cyclictest25308-21ssh10:13:290
159369962,3cyclictest1161-21ssh10:59:480
159519955,0cyclictest782-21lldpd07:21:393
159519954,1cyclictest280-21systemd-udevd07:35:293
159519953,2cyclictest784-21snmpd08:02:373
159519953,2cyclictest762-21ntpd09:25:283
159519952,2cyclictest1118-21ld07:50:163
159519952,2cyclictest1026-21sh11:35:023
159469955,0cyclictest784-21snmpd07:59:422
159469955,0cyclictest784-21snmpd07:25:022
159469955,0cyclictest0-21swapper/207:35:142
159469954,1cyclictest304182sleep209:42:062
159469954,1cyclictest25334-21fschecks_time08:50:132
159469954,1cyclictest0-21swapper/208:05:132
159469953,2cyclictest574-21rs:main2
159469953,1cyclictest6881-21kworker/u16:1+nfsiod12:30:352
159469952,3cyclictest21332-21fw_forwarded_lo08:40:142
159469952,2cyclictest14485-21grep09:25:122
159469951,3cyclictest3117-21sed11:00:232
159469951,3cyclictest19297-21fw_forwarded_lo08:35:162
159369955,0cyclictest784-21snmpd11:15:000
159369954,1cyclictest526-21avahi-daemon08:32:270
159369953,2cyclictest784-21snmpd09:35:460
159369952,2cyclictest574-21rs:main0
159369952,2cyclictest3139-21ssh11:36:200
159369952,2cyclictest19342-21ssh10:05:390
159369952,2cyclictest17982-21ssh09:29:240
159369952,2cyclictest14192-21grep08:20:240
159369952,2cyclictest10051-21apt-get11:45:130
159369951,3cyclictest31574-21memory10:20:150
159369951,3cyclictest29155-21sh10:17:260
159469942,2cyclictest27269-21uniq08:55:152
159469941,2cyclictest27875-21tr12:05:122
159469941,2cyclictest13069-21tr08:20:152
159369944,0cyclictest0-21swapper/008:10:150
159369940,4cyclictest15728-21ntpq08:25:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional