You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 21:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Fri Sep 04, 2026 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
223329910531051,2cyclictest4131-21kworker/3:0+events07:48:443
223329910531051,2cyclictest14359-21kworker/3:1+events09:55:543
223329910521050,2cyclictest6990-21kworker/3:2+events10:23:383
223329910521050,2cyclictest23013-21kworker/3:0+events10:09:023
223329910521050,2cyclictest19680-21kworker/3:1+events11:46:513
223329910511049,2cyclictest6181-21kworker/3:1+events07:52:303
223329910511049,2cyclictest24514-21kworker/3:0+events11:56:053
223329910511049,2cyclictest19680-21kworker/3:1+events12:08:423
223329910511049,2cyclictest19680-21kworker/3:1+events11:51:503
223329910511049,2cyclictest12164-21kworker/3:2+events12:12:563
223329910511049,2cyclictest10024-21kworker/3:0+events11:35:453
223329910501048,2cyclictest6990-21kworker/3:2+events10:26:273
223329910501048,2cyclictest2780-21kworker/3:2+events09:05:213
223179910501048,2cyclictest31112-21kworker/0:2+events09:23:480
223329910491048,1cyclictest19940-21kworker/3:1+events07:13:213
223329910491047,2cyclictest24131-21kworker/3:2+events07:31:243
223329910491047,2cyclictest16778-21kworker/3:2+events10:01:143
223329910461044,2cyclictest2780-21kworker/3:2+events09:19:123
223179910461045,1cyclictest529-21kworker/0:2+events09:36:590
223179910461045,1cyclictest31112-21kworker/0:2+events09:25:220
223219910431041,2cyclictest26398-21kworker/1:1+events11:15:521
223179910431042,1cyclictest28122-21kworker/0:2+events10:41:590
223269910391036,3cyclictest25904-21turbostat10:44:552
223179910291028,1cyclictest14886-21kworker/0:0+events11:10:440
223179910281027,1cyclictest30587-21kworker/0:0+events10:17:010
223219910231022,1cyclictest31304-21kworker/1:2+events11:21:261
223219910211020,1cyclictest8768-21kworker/1:0+events10:49:371
223219910211019,2cyclictest31304-21kworker/1:2+events12:34:251
223179910211019,2cyclictest5433-21kworker/0:3+events10:57:120
223329910191018,1cyclictest19680-21kworker/3:1+events12:18:293
223219910191018,1cyclictest32704-21kworker/1:0+events12:38:271
223219910191018,1cyclictest31304-21kworker/1:2+events12:29:481
223219910191018,1cyclictest26398-21kworker/1:1+events11:27:201
223219910181017,1cyclictest26398-21kworker/1:1+events11:32:111
223179910121010,2cyclictest23187-21kworker/0:1+events09:31:040
223179910071006,1cyclictest10151-21kworker/0:1+events11:08:020
2231799999998,1cyclictest3076-21kworker/0:0+events10:51:280
2233299978976,2cyclictest2780-21kworker/3:2+events09:14:363
2232199974972,2cyclictest21145-21turbostat11:14:561
2231799971970,1cyclictest5478-21kworker/0:1+events09:46:150
2231799971969,2cyclictest22891-21kworker/0:0+events08:35:230
2231799966965,1cyclictest16698-21kworker/0:2+events08:30:220
2231799966965,1cyclictest10151-21kworker/0:1+events11:03:480
2231799963962,1cyclictest10362-21kworker/0:2+events10:33:400
2232699962960,2cyclictest26309-21turbostat07:24:552
2231799962961,1cyclictest17384-21kworker/0:1+events10:39:270
2233299961960,1cyclictest26180-21kworker/3:1+events07:19:543
2231799961960,1cyclictest3278-21kworker/0:0+events07:59:040
2231799959958,1cyclictest9393-21kworker/0:2+events08:03:190
2231799959958,1cyclictest16698-21kworker/0:2+events08:40:220
2231799958957,1cyclictest31112-21kworker/0:2+events08:59:130
2231799958957,1cyclictest16698-21kworker/0:2+events08:17:100
2231799956955,1cyclictest30587-21kworker/0:0+events10:14:110
2231799956955,1cyclictest14658-21kworker/0:0+events08:11:050
2231799956955,1cyclictest12177-21kworker/0:1+events08:24:230
2231799955954,1cyclictest26983-21kworker/0:1+events08:45:210
2231799954953,1cyclictest31112-21kworker/0:2+events08:53:200
2231799951950,1cyclictest17071-21kworker/0:0+events09:42:130
2231799948947,1cyclictest16698-21kworker/0:2+events08:25:450
2231799945944,1cyclictest12177-21kworker/0:1+events08:05:230
2232699930927,3cyclictest11707-21turbostat10:29:562
2232699922920,2cyclictest2456-21turbostat07:44:552
2232199916915,1cyclictest31304-21kworker/1:2+events12:22:541
2232199910906,4cyclictest6863-21turbostat09:14:551
2231799904901,3cyclictest7242-21turbostat11:34:560
2233299902901,1cyclictest24514-21kworker/3:0+events12:00:463
2232199902900,2cyclictest316-21turbostat07:39:541
2233299895894,1cyclictest14359-21kworker/3:1+events09:53:493
2233299894893,1cyclictest26180-21kworker/3:1+events07:23:583
2233299894893,1cyclictest24131-21kworker/3:2+events07:36:593
2233299892891,1cyclictest26180-21kworker/3:1+events07:28:593
2233299891890,1cyclictest6990-21kworker/3:2+events11:41:593
2233299891890,1cyclictest4131-21kworker/3:0+events07:41:053
2233299883880,3cyclictest6181-21kworker/3:1+events09:00:203
2232199880876,4cyclictest30774-21turbostat07:34:541
2233299868866,2cyclictest30538-21turbostat10:49:563
2232699864861,3cyclictest2849-21turbostat12:39:552
2231799855852,3cyclictest22213-21turbostat07:14:540
2232199852850,2cyclictest794-21turbostat08:59:551
2233299709706,3cyclictest2454-21turbostat10:19:553
2231799683681,2cyclictest30538-21turbostat10:49:560
2231799671668,3cyclictest25673-21turbostat10:09:550
2231799661659,2cyclictest6515-21turbostat07:54:540
2231799642641,1cyclictest11707-21turbostat10:29:550
2232199641639,1cyclictest16232-21turbostat12:19:561
2231799638637,1cyclictest11550-21turbostat09:19:550
2233299597595,1cyclictest7242-21turbostat11:34:563
2233299595594,1cyclictest7251-21turbostat09:49:543
2233299582581,1cyclictest794-21turbostat08:59:553
2233299518515,3cyclictest2849-21turbostat12:39:553
2232199514513,1cyclictest25904-21turbostat10:44:551
22332991918,1cyclictest67750irq/123-lan10:35:143
22332991918,1cyclictest67750irq/123-lan08:07:433
22332991818,0cyclictest67750irq/123-lan08:20:143
22332991817,1cyclictest67750irq/123-lan10:43:313
22332991817,1cyclictest67750irq/123-lan10:32:523
22332991817,1cyclictest67750irq/123-lan09:25:153
22332991816,2cyclictest67750irq/123-lan08:05:003
22332991717,0cyclictest67750irq/123-lan11:18:363
22332991716,1cyclictest67750irq/123-lan11:00:453
22332991716,1cyclictest67750irq/123-lan10:50:193
22332991716,1cyclictest67750irq/123-lan10:12:143
22332991716,1cyclictest67750irq/123-lan09:40:403
22332991716,1cyclictest67750irq/123-lan09:38:373
22332991716,1cyclictest67750irq/123-lan09:30:133
22332991616,0cyclictest67750irq/123-lan11:12:563
22332991616,0cyclictest67750irq/123-lan09:20:053
22332991615,1cyclictest67750irq/123-lan12:30:133
22332991615,1cyclictest67750irq/123-lan12:29:403
22332991615,1cyclictest67750irq/123-lan12:21:443
22332991615,1cyclictest67750irq/123-lan11:26:543
22332991615,1cyclictest67750irq/123-lan11:20:033
22332991615,1cyclictest67750irq/123-lan11:05:063
22332991615,1cyclictest67750irq/123-lan10:55:163
22332991615,1cyclictest67750irq/123-lan08:50:193
22332991615,1cyclictest67750irq/123-lan08:10:173
22332991514,1cyclictest67750irq/123-lan08:40:133
22332991514,1cyclictest67750irq/123-lan08:30:003
22332991414,0cyclictest67750irq/123-lan08:39:323
22332991414,0cyclictest67750irq/123-lan08:15:103
22332991313,0cyclictest67750irq/123-lan08:25:163
22332991313,0cyclictest67750irq/123-lan07:55:133
22326991313,0cyclictest784-21snmpd07:19:552
22332991212,0cyclictest67750irq/123-lan08:45:143
22326991212,0cyclictest784-21snmpd11:47:422
22326991212,0cyclictest784-21snmpd10:20:382
22326991212,0cyclictest784-21snmpd10:17:032
22326991212,0cyclictest31060-21cat11:55:152
22326991111,0cyclictest784-21snmpd11:43:332
22326991111,0cyclictest784-21snmpd10:51:372
22326991111,0cyclictest784-21snmpd10:30:302
22326991111,0cyclictest784-21snmpd10:08:142
22326991111,0cyclictest784-21snmpd08:43:292
22326991111,0cyclictest784-21snmpd08:10:572
22326991111,0cyclictest784-21snmpd07:36:482
22326991111,0cyclictest784-21snmpd07:28:502
22326991111,0cyclictest21754-21cat08:25:132
22326991010,0cyclictest784-21snmpd11:31:382
22326991010,0cyclictest784-21snmpd11:15:192
22326991010,0cyclictest784-21snmpd09:59:022
22326991010,0cyclictest784-21snmpd09:51:502
22326991010,0cyclictest784-21snmpd09:44:452
22326991010,0cyclictest784-21snmpd09:15:092
22326991010,0cyclictest784-21snmpd09:12:362
22326991010,0cyclictest784-21snmpd08:17:012
22326991010,0cyclictest784-21snmpd07:34:292
22326991010,0cyclictest31214-21cat09:35:132
22326991010,0cyclictest29843-21cat08:45:132
22326991010,0cyclictest17381-21cat11:05:132
2232199109,1cyclictest526-21avahi-daemon09:43:291
223269999,0cyclictest784-21snmpd12:20:042
223219998,1cyclictest784-21snmpd11:36:251
223219998,1cyclictest526-21avahi-daemon12:01:471
223179998,1cyclictest784-21snmpd09:53:080
223179998,1cyclictest784-21snmpd09:03:480
223179998,1cyclictest782-21lldpd12:39:460
223269988,0cyclictest784-21snmpd08:22:142
223269988,0cyclictest782-21lldpd12:14:072
223269988,0cyclictest782-21lldpd12:00:342
223269987,1cyclictest526-21avahi-daemon12:30:182
223269986,2cyclictest784-21snmpd10:02:402
223269986,2cyclictest784-21snmpd08:31:402
223269986,2cyclictest762-21ntpd08:59:262
223219988,0cyclictest782-21lldpd09:59:141
223219988,0cyclictest782-21lldpd09:53:261
223219988,0cyclictest782-21lldpd09:49:351
223219988,0cyclictest782-21lldpd07:45:231
223219986,2cyclictest784-21snmpd09:27:271
223219986,2cyclictest784-21snmpd09:02:031
223219984,3cyclictest17590-21memory09:20:151
223179988,0cyclictest784-21snmpd07:41:030
223179987,1cyclictest782-21lldpd10:00:570
223179987,1cyclictest507-21systemd-resolve12:19:140
223179986,2cyclictest784-21snmpd11:21:460
223269977,0cyclictest784-21snmpd12:27:012
223269977,0cyclictest784-21snmpd09:45:272
223269977,0cyclictest784-21snmpd08:08:242
223269977,0cyclictest784-21snmpd07:14:342
223269977,0cyclictest782-21lldpd09:26:552
223269976,1cyclictest782-21lldpd11:52:552
223269976,1cyclictest526-21avahi-daemon10:36:522
223269976,1cyclictest507-21systemd-resolve11:13:382
223269975,2cyclictest784-21snmpd12:08:152
223269975,2cyclictest762-21ntpd07:50:022
223269975,2cyclictest762-21ntpd07:48:342
223219977,0cyclictest784-21snmpd08:38:471
223219977,0cyclictest782-21lldpd11:07:251
223219977,0cyclictest782-21lldpd07:54:061
223219976,1cyclictest782-21lldpd08:05:031
223219976,1cyclictest526-21avahi-daemon11:40:271
223219976,1cyclictest5171-21cpuspeed_turbos09:05:111
223219976,1cyclictest1-21systemd08:33:051
223219975,2cyclictest784-21snmpd11:02:031
223219975,2cyclictest784-21snmpd08:29:431
223219975,2cyclictest784-21snmpd08:01:161
223219975,2cyclictest784-21snmpd07:27:091
223179977,0cyclictest784-21snmpd12:08:510
223179977,0cyclictest784-21snmpd11:37:500
223179977,0cyclictest782-21lldpd12:32:590
223179977,0cyclictest782-21lldpd12:04:180
223179977,0cyclictest572-21in:imuxsock09:58:490
223179976,1cyclictest784-21snmpd07:19:190
223179976,1cyclictest782-21lldpd11:27:520
223179975,2cyclictest784-21snmpd12:13:280
223179975,2cyclictest784-21snmpd10:21:350
223179975,2cyclictest784-21snmpd07:34:590
223179974,2cyclictest245-20systemd-journal11:42:210
223179973,3cyclictest547-21NetworkManager11:15:120
223269966,0cyclictest782-21lldpd11:03:482
223269966,0cyclictest782-21lldpd09:08:192
223269965,1cyclictest3238-21fschecks_time11:25:122
223269964,2cyclictest784-21snmpd10:46:582
223269964,2cyclictest784-21snmpd08:00:582
223269962,3cyclictest20049-21ssh12:18:432
223219966,0cyclictest784-21snmpd08:20:471
223219966,0cyclictest782-21lldpd08:15:211
223219965,1cyclictest572-21in:imuxsock10:18:221
223219965,1cyclictest526-21avahi-daemon10:35:061
223219964,2cyclictest28375-21ssh09:31:351
223219963,2cyclictest30065-21ssh11:54:461
223219963,2cyclictest25131-21ssh11:49:111
223219963,2cyclictest13109-21ssh12:10:171
223219962,3cyclictest660-21ssh10:12:031
223179966,0cyclictest782-21lldpd11:55:490
223179964,2cyclictest784-21snmpd11:45:510
223179964,2cyclictest784-21snmpd07:23:180
223179962,3cyclictest245-20systemd-journal11:50:350
223269954,1cyclictest762-21ntpd09:00:032
223269954,1cyclictest421ktimers/210:13:152
223269954,1cyclictest26261-21cpuspeed_turbos09:30:112
223269952,2cyclictest7983-21grep10:55:122
223269952,2cyclictest26660-21sed08:35:232
223269952,2cyclictest245-20systemd-journal07:56:202
223269952,2cyclictest1062-21ssh11:22:272
223219955,0cyclictest784-21snmpd08:45:101
223219954,1cyclictest7489-21cpuspeed_turbos12:05:111
223219954,1cyclictest507-21systemd-resolve08:43:001
223219954,1cyclictest32158-21ntpq08:50:161
223219954,1cyclictest2033-21kworker/u16:3-nfsiod10:25:201
223219953,2cyclictest784-21snmpd09:35:041
223219952,2cyclictest9813-21sensors_temp07:55:161
223219952,2cyclictest9078-21grep10:55:211
223219952,2cyclictest574-21rs:main1
223219952,2cyclictest574-21rs:main1
223219952,2cyclictest3245-21tr10:50:161
223219952,2cyclictest27469-21ssh10:05:191
223219952,2cyclictest245-20systemd-journal07:18:161
223219952,2cyclictest16977-21ssh10:30:041
223219951,3cyclictest547-21NetworkManager08:10:091
223179953,2cyclictest29459-21cat07:25:150
223179952,3cyclictest7676-21cat09:10:130
223179952,3cyclictest6309-21sed09:05:190
223179952,3cyclictest1156-21sed07:35:120
223179952,2cyclictest29283-21ssh12:27:430
223179952,2cyclictest23405-21ssh12:21:130
223269942,2cyclictest31819-21smartctl08:50:152
223269942,2cyclictest12198-21apt-get11:35:112
223269940,4cyclictest17171-21diskstats09:20:122
223219942,2cyclictest21722-21tune2fs10:00:121
223219941,2cyclictest9340-21ssh10:21:021
223219941,2cyclictest574-21rs:main1
223219941,2cyclictest3583-21collect207:40:171
223219940,4cyclictest27824-21ntpq07:20:171
223179941,2cyclictest5482-21ldconfig07:45:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional