You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 13:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Sun Aug 30, 2026 00:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
47749910501049,1cyclictest1402-21kworker/0:2+events20:24:020
47829910401038,2cyclictest7511-21turbostat20:39:552
47859910391038,1cyclictest20297-21kworker/3:1+events22:13:423
47799910391037,2cyclictest10871-21turbostat21:34:551
47799910381037,1cyclictest28826-21kworker/1:0+events00:37:561
47799910341032,2cyclictest28248-21kworker/1:2+events21:22:111
47859910331032,1cyclictest2201-21kworker/3:0+events23:10:543
47799910321029,3cyclictest17244-21turbostat19:44:551
47859910311030,1cyclictest9490-21kworker/3:2+events22:58:193
47799910261025,1cyclictest30494-21kworker/1:2+events00:06:061
47749910261025,1cyclictest8233-21kworker/0:0+events23:52:110
47799910221020,2cyclictest26118-21kworker/1:1+events22:23:491
47859910211020,1cyclictest13100-21kworker/3:2+events19:47:093
47749910211020,1cyclictest1402-21kworker/0:2+events20:39:340
47749910191018,1cyclictest1402-21kworker/0:2+events20:30:210
47829910181017,1cyclictest8649-21kworker/2:2+events22:32:012
47749910181015,3cyclictest5391-21turbostat00:04:550
47749910171016,1cyclictest23274-21kworker/0:0+events19:57:450
47859910131010,3cyclictest3549-21turbostat22:29:563
47799910131009,4cyclictest10008-21turbostat22:04:541
47799910121008,4cyclictest15193-21turbostat22:09:541
47749910121008,4cyclictest24307-21turbostat22:49:560
47749910121008,4cyclictest24307-21turbostat22:49:560
47799910071006,1cyclictest30494-21kworker/1:2+events00:31:281
47859910061003,3cyclictest9517-21turbostat20:44:553
47799910041002,2cyclictest32571-21kworker/1:0+events22:26:291
47749910041003,1cyclictest8233-21kworker/0:0+events23:46:360
47799910031002,1cyclictest19520-21kworker/1:2+events22:49:371
47799910031002,1cyclictest19520-21kworker/1:2+events22:49:371
4774991000999,1cyclictest8233-21kworker/0:0+events23:42:010
477499999998,1cyclictest13450-21kworker/0:1+events19:30:440
478299998995,3cyclictest20369-21turbostat22:14:562
477999998997,1cyclictest32571-21kworker/1:0+events23:15:561
477499997996,1cyclictest13450-21kworker/0:1+events19:35:210
478299993990,1cyclictest497-21kworker/2:0+events23:57:152
477499993992,1cyclictest8233-21kworker/0:0+events23:37:420
478599992991,1cyclictest9490-21kworker/3:2+events21:49:133
477499992991,1cyclictest26214-21kworker/0:1+events22:07:330
477499992991,1cyclictest13450-21kworker/0:1+events19:42:120
477499990989,1cyclictest29838-21kworker/0:2+events22:53:280
477499990989,1cyclictest18034-21kworker/0:1+events21:04:280
477499989988,1cyclictest7153-21kworker/0:0+events21:06:270
477499989988,1cyclictest29838-21kworker/0:2+events23:25:200
477499989988,1cyclictest21863-21kworker/0:2+events21:11:270
478599987984,3cyclictest29499-21turbostat22:54:553
477999987985,2cyclictest22061-21turbostat21:14:541
477499987986,1cyclictest5111-21kworker/0:1+events20:26:060
478299986985,1cyclictest497-21kworker/2:0+events00:00:232
477999986983,3cyclictest32571-21kworker/1:0+events21:53:581
477999982980,2cyclictest28826-21kworker/1:0+events00:27:571
477499982981,1cyclictest1378-21kworker/0:1+events23:32:550
478299980979,1cyclictest15898-21kworker/2:1+events22:38:492
477999980979,1cyclictest10965-21kworker/1:1+events00:10:201
478299979978,1cyclictest11781-21kworker/2:1+events20:47:542
478299978977,1cyclictest6537-21kworker/2:0+events20:51:182
478299977976,1cyclictest7083-21kworker/2:1+events19:13:492
477999977976,1cyclictest26118-21kworker/1:1+events22:18:281
478599975974,1cyclictest8329-21kworker/3:1+events23:05:213
478599975974,1cyclictest17787-21kworker/3:0+events19:26:053
477999974973,1cyclictest30494-21kworker/1:2+events00:22:561
478599973972,1cyclictest19250-21kworker/3:1+events19:50:213
478299972971,1cyclictest6537-21kworker/2:0+events20:55:432
478599970969,1cyclictest28779-21kworker/3:2+events19:17:563
478599969968,1cyclictest16846-21kworker/3:0+events21:38:283
477999969968,1cyclictest30494-21kworker/1:2+events00:18:171
477999969968,1cyclictest28248-21kworker/1:2+events21:17:141
477999969966,1cyclictest23446-21kworker/1:1+events23:20:331
478599966964,2cyclictest5476-21turbostat20:34:553
477999966964,2cyclictest4664-21turbostat19:14:541
478599965964,1cyclictest9490-21kworker/3:2+events21:43:173
477999963962,1cyclictest2610-21kworker/1:1+events21:26:511
477999963961,2cyclictest32571-21kworker/1:0+events22:40:221
477499963960,3cyclictest26850-21turbostat21:49:540
477999962961,1cyclictest29397-21kworker/1:0+events20:12:021
477999962961,1cyclictest29397-21kworker/1:0+events20:07:121
478599961960,1cyclictest17787-21kworker/3:0+events19:22:573
477499961959,2cyclictest25562-21turbostat22:19:560
477999960959,1cyclictest32675-21kworker/1:2+events20:02:201
478599959958,1cyclictest8329-21kworker/3:1+events23:00:453
477999959958,1cyclictest32675-21kworker/1:2+events20:16:071
477999958957,1cyclictest2610-21kworker/1:1+events21:57:531
477499916914,2cyclictest13908-21turbostat22:39:560
478599906904,2cyclictest15575-21turbostat20:59:553
477499890887,3cyclictest31797-21turbostat20:19:550
478299883880,3cyclictest6716-21turbostat19:19:552
477999883881,2cyclictest23301-21turbostat19:59:551
478599874872,2cyclictest27410-21turbostat23:54:553
477499697695,1cyclictest21289-21turbostat19:54:540
477499678676,2cyclictest15575-21turbostat20:59:550
477999650649,1cyclictest13908-21turbostat22:39:561
478299641638,3cyclictest27410-21turbostat23:54:542
478599597594,3cyclictest10871-21turbostat21:34:553
478599588586,2cyclictest17244-21turbostat19:44:553
477499585583,2cyclictest10008-21turbostat22:04:550
478599583581,2cyclictest7511-21turbostat20:39:553
478299578576,2cyclictest3549-21turbostat22:29:562
478299572569,3cyclictest9517-21turbostat20:44:552
478599568565,3cyclictest15193-21turbostat22:09:553
477999567565,2cyclictest17864-21turbostat23:14:551
477999552550,2cyclictest5391-21turbostat00:04:551
477499548545,3cyclictest11195-21turbostat19:29:550
477999540535,5cyclictest20369-21turbostat22:14:561
477499531528,3cyclictest28219-21turbostat23:24:550
478599524521,3cyclictest4664-21turbostat19:14:543
477999496495,1cyclictest26850-21turbostat21:49:541
4779991918,1cyclictest67750irq/123-lan20:40:201
4779991818,0cyclictest67750irq/123-lan23:35:171
4779991818,0cyclictest67750irq/123-lan21:40:201
4779991818,0cyclictest67750irq/123-lan21:35:211
4779991817,1cyclictest67750irq/123-lan23:09:581
4779991817,1cyclictest67750irq/123-lan23:00:391
4779991817,1cyclictest67750irq/123-lan22:59:591
4779991817,1cyclictest67750irq/123-lan22:50:161
4779991817,1cyclictest67750irq/123-lan22:30:171
4774991816,2cyclictest762-21ntpd00:21:200
4779991717,0cyclictest67750irq/123-lan23:45:051
4779991717,0cyclictest67750irq/123-lan23:41:191
4779991717,0cyclictest67750irq/123-lan20:55:121
4779991717,0cyclictest67750irq/123-lan20:20:201
4779991716,1cyclictest67750irq/123-lan23:55:171
4779991716,1cyclictest67750irq/123-lan23:50:001
4779991716,1cyclictest67750irq/123-lan23:26:141
4779991716,1cyclictest67750irq/123-lan20:35:111
4779991716,1cyclictest67750irq/123-lan20:25:161
4774991716,1cyclictest762-21ntpd21:56:060
4782991614,2cyclictest762-21ntpd23:21:032
4779991616,0cyclictest67750irq/123-lan20:31:541
4779991615,1cyclictest67750irq/123-lan23:30:061
4779991615,1cyclictest67750irq/123-lan20:45:141
4779991615,1cyclictest67750irq/123-lan19:22:061
4779991515,0cyclictest67750irq/123-lan19:25:071
4779991514,1cyclictest67750irq/123-lan19:45:181
4779991514,1cyclictest67750irq/123-lan19:35:121
4779991313,0cyclictest67750irq/123-lan20:50:201
4779991313,0cyclictest67750irq/123-lan19:30:221
4779991312,1cyclictest67750irq/123-lan21:00:121
4779991211,1cyclictest67750irq/123-lan21:09:591
4779991110,1cyclictest67750irq/123-lan19:50:201
4779991110,1cyclictest67750irq/123-lan19:15:141
477499109,1cyclictest20278-21ntp_kernel_err22:40:170
47859998,1cyclictest782-21lldpd00:10:143
47829998,1cyclictest784-21snmpd21:04:552
47829998,1cyclictest31803-21cut20:14:592
47749998,1cyclictest784-21snmpd22:20:440
47749998,1cyclictest784-21snmpd21:22:400
47749998,1cyclictest784-21snmpd00:15:270
47749998,1cyclictest784-21snmpd00:07:210
47749998,1cyclictest782-21lldpd23:57:420
47749996,3cyclictest762-21ntpd21:34:200
47859988,0cyclictest784-21snmpd22:15:213
47859988,0cyclictest784-21snmpd20:45:413
47859988,0cyclictest784-21snmpd19:30:483
47859988,0cyclictest782-21lldpd23:43:343
47859987,1cyclictest784-21snmpd21:24:373
47859987,1cyclictest526-21avahi-daemon00:04:253
47859986,2cyclictest784-21snmpd23:49:093
47829988,0cyclictest784-21snmpd21:53:232
47829988,0cyclictest784-21snmpd21:11:432
47829988,0cyclictest782-21lldpd23:09:272
47829988,0cyclictest782-21lldpd20:18:492
47829988,0cyclictest782-21lldpd20:06:572
47829988,0cyclictest782-21lldpd19:53:572
47829987,1cyclictest784-21snmpd21:29:372
47829987,1cyclictest784-21snmpd21:05:542
47829987,1cyclictest526-21avahi-daemon23:28:462
47829987,1cyclictest526-21avahi-daemon21:48:182
47829987,1cyclictest526-21avahi-daemon21:38:012
47829987,1cyclictest526-21avahi-daemon00:24:072
47829986,2cyclictest784-21snmpd23:01:252
47829986,2cyclictest784-21snmpd19:42:232
47829986,2cyclictest762-21ntpd21:15:122
47829986,2cyclictest762-21ntpd19:25:112
47749988,0cyclictest784-21snmpd20:00:440
47749988,0cyclictest784-21snmpd19:49:110
47749987,1cyclictest784-21snmpd20:05:020
47749987,1cyclictest782-21lldpd23:15:530
47749986,2cyclictest784-21snmpd22:30:000
47749986,2cyclictest784-21snmpd20:50:290
47749986,2cyclictest762-21ntpd23:05:250
47749986,2cyclictest762-21ntpd23:02:230
47749986,2cyclictest762-21ntpd22:57:430
47749986,2cyclictest762-21ntpd22:11:200
47749986,2cyclictest762-21ntpd21:53:300
47749986,2cyclictest762-21ntpd21:39:300
47749986,2cyclictest762-21ntpd00:32:330
47749986,2cyclictest762-21ntpd00:12:430
47749985,3cyclictest784-21snmpd21:27:100
47859977,0cyclictest784-21snmpd21:25:553
47859977,0cyclictest782-21lldpd21:03:173
47859975,2cyclictest784-21snmpd23:57:213
47859975,2cyclictest784-21snmpd21:05:363
47859975,2cyclictest784-21snmpd20:27:503
47859975,2cyclictest784-21snmpd20:11:253
47859974,2cyclictest245-20systemd-journal23:29:283
47859973,3cyclictest31722-21ssh23:22:373
47859973,3cyclictest14011-21ssh00:39:153
47829977,0cyclictest784-21snmpd22:05:332
47829977,0cyclictest784-21snmpd19:45:072
47829977,0cyclictest784-21snmpd00:10:572
47829977,0cyclictest782-21lldpd22:02:192
47829977,0cyclictest782-21lldpd00:35:542
47829977,0cyclictest782-21lldpd00:09:062
47829976,1cyclictest784-21snmpd22:24:412
47829976,1cyclictest784-21snmpd21:23:522
47829976,1cyclictest762-21ntpd22:40:172
47829976,1cyclictest22752-21tail00:15:222
47829975,2cyclictest784-21snmpd23:32:132
47829975,2cyclictest784-21snmpd00:28:092
47829973,3cyclictest24568-21ssh23:46:032
47749976,1cyclictest784-21snmpd21:41:350
47749976,1cyclictest784-21snmpd19:16:280
47749976,1cyclictest526-21avahi-daemon21:17:060
47749975,2cyclictest784-21snmpd20:46:450
47749975,2cyclictest762-21ntpd22:34:510
47749975,2cyclictest762-21ntpd00:35:350
47859966,0cyclictest782-21lldpd19:39:543
47859965,1cyclictest784-21snmpd22:39:243
47859964,2cyclictest784-21snmpd22:45:073
47859964,2cyclictest784-21snmpd22:45:073
47859963,3cyclictest762-21ntpd20:08:043
47859963,3cyclictest32312-21ssh21:50:063
47859962,3cyclictest7182-21ssh21:56:053
47859962,3cyclictest29615-21ssh00:22:343
47859962,3cyclictest25982-21ssh21:12:393
47859962,3cyclictest25083-21ssh23:15:383
47859962,3cyclictest24829-21ssh00:18:083
47859962,3cyclictest1997-21ssh00:26:573
47859962,3cyclictest12503-21ssh00:05:243
47859962,3cyclictest11153-21ntpq22:00:143
47829966,0cyclictest784-21snmpd22:56:522
47829965,1cyclictest782-21lldpd19:59:182
47829965,1cyclictest26031-21cpuspeed_turbos22:15:132
47829965,1cyclictest245-20systemd-journal22:49:542
47829965,1cyclictest245-20systemd-journal22:49:542
47829964,2cyclictest762-21ntpd19:20:122
47829963,2cyclictest8298-21ssh00:33:302
47829963,2cyclictest245-20systemd-journal22:52:052
47829962,3cyclictest8156-21ssh21:57:262
47829962,3cyclictest27390-21gpgv20:05:002
47829962,3cyclictest20269-21ssh23:11:092
47829962,3cyclictest17829-21hddtemp_smartct23:40:142
47749964,2cyclictest762-21ntpd23:11:070
47749963,2cyclictest1605-21ssh00:26:260
47859954,1cyclictest0-21swapper/321:15:123
47859953,2cyclictest784-21snmpd22:40:253
47859953,2cyclictest784-21snmpd20:00:023
47859953,2cyclictest784-21snmpd19:55:383
47859953,2cyclictest762-21ntpd22:33:293
47859953,2cyclictest31242-21kworker/u16:1+nfsiod22:21:353
47859952,3cyclictest6907-21ssh23:30:113
47859952,3cyclictest547-21NetworkManager20:50:463
47859952,3cyclictest2477-21ntpq20:20:163
47859952,2cyclictest6535-21ssh00:31:033
47859952,2cyclictest574-21rs:main3
47829954,1cyclictest784-21snmpd21:43:192
47829954,1cyclictest762-21ntpd23:35:022
47829954,1cyclictest4019-21gltestperf20:25:132
47829953,2cyclictest762-21ntpd20:20:132
47829952,3cyclictest23581-21grep23:15:142
47829952,2cyclictest11215-21ssh21:30:012
47749952,2cyclictest31001-21ps20:10:170
47749952,2cyclictest10696-21pmu-power20:40:170
47859940,3cyclictest32358-21fw_forwarded_lo20:15:153
47829944,0cyclictest0-21swapper/220:30:162
47829941,2cyclictest15494-21grep19:35:112
47829940,3cyclictest13768-21fw_conntrack19:30:142
47749941,3cyclictest9285-21cat19:20:000
47749940,4cyclictest5691-21ntpq19:10:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional