You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-16 - 09:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Wed Sep 16, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450790,0irq/25-eth10-21swapper/318:43:293
810023425,0sleep20-21swapper/218:39:562
831922622,0sleep00-21swapper/018:42:270
806722521,0sleep10-21swapper/118:39:311
8501991010,0cyclictest3514-21snmpd22:18:230
85049960,0cyclictest13933-21munin-node22:29:072
339960,0migration/37649-21idleruntime21:04:023
339960,0migration/34968-21kthreadcore23:24:033
339960,0migration/34896-21sh21:42:103
339960,0migration/325576-21sh23:57:123
339960,0migration/316403-21sh00:10:053
29715060,0irq/26-eth0-rx-18984-21ssh22:29:543
29715060,0irq/26-eth0-rx-0-21swapper/323:59:043
149960,0migration/04746-21ntp_offset20:14:070
149960,0migration/030784-21sh20:58:380
149960,0migration/028647-21sh19:19:090
149960,0migration/011618-21sh22:04:590
149960,0migration/010940-21sh23:07:480
85049955,0cyclictest0-21swapper/221:09:392
85049950,0cyclictest0-21swapper/223:13:062
85049950,0cyclictest0-21swapper/221:30:382
85039955,0cyclictest0-21swapper/122:43:581
85039955,0cyclictest0-21swapper/121:36:101
85039954,0cyclictest3885-21awk19:04:031
85019955,0cyclictest0-21swapper/021:45:240
85019955,0cyclictest0-21swapper/021:26:390
85019955,0cyclictest0-21swapper/020:39:020
85019950,0cyclictest0-21swapper/021:40:220
85019950,0cyclictest0-21swapper/019:10:260
8215050,0irq/24-0000:00:31418-21latency_hist20:13:482
8215050,0irq/24-0000:00:29412-21munin-run19:23:482
35150,0ktimersoftd/30-21swapper/320:59:443
339950,0migration/38816-21taskset00:06:083
339950,0migration/38813-21kthreadcore22:44:043
339950,0migration/34933-21latency_hist19:53:483
339950,0migration/34488-21taskset21:19:273
339950,0migration/331548-21latency_hist20:13:483
339950,0migration/330254-21kthreadcore23:19:043
339950,0migration/329302-21runrttasks20:54:233
339950,0migration/328054-21taskset18:54:223
339950,0migration/325376-21latency22:54:033
339950,0migration/323766-21kthreadcore21:54:023
339950,0migration/32071-21kthreadcore20:39:033
339950,0migration/318458-21sh23:11:303
339950,0migration/317983-21kthreadcore21:29:033
339950,0migration/317383-21aten2.4-expect19:38:593
339950,0migration/314868-21taskset18:45:473
339950,0migration/312696-21aten_r1power_fr20:23:583
339950,0migration/31257-21kthreadcore22:39:053
29725050,0irq/27-eth0-tx-9229-21cut22:44:042
29725050,0irq/27-eth0-tx-7013-21munin-node20:44:000
29725050,0irq/27-eth0-tx-30245-21ssh21:18:322
29725050,0irq/27-eth0-tx-2928-21munin-node19:04:000
29725050,0irq/27-eth0-tx-21071-21munin-node22:14:072
29725050,0irq/27-eth0-tx-0-21swapper/223:50:012
29725050,0irq/27-eth0-tx-0-21swapper/222:23:142
29725050,0irq/27-eth0-tx-0-21swapper/222:07:462
29725050,0irq/27-eth0-tx-0-21swapper/221:01:342
29715050,0irq/26-eth0-rx-4193-21ssh22:01:463
29715050,0irq/26-eth0-rx-31435-21grep18:59:053
29715050,0irq/26-eth0-rx-22225-21irqcore22:14:033
29715050,0irq/26-eth0-rx-12150-21cat23:49:033
29715050,0irq/26-eth0-rx-0-21swapper/322:53:443
29715050,0irq/26-eth0-rx-0-21swapper/322:34:023
29715050,0irq/26-eth0-rx-0-21swapper/322:13:403
29715050,0irq/26-eth0-rx-0-21swapper/321:49:403
29715050,0irq/26-eth0-rx-0-21swapper/321:36:423
29715050,0irq/26-eth0-rx-0-21swapper/321:12:483
29715050,0irq/26-eth0-rx-0-21swapper/320:49:083
29715050,0irq/26-eth0-rx-0-21swapper/319:44:003
259950,0migration/2487-21kthreadcore19:49:042
259950,0migration/23259-21cpuspeed_turbos23:23:592
259950,0migration/229835-21kernelversion22:39:042
259950,0migration/227640-21gltestperf23:39:002
259950,0migration/220792-21sh20:49:102
259950,0migration/217525-21sh23:30:162
259950,0migration/217109-21kthreadcore22:49:052
259950,0migration/213335-21kthreadcore18:44:052
249950,0watchdog/212084-21diskstats19:59:022
179950,0migration/127801-21timerandwakeup18:54:101
179950,0migration/120756-21cpuspeed_turbos22:33:571
179950,0migration/118925-21kthreadcore20:49:051
179950,0migration/110996-21munin-node22:04:091
179950,0migration/110172-21kthreadcore20:19:061
179950,0migration/110019-21kthreadcore18:44:041
169950,0watchdog/119665-21fschecks_time23:34:011
149950,0migration/0876-21kthreadcore22:39:050
149950,0migration/05756-21hwlatdetect19:54:030
149950,0migration/03025-21kthreadcore21:19:050
149950,0migration/02622-21taskset23:23:360
149950,0migration/02617-21kthreadcore20:59:060
149950,0migration/025875-21kthreadcore21:54:030
149950,0migration/025650-21taskset23:57:250
149950,0migration/024342-21latency23:34:060
149950,0migration/022825-21fschecks_time21:34:020
149950,0migration/022330-21kthreadcore23:14:030
149950,0migration/021207-21kthreadcore19:39:060
149950,0migration/020657-21sh22:33:560
149950,0migration/019222-21kthreadcore21:29:030
149950,0migration/018697-21sh22:50:340
149950,0migration/018194-21kthreadcore20:49:050
149950,0migration/015319-21kthreadcore22:29:080
149950,0migration/013614-21latency_hist21:48:470
149950,0migration/013229-21fschecks_time20:24:000
149950,0migration/012091-21kthreadcore19:34:050
85049943,0cyclictest4920-21awk19:29:042
85049943,0cyclictest3556-21lldpd20:23:392
85049943,0cyclictest3419-21awk23:44:002
85049943,0cyclictest30983-21awk21:39:012
85049943,0cyclictest23100-21awk21:34:042
85049943,0cyclictest21476-21awk22:34:002
85049943,0cyclictest20170-21awk20:29:022
85049943,0cyclictest13580-21awk20:24:022
85039944,0cyclictest0-21swapper/122:08:481
85039943,0cyclictest6643-21awk21:44:021
85039943,0cyclictest4734-21sadc19:53:481
85039943,0cyclictest3556-21lldpd23:49:101
85039943,0cyclictest3556-21lldpd21:09:391
85039943,0cyclictest3556-21lldpd20:44:091
85039943,0cyclictest3556-21lldpd20:30:091
85039943,0cyclictest3556-21lldpd20:05:081
85039943,0cyclictest3556-21lldpd19:14:361
85039943,0cyclictest3556-21lldpd19:02:061
85039943,0cyclictest3556-21lldpd18:50:051
85039943,0cyclictest3556-21lldpd00:02:091
85039943,0cyclictest3514-21snmpd21:49:261
85039943,0cyclictest22484-21awk21:54:001
85039943,0cyclictest21925-21awk22:14:011
85039943,0cyclictest2166-21sadc23:43:461
85039943,0cyclictest18192-21awk19:39:031
85039943,0cyclictest11506-21awk19:34:031
85039943,0cyclictest10849-21awk00:09:011
85039943,0cyclictest0-21swapper/100:08:281
85039940,0cyclictest0-21swapper/122:22:121
85019944,0cyclictest17143-21ntpq19:59:090
85019944,0cyclictest0-21swapper/023:32:080
85019944,0cyclictest0-21swapper/022:27:400
85019944,0cyclictest0-21swapper/022:18:590
85019943,0cyclictest9620-21awk18:44:030
85019943,0cyclictest7752-21awk21:04:030
85019943,0cyclictest3556-21lldpd23:48:100
85019943,0cyclictest3556-21lldpd22:55:100
85019943,0cyclictest3241-21irqbalance23:39:050
85019943,0cyclictest3241-21irqbalance23:23:550
85019943,0cyclictest31411-21sadc20:13:480
85019943,0cyclictest22948-21awk18:54:030
85019943,0cyclictest20155-21awk20:29:020
85019943,0cyclictest19295-21awk20:04:030
85019943,0cyclictest15670-21awk21:09:050
339940,0migration/37686-21kthreadcore21:24:043
339940,0migration/35970-21kthreadcore19:04:053
339940,0migration/331819-21kthreadcore19:24:053
339940,0migration/325883-21diskmemload23:14:573
339940,0migration/312399-21mdstat20:44:063
29725040,0irq/27-eth0-tx-29670-21aten_r1power_po21:58:572
29725040,0irq/27-eth0-tx-23011-21ssh20:53:492
29725040,0irq/27-eth0-tx-21611-21ssh21:53:552
29725040,0irq/27-eth0-tx-16219-21ssh00:09:312
29725040,0irq/27-eth0-tx-0-21swapper/223:58:512
29725040,0irq/27-eth0-tx-0-21swapper/223:53:492
29725040,0irq/27-eth0-tx-0-21swapper/223:34:012
29725040,0irq/27-eth0-tx-0-21swapper/223:18:512
29725040,0irq/27-eth0-tx-0-21swapper/223:14:272
29725040,0irq/27-eth0-tx-0-21swapper/223:05:442
29725040,0irq/27-eth0-tx-0-21swapper/222:59:382
29725040,0irq/27-eth0-tx-0-21swapper/222:54:032
29725040,0irq/27-eth0-tx-0-21swapper/222:24:212
29725040,0irq/27-eth0-tx-0-21swapper/221:49:482
29725040,0irq/27-eth0-tx-0-21swapper/020:38:050
29725040,0irq/27-eth0-tx-0-21swapper/019:13:590
29715040,0irq/26-eth0-rx-0-21swapper/323:44:503
29715040,0irq/26-eth0-rx-0-21swapper/323:39:073
29715040,0irq/26-eth0-rx-0-21swapper/323:35:503
29715040,0irq/26-eth0-rx-0-21swapper/323:29:363
29715040,0irq/26-eth0-rx-0-21swapper/323:06:023
29715040,0irq/26-eth0-rx-0-21swapper/322:59:053
29715040,0irq/26-eth0-rx-0-21swapper/322:26:063
29715040,0irq/26-eth0-rx-0-21swapper/322:18:523
29715040,0irq/26-eth0-rx-0-21swapper/322:04:023
29715040,0irq/26-eth0-rx-0-21swapper/321:44:073
29715040,0irq/26-eth0-rx-0-21swapper/321:15:083
29715040,0irq/26-eth0-rx-0-21swapper/320:14:073
29715040,0irq/26-eth0-rx-0-21swapper/319:29:063
259940,0migration/27788-21sh20:44:012
259940,0migration/27703-21kthreadcore19:54:062
259940,0migration/25636-21latency_hist21:43:472
259940,0migration/23781-21nfs4_client21:19:062
259940,0migration/231762-21kthreadcore19:24:052
259940,0migration/225917-21latency_hist20:33:482
259940,0migration/21916-21taskset00:03:592
259940,0migration/217049-21gltestperf19:14:022
259940,0migration/214455-21kernelversion22:09:022
259940,0migration/210956-21kthreadcore21:24:052
249940,0watchdog/2356-21cut18:59:062
249940,0watchdog/232658-21aten_r1power_cu20:38:582
249940,0watchdog/224097-21switchtime20:04:102
249940,0watchdog/215890-21kthreadcore19:34:062
249940,0watchdog/210681-21sed19:09:022
249940,0watchdog/20-21swapper/221:04:052
179940,0migration/18517-21kthreadcore23:04:041
179940,0migration/18281-21rt-features23:44:061
179940,0migration/16691-21kthreadcore19:29:061
179940,0migration/1482-21munin-node20:14:041
179940,0migration/1466-21kthreadcore19:24:051
179940,0migration/12885-21kthreadcore21:39:041
179940,0migration/127352-21kthreadcore20:34:071
179940,0migration/126251-21kthreadcore19:44:061
179940,0migration/125762-21kthreadcore20:54:051
179940,0migration/12428-21sh22:39:451
179940,0migration/123813-21munin-node19:19:021
179940,0migration/120542-21fschecks_count22:53:591
179940,0migration/117384-21kthreadcore22:29:081
179940,0migration/115947-21kthreadcore20:24:041
179940,0migration/115147-21if_eth1.221:29:011
179940,0migration/111654-21missed_timers21:24:061
169940,0watchdog/1572-21grep20:59:051
169940,0watchdog/132634-21kthreadcore23:19:051
169940,0watchdog/130330-21kthreadcore22:59:051
169940,0watchdog/114272-21kthreadcore19:59:061
169940,0watchdog/113437-21ssh21:05:451
169940,0watchdog/110542-21timerandwakeup22:24:091
169940,0watchdog/10-21swapper/123:29:051
169940,0watchdog/10-21swapper/123:09:051
169940,0watchdog/10-21swapper/122:49:051
169940,0watchdog/10-21swapper/121:58:571
169940,0watchdog/10-21swapper/121:14:051
149940,0migration/032538-21kthreadcore21:59:030
149940,0migration/027599-21kthreadcore19:44:060
149940,0migration/024550-21kthreadcore21:14:040
149940,0migration/017936-21runrttasks23:09:550
149940,0migration/017728-21sh23:52:280
149940,0migration/010925-21kthreadcore20:19:060
85049932,0cyclictest3556-21lldpd20:17:392
85049932,0cyclictest3556-21lldpd19:05:362
85049932,0cyclictest24316-21df19:44:012
85049932,0cyclictest16298-21awk18:49:042
85049930,0cyclictest23020-21iostat_ios18:54:042
85039932,0cyclictest3556-21lldpd21:23:091
85039932,0cyclictest3556-21lldpd20:11:381
85039932,0cyclictest3556-21lldpd19:55:081
85039932,0cyclictest23541-21kthreadcore23:14:031
85039932,0cyclictest10309-21fschecks_time19:08:591
85019933,0cyclictest3211-21kworker/0:219:48:490
85019933,0cyclictest3211-21kworker/0:219:28:510
85019933,0cyclictest3211-21kworker/0:219:23:510
85019933,0cyclictest3211-21kworker/0:218:58:490
85019933,0cyclictest3211-21kworker/0:218:48:490
85019933,0cyclictest12173-21kworker/0:123:58:580
85019933,0cyclictest12173-21kworker/0:122:58:480
85019933,0cyclictest12173-21kworker/0:100:08:500
85019933,0cyclictest12173-21kworker/0:100:03:500
85019933,0cyclictest1007-21kworker/0:022:43:480
85019933,0cyclictest1007-21kworker/0:022:08:540
29715030,0irq/26-eth0-rx-0-21swapper/320:34:023
29715030,0irq/26-eth0-rx-0-21swapper/320:28:593
29715030,0irq/26-eth0-rx-0-21swapper/320:22:343
29715030,0irq/26-eth0-rx-0-21swapper/320:03:483
29715030,0irq/26-eth0-rx-0-21swapper/319:59:003
29715030,0irq/26-eth0-rx-0-21swapper/319:48:583
29715030,0irq/26-eth0-rx-0-21swapper/319:08:573
29715030,0irq/26-eth0-rx-0-21swapper/318:51:283
249930,0watchdog/220425-21kthreadcore19:39:062
169930,0watchdog/132659-21aten_r1power_cu20:38:581
169930,0watchdog/10-21swapper/123:53:491
169930,0watchdog/10-21swapper/123:24:011
29715020,0irq/26-eth0-rx-0-21swapper/319:33:523
29715020,0irq/26-eth0-rx-0-21swapper/319:19:013
29715020,0irq/26-eth0-rx-0-21swapper/319:15:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional