You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 05:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Apr 23, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450560,0irq/25-eth10-21swapper/318:56:123
1445423824,0sleep00-21swapper/018:54:510
1452623526,0sleep20-21swapper/218:55:412
1435423323,0sleep10-21swapper/118:53:401
339960,0migration/324739-21timerandwakeup23:43:023
339960,0migration/312438-21sh22:17:453
339960,0migration/312204-21sh21:15:163
29725060,0irq/27-eth0-tx-21632-21munin-node19:02:530
29715060,0irq/26-eth0-rx-20038-21smartctl23:22:543
29715060,0irq/26-eth0-rx-10840-21diskstats23:57:543
147709966,0cyclictest0-21swapper/122:36:361
147709960,0cyclictest0-21swapper/122:23:591
149960,0migration/02550-21ntp_offset21:28:000
149960,0migration/01764-21sh23:09:160
8215050,0irq/24-0000:00:29971-21sadc19:57:412
339950,0migration/38955-21needreboot19:38:003
339950,0migration/36210-21kthreadcore23:52:593
339950,0migration/34819-21munin-node22:12:543
339950,0migration/34588-21aten_r1power_en20:02:523
339950,0migration/3444-21kthreadcore20:22:583
339950,0migration/331686-21kthreadcore19:57:583
339950,0migration/32989-21diskmemload22:30:323
339950,0migration/329442-21irqrtprio19:07:563
339950,0migration/328693-21fschecks_time22:47:533
339950,0migration/328498-21kthreadcore23:47:593
339950,0migration/326686-21irqrtprio20:42:583
339950,0migration/324926-21kthreadcore19:52:583
339950,0migration/320966-21latency_hist21:02:413
339950,0migration/317865-21runrttasks22:58:123
339950,0migration/317824-21latency_hist20:12:413
339950,0migration/315871-21kthreadcore21:57:583
339950,0migration/314677-21kthreadcore20:32:573
339950,0migration/313924-21kthreadcore23:17:583
29725050,0irq/27-eth0-tx-9508-21ssh23:13:152
29725050,0irq/27-eth0-tx-4072-21ssh22:12:182
29725050,0irq/27-eth0-tx-3778-21kthreadcore23:52:582
29725050,0irq/27-eth0-tx-28024-21munin-node22:48:022
29725050,0irq/27-eth0-tx-27121-21which21:23:012
29725050,0irq/27-eth0-tx-20914-21ssh21:02:392
29725050,0irq/27-eth0-tx-20796-21munin-node22:02:542
29725050,0irq/27-eth0-tx-17121-21ssh00:21:022
29725050,0irq/27-eth0-tx-11288-21munin-node23:17:572
29725050,0irq/27-eth0-tx-0-21swapper/222:43:252
29725050,0irq/27-eth0-tx-0-21swapper/222:00:152
29725050,0irq/27-eth0-tx-0-21swapper/020:07:000
29725050,0irq/27-eth0-tx-0-21swapper/019:01:170
29715050,0irq/26-eth0-rx-3915-21uniq23:12:543
29715050,0irq/26-eth0-rx-3542-21lldpd23:08:003
29715050,0irq/26-eth0-rx-28539-21sh21:06:103
29715050,0irq/26-eth0-rx-28530-21cut23:27:583
29715050,0irq/26-eth0-rx-21727-21if_eth122:02:563
29715050,0irq/26-eth0-rx-19185-21swap21:18:043
29715050,0irq/26-eth0-rx-12173-21python20:53:033
29715050,0irq/26-eth0-rx-0-21swapper/323:36:183
29715050,0irq/26-eth0-rx-0-21swapper/322:54:243
29715050,0irq/26-eth0-rx-0-21swapper/322:42:553
29715050,0irq/26-eth0-rx-0-21swapper/322:37:563
29715050,0irq/26-eth0-rx-0-21swapper/322:36:363
29715050,0irq/26-eth0-rx-0-21swapper/322:23:193
29715050,0irq/26-eth0-rx-0-21swapper/322:08:513
29715050,0irq/26-eth0-rx-0-21swapper/321:48:043
29715050,0irq/26-eth0-rx-0-21swapper/321:31:053
29715050,0irq/26-eth0-rx-0-21swapper/300:18:403
29715050,0irq/26-eth0-rx-0-21swapper/300:14:433
259950,0migration/28270-21munin-node19:13:022
259950,0migration/25783-21taskset00:12:582
259950,0migration/2480-21kthreadcore19:57:582
259950,0migration/23792-21sh21:29:492
259950,0migration/227090-21latency_hist23:27:412
259950,0migration/219768-21sh21:39:402
259950,0migration/219309-21kthreadcore00:22:572
259950,0migration/213982-21kthreadcore20:07:582
179950,0migration/15502-21kthreadcore22:52:571
169950,0watchdog/115213-21cut23:17:591
147719955,0cyclictest0-21swapper/220:12:592
147709955,0cyclictest12934-21diskmemload23:45:011
147709955,0cyclictest0-21swapper/123:33:591
147709955,0cyclictest0-21swapper/122:21:181
147709954,0cyclictest28029-21sadc19:07:411
147709950,0cyclictest0-21swapper/123:52:161
147709950,0cyclictest0-21swapper/122:57:531
147709950,0cyclictest0-21swapper/122:00:201
147709950,0cyclictest0-21swapper/121:16:591
147709950,0cyclictest0-21swapper/100:24:261
147709950,0cyclictest0-21swapper/100:04:531
147699955,0cyclictest23369-21kworker/0:123:20:500
147699955,0cyclictest12934-21diskmemload21:06:060
149950,0migration/09073-21kthreadcore20:27:590
149950,0migration/06514-21kthreadcore22:12:580
149950,0migration/05214-21kthreadcore19:12:580
149950,0migration/04119-21irqrtprio23:32:570
149950,0migration/04109-21latency20:22:590
149950,0migration/031874-21kthreadcore19:32:580
149950,0migration/030992-21kthreadcore22:47:570
149950,0migration/030692-21kthreadcore21:47:580
149950,0migration/029478-21sh22:27:580
149950,0migration/027029-21sh22:45:340
149950,0migration/026946-21kthreadcore20:17:580
149950,0migration/025041-21kthreadcore19:52:580
149950,0migration/023053-21kthreadcore20:12:580
149950,0migration/021874-21kthreadcore20:37:570
149950,0migration/021739-21kthreadcore00:22:570
149950,0migration/018988-21taskset22:19:050
149950,0migration/016938-21kthreadcore20:57:590
149950,0migration/016799-21latency_hist19:47:410
149950,0migration/013608-21kthreadcore00:17:580
149950,0migration/012989-21hwlatdetect20:32:550
149950,0migration/012720-21taskset20:55:190
149950,0migration/01246-21sh23:28:540
8215040,0irq/24-0000:00:0-21swapper/219:37:412
339940,0migration/331260-21kthreadcore00:07:583
339940,0migration/328785-21taskset19:29:543
339940,0migration/325758-21kthreadcore21:42:583
339940,0migration/323806-21kthreadcore20:37:583
339940,0migration/322506-21rt-features19:48:053
339940,0migration/321632-21cpuspeed_turbos21:22:523
339940,0migration/310839-21kthreadcore19:17:583
29725040,0irq/27-eth0-tx-3644-21ssh22:52:472
29725040,0irq/27-eth0-tx-28970-21kthreadcore00:07:572
29725040,0irq/27-eth0-tx-14721-21ssh21:17:582
29725040,0irq/27-eth0-tx-0-21swapper/223:47:452
29725040,0irq/27-eth0-tx-0-21swapper/223:42:572
29725040,0irq/27-eth0-tx-0-21swapper/223:02:492
29725040,0irq/27-eth0-tx-0-21swapper/222:38:162
29725040,0irq/27-eth0-tx-0-21swapper/222:32:572
29725040,0irq/27-eth0-tx-0-21swapper/222:23:562
29725040,0irq/27-eth0-tx-0-21swapper/221:52:442
29725040,0irq/27-eth0-tx-0-21swapper/200:02:512
29715040,0irq/26-eth0-rx-0-21swapper/323:37:593
29715040,0irq/26-eth0-rx-0-21swapper/323:02:583
29715040,0irq/26-eth0-rx-0-21swapper/321:52:593
29715040,0irq/26-eth0-rx-0-21swapper/321:39:193
29715040,0irq/26-eth0-rx-0-21swapper/321:32:583
29715040,0irq/26-eth0-rx-0-21swapper/321:10:023
29715040,0irq/26-eth0-rx-0-21swapper/320:22:293
29715040,0irq/26-eth0-rx-0-21swapper/319:12:533
29715040,0irq/26-eth0-rx-0-21swapper/300:24:373
29715040,0irq/26-eth0-rx-0-21swapper/300:03:443
259940,0migration/29374-21kthreadcore21:32:582
259940,0migration/26324-21kthreadcore22:12:582
259940,0migration/231272-21kthreadcore21:47:582
259940,0migration/224448-21kthreadcore19:02:582
259940,0migration/223173-21kthreadcore21:02:592
259940,0migration/218580-21kthreadcore19:22:582
259940,0migration/218446-21kthreadcore18:57:562
259940,0migration/215947-21kthreadcore20:32:582
259940,0migration/215758-21kthreadcore23:37:582
259940,0migration/215706-21runrttasks19:22:282
259940,0migration/213879-21kthreadcore22:57:572
249940,0watchdog/2984-21sensors23:08:032
249940,0watchdog/230320-21tr22:27:592
249940,0watchdog/225181-21chrt20:41:322
249940,0watchdog/20-21swapper/223:57:592
249940,0watchdog/20-21swapper/221:43:112
179940,0migration/14340-21hwlatdetect19:37:561
179940,0migration/12757-21kthreadcore20:47:591
179940,0migration/126988-21kthreadcore20:42:581
179940,0migration/123282-21kthreadcore23:22:581
179940,0migration/123009-21kthreadcore22:42:581
179940,0migration/12122-21taskset19:10:301
179940,0migration/119540-21fschecks_time20:37:531
179940,0migration/118702-21pmu-power21:38:011
179940,0migration/115526-21kthreadcore20:32:581
179940,0migration/113742-21kthreadcore23:37:581
179940,0migration/112337-21kthreadcore19:42:591
179940,0migration/112062-21munin-node20:07:561
169940,0watchdog/19583-21ssh23:56:031
169940,0watchdog/116801-21cut18:57:561
169940,0watchdog/10-21swapper/122:27:591
169940,0watchdog/10-21swapper/119:28:001
169940,0watchdog/10-21swapper/100:12:591
147719943,0cyclictest3727-21awk23:32:552
147719943,0cyclictest3556-21lldpd21:14:302
147719943,0cyclictest3514-21snmpd22:17:532
147719943,0cyclictest3514-21snmpd20:27:532
147719943,0cyclictest3514-21snmpd20:23:082
147719943,0cyclictest3514-21snmpd20:18:082
147719943,0cyclictest3514-21snmpd20:02:532
147719943,0cyclictest30386-21awk21:07:552
147719943,0cyclictest29044-21grep19:32:412
147719943,0cyclictest26389-21awk20:42:562
147719943,0cyclictest20193-21awk23:22:562
147709944,0cyclictest0-21swapper/122:38:291
147709944,0cyclictest0-21swapper/121:25:291
147709944,0cyclictest0-21swapper/121:08:281
147709944,0cyclictest0-21swapper/121:04:121
147709943,0cyclictest5659-21awk21:52:551
147709943,0cyclictest5419-21awk22:12:561
147709943,0cyclictest3556-21lldpd22:09:301
147709943,0cyclictest3556-21lldpd21:35:001
147709943,0cyclictest3556-21lldpd21:19:301
147709943,0cyclictest3556-21lldpd20:06:001
147709943,0cyclictest3556-21lldpd00:12:311
147709943,0cyclictest3514-21snmpd22:48:231
147709943,0cyclictest3514-21snmpd20:29:381
147709943,0cyclictest3514-21snmpd19:36:531
147709943,0cyclictest3514-21snmpd19:22:521
147709943,0cyclictest3241-21irqbalance23:27:591
147709943,0cyclictest3241-21irqbalance23:17:391
147709943,0cyclictest3241-21irqbalance21:47:591
147709943,0cyclictest3241-21irqbalance21:43:491
147709943,0cyclictest28467-21awk23:07:561
147709943,0cyclictest24403-21awk19:52:561
147709943,0cyclictest20447-21sort23:02:541
147709943,0cyclictest14181-21awk20:57:571
147699944,0cyclictest23369-21kworker/0:123:37:500
147699944,0cyclictest23369-21kworker/0:123:23:220
147699944,0cyclictest23369-21kworker/0:123:13:200
147699944,0cyclictest23369-21kworker/0:123:02:500
147699944,0cyclictest23369-21kworker/0:122:58:440
147699944,0cyclictest23369-21kworker/0:122:52:500
147699944,0cyclictest23369-21kworker/0:122:32:500
147699944,0cyclictest23369-21kworker/0:122:22:420
147699944,0cyclictest23369-21kworker/0:122:07:440
147699944,0cyclictest23369-21kworker/0:121:52:440
147699944,0cyclictest23369-21kworker/0:121:42:440
147699944,0cyclictest23369-21kworker/0:121:38:040
147699944,0cyclictest23369-21kworker/0:121:32:560
147699944,0cyclictest23369-21kworker/0:121:22:450
147699944,0cyclictest23369-21kworker/0:121:17:490
147699944,0cyclictest23369-21kworker/0:121:12:430
147699944,0cyclictest23369-21kworker/0:121:11:110
147699944,0cyclictest23369-21kworker/0:120:47:550
147699944,0cyclictest23369-21kworker/0:119:57:550
147699944,0cyclictest23369-21kworker/0:119:43:050
147699944,0cyclictest23369-21kworker/0:119:38:030
147699944,0cyclictest11654-21kworker/0:023:59:080
147699944,0cyclictest11654-21kworker/0:023:53:320
147699944,0cyclictest11654-21kworker/0:023:47:440
147699944,0cyclictest11654-21kworker/0:023:43:180
147699944,0cyclictest11654-21kworker/0:000:13:000
147699944,0cyclictest11654-21kworker/0:000:02:480
147699943,0cyclictest21664-21awk22:02:550
147699943,0cyclictest13625-21awk21:57:550
149940,0migration/031886-21diskmemload00:07:590
149940,0migration/023302-21gltestperf19:27:550
149940,0migration/014034-21kthreadcore22:37:570
149940,0migration/013120-21kthreadcore19:17:590
339930,0migration/317000-21irqcore19:22:573
29715030,0irq/26-eth0-rx-0-21swapper/320:48:023
29715030,0irq/26-eth0-rx-0-21swapper/320:28:013
29715030,0irq/26-eth0-rx-0-21swapper/320:07:523
29715030,0irq/26-eth0-rx-0-21swapper/319:33:413
29715030,0irq/26-eth0-rx-0-21swapper/319:05:543
29715030,0irq/26-eth0-rx-0-21swapper/319:00:343
249930,0watchdog/20-21swapper/220:47:592
249930,0watchdog/20-21swapper/219:07:522
179930,0migration/110436-21irqcore19:17:571
169930,0watchdog/10-21swapper/121:27:591
169930,0watchdog/10-21swapper/119:47:441
147719932,0cyclictest7388-21awk20:52:562
147719932,0cyclictest3514-21snmpd19:35:082
147719932,0cyclictest11083-21awk19:42:572
147719930,0cyclictest17280-21diskstats19:47:552
147709932,0cyclictest3556-21lldpd20:18:301
147709932,0cyclictest3556-21lldpd19:13:001
147709932,0cyclictest3514-21snmpd20:52:531
147709932,0cyclictest3514-21snmpd00:17:531
147709932,0cyclictest32103-21awk20:22:561
147709932,0cyclictest31161-21awk19:57:571
147709932,0cyclictest18786-21awk20:12:551
147709932,0cyclictest11435-21awk23:57:571
147709930,0cyclictest21201-21diskstats22:02:541
147699933,0cyclictest23369-21kworker/0:120:42:550
147699933,0cyclictest23369-21kworker/0:120:08:030
147699933,0cyclictest14991-21kworker/0:219:22:430
147699933,0cyclictest14991-21kworker/0:219:07:510
339920,0migration/311249-21iostat_ios19:42:583
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional