You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 15:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed Apr 22, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450350,0irq/25-eth10-21swapper/306:53:293
304450350,0irq/25-eth10-21swapper/306:53:293
1409823324,0sleep20-21swapper/206:57:422
1409823324,0sleep20-21swapper/206:57:422
1394923322,0sleep00-21swapper/006:56:000
1394923322,0sleep00-21swapper/006:56:000
1380023228,0sleep10-21swapper/106:54:131
1380023228,0sleep10-21swapper/106:54:131
8215060,0irq/24-0000:00:28298-21sleep10:07:442
339960,0migration/38133-21kthreadcore11:13:003
339960,0migration/332645-21munin-node08:48:003
339960,0migration/32893-21sh10:09:453
339960,0migration/327845-21taskset10:27:103
339960,0migration/326210-21munin-node10:03:033
339960,0migration/315913-21kthreadcore10:38:003
339960,0migration/312127-21sh09:37:053
29725060,0irq/27-eth0-tx-23005-21munin-node07:53:040
29715060,0irq/26-eth0-rx-3733-21sh09:11:263
29715060,0irq/26-eth0-rx-27311-21memory07:28:013
29715060,0irq/26-eth0-rx-0-21swapper/311:17:573
259960,0migration/29542-21sh11:33:342
141719966,0cyclictest12262-21diskmemload10:15:582
141719966,0cyclictest0-21swapper/210:59:202
141719960,0cyclictest0-21swapper/211:59:332
141719960,0cyclictest0-21swapper/209:25:312
141699966,0cyclictest0-21swapper/010:28:070
149960,0migration/09707-21sh11:13:130
149960,0migration/026842-21latency_hist12:07:430
149960,0migration/026542-21latency_hist12:27:430
149960,0migration/010456-21taskset09:13:070
339950,0migration/38773-21kthreadcore08:03:013
339950,0migration/37700-21kthreadcore08:28:013
339950,0migration/37496-21netstat07:13:043
339950,0migration/327838-21fschecks_time11:47:573
339950,0migration/325970-21irqcore08:43:013
339950,0migration/321440-21sshd07:23:583
339950,0migration/318258-21aten2.4-expect08:37:553
339950,0migration/318206-21munin-node08:12:593
339950,0migration/313316-21idleruntime08:57:583
339950,0migration/312916-21fschecks_count09:57:563
339950,0migration/312198-21crond09:57:443
339950,0migration/311328-21cpuspeed_turbos11:57:553
29725050,0irq/27-eth0-tx-5620-21cut11:13:002
29725050,0irq/27-eth0-tx-26624-21ssh11:25:462
29725050,0irq/27-eth0-tx-24670-21missed_timers11:43:022
29725050,0irq/27-eth0-tx-18272-21sh09:58:052
29725050,0irq/27-eth0-tx-0-21swapper/212:02:532
29725050,0irq/27-eth0-tx-0-21swapper/211:17:592
29725050,0irq/27-eth0-tx-0-21swapper/211:05:022
29725050,0irq/27-eth0-tx-0-21swapper/210:17:582
29725050,0irq/27-eth0-tx-0-21swapper/209:48:132
29725050,0irq/27-eth0-tx-0-21swapper/209:18:022
29725050,0irq/27-eth0-tx-0-21swapper/008:57:530
29725050,0irq/27-eth0-tx-0-21swapper/008:29:580
29725050,0irq/27-eth0-tx-0-21swapper/008:12:560
29725050,0irq/27-eth0-tx-0-21swapper/007:14:060
29715050,0irq/26-eth0-rx-8875-21switchtime11:53:043
29715050,0irq/26-eth0-rx-31049-21grep08:22:573
29715050,0irq/26-eth0-rx-27930-21basename11:07:553
29715050,0irq/26-eth0-rx-2611-21ssh09:48:293
29715050,0irq/26-eth0-rx-24704-21ps12:03:033
29715050,0irq/26-eth0-rx-23536-21kthreadcore11:03:013
29715050,0irq/26-eth0-rx-22038-21cut09:03:013
29715050,0irq/26-eth0-rx-14392-21kthreadcore09:18:013
29715050,0irq/26-eth0-rx-11768-21ssh10:57:493
29715050,0irq/26-eth0-rx-0-21swapper/312:23:113
29715050,0irq/26-eth0-rx-0-21swapper/312:10:123
29715050,0irq/26-eth0-rx-0-21swapper/311:47:363
29715050,0irq/26-eth0-rx-0-21swapper/311:38:333
29715050,0irq/26-eth0-rx-0-21swapper/311:32:593
29715050,0irq/26-eth0-rx-0-21swapper/311:27:313
29715050,0irq/26-eth0-rx-0-21swapper/310:48:003
29715050,0irq/26-eth0-rx-0-21swapper/310:43:183
29715050,0irq/26-eth0-rx-0-21swapper/310:33:003
29715050,0irq/26-eth0-rx-0-21swapper/310:13:373
29715050,0irq/26-eth0-rx-0-21swapper/309:43:013
29715050,0irq/26-eth0-rx-0-21swapper/309:37:563
29715050,0irq/26-eth0-rx-0-21swapper/307:47:593
27150,0ktimersoftd/20-21swapper/210:34:062
259950,0migration/28621-21latency_hist07:17:452
259950,0migration/229245-21fschecks_time09:07:562
259950,0migration/229074-21kthreadcore07:08:012
259950,0migration/228757-21irqcore11:28:002
259950,0migration/228540-21sh10:07:502
259950,0migration/226170-21kthreadcore08:43:012
259950,0migration/222841-21kthreadcore07:03:002
259950,0migration/218344-21kthreadcore07:48:002
249950,0watchdog/225608-21kthreadcore09:03:022
249950,0watchdog/20-21swapper/207:22:552
179950,0migration/17773-21kthreadcore09:13:011
179950,0migration/16211-21munin-node08:52:561
179950,0migration/130654-21timerwakeupswit08:43:081
179950,0migration/129359-21fschecks_time07:32:581
179950,0migration/125175-21taskset12:23:471
179950,0migration/121111-21if_eth1.310:42:591
179950,0migration/120789-21munin-node07:23:021
179950,0migration/118230-21missed_timers09:18:021
179950,0migration/116504-21kthreadcore08:58:011
179950,0migration/114574-21timerwakeupswit07:18:061
179950,0migration/111572-21fschecks_count11:57:561
179950,0migration/110185-21munin-node09:33:021
169950,0watchdog/119768-21ssh10:42:341
169950,0watchdog/117500-21sed08:33:061
141719955,0cyclictest0-21swapper/211:49:182
141719955,0cyclictest0-21swapper/211:10:032
141719955,0cyclictest0-21swapper/209:36:342
141719955,0cyclictest0-21swapper/208:36:012
141719950,0cyclictest0-21swapper/210:44:502
141709955,0cyclictest0-21swapper/111:51:451
141709950,0cyclictest0-21swapper/112:09:151
141709950,0cyclictest0-21swapper/111:31:431
141699955,0cyclictest0-21swapper/008:02:550
141699950,0cyclictest12262-21diskmemload10:05:060
149950,0migration/06980-21kthreadcore11:52:590
149950,0migration/05135-21kthreadcore11:32:580
149950,0migration/0490-21pmu-power11:48:040
149950,0migration/030590-21taskset08:22:510
149950,0migration/030429-21taskset07:57:570
149950,0migration/030181-21kthreadcore11:08:000
149950,0migration/029800-21irqrtprio10:07:590
149950,0migration/02974-21sh09:09:360
149950,0migration/028907-21cpu09:47:560
149950,0migration/026787-21sh11:05:290
149950,0migration/025265-21fschecks_count08:42:580
149950,0migration/025248-21sh11:43:070
149950,0migration/022342-21kthreadcore11:23:010
149950,0migration/021243-21if_eth010:22:590
149950,0migration/02065-21sh10:48:440
149950,0migration/019540-21kthreadcore07:23:000
149950,0migration/018416-21sh11:20:100
149950,0migration/018097-21latency_hist08:37:440
149950,0migration/015982-21taskset07:46:160
149950,0migration/014790-21kthreadcore10:18:000
149950,0migration/011421-21taskset10:57:270
8215040,0irq/24-0000:00:0-21swapper/207:32:442
339940,0migration/37431-21kthreadcore12:13:013
339940,0migration/330098-21kthreadcore11:28:013
339940,0migration/325599-21kthreadcore07:03:013
339940,0migration/317171-21kthreadcore06:58:013
339940,0migration/312701-21irqcore08:32:593
29725040,0irq/27-eth0-tx-5803-21munin-node08:52:570
29725040,0irq/27-eth0-tx-2176-21ssh10:28:252
29725040,0irq/27-eth0-tx-20291-21ssh10:22:482
29725040,0irq/27-eth0-tx-12262-21diskmemload09:52:492
29725040,0irq/27-eth0-tx-0-21swapper/212:07:472
29725040,0irq/27-eth0-tx-0-21swapper/209:42:472
29725040,0irq/27-eth0-tx-0-21swapper/209:27:532
29725040,0irq/27-eth0-tx-0-21swapper/209:12:482
29725040,0irq/27-eth0-tx-0-21swapper/208:58:472
29725040,0irq/27-eth0-tx-0-21swapper/007:47:550
29725040,0irq/27-eth0-tx-0-21swapper/007:03:060
29715040,0irq/26-eth0-rx-4803-21iostat10:52:583
29715040,0irq/26-eth0-rx-0-21swapper/312:18:153
29715040,0irq/26-eth0-rx-0-21swapper/310:28:253
29715040,0irq/26-eth0-rx-0-21swapper/310:18:593
29715040,0irq/26-eth0-rx-0-21swapper/309:29:163
29715040,0irq/26-eth0-rx-0-21swapper/309:23:013
29715040,0irq/26-eth0-rx-0-21swapper/309:13:013
29715040,0irq/26-eth0-rx-0-21swapper/308:07:563
29715040,0irq/26-eth0-rx-0-21swapper/307:42:553
29715040,0irq/26-eth0-rx-0-21swapper/307:07:573
259940,0migration/28342-21missed_timers07:38:012
259940,0migration/24399-21kthreadcore12:13:002
259940,0migration/228737-21fschecks_time10:47:572
259940,0migration/223706-21kthreadcore07:28:002
259940,0migration/223455-21ksmtuned08:15:002
259940,0migration/215905-21latency08:08:022
259940,0migration/212204-21kthreadcore07:18:012
259940,0migration/211008-21cpuspeed_turbos12:17:542
249940,0watchdog/227493-21kthreadcore08:18:022
249940,0watchdog/212978-21ssh10:37:582
179940,0migration/19509-21latency_hist07:42:441
179940,0migration/13522-21idleruntime12:12:581
179940,0migration/132242-21kthreadcore09:08:001
179940,0migration/131084-21kthreadcore10:08:001
179940,0migration/128191-21aten_r1power_fr10:47:541
179940,0migration/124018-21kthreadcore10:03:001
179940,0migration/12298-21kthreadcore07:58:011
179940,0migration/122025-21aten_r1power_cu07:27:541
179940,0migration/120212-21taskset09:42:191
179940,0migration/117590-21kthreadcore09:58:011
179940,0migration/116695-21missed_timers11:38:011
179940,0migration/114520-21kthreadcore12:18:001
179940,0migration/112339-21kthreadcore08:08:011
179940,0migration/110495-21idleruntime07:42:581
169940,0watchdog/111439-21ssh10:16:061
169940,0watchdog/110517-21ssh10:34:101
169940,0watchdog/10-21swapper/109:51:101
169940,0watchdog/10-21swapper/109:03:021
141719944,0cyclictest0-21swapper/207:43:122
141719943,0cyclictest3896-21awk11:52:572
141719943,0cyclictest3514-21snmpd12:23:512
141719943,0cyclictest3514-21snmpd10:52:512
141719943,0cyclictest3514-21snmpd09:38:212
141719943,0cyclictest3514-21snmpd08:37:512
141719943,0cyclictest3514-21snmpd08:22:512
141719943,0cyclictest32369-21awk08:47:592
141719943,0cyclictest23843-21awk07:52:582
141719943,0cyclictest12149-21awk11:37:582
141709944,0cyclictest0-21swapper/111:09:491
141709944,0cyclictest0-21swapper/110:56:251
141709944,0cyclictest0-21swapper/110:27:051
141709944,0cyclictest0-21swapper/109:56:211
141709943,0cyclictest5835-21awk08:28:001
141709943,0cyclictest4101-21awk11:32:561
141709943,0cyclictest3556-21lldpd09:28:261
141709943,0cyclictest3556-21lldpd08:41:271
141709943,0cyclictest3556-21lldpd08:19:271
141709943,0cyclictest3514-21snmpd09:44:211
141709943,0cyclictest3514-21snmpd08:05:061
141709943,0cyclictest32417-21awk08:47:591
141709943,0cyclictest3241-21irqbalance10:29:421
141709943,0cyclictest2836-21awk07:12:591
141709943,0cyclictest28167-21sort07:07:581
141709943,0cyclictest23964-21awk07:52:591
141709943,0cyclictest13288-21awk10:17:591
141699944,0cyclictest0-21swapper/010:13:080
141699943,0cyclictest9679-21awk07:17:590
141699943,0cyclictest3894-21awk07:37:570
141699943,0cyclictest3690-21awk12:12:590
141699943,0cyclictest3556-21lldpd10:32:560
141699943,0cyclictest3556-21lldpd09:30:570
141699943,0cyclictest3556-21lldpd09:19:270
141699943,0cyclictest3556-21lldpd08:37:570
141699943,0cyclictest3556-21lldpd07:09:240
141699943,0cyclictest3514-21snmpd07:31:360
141699943,0cyclictest29842-21grep07:33:010
141699943,0cyclictest28401-21sadc09:07:440
141699943,0cyclictest27892-21kworker/0:209:54:530
141699943,0cyclictest24814-21awk08:18:000
141699943,0cyclictest21287-21kworker/0:011:37:490
141699943,0cyclictest11627-21awk08:08:000
149940,0migration/031475-21taskset08:47:490
149940,0migration/023647-21kthreadcore10:43:010
149940,0migration/016255-21kthreadcore10:58:000
149940,0migration/015492-21irqcore06:58:000
8215030,0irq/24-0000:00:0-21swapper/208:27:442
29715030,0irq/26-eth0-rx-0-21swapper/308:52:553
29715030,0irq/26-eth0-rx-0-21swapper/308:21:423
29715030,0irq/26-eth0-rx-0-21swapper/307:57:543
29715030,0irq/26-eth0-rx-0-21swapper/307:53:203
29715030,0irq/26-eth0-rx-0-21swapper/307:37:563
29715030,0irq/26-eth0-rx-0-21swapper/307:32:563
29715030,0irq/26-eth0-rx-0-21swapper/307:17:473
169930,0watchdog/112262-21diskmemload11:23:061
169930,0watchdog/10-21swapper/111:52:541
169930,0watchdog/10-21swapper/111:42:461
141719932,0cyclictest4688-21gltestperf08:02:572
141719932,0cyclictest10899-21kthreadcore08:53:012
141709932,0cyclictest3556-21lldpd08:22:571
141709932,0cyclictest3514-21snmpd07:52:361
141709932,0cyclictest27028-21users07:03:071
141709932,0cyclictest21836-21awk09:22:581
141709932,0cyclictest19949-21awk12:02:571
141709932,0cyclictest18377-21irqcore08:13:001
141709932,0cyclictest15339-21awk06:58:001
141709932,0cyclictest12510-21awk11:17:591
141709932,0cyclictest12262-21diskmemload11:14:201
141709930,0cyclictest12578-21hddtemp_smartct10:57:561
141699933,0cyclictest27892-21kworker/0:209:42:450
141699933,0cyclictest27892-21kworker/0:209:37:490
141699933,0cyclictest27892-21kworker/0:209:32:490
141699933,0cyclictest21287-21kworker/0:012:18:110
141699933,0cyclictest21287-21kworker/0:012:08:230
141699933,0cyclictest21287-21kworker/0:011:57:450
141699933,0cyclictest21287-21kworker/0:011:28:010
141699933,0cyclictest21287-21kworker/0:010:37:510
141699932,0cyclictest3556-21lldpd09:22:570
141699932,0cyclictest18264-21sensors09:58:050
249920,0watchdog/20-21swapper/206:57:472
169920,0watchdog/10-21swapper/111:02:461
141719920,0cyclictest0-21swapper/207:57:442
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional