You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 13:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Fri May 22, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450460,0irq/25-eth10-21swapper/306:51:593
218023424,0sleep10-21swapper/106:53:461
214423127,0sleep20-21swapper/206:53:192
207723127,0sleep00-21swapper/006:52:330
339960,0migration/38082-21sh10:19:283
339960,0migration/37937-21sh09:38:043
339960,0migration/332587-21sh09:34:023
339960,0migration/331795-21sh09:52:203
339960,0migration/324453-21sh09:49:203
339960,0migration/323367-21runrttasks11:08:323
339960,0migration/315881-21sh11:04:543
339960,0migration/314194-21sh12:22:483
339960,0migration/311454-21kthreadcore09:00:103
29725060,0irq/27-eth0-tx-4562-21munin-node07:45:140
29715060,0irq/26-eth0-rx-7605-21sh12:00:043
29715060,0irq/26-eth0-rx-18161-21iostat_ios09:05:083
29715060,0irq/26-eth0-rx-17400-21grep10:45:103
29715060,0irq/26-eth0-rx-10597-21kthreadcore10:40:093
259960,0migration/22483-21kthreadcore11:55:102
23509966,0cyclictest0-21swapper/209:33:022
23509966,0cyclictest0-21swapper/209:02:272
23499966,0cyclictest479-21diskmemload11:53:431
23499960,0cyclictest0-21swapper/109:11:001
23499960,0cyclictest0-21swapper/108:56:401
149960,0migration/08159-21sh09:38:410
149960,0migration/06281-21sh11:36:440
149960,0migration/032116-21sh10:34:130
149960,0migration/031047-21sh11:12:300
149960,0migration/023410-21sh11:49:500
149960,0migration/014001-21sh12:22:130
8215050,0irq/24-0000:00:16095-21munin-run10:44:542
339950,0migration/39817-21irqcore10:00:103
339950,0migration/38026-21kthreadcore08:35:103
339950,0migration/37753-21taskset08:57:213
339950,0migration/33932-21kthreadcore12:15:103
339950,0migration/33407-21idleruntime06:55:083
339950,0migration/332413-21fschecks_time11:55:063
339950,0migration/332364-21munin-node11:35:063
339950,0migration/331396-21aten_r1power_vo08:05:063
339950,0migration/331219-21timerwakeupswit09:10:163
339950,0migration/330643-21taskset08:00:463
339950,0migration/329647-21taskset07:35:433
339950,0migration/324936-21kthreadcore12:10:093
339950,0migration/324335-21sh10:09:333
339950,0migration/319430-21kthreadcore12:05:093
339950,0migration/31931-21kthreadcore09:55:093
339950,0migration/317335-21kthreadcore07:05:103
339950,0migration/317231-21cpuspeed_turbos07:30:063
339950,0migration/313066-21latency11:40:123
339950,0migration/313066-21latency11:40:123
29725050,0irq/27-eth0-tx-8075-21ssh09:17:462
29725050,0irq/27-eth0-tx-16920-21munin-node07:30:100
29725050,0irq/27-eth0-tx-13146-21munin-node08:40:100
29725050,0irq/27-eth0-tx-0-21swapper/008:55:010
29725050,0irq/27-eth0-tx-0-21swapper/008:30:090
29725050,0irq/27-eth0-tx-0-21swapper/008:17:040
29715050,0irq/26-eth0-rx-8857-21ssh09:40:033
29715050,0irq/26-eth0-rx-26025-21irqstats10:10:083
29715050,0irq/26-eth0-rx-2520-21kthreadcore11:15:113
29715050,0irq/26-eth0-rx-23609-21which07:55:163
29715050,0irq/26-eth0-rx-22687-21kthreadcore08:20:123
29715050,0irq/26-eth0-rx-20940-21kthreadcore11:45:133
29715050,0irq/26-eth0-rx-16922-21sort09:24:543
29715050,0irq/26-eth0-rx-14407-21sed10:20:163
29715050,0irq/26-eth0-rx-0-21swapper/311:50:093
29715050,0irq/26-eth0-rx-0-21swapper/311:32:463
29715050,0irq/26-eth0-rx-0-21swapper/311:25:053
29715050,0irq/26-eth0-rx-0-21swapper/311:10:043
29715050,0irq/26-eth0-rx-0-21swapper/310:38:263
29715050,0irq/26-eth0-rx-0-21swapper/310:29:543
29715050,0irq/26-eth0-rx-0-21swapper/309:25:063
27150,0ktimersoftd/20-21swapper/212:14:222
27150,0ktimersoftd/20-21swapper/212:05:292
27150,0ktimersoftd/20-21swapper/211:33:432
259950,0migration/232105-21latency_hist08:29:542
259950,0migration/226541-21munin-node08:25:102
259950,0migration/210127-21kthreadcore10:00:102
249950,0watchdog/26173-21cat10:35:162
249950,0watchdog/223884-21ssh09:07:042
23509955,0cyclictest0-21swapper/212:02:582
23509955,0cyclictest0-21swapper/211:45:092
23509955,0cyclictest0-21swapper/211:35:512
23509955,0cyclictest0-21swapper/211:29:042
23509955,0cyclictest0-21swapper/211:18:022
23509955,0cyclictest0-21swapper/211:05:342
23509955,0cyclictest0-21swapper/210:24:442
23509955,0cyclictest0-21swapper/210:06:462
23509955,0cyclictest0-21swapper/209:36:582
23509950,0cyclictest0-21swapper/210:14:112
23499955,0cyclictest0-21swapper/108:10:091
23499950,0cyclictest0-21swapper/112:17:121
23499950,0cyclictest0-21swapper/111:47:051
23499950,0cyclictest0-21swapper/111:37:281
23499950,0cyclictest0-21swapper/111:15:431
23499950,0cyclictest0-21swapper/109:46:291
23499950,0cyclictest0-21swapper/109:43:571
179950,0migration/18897-21latency07:20:141
179950,0migration/131172-21taskset10:31:311
179950,0migration/127875-21kthreadcore08:50:101
179950,0migration/122722-21taskset10:25:221
179950,0migration/117516-21latency08:15:121
179950,0migration/11732-21kthreadcore10:55:091
179950,0migration/114776-21sh11:43:031
179950,0migration/114776-21sh11:43:031
179950,0migration/113748-21timerandwakeup11:20:161
179950,0migration/112841-21latency12:00:101
169950,0watchdog/16175-21wc10:35:161
169950,0watchdog/129336-21grep12:10:151
149950,0migration/07855-21kthreadcore06:55:120
149950,0migration/06069-21sensors_temp10:35:150
149950,0migration/0394-21taskset09:14:160
149950,0migration/031797-21kthreadcore07:15:110
149950,0migration/031694-21sh11:54:550
149950,0migration/030727-21taskset10:50:520
149950,0migration/030286-21taskset11:51:310
149950,0migration/027469-21kthreadcore10:10:090
149950,0migration/026910-21kthreadcore08:00:100
149950,0migration/025046-21irqcore11:30:080
149950,0migration/024160-21taskset10:09:030
149950,0migration/023650-21taskset10:28:040
149950,0migration/019310-21kthreadcore09:25:100
149950,0migration/017419-21irqrtprio11:05:090
149950,0migration/016508-21taskset07:27:560
149950,0migration/015725-21latency_hist11:24:540
149950,0migration/013997-21kthreadcore09:00:110
149950,0migration/01382-21fschecks_count09:15:060
149950,0migration/012718-21kthreadcore07:50:120
149950,0migration/012388-21kthreadcore10:20:100
149950,0migration/011150-21kthreadcore12:00:100
149950,0migration/010709-21kthreadcore10:40:090
149950,0migration/010533-21kthreadcore11:40:110
149950,0migration/010533-21kthreadcore11:40:110
339940,0migration/3673-21kthreadcore07:15:113
339940,0migration/332498-21aten_r1power_fr10:55:043
339940,0migration/330729-21kthreadcore08:50:113
339940,0migration/323558-21kthreadcore08:45:113
339940,0migration/32147-21kthreadcore07:40:113
339940,0migration/321462-21kthreadcore10:25:113
339940,0migration/316833-21kthreadcore08:15:123
339940,0migration/310695-21kthreadcore07:00:113
29725040,0irq/27-eth0-tx-6622-21telnet08:35:050
29725040,0irq/27-eth0-tx-30854-21ssh10:30:352
29725040,0irq/27-eth0-tx-24808-21sed10:50:062
29725040,0irq/27-eth0-tx-17308-21ssh10:25:072
29725040,0irq/27-eth0-tx-0-21swapper/212:15:062
29725040,0irq/27-eth0-tx-0-21swapper/211:40:272
29725040,0irq/27-eth0-tx-0-21swapper/211:40:272
29725040,0irq/27-eth0-tx-0-21swapper/211:09:582
29725040,0irq/27-eth0-tx-0-21swapper/211:00:272
29725040,0irq/27-eth0-tx-0-21swapper/210:45:152
29725040,0irq/27-eth0-tx-0-21swapper/210:15:392
29725040,0irq/27-eth0-tx-0-21swapper/209:54:542
29725040,0irq/27-eth0-tx-0-21swapper/209:50:102
29725040,0irq/27-eth0-tx-0-21swapper/209:47:342
29725040,0irq/27-eth0-tx-0-21swapper/209:40:002
29725040,0irq/27-eth0-tx-0-21swapper/209:25:292
29725040,0irq/27-eth0-tx-0-21swapper/209:13:262
29725040,0irq/27-eth0-tx-0-21swapper/208:55:392
29725040,0irq/27-eth0-tx-0-21swapper/007:57:000
29715040,0irq/26-eth0-rx-0-21swapper/311:21:463
29715040,0irq/26-eth0-rx-0-21swapper/310:50:073
29715040,0irq/26-eth0-rx-0-21swapper/309:16:173
259940,0migration/28427-21fschecks_time11:20:072
259940,0migration/25938-21df_abs08:10:062
259940,0migration/25647-21pmu-power10:55:132
259940,0migration/212795-21runrttasks08:38:352
249940,0watchdog/223732-21aten2.4-expect11:50:032
249940,0watchdog/222890-21cpuspeed_turbos07:10:052
249940,0watchdog/212284-21kthreadcore12:20:112
249940,0watchdog/211278-21interrupts07:25:082
249940,0watchdog/20-21swapper/209:19:562
23509943,0cyclictest3556-21lldpd08:44:552
23509943,0cyclictest3556-21lldpd08:41:252
23509943,0cyclictest3556-21lldpd07:49:552
23509943,0cyclictest3556-21lldpd07:20:252
23509943,0cyclictest3514-21snmpd06:58:302
23509943,0cyclictest3241-21irqbalance08:20:022
23509943,0cyclictest3241-21irqbalance08:15:022
23509943,0cyclictest3241-21irqbalance08:05:132
23509943,0cyclictest3241-21irqbalance07:55:032
23509943,0cyclictest3241-21irqbalance07:45:132
23509943,0cyclictest3241-21irqbalance07:42:532
23509943,0cyclictest3241-21irqbalance07:35:232
23509943,0cyclictest3241-21irqbalance07:30:432
23509943,0cyclictest30402-21cat08:00:162
23509943,0cyclictest30141-21awk07:15:082
23509943,0cyclictest16808-21awk07:05:082
23509943,0cyclictest10197-21awk07:00:102
23499943,0cyclictest5399-21awk07:45:081
23499943,0cyclictest3514-21snmpd12:05:011
23499943,0cyclictest3514-21snmpd11:30:011
23499943,0cyclictest3514-21snmpd11:02:001
23499943,0cyclictest3514-21snmpd10:50:001
23499943,0cyclictest3514-21snmpd10:08:001
23499943,0cyclictest3514-21snmpd09:53:311
23499943,0cyclictest3514-21snmpd09:37:011
23499943,0cyclictest3514-21snmpd09:27:161
23499943,0cyclictest3514-21snmpd09:20:011
23499943,0cyclictest3514-21snmpd09:01:011
23499943,0cyclictest3514-21snmpd08:45:311
23499943,0cyclictest31006-21sadc08:04:541
23499943,0cyclictest26420-21awk08:25:091
23499943,0cyclictest24989-21awk11:10:061
23499943,0cyclictest18795-21awk07:55:091
23499943,0cyclictest16872-21awk07:05:081
23499943,0cyclictest16733-21awk11:25:081
23489943,0cyclictest9981-21awk09:20:090
23489943,0cyclictest954-21grep10:15:070
23489943,0cyclictest3590-21kworker/0:009:07:070
23489943,0cyclictest3556-21lldpd11:25:570
23489943,0cyclictest3514-21snmpd08:28:460
23489943,0cyclictest25199-21kworker/0:212:14:510
23489943,0cyclictest25199-21kworker/0:210:59:530
179940,0migration/17094-21runrttasks10:16:381
179940,0migration/1699-21kthreadcore11:55:101
179940,0migration/16478-21kthreadcore06:55:111
179940,0migration/13327-21kthreadcore09:15:101
179940,0migration/127385-21kthreadcore10:10:091
179940,0migration/127161-21kthreadcore09:30:101
179940,0migration/116066-21kthreadcore08:40:101
179940,0migration/116009-21sh10:44:421
179940,0migration/11122-21kthreadcore07:15:111
179940,0migration/110534-21irqrtprio07:00:111
169940,0watchdog/18701-21sh09:59:561
169940,0watchdog/17365-21if_err_eth1.208:35:081
169940,0watchdog/122889-21cpuspeed_turbos07:10:051
169940,0watchdog/118310-21sed09:05:081
169940,0watchdog/10-21swapper/111:06:321
169940,0watchdog/10-21swapper/110:19:561
169940,0watchdog/10-21swapper/108:20:121
169940,0watchdog/10-21swapper/107:50:121
149940,0migration/032622-21irqcore12:15:080
149940,0migration/025741-21kthreadcore07:35:100
149940,0migration/022766-21sh12:08:330
149940,0migration/018045-21kthreadcore07:05:100
149940,0migration/011831-21kthreadcore10:00:110
29725030,0irq/27-eth0-tx-0-21swapper/008:45:050
29715030,0irq/26-eth0-rx-0-21swapper/308:40:173
29715030,0irq/26-eth0-rx-0-21swapper/308:30:063
29715030,0irq/26-eth0-rx-0-21swapper/308:25:553
29715030,0irq/26-eth0-rx-0-21swapper/308:10:053
29715030,0irq/26-eth0-rx-0-21swapper/307:48:203
29715030,0irq/26-eth0-rx-0-21swapper/307:20:083
23509932,0cyclictest27424-21awk08:50:092
23499932,0cyclictest3553-21sensors07:40:141
23499932,0cyclictest23608-21cut07:35:051
23499930,0cyclictest19966-21tr10:45:111
23489933,0cyclictest3590-21kworker/0:009:44:550
23489933,0cyclictest3590-21kworker/0:009:40:090
23489933,0cyclictest3590-21kworker/0:009:29:550
23489933,0cyclictest3590-21kworker/0:008:49:570
23489933,0cyclictest3590-21kworker/0:008:20:030
23489933,0cyclictest3590-21kworker/0:008:09:550
23489933,0cyclictest3590-21kworker/0:008:05:000
23489933,0cyclictest3590-21kworker/0:007:40:060
23489933,0cyclictest3590-21kworker/0:007:20:040
23489933,0cyclictest3590-21kworker/0:007:10:040
23489933,0cyclictest3590-21kworker/0:007:00:040
23489933,0cyclictest25199-21kworker/0:211:14:570
23489933,0cyclictest25199-21kworker/0:210:59:550
23489933,0cyclictest22675-21kworker/0:110:44:550
23489933,0cyclictest22675-21kworker/0:109:54:550
23489933,0cyclictest22675-21kworker/0:109:49:570
179930,0migration/11940-21kthreadcore08:05:111
179930,0migration/116663-21runrttasks07:29:431
169930,0watchdog/10-21swapper/112:20:031
169930,0watchdog/10-21swapper/109:55:161
169930,0watchdog/10-21swapper/108:30:161
339920,0migration/311292-21iostat_ios07:25:093
29715020,0irq/26-eth0-rx-0-21swapper/307:49:553
29715020,0irq/26-eth0-rx-0-21swapper/307:11:093
169920,0watchdog/10-21swapper/107:29:561
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional