You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-21 - 05:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat Mar 21, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450470,0irq/25-eth10-21swapper/318:56:123
1625723627,0sleep20-21swapper/219:00:102
994323524,0sleep00-21swapper/018:55:560
1616523329,0sleep10-21swapper/118:59:051
8215060,0irq/24-0000:00:29984-21ls22:30:482
339960,0migration/34446-21sh22:32:303
339960,0migration/329035-21sh22:48:593
339960,0migration/327719-21sh00:29:533
339960,0migration/327433-21sh23:47:113
339960,0migration/324753-21kthreadcore23:06:043
339960,0migration/320210-21sh22:41:353
339960,0migration/320210-21sh22:41:353
339960,0migration/316421-21kthreadcore20:36:033
339960,0migration/310128-21munin-node23:56:063
29725060,0irq/27-eth0-tx-6184-21munin-node20:06:010
29715060,0irq/26-eth0-rx-7013-21cut21:56:003
29715060,0irq/26-eth0-rx-27694-21sh23:27:023
29715060,0irq/26-eth0-rx-14295-21aten2.4-expect22:20:573
249960,0watchdog/24254-21unixbench-2d22:11:102
163869960,0cyclictest0-21swapper/123:43:501
163859966,0cyclictest0-21swapper/021:46:470
149960,0migration/08105-21latency_hist20:55:480
149960,0migration/06229-21sh21:55:450
149960,0migration/06092-21sh21:34:270
149960,0migration/04096-21sh23:34:090
149960,0migration/027893-21kthreadcore19:06:050
149960,0migration/013405-21sh21:58:150
339950,0migration/34451-21kthreadcore20:51:053
339950,0migration/331990-21kthreadcore22:51:043
339950,0migration/330773-21taskset21:30:193
339950,0migration/324743-21kthreadcore21:46:033
339950,0migration/321779-21taskset22:04:123
339950,0migration/32102-21kthreadcore20:26:053
339950,0migration/318993-21fschecks_count19:51:003
339950,0migration/317733-21kthreadcore21:01:043
339950,0migration/314202-21kthreadcore00:21:053
339950,0migration/311668-21idleruntime-cro19:45:483
339950,0migration/310916-21kthreadcore20:56:043
29725050,0irq/27-eth0-tx-7172-21munin-node20:31:010
29725050,0irq/27-eth0-tx-4945-21munin-node23:35:582
29725050,0irq/27-eth0-tx-4639-21hostname23:55:582
29725050,0irq/27-eth0-tx-27291-21ssh23:46:462
29725050,0irq/27-eth0-tx-21618-21munin-node23:06:102
29725050,0irq/27-eth0-tx-14844-21cpuspeed_turbos22:00:592
29725050,0irq/27-eth0-tx-10652-21ssh00:16:422
29725050,0irq/27-eth0-tx-0-21swapper/222:47:542
29725050,0irq/27-eth0-tx-0-21swapper/221:31:042
29725050,0irq/27-eth0-tx-0-21swapper/021:00:490
29725050,0irq/27-eth0-tx-0-21swapper/020:36:070
29715050,0irq/26-eth0-rx-7887-21grep23:36:043
29715050,0irq/26-eth0-rx-4910-21ssh22:12:443
29715050,0irq/26-eth0-rx-3542-21lldpd00:06:003
29715050,0irq/26-eth0-rx-29535-21ssh22:29:303
29715050,0irq/26-eth0-rx-0-21swapper/323:52:463
29715050,0irq/26-eth0-rx-0-21swapper/323:01:583
29715050,0irq/26-eth0-rx-0-21swapper/322:56:563
29715050,0irq/26-eth0-rx-0-21swapper/322:35:503
29715050,0irq/26-eth0-rx-0-21swapper/322:16:073
29715050,0irq/26-eth0-rx-0-21swapper/322:09:343
29715050,0irq/26-eth0-rx-0-21swapper/321:39:203
29715050,0irq/26-eth0-rx-0-21swapper/321:16:033
29715050,0irq/26-eth0-rx-0-21swapper/319:11:043
29715050,0irq/26-eth0-rx-0-21swapper/300:10:533
259950,0migration/26746-21munin-node22:36:012
259950,0migration/25157-21sh21:11:482
259950,0migration/229172-21sh22:07:282
259950,0migration/227164-21sh00:07:142
259950,0migration/218321-21sh23:41:052
259950,0migration/217449-21kthreadcore23:01:022
259950,0migration/215398-21kthreadcore19:21:052
259950,0migration/214387-21aten_r1power_vo22:20:582
179950,0migration/17925-21kthreadcore23:16:041
179950,0migration/132499-21kthreadcore19:36:041
179950,0migration/125871-21ntp_offset00:26:051
179950,0migration/112007-21aten_r1power_po19:46:001
163869955,0cyclictest14578-21diskmemload22:05:081
163869955,0cyclictest0-21swapper/122:43:271
163869955,0cyclictest0-21swapper/122:43:271
163869955,0cyclictest0-21swapper/122:31:191
163869955,0cyclictest0-21swapper/100:08:071
163869950,0cyclictest0-21swapper/123:12:271
163869950,0cyclictest0-21swapper/122:06:431
163869950,0cyclictest0-21swapper/121:40:231
163859955,0cyclictest14578-21diskmemload23:48:210
163859955,0cyclictest0-21swapper/023:37:000
163859955,0cyclictest0-21swapper/023:14:360
163859955,0cyclictest0-21swapper/019:40:590
163859950,0cyclictest0-21swapper/019:48:230
163859950,0cyclictest0-21swapper/000:02:510
169950,0watchdog/129022-21sh22:48:571
169950,0watchdog/127010-21memory23:06:051
169950,0watchdog/113488-21if_err_eth1.200:01:011
149950,0migration/07204-21if_eth022:16:020
149950,0migration/07018-21aten_r1power_fr21:15:580
149950,0migration/0456-21kthreadcore22:11:030
149950,0migration/04266-21munin-node19:15:580
149950,0migration/032713-21proc_pri20:46:080
149950,0migration/030995-21aten_r1power_po19:35:590
149950,0migration/029667-21ntp_kernel_pll_19:31:070
149950,0migration/02892-21latency22:51:050
149950,0migration/028379-21sh22:47:060
149950,0migration/027922-21proc_pri22:26:070
149950,0migration/02782-21kthreadcore20:01:040
149950,0migration/027107-21if_eth1.220:21:030
149950,0migration/023233-21fschecks_time22:06:000
149950,0migration/022653-21kthreadcore19:51:050
149950,0migration/022163-21kthreadcore20:16:050
149950,0migration/019369-21kthreadcore19:26:040
149950,0migration/01903-21kthreadcore19:11:040
149950,0migration/016898-21kthreadcore23:41:050
149950,0migration/013874-21irqcore20:11:040
149950,0migration/011992-21irqcore19:21:030
8215040,0irq/24-0000:00:29669-21latency_hist19:10:482
339940,0migration/36640-21kthreadcore19:16:043
339940,0migration/35647-21runrttasks20:02:223
339940,0migration/35062-21diskmemload21:31:273
339940,0migration/3420-21kthreadcore21:51:053
339940,0migration/32476-21kthreadcore21:11:043
339940,0migration/320194-21kthreadcore19:26:043
339940,0migration/319509-21taskset20:15:493
29725040,0irq/27-eth0-tx-0-21swapper/223:31:262
29725040,0irq/27-eth0-tx-0-21swapper/223:25:542
29725040,0irq/27-eth0-tx-0-21swapper/223:22:132
29725040,0irq/27-eth0-tx-0-21swapper/222:41:402
29725040,0irq/27-eth0-tx-0-21swapper/222:41:402
29725040,0irq/27-eth0-tx-0-21swapper/222:31:442
29725040,0irq/27-eth0-tx-0-21swapper/222:16:082
29725040,0irq/27-eth0-tx-0-21swapper/221:51:012
29725040,0irq/27-eth0-tx-0-21swapper/221:35:552
29725040,0irq/27-eth0-tx-0-21swapper/221:26:012
29725040,0irq/27-eth0-tx-0-21swapper/221:21:142
29725040,0irq/27-eth0-tx-0-21swapper/221:15:592
29725040,0irq/27-eth0-tx-0-21swapper/221:07:322
29725040,0irq/27-eth0-tx-0-21swapper/221:02:322
29725040,0irq/27-eth0-tx-0-21swapper/200:13:032
29725040,0irq/27-eth0-tx-0-21swapper/200:00:512
29715040,0irq/26-eth0-rx-0-21swapper/323:41:043
29715040,0irq/26-eth0-rx-0-21swapper/323:31:043
29715040,0irq/26-eth0-rx-0-21swapper/323:21:033
29715040,0irq/26-eth0-rx-0-21swapper/323:19:573
29715040,0irq/26-eth0-rx-0-21swapper/323:11:253
29715040,0irq/26-eth0-rx-0-21swapper/321:41:163
29715040,0irq/26-eth0-rx-0-21swapper/321:20:583
29715040,0irq/26-eth0-rx-0-21swapper/321:06:043
29715040,0irq/26-eth0-rx-0-21swapper/300:15:513
29715040,0irq/26-eth0-rx-0-21swapper/300:01:563
259940,0migration/29637-21kthreadcore20:56:042
259940,0migration/29569-21kthreadcore19:41:052
259940,0migration/29212-21kthreadcore21:56:042
259940,0migration/26593-21kthreadcore20:51:062
259940,0migration/26549-21runrttasks20:26:332
259940,0migration/224233-21aten_r1power_cu19:30:582
259940,0migration/219918-21munin-node20:16:002
259940,0migration/219583-21kthreadcore19:01:032
259940,0migration/218673-21aten_r1power_vo19:50:592
259940,0migration/218137-21fschecks_time19:26:012
259940,0migration/217365-21kthreadcore21:41:062
259940,0migration/212500-21runrttasks20:09:362
259940,0migration/210143-21kthreadcore23:16:052
249940,0watchdog/2203112chrt00:25:532
249940,0watchdog/212303-21ssh00:20:532
249940,0watchdog/20-21swapper/220:35:582
179940,0migration/1913-21fschecks_count20:26:011
179940,0migration/16084-21cpuspeed_turbos22:35:591
179940,0migration/13492-21kthreadcore21:51:051
179940,0migration/132628-21kthreadcore19:11:041
179940,0migration/132430-21kthreadcore23:51:041
179940,0migration/131974-21aten_r1power_po20:00:581
179940,0migration/131611-21munin-node22:11:021
179940,0migration/128820-21kthreadcore20:21:041
179940,0migration/124711-21kthreadcore19:06:041
179940,0migration/120814-21unixbench-2d21:01:091
179940,0migration/120444-21kthreadcore19:26:041
179940,0migration/119511-21taskset20:15:511
179940,0migration/118565-21kthreadcore22:21:041
179940,0migration/117991-21kthreadcore23:21:041
179940,0migration/116940-21taskset19:21:121
163879943,0cyclictest3556-21lldpd23:10:592
163879943,0cyclictest3556-21lldpd22:55:592
163879943,0cyclictest3556-21lldpd20:50:282
163879943,0cyclictest3556-21lldpd20:41:282
163879943,0cyclictest31814-21awk19:36:022
163879943,0cyclictest30880-21awk22:51:022
163879943,0cyclictest29907-21awk23:51:012
163879943,0cyclictest23757-21awk21:46:022
163869944,0cyclictest0-21swapper/123:30:541
163869944,0cyclictest0-21swapper/122:56:231
163869943,0cyclictest7255-21awk22:16:031
163869943,0cyclictest5138-21awk19:16:021
163869943,0cyclictest3556-21lldpd22:54:291
163869943,0cyclictest3556-21lldpd21:48:281
163869943,0cyclictest3556-21lldpd21:41:581
163869943,0cyclictest3556-21lldpd21:21:281
163869943,0cyclictest3556-21lldpd20:55:271
163869943,0cyclictest3556-21lldpd20:47:271
163869943,0cyclictest3556-21lldpd20:40:581
163869943,0cyclictest3556-21lldpd20:36:571
163869943,0cyclictest3556-21lldpd20:32:571
163869943,0cyclictest3556-21lldpd20:11:281
163869943,0cyclictest3556-21lldpd19:40:581
163869943,0cyclictest3556-21lldpd19:00:581
163869943,0cyclictest3556-21lldpd00:15:001
163869943,0cyclictest26147-21awk19:56:041
163869943,0cyclictest24168-21awk21:26:041
163869943,0cyclictest23876-21awk21:06:021
163869943,0cyclictest21843-21awk23:46:021
163869943,0cyclictest19449-21awk19:51:021
163859944,0cyclictest0-21swapper/022:56:100
163859943,0cyclictest3949-21kworker/0:221:39:490
163859943,0cyclictest3241-21irqbalance21:42:160
163859943,0cyclictest21317-21kworker/0:023:23:060
163859943,0cyclictest21317-21kworker/0:000:21:360
163859943,0cyclictest21317-21kworker/0:000:18:540
163859943,0cyclictest20481-21munin-node20:40:590
163859943,0cyclictest14849-21awk22:41:030
163859943,0cyclictest14849-21awk22:41:030
163859943,0cyclictest1397-21awk20:26:040
169940,0watchdog/15513-21ssh21:12:461
169940,0watchdog/132132-21if_eth121:31:021
169940,0watchdog/123156-21if_eth022:26:011
169940,0watchdog/115708-21cut23:01:011
169940,0watchdog/113631-21ssh21:58:541
169940,0watchdog/112919-21grep00:21:011
169940,0watchdog/10-21swapper/123:40:211
149940,0migration/024786-21kthreadcore00:06:040
149940,0migration/019220-21kthreadcore19:01:030
149940,0migration/01669-21kthreadcore23:51:040
149940,0migration/011561-21runrttasks23:16:400
339930,0migration/322858-21taskset19:04:043
29725030,0irq/27-eth0-tx-0-21swapper/019:56:030
29715030,0irq/26-eth0-rx-0-21swapper/320:45:583
29715030,0irq/26-eth0-rx-0-21swapper/320:41:093
29715030,0irq/26-eth0-rx-0-21swapper/320:10:593
29715030,0irq/26-eth0-rx-0-21swapper/319:56:013
29715030,0irq/26-eth0-rx-0-21swapper/319:46:113
29715030,0irq/26-eth0-rx-0-21swapper/319:35:583
259930,0migration/211088-21kthreadcore20:31:062
249930,0watchdog/226155-21munin-node20:21:022
179930,0migration/110239-21kthreadcore20:56:041
163879932,0cyclictest5211-21awk19:16:022
163879932,0cyclictest5181-21sensors20:01:082
163879932,0cyclictest30870-21sensors19:56:102
163879932,0cyclictest12723-21awk19:46:032
163879930,0cyclictest0-21swapper/219:13:142
163869932,0cyclictest5234-21awk00:16:011
163869932,0cyclictest3556-21lldpd21:15:571
163869932,0cyclictest27643-21grep19:31:051
163859933,0cyclictest3949-21kworker/0:222:01:110
163859933,0cyclictest3949-21kworker/0:221:21:050
163859933,0cyclictest3949-21kworker/0:221:06:210
163859933,0cyclictest3949-21kworker/0:220:50:490
163859933,0cyclictest23384-21kworker/0:122:36:070
163859933,0cyclictest21317-21kworker/0:023:55:560
163859933,0cyclictest21317-21kworker/0:023:26:060
163859933,0cyclictest21317-21kworker/0:023:06:030
163859933,0cyclictest21317-21kworker/0:000:27:080
163859933,0cyclictest21317-21kworker/0:000:12:280
163859932,0cyclictest4527-21sensors21:11:080
163859932,0cyclictest28938-21processes21:26:100
163859932,0cyclictest14577-21awk23:00:590
163859932,0cyclictest14328-21aten2.4-expect22:20:570
163859930,0cyclictest30914-21perl22:30:590
169930,0watchdog/10-21swapper/123:57:531
169930,0watchdog/10-21swapper/123:27:051
329920,0watchdog/30-21swapper/320:06:113
29715020,0irq/26-eth0-rx-0-21swapper/320:31:023
29715020,0irq/26-eth0-rx-0-21swapper/320:20:483
29715020,0irq/26-eth0-rx-0-21swapper/319:31:103
29715020,0irq/26-eth0-rx-0-21swapper/319:20:483
29715020,0irq/26-eth0-rx-0-21swapper/319:05:513
249920,0watchdog/20-21swapper/220:10:542
163869921,0cyclictest6122-21latency_hist20:05:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional