You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 03:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Sun Jul 05, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
413828786,0sleep20-21swapper/218:49:002
409323824,0sleep00-21swapper/018:48:300
416123727,0sleep30-21swapper/318:49:173
401423324,0sleep10-21swapper/118:47:351
8215060,0irq/24-0000:00:9865-21munin-run23:15:442
43659965,0cyclictest24972-21grep21:01:072
43649966,0cyclictest2463-21diskmemload23:52:341
43649966,0cyclictest0-21swapper/118:50:581
43649960,0cyclictest2463-21diskmemload23:32:231
43649960,0cyclictest0-21swapper/120:41:001
43639965,0cyclictest28531-21ps22:06:000
43639965,0cyclictest11117-21kthreadcore00:16:010
339960,0migration/326090-21sh21:03:223
339960,0migration/325832-21sh23:45:333
339960,0migration/321640-21kthreadcore23:01:013
339960,0migration/311001-21aten_r1power_cu22:15:543
29715060,0irq/26-eth0-rx-28393-21irqrtprio22:05:593
29715060,0irq/26-eth0-rx-25081-21ssh00:03:493
29715060,0irq/26-eth0-rx-15368-21tr22:36:023
29715060,0irq/26-eth0-rx-0-21swapper/323:31:353
29715060,0irq/26-eth0-rx-0-21swapper/321:11:033
149960,0migration/09100-21taskset23:54:130
149960,0migration/026323-21sh22:04:010
149960,0migration/025292-21sh00:04:270
149960,0migration/025054-21sh23:43:220
149960,0migration/018674-21sh21:39:390
149960,0migration/018033-21taskset21:17:260
149960,0migration/017032-21timerandwakeup18:56:080
43659955,0cyclictest0-21swapper/223:08:042
43659955,0cyclictest0-21swapper/222:56:332
43659955,0cyclictest0-21swapper/221:44:402
43659955,0cyclictest0-21swapper/200:07:582
43659950,0cyclictest0-21swapper/222:53:052
43659950,0cyclictest0-21swapper/222:16:122
43659950,0cyclictest0-21swapper/221:25:162
43649955,0cyclictest0-21swapper/123:00:231
43649955,0cyclictest0-21swapper/121:14:261
43649955,0cyclictest0-21swapper/121:05:461
43649954,0cyclictest13124-21awk19:21:001
43649950,0cyclictest0-21swapper/122:18:171
43639955,0cyclictest0-21swapper/022:24:270
43639950,0cyclictest0-21swapper/023:36:590
43639950,0cyclictest0-21swapper/023:13:390
43639950,0cyclictest0-21swapper/023:09:040
43639950,0cyclictest0-21swapper/021:56:430
43639950,0cyclictest0-21swapper/021:49:090
339950,0migration/39020-21kthreadcore20:06:003
339950,0migration/37559-21switchtime00:11:083
339950,0migration/36790-21kthreadcore18:51:013
339950,0migration/35237-21kthreadcore20:51:033
339950,0migration/3512-21munin-node20:21:033
339950,0migration/332413-21timerandwakeup22:46:083
339950,0migration/33140-21kthreadcore19:11:033
339950,0migration/330251-21kthreadcore19:56:013
339950,0migration/329078-21fschecks_time20:45:573
339950,0migration/327162-21diskmemload21:25:313
339950,0migration/326791-21fschecks_time23:45:583
339950,0migration/32657-21diskmemload23:50:583
339950,0migration/326408-21kthreadcore20:41:023
339950,0migration/323293-21kthreadcore22:41:033
339950,0migration/323293-21kthreadcore22:41:033
339950,0migration/32317-21kthreadcore19:36:023
339950,0migration/32213-21munin-node22:50:533
339950,0migration/321009-21kthreadcore19:01:023
339950,0migration/320993-21kthreadcore19:26:013
339950,0migration/320632-21taskset20:15:313
339950,0migration/31785-21taskset21:08:053
339950,0migration/317297-21timerandwakeup21:16:093
339950,0migration/313329-21kthreadcore18:56:023
339950,0migration/313146-21sh20:56:033
339950,0migration/311741-21fschecks_time21:55:583
339950,0migration/311645-21kernelversion22:56:013
339950,0migration/311604-21taskset19:16:113
29725050,0irq/27-eth0-tx-3560-21fschecks_time22:11:002
29725050,0irq/27-eth0-tx-30685-21kthreadcore21:46:012
29725050,0irq/27-eth0-tx-2584-21ssh21:10:092
29725050,0irq/27-eth0-tx-18218-21munin-node23:20:592
29725050,0irq/27-eth0-tx-16865-21ssh22:36:532
29725050,0irq/27-eth0-tx-11314-21munin-node21:35:572
29725050,0irq/27-eth0-tx-0-21swapper/222:24:072
29725050,0irq/27-eth0-tx-0-21swapper/020:20:550
29725050,0irq/27-eth0-tx-0-21swapper/019:01:030
29715050,0irq/26-eth0-rx-28896-21kthreadcore23:26:013
29715050,0irq/26-eth0-rx-25242-21ssh23:23:393
29715050,0irq/26-eth0-rx-25116-21cut20:16:013
29715050,0irq/26-eth0-rx-10008-21cpuspeed_turbos00:15:563
29715050,0irq/26-eth0-rx-0-21swapper/323:36:523
29715050,0irq/26-eth0-rx-0-21swapper/323:06:043
29715050,0irq/26-eth0-rx-0-21swapper/322:31:003
29715050,0irq/26-eth0-rx-0-21swapper/322:25:593
29715050,0irq/26-eth0-rx-0-21swapper/322:21:123
29715050,0irq/26-eth0-rx-0-21swapper/322:15:103
29715050,0irq/26-eth0-rx-0-21swapper/322:00:563
29715050,0irq/26-eth0-rx-0-21swapper/321:30:253
29715050,0irq/26-eth0-rx-0-21swapper/300:06:083
259950,0migration/28765-21sh23:53:152
259950,0migration/23328-21aten_r1power_po21:30:552
259950,0migration/23256-21kthreadcore20:01:022
259950,0migration/232476-21unixbench_multi19:56:072
259950,0migration/23233-21kthreadcore20:26:012
259950,0migration/231334-21kthreadcore22:06:012
259950,0migration/226168-21munin-node20:16:022
259950,0migration/222646-21kthreadcore00:01:012
259950,0migration/218975-21irqcore19:01:012
259950,0migration/215475-21kthreadcore18:56:032
259950,0migration/213797-21kthreadcore21:16:012
259950,0migration/210057-21latency_hist23:15:452
249950,0watchdog/25845-21kthreadcore20:51:032
179950,0migration/16551-21munin-node19:40:561
179950,0migration/128123-21kthreadcore19:31:021
179950,0migration/126182-21latency_hist23:05:451
179950,0migration/125112-21sh23:23:161
179950,0migration/123867-21timerandwakeup00:01:061
179950,0migration/119066-21kthreadcore20:11:041
179950,0migration/114014-21kthreadcore23:56:011
179950,0migration/110092-21taskset21:33:041
169950,0watchdog/132481-21ssh00:07:061
169950,0watchdog/124085-21cut21:41:031
149950,0migration/09473-21runrttasks22:12:140
149950,0migration/07802-21kthreadcore18:51:010
149950,0migration/05409-21kthreadcore00:11:020
149950,0migration/04668-21kthreadcore21:31:000
149950,0migration/032749-21needreboot21:06:020
149950,0migration/030991-21kthreadcore19:56:010
149950,0migration/03033-21irqcore23:31:000
149950,0migration/029663-21kthreadcore21:26:010
149950,0migration/028474-21aten_r1power_cu20:45:550
149950,0migration/027363-21irqcore23:26:000
149950,0migration/025961-21taskset19:51:310
149950,0migration/025188-21fschecks_time19:05:580
149950,0migration/024393-21latency21:01:030
149950,0migration/023146-21kthreadcore20:16:010
149950,0migration/022859-21kthreadcore19:26:020
149950,0migration/021825-21kthreadcore23:21:010
149950,0migration/020705-21kthreadcore22:41:020
149950,0migration/020705-21kthreadcore22:41:020
149950,0migration/020499-21irqcore21:41:010
149950,0migration/018338-21taskset19:22:050
149950,0migration/017319-21kthreadcore19:46:020
149950,0migration/017121-21taskset22:37:400
149950,0migration/016992-21kthreadcore20:36:020
149950,0migration/015965-21runrttasks22:56:050
149950,0migration/015742-21taskset20:56:040
43659943,0cyclictest690-21awk19:36:002
43659943,0cyclictest3556-21lldpd19:22:032
43659943,0cyclictest32175-21awk19:11:012
43659943,0cyclictest27056-21awk23:45:592
43649944,0cyclictest0-21swapper/121:03:141
43649943,0cyclictest3905-21awk21:50:591
43649943,0cyclictest3514-21snmpd23:46:331
43649943,0cyclictest3514-21snmpd20:31:311
43649943,0cyclictest3514-21snmpd20:28:311
43649943,0cyclictest3514-21snmpd20:21:311
43649943,0cyclictest3514-21snmpd20:07:311
43649943,0cyclictest3241-21irqbalance23:26:521
43649943,0cyclictest27972-21awk22:25:591
43649943,0cyclictest27546-21awk19:55:591
43649943,0cyclictest27496-21awk22:46:001
43649943,0cyclictest20777-21awk19:51:001
43649943,0cyclictest19761-21awk19:25:591
43649943,0cyclictest18898-21awk19:01:001
43649943,0cyclictest10985-21awk23:35:581
43639944,0cyclictest0-21swapper/023:56:510
43639944,0cyclictest0-21swapper/023:04:300
43639943,0cyclictest4024-21awk21:10:590
43639943,0cyclictest3987-21awk21:50:590
43639943,0cyclictest3556-21lldpd20:05:330
43639943,0cyclictest3556-21lldpd19:38:030
43639943,0cyclictest27941-21awk22:25:580
43639943,0cyclictest20265-21kworker/0:123:48:510
43639943,0cyclictest20265-21kworker/0:122:31:240
43639943,0cyclictest17709-21kworker/0:020:51:140
43639943,0cyclictest15072-21awk20:11:010
339940,0migration/36524-21kthreadcore23:11:023
339940,0migration/327990-21fschecks_time21:45:573
339940,0migration/32192-21fschecks_count20:25:573
339940,0migration/315603-21kthreadcore19:21:023
29725040,0irq/27-eth0-tx-27918-21df_abs21:25:572
29725040,0irq/27-eth0-tx-16829-21ssh20:56:092
29725040,0irq/27-eth0-tx-16439-21ssh00:17:372
29725040,0irq/27-eth0-tx-0-21swapper/223:55:442
29725040,0irq/27-eth0-tx-0-21swapper/223:37:482
29725040,0irq/27-eth0-tx-0-21swapper/223:25:442
29725040,0irq/27-eth0-tx-0-21swapper/223:00:492
29725040,0irq/27-eth0-tx-0-21swapper/222:40:532
29725040,0irq/27-eth0-tx-0-21swapper/222:40:532
29725040,0irq/27-eth0-tx-0-21swapper/222:26:142
29725040,0irq/27-eth0-tx-0-21swapper/222:01:092
29725040,0irq/27-eth0-tx-0-21swapper/221:51:362
29725040,0irq/27-eth0-tx-0-21swapper/221:10:502
29725040,0irq/27-eth0-tx-0-21swapper/019:16:080
29715040,0irq/26-eth0-rx-0-21swapper/323:55:553
29715040,0irq/26-eth0-rx-0-21swapper/323:16:203
29715040,0irq/26-eth0-rx-0-21swapper/321:50:553
29715040,0irq/26-eth0-rx-0-21swapper/321:40:573
29715040,0irq/26-eth0-rx-0-21swapper/321:36:093
29715040,0irq/26-eth0-rx-0-21swapper/321:31:033
259940,0migration/27984-21kthreadcore19:16:012
259940,0migration/26812-21kthreadcore22:31:012
259940,0migration/25161-21kthreadcore00:11:022
259940,0migration/228809-21kernelversion20:21:002
259940,0migration/224522-21kthreadcore20:41:012
259940,0migration/22330-21runrttasks20:49:252
259940,0migration/219387-21runrttasks19:47:452
259940,0migration/218280-21aten_r1power_vo23:40:582
259940,0migration/211629-21fschecks_count21:55:582
249940,0watchdog/23514-21snmpd22:45:502
249940,0watchdog/20-21swapper/223:31:022
249940,0watchdog/20-21swapper/220:11:032
249940,0watchdog/20-21swapper/219:51:032
179940,0migration/1922-21aten_r1power_po20:00:561
179940,0migration/17823-21kthreadcore19:16:011
179940,0migration/17352-21kthreadcore23:11:021
179940,0migration/14122-21kthreadcore22:50:581
179940,0migration/131675-21kthreadcore22:06:011
179940,0migration/129411-21kthreadcore19:06:021
179940,0migration/128203-21kthreadcore23:06:011
179940,0migration/123779-21kthreadcore22:01:011
179940,0migration/123281-21kthreadcore23:41:041
179940,0migration/12275-21sh21:28:581
179940,0migration/114164-21kthreadcore18:56:021
179940,0migration/111741-21kthreadcore00:16:011
169940,0watchdog/18896-21ssh22:32:061
169940,0watchdog/16559-21runrttasks22:36:461
169940,0watchdog/14439-21kthreadcore00:11:021
169940,0watchdog/14076-21irqrtprio22:11:031
169940,0watchdog/127361-21munin-node21:46:031
169940,0watchdog/118539-21memory19:46:031
169940,0watchdog/116880-21sensors21:56:071
169940,0watchdog/111933-21tr23:16:021
169940,0watchdog/10-21swapper/122:41:061
169940,0watchdog/10-21swapper/122:41:061
169940,0watchdog/10-21swapper/121:20:591
169940,0watchdog/10-21swapper/121:19:231
169940,0watchdog/10-21swapper/120:56:031
169940,0watchdog/10-21swapper/120:51:031
169940,0watchdog/10-21swapper/120:36:031
149940,0migration/029167-21kthreadcore00:06:010
8215030,0irq/24-0000:00:0-21swapper/220:35:452
43659932,0cyclictest29498-21cut19:31:022
43659932,0cyclictest25431-21awk19:05:592
43659932,0cyclictest13527-21unixbench_singl20:06:072
43659931,0cyclictest16726-21kthreadcore20:36:022
43659930,0cyclictest11055-21dump-pmu-power18:55:452
43659930,0cyclictest0-21swapper/219:26:012
43649933,0cyclictest620-21awk19:36:001
43649932,0cyclictest28449-21munin-node20:46:001
43649932,0cyclictest21825-21awk20:15:591
43639933,0cyclictest20265-21kworker/0:123:15:470
43639933,0cyclictest20265-21kworker/0:122:50:500
43639933,0cyclictest20265-21kworker/0:122:45:480
43639933,0cyclictest20265-21kworker/0:122:15:480
43639933,0cyclictest17709-21kworker/0:021:20:540
43639933,0cyclictest17709-21kworker/0:020:40:460
43639933,0cyclictest17709-21kworker/0:020:30:460
43639933,0cyclictest17709-21kworker/0:020:25:560
43639933,0cyclictest17709-21kworker/0:020:05:560
43639933,0cyclictest17709-21kworker/0:019:40:480
43639933,0cyclictest17709-21kworker/0:019:30:540
43639933,0cyclictest17709-21kworker/0:019:11:000
29715030,0irq/26-eth0-rx-0-21swapper/320:30:563
29715030,0irq/26-eth0-rx-0-21swapper/320:01:103
29715030,0irq/26-eth0-rx-0-21swapper/319:50:573
29715030,0irq/26-eth0-rx-0-21swapper/319:45:543
249930,0watchdog/20-21swapper/219:40:592
169930,0watchdog/10-21swapper/122:20:541
169930,0watchdog/10-21swapper/121:36:031
169930,0watchdog/10-21swapper/119:11:031
29715020,0irq/26-eth0-rx-0-21swapper/320:37:313
29715020,0irq/26-eth0-rx-0-21swapper/319:40:563
29715020,0irq/26-eth0-rx-0-21swapper/319:31:063
29715020,0irq/26-eth0-rx-0-21swapper/319:05:463
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional