You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 13:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Tue Sep 15, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450690,0irq/25-eth10-21swapper/318:40:533
1540426766,0sleep20-21swapper/218:40:012
1554425857,0sleep10-21swapper/118:41:361
938423524,0sleep00-21swapper/018:38:590
1580799130,0cyclictest0-21swapper/020:45:220
158079976,0cyclictest2963-21ssh22:37:290
339960,0migration/39964-21munin-node00:04:063
339960,0migration/326614-21sh22:30:013
339960,0migration/326465-21latency_hist20:28:533
339960,0migration/313465-21munin-node20:39:153
339960,0migration/311053-21sh22:21:073
29715060,0irq/26-eth0-rx-7428-21cut21:39:103
29715060,0irq/26-eth0-rx-18851-21ssh00:09:083
29715060,0irq/26-eth0-rx-16176-21sed23:44:153
29715060,0irq/26-eth0-rx-11647-21diskstats23:04:053
29715060,0irq/26-eth0-rx-0-21swapper/321:25:513
158089960,0cyclictest12030-21kthreadcore23:24:081
158089960,0cyclictest0-21swapper/123:41:571
158089960,0cyclictest0-21swapper/122:08:561
149960,0migration/04021-21sh21:57:200
149960,0migration/027077-21sh22:31:250
339950,0migration/3890-21kthreadcore20:54:103
339950,0migration/36632-21irqcore19:49:093
339950,0migration/331569-21unixbench_multi20:04:173
339950,0migration/328602-21sh21:09:393
339950,0migration/327555-21fschecks_count23:14:053
339950,0migration/327204-21kthreadcore20:49:113
339950,0migration/326482-21latency_hist23:33:523
339950,0migration/325862-21taskset23:32:383
339950,0migration/324365-21gltestperf19:14:083
339950,0migration/319385-21sh22:05:413
339950,0migration/317628-21kthreadcore18:44:093
339950,0migration/317519-21smart_sdb22:44:133
339950,0migration/315159-21kthreadcore19:04:103
29725050,0irq/27-eth0-tx-0-21swapper/019:54:100
29725050,0irq/27-eth0-tx-0-21swapper/019:00:410
29715050,0irq/26-eth0-rx-9564-21ssh23:21:203
29715050,0irq/26-eth0-rx-4653-21cut23:39:093
29715050,0irq/26-eth0-rx-32539-21kthreadcore19:19:093
29715050,0irq/26-eth0-rx-2900-21taskset22:15:413
29715050,0irq/26-eth0-rx-2900-21taskset22:15:413
29715050,0irq/26-eth0-rx-27494-21sh22:11:083
29715050,0irq/26-eth0-rx-26996-21which21:49:123
29715050,0irq/26-eth0-rx-18866-21awk21:44:113
29715050,0irq/26-eth0-rx-16659-21kthreadcore20:44:113
29715050,0irq/26-eth0-rx-0-21swapper/323:58:593
29715050,0irq/26-eth0-rx-0-21swapper/323:24:283
29715050,0irq/26-eth0-rx-0-21swapper/323:09:043
29715050,0irq/26-eth0-rx-0-21swapper/322:59:393
29715050,0irq/26-eth0-rx-0-21swapper/322:51:003
29715050,0irq/26-eth0-rx-0-21swapper/321:59:083
29715050,0irq/26-eth0-rx-0-21swapper/321:54:093
29715050,0irq/26-eth0-rx-0-21swapper/321:14:123
29715050,0irq/26-eth0-rx-0-21swapper/321:04:113
29715050,0irq/26-eth0-rx-0-21swapper/320:34:083
29715050,0irq/26-eth0-rx-0-21swapper/319:29:113
179950,0migration/17004-21mdstat23:59:091
179950,0migration/13725-21munin-node23:19:081
179950,0migration/131896-21missed_timers20:29:101
179950,0migration/128202-21kthreadcore19:39:111
179950,0migration/127572-21latency_hist22:53:521
179950,0migration/125732-21needreboot22:29:121
179950,0migration/122304-21kthreadcore23:49:091
179950,0migration/120052-21munin-node20:44:171
179950,0migration/11869-21munin-node22:14:121
179950,0migration/11869-21munin-node22:14:121
169950,0watchdog/12338-21cut20:34:111
169950,0watchdog/114699-21fschecks_count21:04:071
169950,0watchdog/10-21swapper/121:49:031
158109954,0cyclictest12739-21irqcore22:44:072
158109950,0cyclictest0-21swapper/223:44:422
158109950,0cyclictest0-21swapper/222:02:132
158089955,0cyclictest0-21swapper/122:02:281
158089950,0cyclictest0-21swapper/121:17:041
158089950,0cyclictest0-21swapper/121:12:201
158089950,0cyclictest0-21swapper/118:54:331
158089950,0cyclictest0-21swapper/100:08:271
158079953,0cyclictest27999-21kworker/0:019:45:530
158079950,0cyclictest0-21swapper/022:27:240
158079950,0cyclictest0-21swapper/021:09:120
149950,0migration/0993-21kthreadcore21:34:110
149950,0migration/08655-21latency22:59:100
149950,0migration/07578-21munin-node23:39:100
149950,0migration/06558-21sendmail_mailst20:34:160
149950,0migration/0505-21kthreadcore18:54:110
149950,0migration/04530-21kthreadcore20:09:110
149950,0migration/030062-21runrttasks20:53:510
149950,0migration/028394-21sh22:13:510
149950,0migration/028211-21kthreadcore23:54:100
149950,0migration/027519-21latency_hist22:53:520
149950,0migration/027093-21taskset22:53:070
149950,0migration/026017-21taskset20:24:470
149950,0migration/026007-21kthreadcore19:39:100
149950,0migration/025769-21munin-node20:04:060
149950,0migration/02401-21sh22:14:150
149950,0migration/02401-21sh22:14:150
149950,0migration/023482-21idleruntime18:49:080
149950,0migration/020981-21sh21:27:070
149950,0migration/019034-21aten_r1power_po19:59:040
149950,0migration/017945-21munin-node19:34:050
149950,0migration/01718-21kthreadcore20:54:100
149950,0migration/01689-21kthreadcore19:19:100
149950,0migration/014368-21irqcore20:19:090
149950,0migration/012551-21munin-node22:44:050
149950,0migration/011359-21sh22:22:020
149950,0migration/01064-21sh23:14:570
8215040,0irq/24-0000:00:30051-21latency_hist19:18:532
339940,0migration/37737-21kthreadcore20:59:093
339940,0migration/326190-21kthreadcore19:39:103
339940,0migration/31961-21kthreadcore19:44:113
339940,0migration/314729-21kthreadcore19:54:093
29725040,0irq/27-eth0-tx-22740-21kthreadcore00:09:102
29725040,0irq/27-eth0-tx-20725-21munin-node22:09:052
29725040,0irq/27-eth0-tx-0-21swapper/223:29:232
29725040,0irq/27-eth0-tx-0-21swapper/223:22:252
29725040,0irq/27-eth0-tx-0-21swapper/223:10:392
29725040,0irq/27-eth0-tx-0-21swapper/222:27:082
29725040,0irq/27-eth0-tx-0-21swapper/222:14:322
29725040,0irq/27-eth0-tx-0-21swapper/222:14:322
29725040,0irq/27-eth0-tx-0-21swapper/221:44:562
29725040,0irq/27-eth0-tx-0-21swapper/221:39:072
29725040,0irq/27-eth0-tx-0-21swapper/221:34:062
29725040,0irq/27-eth0-tx-0-21swapper/221:19:082
29725040,0irq/27-eth0-tx-0-21swapper/221:14:042
29725040,0irq/27-eth0-tx-0-21swapper/020:29:040
29725040,0irq/27-eth0-tx-0-21swapper/019:49:080
29725040,0irq/27-eth0-tx-0-21swapper/019:29:130
29715040,0irq/26-eth0-rx-0-21swapper/323:54:103
29715040,0irq/26-eth0-rx-0-21swapper/323:48:583
29715040,0irq/26-eth0-rx-0-21swapper/322:55:333
29715040,0irq/26-eth0-rx-0-21swapper/322:39:073
29715040,0irq/26-eth0-rx-0-21swapper/322:33:573
29715040,0irq/26-eth0-rx-0-21swapper/322:24:073
29715040,0irq/26-eth0-rx-0-21swapper/321:33:553
29715040,0irq/26-eth0-rx-0-21swapper/321:28:573
29715040,0irq/26-eth0-rx-0-21swapper/321:18:593
29715040,0irq/26-eth0-rx-0-21swapper/320:19:143
29715040,0irq/26-eth0-rx-0-21swapper/320:14:073
259940,0migration/24278-21kthreadcore23:59:082
259940,0migration/228420-21munin-node22:34:052
259940,0migration/223828-21munin-node18:49:102
259940,0migration/219283-21runrttasks20:19:252
249940,0watchdog/229707-21kthreadcore20:04:112
249940,0watchdog/224522-21kthreadcore22:29:112
249940,0watchdog/219835-21if_eth119:59:072
249940,0watchdog/216936-21sensors19:29:162
249940,0watchdog/216537-21kthreadcore20:44:112
249940,0watchdog/212592-21cat00:04:102
249940,0watchdog/20-21swapper/222:59:272
249940,0watchdog/20-21swapper/221:49:032
249940,0watchdog/20-21swapper/219:34:152
179940,0migration/17156-21kthreadcore22:59:101
179940,0migration/16498-21if_eth019:49:081
179940,0migration/16024-21aten_r1power_po21:19:041
179940,0migration/15045-21kthreadcore18:59:101
179940,0migration/1460-21kthreadcore21:54:101
179940,0migration/132451-21timerandwakeup23:34:151
179940,0migration/131599-21cpuspeed_turbos19:44:061
179940,0migration/123647-21kthreadcore19:59:101
179940,0migration/119378-21cpu23:09:041
179940,0migration/118059-21timerandwakeup19:54:141
179940,0migration/117479-21taskset19:31:241
179940,0migration/117021-21munin-node18:44:091
179940,0migration/114248-21if_eth1.320:19:081
179940,0migration/114244-21df_abs21:24:051
179940,0migration/113125-21latency_hist20:18:531
169940,0watchdog/14605-21df22:19:031
169940,0watchdog/13514-21snmpd21:33:591
169940,0watchdog/113519-21ssh21:02:431
169940,0watchdog/112931-21cut22:44:071
169940,0watchdog/10-21swapper/121:44:031
169940,0watchdog/10-21swapper/121:29:151
158109944,0cyclictest0-21swapper/223:56:312
158109944,0cyclictest0-21swapper/223:13:572
158109943,0cyclictest8573-21awk20:39:082
158109943,0cyclictest700-21awk20:09:092
158109943,0cyclictest3556-21lldpd21:29:002
158109943,0cyclictest3556-21lldpd19:03:592
158109943,0cyclictest3514-21snmpd23:38:522
158109943,0cyclictest3514-21snmpd19:00:522
158109943,0cyclictest3514-21snmpd18:47:072
158109943,0cyclictest3241-21irqbalance23:34:112
158109943,0cyclictest3241-21irqbalance23:25:012
158109943,0cyclictest3241-21irqbalance21:24:112
158109943,0cyclictest3241-21irqbalance21:09:012
158109943,0cyclictest3241-21irqbalance20:59:012
158109943,0cyclictest3241-21irqbalance20:55:512
158109943,0cyclictest3241-21irqbalance19:54:422
158109943,0cyclictest3241-21irqbalance19:50:522
158109943,0cyclictest30170-21awk18:54:082
158109943,0cyclictest30063-21awk21:54:072
158109943,0cyclictest28644-21awk22:54:102
158109943,0cyclictest25508-21awk19:39:092
158109943,0cyclictest23078-21awk20:49:082
158109943,0cyclictest20839-21awk20:24:072
158109943,0cyclictest20558-21awk22:49:052
158109943,0cyclictest19104-21awk23:49:072
158109943,0cyclictest1759-21awk20:34:102
158109943,0cyclictest15140-21awk21:04:092
158109943,0cyclictest12145-21awk23:04:072
158109940,0cyclictest12825-21munin-node22:04:062
158109940,0cyclictest0-21swapper/219:15:532
158089944,0cyclictest0-21swapper/123:16:151
158089944,0cyclictest0-21swapper/122:37:191
158089944,0cyclictest0-21swapper/120:49:481
158089943,0cyclictest5490-21awk19:24:081
158089943,0cyclictest3514-21snmpd23:55:221
158089943,0cyclictest3514-21snmpd21:41:071
158089943,0cyclictest3514-21snmpd19:10:371
158089943,0cyclictest31276-21awk20:54:081
158089943,0cyclictest28030-21needreboot18:49:121
158089943,0cyclictest24511-21awk19:14:101
158089943,0cyclictest20542-21awk22:49:051
158089943,0cyclictest19488-21awk23:29:061
158089943,0cyclictest11184-21awk19:04:081
158079944,0cyclictest0-21swapper/021:49:530
158079943,0cyclictest5538-21awk19:24:080
158079943,0cyclictest3556-21lldpd18:44:590
158079943,0cyclictest3514-21snmpd00:03:520
158079943,0cyclictest18443-21awk00:09:070
158079943,0cyclictest17902-21awk19:09:070
158079943,0cyclictest12034-21kworker/0:223:48:020
158079943,0cyclictest12034-21kworker/0:223:20:200
158079943,0cyclictest11539-21awk23:24:060
149940,0migration/09501-21processes22:39:130
149940,0migration/05862-21irqcore21:59:070
149940,0migration/028882-21sh21:32:020
149940,0migration/017100-21kthreadcore21:04:110
149940,0migration/015609-21kthreadcore23:04:100
149940,0migration/012256-21sh21:19:510
149940,0migration/010435-21aten_r1power_po19:04:040
149940,0migration/010312-21kthreadcore20:59:100
339930,0migration/332087-21pmu-power20:29:123
29725030,0irq/27-eth0-tx-0-21swapper/222:38:552
29715030,0irq/26-eth0-rx-0-21swapper/320:10:323
29715030,0irq/26-eth0-rx-0-21swapper/319:59:033
29715030,0irq/26-eth0-rx-0-21swapper/319:34:063
29715030,0irq/26-eth0-rx-0-21swapper/319:24:043
29715030,0irq/26-eth0-rx-0-21swapper/319:12:033
29715030,0irq/26-eth0-rx-0-21swapper/318:59:053
29715030,0irq/26-eth0-rx-0-21swapper/318:54:053
29715030,0irq/26-eth0-rx-0-21swapper/318:49:063
249930,0watchdog/20-21swapper/220:29:592
249930,0watchdog/20-21swapper/219:44:072
169930,0watchdog/116667-21ssh23:45:231
169930,0watchdog/114023-21diskmemload22:24:071
169930,0watchdog/10-21swapper/122:04:111
169930,0watchdog/10-21swapper/120:09:111
158109932,0cyclictest5140-21awk22:19:052
158109932,0cyclictest3556-21lldpd19:27:592
158109932,0cyclictest3514-21snmpd20:14:522
158109932,0cyclictest17854-21awk19:09:072
158089932,0cyclictest8331-21gltestperf20:39:061
158089932,0cyclictest4723-21awk22:39:071
158089932,0cyclictest26459-21awk20:04:091
158089932,0cyclictest18065-21aten_r1power_vo19:34:061
158089932,0cyclictest12194-21awk23:04:071
158089931,0cyclictest19314-21kthreadcore00:09:091
158089930,0cyclictest30281-21munin-node19:19:061
158079933,0cyclictest27999-21kworker/0:022:03:560
158079933,0cyclictest27999-21kworker/0:021:43:540
158079933,0cyclictest27999-21kworker/0:021:38:560
158079933,0cyclictest27999-21kworker/0:021:13:540
158079933,0cyclictest27999-21kworker/0:020:38:540
158079933,0cyclictest27999-21kworker/0:020:13:570
158079933,0cyclictest27999-21kworker/0:019:13:550
158079933,0cyclictest12034-21kworker/0:223:58:560
158079933,0cyclictest12034-21kworker/0:223:49:040
158079933,0cyclictest12034-21kworker/0:223:33:540
158079933,0cyclictest12034-21kworker/0:223:28:540
158079933,0cyclictest12034-21kworker/0:223:08:540
169920,0watchdog/10-21swapper/120:23:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional