You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 12:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed Jul 15, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1969923626,0sleep20-21swapper/218:46:562
304450350,0irq/25-eth10-21swapper/318:44:503
1966722622,0sleep10-21swapper/118:46:311
1965522521,0sleep00-21swapper/018:46:260
35160,0ktimersoftd/30-21swapper/321:31:153
339960,0migration/39351-21sh23:24:063
339960,0migration/3894-21sh22:57:513
339960,0migration/38538-21sh23:42:033
339960,0migration/317452-21sh23:29:203
339960,0migration/316542-21sh22:45:533
339960,0migration/31177-21sh23:19:023
339960,0migration/310713-21munin-node22:25:013
29725060,0irq/27-eth0-tx-32449-21users20:55:122
29715060,0irq/26-eth0-rx-0-21swapper/323:04:163
200189965,0cyclictest12916-21sed20:45:032
200179960,0cyclictest0-21swapper/123:21:321
200179960,0cyclictest0-21swapper/121:07:321
19160,0ktimersoftd/16559-21runrttasks22:19:251
149960,0migration/08849-21sh23:22:400
149960,0migration/02596-21munin-node22:00:000
149960,0migration/025604-21sh22:33:150
149960,0migration/025246-21sh23:33:170
149960,0migration/016562-21sh21:05:160
8215050,0irq/24-0000:00:27605-21turbostat19:19:482
4150,0ktimersoftd/00-21swapper/000:15:140
35150,0ktimersoftd/30-21swapper/322:31:033
339950,0migration/38839-21sh00:03:143
339950,0migration/38385-21taskset19:27:173
339950,0migration/3687-21munin-node19:20:053
339950,0migration/3687-21munin-node19:20:053
339950,0migration/327589-21kthreadcore20:05:063
339950,0migration/324773-21sh22:51:223
339950,0migration/324143-21munin-node23:30:123
339950,0migration/323892-21munin-node00:10:113
339950,0migration/321921-21kthreadcore21:50:063
339950,0migration/320498-21kthreadcore22:10:033
339950,0migration/319824-21kthreadcore20:50:053
339950,0migration/318789-21kthreadcore20:00:053
339950,0migration/313263-21kthreadcore23:05:053
339950,0migration/312072-21kthreadcore21:05:043
339950,0migration/311970-21kthreadcore21:25:043
339950,0migration/311502-21munin-node21:45:053
339950,0migration/310085-21munin-node20:15:123
29725050,0irq/27-eth0-tx-3157-21iostat_ios21:00:032
29725050,0irq/27-eth0-tx-3109-21munin-node19:50:140
29725050,0irq/27-eth0-tx-18918-21if_err_eth023:10:022
29725050,0irq/27-eth0-tx-17454-21munin-node20:25:000
29725050,0irq/27-eth0-tx-10799-21munin-node20:20:090
29725050,0irq/27-eth0-tx-0-21swapper/223:59:112
29725050,0irq/27-eth0-tx-0-21swapper/222:58:062
29725050,0irq/27-eth0-tx-0-21swapper/222:23:142
29725050,0irq/27-eth0-tx-0-21swapper/222:06:162
29725050,0irq/27-eth0-tx-0-21swapper/221:35:462
29725050,0irq/27-eth0-tx-0-21swapper/200:14:582
29725050,0irq/27-eth0-tx-0-21swapper/020:40:010
29725050,0irq/27-eth0-tx-0-21swapper/020:08:590
29725050,0irq/27-eth0-tx-0-21swapper/019:36:290
29715050,0irq/26-eth0-rx-6468-21cut21:40:053
29715050,0irq/26-eth0-rx-27878-21irqrtprio21:55:053
29715050,0irq/26-eth0-rx-27398-21if_err_eth022:15:003
29715050,0irq/26-eth0-rx-27061-21df21:35:003
29715050,0irq/26-eth0-rx-2421-21kthreadcore19:00:053
29715050,0irq/26-eth0-rx-23865-21sensors23:10:103
29715050,0irq/26-eth0-rx-22393-21kthreadcore23:50:053
29715050,0irq/26-eth0-rx-15036-21mdstat00:05:063
29715050,0irq/26-eth0-rx-0-21swapper/323:56:223
29715050,0irq/26-eth0-rx-0-21swapper/323:35:043
29715050,0irq/26-eth0-rx-0-21swapper/322:34:553
29715050,0irq/26-eth0-rx-0-21swapper/322:02:503
29715050,0irq/26-eth0-rx-0-21swapper/321:10:043
29715050,0irq/26-eth0-rx-0-21swapper/321:01:563
29715050,0irq/26-eth0-rx-0-21swapper/300:15:283
27150,0ktimersoftd/20-21swapper/223:45:272
27150,0ktimersoftd/20-21swapper/223:20:052
27150,0ktimersoftd/20-21swapper/222:31:032
27150,0ktimersoftd/20-21swapper/221:47:032
259950,0migration/24588-21fschecks_count20:15:022
259950,0migration/23864-21open_files20:35:092
259950,0migration/23453-21irqcore22:00:042
259950,0migration/225851-21kthreadcore20:05:052
259950,0migration/225759-21sh20:54:022
259950,0migration/220736-21kthreadcore19:35:062
259950,0migration/219388-21idleruntime21:50:032
259950,0migration/213402-21kthreadcore21:25:052
259950,0migration/211497-21kthreadcore23:25:032
249950,0watchdog/223060-21kthreadcore23:30:052
249950,0watchdog/210962-21smartctl22:45:012
249950,0watchdog/210536-21gltestperf19:55:022
249950,0watchdog/20-21swapper/200:10:092
200189955,0cyclictest18161-21diskmemload00:04:132
200189955,0cyclictest0-21swapper/223:01:572
200189955,0cyclictest0-21swapper/222:36:152
200189954,0cyclictest7813-21taskset19:25:102
200189950,0cyclictest0-21swapper/222:52:292
200179955,0cyclictest18161-21diskmemload22:50:481
200179955,0cyclictest0-21swapper/123:56:231
200179955,0cyclictest0-21swapper/122:36:361
200179955,0cyclictest0-21swapper/121:11:561
200179955,0cyclictest0-21swapper/121:01:231
200179955,0cyclictest0-21swapper/120:59:201
200179954,0cyclictest3514-21snmpd22:01:591
200179950,0cyclictest0-21swapper/121:51:591
200169955,0cyclictest0-21swapper/022:12:060
200169950,0cyclictest0-21swapper/023:17:310
169950,0watchdog/16412-21kthreadcore19:50:061
149950,0migration/09750-21munin-node19:30:030
149950,0migration/08960-21taskset23:43:160
149950,0migration/07958-21munin-node21:20:060
149950,0migration/05043-21kthreadcore00:00:040
149950,0migration/0485-21kthreadcore20:10:050
149950,0migration/031543-21kthreadcore21:15:060
149950,0migration/031354-21kthreadcore20:55:060
149950,0migration/029871-21kthreadcore19:20:030
149950,0migration/029871-21kthreadcore19:20:030
149950,0migration/02793-21fschecks_time21:00:010
149950,0migration/024822-21taskset22:51:300
149950,0migration/02204-21aten_r1power_vo22:39:580
149950,0migration/019654-21irqcore21:10:040
149950,0migration/019097-21fschecks_count21:50:020
149950,0migration/017578-21latency_hist00:09:470
149950,0migration/01709-21sh22:19:210
149950,0migration/016817-21sh22:05:510
149950,0migration/016733-21cpuspeed_turbos20:00:000
149950,0migration/015658-21needreboot22:45:070
149950,0migration/01286-21sh23:39:330
149950,0migration/011749-21kthreadcore22:25:050
149950,0migration/011256-21fschecks_time21:25:010
149950,0migration/010595-21aten_r1power_fr21:45:000
339940,0migration/36032-21kthreadcore19:50:063
339940,0migration/33192-21kthreadcore20:35:073
339940,0migration/331661-21kthreadcore18:55:063
339940,0migration/326518-21taskset18:53:273
339940,0migration/326449-21kthreadcore20:30:063
339940,0migration/32553-21taskset19:46:183
339940,0migration/314349-21kthreadcore22:05:053
339940,0migration/314267-21kthreadcore20:20:063
339940,0migration/313308-21ntp_kernel_pll_19:05:073
339940,0migration/312379-21fschecks_time20:45:003
29725040,0irq/27-eth0-tx-27419-21hddtemp_smartct21:55:022
29725040,0irq/27-eth0-tx-2496-21ssh23:40:022
29725040,0irq/27-eth0-tx-2340-21munin-node21:39:592
29725040,0irq/27-eth0-tx-0-21swapper/223:49:512
29725040,0irq/27-eth0-tx-0-21swapper/222:24:522
29725040,0irq/27-eth0-tx-0-21swapper/222:14:522
29725040,0irq/27-eth0-tx-0-21swapper/222:10:562
29725040,0irq/27-eth0-tx-0-21swapper/221:14:472
29725040,0irq/27-eth0-tx-0-21swapper/221:05:012
29725040,0irq/27-eth0-tx-0-21swapper/020:49:490
29725040,0irq/27-eth0-tx-0-21swapper/019:55:040
29725040,0irq/27-eth0-tx-0-21swapper/019:44:590
29715040,0irq/26-eth0-rx-9774-21munin-node19:30:033
29715040,0irq/26-eth0-rx-0-21swapper/323:44:523
29715040,0irq/26-eth0-rx-0-21swapper/322:40:003
29715040,0irq/26-eth0-rx-0-21swapper/322:20:423
29715040,0irq/26-eth0-rx-0-21swapper/321:21:143
29715040,0irq/26-eth0-rx-0-21swapper/321:15:063
29715040,0irq/26-eth0-rx-0-21swapper/320:57:203
29715040,0irq/26-eth0-rx-0-21swapper/319:39:583
29715040,0irq/26-eth0-rx-0-21swapper/319:15:073
29715040,0irq/26-eth0-rx-0-21swapper/319:14:483
259940,0migration/29990-21kthreadcore19:05:052
259940,0migration/22713-21runrttasks19:48:052
259940,0migration/226803-21kthreadcore20:30:062
259940,0migration/217382-21latency_hist20:24:472
249940,0watchdog/27467-21kthreadcore20:40:062
249940,0watchdog/26559-21runrttasks23:15:572
249940,0watchdog/223691-21kthreadcore21:30:052
249940,0watchdog/20-21swapper/223:35:052
249940,0watchdog/20-21swapper/223:05:012
249940,0watchdog/20-21swapper/221:10:092
249940,0watchdog/20-21swapper/220:00:062
249940,0watchdog/20-21swapper/218:50:062
249940,0watchdog/20-21swapper/200:05:052
200189943,0cyclictest9697-21awk19:30:032
200189943,0cyclictest872-21sadc18:59:482
200189943,0cyclictest4022-21awk19:50:032
200189943,0cyclictest3556-21lldpd20:22:592
200189943,0cyclictest3556-21lldpd19:12:002
200189943,0cyclictest3538-21awk21:20:032
200189943,0cyclictest3323-21sed20:10:112
200189943,0cyclictest2957-21awk22:40:022
200179944,0cyclictest681-21ssh21:36:041
200179944,0cyclictest0-21swapper/123:42:301
200179944,0cyclictest0-21swapper/100:14:591
200179943,0cyclictest3556-21lldpd23:30:001
200179943,0cyclictest3556-21lldpd19:11:301
200179943,0cyclictest3556-21lldpd18:58:301
200179943,0cyclictest3514-21snmpd22:55:291
200179943,0cyclictest3514-21snmpd19:41:421
200179943,0cyclictest3514-21snmpd19:23:571
200179943,0cyclictest3514-21snmpd19:23:571
200179943,0cyclictest3241-21irqbalance23:14:551
200179943,0cyclictest3241-21irqbalance20:34:561
200179943,0cyclictest3241-21irqbalance20:30:061
200179943,0cyclictest3241-21irqbalance20:26:361
200179943,0cyclictest3241-21irqbalance20:11:161
200179943,0cyclictest3241-21irqbalance20:02:461
200179943,0cyclictest2987-21awk22:40:021
200179943,0cyclictest27733-21awk21:15:031
200179943,0cyclictest27620-21awk21:55:041
200179943,0cyclictest2485-21awk00:00:021
200179943,0cyclictest22056-21awk19:15:021
200179943,0cyclictest19420-21awk22:10:021
200179943,0cyclictest18873-21grep23:50:031
200179943,0cyclictest18590-21awk00:10:001
200179943,0cyclictest10672-21awk19:55:031
200169944,0cyclictest15556-21kworker/0:000:06:020
200169944,0cyclictest13771-21kworker/0:219:25:010
200169943,0cyclictest3556-21lldpd21:59:000
200169943,0cyclictest3514-21snmpd23:12:590
200169943,0cyclictest3514-21snmpd22:59:440
200169943,0cyclictest3514-21snmpd19:42:420
200169943,0cyclictest3241-21irqbalance23:55:050
200169943,0cyclictest3241-21irqbalance21:44:160
200169943,0cyclictest2057-21sadc21:39:470
200169943,0cyclictest1984-21awk19:00:030
200169943,0cyclictest19609-21awk21:30:030
200169943,0cyclictest18827-21awk23:50:030
200169943,0cyclictest10787-21awk23:45:030
200169940,0cyclictest0-21swapper/018:50:020
179940,0migration/19363-21kthreadcore20:40:061
179940,0migration/124035-21kthreadcore18:50:061
179940,0migration/123412-21cpuspeed_turbos20:05:001
179940,0migration/119172-21hwlatdetect22:30:021
179940,0migration/119038-21df_abs21:30:001
179940,0migration/118897-21munin-node20:50:021
179940,0migration/115932-21munin-node19:35:011
179940,0migration/115029-21kthreadcore21:25:051
179940,0migration/110074-21irqrtprio19:30:041
169940,0watchdog/130556-21cut23:35:051
169940,0watchdog/12952-21ssh22:20:011
169940,0watchdog/121738-21kthreadcore23:10:051
169940,0watchdog/117027-21memory20:45:061
169940,0watchdog/116246-21ssh23:25:531
169940,0watchdog/114427-21kthreadcore20:20:061
169940,0watchdog/110862-21cut22:25:011
169940,0watchdog/110501-21munin-node21:45:051
169940,0watchdog/110434-21perl23:45:011
169940,0watchdog/110401-21ssh22:04:571
169940,0watchdog/110174-21ssh21:44:411
169940,0watchdog/10-21swapper/123:05:011
169940,0watchdog/10-21swapper/120:15:061
169940,0watchdog/10-21swapper/119:44:581
169940,0watchdog/10-21swapper/100:05:051
149940,0migration/0490-21sh22:36:170
149940,0migration/028355-21kthreadcore18:55:050
149940,0migration/016241-21sh23:25:520
149940,0migration/013371-21kthreadcore23:05:050
29715030,0irq/26-eth0-rx-0-21swapper/320:40:143
29715030,0irq/26-eth0-rx-0-21swapper/320:25:213
29715030,0irq/26-eth0-rx-0-21swapper/320:10:283
29715030,0irq/26-eth0-rx-0-21swapper/319:55:103
29715030,0irq/26-eth0-rx-0-21swapper/319:34:593
249930,0watchdog/20-21swapper/219:40:022
200189932,0cyclictest3556-21lldpd19:20:302
200189932,0cyclictest3556-21lldpd19:20:302
200189932,0cyclictest3556-21lldpd19:03:302
200179932,0cyclictest3413-21awk21:20:021
200179932,0cyclictest3241-21irqbalance22:44:551
200169933,0cyclictest13771-21kworker/0:222:59:480
200169933,0cyclictest13771-21kworker/0:222:19:560
200169933,0cyclictest13771-21kworker/0:220:45:050
200169933,0cyclictest13771-21kworker/0:220:34:590
200169933,0cyclictest13771-21kworker/0:220:29:510
200169933,0cyclictest13771-21kworker/0:220:14:530
200169933,0cyclictest13771-21kworker/0:219:09:550
200169932,0cyclictest7886-21munin-node19:05:110
200169930,0cyclictest0-21swapper/019:14:530
169930,0watchdog/14534-21kthreadcore23:00:051
169930,0watchdog/10-21swapper/119:25:061
169930,0watchdog/10-21swapper/119:00:021
200179921,0cyclictest0-21swapper/119:04:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional