You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-24 - 04:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Wed Jun 24, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2663525041,0sleep30-21swapper/318:47:003
3254923627,0sleep20-21swapper/218:47:512
3259423525,0sleep10-21swapper/118:48:221
3265322925,0sleep00-21swapper/018:49:010
4929966,0cyclictest25935-21diskmemload23:54:180
4929966,0cyclictest25935-21diskmemload21:43:360
4929960,0cyclictest0-21swapper/023:57:180
35160,0ktimersoftd/326844-1kworker/3:0H22:45:043
339960,0migration/38854-21sh21:18:463
339960,0migration/35185-21aten_r1power_fr20:12:003
339960,0migration/33491-21sh23:20:113
339960,0migration/328926-21sh21:36:353
339960,0migration/321164-21kthreadcore21:07:053
339960,0migration/319210-21munin-node20:22:023
339960,0migration/318534-21sh23:47:193
339960,0migration/310881-21sh23:23:013
29725060,0irq/27-eth0-tx-29416-21munin-node20:02:020
29715060,0irq/26-eth0-rx-26018-21open_files23:32:083
149960,0migration/026816-21fschecks_count21:32:010
149960,0migration/015400-21cpuspeed_turbos19:27:000
8853250,0sleep310413-21munin-node21:42:063
4959955,0cyclictest0-21swapper/223:16:592
4959955,0cyclictest0-21swapper/222:17:132
4959955,0cyclictest0-21swapper/200:07:352
4959950,0cyclictest0-21swapper/220:59:112
4949955,0cyclictest0-21swapper/122:43:411
4949955,0cyclictest0-21swapper/100:20:481
4949950,0cyclictest0-21swapper/122:10:251
4949950,0cyclictest0-21swapper/121:37:001
4949950,0cyclictest0-21swapper/121:25:101
4949950,0cyclictest0-21swapper/121:13:211
4929955,0cyclictest0-21swapper/023:36:200
4929955,0cyclictest0-21swapper/022:43:120
4929953,0cyclictest29825-21kworker/0:223:37:050
4929950,0cyclictest0-21swapper/022:49:310
4929950,0cyclictest0-21swapper/021:09:330
4929950,0cyclictest0-21swapper/000:03:180
35150,0ktimersoftd/30-21swapper/321:22:463
339950,0migration/36377-21cpuspeed_turbos20:37:023
339950,0migration/36197-21kthreadcore22:22:033
339950,0migration/35253-21kthreadcore19:42:143
339950,0migration/331499-21latency20:52:083
339950,0migration/331212-21df_abs20:07:003
339950,0migration/329582-21df_abs21:57:003
339950,0migration/329502-21munin-node23:57:033
339950,0migration/327912-21runrttasks22:55:023
339950,0migration/327085-21kthreadcore19:57:033
339950,0migration/32652-21taskset22:57:273
339950,0migration/321620-21pmu-power19:52:093
339950,0migration/321468-21taskset19:30:593
339950,0migration/321049-21aten_r1power_en22:12:003
339950,0migration/320815-21munin-node20:47:053
339950,0migration/31826-21aten_r1power_po20:57:013
339950,0migration/317028-21kthreadcore19:02:053
339950,0migration/314805-21kthreadcore23:07:053
339950,0migration/31334-21munin-node00:17:063
29725050,0irq/27-eth0-tx-6129-21munin-node20:37:050
29725050,0irq/27-eth0-tx-30828-21munin-node20:07:110
29725050,0irq/27-eth0-tx-20846-21munin-node19:07:060
29725050,0irq/27-eth0-tx-18483-21munin-node20:22:090
29725050,0irq/27-eth0-tx-10215-21port_sshpriv23:02:082
29715050,0irq/26-eth0-rx-8249-21munin-run19:21:483
29715050,0irq/26-eth0-rx-27600-21ssh23:14:333
29715050,0irq/26-eth0-rx-26686-21ssh23:52:253
29715050,0irq/26-eth0-rx-26460-21aten_r1power_po21:12:003
29715050,0irq/26-eth0-rx-21943-21munin-node21:52:013
29715050,0irq/26-eth0-rx-16577-21kthreadcore22:27:053
29715050,0irq/26-eth0-rx-15728-21kthreadcore00:07:043
29715050,0irq/26-eth0-rx-0-21swapper/323:27:573
29715050,0irq/26-eth0-rx-0-21swapper/322:46:553
29715050,0irq/26-eth0-rx-0-21swapper/322:36:533
29715050,0irq/26-eth0-rx-0-21swapper/322:34:293
29715050,0irq/26-eth0-rx-0-21swapper/322:19:033
29715050,0irq/26-eth0-rx-0-21swapper/322:02:033
29715050,0irq/26-eth0-rx-0-21swapper/322:02:033
29715050,0irq/26-eth0-rx-0-21swapper/321:50:553
29715050,0irq/26-eth0-rx-0-21swapper/321:02:033
29715050,0irq/26-eth0-rx-0-21swapper/318:57:013
27150,0ktimersoftd/20-21swapper/223:58:362
27150,0ktimersoftd/20-21swapper/221:17:572
249950,0watchdog/25382-21fschecks_count22:02:022
249950,0watchdog/25382-21fschecks_count22:02:022
179950,0migration/19176-21kthreadcore20:37:071
179950,0migration/17150-21kthreadcore23:22:031
179950,0migration/130289-21kthreadcore23:57:041
179950,0migration/126243-21munin-node23:52:081
179950,0migration/125669-21sh21:30:471
179950,0migration/125175-21munin-node20:47:101
179950,0migration/12081-21df_abs19:17:011
179950,0migration/118206-21munin-node22:47:071
179950,0migration/117265-21kthreadcore23:07:061
179950,0migration/113196-21gltestperf23:27:011
179950,0migration/111342-21kthreadcore19:47:041
179950,0migration/110990-21taskset23:02:571
169950,0watchdog/121407-21fschecks_time22:52:021
149950,0migration/09823-21kthreadcore23:02:060
149950,0migration/0832-21sh20:55:260
149950,0migration/06926-21kthreadcore21:17:110
149950,0migration/05469-21kthreadcore18:52:060
149950,0migration/03448-21gltestperf19:42:020
149950,0migration/030211-21kthreadcore21:12:070
149950,0migration/028368-21latency_hist19:36:480
149950,0migration/022915-21sh19:56:570
149950,0migration/022073-21kthreadcore22:52:050
149950,0migration/021931-21irqcore22:32:040
149950,0migration/021777-21taskset19:52:100
149950,0migration/021244-21kthreadcore21:27:050
149950,0migration/020977-21kthreadcore20:47:050
149950,0migration/016954-21kthreadcore23:27:060
149950,0migration/01384-21kthreadcore21:57:090
149950,0migration/013604-21kthreadcore20:17:060
149950,0migration/013249-21fschecks_time23:07:010
149950,0migration/013143-21hwlatdetect23:47:050
149950,0migration/010340-21aten_r1power_fr21:21:590
4959944,0cyclictest0-21swapper/223:46:562
4959944,0cyclictest0-21swapper/220:26:522
4959943,0cyclictest5304-21awk23:22:022
4959943,0cyclictest3580-21awk19:42:032
4959943,0cyclictest3556-21lldpd23:52:312
4959943,0cyclictest3556-21lldpd21:25:302
4959943,0cyclictest3556-21lldpd20:42:002
4959943,0cyclictest3556-21lldpd19:32:302
4959943,0cyclictest3556-21lldpd19:23:002
4959943,0cyclictest3556-21lldpd19:01:002
4959943,0cyclictest3514-21snmpd22:38:112
4959943,0cyclictest3514-21snmpd20:18:402
4959943,0cyclictest3514-21snmpd19:52:252
4959943,0cyclictest3514-21snmpd18:56:102
4959943,0cyclictest3241-21irqbalance23:12:062
4959943,0cyclictest3241-21irqbalance21:56:562
4959943,0cyclictest3241-21irqbalance21:11:562
4959943,0cyclictest3241-21irqbalance20:47:062
4959943,0cyclictest3241-21irqbalance20:41:062
4959943,0cyclictest3241-21irqbalance20:34:362
4959943,0cyclictest3241-21irqbalance00:17:462
4959943,0cyclictest3241-21irqbalance00:02:262
4959943,0cyclictest31807-21awk20:07:032
4959943,0cyclictest29481-21awk23:37:042
4959943,0cyclictest28479-21awk19:12:032
4959943,0cyclictest27090-21awk20:52:052
4959943,0cyclictest2662-21awk19:17:042
4959943,0cyclictest21827-21awk19:07:052
4959943,0cyclictest19335-21awk20:22:032
4959943,0cyclictest15977-21awk19:27:022
4959941,0cyclictest0-21swapper/222:41:582
4959941,0cyclictest0-21swapper/222:07:022
4959940,0cyclictest20719-21munin-node22:52:002
4949944,0cyclictest0-21swapper/120:56:101
4949943,0cyclictest9973-21sadc21:21:481
4949943,0cyclictest3556-21lldpd21:32:301
4949943,0cyclictest3514-21snmpd21:49:261
4949943,0cyclictest29585-21awk23:17:011
4949943,0cyclictest23664-21awk19:57:001
4949943,0cyclictest21803-21awk19:07:051
4949943,0cyclictest16960-21awk19:52:031
4949943,0cyclictest1672-21awk18:52:031
4929944,0cyclictest25935-21diskmemload23:42:190
4929944,0cyclictest11723-21kworker/0:022:07:110
4929944,0cyclictest0-21swapper/020:58:590
4929943,0cyclictest6099-21awk20:12:040
4929943,0cyclictest3556-21lldpd20:27:300
4929943,0cyclictest3556-21lldpd19:12:300
4929943,0cyclictest29784-21awk22:57:020
4929943,0cyclictest21901-21awk22:12:050
4929943,0cyclictest21479-21awk23:12:000
4929943,0cyclictest21177-21awk00:12:030
4929943,0cyclictest14011-21awk21:47:020
339940,0migration/35702-21kthreadcore23:42:053
339940,0migration/328081-21taskset19:35:123
339940,0migration/317602-21timerandwakeup20:17:113
339940,0migration/31584-21proc_pri19:37:083
339940,0migration/31497-21gltestperf18:52:023
29725040,0irq/27-eth0-tx-8318-21kthreadcore21:42:052
29725040,0irq/27-eth0-tx-20507-21ssh23:31:582
29725040,0irq/27-eth0-tx-20289-21munin-node00:12:032
29725040,0irq/27-eth0-tx-19084-21hwlatdetect21:27:022
29725040,0irq/27-eth0-tx-18593-21python22:27:092
29725040,0irq/27-eth0-tx-18484-21fschecks_count21:07:012
29725040,0irq/27-eth0-tx-12719-21munin-node22:47:092
29725040,0irq/27-eth0-tx-0-21swapper/222:22:242
29725040,0irq/27-eth0-tx-0-21swapper/221:47:502
29725040,0irq/27-eth0-tx-0-21swapper/221:37:092
29725040,0irq/27-eth0-tx-0-21swapper/221:33:562
29725040,0irq/27-eth0-tx-0-21swapper/221:02:042
29725040,0irq/27-eth0-tx-0-21swapper/020:32:070
29715040,0irq/26-eth0-rx-1281-21kthreadcore20:32:063
29715040,0irq/26-eth0-rx-0-21swapper/323:37:003
29715040,0irq/26-eth0-rx-0-21swapper/323:02:013
29715040,0irq/26-eth0-rx-0-21swapper/322:07:153
29715040,0irq/26-eth0-rx-0-21swapper/321:37:063
29715040,0irq/26-eth0-rx-0-21swapper/321:27:113
29715040,0irq/26-eth0-rx-0-21swapper/319:12:053
29715040,0irq/26-eth0-rx-0-21swapper/300:13:343
29715040,0irq/26-eth0-rx-0-21swapper/300:02:253
259940,0migration/228053-21sh21:54:232
259940,0migration/223943-21irqrtprio19:57:022
259940,0migration/222106-21irqcore22:12:062
259940,0migration/219305-21ksmtuned23:08:532
249940,0watchdog/25706-21fschecks_time20:12:022
249940,0watchdog/22215-21switchtime22:57:102
249940,0watchdog/221591-21gltestperf22:32:022
249940,0watchdog/215093-21grep23:27:062
249940,0watchdog/20-21swapper/223:42:012
19140,0ktimersoftd/10-21swapper/122:05:041
19140,0ktimersoftd/10-21swapper/122:05:041
179940,0migration/19229-21kthreadcore18:57:051
179940,0migration/18023-21kthreadcore00:02:051
179940,0migration/17692-21kthreadcore20:12:061
179940,0migration/13332-21kthreadcore20:32:071
179940,0migration/132512-21kthreadcore20:07:071
179940,0migration/132209-21kthreadcore22:37:071
179940,0migration/130504-21kthreadcore23:37:051
179940,0migration/129050-21latency_hist21:56:481
179940,0migration/128814-21latency_hist22:16:481
179940,0migration/125933-21munin-node20:27:021
179940,0migration/124672-21kthreadcore00:12:051
179940,0migration/124550-21taskset20:22:501
179940,0migration/123740-21munin-node21:07:091
179940,0migration/123688-21kthreadcore23:12:031
179940,0migration/117407-21kthreadcore00:07:051
179940,0migration/115198-21kthreadcore22:27:041
179940,0migration/113870-21irqcore20:42:041
179940,0migration/112933-21fschecks_time23:47:051
179940,0migration/111722-21kthreadcore21:02:051
179940,0migration/11119-21kthreadcore19:37:051
169940,0watchdog/17546-21ssh20:57:101
169940,0watchdog/13106-21ssh22:18:061
169940,0watchdog/126672-21rm23:32:261
169940,0watchdog/114913-21kthreadcore20:17:061
169940,0watchdog/114414-21unixbench_singl19:22:111
169940,0watchdog/10-21swapper/123:42:011
169940,0watchdog/10-21swapper/122:32:021
149940,0migration/0846-21kthreadcore22:17:050
149940,0migration/06963-21kthreadcore19:17:060
149940,0migration/030627-21kthreadcore22:37:060
149940,0migration/028795-21fschecks_count00:17:000
149940,0migration/028728-21aten_r1power_fr23:16:580
149940,0migration/02769-21timerandwakeup21:37:140
149940,0migration/027592-21sh21:53:020
149940,0migration/015295-21irqcore19:02:040
4959933,0cyclictest3556-21lldpd20:04:002
4959932,0cyclictest3514-21snmpd19:46:552
4959932,0cyclictest3514-21snmpd19:02:402
4949932,0cyclictest3556-21lldpd19:02:001
4949932,0cyclictest30142-21awk21:57:031
4949930,0cyclictest29425-21perl22:57:001
4929933,0cyclictest29825-21kworker/0:200:11:310
4929932,0cyclictest13686-21awk22:27:020
4929932,0cyclictest13655-21awk20:42:020
4929932,0cyclictest10711-21awk21:02:030
4929932,0cyclictest10664-21sensors22:02:100
4929932,0cyclictest10664-21sensors22:02:100
4929931,0cyclictest9819-21kthreadcore19:22:040
4929930,0cyclictest7536-21munin-node18:57:040
4929930,0cyclictest0-21swapper/019:47:030
4929930,0cyclictest0-21swapper/019:32:000
339930,0migration/330305-21runrttasks20:03:313
29715030,0irq/26-eth0-rx-0-21swapper/320:43:473
29715030,0irq/26-eth0-rx-0-21swapper/320:31:053
29715030,0irq/26-eth0-rx-0-21swapper/319:50:123
29715030,0irq/26-eth0-rx-0-21swapper/319:21:593
29715030,0irq/26-eth0-rx-0-21swapper/319:09:523
249930,0watchdog/228517-21tail19:36:582
179930,0migration/131702-21kthreadcore19:12:051
169930,0watchdog/115124-21munin-node19:27:071
169930,0watchdog/10-21swapper/122:21:581
169930,0watchdog/10-21swapper/121:43:301
149930,0migration/011508-21sh23:24:520
4949920,0cyclictest0-21swapper/119:31:481
4929921,0cyclictest4731-21sh22:21:540
169920,0watchdog/10-21swapper/120:01:501
169920,0watchdog/10-21swapper/119:41:541
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional