You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-15 - 02:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Mon Jun 15, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
409723926,0sleep00-21swapper/018:47:460
304450350,0irq/25-eth10-21swapper/318:48:093
1015623425,0sleep20-21swapper/218:48:562
1012322622,0sleep10-21swapper/118:48:311
8215060,0irq/24-0000:00:8807-21dump-pmu-power21:32:392
339960,0migration/37214-21sh23:52:343
339960,0migration/323110-21sh22:18:143
339960,0migration/31605-21sh21:47:543
339960,0migration/314332-21sh23:13:033
339960,0migration/313504-21sh00:13:153
29725060,0irq/27-eth0-tx-23567-21munin-node00:03:042
29725060,0irq/27-eth0-tx-2309-21munin-node20:48:000
29715060,0irq/26-eth0-rx-29554-21munin-node19:03:003
29715060,0irq/26-eth0-rx-18148-21iostat_ios21:37:553
29715060,0irq/26-eth0-rx-17183-21perl22:57:523
29715060,0irq/26-eth0-rx-16141-21sh22:16:143
29715060,0irq/26-eth0-rx-1280-21perl22:07:523
105539960,0cyclictest0-21swapper/221:35:542
105539960,0cyclictest0-21swapper/219:17:572
105529960,0cyclictest0-21swapper/121:37:591
105519966,0cyclictest8816-21diskmemload23:54:140
8215050,0irq/24-0000:00:13545-21awk20:07:402
4150,0ktimersoftd/00-21swapper/022:11:170
339950,0migration/39503-21kthreadcore23:52:573
339950,0migration/39119-21aten_r1power_en20:52:513
339950,0migration/38961-21if_eth020:27:533
339950,0migration/37692-21missed_timers20:47:593
339950,0migration/35495-21fschecks_count19:12:543
339950,0migration/332203-21munin-node19:32:533
339950,0migration/331975-21taskset21:04:523
339950,0migration/331639-21sh22:44:593
339950,0migration/329354-21sendmail_mailtr00:03:023
339950,0migration/328371-21kthreadcore23:42:583
339950,0migration/325462-21fschecks_count22:22:523
339950,0migration/325444-21munin-node21:22:513
339950,0migration/323806-21taskset19:01:553
339950,0migration/32021-21kthreadcore22:47:573
339950,0migration/317169-21kthreadcore23:57:563
339950,0migration/31435-21munin-node19:07:543
339950,0migration/313575-21latency_hist20:07:403
339950,0migration/312779-21aten_r1power_en19:42:513
339950,0migration/312370-21kthreadcore22:52:553
339950,0migration/310554-21kthreadcore23:32:563
29725050,0irq/27-eth0-tx-31723-21munin-node19:32:560
29725050,0irq/27-eth0-tx-31614-21ssh21:43:532
29725050,0irq/27-eth0-tx-2984-21tr22:07:562
29725050,0irq/27-eth0-tx-25095-21munin-node21:02:502
29725050,0irq/27-eth0-tx-24156-21ssh23:22:422
29725050,0irq/27-eth0-tx-24116-21munin-node19:02:580
29725050,0irq/27-eth0-tx-17287-21munin-node21:17:522
29725050,0irq/27-eth0-tx-16788-21munin-node22:37:512
29725050,0irq/27-eth0-tx-14722-21munin-node20:32:590
29725050,0irq/27-eth0-tx-0-21swapper/223:43:342
29725050,0irq/27-eth0-tx-0-21swapper/223:39:412
29725050,0irq/27-eth0-tx-0-21swapper/222:32:342
29725050,0irq/27-eth0-tx-0-21swapper/222:13:002
29725050,0irq/27-eth0-tx-0-21swapper/221:55:562
29725050,0irq/27-eth0-tx-0-21swapper/221:16:292
29725050,0irq/27-eth0-tx-0-21swapper/221:00:512
29725050,0irq/27-eth0-tx-0-21swapper/020:07:510
29715050,0irq/26-eth0-rx-31184-21taskset19:29:153
29715050,0irq/26-eth0-rx-29713-21cut23:02:573
29715050,0irq/26-eth0-rx-0-21swapper/323:37:573
29715050,0irq/26-eth0-rx-0-21swapper/323:18:143
29715050,0irq/26-eth0-rx-0-21swapper/323:07:583
29715050,0irq/26-eth0-rx-0-21swapper/322:37:513
29715050,0irq/26-eth0-rx-0-21swapper/322:02:443
29715050,0irq/26-eth0-rx-0-21swapper/321:57:553
29715050,0irq/26-eth0-rx-0-21swapper/321:42:563
29715050,0irq/26-eth0-rx-0-21swapper/321:19:033
29715050,0irq/26-eth0-rx-0-21swapper/321:12:503
29715050,0irq/26-eth0-rx-0-21swapper/321:11:503
29715050,0irq/26-eth0-rx-0-21swapper/320:58:373
29715050,0irq/26-eth0-rx-0-21swapper/319:47:543
29715050,0irq/26-eth0-rx-0-21swapper/300:17:573
29715050,0irq/26-eth0-rx-0-21swapper/300:07:573
259950,0migration/28033-21sh00:12:522
259950,0migration/26445-21munin-node21:48:002
259950,0migration/232623-21latency_hist22:47:392
259950,0migration/226843-21turbostat20:17:392
259950,0migration/226264-21kernelversion22:22:552
259950,0migration/22172-21kthreadcore23:47:572
259950,0migration/217850-21kernelversion22:57:562
259950,0migration/21528-21fschecks_time21:07:542
259950,0migration/214879-21aten2.4-expect20:32:522
249950,0watchdog/20-21swapper/220:17:542
179950,0migration/130936-21kthreadcore19:52:561
179950,0migration/127529-21kthreadcore23:02:561
179950,0migration/122912-21timerwakeupswit20:58:031
179950,0migration/121742-21sh23:17:581
179950,0migration/120488-21irqcore19:47:581
179950,0migration/119274-21kthreadcore22:17:551
179950,0migration/118893-21fschecks_count19:22:521
179950,0migration/117724-21unixbench_singl19:18:041
149950,0migration/07887-21idleruntime20:02:540
149950,0migration/07271-21aten2.4-expect00:12:490
149950,0migration/05937-21switchtime23:08:010
149950,0migration/04593-21taskset19:09:560
149950,0migration/04302-21kthreadcore21:07:580
149950,0migration/032409-21idleruntime00:07:550
149950,0migration/031441-21sh21:03:250
149950,0migration/030929-21munin-node21:23:000
149950,0migration/027617-21kthreadcore21:42:560
149950,0migration/024011-21kthreadcore20:12:570
149950,0migration/021829-21unixbench-2d23:38:040
149950,0migration/016939-21kthreadcore00:17:560
149950,0migration/015871-21kthreadcore18:52:570
149950,0migration/015502-21sh20:54:330
149950,0migration/015052-21sh22:33:300
149950,0migration/015024-21timerandwakeup21:33:030
149950,0migration/01272-21latency_hist20:22:390
149950,0migration/010788-21munin-node19:13:030
149950,0migration/010472-21kthreadcore22:12:580
105539955,0cyclictest0-21swapper/222:54:062
105539950,0cyclictest0-21swapper/222:37:042
105539950,0cyclictest0-21swapper/219:12:542
105529955,0cyclictest8816-21diskmemload23:47:251
105529955,0cyclictest12763-21sensors20:03:011
105529955,0cyclictest0-21swapper/121:02:591
105529950,0cyclictest24640-21ssh22:02:161
105529950,0cyclictest0-21swapper/123:13:311
105529950,0cyclictest0-21swapper/100:13:071
105519955,0cyclictest0-21swapper/022:47:510
105519955,0cyclictest0-21swapper/021:37:420
105519954,0cyclictest3514-21snmpd20:21:520
105519950,0cyclictest0-21swapper/022:29:440
105519950,0cyclictest0-21swapper/022:02:370
105519950,0cyclictest0-21swapper/021:53:180
8215040,0irq/24-0000:00:0-21swapper/219:32:402
339940,0migration/37719-21taskset20:26:273
339940,0migration/37634-21kthreadcore19:37:573
339940,0migration/37634-21kthreadcore19:37:573
339940,0migration/330181-21kthreadcore20:17:583
339940,0migration/323983-21kthreadcore20:12:573
339940,0migration/317473-21switchtime19:18:033
339940,0migration/316944-21taskset18:54:413
339940,0migration/316570-21kthreadcore20:07:573
339940,0migration/31565-21irqrtprio19:57:583
29725040,0irq/27-eth0-tx-6418-21ssh23:08:282
29725040,0irq/27-eth0-tx-399-21munin-node22:47:562
29725040,0irq/27-eth0-tx-32746-21munin-node19:57:540
29725040,0irq/27-eth0-tx-0-21swapper/223:57:582
29725040,0irq/27-eth0-tx-0-21swapper/223:32:562
29725040,0irq/27-eth0-tx-0-21swapper/223:28:192
29725040,0irq/27-eth0-tx-0-21swapper/223:17:532
29725040,0irq/27-eth0-tx-0-21swapper/223:02:422
29725040,0irq/27-eth0-tx-0-21swapper/222:18:372
29725040,0irq/27-eth0-tx-0-21swapper/222:03:022
29725040,0irq/27-eth0-tx-0-21swapper/221:58:002
29725040,0irq/27-eth0-tx-0-21swapper/200:17:462
29725040,0irq/27-eth0-tx-0-21swapper/200:08:342
29725040,0irq/27-eth0-tx-0-21swapper/019:37:510
29725040,0irq/27-eth0-tx-0-21swapper/019:37:510
29715040,0irq/26-eth0-rx-29057-21kthreadcore23:22:573
29715040,0irq/26-eth0-rx-0-21swapper/323:29:173
29715040,0irq/26-eth0-rx-0-21swapper/322:34:123
29715040,0irq/26-eth0-rx-0-21swapper/322:27:503
29715040,0irq/26-eth0-rx-0-21swapper/321:52:493
29715040,0irq/26-eth0-rx-0-21swapper/321:33:083
29715040,0irq/26-eth0-rx-0-21swapper/321:28:483
29715040,0irq/26-eth0-rx-0-21swapper/320:42:593
29715040,0irq/26-eth0-rx-0-21swapper/320:37:523
29715040,0irq/26-eth0-rx-0-21swapper/319:22:573
259940,0migration/22774-21fschecks_count20:47:532
259940,0migration/224762-21fschecks_time19:02:532
259940,0migration/222154-21munin-node20:37:542
259940,0migration/218421-21munin-node21:37:562
259940,0migration/215582-21kthreadcore20:07:572
249940,0watchdog/28185-21perl23:52:532
249940,0watchdog/217629-21kthreadcore19:42:582
249940,0watchdog/20-21swapper/219:48:062
249940,0watchdog/20-21swapper/219:07:542
179940,0migration/19175-21aten_r1power_po20:52:511
179940,0migration/17550-21kthreadcore19:12:581
179940,0migration/131222-21taskset19:29:391
179940,0migration/12563-21kthreadcore22:47:571
179940,0migration/115920-21aten_r1power_fr23:37:501
179940,0migration/11560-21cpuspeed_turbos20:22:521
179940,0migration/114220-21taskset20:29:391
179940,0migration/112490-21kthreadcore21:32:571
179940,0migration/111522-21munin-node18:52:531
179940,0migration/110789-21kthreadcore19:37:581
179940,0migration/110789-21kthreadcore19:37:581
179940,0migration/110042-21irqcore21:52:561
169940,0watchdog/18871-21kthreadcore23:52:571
169940,0watchdog/18816-21diskmemload21:24:461
169940,0watchdog/17019-21ssh23:31:051
169940,0watchdog/14279-21kthreadcore23:47:571
169940,0watchdog/14096-21kthreadcore21:07:581
169940,0watchdog/131160-21diskstats19:07:501
169940,0watchdog/125756-21kthreadcore00:02:571
169940,0watchdog/123571-21ssh22:39:571
169940,0watchdog/117630-21kthreadcore19:42:581
169940,0watchdog/11550-21ssh22:27:541
169940,0watchdog/10-21swapper/123:33:131
169940,0watchdog/10-21swapper/122:43:011
169940,0watchdog/10-21swapper/121:47:581
169940,0watchdog/10-21swapper/121:19:581
149940,0migration/031639-21kthreadcore20:42:570
149940,0migration/026827-21kthreadcore23:42:580
149940,0migration/023761-21sh22:20:050
149940,0migration/023537-21sh22:39:520
149940,0migration/022375-21taskset23:18:120
149940,0migration/021866-21kthreadcore19:22:560
149940,0migration/021481-21timerandwakeup23:58:020
149940,0migration/021139-21kthreadcore21:17:580
149940,0migration/01229-21cpuspeed_turbos21:27:530
149940,0migration/012198-21kthreadcore23:32:570
105539943,0cyclictest9978-21awk20:52:552
105539943,0cyclictest3514-21snmpd23:12:522
105539943,0cyclictest28913-21awk20:42:552
105539943,0cyclictest27000-21awk19:52:542
105539943,0cyclictest26240-21awk21:22:552
105539943,0cyclictest19255-21awk19:22:542
105539943,0cyclictest18293-21awk18:57:552
105539943,0cyclictest1216-21awk19:57:562
105529944,0cyclictest0-21swapper/122:56:201
105529944,0cyclictest0-21swapper/121:27:541
105529944,0cyclictest0-21swapper/121:15:261
105529943,0cyclictest9827-21awk22:12:561
105529943,0cyclictest9669-21awk22:32:541
105529943,0cyclictest932-21awk23:07:531
105529943,0cyclictest3556-21lldpd22:25:061
105529943,0cyclictest3556-21lldpd22:07:361
105529943,0cyclictest3556-21lldpd21:44:371
105529943,0cyclictest28867-21awk20:42:541
105529943,0cyclictest28026-21awk20:17:561
105529943,0cyclictest15605-21awk20:32:551
105519944,0cyclictest0-21swapper/000:02:450
105519943,0cyclictest9510-21awk22:52:530
105519943,0cyclictest7254-21sadc23:52:390
105519943,0cyclictest633-21awk23:27:540
105519943,0cyclictest3514-21snmpd23:22:520
105519943,0cyclictest26897-21awk19:52:530
105519943,0cyclictest22280-21awk20:37:550
105519943,0cyclictest17989-21awk20:57:560
105519943,0cyclictest17387-21awk22:57:530
105519943,0cyclictest1676-21awk21:47:550
8215030,0irq/24-0000:00:0-21swapper/218:52:402
4130,0ktimersoftd/015587-21sh21:13:390
29715030,0irq/26-eth0-rx-0-21swapper/320:32:513
249930,0watchdog/20-21swapper/220:27:502
169930,0watchdog/117403-21munin-node22:57:531
169930,0watchdog/116299-21ssh23:57:531
169930,0watchdog/10-21swapper/123:22:531
169930,0watchdog/10-21swapper/120:08:021
169930,0watchdog/10-21swapper/100:18:331
149930,0migration/031040-21sh22:43:190
105539933,0cyclictest7064-21awk19:37:562
105539933,0cyclictest7064-21awk19:37:562
105539932,0cyclictest26049-21awk19:27:562
105529932,0cyclictest3514-21snmpd19:32:521
105529932,0cyclictest3503-21grep22:07:561
105529932,0cyclictest3407-21cut20:47:561
105529932,0cyclictest24998-21awk19:02:551
105529932,0cyclictest21246-21awk20:12:541
105529932,0cyclictest18347-21awk18:57:551
105529931,0cyclictest0-21swapper/100:07:531
105519932,0cyclictest9128-21awk23:12:530
105519932,0cyclictest3514-21snmpd23:03:070
105519932,0cyclictest25920-21awk22:22:540
105519932,0cyclictest20268-21awk19:47:560
105519932,0cyclictest18278-21awk18:57:550
105519932,0cyclictest13015-21cut19:42:530
105519930,0cyclictest25474-21diskstats22:02:520
105519930,0cyclictest11788-21munin-node19:17:560
29715020,0irq/26-eth0-rx-0-21swapper/319:52:503
249920,0watchdog/20-21swapper/220:22:422
105529921,0cyclictest21375-21aten_r1power_cu20:37:511
105529921,0cyclictest0-21swapper/119:57:401
105519921,0cyclictest25056-21latency_hist19:27:400
105519921,0cyclictest0-21swapper/020:27:390
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional