You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 05:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat Jun 13, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1280524434,0sleep20-21swapper/218:48:332
304450350,0irq/25-eth10-21swapper/318:48:363
1287523423,0sleep00-21swapper/018:49:190
1283623228,0sleep10-21swapper/118:48:561
132569970,0cyclictest8652-21proc_pri23:08:112
132469970,0cyclictest0-21swapper/123:05:511
339960,0migration/39349-21sh23:29:233
339960,0migration/329111-21missed_timers20:38:103
339960,0migration/321764-21munin-node20:08:093
339960,0migration/31577-21sh23:45:483
29725060,0irq/27-eth0-tx-22006-21munin-node19:48:140
29715060,0irq/26-eth0-rx-5242-21kthreadcore23:48:113
29715060,0irq/26-eth0-rx-26109-21chrt23:20:383
29715060,0irq/26-eth0-rx-17880-21ssh22:54:493
29715060,0irq/26-eth0-rx-11968-21diskstats21:53:033
29715060,0irq/26-eth0-rx-0-21swapper/323:03:133
149960,0migration/018213-21sh22:14:530
8215050,0irq/24-0000:00:11633-21cat21:32:512
339950,0migration/39698-21sh21:48:203
339950,0migration/38417-21kthreadcore21:28:073
339950,0migration/35058-21irqrtprio20:23:073
339950,0migration/34306-21irqcore22:28:073
339950,0migration/33984-21fschecks_count21:08:013
339950,0migration/33923-21munin-node23:08:053
339950,0migration/33812-21fschecks_count22:08:043
339950,0migration/331590-21kthreadcore19:03:083
339950,0migration/330457-21aten_r1power_cu20:43:013
339950,0migration/32939-21munin-node19:58:013
339950,0migration/329018-21kthreadcore22:03:073
339950,0migration/328410-21gltestperf19:28:053
339950,0migration/326440-21taskset19:02:313
339950,0migration/326306-21kthreadcore19:48:093
339950,0migration/325160-21missed_timers21:38:103
339950,0migration/320067-21fschecks_time22:38:043
339950,0migration/319216-21timerandwakeup18:53:123
339950,0migration/316847-21diskmemload00:13:273
339950,0migration/314395-21aten_r1power_cu19:18:023
339950,0migration/313540-21timerwakeupswit19:13:143
339950,0migration/312475-21kthreadcore19:38:093
339950,0migration/311815-21munin-node20:53:023
29725050,0irq/27-eth0-tx-2906-21munin-node19:58:110
29725050,0irq/27-eth0-tx-28633-21munin-node19:53:060
29725050,0irq/27-eth0-tx-26811-21munin-node00:03:142
29725050,0irq/27-eth0-tx-22369-21kthreadcore22:58:072
29725050,0irq/27-eth0-tx-22369-21kthreadcore22:58:072
29725050,0irq/27-eth0-tx-19898-21ssh21:18:002
29725050,0irq/27-eth0-tx-1474-21ssh23:24:572
29725050,0irq/27-eth0-tx-13459-21munin-node18:53:070
29725050,0irq/27-eth0-tx-0-21swapper/020:42:070
29725050,0irq/27-eth0-tx-0-21swapper/020:20:170
29725050,0irq/27-eth0-tx-0-21swapper/019:39:070
29715050,0irq/26-eth0-rx-9388-21ssh00:10:143
29715050,0irq/26-eth0-rx-6559-21runrttasks22:22:523
29715050,0irq/26-eth0-rx-28459-21fschecks_count21:23:043
29715050,0irq/26-eth0-rx-19972-21fschecks_time20:58:043
29715050,0irq/26-eth0-rx-17298-21munin-node22:13:103
29715050,0irq/26-eth0-rx-1606-21ssh00:06:093
29715050,0irq/26-eth0-rx-12731-21kthreadcore23:53:073
29715050,0irq/26-eth0-rx-10262-21ssh22:51:023
29715050,0irq/26-eth0-rx-0-21swapper/323:38:013
29715050,0irq/26-eth0-rx-0-21swapper/323:27:203
29715050,0irq/26-eth0-rx-0-21swapper/323:13:103
29715050,0irq/26-eth0-rx-0-21swapper/322:58:483
29715050,0irq/26-eth0-rx-0-21swapper/322:58:483
29715050,0irq/26-eth0-rx-0-21swapper/322:43:593
29715050,0irq/26-eth0-rx-0-21swapper/321:13:083
29715050,0irq/26-eth0-rx-0-21swapper/321:05:073
259950,0migration/231261-21idleruntime20:43:052
259950,0migration/210476-21sh21:30:102
249950,0watchdog/20-21swapper/221:02:452
149950,0migration/08272-21kthreadcore22:28:090
149950,0migration/07748-21kthreadcore23:08:070
149950,0migration/07558-21kthreadcore21:28:070
149950,0migration/07526-21latency_hist19:12:510
149950,0migration/04891-21kthreadcore00:08:060
149950,0migration/04290-21taskset20:44:520
149950,0migration/03442-21latency_hist21:27:510
149950,0migration/031699-21kthreadcore19:28:090
149950,0migration/029560-21kthreadcore00:03:070
149950,0migration/028531-21rt-features20:13:110
149950,0migration/027933-21munin-node23:23:040
149950,0migration/022707-21kthreadcore22:38:080
149950,0migration/019577-21gltestperf23:58:050
149950,0migration/017807-21kthreadcore20:08:060
149950,0migration/016858-21unixbench-2d23:33:120
149950,0migration/016294-21proc_pri00:13:110
149950,0migration/015741-21latency20:28:080
149950,0migration/015663-21taskset20:03:450
149950,0migration/015149-21kthreadcore23:13:070
149950,0migration/014627-21kthreadcore21:53:070
149950,0migration/013995-21kthreadcore20:53:080
149950,0migration/013096-21kthreadcore21:13:070
149950,0migration/01196-21sh23:44:440
132569955,0cyclictest0-21swapper/222:18:122
132469955,0cyclictest0-21swapper/123:52:591
132469955,0cyclictest0-21swapper/122:24:231
132449955,0cyclictest0-21swapper/022:26:420
132449955,0cyclictest0-21swapper/021:57:510
132449950,0cyclictest0-21swapper/023:07:040
132449950,0cyclictest0-21swapper/022:19:560
132449950,0cyclictest0-21swapper/021:43:310
132449950,0cyclictest0-21swapper/021:06:280
339940,0migration/328404-21pmu-power20:13:113
339940,0migration/323604-21perf20:37:513
339940,0migration/323325-21kthreadcore19:23:063
339940,0migration/322721-21kthreadcore21:58:063
339940,0migration/320953-21kthreadcore00:18:053
339940,0migration/31538-21fschecks_time19:08:043
29725040,0irq/27-eth0-tx-9887-21ssh22:29:312
29725040,0irq/27-eth0-tx-6308-21kthreadcore21:08:052
29725040,0irq/27-eth0-tx-29267-21kernelversion21:23:072
29725040,0irq/27-eth0-tx-26915-21ssh23:42:572
29725040,0irq/27-eth0-tx-23417-21kthreadcore23:58:082
29725040,0irq/27-eth0-tx-11458-21perl23:33:032
29725040,0irq/27-eth0-tx-0-21swapper/223:53:422
29725040,0irq/27-eth0-tx-0-21swapper/223:19:532
29725040,0irq/27-eth0-tx-0-21swapper/222:43:322
29725040,0irq/27-eth0-tx-0-21swapper/222:38:202
29725040,0irq/27-eth0-tx-0-21swapper/222:34:592
29725040,0irq/27-eth0-tx-0-21swapper/222:13:032
29725040,0irq/27-eth0-tx-0-21swapper/222:07:552
29725040,0irq/27-eth0-tx-0-21swapper/222:04:312
29725040,0irq/27-eth0-tx-0-21swapper/221:58:562
29725040,0irq/27-eth0-tx-0-21swapper/221:51:402
29725040,0irq/27-eth0-tx-0-21swapper/221:03:072
29725040,0irq/27-eth0-tx-0-21swapper/200:18:402
29725040,0irq/27-eth0-tx-0-21swapper/200:13:592
29715040,0irq/26-eth0-rx-12042-21df_abs21:33:043
29715040,0irq/26-eth0-rx-0-21swapper/323:58:493
29715040,0irq/26-eth0-rx-0-21swapper/323:33:073
29715040,0irq/26-eth0-rx-0-21swapper/322:33:093
29715040,0irq/26-eth0-rx-0-21swapper/322:18:053
29715040,0irq/26-eth0-rx-0-21swapper/321:44:103
29715040,0irq/26-eth0-rx-0-21swapper/321:18:343
259940,0migration/232395-21kthreadcore22:23:082
259940,0migration/23227-21fschecks_count23:28:022
259940,0migration/231642-21kthreadcore21:43:072
259940,0migration/227334-21kthreadcore20:38:092
259940,0migration/215131-21kthreadcore23:13:072
249940,0watchdog/2941-21unixbench_singl23:03:132
249940,0watchdog/219758-21sh23:38:052
249940,0watchdog/20-21swapper/219:18:222
249940,0watchdog/20-21swapper/218:53:062
249940,0watchdog/20-21swapper/200:08:012
169940,0watchdog/10-21swapper/121:33:091
149940,0migration/08426-21kthreadcore20:23:080
149940,0migration/04559-21irqcore21:48:060
149940,0migration/0322-21runrttasks19:03:520
149940,0migration/022581-21kthreadcore21:38:090
149940,0migration/020950-21irqcore21:18:060
149940,0migration/020184-21aten_r1power_po18:58:020
149940,0migration/018486-21kthreadcore19:43:080
149940,0migration/014490-21aten_r1power_po19:18:030
132569944,0cyclictest0-21swapper/221:12:562
132569943,0cyclictest9528-21awk19:38:062
132569943,0cyclictest3970-21awk22:48:052
132569943,0cyclictest3809-21awk19:58:052
132569943,0cyclictest3610-21awk23:48:092
132569943,0cyclictest3556-21lldpd22:53:192
132569943,0cyclictest3556-21lldpd20:30:182
132569943,0cyclictest3514-21snmpd20:23:202
132569943,0cyclictest3514-21snmpd20:20:202
132569943,0cyclictest3514-21snmpd19:51:202
132569943,0cyclictest3241-21irqbalance21:37:592
132569943,0cyclictest3241-21irqbalance19:45:102
132569943,0cyclictest3241-21irqbalance19:33:102
132569943,0cyclictest3241-21irqbalance19:28:202
132569943,0cyclictest3241-21irqbalance19:23:002
132569943,0cyclictest3241-21irqbalance19:13:202
132569943,0cyclictest3241-21irqbalance19:08:402
132569943,0cyclictest3241-21irqbalance19:03:102
132569943,0cyclictest3241-21irqbalance18:58:202
132569943,0cyclictest18146-21awk20:33:052
132569943,0cyclictest12447-21awk21:53:052
132569943,0cyclictest12359-21awk20:53:052
132469944,0cyclictest0-21swapper/123:13:441
132469944,0cyclictest0-21swapper/122:59:041
132469944,0cyclictest0-21swapper/122:59:041
132469944,0cyclictest0-21swapper/122:50:521
132469944,0cyclictest0-21swapper/122:42:591
132469944,0cyclictest0-21swapper/121:01:091
132469943,0cyclictest6685-21find19:08:121
132469943,0cyclictest4772-21awk20:23:061
132469943,0cyclictest4228-21awk22:08:061
132469943,0cyclictest3556-21lldpd23:42:501
132469943,0cyclictest3556-21lldpd23:31:501
132469943,0cyclictest3556-21lldpd19:53:191
132469943,0cyclictest3514-21snmpd23:50:051
132469943,0cyclictest3514-21snmpd21:59:211
132469943,0cyclictest3514-21snmpd21:49:211
132469943,0cyclictest3514-21snmpd19:45:201
132469943,0cyclictest3514-21snmpd19:42:051
132469943,0cyclictest3514-21snmpd19:14:051
132469943,0cyclictest3514-21snmpd00:17:511
132469943,0cyclictest3514-21snmpd00:10:361
132469943,0cyclictest3241-21irqbalance23:08:191
132469943,0cyclictest3241-21irqbalance22:54:191
132469943,0cyclictest3241-21irqbalance22:29:591
132469943,0cyclictest3241-21irqbalance22:15:391
132469943,0cyclictest3241-21irqbalance20:53:091
132469943,0cyclictest3241-21irqbalance20:48:101
132469943,0cyclictest3241-21irqbalance20:43:301
132469943,0cyclictest3241-21irqbalance20:34:301
132469943,0cyclictest3241-21irqbalance20:28:501
132469943,0cyclictest3241-21irqbalance20:18:001
132469943,0cyclictest3241-21irqbalance20:14:201
132469943,0cyclictest3241-21irqbalance20:08:001
132469943,0cyclictest3241-21irqbalance20:01:101
132469943,0cyclictest28824-21awk21:23:051
132469943,0cyclictest28746-21awk21:43:051
132469943,0cyclictest28659-21awk19:28:061
132469943,0cyclictest28558-21awk21:03:051
132469943,0cyclictest28086-21awk23:23:051
132469943,0cyclictest27284-21latency_hist22:22:511
132469943,0cyclictest24776-21awk20:38:071
132469943,0cyclictest22873-21awk19:48:061
132469943,0cyclictest20647-21awk21:38:071
132469943,0cyclictest20339-21awk22:38:061
132469943,0cyclictest19874-21awk23:38:051
132469943,0cyclictest15216-21awk19:18:051
132469943,0cyclictest14311-21awk18:53:041
132469943,0cyclictest12659-21awk21:13:061
132469943,0cyclictest12416-21awk21:53:051
132469943,0cyclictest12251-21awk22:33:051
132469943,0cyclictest11717-21awk23:33:041
132469943,0cyclictest10492-21awk20:03:031
132469942,0cyclictest16393-21sensors00:13:121
132449944,0cyclictest18788-21kworker/0:023:19:500
132449944,0cyclictest0-21swapper/023:00:170
132449944,0cyclictest0-21swapper/023:00:170
132449944,0cyclictest0-21swapper/022:11:440
132449943,0cyclictest3556-21lldpd23:39:200
132449943,0cyclictest3556-21lldpd22:44:490
132449943,0cyclictest3556-21lldpd20:52:480
132449943,0cyclictest3556-21lldpd00:17:500
132449943,0cyclictest3525-21awk23:48:090
132449943,0cyclictest22007-21awk19:23:050
132449943,0cyclictest20347-21awk20:58:060
132449943,0cyclictest18018-21awk20:33:040
339930,0migration/37958-21kthreadcore20:48:093
339930,0migration/330257-21runrttasks20:18:043
29725030,0irq/27-eth0-tx-0-21swapper/019:13:030
29715030,0irq/26-eth0-rx-0-21swapper/320:28:013
29715030,0irq/26-eth0-rx-0-21swapper/320:03:003
29715030,0irq/26-eth0-rx-0-21swapper/319:43:023
29715030,0irq/26-eth0-rx-0-21swapper/319:33:053
249930,0watchdog/20-21swapper/220:03:052
169930,0watchdog/11908-21ssh22:04:531
169930,0watchdog/10-21swapper/123:17:531
169930,0watchdog/10-21swapper/121:28:171
169930,0watchdog/10-21swapper/121:19:251
169930,0watchdog/10-21swapper/121:08:051
169930,0watchdog/10-21swapper/118:58:021
132569933,0cyclictest3556-21lldpd20:09:182
132569932,0cyclictest5772-21awk20:48:072
132569932,0cyclictest3514-21snmpd19:53:202
132569932,0cyclictest23795-21awk20:13:052
132469932,0cyclictest3514-21snmpd23:59:051
132469932,0cyclictest3514-21snmpd00:04:051
132469932,0cyclictest21983-21awk19:23:051
132469930,0cyclictest26855-21aten_r1power_vo19:03:021
132449932,0cyclictest4354-21awk21:08:030
132449932,0cyclictest3997-21irqcore23:28:050
132449932,0cyclictest3985-21awk22:48:050
132449932,0cyclictest3241-21irqbalance22:53:290
132449932,0cyclictest30730-21kthreadcore22:03:080
132449932,0cyclictest12236-21awk22:33:050
132449932,0cyclictest11706-21awk23:53:050
132449930,0cyclictest0-21swapper/019:33:140
29715020,0irq/26-eth0-rx-0-21swapper/319:53:023
169920,0watchdog/10-21swapper/119:32:541
132449921,0cyclictest11728-21aten_r1power_cu21:33:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional