You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-02 - 05:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat May 02, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450550,0irq/25-eth10-21swapper/318:54:393
934623524,0sleep10-21swapper/118:54:401
921423524,0sleep00-21swapper/018:53:030
918823425,0sleep20-21swapper/218:52:452
29715070,0irq/26-eth0-rx-6729-21df00:17:013
96149960,0cyclictest0-21swapper/221:45:412
96129960,0cyclictest0-21swapper/121:52:111
96119966,0cyclictest0-21swapper/023:42:070
339960,0migration/36823-21sh21:33:213
339960,0migration/35951-21sh23:35:013
339960,0migration/35912-21sh22:32:503
339960,0migration/330757-21sh21:27:153
339960,0migration/322642-21sh22:24:023
339960,0migration/315080-21sh22:20:243
339960,0migration/314692-21sh21:58:323
339960,0migration/314483-21sh22:59:443
29725060,0irq/27-eth0-tx-4109-21munin-node19:17:060
29725060,0irq/27-eth0-tx-4109-21munin-node19:17:060
29715060,0irq/26-eth0-rx-6829-21perl20:07:033
29715060,0irq/26-eth0-rx-32540-21idleruntime22:52:023
29715060,0irq/26-eth0-rx-30055-21pmu-power21:47:103
29715060,0irq/26-eth0-rx-26732-21kthreadcore22:07:063
29715060,0irq/26-eth0-rx-24913-21iostat_ios22:27:053
29715060,0irq/26-eth0-rx-16522-21diskstats22:02:023
29715060,0irq/26-eth0-rx-1400-21kthreadcore22:12:063
149960,0migration/07487-21munin-node23:57:030
149960,0migration/04254-21timerandwakeup00:12:110
149960,0migration/028511-21kthreadcore22:07:070
149960,0migration/015590-21sh21:00:550
149960,0migration/015221-21sh21:39:120
149960,0migration/013519-21sh23:38:380
96149955,0cyclictest0-21swapper/222:37:142
96149955,0cyclictest0-21swapper/222:25:252
96149950,0cyclictest0-21swapper/223:18:142
96129955,0cyclictest0-21swapper/120:58:251
96129950,0cyclictest0-21swapper/123:54:321
96129950,0cyclictest0-21swapper/123:26:181
96129950,0cyclictest0-21swapper/122:23:521
96129950,0cyclictest0-21swapper/122:19:181
96129950,0cyclictest0-21swapper/121:21:081
96129950,0cyclictest0-21swapper/121:08:021
96129950,0cyclictest0-21swapper/100:12:491
96119955,0cyclictest7845-21diskmemload22:18:050
96119954,0cyclictest0-21swapper/019:12:120
96119950,0cyclictest0-21swapper/021:09:300
8215050,0irq/24-0000:00:1086-21latency_hist20:51:502
4150,0ktimersoftd/00-21swapper/022:45:400
35150,0ktimersoftd/30-21swapper/323:05:123
339950,0migration/38236-21latency_hist21:36:503
339950,0migration/37262-21aten_r1power_vo20:32:023
339950,0migration/36746-21sh21:53:413
339950,0migration/330775-21sh23:31:263
339950,0migration/329263-21diskmemload22:47:113
339950,0migration/328832-21latency23:07:083
339950,0migration/323473-21fschecks_time00:07:043
339950,0migration/320082-21kthreadcore22:42:083
339950,0migration/318671-21kthreadcore19:02:063
339950,0migration/317575-21switchtime19:47:133
339950,0migration/316799-21munin-node21:22:013
339950,0migration/314013-21cpuspeed_turbos20:37:003
339950,0migration/313749-21munin-node20:12:053
339950,0migration/312298-21kthreadcore18:57:083
339950,0migration/311761-21if_eth1.219:22:053
29725050,0irq/27-eth0-tx-9145-21irqstats22:17:052
29725050,0irq/27-eth0-tx-8109-21ssh21:56:562
29725050,0irq/27-eth0-tx-7796-21irqcore23:57:052
29725050,0irq/27-eth0-tx-31951-21munin-node23:12:042
29725050,0irq/27-eth0-tx-24136-21munin-node22:07:052
29725050,0irq/27-eth0-tx-23554-21sshd00:07:042
29725050,0irq/27-eth0-tx-11161-21grep23:37:052
29725050,0irq/27-eth0-tx-0-21swapper/223:43:182
29725050,0irq/27-eth0-tx-0-21swapper/223:35:592
29725050,0irq/27-eth0-tx-0-21swapper/223:03:192
29725050,0irq/27-eth0-tx-0-21swapper/222:57:572
29725050,0irq/27-eth0-tx-0-21swapper/222:42:432
29725050,0irq/27-eth0-tx-0-21swapper/221:55:562
29725050,0irq/27-eth0-tx-0-21swapper/221:10:242
29715050,0irq/26-eth0-rx-31511-21basename23:12:013
29715050,0irq/26-eth0-rx-27053-21kthreadcore19:57:063
29715050,0irq/26-eth0-rx-24167-21irqrtprio23:47:053
29715050,0irq/26-eth0-rx-23747-21ssh21:45:403
29715050,0irq/26-eth0-rx-15183-21munin-node23:22:103
29715050,0irq/26-eth0-rx-13529-21ssh23:59:123
29715050,0irq/26-eth0-rx-0-21swapper/323:17:063
29715050,0irq/26-eth0-rx-0-21swapper/322:37:103
29715050,0irq/26-eth0-rx-0-21swapper/321:17:013
29715050,0irq/26-eth0-rx-0-21swapper/321:07:103
29715050,0irq/26-eth0-rx-0-21swapper/321:06:113
29715050,0irq/26-eth0-rx-0-21swapper/320:59:253
29715050,0irq/26-eth0-rx-0-21swapper/300:25:363
29715050,0irq/26-eth0-rx-0-21swapper/300:02:083
259950,0migration/28643-21fschecks_time20:57:032
259950,0migration/25574-21sh22:52:192
259950,0migration/231915-21timerwakeupswit20:22:112
259950,0migration/231076-21sh22:50:442
259950,0migration/228176-21kthreadcore23:47:062
259950,0migration/226509-21kthreadcore19:32:062
259950,0migration/223807-21fschecks_time19:07:012
259950,0migration/222105-21kthreadcore20:42:072
259950,0migration/220358-21kthreadcore22:02:062
259950,0migration/214568-21taskset21:37:192
249950,0watchdog/24341-21port_sshpriv23:52:162
179950,0migration/131884-21irqcore19:37:061
179950,0migration/126566-21kthreadcore23:07:071
179950,0migration/125706-21irqcore21:27:051
179950,0migration/114620-21latency_hist00:01:501
179950,0migration/111194-21df_abs19:22:021
149950,0migration/09265-21hwlatdetect21:17:040
149950,0migration/09040-21kthreadcore23:17:060
149950,0migration/08575-21kthreadcore19:42:070
149950,0migration/06932-21sh21:33:400
149950,0migration/0489-21hddtemp_smartct22:12:030
149950,0migration/04855-21kthreadcore22:32:060
149950,0migration/03694-21kthreadcore20:52:060
149950,0migration/031980-21cpu20:02:020
149950,0migration/031138-21munin-node23:52:070
149950,0migration/029517-21munin-node19:32:080
149950,0migration/027893-21kthreadcore20:22:050
149950,0migration/027866-21kthreadcore23:07:080
149950,0migration/025907-21kthreadcore22:47:080
149950,0migration/025363-21kthreadcore20:42:080
149950,0migration/023699-21taskset19:29:390
149950,0migration/023375-21cpuspeed_turbos19:07:000
149950,0migration/021649-21munin-node22:22:110
149950,0migration/019172-21needreboot20:37:070
149950,0migration/015391-21latency_hist23:01:500
149950,0migration/013595-21needreboot21:57:090
149950,0migration/012066-21irqrtprio19:22:050
149950,0migration/012012-21kthreadcore18:57:080
149950,0migration/011696-21proc_pri20:07:110
149950,0migration/010346-21kthreadcore20:32:080
96149943,0cyclictest3556-21lldpd20:02:462
96149943,0cyclictest3556-21lldpd19:46:162
96149943,0cyclictest3514-21snmpd21:31:592
96149943,0cyclictest3514-21snmpd20:11:592
96149943,0cyclictest25537-21awk21:27:042
96149943,0cyclictest25422-21awk21:47:052
96149943,0cyclictest19361-21awk19:52:052
96149943,0cyclictest1222-21awk20:27:042
96149943,0cyclictest11763-21awk19:22:052
96129944,0cyclictest0-21swapper/123:39:241
96129944,0cyclictest0-21swapper/123:05:111
96129944,0cyclictest0-21swapper/119:17:411
96129944,0cyclictest0-21swapper/119:17:411
96129943,0cyclictest9138-21awk21:57:061
96129943,0cyclictest5968-21awk19:42:041
96129943,0cyclictest3556-21lldpd23:47:471
96129943,0cyclictest3556-21lldpd23:30:161
96129943,0cyclictest3556-21lldpd21:23:161
96129943,0cyclictest3556-21lldpd20:53:461
96129943,0cyclictest3556-21lldpd20:46:461
96129943,0cyclictest3556-21lldpd20:28:161
96129943,0cyclictest3556-21lldpd20:24:461
96129943,0cyclictest3556-21lldpd20:20:461
96129943,0cyclictest3556-21lldpd19:55:461
96129943,0cyclictest3556-21lldpd19:48:461
96129943,0cyclictest3556-21lldpd19:12:461
96129943,0cyclictest3556-21lldpd00:24:471
96129943,0cyclictest32582-21awk22:52:021
96129943,0cyclictest3241-21irqbalance22:57:281
96129943,0cyclictest26118-21awk19:57:051
96129943,0cyclictest25331-21awk21:47:041
96129943,0cyclictest17075-21awk21:02:041
96129943,0cyclictest17065-21awk22:02:041
96129943,0cyclictest14645-21awk20:37:031
96129940,0cyclictest0-21swapper/118:57:491
96119944,0cyclictest0-21swapper/023:12:190
96119944,0cyclictest0-21swapper/021:13:450
96119943,0cyclictest8616-21awk22:37:030
96119943,0cyclictest3556-21lldpd20:15:460
96119943,0cyclictest3241-21irqbalance00:02:480
96119941,0cyclictest0-21swapper/020:47:020
8218240,0sleep311174-21kthreadcore23:37:053
339940,0migration/325458-21kthreadcore19:07:043
339940,0migration/319782-21df_abs20:17:023
339940,0migration/31786-21kthreadcore19:37:083
339940,0migration/31304-21taskset20:51:513
29725040,0irq/27-eth0-tx-4100-21kthreadcore22:32:052
29725040,0irq/27-eth0-tx-23201-21munin-node23:27:022
29725040,0irq/27-eth0-tx-0-21swapper/221:18:212
29725040,0irq/27-eth0-tx-0-21swapper/221:11:522
29725040,0irq/27-eth0-tx-0-21swapper/221:01:562
29725040,0irq/27-eth0-tx-0-21swapper/200:16:542
29725040,0irq/27-eth0-tx-0-21swapper/200:02:042
29725040,0irq/27-eth0-tx-0-21swapper/019:55:470
29715040,0irq/26-eth0-rx-4143-21aten_r1power_en19:17:003
29715040,0irq/26-eth0-rx-4143-21aten_r1power_en19:17:003
29715040,0irq/26-eth0-rx-0-21swapper/323:52:503
29715040,0irq/26-eth0-rx-0-21swapper/323:42:013
29715040,0irq/26-eth0-rx-0-21swapper/321:12:193
29715040,0irq/26-eth0-rx-0-21swapper/320:46:503
29715040,0irq/26-eth0-rx-0-21swapper/300:12:113
259940,0migration/28409-21kthreadcore19:17:072
259940,0migration/28409-21kthreadcore19:17:072
259940,0migration/226684-21kthreadcore19:57:062
259940,0migration/225289-21kthreadcore22:27:062
259940,0migration/224758-21irqrtprio23:07:072
259940,0migration/218890-21kthreadcore19:02:062
259940,0migration/216699-21aten_r1power_po21:22:002
259940,0migration/213939-21aten_r1power_vo20:37:002
259940,0migration/213704-21kthreadcore19:47:072
259940,0migration/21334-21kthreadcore00:12:062
259940,0migration/211342-21kthreadcore20:07:082
259940,0migration/210073-21kthreadcore20:32:072
249940,0watchdog/215431-21if_eth1.200:22:042
249940,0watchdog/215276-21aten2.4-expect23:22:002
249940,0watchdog/20-21swapper/222:12:002
179940,0migration/18780-21irqcore22:37:041
179940,0migration/18477-21kthreadcore20:32:071
179940,0migration/16483-21aten2.4-expect00:17:001
179940,0migration/16068-21latency_hist20:06:501
179940,0migration/14370-21kthreadcore23:12:081
179940,0migration/132052-21latency_hist22:11:501
179940,0migration/124979-21irqcore22:27:051
179940,0migration/124292-21fschecks_time22:47:051
179940,0migration/123594-21idleruntime00:07:041
179940,0migration/118190-21gltestperf19:27:021
179940,0migration/11728-21kthreadcore21:32:061
179940,0migration/116006-21kthreadcore20:12:071
179940,0migration/113714-21kthreadcore21:37:071
179940,0migration/112043-21latency23:57:071
169940,0watchdog/17132-21ssh22:36:161
169940,0watchdog/131998-21ssh23:32:041
169940,0watchdog/131876-21stty20:02:011
169940,0watchdog/122292-21timerandwakeup21:42:121
169940,0watchdog/10-21swapper/123:42:201
169940,0watchdog/10-21swapper/122:42:081
169940,0watchdog/10-21swapper/121:15:441
149940,0migration/07973-21fschecks_count22:57:020
149940,0migration/07912-21kthreadcore00:17:060
149940,0migration/0440-21aten_r1power_vo20:27:010
149940,0migration/032560-21kthreadcore23:32:070
149940,0migration/028353-21kthreadcore21:27:060
149940,0migration/026804-21kthreadcore23:47:060
149940,0migration/026607-21kthreadcore19:57:060
149940,0migration/025046-21kthreadcore00:07:070
149940,0migration/019132-21kthreadcore00:22:060
149940,0migration/017863-21kthreadcore21:42:060
96149932,0cyclictest3880-21sadc19:16:512
96149932,0cyclictest3514-21snmpd20:52:142
96149932,0cyclictest3514-21snmpd20:16:592
96149932,0cyclictest3514-21snmpd19:37:592
96149932,0cyclictest10805-21awk18:57:062
96129933,0cyclictest3556-21lldpd20:47:461
96129932,0cyclictest25063-21awk19:32:041
96129932,0cyclictest23977-21awk19:07:021
96119933,0cyclictest24529-21ps23:27:060
96119933,0cyclictest22327-21kworker/0:222:26:590
96119933,0cyclictest22327-21kworker/0:222:01:590
96119933,0cyclictest22327-21kworker/0:221:51:580
96119933,0cyclictest22327-21kworker/0:221:47:040
96119933,0cyclictest10459-21kworker/0:021:22:000
96119933,0cyclictest10459-21kworker/0:021:01:520
96119933,0cyclictest10459-21kworker/0:020:16:560
96119933,0cyclictest10459-21kworker/0:019:36:580
96119933,0cyclictest10459-21kworker/0:019:01:540
96119932,0cyclictest5425-21unixbench_multi22:52:100
96119932,0cyclictest16068-21awk23:22:030
96119932,0cyclictest11821-21munin-node19:47:110
339930,0migration/321723-21kthreadcore19:52:073
339930,0migration/318485-21iostat_ios19:27:053
29715030,0irq/26-eth0-rx-0-21swapper/320:47:103
29715030,0irq/26-eth0-rx-0-21swapper/320:27:013
29715030,0irq/26-eth0-rx-0-21swapper/320:22:013
249930,0watchdog/20-21swapper/219:27:052
179930,0migration/129880-21sendmail_mailqu22:07:101
169930,0watchdog/17845-21diskmemload23:17:001
169930,0watchdog/10-21swapper/119:02:051
339920,0migration/35513-21diskstats19:42:033
29715020,0irq/26-eth0-rx-0-21swapper/320:02:013
29715020,0irq/26-eth0-rx-0-21swapper/319:32:013
29715020,0irq/26-eth0-rx-0-21swapper/319:12:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional