You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 07:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Fri Jul 17, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
129023624,0sleep20-21swapper/219:27:472
104523524,0sleep00-21swapper/019:24:570
99723425,0sleep10-21swapper/119:24:221
128323425,0sleep30-21swapper/319:27:443
1363991111,0cyclictest8612-21sensors23:48:150
1363991111,0cyclictest3571-21lldpd21:24:060
339960,0migration/35484-21sh22:02:223
339960,0migration/327259-21sh23:58:353
339960,0migration/323079-21irqrtprio23:23:093
339960,0migration/316460-21sh23:00:423
339960,0migration/315105-21latency_hist00:12:513
329960,0watchdog/323907-21if_err_eth1.222:48:063
29805060,0irq/28-eth0-rx-2085-21port_sshpriv00:38:133
29805060,0irq/28-eth0-rx-18149-21diskstats23:03:063
29805060,0irq/28-eth0-rx-16518-21iostat00:13:083
29805060,0irq/28-eth0-rx-13004-21diskstats23:18:063
29805060,0irq/28-eth0-rx-12548-21iostat_ios23:53:093
29805060,0irq/28-eth0-rx-11439-21iostat_ios00:28:093
149960,0migration/07573-21taskset22:56:050
149960,0migration/029843-21sh23:26:420
149960,0migration/025628-21sh23:05:590
149960,0migration/023714-21sh23:39:310
149960,0migration/022343-21sh22:09:320
149960,0migration/021401-21ntp_offset00:13:120
149960,0migration/014035-21sh22:06:170
149960,0migration/013236-21sh00:08:560
149960,0migration/011969-21sh22:39:270
339950,0migration/3960-21taskset00:22:593
339950,0migration/37926-21taskset22:56:533
339950,0migration/36277-21gltestperf19:53:043
339950,0migration/36198-21df_abs21:23:043
339950,0migration/35208-21taskset23:28:393
339950,0migration/34854-21sh21:38:143
339950,0migration/33877-21kthreadcore21:18:093
339950,0migration/326227-21sendmail_mailqu20:48:133
339950,0migration/325787-21kthreadcore00:53:103
339950,0migration/325192-21kthreadcore20:03:113
339950,0migration/32144-21fschecks_count19:28:043
339950,0migration/318359-21kthreadcore21:08:083
339950,0migration/317586-21irqrtprio19:38:063
339950,0migration/316944-21fschecks_count20:23:053
339950,0migration/314521-21munin-node21:28:073
339950,0migration/312417-21kthreadcore21:03:093
339950,0migration/311898-21runrttasks00:43:363
339950,0migration/310084-21idleruntime20:18:063
339950,0migration/310039-21kthreadcore23:33:103
329950,0watchdog/3984-21kthreadcore00:03:113
329950,0watchdog/386932chrt22:20:423
329950,0watchdog/327557-21grep23:08:063
329950,0watchdog/326873-21sh22:30:583
329950,0watchdog/30-21swapper/300:49:553
29815050,0irq/29-eth0-tx-8795-21ssh22:20:572
29815050,0irq/29-eth0-tx-5339-21munin-node19:53:170
29815050,0irq/29-eth0-tx-29458-21munin-node00:03:132
29815050,0irq/29-eth0-tx-26770-21munin-node23:08:062
29815050,0irq/29-eth0-tx-21848-21munin-node21:33:072
29815050,0irq/29-eth0-tx-21618-21ssh23:23:002
29815050,0irq/29-eth0-tx-21595-21ssh00:49:592
29815050,0irq/29-eth0-tx-0-21swapper/223:33:512
29815050,0irq/29-eth0-tx-0-21swapper/223:28:522
29815050,0irq/29-eth0-tx-0-21swapper/223:20:592
29815050,0irq/29-eth0-tx-0-21swapper/222:58:172
29815050,0irq/29-eth0-tx-0-21swapper/222:55:532
29815050,0irq/29-eth0-tx-0-21swapper/222:39:442
29815050,0irq/29-eth0-tx-0-21swapper/221:53:082
29815050,0irq/29-eth0-tx-0-21swapper/200:20:042
29815050,0irq/29-eth0-tx-0-21swapper/019:47:320
29815050,0irq/29-eth0-tx-0-21swapper/019:37:110
29805050,0irq/28-eth0-rx-26557-21if_err_eth1.223:43:093
29805050,0irq/28-eth0-rx-2584-21diskstats23:48:053
29805050,0irq/28-eth0-rx-25453-21if_err_eth1.300:18:103
29805050,0irq/28-eth0-rx-19468-21cpuspeed_turbos00:33:043
29805050,0irq/28-eth0-rx-14214-21diskstats22:43:053
29805050,0irq/28-eth0-rx-11506-21irqrtprio22:23:103
29805050,0irq/28-eth0-rx-0-21swapper/323:38:043
29805050,0irq/28-eth0-rx-0-21swapper/323:12:573
29805050,0irq/28-eth0-rx-0-21swapper/322:38:103
29805050,0irq/28-eth0-rx-0-21swapper/322:37:123
29805050,0irq/28-eth0-rx-0-21swapper/322:13:103
29805050,0irq/28-eth0-rx-0-21swapper/322:04:073
29805050,0irq/28-eth0-rx-0-21swapper/321:50:383
29805050,0irq/28-eth0-rx-0-21swapper/321:47:103
29805050,0irq/28-eth0-rx-0-21swapper/321:13:083
259950,0migration/29510-21missed_timers23:13:112
259950,0migration/25801-21latency_hist21:22:512
259950,0migration/25398-21kthreadcore20:13:082
259950,0migration/24190-21kthreadcore21:18:102
259950,0migration/232481-21kthreadcore22:33:112
259950,0migration/230924-21kthreadcore00:38:092
259950,0migration/222757-21sh22:10:292
259950,0migration/222668-21kthreadcore22:28:102
259950,0migration/221629-21irqcore23:58:082
259950,0migration/220534-21sh22:43:202
259950,0migration/218251-21kthreadcore20:43:102
259950,0migration/217394-21fschecks_time21:48:062
259950,0migration/217371-21kthreadcore00:13:092
259950,0migration/214389-21sh21:43:182
249950,0watchdog/224977-21kthreadcore20:48:102
19150,0ktimersoftd/10-21swapper/100:23:081
179950,0migration/1693-21sendmail_mailtr20:08:131
179950,0migration/127614-21kthreadcore19:43:081
179950,0migration/126467-21kthreadcore00:18:121
179950,0migration/122983-21munin-node21:33:081
179950,0migration/121971-21munin-node23:23:041
179950,0migration/116163-21missed_timers00:28:121
169950,0watchdog/112069-21sensors_fan21:23:141
149950,0migration/07722-21kthreadcore20:38:090
149950,0migration/03896-21taskset00:41:020
149950,0migration/03395-21kthreadcore00:23:140
149950,0migration/030729-21kthreadcore23:08:120
149950,0migration/030663-21timerwakeupswit22:13:170
149950,0migration/029342-21latency20:28:090
149950,0migration/028038-21latency_hist00:37:510
149950,0migration/027365-21aten_r1power_po20:53:030
149950,0migration/026492-21rt-features21:53:130
149950,0migration/024924-21missed_timers22:28:110
149950,0migration/024068-21fschecks_time00:53:060
149950,0migration/021442-21irqrtprio20:48:090
149950,0migration/018892-21kthreadcore20:23:090
149950,0migration/018675-21munin-node23:18:130
149950,0migration/018046-21sh21:48:320
149950,0migration/017667-21runrttasks23:53:150
149950,0migration/017061-21kthreadcore22:43:100
149950,0migration/016812-21sh22:23:430
149950,0migration/016265-21kthreadcore20:43:100
149950,0migration/014885-21fschecks_time00:48:040
149950,0migration/013071-21fschecks_count19:58:040
149950,0migration/012918-21kthreadcore20:18:090
149950,0migration/010442-21cpuspeed_turbos00:28:040
149950,0migration/010066-21fschecks_time21:03:050
13659954,0cyclictest0-21swapper/200:33:062
13649955,0cyclictest0-21swapper/123:30:381
13649955,0cyclictest0-21swapper/122:52:011
13649955,0cyclictest0-21swapper/122:45:141
13649955,0cyclictest0-21swapper/122:17:201
13649955,0cyclictest0-21swapper/121:59:121
13649955,0cyclictest0-21swapper/121:46:351
13649955,0cyclictest0-21swapper/100:37:571
13649950,0cyclictest0-21swapper/123:59:201
13649950,0cyclictest0-21swapper/123:46:521
13649950,0cyclictest0-21swapper/123:42:091
13649950,0cyclictest0-21swapper/122:37:111
13649950,0cyclictest0-21swapper/122:29:091
13649950,0cyclictest0-21swapper/100:13:031
339940,0migration/33045-21kthreadcore20:33:123
339940,0migration/32354-21fschecks_count20:13:033
339940,0migration/323448-21kthreadcore21:53:093
339940,0migration/314050-21iostat20:43:083
329940,0watchdog/30-21swapper/322:08:103
329940,0watchdog/30-21swapper/320:58:103
329940,0watchdog/30-21swapper/320:31:423
329940,0watchdog/30-21swapper/319:33:103
29815040,0irq/29-eth0-tx-23877-21telnet21:13:030
29815040,0irq/29-eth0-tx-13114-21ssh21:28:000
29815040,0irq/29-eth0-tx-0-21swapper/223:48:042
29815040,0irq/29-eth0-tx-0-21swapper/223:42:592
29815040,0irq/29-eth0-tx-0-21swapper/223:38:132
29815040,0irq/29-eth0-tx-0-21swapper/222:48:152
29815040,0irq/29-eth0-tx-0-21swapper/222:23:052
29815040,0irq/29-eth0-tx-0-21swapper/221:58:172
29815040,0irq/29-eth0-tx-0-21swapper/221:37:572
29815040,0irq/29-eth0-tx-0-21swapper/200:43:082
29815040,0irq/29-eth0-tx-0-21swapper/200:24:052
29815040,0irq/29-eth0-tx-0-21swapper/200:08:002
29805040,0irq/28-eth0-rx-0-21swapper/321:33:193
29805040,0irq/28-eth0-rx-0-21swapper/320:38:023
259940,0migration/27731-21pmu-power19:28:122
259940,0migration/26752-21fschecks_time22:03:062
259940,0migration/26044-21fschecks_time19:53:032
259940,0migration/24926-21kthreadcore20:58:082
259940,0migration/23591-21kthreadcore20:33:122
259940,0migration/230485-21taskset19:48:012
259940,0migration/229134-21kthreadcore20:53:082
259940,0migration/227859-21kthreadcore21:13:092
259940,0migration/227787-21fschecks_time20:08:042
259940,0migration/226379-21kthreadcore00:53:102
259940,0migration/224258-21munin-node19:43:052
259940,0migration/220756-21kthreadcore21:08:092
259940,0migration/219057-21irqcore23:03:102
259940,0migration/215963-21runrttasks21:04:032
259940,0migration/215579-21kthreadcore21:28:082
249940,0watchdog/216808-21kthreadcore23:53:112
249940,0watchdog/20-21swapper/222:13:142
179940,0migration/18932-21kthreadcore22:03:111
179940,0migration/17345-21kthreadcore19:53:071
179940,0migration/16865-21kthreadcore22:38:091
179940,0migration/16753-21kthreadcore00:43:101
179940,0migration/131864-21gltestperf21:18:051
179940,0migration/129674-21kthreadcore20:53:081
179940,0migration/127918-21runrttasks21:55:321
179940,0migration/127437-21kthreadcore21:13:091
179940,0migration/123401-21cpuspeed_turbos00:53:041
179940,0migration/121364-21sh22:08:141
179940,0migration/120621-21kthreadcore19:38:071
179940,0migration/116105-21kthreadcore19:58:091
179940,0migration/11577-21munin-node19:28:021
179940,0migration/115665-21taskset19:35:401
179940,0migration/113203-21taskset00:08:511
169940,0watchdog/1985-21kthreadcore00:03:111
169940,0watchdog/17911-21ssh22:56:501
169940,0watchdog/131177-21diskstats20:33:061
169940,0watchdog/130418-21taskset20:31:421
169940,0watchdog/122762-21python21:08:141
169940,0watchdog/117598-21kthreadcore20:43:101
169940,0watchdog/114927-21mdstat20:18:101
169940,0watchdog/113366-21kthreadcore22:58:101
169940,0watchdog/10-21swapper/123:33:111
169940,0watchdog/10-21swapper/123:18:101
169940,0watchdog/10-21swapper/122:23:101
169940,0watchdog/10-21swapper/121:40:581
169940,0watchdog/10-21swapper/121:28:461
169940,0watchdog/10-21swapper/120:58:101
169940,0watchdog/10-21swapper/100:49:551
149940,0migration/031782-21taskset23:28:080
149940,0migration/029800-21kthreadcore22:33:110
13659943,0cyclictest9958-21awk19:33:072
13659943,0cyclictest3571-21lldpd20:31:362
13659943,0cyclictest3571-21lldpd20:22:062
13659943,0cyclictest3571-21lldpd00:28:082
13659943,0cyclictest3524-21snmpd20:38:072
13659943,0cyclictest20810-21awk20:03:082
13659943,0cyclictest17413-21awk20:23:072
13659943,0cyclictest17168-21awk19:38:042
13649944,0cyclictest0-21swapper/123:51:361
13649944,0cyclictest0-21swapper/123:04:181
13649944,0cyclictest0-21swapper/121:49:061
13649943,0cyclictest6727-21awk20:38:071
13649943,0cyclictest3524-21snmpd23:07:551
13649943,0cyclictest3524-21snmpd20:24:221
13649943,0cyclictest21112-21awk20:48:071
13649943,0cyclictest16301-21sadc21:07:511
13639944,0cyclictest0-21swapper/021:44:520
13639943,0cyclictest9740-21awk22:58:070
13639943,0cyclictest3571-21lldpd23:47:080
13639943,0cyclictest30757-21munin-node20:33:060
13639943,0cyclictest30295-21awk21:58:060
13639943,0cyclictest17686-21awk21:08:070
13639940,0cyclictest19746-21munin-node20:03:110
13639940,0cyclictest0-21swapper/021:40:180
329930,0watchdog/30-21swapper/320:53:103
329930,0watchdog/30-21swapper/320:08:023
329930,0watchdog/30-21swapper/319:43:023
29815030,0irq/29-eth0-tx-0-21swapper/021:18:020
29805030,0irq/28-eth0-rx-0-21swapper/320:02:123
29805030,0irq/28-eth0-rx-0-21swapper/319:48:103
179930,0migration/131009-21fschecks_count19:48:031
169930,0watchdog/10-21swapper/123:53:111
169930,0watchdog/10-21swapper/123:12:581
169930,0watchdog/10-21swapper/100:37:151
13659930,0cyclictest0-21swapper/219:57:512
13649932,0cyclictest707-21munin-node22:18:081
13649932,0cyclictest3571-21lldpd20:13:061
13639933,0cyclictest17291-21irqcore19:38:050
13639933,0cyclictest0-21swapper/023:58:430
13639932,0cyclictest5317-21ssh00:06:340
13639932,0cyclictest30484-21munin-node19:48:050
13639932,0cyclictest2431-21grep22:18:090
13639932,0cyclictest22927-21awk21:33:080
13639932,0cyclictest2217-21tune2fs19:28:040
13639932,0cyclictest2059-21aten_r1power_en20:58:020
13639932,0cyclictest12858-21diskmemload22:49:380
13639932,0cyclictest127572sleep000:45:330
13639930,0cyclictest28721-21kthreadcore00:18:120
13639930,0cyclictest0-21swapper/020:14:130
169920,0watchdog/10-21swapper/120:02:581
13639921,0cyclictest0-21swapper/023:32:520
13639920,0cyclictest0-21swapper/023:12:520
13639920,0cyclictest0-21swapper/020:07:560
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional