You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 03:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Thu Mar 19, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
528524839,0sleep20-21swapper/219:17:552
522924435,0sleep10-21swapper/119:17:181
506723228,0sleep00-21swapper/019:15:250
500423120,0sleep30-21swapper/319:14:363
8305060,0irq/26-0000:00:22647-21ls00:28:002
53669965,0cyclictest26228-21ps23:33:172
53669960,0cyclictest0-21swapper/222:24:182
4160,0ktimersoftd/00-21swapper/023:16:450
4160,0ktimersoftd/00-21swapper/022:43:390
35160,0ktimersoftd/30-21swapper/322:28:593
339960,0migration/326485-21sh23:52:173
339960,0migration/323593-21sh22:16:243
339960,0migration/323462-21sh23:30:053
339960,0migration/318658-21missed_timers19:23:183
339960,0migration/317975-21sh23:47:353
339960,0migration/315692-21kthreadcore21:53:173
339960,0migration/313510-21sh23:07:343
339960,0migration/31255-21sh22:39:033
29815060,0irq/29-eth0-tx-27430-21munin-node20:18:130
27160,0ktimersoftd/20-21swapper/223:16:452
27160,0ktimersoftd/20-21swapper/222:43:392
27160,0ktimersoftd/20-21swapper/200:32:262
19160,0ktimersoftd/10-21swapper/100:32:261
149960,0migration/08306-21fschecks_time23:23:130
149960,0migration/08254-21sh23:39:300
149960,0migration/02971-21kthreadcore20:43:180
149960,0migration/020679-21ksmtuned21:54:320
149960,0migration/016005-21kthreadcore21:33:170
149960,0migration/014718-21sh22:10:420
8305050,0irq/26-0000:00:27401-21crond21:03:002
53669955,0cyclictest0-21swapper/223:20:452
53669950,0cyclictest0-21swapper/223:01:122
53669950,0cyclictest0-21swapper/221:29:082
53659950,0cyclictest0-21swapper/121:28:411
53659950,0cyclictest0-21swapper/100:04:271
4150,0ktimersoftd/00-21swapper/022:56:490
339950,0migration/38512-21kthreadcore23:58:173
339950,0migration/37539-21kthreadcore00:18:163
339950,0migration/34529-21kthreadcore22:23:163
339950,0migration/332568-21idleruntime00:33:143
339950,0migration/330894-21taskset00:32:003
339950,0migration/3303-21runrttasks23:36:543
339950,0migration/330130-21unixbench-2d19:53:243
339950,0migration/326171-21fschecks_count21:23:123
339950,0migration/32543-21fschecks_count19:38:123
339950,0migration/323878-21runrttasks21:19:103
339950,0migration/320196-21kthreadcore20:33:173
339950,0migration/320142-21kthreadcore19:48:163
339950,0migration/318908-21fschecks_time22:33:143
339950,0migration/317472-21gltestperf00:43:153
339950,0migration/316430-21kthreadcore00:03:183
339950,0migration/315648-21kthreadcore23:08:173
339950,0migration/313339-21kthreadcore21:13:173
339950,0migration/312501-21taskset20:04:493
339950,0migration/312280-21sh21:50:103
339950,0migration/31197-21munin-node20:18:213
339950,0migration/31141-21sh23:38:123
329950,0watchdog/332432-1kworker/3:2H23:22:393
329950,0watchdog/324644-21tune2fs20:38:103
329950,0watchdog/324644-21tune2fs20:38:103
329950,0watchdog/30-21swapper/320:48:143
29815050,0irq/29-eth0-tx-7168-21munin-node22:08:172
29815050,0irq/29-eth0-tx-4884-21munin-node21:48:122
29815050,0irq/29-eth0-tx-27055-21sh23:53:102
29815050,0irq/29-eth0-tx-25638-21munin-node21:23:202
29815050,0irq/29-eth0-tx-22195-21munin-node21:58:102
29815050,0irq/29-eth0-tx-16505-21ssh00:43:112
29815050,0irq/29-eth0-tx-16169-21munin-node23:28:182
29815050,0irq/29-eth0-tx-0-21swapper/223:41:302
29815050,0irq/29-eth0-tx-0-21swapper/222:04:392
29815050,0irq/29-eth0-tx-0-21swapper/200:18:242
29815050,0irq/29-eth0-tx-0-21swapper/021:18:160
29815050,0irq/29-eth0-tx-0-21swapper/020:28:180
29815050,0irq/29-eth0-tx-0-21swapper/020:13:190
29815050,0irq/29-eth0-tx-0-21swapper/019:36:260
29805050,0irq/28-eth0-rx-30960-21aten_r1power_po22:03:113
29805050,0irq/28-eth0-rx-24205-21kthreadcore00:08:193
29805050,0irq/28-eth0-rx-13492-21cat21:33:163
29805050,0irq/28-eth0-rx-11770-21aten_r1power_fr22:48:103
29805050,0irq/28-eth0-rx-0-21swapper/323:56:343
29805050,0irq/28-eth0-rx-0-21swapper/323:13:153
29805050,0irq/28-eth0-rx-0-21swapper/323:00:123
29805050,0irq/28-eth0-rx-0-21swapper/322:11:303
29805050,0irq/28-eth0-rx-0-21swapper/320:28:143
29805050,0irq/28-eth0-rx-0-21swapper/319:43:163
29805050,0irq/28-eth0-rx-0-21swapper/319:28:213
29805050,0irq/28-eth0-rx-0-21swapper/300:25:493
27150,0ktimersoftd/20-21swapper/222:32:022
259950,0migration/26635-21kthreadcore21:08:172
259950,0migration/232672-21kthreadcore20:18:172
259950,0migration/231474-21sh22:19:152
259950,0migration/229440-21kthreadcore21:03:172
259950,0migration/225017-21kthreadcore22:53:182
259950,0migration/221875-21sh21:57:542
259950,0migration/221194-21fschecks_count00:08:142
259950,0migration/219930-21missed_timers23:08:192
259950,0migration/217019-21if_eth1.222:13:162
259950,0migration/216771-21munin-node20:33:102
259950,0migration/215973-21kthreadcore00:03:182
259950,0migration/215867-21timerandwakeup20:28:232
259950,0migration/211079-21aten_r1power_po21:33:102
249950,0watchdog/24591-21irqcore23:58:152
19150,0ktimersoftd/10-21swapper/122:43:391
179950,0migration/16891-21kernelversion23:03:171
179950,0migration/132764-21kthreadcore20:18:171
179950,0migration/130812-21munin-node22:18:221
179950,0migration/126262-21latency22:53:191
179950,0migration/125649-21kthreadcore23:13:181
179950,0migration/124208-21taskset00:46:161
179950,0migration/11733-21kthreadcore00:33:161
179950,0migration/114512-21kthreadcore21:13:181
179950,0migration/114477-21kthreadcore22:28:191
179950,0migration/112171-21munin-node19:18:231
179950,0migration/110565-21kthreadcore00:18:171
169950,0watchdog/112875-21kthreadcore23:43:191
149950,0migration/08493-21sh22:26:130
149950,0migration/06198-21irqcore21:48:160
149950,0migration/05557-21cpuspeed_turbos23:03:120
149950,0migration/05148-21sh00:17:260
149950,0migration/04714-21kthreadcore21:28:170
149950,0migration/030317-21timerwakeupswit20:38:220
149950,0migration/030317-21timerwakeupswit20:38:220
149950,0migration/030073-21kthreadcore23:33:190
149950,0migration/028504-21sendmail_mailst21:58:200
149950,0migration/023405-21taskset19:52:210
149950,0migration/020700-21kthreadcore23:28:180
149950,0migration/019784-21idleruntime-cro19:27:590
149950,0migration/018125-21kthreadcore00:43:180
149950,0migration/018034-21kthreadcore23:08:180
149950,0migration/01439-21taskset23:53:480
149950,0migration/014201-21sendmail_mailst00:38:210
149950,0migration/013750-21kthreadcore22:28:190
149950,0migration/01313-21kthreadcore00:33:160
149950,0migration/011251-21kthreadcore00:18:170
149950,0migration/011024-21kthreadcore19:43:150
53669944,0cyclictest0-21swapper/222:48:262
53669944,0cyclictest0-21swapper/221:38:072
53669944,0cyclictest0-21swapper/220:08:242
53669943,0cyclictest6981-21awk20:03:152
53669943,0cyclictest3571-21lldpd20:15:162
53669943,0cyclictest3524-21snmpd20:00:202
53669943,0cyclictest3524-21snmpd19:23:052
53669943,0cyclictest3314-21awk20:23:142
53669943,0cyclictest24784-21awk19:53:142
53669943,0cyclictest10919-21awk21:13:152
53659944,0cyclictest0-21swapper/121:49:481
53659943,0cyclictest3571-21lldpd21:08:171
53659943,0cyclictest3571-21lldpd20:49:171
53659943,0cyclictest3571-21lldpd20:33:171
53659943,0cyclictest3524-21snmpd23:58:391
53659943,0cyclictest3524-21snmpd23:55:241
53659943,0cyclictest3524-21snmpd23:38:391
53659943,0cyclictest3524-21snmpd23:32:091
53659943,0cyclictest3524-21snmpd23:23:081
53659943,0cyclictest3524-21snmpd23:18:381
53659943,0cyclictest3524-21snmpd23:08:081
53659943,0cyclictest3524-21snmpd22:51:231
53659943,0cyclictest3524-21snmpd22:34:381
53659943,0cyclictest3524-21snmpd22:13:371
53659943,0cyclictest3524-21snmpd21:58:071
53659943,0cyclictest3524-21snmpd21:38:371
53659943,0cyclictest3524-21snmpd21:33:071
53659943,0cyclictest3524-21snmpd21:26:371
53659943,0cyclictest3524-21snmpd21:03:361
53659943,0cyclictest3524-21snmpd20:28:361
53659943,0cyclictest3524-21snmpd19:59:501
53659943,0cyclictest3524-21snmpd00:17:391
53659943,0cyclictest3524-21snmpd00:11:091
53659943,0cyclictest3426-21awk20:23:151
53659943,0cyclictest25908-21awk23:33:161
53659943,0cyclictest21405-21awk20:13:151
53659943,0cyclictest1792-21awk22:23:131
53649943,0cyclictest3571-21lldpd22:58:460
53649943,0cyclictest3571-21lldpd20:57:170
53649943,0cyclictest3571-21lldpd20:51:170
53649943,0cyclictest3346-21awk20:23:150
53649943,0cyclictest14145-21awk20:08:160
53649940,0cyclictest0-21swapper/000:12:280
339940,0migration/39921-21diskmemload22:43:483
339940,0migration/330953-21kthreadcore19:33:173
339940,0migration/320614-21fschecks_time21:38:133
329940,0watchdog/36314-21runrttasks19:59:103
329940,0watchdog/316816-21grep20:08:183
329940,0watchdog/30-21swapper/323:23:113
329940,0watchdog/30-21swapper/320:58:183
329940,0watchdog/30-21swapper/319:18:143
29815040,0irq/29-eth0-tx-5792-21munin-node20:03:160
29815040,0irq/29-eth0-tx-30067-21fschecks_time00:13:122
29815040,0irq/29-eth0-tx-0-21swapper/222:38:062
29815040,0irq/29-eth0-tx-0-21swapper/222:33:132
29815040,0irq/29-eth0-tx-0-21swapper/221:44:092
29815040,0irq/29-eth0-tx-0-21swapper/221:18:302
29815040,0irq/29-eth0-tx-0-21swapper/200:39:452
29815040,0irq/29-eth0-tx-0-21swapper/019:58:170
29815040,0irq/29-eth0-tx-0-21swapper/019:56:300
29815040,0irq/29-eth0-tx-0-21swapper/019:38:100
29815040,0irq/29-eth0-tx-0-21swapper/019:18:120
29805040,0irq/28-eth0-rx-21382-21if_eth1.320:13:153
29805040,0irq/28-eth0-rx-0-21swapper/322:53:123
29805040,0irq/28-eth0-rx-0-21swapper/322:18:343
29805040,0irq/28-eth0-rx-0-21swapper/321:58:163
29805040,0irq/28-eth0-rx-0-21swapper/321:44:053
29805040,0irq/28-eth0-rx-0-21swapper/321:28:173
29805040,0irq/28-eth0-rx-0-21swapper/321:08:113
29805040,0irq/28-eth0-rx-0-21swapper/321:03:113
29805040,0irq/28-eth0-rx-0-21swapper/300:38:023
29805040,0irq/28-eth0-rx-0-21swapper/300:13:273
259940,0migration/26761-21fschecks_time20:48:102
259940,0migration/2580-21irqrtprio00:33:162
259940,0migration/25040-21switchtime20:43:242
259940,0migration/2388-21kthreadcore19:33:172
259940,0migration/222012-21kthreadcore23:48:182
259940,0migration/217408-21gltestperf19:48:132
259940,0migration/210596-21kthreadcore23:03:182
249940,0watchdog/20-21swapper/223:43:112
249940,0watchdog/20-21swapper/223:23:192
249940,0watchdog/20-21swapper/219:28:102
249940,0watchdog/20-21swapper/219:18:142
179940,0migration/19844-21fschecks_count19:43:121
179940,0migration/19072-21kthreadcore22:08:161
179940,0migration/14889-21processes20:43:211
179940,0migration/1475-21kthreadcore22:03:161
179940,0migration/132088-21kthreadcore19:33:171
179940,0migration/128876-21latency_hist22:58:001
179940,0migration/126598-21latency_hist22:38:001
179940,0migration/121521-21irqrtprio19:28:161
179940,0migration/121069-21kthreadcore21:18:181
179940,0migration/119420-21timerwakeupswit20:08:261
179940,0migration/117352-21kthreadcore19:23:171
179940,0migration/114850-21irqcore21:53:171
169940,0watchdog/124645-21fschecks_time20:38:101
169940,0watchdog/124645-21fschecks_time20:38:101
169940,0watchdog/124348-21munin-node23:48:191
169940,0watchdog/12266-21munin-node21:43:191
169940,0watchdog/115519-21iostat00:23:151
169940,0watchdog/10-21swapper/119:48:141
169940,0watchdog/10-21swapper/100:38:151
149940,0migration/030556-21kthreadcore21:23:170
149940,0migration/028942-21kthreadcore22:38:160
149940,0migration/025917-21kthreadcore00:28:170
149940,0migration/024387-21kthreadcore20:58:180
149940,0migration/023483-21kthreadcore22:33:190
149940,0migration/021374-21irqrtprio21:38:160
53669932,0cyclictest3524-21snmpd20:55:062
53669932,0cyclictest3178-21awk19:38:142
53659932,0cyclictest3524-21snmpd19:53:051
53649932,0cyclictest2856-21cut23:18:180
53649932,0cyclictest25605-21awk22:18:150
53649932,0cyclictest2423-21date21:08:000
53649932,0cyclictest21105-21awk19:28:140
53649932,0cyclictest17865-21awk20:33:150
53649932,0cyclictest16533-21grep22:13:130
53649932,0cyclictest15353-21awk00:23:140
53649932,0cyclictest15224-21kthreadcore22:48:160
53649932,0cyclictest10856-21awk21:13:150
53649930,0cyclictest419-21kthreadcore21:03:180
53649930,0cyclictest3162-21latency_hist23:58:000
53649930,0cyclictest19011-21tune2fs23:48:140
53649930,0cyclictest12951-21diskmemload00:03:150
329930,0watchdog/30-21swapper/320:53:103
329930,0watchdog/30-21swapper/320:44:023
29805030,0irq/28-eth0-rx-0-21swapper/320:23:093
249930,0watchdog/20-21swapper/220:38:102
249930,0watchdog/20-21swapper/220:38:102
249930,0watchdog/20-21swapper/219:43:022
19130,0ktimersoftd/10-21swapper/119:40:551
179930,0migration/118927-21kthreadcore20:53:171
169930,0watchdog/10-21swapper/120:58:181
169930,0watchdog/10-21swapper/120:03:101
149930,0migration/06041-21runrttasks22:05:410
149930,0migration/04257-21sh21:47:040
53649920,0cyclictest0-21swapper/023:43:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional