You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-20 - 07:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Fri Mar 20, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1747724838,0sleep20-21swapper/219:13:062
2439524536,0sleep30-21swapper/319:17:593
2433223523,0sleep00-21swapper/019:17:160
2427223526,0sleep10-21swapper/119:16:371
244759976,0cyclictest0-21swapper/222:28:232
8305060,0irq/26-0000:00:10449-21idleruntime-cro20:38:042
339960,0migration/38032-21sh23:10:293
339960,0migration/34667-21sh21:33:593
339960,0migration/32944-21sh00:43:133
339960,0migration/329113-21sh21:31:273
339960,0migration/325733-21kthreadcore23:58:223
339960,0migration/319750-21sh23:38:013
329960,0watchdog/318001-21cpuspeed_turbos19:58:153
29815060,0irq/29-eth0-tx-9461-21munin-node00:28:262
29815060,0irq/29-eth0-tx-26466-21unixbench_singl22:23:302
244759960,0cyclictest3396-21diskmemload00:10:422
244679965,0cyclictest0-21swapper/019:48:200
149960,0migration/019588-21kthreadcore19:58:200
149960,0migration/016834-21kthreadcore22:38:220
8305050,0irq/26-0000:00:0-21swapper/223:28:222
339950,0migration/39577-21cpuspeed_turbos23:13:163
339950,0migration/39049-21kthreadcore00:08:233
339950,0migration/34110-21munin-node22:13:223
339950,0migration/33866-21munin-node23:28:193
339950,0migration/332559-21kthreadcore19:43:213
339950,0migration/332394-21sh23:07:253
339950,0migration/331179-21runrttasks00:18:333
339950,0migration/33033-21runrttasks22:29:083
339950,0migration/328649-21kthreadcore00:38:233
339950,0migration/328410-21munin-node22:43:293
339950,0migration/328167-21kthreadcore19:18:213
339950,0migration/328088-21taskset19:41:533
339950,0migration/326959-21munin-node23:23:173
339950,0migration/322499-21taskset21:44:403
339950,0migration/321948-21munin-node00:13:243
339950,0migration/320287-21sh21:26:443
339950,0migration/320262-21switchtime19:33:293
339950,0migration/31857-21kernelversion21:53:223
339950,0migration/31826-21sh22:12:073
339950,0migration/317859-21latency_hist20:43:043
339950,0migration/315558-21kthreadcore23:53:233
339950,0migration/314294-21fschecks_time22:38:173
339950,0migration/313349-21munin-node20:58:293
339950,0migration/31249-21kthreadcore22:48:223
339950,0migration/31236-21munin-node00:23:193
339950,0migration/310462-21kthreadcore22:53:223
329950,0watchdog/314344-21munin-node21:03:163
329950,0watchdog/31134-21grep00:03:243
329950,0watchdog/30-21swapper/321:49:443
329950,0watchdog/30-21swapper/321:38:123
329950,0watchdog/30-21swapper/320:38:233
29815050,0irq/29-eth0-tx-8151-21ssh23:10:492
29815050,0irq/29-eth0-tx-28426-21munin-node19:43:150
29815050,0irq/29-eth0-tx-24684-21munin-node19:18:240
29815050,0irq/29-eth0-tx-23746-21awk22:03:262
29815050,0irq/29-eth0-tx-22247-21munin-node23:58:202
29815050,0irq/29-eth0-tx-19991-21awk22:38:302
29815050,0irq/29-eth0-tx-13654-21munin-node23:53:252
29815050,0irq/29-eth0-tx-0-21swapper/223:51:582
29815050,0irq/29-eth0-tx-0-21swapper/223:15:522
29815050,0irq/29-eth0-tx-0-21swapper/223:05:242
29815050,0irq/29-eth0-tx-0-21swapper/200:38:242
29815050,0irq/29-eth0-tx-0-21swapper/021:18:040
29805050,0irq/28-eth0-rx-32672-21diskstats20:53:173
29805050,0irq/28-eth0-rx-32218-21kthreadcore23:43:223
29805050,0irq/28-eth0-rx-17971-21sh22:18:383
29805050,0irq/28-eth0-rx-12182-21kthreadcore21:58:223
29805050,0irq/28-eth0-rx-11432-21grep19:28:213
29805050,0irq/28-eth0-rx-11167-21ssh21:20:503
29805050,0irq/28-eth0-rx-0-21swapper/323:48:263
29805050,0irq/28-eth0-rx-0-21swapper/323:38:233
29805050,0irq/28-eth0-rx-0-21swapper/323:22:553
29805050,0irq/28-eth0-rx-0-21swapper/322:36:163
29805050,0irq/28-eth0-rx-0-21swapper/322:24:353
29805050,0irq/28-eth0-rx-0-21swapper/300:28:373
259950,0migration/231993-21sh21:51:572
259950,0migration/231698-21idleruntime22:48:202
259950,0migration/228821-21cpuspeed_turbos20:28:162
259950,0migration/228387-21kthreadcore22:08:222
259950,0migration/228358-21latency_hist20:28:042
259950,0migration/225696-21munin-node00:18:202
259950,0migration/222931-21sh23:00:042
259950,0migration/222571-21sh23:38:222
259950,0migration/222026-21pmu-power00:13:252
259950,0migration/21666-21kthreadcore23:43:232
259950,0migration/21426-21sh23:25:142
259950,0migration/211117-21latency_hist22:18:052
244759955,0cyclictest0-21swapper/221:54:582
244759955,0cyclictest0-21swapper/221:22:102
244759954,0cyclictest6616-21munin-node21:38:182
244739955,0cyclictest0-21swapper/100:23:071
249950,0watchdog/22957-21munin-node00:43:242
249950,0watchdog/220125-21latency21:03:242
179950,0migration/17022-21munin-node21:53:311
179950,0migration/15572-21ntp_offset19:23:241
179950,0migration/15527-21sh22:49:491
179950,0migration/131135-21kthreadcore23:23:231
179950,0migration/128489-21kthreadcore00:38:231
179950,0migration/126412-21kthreadcore00:18:211
179950,0migration/126057-21kthreadcore21:28:241
179950,0migration/125538-21fschecks_time19:18:171
179950,0migration/119493-21taskset21:24:521
179950,0migration/116862-21kthreadcore21:03:221
179950,0migration/115502-21kthreadcore20:38:241
179950,0migration/110713-21irqcore00:28:221
169950,0watchdog/130878-21ntp_kernel_pll_20:03:231
149950,0migration/06680-21latency_hist19:28:040
149950,0migration/05728-21kthreadcore21:53:230
149950,0migration/04435-21munin-node22:48:240
149950,0migration/03415-21fschecks_count23:28:170
149950,0migration/032729-21missed_timers00:38:250
149950,0migration/022254-21aten_r1power_cu23:58:150
149950,0migration/021390-21aten_r1power_cu20:23:160
149950,0migration/020872-21kthreadcore00:33:240
149950,0migration/020733-21fschecks_time23:38:180
149950,0migration/020484-21timerandwakeup20:18:300
149950,0migration/018708-21kthreadcore22:58:210
149950,0migration/016369-21hddtemp_smartct21:43:180
149950,0migration/013571-21kthreadcore23:33:230
149950,0migration/013480-21kthreadcore20:38:230
149950,0migration/013271-21switchtime20:13:280
149950,0migration/013051-21needreboot20:58:240
149950,0migration/011080-21taskset21:20:380
149950,0migration/010829-21missed_timers22:33:250
8305040,0irq/26-0000:00:0-21swapper/220:38:042
339940,0migration/331517-21taskset20:04:043
339940,0migration/330198-21kthreadcore20:28:213
329940,0watchdog/30-21swapper/322:03:243
329940,0watchdog/30-21swapper/320:22:073
329940,0watchdog/30-21swapper/320:14:193
329940,0watchdog/30-21swapper/320:08:233
29815040,0irq/29-eth0-tx-6403-21ssh22:33:232
29815040,0irq/29-eth0-tx-3449-21munin-node20:33:220
29815040,0irq/29-eth0-tx-23260-21irqcore22:43:212
29815040,0irq/29-eth0-tx-0-21swapper/223:18:222
29815040,0irq/29-eth0-tx-0-21swapper/222:53:182
29815040,0irq/29-eth0-tx-0-21swapper/222:13:592
29815040,0irq/29-eth0-tx-0-21swapper/221:43:502
29815040,0irq/29-eth0-tx-0-21swapper/221:34:182
29815040,0irq/29-eth0-tx-0-21swapper/221:28:062
29815040,0irq/29-eth0-tx-0-21swapper/221:24:102
29815040,0irq/29-eth0-tx-0-21swapper/200:23:182
29815040,0irq/29-eth0-tx-0-21swapper/021:13:030
29805040,0irq/28-eth0-rx-0-21swapper/322:58:373
29805040,0irq/28-eth0-rx-0-21swapper/320:23:233
29805040,0irq/28-eth0-rx-0-21swapper/300:33:123
259940,0migration/231197-21kthreadcore21:13:222
259940,0migration/227368-21kthreadcore20:03:212
259940,0migration/223851-21munin-node20:43:252
259940,0migration/217491-21kthreadcore19:33:222
259940,0migration/212815-21kthreadcore19:53:212
244759943,0cyclictest7932-21awk19:28:192
244759943,0cyclictest3524-21snmpd23:33:232
244759943,0cyclictest3524-21snmpd20:48:512
244759943,0cyclictest3524-21snmpd20:11:512
244759943,0cyclictest3524-21snmpd19:18:502
244759943,0cyclictest3524-21snmpd00:03:082
244759943,0cyclictest10068-21awk21:58:192
244739944,0cyclictest18-21rcuc/100:03:241
244739944,0cyclictest0-21swapper/123:55:221
244739944,0cyclictest0-21swapper/122:19:401
244739944,0cyclictest0-21swapper/122:02:571
244739943,0cyclictest5923-21awk22:33:221
244739943,0cyclictest4112-21awk00:43:211
244739943,0cyclictest3896-21awk23:28:191
244739943,0cyclictest3571-21lldpd22:54:401
244739943,0cyclictest3571-21lldpd20:58:091
244739943,0cyclictest3571-21lldpd20:43:081
244739943,0cyclictest3571-21lldpd20:37:381
244739943,0cyclictest3524-21snmpd23:49:531
244739943,0cyclictest3524-21snmpd22:29:221
244739943,0cyclictest3524-21snmpd22:27:371
244739943,0cyclictest29851-21awk21:13:201
244739943,0cyclictest25075-21awk21:48:201
244739943,0cyclictest19239-21awk00:33:221
244739943,0cyclictest12609-21awk23:33:221
244679944,0cyclictest31076-21kworker/0:222:14:420
244679944,0cyclictest0-21swapper/023:06:210
244679943,0cyclictest8343-21awk00:08:220
244679943,0cyclictest3571-21lldpd23:25:400
244679943,0cyclictest3250-21irqbalance20:48:110
244679943,0cyclictest3250-21irqbalance20:43:510
244679943,0cyclictest3250-21irqbalance20:28:110
244679943,0cyclictest3250-21irqbalance20:08:210
244679943,0cyclictest3250-21irqbalance20:03:210
244679943,0cyclictest3250-21irqbalance19:53:110
244679943,0cyclictest3250-21irqbalance00:43:120
244679943,0cyclictest3250-21irqbalance00:28:120
244679943,0cyclictest13320-21awk21:23:190
244679943,0cyclictest10215-21awk21:58:200
249940,0watchdog/222966-21kthreadcore19:38:192
249940,0watchdog/217998-21grep19:58:152
249940,0watchdog/20-21swapper/221:08:162
249940,0watchdog/20-21swapper/220:58:232
249940,0watchdog/20-21swapper/200:33:082
19480240,0sleep021793-21kthreadcore23:18:230
179940,0migration/19459-21kthreadcore21:38:231
179940,0migration/131663-21kernelversion21:33:231
179940,0migration/128996-21fschecks_count19:43:161
179940,0migration/128587-21kthreadcore23:03:231
179940,0migration/128026-21runrttasks19:41:131
179940,0migration/125039-21kthreadcore20:23:231
179940,0migration/12392-21kthreadcore23:08:211
179940,0migration/120685-21kthreadcore22:03:231
179940,0migration/119695-21kthreadcore20:18:231
179940,0migration/118926-21kthreadcore22:38:221
179940,0migration/115804-21latency_hist00:13:061
179940,0migration/115678-21aten_r1power_en22:58:151
179940,0migration/115282-21missed_timers23:13:231
179940,0migration/113248-21missed_timers00:08:261
179940,0migration/11270-21kthreadcore23:43:231
169940,0watchdog/126406-21ssh23:38:281
169940,0watchdog/124766-21ssh23:18:561
169940,0watchdog/117999-21tr19:58:151
169940,0watchdog/110531-21ssh21:19:121
149940,0migration/06669-21aten_r1power_en21:38:160
149940,0migration/05241-21taskset21:35:280
149940,0migration/031335-21diskmemload00:03:200
149940,0migration/02985-21kthreadcore00:23:230
149940,0migration/028351-21kthreadcore21:48:220
149940,0migration/025732-21kthreadcore22:43:220
149940,0migration/025268-21kthreadcore22:23:230
149940,0migration/019541-21kthreadcore21:03:230
149940,0migration/017607-21taskset22:03:150
149940,0migration/016636-21kthreadcore23:53:230
149940,0migration/013443-21taskset19:29:220
149940,0migration/01154-21kthreadcore23:43:230
329930,0watchdog/324466-21cyclictest19:50:313
329930,0watchdog/322146-21fschecks_count21:08:163
329930,0watchdog/30-21swapper/321:13:243
329930,0watchdog/30-21swapper/320:48:153
29805030,0irq/28-eth0-rx-0-21swapper/320:33:123
29805030,0irq/28-eth0-rx-0-21swapper/319:53:173
29805030,0irq/28-eth0-rx-0-21swapper/319:23:163
244759932,0cyclictest3367-21basename19:48:152
244759932,0cyclictest15379-21awk20:18:212
244739932,0cyclictest4451-21awk19:48:191
244739932,0cyclictest3638-21awk22:13:201
244739932,0cyclictest3524-21snmpd19:33:511
244739932,0cyclictest26182-21awk20:48:201
244739932,0cyclictest11633-21awk19:53:191
244739930,0cyclictest402-21perl20:08:191
244679933,0cyclictest6026-21kworker/0:100:13:220
244679933,0cyclictest31076-21kworker/0:222:28:160
244679933,0cyclictest31076-21kworker/0:222:08:200
244679932,0cyclictest8119-21awk22:53:190
244679932,0cyclictest3250-21irqbalance20:53:110
244679932,0cyclictest25158-21tr21:28:230
244679932,0cyclictest12355-21awk22:18:200
244679932,0cyclictest10324-21awk23:13:190
244679930,0cyclictest5462-21diskstats23:48:170
244679930,0cyclictest24907-21diskstats00:18:170
244679930,0cyclictest21202-21munin-node19:38:150
244679930,0cyclictest15204-21iostat_ios19:33:210
249930,0watchdog/20-21swapper/220:17:432
249930,0watchdog/20-21swapper/219:23:152
179930,0migration/110098-21kthreadcore20:13:211
169930,0watchdog/10-21swapper/123:58:281
169930,0watchdog/10-21swapper/122:43:401
169930,0watchdog/10-21swapper/122:12:081
169930,0watchdog/10-21swapper/121:43:201
169930,0watchdog/10-21swapper/121:08:161
169930,0watchdog/10-21swapper/120:53:231
169930,0watchdog/10-21swapper/120:28:351
169930,0watchdog/10-21swapper/119:28:151
244759920,0cyclictest32286-21munin-node20:53:152
244759920,0cyclictest0-21swapper/219:43:042
244679921,0cyclictest314-21latency_hist23:08:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional