You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-19 - 12:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue May 19, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2021224939,0sleep30-21swapper/319:18:523
2048824129,0sleep10-21swapper/119:22:021
2048423626,0sleep20-21swapper/219:21:592
2030823430,0sleep00-21swapper/019:19:570
206439983,0cyclictest30402-21awk23:13:200
206439983,0cyclictest24491-21sadc20:33:020
206439983,0cyclictest11654-21awk21:08:180
206439982,0cyclictest3524-21snmpd19:23:180
206439980,0cyclictest13832-21munin-node20:03:270
206439980,0cyclictest0-21swapper/000:19:330
206439975,0cyclictest0-21swapper/019:43:300
206439973,0cyclictest3571-21lldpd22:13:510
206439972,0cyclictest826-21awk21:23:170
206439972,0cyclictest7660-21kthreadcore21:03:200
206439972,0cyclictest3524-21snmpd22:45:500
206439972,0cyclictest3524-21snmpd21:58:100
206439972,0cyclictest3301-21hostname22:58:140
206439972,0cyclictest26269-21awk23:48:180
206439972,0cyclictest26168-21awk21:18:190
206439972,0cyclictest22753-21sh00:42:460
206439972,0cyclictest21772-21awk23:08:200
206439972,0cyclictest11259-21awk23:58:220
206439970,0cyclictest8689-21cut20:43:200
206439970,0cyclictest7101-21grep22:03:180
206439970,0cyclictest6314-21runrttasks19:40:170
206439970,0cyclictest4864-21netstat22:18:220
206439970,0cyclictest464-21grep00:08:180
206439970,0cyclictest32554-21munin-node21:38:230
206439970,0cyclictest25045-21sh21:35:380
206439970,0cyclictest24916-21telnet22:33:140
206439970,0cyclictest24716-21munin-node20:33:160
206439970,0cyclictest23994-21python21:13:290
206439970,0cyclictest22037-21ssh22:12:360
206439970,0cyclictest18708-21kthreadcore23:43:200
206439970,0cyclictest13344-21ssh00:35:300
206439970,0cyclictest13017-21sh23:20:420
206439970,0cyclictest10636-21kthreadcore22:23:200
206439970,0cyclictest0-21swapper/021:29:410
206439970,0cyclictest0-21swapper/000:25:230
8305060,0irq/26-0000:00:3222-17sedispatch21:43:022
339960,0migration/34302-21sh00:29:323
339960,0migration/322793-21taskset23:43:253
339960,0migration/31573-21munin-node00:08:263
339960,0migration/311972-21sh22:03:383
339960,0migration/310151-21sh22:58:543
329960,0watchdog/318167-21df_inode21:13:173
29815060,0irq/29-eth0-tx-19847-21sed22:08:212
29805060,0irq/28-eth0-rx-2878-21nfs4_client23:13:233
29805060,0irq/28-eth0-rx-24897-21tr23:08:223
29805060,0irq/28-eth0-rx-10287-21kthreadcore22:23:203
206439961,0cyclictest31318-21cut19:28:210
206439961,0cyclictest28416-21munin-node20:58:160
206439961,0cyclictest2578-21latency_hist21:43:020
206439960,0cyclictest7786-21sh23:38:090
206439960,0cyclictest6852-21munin-node19:58:150
206439960,0cyclictest664-21sed20:38:170
206439960,0cyclictest664-21sed20:38:170
206439960,0cyclictest6314-21runrttasks19:33:090
206439960,0cyclictest3583-21sh00:13:070
206439960,0cyclictest3521-21df_inode20:18:140
206439960,0cyclictest31980-21cpuspeed_turbos19:53:160
206439960,0cyclictest31788-21sh00:48:120
206439960,0cyclictest31432-21sh23:33:090
206439960,0cyclictest29900-21cpuspeed_turbos00:28:160
206439960,0cyclictest28531-21tr20:13:130
206439960,0cyclictest26936-21sh22:53:070
206439960,0cyclictest24826-21tr19:48:210
206439960,0cyclictest23505-21cut00:03:220
206439960,0cyclictest23190-21aten_r1power_en00:43:130
206439960,0cyclictest23034-21head23:28:170
206439960,0cyclictest22064-21tune2fs20:53:160
206439960,0cyclictest21457-21fschecks_count20:08:160
206439960,0cyclictest20190-21ssh21:53:070
206439960,0cyclictest18295-21sh22:48:030
206439960,0cyclictest16126-21aten_r1power_en22:28:150
206439960,0cyclictest1568-21tr23:53:140
206439960,0cyclictest14480-21forks20:48:160
206439960,0cyclictest14131-21sh23:23:110
206439960,0cyclictest12158-21cpu23:03:140
206439960,0cyclictest11582-21munin-node21:48:120
206439960,0cyclictest10550-21awk20:23:150
206439960,0cyclictest0-21swapper/022:38:150
8305050,0irq/26-0000:00:16183-21crond23:43:022
339950,0migration/38386-21kthreadcore21:43:203
339950,0migration/3825-21munin-node21:23:173
339950,0migration/35940-21munin-node23:18:153
339950,0migration/35676-21runrttasks20:38:223
339950,0migration/35676-21runrttasks20:38:223
339950,0migration/331568-21taskset21:18:413
339950,0migration/330547-21kthreadcore21:58:223
339950,0migration/328059-21taskset00:24:343
339950,0migration/325677-21munin-node20:33:133
339950,0migration/323637-21munin-node22:13:193
339950,0migration/31935-21kthreadcore23:33:223
339950,0migration/315589-21irqrtprio23:23:203
339950,0migration/312011-21aten_r1power_fr23:03:133
339950,0migration/310191-21taskset21:07:003
329950,0watchdog/39047-21diskstats21:28:173
329950,0watchdog/35720-21taskset22:19:053
329950,0watchdog/331422-21python23:48:263
329950,0watchdog/324247-21if_eth000:43:183
329950,0watchdog/316181-21cut00:38:183
329950,0watchdog/311719-21grep00:33:223
29815050,0irq/29-eth0-tx-5266-21munin-node23:33:252
29815050,0irq/29-eth0-tx-3295-21ssh00:13:012
29815050,0irq/29-eth0-tx-20220-21munin-node21:53:202
29815050,0irq/29-eth0-tx-18357-21munin-node22:48:252
29815050,0irq/29-eth0-tx-17965-21irqrtprio23:43:202
29815050,0irq/29-eth0-tx-13803-21kthreadcore21:28:222
29815050,0irq/29-eth0-tx-1299-21munin-node23:53:202
29815050,0irq/29-eth0-tx-11933-21munin-node23:03:172
29815050,0irq/29-eth0-tx-11463-21irqcore23:58:232
29805050,0irq/28-eth0-rx-9110-21kthreadcore20:43:203
29805050,0irq/28-eth0-rx-26387-21sh21:38:133
29805050,0irq/28-eth0-rx-23885-21hwlatdetect23:28:203
29805050,0irq/28-eth0-rx-14479-21fschecks_count22:08:153
29805050,0irq/28-eth0-rx-14181-21sh23:38:253
29805050,0irq/28-eth0-rx-11475-21latency_hist21:48:023
29805050,0irq/28-eth0-rx-0-21swapper/323:55:393
29805050,0irq/28-eth0-rx-0-21swapper/322:48:213
29805050,0irq/28-eth0-rx-0-21swapper/322:43:213
29805050,0irq/28-eth0-rx-0-21swapper/322:40:363
29805050,0irq/28-eth0-rx-0-21swapper/322:33:153
29805050,0irq/28-eth0-rx-0-21swapper/319:43:143
29805050,0irq/28-eth0-rx-0-21swapper/300:15:013
29805050,0irq/28-eth0-rx-0-21swapper/300:05:153
29805050,0irq/28-eth0-rx-0-21swapper/300:00:323
27150,0ktimersoftd/20-21swapper/220:43:172
259950,0migration/2553-21kthreadcore23:13:212
259950,0migration/25187-21kthreadcore00:48:222
259950,0migration/24373-21kthreadcore21:23:192
259950,0migration/232149-21cpuspeed_turbos20:38:132
259950,0migration/232149-21cpuspeed_turbos20:38:132
259950,0migration/223762-21irqcore22:13:202
259950,0migration/220924-21latency_hist00:23:032
259950,0migration/211347-21idleruntime20:23:182
249950,0watchdog/210672-21kthreadcore19:58:212
206459955,0cyclictest0-21swapper/200:13:452
206459950,0cyclictest0-21swapper/222:44:592
206459950,0cyclictest0-21swapper/222:39:382
206459950,0cyclictest0-21swapper/200:32:212
206449955,0cyclictest0-21swapper/122:48:021
179950,0migration/18390-21sh22:40:071
179950,0migration/15414-21munin-node00:48:221
179950,0migration/130575-21kthreadcore20:58:201
179950,0migration/12996-21kthreadcore23:53:191
179950,0migration/127155-21kthreadcore23:28:231
179950,0migration/119660-21missed_timers20:03:211
179950,0migration/117008-21sh21:32:391
169950,0watchdog/11984-21ssh00:09:301
8305040,0irq/26-0000:00:0-21swapper/319:23:023
8305040,0irq/26-0000:00:0-21swapper/221:03:032
339940,0migration/39814-21taskset20:19:523
339940,0migration/38279-21kthreadcore19:33:193
339940,0migration/33333-21kthreadcore19:53:223
339940,0migration/323092-21kthreadcore20:53:203
339940,0migration/321536-21irqcore21:53:173
339940,0migration/316444-21missed_timers21:08:213
339940,0migration/314029-21taskset20:48:033
329940,0watchdog/36314-21runrttasks21:34:013
329940,0watchdog/314809-21munin-node20:03:173
329940,0watchdog/30-21swapper/320:08:213
329940,0watchdog/30-21swapper/319:58:213
29815040,0irq/29-eth0-tx-18693-21munin-node00:03:162
29815040,0irq/29-eth0-tx-0-21swapper/223:48:312
29815040,0irq/29-eth0-tx-0-21swapper/223:23:122
29815040,0irq/29-eth0-tx-0-21swapper/223:19:332
29815040,0irq/29-eth0-tx-0-21swapper/222:23:532
29815040,0irq/29-eth0-tx-0-21swapper/222:03:172
29815040,0irq/29-eth0-tx-0-21swapper/221:48:202
29815040,0irq/29-eth0-tx-0-21swapper/221:33:032
29815040,0irq/29-eth0-tx-0-21swapper/200:43:112
29815040,0irq/29-eth0-tx-0-21swapper/200:33:212
29815040,0irq/29-eth0-tx-0-21swapper/200:18:522
29805040,0irq/28-eth0-rx-0-21swapper/322:53:103
29805040,0irq/28-eth0-rx-0-21swapper/322:28:203
29805040,0irq/28-eth0-rx-0-21swapper/319:38:213
29805040,0irq/28-eth0-rx-0-21swapper/319:28:213
29805040,0irq/28-eth0-rx-0-21swapper/300:49:163
29805040,0irq/28-eth0-rx-0-21swapper/300:19:233
259940,0migration/231746-21kthreadcore21:58:222
259940,0migration/230910-21kthreadcore19:28:212
259940,0migration/228640-21kthreadcore21:18:212
259940,0migration/227986-21kthreadcore20:33:172
259940,0migration/227650-21kthreadcore23:28:232
259940,0migration/227386-21df_abs22:53:142
259940,0migration/222594-21irqcore20:53:192
259940,0migration/222111-21kthreadcore20:28:192
259940,0migration/221620-21fschecks_count20:08:162
259940,0migration/216812-21fschecks_time22:28:172
259940,0migration/215171-21kthreadcore21:08:202
249940,0watchdog/2807-21irqstats19:53:212
249940,0watchdog/232111-21sort22:18:172
249940,0watchdog/221153-21fschecks_count23:08:172
249940,0watchdog/220480-21unixbench-2d20:48:292
206459943,0cyclictest4356-21awk22:58:182
206459943,0cyclictest3524-21snmpd19:23:032
206459943,0cyclictest3445-21perl21:43:152
206459943,0cyclictest29501-21awk20:58:182
206459943,0cyclictest29314-21awk20:13:162
206459943,0cyclictest15699-21awk00:38:162
206459941,0cyclictest0-21swapper/222:33:132
206449943,0cyclictest3524-21snmpd23:13:211
206449943,0cyclictest3524-21snmpd22:08:501
206449943,0cyclictest3524-21snmpd21:57:051
206449943,0cyclictest3524-21snmpd21:40:051
206449943,0cyclictest3524-21snmpd20:14:491
206449943,0cyclictest28001-21sadc20:13:021
206449943,0cyclictest26095-21awk21:18:181
206449943,0cyclictest25846-21awk22:33:171
206449943,0cyclictest24242-21awk00:43:181
206449943,0cyclictest23554-21awk22:13:191
206449943,0cyclictest17139-21awk22:28:191
206449943,0cyclictest15335-21awk23:23:191
206449943,0cyclictest15129-21awk20:48:191
206449943,0cyclictest13116-21awk23:03:181
206449943,0cyclictest10918-21awk22:43:191
19140,0ktimersoftd/10-21swapper/121:50:201
179940,0migration/18856-21irqcore22:23:191
179940,0migration/18436-21kthreadcore22:58:211
179940,0migration/15981-21kthreadcore19:33:191
179940,0migration/15921-21aten_r1power_en00:33:151
179940,0migration/132350-21aten_r1power_vo21:23:131
179940,0migration/132012-21kthreadcore21:58:221
179940,0migration/126003-21gltestperf23:48:151
179940,0migration/125502-21fschecks_time20:33:131
179940,0migration/122850-21taskset00:43:021
179940,0migration/122640-21kthreadcore00:23:211
179940,0migration/120432-21kthreadcore23:43:211
179940,0migration/117667-21latency_hist21:13:021
179940,0migration/11682-21kthreadcore19:53:211
179940,0migration/113213-21taskset19:58:381
179940,0migration/112642-21kthreadcore20:23:201
179940,0migration/111846-21sh23:18:251
179940,0migration/110033-21kthreadcore20:43:201
169940,0watchdog/17446-21ssh23:37:501
169940,0watchdog/16400-21kthreadcore00:13:221
169940,0watchdog/132110-21ls22:18:171
169940,0watchdog/127215-21cpuspeed_turbos22:53:131
169940,0watchdog/12636-21kthreadcore00:28:221
169940,0watchdog/123955-21kthreadcore00:03:221
169940,0watchdog/115794-21ssh23:41:581
169940,0watchdog/111174-21ssh23:58:221
169940,0watchdog/10-21swapper/123:08:211
169940,0watchdog/10-21swapper/122:03:211
169940,0watchdog/10-21swapper/120:18:171
329930,0watchdog/30-21swapper/319:48:213
29805030,0irq/28-eth0-rx-0-21swapper/320:58:073
29805030,0irq/28-eth0-rx-0-21swapper/320:28:303
29805030,0irq/28-eth0-rx-0-21swapper/320:23:143
29805030,0irq/28-eth0-rx-0-21swapper/320:13:133
259930,0migration/210474-21cpuspeed_turbos19:38:142
249930,0watchdog/20-21swapper/219:33:092
206459932,0cyclictest4174-21awk20:18:172
206459932,0cyclictest25621-21awk19:48:242
206459930,0cyclictest18251-21perl19:43:162
206449933,0cyclictest505-21awk20:38:161
206449933,0cyclictest505-21awk20:38:161
206449932,0cyclictest8069-21kthreadcore21:43:191
206449932,0cyclictest3571-21lldpd21:08:201
206449932,0cyclictest3524-21snmpd19:32:431
206449932,0cyclictest25606-21awk19:48:241
206449932,0cyclictest21841-21sed19:23:161
206449932,0cyclictest18658-21awk20:28:171
206449932,0cyclictest13856-21cut00:18:211
179930,0migration/16461-21kthreadcore21:03:201
179930,0migration/125304-21diskmemload21:36:221
169930,0watchdog/13524-21snmpd19:42:451
169930,0watchdog/10-21swapper/120:53:251
206459921,0cyclictest13783-21cat20:03:022
206459920,0cyclictest0-21swapper/221:13:022
169920,0watchdog/10-21swapper/119:43:051
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional