You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 11:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Wed Mar 25, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3009924738,0sleep20-21swapper/219:14:012
3022923727,0sleep30-21swapper/319:15:343
3012923322,0sleep00-21swapper/019:14:230
3027023123,0sleep10-21swapper/119:16:001
339960,0migration/325490-21sh23:37:343
339960,0migration/31119-21sh23:40:593
329960,0watchdog/33020-21sh21:32:173
29805060,0irq/28-eth0-rx-7043-21tr22:48:483
8305050,0irq/26-0000:00:16560-21latency_hist19:53:292
339950,0migration/39538-21latency_hist20:33:303
339950,0migration/38437-21switchtime19:43:553
339950,0migration/35463-21taskset23:05:373
339950,0migration/34929-21kthreadcore23:43:493
339950,0migration/332161-21munin-node19:18:463
339950,0migration/330567-21taskset22:04:273
339950,0migration/326911-21ksmtuned20:19:393
339950,0migration/323612-21taskset20:42:143
339950,0migration/323228-21kthreadcore21:43:473
339950,0migration/320723-21fschecks_count19:33:433
339950,0migration/320391-21kthreadcore19:53:473
339950,0migration/318222-21kthreadcore19:28:473
339950,0migration/318157-21fschecks_time22:18:503
339950,0migration/316807-21runrttasks23:32:113
339950,0migration/315136-21aten_r1power_fr21:58:423
339950,0migration/314027-21fschecks_time00:08:423
339950,0migration/313771-21fschecks_time20:13:433
339950,0migration/312894-21kthreadcore19:48:473
339950,0migration/311202-21aten_r1power_vo23:48:443
339950,0migration/310608-21kthreadcore20:08:483
329950,0watchdog/35573-21chrt20:50:163
329950,0watchdog/331413-21perl00:18:453
329950,0watchdog/33001-21df_inode21:13:443
329950,0watchdog/326573-21ssh23:54:333
329950,0watchdog/321728-21iostat21:03:443
329950,0watchdog/311707-21fschecks_time22:33:453
305549955,0cyclictest0-21swapper/223:44:312
305549955,0cyclictest0-21swapper/222:37:592
305549955,0cyclictest0-21swapper/221:37:552
305539955,0cyclictest0-21swapper/100:43:311
305539955,0cyclictest0-21swapper/100:27:451
305539954,0cyclictest6899-21crond22:09:291
305539954,0cyclictest21170-21awk19:33:451
305539950,0cyclictest0-21swapper/123:48:581
305539950,0cyclictest0-21swapper/123:33:501
305539950,0cyclictest0-21swapper/122:06:581
305539950,0cyclictest0-21swapper/122:00:111
305539950,0cyclictest0-21swapper/121:25:211
305539950,0cyclictest0-21swapper/100:08:311
305529955,0cyclictest4812-21kworker/0:223:46:350
305529955,0cyclictest4812-21kworker/0:222:58:490
305529955,0cyclictest10708-21kworker/0:000:14:070
305529953,0cyclictest5873-21munin-node20:08:470
29815050,0irq/29-eth0-tx-4509-21ssh23:03:552
29815050,0irq/29-eth0-tx-4072-21ssh22:47:542
29815050,0irq/29-eth0-tx-30031-21ssh22:03:552
29815050,0irq/29-eth0-tx-28602-21df_abs23:58:422
29815050,0irq/29-eth0-tx-22308-21awk00:13:432
29815050,0irq/29-eth0-tx-21540-21port_sshpriv00:28:522
29815050,0irq/29-eth0-tx-0-21swapper/222:09:312
29815050,0irq/29-eth0-tx-0-21swapper/020:30:010
29805050,0irq/28-eth0-rx-9666-21ssh22:30:413
29805050,0irq/28-eth0-rx-7280-21tr00:03:483
29805050,0irq/28-eth0-rx-29013-21fschecks_time22:43:443
29805050,0irq/28-eth0-rx-27901-21diskstats20:23:403
29805050,0irq/28-eth0-rx-2786-21sh23:59:253
29805050,0irq/28-eth0-rx-22532-21ssh00:30:213
29805050,0irq/28-eth0-rx-22260-21ssh23:14:153
29805050,0irq/28-eth0-rx-20651-21if_err_eth022:38:453
29805050,0irq/28-eth0-rx-0-21swapper/322:25:193
29805050,0irq/28-eth0-rx-0-21swapper/322:13:493
29805050,0irq/28-eth0-rx-0-21swapper/322:08:553
29805050,0irq/28-eth0-rx-0-21swapper/321:56:173
29805050,0irq/28-eth0-rx-0-21swapper/321:42:303
29805050,0irq/28-eth0-rx-0-21swapper/321:34:323
29805050,0irq/28-eth0-rx-0-21swapper/321:20:463
29805050,0irq/28-eth0-rx-0-21swapper/300:48:073
29805050,0irq/28-eth0-rx-0-21swapper/300:26:343
259950,0migration/27306-21kthreadcore22:48:482
259950,0migration/21804-21sh23:42:552
249950,0watchdog/213001-21processes00:23:532
19150,0ktimersoftd/10-21swapper/122:53:291
19150,0ktimersoftd/10-21swapper/121:30:211
179950,0migration/19308-21sh22:29:401
179950,0migration/16657-21fschecks_time20:08:441
179950,0migration/16536-21latency_hist00:23:301
179950,0migration/15923-21sh21:53:021
179950,0migration/14870-21cpuspeed_turbos00:03:431
179950,0migration/130075-21sh23:03:111
179950,0migration/127797-21cpuspeed_turbos20:23:391
179950,0migration/123377-21taskset19:56:361
179950,0migration/119950-21taskset20:17:261
179950,0migration/11982-21idleruntime-cro22:28:291
179950,0migration/118898-21kthreadcore00:28:491
179950,0migration/117621-21fschecks_time20:38:451
179950,0migration/11729-21sshd19:42:001
179950,0migration/114275-21kthreadcore21:38:471
179950,0migration/113213-21sh22:53:341
149950,0migration/08569-21latency_hist22:13:290
149950,0migration/08345-21taskset00:42:530
149950,0migration/07724-21kthreadcore22:48:480
149950,0migration/04928-21kthreadcore21:13:490
149950,0migration/04165-21df_abs21:33:420
149950,0migration/03282-21sh22:28:430
149950,0migration/032309-21kthreadcore22:43:480
149950,0migration/028548-21fschecks_time21:08:440
149950,0migration/027900-21kthreadcore22:23:470
149950,0migration/025425-21kthreadcore23:53:480
149950,0migration/023060-21switchtime20:38:560
149950,0migration/022854-21kthreadcore22:18:550
149950,0migration/022573-21kthreadcore21:03:450
149950,0migration/020636-21kthreadcore19:53:470
149950,0migration/020203-21sh21:40:590
149950,0migration/018882-21munin-node19:28:490
149950,0migration/017710-21sh22:34:010
149950,0migration/016705-21sh21:19:440
149950,0migration/01489-21kthreadcore20:03:460
149950,0migration/014853-21kthreadcore00:08:450
149950,0migration/014762-21munin-run21:58:290
149950,0migration/013240-21sh22:53:390
149950,0migration/011873-21kthreadcore23:28:470
8305040,0irq/26-0000:00:0-21swapper/223:53:422
339940,0migration/38021-21kthreadcore19:23:463
339940,0migration/3515-21cpuspeed_turbos23:23:403
339940,0migration/330519-21kthreadcore19:38:473
339940,0migration/330069-21ksmtuned21:48:403
339940,0migration/325598-21diskmemload21:24:583
339940,0migration/315449-21kthreadcore20:58:473
329940,0watchdog/37935-21kthreadcore20:28:483
329940,0watchdog/328501-21kthreadcore20:43:483
329940,0watchdog/328501-21kthreadcore20:43:483
329940,0watchdog/30-21swapper/323:18:453
329940,0watchdog/30-21swapper/323:08:413
329940,0watchdog/30-21swapper/300:33:493
305549944,0cyclictest0-21swapper/223:33:472
305549944,0cyclictest0-21swapper/220:38:572
305549943,0cyclictest3571-21lldpd21:53:472
305549943,0cyclictest3571-21lldpd20:29:162
305549943,0cyclictest3571-21lldpd20:21:162
305549943,0cyclictest3571-21lldpd20:07:162
305549943,0cyclictest3571-21lldpd19:59:162
305549943,0cyclictest3524-21snmpd20:25:442
305549943,0cyclictest3250-21irqbalance22:28:462
305549943,0cyclictest3250-21irqbalance19:30:452
305549943,0cyclictest3250-21irqbalance19:23:352
305549943,0cyclictest3250-21irqbalance19:18:352
305549943,0cyclictest14262-21awk20:13:452
305549940,0cyclictest0-21swapper/220:46:402
305549940,0cyclictest0-21swapper/220:46:402
305539944,0cyclictest0-21swapper/123:19:111
305539943,0cyclictest3571-21lldpd21:10:471
305539943,0cyclictest3571-21lldpd20:46:171
305539943,0cyclictest3571-21lldpd20:46:171
305539943,0cyclictest3571-21lldpd19:19:161
305539943,0cyclictest3571-21lldpd00:13:501
305539943,0cyclictest3524-21snmpd23:23:321
305539943,0cyclictest3524-21snmpd21:56:001
305539943,0cyclictest3444-21awk23:43:471
305539943,0cyclictest3355-21awk20:28:451
305539943,0cyclictest32344-21awk20:48:451
305529944,0cyclictest8533-21kworker/0:200:45:210
305529944,0cyclictest8265-21kworker/0:119:23:460
305529944,0cyclictest4812-21kworker/0:223:39:050
305529944,0cyclictest4812-21kworker/0:223:24:590
305529944,0cyclictest4812-21kworker/0:223:20:190
305529944,0cyclictest4812-21kworker/0:223:14:030
305529944,0cyclictest4812-21kworker/0:223:04:490
305529944,0cyclictest4812-21kworker/0:222:38:370
305529944,0cyclictest4812-21kworker/0:222:08:470
305529944,0cyclictest4812-21kworker/0:222:03:470
305529944,0cyclictest4812-21kworker/0:221:48:310
305529944,0cyclictest4812-21kworker/0:221:44:170
305529944,0cyclictest10708-21kworker/0:023:58:470
305529944,0cyclictest10708-21kworker/0:000:33:470
305529944,0cyclictest10708-21kworker/0:000:29:130
305529944,0cyclictest10708-21kworker/0:000:24:390
305529944,0cyclictest10708-21kworker/0:000:18:370
305529944,0cyclictest0-21swapper/000:03:320
305529943,0cyclictest7452-21fschecks_time23:08:430
305529943,0cyclictest3524-21snmpd20:43:590
305529943,0cyclictest3524-21snmpd20:43:590
305529943,0cyclictest3250-21irqbalance21:23:560
305529943,0cyclictest3250-21irqbalance20:18:460
305529943,0cyclictest3250-21irqbalance19:59:260
305529943,0cyclictest3250-21irqbalance19:48:360
305529943,0cyclictest3250-21irqbalance19:44:260
305529943,0cyclictest28427-21awk21:28:450
305529943,0cyclictest18652-21awk23:33:470
305529943,0cyclictest16174-21awk21:58:460
305529943,0cyclictest14238-21awk20:13:450
29815040,0irq/29-eth0-tx-4520-21ssh00:03:332
29815040,0irq/29-eth0-tx-27294-21ssh21:28:312
29815040,0irq/29-eth0-tx-18509-21munin-node21:23:452
29815040,0irq/29-eth0-tx-15748-21ssh23:29:092
29815040,0irq/29-eth0-tx-0-21swapper/223:25:062
29815040,0irq/29-eth0-tx-0-21swapper/223:18:352
29815040,0irq/29-eth0-tx-0-21swapper/223:13:392
29815040,0irq/29-eth0-tx-0-21swapper/223:09:012
29815040,0irq/29-eth0-tx-0-21swapper/222:58:442
29815040,0irq/29-eth0-tx-0-21swapper/222:39:392
29815040,0irq/29-eth0-tx-0-21swapper/221:58:472
29815040,0irq/29-eth0-tx-0-21swapper/221:48:302
29815040,0irq/29-eth0-tx-0-21swapper/200:38:432
29815040,0irq/29-eth0-tx-0-21swapper/200:33:402
29805040,0irq/28-eth0-rx-31171-21cpu20:03:403
29805040,0irq/28-eth0-rx-0-21swapper/322:58:303
29805040,0irq/28-eth0-rx-0-21swapper/322:53:533
29805040,0irq/28-eth0-rx-0-21swapper/300:38:473
29805040,0irq/28-eth0-rx-0-21swapper/300:13:573
259940,0migration/230662-21kthreadcore22:23:472
259940,0migration/230289-21kthreadcore21:08:482
259940,0migration/223968-21sh22:19:022
259940,0migration/222150-21kthreadcore19:33:472
259940,0migration/218679-21kthreadcore00:08:462
259940,0migration/218627-21missed_timers21:38:492
259940,0migration/216788-21kthreadcore23:48:502
259940,0migration/214905-21kthreadcore22:53:472
259940,0migration/213740-21kthreadcore22:13:492
259940,0migration/213182-21latency_hist20:58:302
259940,0migration/212463-21kthreadcore21:18:472
259940,0migration/212241-21kthreadcore00:43:482
259940,0migration/21136-21kthreadcore20:48:472
259940,0migration/211207-21kthreadcore20:08:492
249940,0watchdog/25604-21kthreadcore19:43:482
249940,0watchdog/24165-21irqstats21:13:482
249940,0watchdog/221453-21aten_r1power_cu21:43:412
249940,0watchdog/20-21swapper/200:18:492
179940,0migration/19853-21kthreadcore23:08:471
179940,0migration/19847-21fschecks_count19:48:431
179940,0migration/19550-21taskset20:33:311
179940,0migration/16676-21fschecks_count20:53:421
179940,0migration/16432-21kthreadcore21:13:491
179940,0migration/15579-21latency_hist19:23:291
179940,0migration/1407-21kthreadcore20:03:461
179940,0migration/128631-21kthreadcore23:38:481
179940,0migration/127397-21mdstat21:43:491
179940,0migration/126833-21kthreadcore19:58:471
179940,0migration/125044-21kthreadcore23:53:481
179940,0migration/124118-21cpu00:33:441
179940,0migration/120494-21fschecks_time22:38:441
179940,0migration/118245-21fschecks_time22:18:501
169940,0watchdog/19263-21grep22:13:451
169940,0watchdog/13790-21ssh21:33:371
169940,0watchdog/127091-21chrt20:21:441
169940,0watchdog/12235-21python23:58:531
169940,0watchdog/120813-21cpuspeed_turbos21:03:401
169940,0watchdog/116421-21ssh23:13:451
169940,0watchdog/111706-21fschecks_time22:33:451
169940,0watchdog/11099-21kthreadcore22:43:491
149940,0migration/031895-21fschecks_time20:48:430
149940,0migration/030047-21kthreadcore19:38:460
149940,0migration/027409-21latency_hist20:23:300
149940,0migration/017779-21kthreadcore20:58:470
149940,0migration/014665-21kthreadcore23:48:490
329930,0watchdog/30-21swapper/321:08:483
329930,0watchdog/30-21swapper/320:53:403
329930,0watchdog/30-21swapper/319:58:443
305549933,0cyclictest11144-21sort20:33:462
305549932,0cyclictest3571-21lldpd19:41:462
305549932,0cyclictest18227-21kthreadcore20:58:472
305539933,0cyclictest31556-21awk23:03:451
305539932,0cyclictest3524-21snmpd00:39:031
305539932,0cyclictest13998-21awk19:28:441
305529933,0cyclictest8265-21kworker/0:119:33:380
305529933,0cyclictest6855-21kworker/0:020:53:410
305529932,0cyclictest32304-21irqstats19:18:470
305529930,0cyclictest9989-21diskstats20:33:420
249930,0watchdog/20-21swapper/221:03:402
249930,0watchdog/20-21swapper/219:48:562
179930,0migration/118299-21kthreadcore20:58:481
169930,0watchdog/10-21swapper/123:30:131
169930,0watchdog/10-21swapper/121:20:001
169930,0watchdog/10-21swapper/119:43:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional