You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 05:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Wed Dec 31, 2025 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
306924940,0sleep30-21swapper/319:11:063
302423627,0sleep10-21swapper/119:10:351
294123324,0sleep20-21swapper/219:09:402
300823127,0sleep00-21swapper/019:10:220
31769976,0cyclictest0-21swapper/023:46:520
339960,0migration/327810-21sh22:30:483
339960,0migration/32726-21kthreadcore21:01:493
339960,0migration/324730-21sh22:10:423
339960,0migration/323784-21munin-node22:46:483
339960,0migration/323017-21sh21:15:533
339960,0migration/312800-21sh22:39:443
339960,0migration/311379-21kthreadcore23:31:513
31789965,0cyclictest10581-21crond20:01:312
31779960,0cyclictest0-21swapper/123:49:181
31779960,0cyclictest0-21swapper/100:37:051
31769960,0cyclictest0-21swapper/020:11:490
29805060,0irq/28-eth0-rx-8781-21cut00:26:523
29805060,0irq/28-eth0-rx-25487-21cut21:51:493
29805060,0irq/28-eth0-rx-22565-21vmstat00:32:033
29805060,0irq/28-eth0-rx-0-21swapper/321:48:133
8305050,0irq/26-0000:00:8384-21awk20:21:462
8305050,0irq/26-0000:00:5665-21crond23:31:322
8305050,0irq/26-0000:00:0-21swapper/222:46:272
339950,0migration/35407-21kthreadcore22:16:503
339950,0migration/34742-21munin-node00:06:493
339950,0migration/34113-21kthreadcore21:56:523
339950,0migration/331795-21taskset19:29:273
339950,0migration/331751-21sh21:20:083
339950,0migration/32596-21pmu-power20:36:533
339950,0migration/325655-21munin-node00:36:473
339950,0migration/321861-21kthreadcore20:51:513
339950,0migration/321204-21taskset19:45:533
339950,0migration/31939-21taskset00:03:233
339950,0migration/316511-21taskset21:27:373
339950,0migration/31280-21kthreadcore22:51:503
339950,0migration/311876-21munin-node22:21:473
339950,0migration/311587-21aten_r1power_cu23:16:433
339950,0migration/311092-21kthreadcore20:21:493
339950,0migration/310510-21taskset20:00:453
329950,0watchdog/34131-21rm23:27:513
329950,0watchdog/325792-21df20:56:463
329950,0watchdog/318203-21cut23:36:513
329950,0watchdog/315246-40yum-updatesd-he22:04:033
329950,0watchdog/312184-21if_eth1.220:46:503
31789954,0cyclictest1242-21irqcore20:16:492
31779950,0cyclictest0-21swapper/123:20:371
31779950,0cyclictest0-21swapper/122:59:581
31779950,0cyclictest0-21swapper/121:18:261
31779950,0cyclictest0-21swapper/100:00:021
31769955,0cyclictest0-21swapper/022:31:300
31769955,0cyclictest0-21swapper/021:59:300
31769955,0cyclictest0-21swapper/019:41:330
31769954,0cyclictest3524-21snmpd00:34:030
31769950,0cyclictest0-21swapper/022:47:260
31769950,0cyclictest0-21swapper/022:35:080
31769950,0cyclictest0-21swapper/021:54:090
29815050,0irq/29-eth0-tx-4988-21munin-node22:36:482
29815050,0irq/29-eth0-tx-4707-21munin-run22:36:322
29815050,0irq/29-eth0-tx-28724-21kthreadcore00:01:522
29815050,0irq/29-eth0-tx-18857-21ssh22:25:212
29815050,0irq/29-eth0-tx-18352-21kthreadcore21:11:510
29815050,0irq/29-eth0-tx-0-21swapper/223:43:172
29815050,0irq/29-eth0-tx-0-21swapper/223:09:542
29815050,0irq/29-eth0-tx-0-21swapper/222:48:032
29815050,0irq/29-eth0-tx-0-21swapper/222:16:412
29815050,0irq/29-eth0-tx-0-21swapper/221:58:442
29815050,0irq/29-eth0-tx-0-21swapper/221:54:532
29815050,0irq/29-eth0-tx-0-21swapper/200:38:562
29815050,0irq/29-eth0-tx-0-21swapper/200:34:182
29815050,0irq/29-eth0-tx-0-21swapper/021:10:310
29815050,0irq/29-eth0-tx-0-21swapper/020:41:530
29815050,0irq/29-eth0-tx-0-21swapper/020:40:520
29805050,0irq/28-eth0-rx-530-21ssh23:07:273
29805050,0irq/28-eth0-rx-24225-21netstat23:56:543
29805050,0irq/28-eth0-rx-212442chrt22:43:403
29805050,0irq/28-eth0-rx-14479-21kthreadcore20:01:503
29805050,0irq/28-eth0-rx-12923-21diskstats00:11:463
29805050,0irq/28-eth0-rx-10466-21load21:41:513
29805050,0irq/28-eth0-rx-0-21swapper/323:49:403
29805050,0irq/28-eth0-rx-0-21swapper/323:42:243
29805050,0irq/28-eth0-rx-0-21swapper/323:11:443
29805050,0irq/28-eth0-rx-0-21swapper/323:01:473
29805050,0irq/28-eth0-rx-0-21swapper/323:00:183
29805050,0irq/28-eth0-rx-0-21swapper/322:31:493
29805050,0irq/28-eth0-rx-0-21swapper/321:36:493
29805050,0irq/28-eth0-rx-0-21swapper/321:21:493
29805050,0irq/28-eth0-rx-0-21swapper/300:26:273
29805050,0irq/28-eth0-rx-0-21swapper/300:17:553
259950,0migration/28721-21needreboot23:11:512
259950,0migration/232391-21fschecks_time22:51:472
259950,0migration/230150-21kthreadcore21:36:502
259950,0migration/218065-21latency_hist20:51:312
259950,0migration/217899-21kthreadcore23:36:512
259950,0migration/214685-21latency_hist21:11:312
259950,0migration/211696-21kthreadcore23:51:502
259950,0migration/211630-21aten_r1power_fr23:16:442
19150,0ktimersoftd/124230-21ssh00:36:021
19150,0ktimersoftd/10-21swapper/122:12:301
179950,0migration/18651-21kthreadcore20:41:511
179950,0migration/132718-21aten_r1power_en21:21:431
179950,0migration/131472-21munin-node00:21:501
179950,0migration/130243-21fschecks_time23:26:461
179950,0migration/128182-21latency_hist22:31:321
179950,0migration/116328-21kthreadcore19:41:521
169950,0watchdog/115710-21fschecks_time21:11:461
169950,0watchdog/10-21swapper/121:53:311
149950,0migration/09950-21sh23:13:190
149950,0migration/09251-21latency_hist21:26:320
149950,0migration/08812-21sh21:25:510
149950,0migration/04942-21fschecks_count21:41:460
149950,0migration/03385-21latency_hist19:11:310
149950,0migration/032220-21aten_r1power_cu19:31:430
149950,0migration/028806-21sh00:18:390
149950,0migration/02507-21taskset00:04:450
149950,0migration/020128-21sh23:21:170
149950,0migration/01874-21runrttasks23:10:360
149950,0migration/016718-21kthreadcore00:11:510
149950,0migration/013862-21kthreadcore20:46:520
339940,0migration/331007-21kthreadcore19:51:503
339940,0migration/325605-21diskmemload21:32:413
339940,0migration/313091-21kthreadcore19:16:473
339940,0migration/312247-21kthreadcore23:51:503
339940,0migration/310485-21kthreadcore19:36:493
329940,0watchdog/322172-21perl19:46:463
329940,0watchdog/30-21swapper/320:46:023
329940,0watchdog/30-21swapper/320:31:503
329940,0watchdog/30-21swapper/319:31:503
329940,0watchdog/30-21swapper/319:11:503
31789943,0cyclictest3524-21snmpd20:56:012
31789943,0cyclictest3524-21snmpd00:11:322
31789943,0cyclictest22482-21awk00:16:502
31789943,0cyclictest15671-21awk20:26:482
31779944,0cyclictest0-21swapper/122:25:171
31779944,0cyclictest0-21swapper/122:18:491
31779944,0cyclictest0-21swapper/122:07:181
31779944,0cyclictest0-21swapper/100:16:441
31779943,0cyclictest5500-21awk21:41:471
31779943,0cyclictest3571-21lldpd23:15:031
31779943,0cyclictest3571-21lldpd21:56:321
31779943,0cyclictest3544-21sadc20:41:311
31779943,0cyclictest3524-21snmpd21:09:011
31779943,0cyclictest3524-21snmpd21:03:011
31779943,0cyclictest3524-21snmpd20:31:011
31779943,0cyclictest3524-21snmpd20:01:011
31779943,0cyclictest3524-21snmpd19:53:011
31779943,0cyclictest3524-21snmpd19:37:001
31779943,0cyclictest3524-21snmpd19:27:001
31779943,0cyclictest3524-21snmpd19:20:001
31779943,0cyclictest349-21awk22:51:491
31779943,0cyclictest22554-21awk19:46:481
31779943,0cyclictest12131-21awk20:46:501
31769943,0cyclictest4743-21awk00:06:490
31769943,0cyclictest4123-21sadc21:41:320
31769943,0cyclictest3571-21lldpd22:18:020
31769943,0cyclictest3571-21lldpd22:11:320
31769943,0cyclictest3571-21lldpd00:26:340
31769943,0cyclictest3524-21snmpd22:04:310
31769943,0cyclictest3250-21irqbalance23:51:480
31769943,0cyclictest3250-21irqbalance21:01:580
31769943,0cyclictest3250-21irqbalance20:57:080
31769943,0cyclictest3250-21irqbalance20:06:380
31769943,0cyclictest3250-21irqbalance19:46:380
31769943,0cyclictest3250-21irqbalance19:37:270
31769943,0cyclictest3250-21irqbalance19:26:570
31769943,0cyclictest3250-21irqbalance19:19:070
31769943,0cyclictest3250-21irqbalance00:22:480
31769943,0cyclictest19213-21awk23:56:500
31769943,0cyclictest18908-21awk19:21:480
31769943,0cyclictest14528-21awk21:46:490
31769943,0cyclictest11853-21awk20:01:470
29815040,0irq/29-eth0-tx-16586-21ssh22:06:442
29815040,0irq/29-eth0-tx-14562-21diskmemload00:06:402
29815040,0irq/29-eth0-tx-11366-21kthreadcore22:56:512
29815040,0irq/29-eth0-tx-0-21swapper/223:46:352
29815040,0irq/29-eth0-tx-0-21swapper/223:21:572
29815040,0irq/29-eth0-tx-0-21swapper/223:03:392
29815040,0irq/29-eth0-tx-0-21swapper/222:27:192
29815040,0irq/29-eth0-tx-0-21swapper/222:11:352
29815040,0irq/29-eth0-tx-0-21swapper/222:01:382
29815040,0irq/29-eth0-tx-0-21swapper/221:31:462
29815040,0irq/29-eth0-tx-0-21swapper/221:21:432
29815040,0irq/29-eth0-tx-0-21swapper/221:13:492
29815040,0irq/29-eth0-tx-0-21swapper/200:26:342
29815040,0irq/29-eth0-tx-0-21swapper/200:21:332
29815040,0irq/29-eth0-tx-0-21swapper/020:51:450
29815040,0irq/29-eth0-tx-0-21swapper/020:36:080
29815040,0irq/29-eth0-tx-0-21swapper/019:56:450
29805040,0irq/28-eth0-rx-8523-21munin-node21:06:463
29805040,0irq/28-eth0-rx-0-21swapper/323:21:553
29805040,0irq/28-eth0-rx-0-21swapper/322:11:413
259940,0migration/24370-21sh21:41:362
259940,0migration/230177-21timerwakeupswit21:16:572
259940,0migration/228749-21aten_r1power_cu19:51:432
259940,0migration/225541-21fschecks_count19:26:452
259940,0migration/224194-21kthreadcore19:46:502
259940,0migration/222661-21kthreadcore20:06:492
259940,0migration/219495-21kthreadcore19:41:522
259940,0migration/219465-21irqcore23:56:512
259940,0migration/219178-21irqcore19:21:492
259940,0migration/216242-21kthreadcore21:46:522
259940,0migration/212324-21kthreadcore19:16:472
259940,0migration/210969-21kthreadcore19:36:492
249940,0watchdog/29661-21grep23:31:512
249940,0watchdog/28215-21kthreadcore19:11:502
249940,0watchdog/26319-21kthreadcore20:41:502
249940,0watchdog/210292-21perl21:26:462
179940,0migration/18640-21kthreadcore00:26:511
179940,0migration/18615-21gltestperf22:01:481
179940,0migration/18066-21kthreadcore19:11:501
179940,0migration/131755-21kthreadcore21:36:501
179940,0migration/130114-21kthreadcore20:11:501
179940,0migration/128519-21aten_r1power_po22:31:431
179940,0migration/12818-21kthreadcore20:16:521
179940,0migration/127964-21munin-node20:31:571
179940,0migration/122747-21kthreadcore20:51:511
179940,0migration/121983-21kthreadcore19:21:511
179940,0migration/119779-21sh22:41:521
179940,0migration/118467-21fschecks_count20:06:451
179940,0migration/115319-21kthreadcore21:46:521
179940,0migration/113344-21fschecks_time00:11:461
179940,0migration/112059-21kthreadcore20:21:491
179940,0migration/111981-21munin-node23:31:521
179940,0migration/111878-21kthreadcore21:26:501
179940,0migration/111582-21sh00:10:031
179940,0migration/110441-21irqcore23:51:491
169940,0watchdog/132293-21port_sshpriv23:06:551
169940,0watchdog/128507-21kthreadcore23:41:511
169940,0watchdog/120794-21cut23:01:511
169940,0watchdog/116513-21cut20:01:501
169940,0watchdog/115652-21fschecks_time23:36:471
169940,0watchdog/10-21swapper/122:46:511
169940,0watchdog/10-21swapper/100:01:511
149940,0migration/09811-21irqstats22:56:510
149940,0migration/05268-21cpuspeed_turbos22:36:430
149940,0migration/028677-21latency_hist19:51:310
149940,0migration/024893-21aten_r1power_vo00:36:450
149940,0migration/024850-21if_eth1.323:41:490
149940,0migration/023496-21taskset22:07:350
149940,0migration/022101-21kthreadcore21:31:510
149940,0migration/021315-21ksmtuned22:43:500
149940,0migration/015084-21kthreadcore22:21:500
329930,0watchdog/30-21swapper/320:26:343
329930,0watchdog/30-21swapper/320:11:503
329930,0watchdog/30-21swapper/320:06:343
31789932,0cyclictest876-21awk19:31:482
31789932,0cyclictest3571-21lldpd20:01:312
31789932,0cyclictest3524-21snmpd20:40:312
31789932,0cyclictest22832-21awk20:31:492
31789930,0cyclictest1080-21perl21:01:452
31779932,0cyclictest931-21awk19:31:481
31779932,0cyclictest10252-21kthreadcore22:36:491
31769933,0cyclictest0-21swapper/023:25:540
31769932,0cyclictest3777-21sh23:27:000
31769932,0cyclictest3250-21irqbalance20:16:480
31769932,0cyclictest18319-21awk23:01:490
31769932,0cyclictest16147-21grep20:26:490
31769932,0cyclictest12358-21sensors23:31:550
31769932,0cyclictest0-21swapper/020:21:500
31769930,0cyclictest31557-21cat22:51:320
31769930,0cyclictest28902-21cut21:16:500
31769930,0cyclictest14562-21diskmemload23:38:110
29805030,0irq/28-eth0-rx-0-21swapper/320:16:453
29805030,0irq/28-eth0-rx-0-21swapper/319:21:473
259930,0migration/226542-21irqcore20:11:492
249930,0watchdog/20-21swapper/220:56:462
179930,0migration/120582-21aten_r1power_en23:21:421
169930,0watchdog/16314-21runrttasks20:57:341
169930,0watchdog/10-21swapper/121:31:541
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional