You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 00:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot2.osadl.org (updated Fri Apr 26, 2024 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1372023928,0sleep30-21swapper/306:52:353
1355723624,0sleep00-21swapper/006:50:400
1389723523,0sleep10-21swapper/106:54:371
1372423425,0sleep20-21swapper/206:52:382
13976991010,0cyclictest25754-21sensors10:50:051
339960,0migration/39587-21cpuspeed_turbos10:24:493
339960,0migration/38813-21sh11:55:403
339960,0migration/36750-21sh10:01:583
339960,0migration/330599-21kthreadcore10:35:023
339960,0migration/326085-21latency_hist10:34:373
339960,0migration/320879-21sh09:50:043
339960,0migration/320879-21sh09:50:043
329960,0watchdog/39129-21awk10:40:063
29925060,0irq/32-eth0-rx-27241-21sleep08:59:383
29925060,0irq/32-eth0-rx-25765-21sensors10:50:053
149960,0migration/032370-21kthreadcore08:40:010
149960,0migration/021165-21sh12:23:090
149960,0migration/017834-21kthreadcore11:24:580
139769960,0cyclictest0-21swapper/111:44:051
339950,0migration/36561-21fschecks_time11:19:533
339950,0migration/36260-21kthreadcore12:14:593
339950,0migration/3571-21taskset07:50:013
339950,0migration/35519-21kthreadcore08:19:573
339950,0migration/35108-21munin-node08:44:503
339950,0migration/34584-21kthreadcore07:30:043
339950,0migration/332381-21kthreadcore09:00:013
339950,0migration/331125-21kthreadcore08:14:543
339950,0migration/330142-21taskset11:14:543
339950,0migration/329806-21munin-node09:19:563
339950,0migration/328482-21diskmemload11:12:393
339950,0migration/323836-21kthreadcore07:00:003
339950,0migration/320495-21sh09:31:013
339950,0migration/318091-21latency_hist08:04:383
339950,0migration/317579-21sh12:00:463
339950,0migration/314047-21kthreadcore11:04:553
339950,0migration/311756-21if_eth107:14:563
329950,0watchdog/330204-21basename09:39:463
329950,0watchdog/325874-21perl07:24:513
329950,0watchdog/323694-21interrupts08:34:543
329950,0watchdog/322792-21iostat_ios07:44:553
329950,0watchdog/311032-21ssh09:07:503
329950,0watchdog/310002-21ntp_states11:00:023
329950,0watchdog/30-21swapper/312:09:503
29935050,0irq/33-eth0-tx-23156-21munin-node09:54:562
29935050,0irq/33-eth0-tx-11463-21fschecks_time11:59:492
29935050,0irq/33-eth0-tx-0-21swapper/209:13:442
29935050,0irq/33-eth0-tx-0-21swapper/008:54:560
29935050,0irq/33-eth0-tx-0-21swapper/008:01:480
29935050,0irq/33-eth0-tx-0-21swapper/007:56:470
29935050,0irq/33-eth0-tx-0-21swapper/007:10:110
29925050,0irq/32-eth0-rx-9025-21if_err_eth011:39:523
29925050,0irq/32-eth0-rx-877-21ssh10:19:483
29925050,0irq/32-eth0-rx-8683-21fschecks_time10:04:543
29925050,0irq/32-eth0-rx-29419-21kthreadcore11:49:563
29925050,0irq/32-eth0-rx-28478-21kthreadcore10:14:583
29925050,0irq/32-eth0-rx-23259-21cat11:45:073
29925050,0irq/32-eth0-rx-21412-21ssh12:23:493
29925050,0irq/32-eth0-rx-20882-21kthreadcore10:09:573
29925050,0irq/32-eth0-rx-0-21swapper/312:08:243
29925050,0irq/32-eth0-rx-0-21swapper/310:58:103
29925050,0irq/32-eth0-rx-0-21swapper/309:55:023
29925050,0irq/32-eth0-rx-0-21swapper/309:39:293
29925050,0irq/32-eth0-rx-0-21swapper/309:25:153
27150,0ktimersoftd/20-21swapper/211:55:072
259950,0migration/27072-21sh11:38:012
259950,0migration/231143-21kthreadcore11:14:592
249950,0watchdog/20-21swapper/212:09:502
19150,0ktimersoftd/10-21swapper/111:55:071
179950,0migration/18528-21kthreadcore09:24:581
179950,0migration/16632-21kthreadcore10:59:581
179950,0migration/130842-21kthreadcore12:09:551
179950,0migration/129962-21kthreadcore07:24:561
179950,0migration/128450-21taskset07:48:181
179950,0migration/123120-21sh09:54:391
179950,0migration/118521-21sh10:47:451
179950,0migration/11623-21kthreadcore08:40:011
179950,0migration/11614-21munin-node10:55:031
179950,0migration/114481-21aten_r1power_po11:24:491
179950,0migration/114123-21kthreadcore11:59:561
169950,0watchdog/18216-21df_abs10:04:501
169950,0watchdog/14283-21fschecks_time07:09:511
149950,0migration/07788-21kthreadcore12:14:590
149950,0migration/06934-21latency10:20:000
149950,0migration/05432-21kthreadcore11:54:590
149950,0migration/0523-21taskset11:52:120
149950,0migration/03846-21sh10:59:440
149950,0migration/03281-21latency_hist07:09:380
149950,0migration/031755-21kthreadcore08:14:540
149950,0migration/029443-21sh09:38:220
149950,0migration/028345-21kthreadcore10:35:010
149950,0migration/027441-21sh12:08:460
149950,0migration/025095-21kthreadcore07:00:010
149950,0migration/024355-21sendmail_mailqu08:05:050
149950,0migration/023698-21kthreadcore11:09:590
149950,0migration/021671-21kthreadcore07:20:040
149950,0migration/020580-21munin-node10:49:550
149950,0migration/020161-21munin-node07:40:010
149950,0migration/019676-21kthreadcore08:29:560
149950,0migration/017883-21irqrtprio10:09:560
149950,0migration/014999-21taskset08:28:560
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional