You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-31 - 05:45

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.4.229-rt200 (Profile)

Latency plot of system in rack #1, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a -t3 -p99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100, highest latencies:
System rack1slot2.osadl.org (updated Fri Mar 31, 2023 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3021723728,0sleep20-21swapper/218:16:442
3040623627,0sleep30-21swapper/318:18:533
3044923026,0sleep00-21swapper/018:19:260
3026922925,0sleep10-21swapper/118:17:191
4160,0ktimersoftd/00-21swapper/019:05:070
339960,0migration/34947-21sh23:49:113
339960,0migration/332403-21munin-node23:09:583
339960,0migration/328206-21taskset22:13:573
339960,0migration/325632-21sh23:24:393
339960,0migration/32214-21sh20:58:253
339960,0migration/315182-21sh21:23:033
305419966,0cyclictest30373-21kthreadcore23:25:021
305419960,0cyclictest1925-21diskmemload21:39:431
305419960,0cyclictest0-21swapper/121:26:381
28005060,0irq/28-eth0-rx-13993-21kthreadcore20:44:583
149960,0migration/06072-21taskset21:17:560
149960,0migration/023657-21sh21:52:360
149960,0migration/021796-21sh22:26:140
339950,0migration/39265-21taskset19:39:103
339950,0migration/39080-21taskset18:49:513
339950,0migration/35903-21latency_hist19:14:403
339950,0migration/35069-21fschecks_count20:24:543
339950,0migration/328658-21munin-node19:29:563
339950,0migration/32815-21idleruntime18:44:563
339950,0migration/327908-21df_abs22:49:553
339950,0migration/323811-21dump-pmu-power19:04:403
339950,0migration/323288-21kthreadcore23:40:023
339950,0migration/321363-21idleruntime19:24:553
339950,0migration/318603-21munin-node18:30:113
339950,0migration/313366-21kthreadcore23:34:573
339950,0migration/311157-21fschecks_count22:04:533
329950,0watchdog/319415-21sensors19:20:033
329950,0watchdog/312180-21ssh21:04:393
329950,0watchdog/310440-21sh21:01:193
329950,0watchdog/30-21swapper/321:14:553
329950,0watchdog/30-21swapper/319:49:593
305429955,0cyclictest0-21swapper/223:21:352
305429955,0cyclictest0-21swapper/221:46:592
305429955,0cyclictest0-21swapper/221:00:192
305429954,0cyclictest28590-21sed20:14:572
305429954,0cyclictest14023-21lldpd18:50:422
305429950,0cyclictest0-21swapper/222:53:122
305429950,0cyclictest0-21swapper/221:56:082
305419955,0cyclictest0-21swapper/122:59:011
305419955,0cyclictest0-21swapper/122:28:171
305419955,0cyclictest0-21swapper/121:53:261
305419955,0cyclictest0-21swapper/119:05:031
305419950,0cyclictest0-21swapper/123:45:511
305419950,0cyclictest0-21swapper/123:41:541
305419950,0cyclictest0-21swapper/122:35:411
305419950,0cyclictest0-21swapper/121:09:361
305419950,0cyclictest0-21swapper/120:58:151
305409955,0cyclictest1925-21diskmemload23:09:480
305409950,0cyclictest0-21swapper/022:52:460
305409950,0cyclictest0-21swapper/022:39:410
28015050,0irq/29-eth0-tx-6793-21cut21:35:162
28015050,0irq/29-eth0-tx-6366-21needreboot22:35:032
28015050,0irq/29-eth0-tx-4090-21grep23:30:062
28015050,0irq/29-eth0-tx-31612-21iostat21:14:562
28015050,0irq/29-eth0-tx-23232-21perl20:34:532
28015050,0irq/29-eth0-tx-19948-21munin-node18:35:010
28015050,0irq/29-eth0-tx-13072-21munin-node20:04:520
28015050,0irq/29-eth0-tx-11033-21yum22:55:162
28015050,0irq/29-eth0-tx-10920-21python20:25:062
28015050,0irq/29-eth0-tx-0-21swapper/223:48:582
28015050,0irq/29-eth0-tx-0-21swapper/223:04:572
28015050,0irq/29-eth0-tx-0-21swapper/222:08:402
28015050,0irq/29-eth0-tx-0-21swapper/220:59:082
28005050,0irq/28-eth0-rx-9778-21ssh23:32:063
28005050,0irq/28-eth0-rx-8424-21ssh22:38:093
28005050,0irq/28-eth0-rx-24598-21open_files22:45:013
28005050,0irq/28-eth0-rx-22428-21ssh21:49:533
28005050,0irq/28-eth0-rx-19460-21ntp_kernel_pll_21:45:013
28005050,0irq/28-eth0-rx-1906-21ssh21:59:533
28005050,0irq/28-eth0-rx-14564-21ssh22:24:433
28005050,0irq/28-eth0-rx-0-21swapper/323:19:393
28005050,0irq/28-eth0-rx-0-21swapper/323:05:013
28005050,0irq/28-eth0-rx-0-21swapper/322:59:483
28005050,0irq/28-eth0-rx-0-21swapper/322:55:023
28005050,0irq/28-eth0-rx-0-21swapper/322:31:223
28005050,0irq/28-eth0-rx-0-21swapper/322:19:513
28005050,0irq/28-eth0-rx-0-21swapper/322:14:573
28005050,0irq/28-eth0-rx-0-21swapper/321:55:063
28005050,0irq/28-eth0-rx-0-21swapper/321:35:023
28005050,0irq/28-eth0-rx-0-21swapper/321:27:503
28005050,0irq/28-eth0-rx-0-21swapper/321:09:423
28005050,0irq/28-eth0-rx-0-21swapper/320:53:163
28005050,0irq/28-eth0-rx-0-21swapper/320:39:423
28005050,0irq/28-eth0-rx-0-21swapper/320:34:583
259950,0migration/231821-21munin-node21:30:082
259950,0migration/227858-21sh22:13:112
259950,0migration/226694-21taskset22:48:292
259950,0migration/225132-21kthreadcore23:40:022
259950,0migration/219449-21switchtime19:20:062
259950,0migration/214741-21kthreadcore21:04:582
259950,0migration/213339-21kthreadcore23:15:032
259950,0migration/212058-21hddtemp_smartct23:34:532
249950,0watchdog/235872chrt20:23:112
249950,0watchdog/20-21swapper/221:24:392
179950,0migration/18080-21kthreadcore23:30:071
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional