You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-05-27 - 17:21

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.4.229-rt200 (Profile)

Latency plot of system in rack #1, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a -t3 -p99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack1slot2.osadl.org (updated Fri May 27, 2022 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
141323930,0sleep30-21swapper/306:56:443
109423725,0sleep20-21swapper/206:53:032
137223526,0sleep10-21swapper/106:56:181
126323028,0sleep00-21swapper/006:55:010
339960,0migration/37209-21sh12:19:463
339960,0migration/3560-21sh11:24:193
339960,0migration/3515-21sh07:37:293
339960,0migration/34380-21sh11:08:163
339960,0migration/329485-21sh09:38:313
339960,0migration/328899-21sh09:04:113
339960,0migration/321641-21sh09:36:313
339960,0migration/318471-21munin-node09:17:223
339960,0migration/314190-21timerandwakeup09:12:323
339960,0migration/312527-21sh10:04:573
329960,0watchdog/321308-21python10:42:283
28015060,0irq/29-eth0-tx-8991-21munin-node07:02:260
28005060,0irq/28-eth0-rx-27493-21seq11:03:383
28005060,0irq/28-eth0-rx-18540-21grep08:57:323
28005060,0irq/28-eth0-rx-11660-21ntpdc10:37:243
28005060,0irq/28-eth0-rx-0-21swapper/310:36:453
15199960,0cyclictest0-21swapper/211:39:552
15199960,0cyclictest0-21swapper/209:15:112
15199960,0cyclictest0-21swapper/207:52:062
15119960,0cyclictest0-21swapper/007:57:310
149960,0migration/06562-21sh11:45:390
149960,0migration/027915-21fschecks_count09:57:160
149960,0migration/015936-21munin-node10:42:180
8315050,0irq/26-0000:00:2383-21kauditd07:47:052
339950,0migration/3943-21latency09:57:223
339950,0migration/37785-21ntp_kernel_pll_06:57:253
339950,0migration/37695-21kthreadcore08:52:243
339950,0migration/332428-21latency08:22:233
339950,0migration/330202-21latency_hist08:02:053
339950,0migration/330202-21latency_hist08:02:053
339950,0migration/326280-21latency_hist11:57:043
339950,0migration/324474-21kthreadcore10:27:223
339950,0migration/323838-21fschecks_time07:57:193
339950,0migration/322239-21kthreadcore08:17:233
339950,0migration/321447-21kthreadcore09:52:223
339950,0migration/319295-21kthreadcore08:37:223
339950,0migration/317288-21kthreadcore08:12:233
339950,0migration/31695-21kthreadcore09:07:233
329950,0watchdog/39568-21latency_hist10:22:043
329950,0watchdog/31483-21ssh09:24:003
329950,0watchdog/31324-21tr08:47:253
329950,0watchdog/30-21swapper/312:07:153
329950,0watchdog/30-21swapper/311:32:163
329950,0watchdog/30-21swapper/310:57:163
28015050,0irq/29-eth0-tx-6121-21ssh11:44:492
28015050,0irq/29-eth0-tx-5620-21sensors_temp09:42:272
28015050,0irq/29-eth0-tx-5213-21ssh10:36:592
28015050,0irq/29-eth0-tx-4027-21kthreadcore12:17:222
28015050,0irq/29-eth0-tx-28681-21tr10:12:232
28015050,0irq/29-eth0-tx-22279-21idleruntime09:02:192
28015050,0irq/29-eth0-tx-2137-21kthreadcore11:07:222
28015050,0irq/29-eth0-tx-19124-21ssh09:52:202
28015050,0irq/29-eth0-tx-10085-21ssh10:56:152
28015050,0irq/29-eth0-tx-0-21swapper/212:22:202
28015050,0irq/29-eth0-tx-0-21swapper/211:55:392
28015050,0irq/29-eth0-tx-0-21swapper/007:42:320
28015050,0irq/29-eth0-tx-0-21swapper/007:14:140
28005050,0irq/28-eth0-rx-6452-21iostat_ios07:22:233
28005050,0irq/28-eth0-rx-32000-21cut11:42:203
28005050,0irq/28-eth0-rx-19667-21cut11:17:233
28005050,0irq/28-eth0-rx-19424-21kthreadcore10:07:223
28005050,0irq/28-eth0-rx-13013-21cut07:27:173
28005050,0irq/28-eth0-rx-0-21swapper/312:12:233
28005050,0irq/28-eth0-rx-0-21swapper/311:52:173
28005050,0irq/28-eth0-rx-0-21swapper/311:47:213
28005050,0irq/28-eth0-rx-0-21swapper/311:38:383
28005050,0irq/28-eth0-rx-0-21swapper/311:27:203
28005050,0irq/28-eth0-rx-0-21swapper/311:12:273
28005050,0irq/28-eth0-rx-0-21swapper/310:52:053
28005050,0irq/28-eth0-rx-0-21swapper/310:23:323
28005050,0irq/28-eth0-rx-0-21swapper/310:12:233
28005050,0irq/28-eth0-rx-0-21swapper/309:30:543
28005050,0irq/28-eth0-rx-0-21swapper/307:12:233
259950,0migration/2602-21unixbench_multi09:22:332
259950,0migration/24039-21sh10:01:432
259950,0migration/232004-21kthreadcore08:47:242
259950,0migration/226511-21kthreadcore10:47:212
249950,0watchdog/24309-21memory09:07:242
249950,0watchdog/227618-21ps11:57:202
179950,0migration/14111-21fschecks_time12:02:171
179950,0migration/131054-21gltestperf08:47:201
179950,0migration/128579-21kthreadcore08:42:241
179950,0migration/120679-21kernelversion10:27:211
179950,0migration/114191-21sh11:14:041
179950,0migration/113621-21kthreadcore11:32:211
169950,0watchdog/19563-21latency_hist10:22:041
169950,0watchdog/127625-21cut11:57:201
169950,0watchdog/118884-21date10:27:041
15199955,0cyclictest31726-21kworker/2:112:07:232
15199955,0cyclictest0-21swapper/210:07:222
15199955,0cyclictest0-21swapper/209:36:382
15199954,0cyclictest31726-21kworker/2:111:47:552
15199954,0cyclictest31726-21kworker/2:110:25:052
15199954,0cyclictest31726-21kworker/2:107:17:222
15199950,0cyclictest0-21swapper/210:42:132
15199950,0cyclictest0-21swapper/210:19:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional