You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-10-16 - 13:43

Intel(R) Xeon(R) CPU E3-1220L V2 @ 2.30GHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #a, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 100 highest latencies:
System rackaslot0.osadl.org (updated Sat Oct 16, 2021 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
293652870,1sleep329363-21sshd22:12:173
255842780,0sleep20-21swapper/222:02:472
233202660,1sleep10-21swapper/100:13:021
216392610,0sleep20-21swapper/222:39:242
226942600,6sleep03-21ksoftirqd/022:36:220
327242580,1sleep00-21swapper/023:32:470
182272570,0sleep118222-21apache_accesses23:25:191
313792550,0sleep30-21swapper/322:00:153
253942540,1sleep20-21swapper/222:49:012
302332530,1sleep330234-21cpuspeed_turbos22:40:133
2614025325,9sleep10-21swapper/119:09:481
2586425330,19sleep00-21swapper/019:06:170
211932530,0sleep30-21swapper/322:36:123
2606825226,8sleep30-21swapper/319:08:533
30292510,0sleep00-21swapper/000:18:410
209472510,0sleep30-21swapper/323:19:283
209472510,0sleep30-21swapper/323:19:283
2599925025,21sleep20-21swapper/219:08:012
150902500,1sleep30-21swapper/322:07:523
94072490,1sleep326414-21cyclictest23:24:273
301282490,0sleep10-21swapper/121:44:441
129372490,0sleep10-21swapper/122:13:521
230072480,0sleep11785-21runrttasks22:42:401
23812470,0sleep00-21swapper/023:14:390
261052460,2sleep02641699cyclictest21:50:230
117342440,0sleep00-21swapper/023:27:420
272402420,0sleep30-21swapper/300:16:323
159692240,0sleep30-21swapper/322:20:183
298862230,1sleep229883-21bash00:07:342
26419992217,1cyclictest119950irq/25-eth023:47:183
2641999220,10cyclictest563-21sshd23:51:053
26418992220,1cyclictest0-21swapper/200:00:062
2641999210,20cyclictest0-21swapper/321:55:343
2641999200,1cyclictest0-21swapper/321:15:423
2641999200,15cyclictest0-21swapper/323:44:193
26416992018,1cyclictest9800-21sshd21:42:440
80512190,0sleep219123-21diskmemload21:39:312
2641999190,14cyclictest7587-21cp21:36:213
26417991918,1cyclictest26862-21sshd00:16:271
26416991917,1cyclictest14521-21sshd00:25:510
153942190,1sleep315396-21bash22:29:313
2641999187,8cyclictest0-21swapper/323:29:043
2641999181,1cyclictest119950irq/25-eth023:31:103
2641999181,1cyclictest0-21swapper/321:43:583
2641999181,1cyclictest0-21swapper/321:29:513
26419991810,7cyclictest8372-21cp23:57:543
2641999180,17cyclictest12683-21sshd22:50:473
2641999180,14cyclictest0-21swapper/321:50:033
2641999180,10cyclictest320-21sshd00:27:383
2641999180,10cyclictest23390-21sshd23:01:063
2641799186,11cyclictest30247-21kworker/1:123:52:421
26417991813,2cyclictest25523-21kworker/1:200:32:221
2641699188,9cyclictest22713-21sshd21:16:220
2641999178,6cyclictest0-21swapper/322:33:163
2641999178,4cyclictest119950irq/25-eth021:34:533
2641999172,1cyclictest30333-21sshd21:23:163
2641999171,2cyclictest0-21swapper/323:38:013
2641999171,15cyclictest0-21swapper/322:46:403
2641999171,11cyclictest0-21swapper/300:05:133
2641999170,9cyclictest6412-21ls21:45:273
2641999170,1cyclictest0-21swapper/321:14:103
2641999170,13cyclictest0-21swapper/300:14:383
2641699179,7cyclictest0-21swapper/022:11:030
2641699174,10cyclictest3-21ksoftirqd/023:46:170
26416991712,4cyclictest3-21ksoftirqd/021:39:560
26416991712,4cyclictest3-21ksoftirqd/000:39:060
245222170,1sleep024518-21bash22:45:480
2641999161,1cyclictest0-21swapper/322:15:533
2641999160,2cyclictest0-21swapper/323:06:163
2641999160,2cyclictest0-21swapper/300:00:303
2641999160,1cyclictest31285-21sshd00:21:243
2641999160,15cyclictest7675-21sshd22:56:303
2641999160,15cyclictest17178-21sshd00:30:443
2641999160,15cyclictest0-21swapper/323:10:233
2641999160,15cyclictest0-21swapper/300:35:283
2641699169,3cyclictest10046-21sshd22:19:500
2641699168,4cyclictest0-21swapper/000:05:060
2641699168,3cyclictest19766-21sshd23:52:550
2641699164,2cyclictest3-21ksoftirqd/021:47:300
26416991614,1cyclictest3-21ksoftirqd/000:13:020
26416991614,1cyclictest10-21rcuc/022:24:070
26416991612,3cyclictest3-21ksoftirqd/022:09:200
26416991611,4cyclictest3-21ksoftirqd/023:39:340
2641799159,2cyclictest0-21swapper/122:33:321
26417991514,1cyclictest27228-21kworker/1:023:31:101
26417991514,1cyclictest21-21ksoftirqd/122:21:051
26417991512,2cyclictest12786-21kworker/1:121:36:251
26417991512,1cyclictest19116-21kworker/1:221:31:531
26417991510,1cyclictest18376-21kworker/1:221:55:251
2641799150,14cyclictest0-21swapper/121:50:561
2641699159,3cyclictest0-21swapper/021:13:290
2641699158,3cyclictest881-21sshd00:21:360
2641699154,11cyclictest3-21ksoftirqd/000:02:340
26416991514,1cyclictest3-21ksoftirqd/022:42:330
26416991514,1cyclictest3-21ksoftirqd/022:30:450
26416991513,2cyclictest3-21ksoftirqd/023:22:440
26416991513,1cyclictest3-21ksoftirqd/023:40:080
26416991513,1cyclictest3-21ksoftirqd/023:18:370
26416991513,1cyclictest3-21ksoftirqd/023:18:370
26416991513,1cyclictest3-21ksoftirqd/023:01:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional