You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-06-20 - 03:34

Intel(R) Xeon(R) CPU E31220L @ 2.20GHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #5, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 100 highest latencies:
System rack5slot0.osadl.org (updated Sun Jun 20, 2021 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2876021410,1sleep028752-21sshd21:59:540
2876021410,1sleep028752-21sshd21:59:530
2695229632,60sleep30-21swapper/319:06:423
118512950,1sleep00-21swapper/022:36:050
203912910,0sleep00-21swapper/000:35:490
77032900,3sleep10-21swapper/100:38:591
253772850,1sleep30-21swapper/323:12:303
305272840,1sleep041ktimersoftd/023:03:280
220462840,2sleep10-21swapper/122:37:411
46202830,2sleep10-21swapper/123:04:311
2719728333,47sleep10-21swapper/119:09:441
140362810,1sleep00-21swapper/022:41:170
57202800,2sleep30-21swapper/300:23:513
145372790,2sleep30-21swapper/323:45:243
234412770,2sleep31876-21nfsd21:49:223
306992760,1sleep11873-21nfsd21:40:401
49992740,2sleep10-21swapper/100:28:401
26722740,0sleep00-21swapper/023:09:050
148282740,2sleep20-21swapper/200:25:142
101042740,1sleep02121-21runrttasks19:40:230
180512730,4sleep32740199cyclictest21:24:343
18852720,1sleep20-21swapper/220:35:212
323102680,0sleep00-21swapper/000:32:490
2708826735,12sleep20-21swapper/219:08:242
21572650,1sleep10-21swapper/100:23:161
231092640,2sleep02739199cyclictest21:20:230
2700025934,13sleep00-21swapper/019:07:190
123282580,0sleep00-21swapper/021:33:170
271442290,1sleep00-21swapper/023:22:410
54102281,25sleep2138550irq/27-eth021:37:012
26962280,26sleep2138550irq/27-eth021:46:102
286592270,25sleep228750irq/26-ahci[00021:50:112
2739199272,14cyclictest0-21swapper/000:01:200
289022250,2sleep32121-21runrttasks00:12:293
24032250,2sleep31876-21nfsd22:10:233
24032250,2sleep31876-21nfsd22:10:233
4812240,2sleep30-21swapper/323:58:173
2740099248,9cyclictest138550irq/27-eth022:47:292
2740099247,10cyclictest1987-21sshd21:25:352
2740099230,16cyclictest0-21swapper/223:48:102
2740099228,12cyclictest27069-21sshd21:30:312
2740099227,13cyclictest10183-21sshd21:13:492
2740099226,2cyclictest0-21swapper/222:57:372
2740099226,2cyclictest0-21swapper/222:33:422
2740099224,2cyclictest0-21swapper/221:22:112
2740099223,9cyclictest0-21swapper/200:13:382
2740099220,5cyclictest0-21swapper/221:17:532
2740099220,16cyclictest0-21swapper/200:05:422
162952220,20sleep2138550irq/27-eth023:55:382
6122210,19sleep2138550irq/27-eth023:33:292
52322210,2sleep25230-21bash23:24:192
2740099218,11cyclictest30007-21sshd23:42:552
2740099218,11cyclictest19075-21sshd23:36:082
2740099218,11cyclictest15415-21sshd22:02:392
2740099218,11cyclictest15096-21sshd22:41:282
2740099213,2cyclictest0-21swapper/222:52:542
2740099212,14cyclictest613-21id22:24:492
2740099212,10cyclictest0-21swapper/222:38:482
2740099211,1cyclictest0-21swapper/221:40:332
2740099210,2cyclictest0-21swapper/222:27:362
2740099210,19cyclictest0-21swapper/200:16:552
2740099208,9cyclictest138550irq/27-eth000:36:102
2740099208,6cyclictest0-21swapper/219:21:182
2740099208,10cyclictest4565-21sshd22:15:282
2740099208,10cyclictest2444-21sshd23:09:042
2740099208,10cyclictest13798-21sshd22:12:062
2740099208,10cyclictest13798-21sshd22:12:052
2740099207,11cyclictest1794-21hald-addon-acpi19:13:502
2740099200,9cyclictest0-21swapper/223:11:202
2740099200,6cyclictest0-21swapper/221:57:482
2740099200,6cyclictest0-21swapper/221:57:482
2740099200,4cyclictest0-21swapper/200:22:002
2740099200,2cyclictest0-21swapper/200:30:202
2740099200,18cyclictest0-21swapper/221:05:312
251042200,2sleep325105-21id22:28:263
101512200,3sleep12739799cyclictest23:44:531
2740099197,10cyclictest15158-21sshd23:25:392
2740099194,5cyclictest10844-21sshd23:54:572
2740099190,9cyclictest0-21swapper/223:01:372
2740099190,9cyclictest0-21swapper/220:25:152
2740099190,9cyclictest0-21swapper/219:35:162
2740099190,8cyclictest0-21swapper/219:46:042
2740099190,2cyclictest0-21swapper/223:16:192
2740099190,2cyclictest0-21swapper/219:30:172
2740099190,2cyclictest0-21swapper/200:03:182
212442190,3sleep30-21swapper/322:03:333
3472180,3sleep10-21swapper/123:53:191
2740099188,9cyclictest1877-21nfsd20:08:162
2740099181,8cyclictest0-21swapper/222:05:112
2740099181,1cyclictest0-21swapper/220:01:002
2740099180,9cyclictest0-21swapper/220:10:152
2740099180,9cyclictest0-21swapper/219:26:482
2740099180,8cyclictest0-21swapper/220:47:012
2740099180,8cyclictest0-21swapper/220:30:352
2740099180,1cyclictest0-21swapper/221:00:472
2740099180,1cyclictest0-21swapper/220:55:272
2740099180,1cyclictest0-21swapper/219:43:272
2740099180,17cyclictest0-21swapper/220:15:302
2740099180,17cyclictest0-21swapper/219:55:302
260722180,0sleep00-21swapper/023:32:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional