You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-09-17 - 21:30

Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, Linux 4.19.127-rt55 (Profile)

Latency plot of system in rack #c, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 100 highest latencies:
System rackcslot0.osadl.org (updated Fri Sep 17, 2021 00:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
171312136119,12sleep140-21swapper/1419:12:156
861021340,1sleep20-21swapper/200:36:288
258021320,0sleep10-21swapper/123:48:501
1174821310,1sleep120-21swapper/1200:33:094
2585121300,3sleep141765999cyclictest21:55:226
2091121150,2sleep131201rcuc/1322:29:195
740321130,0sleep40-21swapper/421:41:3310
1759021130,6sleep61764799cyclictest22:40:2612
17144211392,16sleep90-21swapper/919:12:2615
721821100,1sleep110-21swapper/1121:18:403
721821100,1sleep110-21swapper/1121:18:403
1718821100,1sleep110-21swapper/1121:31:143
16957211093,13sleep70-21swapper/719:10:3113
1335621080,6sleep131765899cyclictest21:23:155
16938210792,11sleep60-21swapper/619:10:1412
478221060,1sleep150-21swapper/1521:41:127
3040021060,0sleep20-21swapper/223:25:028
3040021060,0sleep20-21swapper/223:25:028
960621040,1sleep100-21swapper/1022:00:552
587421030,1sleep140-21swapper/1423:26:036
587421030,1sleep140-21swapper/1423:26:036
1480221030,0sleep150-21swapper/1522:09:017
3167721020,1sleep90-21swapper/923:29:1015
3167721020,1sleep90-21swapper/923:29:1015
2317521010,1sleep120-21swapper/1221:35:484
789021000,1sleep60-21swapper/623:45:2612
243421000,1sleep140-21swapper/1400:12:516
174321000,1sleep00-21swapper/021:59:560
325942970,1sleep100-21swapper/1021:48:202
45612960,1sleep130-21swapper/1323:41:165
29592960,1sleep140-21swapper/1423:44:466
286042960,1sleep20-21swapper/222:03:118
69482950,1sleep140-21swapper/1421:48:566
239632950,2sleep125-21ksoftirqd/122:18:091
286402940,3sleep81765099cyclictest21:43:4514
109352920,0sleep20-21swapper/222:04:318
221692910,0sleep110-21swapper/1121:24:013
161192910,0sleep30-21swapper/300:25:319
1692029079,3sleep50-21swapper/519:09:5711
164832900,0sleep150-21swapper/1500:14:137
1687828981,4sleep40-21swapper/419:09:2410
1687628872,4sleep20-21swapper/219:09:228
237952870,0sleep00-21swapper/022:18:080
1713428772,11sleep00-21swapper/019:12:170
270272860,0sleep20-21swapper/200:42:218
163052860,0sleep120-21swapper/1200:06:084
1695328468,12sleep30-21swapper/319:10:279
220462830,1sleep140-21swapper/1423:39:256
1706428375,4sleep10-21swapper/119:12:021
1700228375,4sleep130-21swapper/1319:11:095
1698728375,4sleep150-21swapper/1519:10:557
1685428375,4sleep120-21swapper/1219:09:164
1716028274,4sleep80-21swapper/819:12:4114
1688428274,4sleep100-21swapper/1019:09:302
124352820,0sleep140-21swapper/1422:59:186
1688528072,4sleep110-21swapper/1119:09:313
137382790,0sleep80-21swapper/823:11:3014
196702770,3sleep41764599cyclictest22:40:4010
73772710,5sleep71764899cyclictest21:15:0713
73772710,5sleep71764899cyclictest21:15:0713
241292530,1sleep90-21swapper/921:24:1515
100462530,2sleep30-21swapper/322:35:509
65662490,0sleep140-21swapper/1400:04:506
285142420,1sleep120-21swapper/1221:32:514
1766099426,29cyclictest23252-21systemd22:21:557
1766099412,33cyclictest0-21swapper/1521:45:587
17660994120,18cyclictest512-21systemd-journal23:45:027
17660994116,19cyclictest0-21swapper/1522:25:007
1766099407,26cyclictest969-21dbus-daemon23:30:517
1766099407,26cyclictest969-21dbus-daemon23:30:517
17660994018,14cyclictest27914-21sshd21:13:467
17660994018,14cyclictest27914-21sshd21:13:467
210392390,5sleep81765099cyclictest23:23:4814
210392390,5sleep81765099cyclictest23:23:4814
1766099397,24cyclictest3292-21systemd23:53:097
1766099395,25cyclictest0-21swapper/1523:40:477
1766099392,32cyclictest0-21swapper/1521:54:377
1766099390,31cyclictest0-21swapper/1523:34:237
1766099390,31cyclictest0-21swapper/1523:34:237
1766099386,25cyclictest0-21swapper/1522:03:547
1766099384,26cyclictest0-21swapper/1500:38:547
1766099384,25cyclictest1-21systemd00:34:417
1766099384,25cyclictest0-21swapper/1521:20:397
1766099384,25cyclictest0-21swapper/1521:20:397
1766099381,30cyclictest0-21swapper/1521:23:567
1766099380,31cyclictest0-21swapper/1523:06:337
1766099377,23cyclictest14461-21systemd-cgroups23:19:117
1766099377,23cyclictest14461-21systemd-cgroups23:19:117
1766099376,24cyclictest1-21systemd00:07:477
1766099376,24cyclictest1-21systemd00:00:247
1766099373,26cyclictest969-21dbus-daemon22:45:147
1766099373,26cyclictest0-21swapper/1522:43:077
17660993716,19cyclictest97850irq/41-eth0-TxR22:13:157
1766099365,22cyclictest29577-21sshd00:23:167
1766099365,22cyclictest1-21systemd00:09:217
1766099364,29cyclictest13972-21systemd22:55:497
1766099364,25cyclictest26608-21systemd-cgroups22:33:507
1766099364,20cyclictest0-21swapper/1521:30:447
1766099363,26cyclictest0-21swapper/1500:31:037
1766099363,24cyclictest0-21swapper/1523:57:107
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional