You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-09-27 - 06:41

Intel(R) Atom(TM) CPU E3845 @ 1.91GHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 100 highest latencies:
System rackdslot1.osadl.org (updated Mon Sep 27, 2021 00:46:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1146911760,16ptp4l0-21swapper/219:07:382
1146911750,13ptp4l0-21swapper/019:06:260
1802421680,7sleep12243799cyclictest21:40:331
1146911660,15ptp4l0-21swapper/319:08:523
157621650,5sleep22243899cyclictest19:21:022
1146911480,15ptp4l0-21swapper/119:09:451
22437998771,10cyclictest25-21ksoftirqd/121:50:141
22437998072,5cyclictest25-21ksoftirqd/119:10:141
22437997562,7cyclictest25-21ksoftirqd/122:25:161
22437997154,10cyclictest25-21ksoftirqd/123:15:151
2243899699,9cyclictest118791phc2sys20:10:152
22437996946,15cyclictest25-21ksoftirqd/122:10:151
2243899687,14cyclictest4706-21sed23:25:192
114691680,2ptp4l0-21swapper/319:30:043
2243899678,19cyclictest26411-21taskset22:32:492
2243899676,15cyclictest22636-21sed19:10:032
2243899676,14cyclictest19487-21expr20:25:082
2243899674,14cyclictest28204-21sort21:15:132
2243899667,14cyclictest26934-21df_inode23:15:022
2243899666,13cyclictest12917-21sed00:15:172
2243899665,20cyclictest11559-21wc22:55:092
114691660,4ptp4l28271-21acpi00:35:113
114691660,4ptp4l2255-21/usr/sbin/munin20:45:143
2243899656,13cyclictest18836-21if_enp4s023:45:022
2243899656,13cyclictest18836-21if_enp4s023:45:012
22436996530,9cyclictest9-21ksoftirqd/021:35:010
2243899645,13cyclictest7927-21/usr/sbin/munin22:50:122
114691640,4ptp4l15929-21/usr/sbin/munin23:40:131
2243899635,13cyclictest32342-21/usr/sbin/munin20:40:152
114691630,3ptp4l2937-21ls19:25:073
2243899626,19cyclictest16987-21perl23:40:192
2243899626,14cyclictest14455-21latency_hist21:00:002
2243899616,17cyclictest7620-21df_abs19:30:122
2243899615,13cyclictest24045-21df_abs21:50:122
2243699618,7cyclictest9-21ksoftirqd/021:05:060
22436996129,9cyclictest9-21ksoftirqd/019:10:190
2243899605,19cyclictest2847-21ntp_states19:25:082
2243899605,14cyclictest19240-21sed21:05:082
2243699605,7cyclictest9-21ksoftirqd/019:45:070
22436996028,9cyclictest9-21ksoftirqd/021:15:330
114691600,8ptp4l0-21swapper/019:19:010
2243899595,14cyclictest4429-21cpuspeed_turbos21:25:232
2243899595,13cyclictest5097-21cut22:05:222
2243699598,8cyclictest9-21ksoftirqd/022:20:090
2243699597,10cyclictest9-21ksoftirqd/021:50:130
2243699596,9cyclictest9-21ksoftirqd/020:30:200
22436995927,9cyclictest9-21ksoftirqd/023:20:190
22436995925,10cyclictest9-21ksoftirqd/023:35:340
114691590,5ptp4l13809-21/usr/sbin/munin20:55:351
114691590,2ptp4l0-21swapper/323:27:243
114691590,2ptp4l0-21swapper/023:50:180
114691590,2ptp4l0-21swapper/023:50:180
2243899586,9cyclictest23883-21df_abs20:30:122
2243699586,8cyclictest0-21swapper/023:40:060
2243699584,7cyclictest9-21ksoftirqd/020:20:090
2243699584,7cyclictest9-21ksoftirqd/000:30:270
2243699583,7cyclictest9-21ksoftirqd/023:15:260
22436995826,9cyclictest9-21ksoftirqd/021:40:020
22436995826,9cyclictest9-21ksoftirqd/020:40:010
22436995825,9cyclictest9-21ksoftirqd/022:15:260
22436995825,9cyclictest9-21ksoftirqd/020:05:290
22436995825,9cyclictest9-21ksoftirqd/020:05:280
2243699580,8cyclictest101ktimersoftd/022:55:080
114691580,4ptp4l29832-21sendmail_mailqu22:35:301
114691580,2ptp4l0-21swapper/121:05:441
114691580,2ptp4l0-21swapper/120:30:071
2243899570,18cyclictest17742-21/usr/sbin/munin19:40:322
2243699577,9cyclictest9-21ksoftirqd/019:55:060
2243699577,9cyclictest6329-21df19:30:020
2243699576,8cyclictest9-21ksoftirqd/022:40:170
2243699576,7cyclictest9-21ksoftirqd/022:50:010
2243699574,7cyclictest9-21ksoftirqd/023:10:140
2243699574,7cyclictest9-21ksoftirqd/020:55:180
2243699573,7cyclictest9-21ksoftirqd/000:25:270
22436995726,9cyclictest9-21ksoftirqd/019:35:260
22436995725,9cyclictest9-21ksoftirqd/022:10:230
22436995725,9cyclictest9-21ksoftirqd/022:00:190
22436995725,9cyclictest9-21ksoftirqd/019:20:200
22436995725,11cyclictest9-21ksoftirqd/020:50:220
114691570,7ptp4l0-21swapper/023:58:400
114691570,5ptp4l9437-21/usr/sbin/munin22:50:241
114691570,2ptp4l0-21swapper/020:25:170
114691570,1ptp4l0-21swapper/300:18:263
2243699567,9cyclictest9-21ksoftirqd/023:00:090
2243699567,8cyclictest9-21ksoftirqd/019:50:140
2243699567,8cyclictest9-21ksoftirqd/000:20:260
2243699566,9cyclictest9-21ksoftirqd/023:45:060
2243699566,9cyclictest9-21ksoftirqd/023:45:060
2243699566,6cyclictest9-21ksoftirqd/020:15:200
22436995649,4cyclictest9-21ksoftirqd/021:20:140
2243699564,7cyclictest9-21ksoftirqd/021:45:110
2243699563,7cyclictest101ktimersoftd/021:10:010
2243699563,6cyclictest101ktimersoftd/022:50:260
2243699563,6cyclictest101ktimersoftd/022:30:330
2243699562,6cyclictest101ktimersoftd/022:35:080
2243699561,7cyclictest9-21ksoftirqd/020:45:150
2243699560,7cyclictest101ktimersoftd/000:00:440
2243699560,6cyclictest114691ptp4l21:30:220
2243699560,6cyclictest101ktimersoftd/023:05:140
114691560,2ptp4l0-21swapper/322:25:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional