You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-09-27 - 06:44

Intel(R) Atom(TM) CPU E3845 @ 1.91GHz, Linux 4.19.37-rt19 (Profile)

Latency plot of system in rack #d, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 100 highest latencies:
System rackdslot2.osadl.org (updated Mon Sep 27, 2021 00:46:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
125852154133,9sleep20-21swapper/219:08:402
1268911200,50ptp4l41-21ksoftirqd/319:08:583
257432760,7sleep31315399cyclictest21:25:083
1315399740,3cyclictest0-21swapper/321:55:143
126891740,2ptp4l391rcuc/320:27:423
124352735,56sleep10-21swapper/119:06:421
152602720,2sleep00-21swapper/021:10:230
152602720,2sleep00-21swapper/021:10:230
289952680,4sleep328997-21readlink22:10:013
293512660,9sleep21315299cyclictest20:50:022
220472660,5sleep222027-21irqstats22:00:132
207842630,1sleep00-21swapper/000:00:020
254032620,2sleep00-21swapper/022:05:040
154192600,2sleep30-21swapper/322:30:243
126891580,1ptp4l391rcuc/321:12:263
126891580,1ptp4l391rcuc/321:12:253
276892530,2sleep30-21swapper/320:45:253
55598520,2rtkit-daemon0-21swapper/123:37:451
13150995126,4cyclictest9-21ksoftirqd/021:44:410
13150995026,4cyclictest9-21ksoftirqd/023:29:590
1315399487,26cyclictest587-21gdbus00:15:093
13150994827,4cyclictest9-21ksoftirqd/021:17:300
13153994629,14cyclictest41-21ksoftirqd/319:26:403
13153994625,17cyclictest21647-21grep21:20:073
126891450,1ptp4l401ktimersoftd/323:42:283
126891450,1ptp4l401ktimersoftd/319:15:293
13152994437,4cyclictest33-21ksoftirqd/222:05:142
13152994433,6cyclictest22370-21acpi21:20:132
1269024414,18sleep00-21swapper/019:09:590
126891440,1ptp4l401ktimersoftd/322:17:363
126891440,1ptp4l401ktimersoftd/300:05:183
126891430,1ptp4l401ktimersoftd/323:05:173
126891430,1ptp4l401ktimersoftd/322:06:093
126891430,1ptp4l401ktimersoftd/321:40:263
13153994224,15cyclictest41-21ksoftirqd/322:22:343
1315399403,31cyclictest10167-21apt-get22:25:153
1315399403,31cyclictest10167-21apt-get22:25:153
1315399393,27cyclictest6164-21apt-get19:40:143
1315399390,4cyclictest0-21swapper/323:21:223
13151993933,4cyclictest25-21ksoftirqd/120:10:151
13151993932,4cyclictest25-21ksoftirqd/122:05:121
13150993933,3cyclictest9-21ksoftirqd/021:58:580
1315399380,6cyclictest10247-21expr00:25:153
1315399380,5cyclictest30737-21acpi20:10:153
92072370,2sleep1231rcuc/121:05:021
1315399378,26cyclictest27092-21grep22:45:183
1315399373,27cyclictest6603-21apt-get20:20:183
13153993716,18cyclictest8544-21/usr/sbin/munin21:45:083
13153993713,20cyclictest8917-21sed19:45:013
13153993710,23cyclictest15388-21basename20:30:213
1315399370,4cyclictest29848-21uname23:30:103
1315399370,4cyclictest24975-21ls23:25:033
1315399370,4cyclictest2081-21expr22:55:153
1315399370,4cyclictest19613-21gunzip23:15:273
13152993726,6cyclictest33-21ksoftirqd/200:20:142
13151993731,3cyclictest25-21ksoftirqd/120:05:001
13151993730,4cyclictest25-21ksoftirqd/123:30:151
1315199371,34cyclictest5611-21kworker/1:122:40:361
323562360,3sleep0111rcuc/020:10:330
13153993617,16cyclictest29370-21sed20:50:023
1315399361,30cyclictest22162-21acpi22:00:123
13153993611,22cyclictest19894-21sort22:35:293
13153993610,23cyclictest26207-21ptp4l20:05:103
13153993610,23cyclictest15052-21cat23:50:213
13153993610,22cyclictest30997-21sh22:50:173
1315399360,5cyclictest16212-21cat19:10:343
13152993629,4cyclictest33-21ksoftirqd/221:00:112
13152993627,5cyclictest33-21ksoftirqd/220:18:592
13151993631,3cyclictest25-21ksoftirqd/120:30:041
13151993630,4cyclictest25-21ksoftirqd/100:20:001
13151993629,4cyclictest25-21ksoftirqd/121:35:021
282723528,3sleep125-21ksoftirqd/122:15:171
1315399358,24cyclictest30481-21if_err_enp1s019:30:143
1315399358,24cyclictest11741-21grep23:45:323
1315399358,24cyclictest11741-21grep23:45:323
1315399354,24cyclictest18254-21apt-get19:55:123
1315399353,25cyclictest22511-21apt-get20:40:133
13153993514,17cyclictest12315-21/usr/sbin/munin23:10:123
1315399351,30cyclictest0-21swapper/300:35:133
13153993511,20cyclictest3236-21sed20:15:233
13153993510,22cyclictest3386-21cut23:35:453
13153993510,22cyclictest29148-21mailstats21:30:013
13153993510,22cyclictest20105-21gzip20:35:303
1315399350,4cyclictest23227-21cat22:40:223
1315399350,4cyclictest2311-21grep20:55:153
1315399350,4cyclictest15857-21basename19:50:313
1315399350,4cyclictest15857-21basename19:50:303
1315399350,4cyclictest12564-21/usr/sbin/munin21:50:063
13152993527,5cyclictest33-21ksoftirqd/220:07:582
13151993528,4cyclictest25-21ksoftirqd/123:54:501
1315199351,32cyclictest26697-21kworker/1:019:15:571
13150993529,4cyclictest9-21ksoftirqd/000:40:000
13150993529,3cyclictest9-21ksoftirqd/022:43:250
13150993527,5cyclictest9-21ksoftirqd/023:38:230
96802340,5sleep09678-21unixbench_multi23:05:100
259502340,6sleep225951-21cpuspeed_turbos00:05:152
1315399347,23cyclictest803-21irqrtprio19:35:003
1315399343,25cyclictest22485-21apt-get20:00:133
13153993417,14cyclictest41-21ksoftirqd/319:22:463
1315399341,4cyclictest0-21swapper/300:10:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional