You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-10-27 - 00:14

Intel(R) Atom(TM) Processor E3950 @ 1.60GHz, Linux 4.19.182-rt74 (Profile)

Latency plot of system in rack #d, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Up99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 100 highest latencies:
System rackdslot6.osadl.org (updated Sun Jun 06, 2021 00:44:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17366993420,9cyclictest13227-21cat19:35:043
17363993227,3cyclictest9-21ksoftirqd/021:55:010
1736399321,15cyclictest0-21swapper/022:30:000
17366993124,4cyclictest8262-21grep20:57:003
17363993111,17cyclictest8561-21sudo21:00:010
1736399310,16cyclictest352-21systemd-journal19:55:010
17363993016,8cyclictest21416-21timerwakeupswit20:40:180
17366992917,7cyclictest32178-21if_enp2s0.720:20:193
17366992915,8cyclictest22022-21wc21:10:173
17366992915,8cyclictest22022-21wc21:10:173
17365992916,7cyclictest20187-21cat00:35:172
1736399298,18cyclictest629-21dbus-daemon00:25:010
1736399283,12cyclictest12439-21max_latency_gen19:35:010
17363992823,3cyclictest9-21ksoftirqd/000:30:010
17363992823,3cyclictest9-21ksoftirqd/000:00:010
1736399281,13cyclictest8067-21idleruntime-cro20:30:010
17366992715,6cyclictest5755-21cat21:25:173
1736399278,17cyclictest3017-21munin-run20:55:010
17366992612,11cyclictest11258-21if_enp3s021:30:163
1736399264,19cyclictest18651-21awk20:10:010
17363992620,4cyclictest9-21ksoftirqd/000:10:010
17363992615,9cyclictest9-21ksoftirqd/022:50:000
17366992518,4cyclictest26203-21sh22:15:003
1736399256,17cyclictest28321-21munin-run00:15:010
17363992522,2cyclictest9-21ksoftirqd/021:35:010
17363992520,3cyclictest9-21ksoftirqd/020:00:010
1736699247,10cyclictest26041-21timerwakeupswit19:45:183
17366992417,4cyclictest22449-21cat19:11:003
17366992416,4cyclictest31940-21sendmail22:20:013
17366992414,5cyclictest0-21swapper/321:55:053
17366992412,8cyclictest1962-21cat00:20:043
1736599241,20cyclictest11833-21grep00:00:012
17364992419,3cyclictest25-21ksoftirqd/123:15:011
17363992421,2cyclictest9-21ksoftirqd/021:05:000
1736699238,9cyclictest3173-21grep23:50:173
17366992316,4cyclictest9228-21grep19:30:173
17366992312,7cyclictest3280-21apt-get23:20:213
17366992312,7cyclictest15474-21apt-get21:35:063
17366992312,6cyclictest9564-21if_enp2s0.600:25:183
17365992317,4cyclictest30240-21sed21:15:382
17365992317,3cyclictest33-21ksoftirqd/221:30:012
17365992316,4cyclictest5033-21grep20:25:182
17364992317,3cyclictest16390-21cat20:35:201
17364992311,7cyclictest4337-21head19:55:171
1736399234,17cyclictest22367-21munin-run23:40:010
1736399231,3cyclictest121rcu_preempt21:20:190
17363992313,6cyclictest71150irq/126-enp1s0-21:15:190
17363992313,6cyclictest24971-21bc19:15:160
1736399230,3cyclictest19756-21sudo21:10:010
1736699229,8cyclictest16154-21apt-get22:05:063
1736699229,8cyclictest16154-21apt-get22:05:063
1736699222,13cyclictest7926-21sed22:55:183
1736699222,10cyclictest18060-21tr22:35:173
17366992215,4cyclictest25725-21awk19:15:193
17366992215,4cyclictest1877-21head21:50:233
1736699221,18cyclictest14662-21tc_qdisc_statis00:30:163
17366992210,8cyclictest31486-21apt-get21:20:073
1736599222,13cyclictest26174-21cut20:15:172
17365992217,3cyclictest33-21ksoftirqd/219:45:002
17365992215,4cyclictest24820-21cat23:10:192
17365992215,4cyclictest15427-21mailstats21:05:112
17365992212,6cyclictest16506-21cpuspeed_turbos21:35:152
1736499222,14cyclictest20418-21unixbench_multi19:40:171
17364992217,3cyclictest25-21ksoftirqd/100:40:001
17364992214,6cyclictest5357-21ls23:50:291
17363992217,3cyclictest9-21ksoftirqd/023:20:010
17363992217,3cyclictest9-21ksoftirqd/023:10:010
17363992217,3cyclictest24051-21ethtool_rx_queu20:15:010
17363992216,3cyclictest1237-21if_enp2s0.523:50:030
1736399221,18cyclictest29518-21find20:20:010
1736699213,11cyclictest27511-21timerwakeupswit21:15:183
1736699213,11cyclictest23949-21if_enp2s0.622:40:183
1736699212,6cyclictest14606-21ifqueues_enp2s021:05:043
1736699212,13cyclictest9140-21find23:55:203
1736699212,11cyclictest4290-21ethtool_rx_queu19:55:163
1736699212,11cyclictest24246-21unixbench_singl23:10:173
17366992116,3cyclictest41-21ksoftirqd/322:25:013
17366992116,3cyclictest41-21ksoftirqd/322:25:013
17366992114,5cyclictest572-21awk22:50:043
17366992114,4cyclictest1335-21max_latency_gen00:20:013
1736599213,15cyclictest26192-21cron22:15:002
17365992114,4cyclictest5324-21/usr/sbin/munin22:25:162
17365992114,4cyclictest30739-21needreboot19:50:152
17365992114,4cyclictest17050-21pluginstate23:05:052
1736499211,6cyclictest13607-21cpu_utilization23:00:191
17364992116,3cyclictest25-21ksoftirqd/121:00:011
17364992116,3cyclictest16735-21find21:05:191
17364992115,4cyclictest20517-21cpu20:10:151
17364992115,3cyclictest1232-21if_enp2s0.620:50:281
17364992114,5cyclictest2047-21grep00:20:041
17364992114,4cyclictest4296-21sed21:25:051
17364992111,6cyclictest352-21systemd-journal00:00:021
1736399216,9cyclictest10287-21unixbench_multi20:30:170
17363992116,3cyclictest9-21ksoftirqd/023:35:010
17363992116,3cyclictest9-21ksoftirqd/023:15:010
17363992116,3cyclictest9-21ksoftirqd/020:40:010
17363992116,3cyclictest9-21ksoftirqd/000:20:000
17363992115,4cyclictest9-21ksoftirqd/023:00:010
17363992115,4cyclictest15219-21fschecks_count00:00:250
17363992115,4cyclictest11328-21sh23:29:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional