You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2020-06-05 - 15:03

Intel(R) Atom(TM) Processor E3930 @ 1.30GHz, Linux 5.2.0-rt1 (Profile)

Latency plot of system in rack #8, slot #8
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack8slot8.osadl.org (updated Sun Jul 28, 2019 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18642214176,26sleep10-21swapper/11
18642214176,26sleep10-21swapper/11
18317213473,25sleep00-21swapper/00
18317213473,25sleep00-21swapper/00
23822730,2sleep02381-21wc0
248772500,6sleep121-21ksoftirqd/11
1882799441,29cyclictest13646-21systemd-logind1
1882799381,33cyclictest11731-21grep1
1882799380,11cyclictest0-21swapper/11
1882099371,12cyclictest269062awk0
1882099371,12cyclictest269062awk0
1882799364,5cyclictest13652-21sssd_kcm1
1882799361,10cyclictest0-21swapper/11
18827993513,4cyclictest20854-21cat1
1882099354,4cyclictest121rcu_preempt0
1882099351,31cyclictest535-21systemd-journal0
6462341,18sleep0650-21bash0
1882799349,4cyclictest21325-1kworker/u9:21
1882799341,26cyclictest13652-21sssd_kcm1
1882799339,6cyclictest21-21ksoftirqd/11
1882799338,12cyclictest0-21swapper/11
1882799336,14cyclictest0-21swapper/11
1882799332,14cyclictest13652-21sssd_kcm1
1882099336,10cyclictest121rcu_preempt0
1882099333,3cyclictest121rcu_preempt0
18820993321,4cyclictest1300-21sed0
1882099331,17cyclictest32608-21uptime0
1882799329,12cyclictest0-21swapper/11
1882799327,13cyclictest0-21swapper/11
1882799327,12cyclictest1720-21pool1
1882799322,11cyclictest21-21ksoftirqd/11
1882099321,19cyclictest24285-21vmstat0
18820993211,5cyclictest2678-21cstates0
1882799319,3cyclictest21-21ksoftirqd/11
1882799319,19cyclictest21-21ksoftirqd/11
1882799315,11cyclictest1365998rtkit-daemon1
1882799310,8cyclictest0-21swapper/11
1882099318,10cyclictest28443-21expr0
1882099315,11cyclictest19736-21latency_hist0
18820993123,5cyclictest26842-21/usr/sbin/munin0
1882099311,6cyclictest30297-21irqstats0
1365998310,6rtkit-daemon21751-21diskmemload1
269052300,7sleep10-21swapper/11
269052300,7sleep10-21swapper/11
1882799308,11cyclictest0-21swapper/11
1882799306,13cyclictest121rcu_preempt1
1882799305,14cyclictest0-21swapper/11
1882799302,9cyclictest13652-21sssd_kcm1
1882799302,9cyclictest13652-21sssd_kcm1
1882799302,5cyclictest0-21swapper/11
1882799302,21cyclictest13652-21sssd_kcm1
1882799302,10cyclictest13652-21sssd_kcm1
1882799301,25cyclictest535-21systemd-journal1
18827993010,5cyclictest1365998rtkit-daemon1
1882099305,9cyclictest25769-21turbostat0
1882099305,3cyclictest121rcu_preempt0
1882099301,25cyclictest535-21systemd-journal0
1882099300,27cyclictest13646-21systemd-logind0
1365998300,5rtkit-daemon22961-21turbostat1
1882799299,4cyclictest21751-21diskmemload1
1882799298,4cyclictest21751-21diskmemload1
1882799298,11cyclictest21-21ksoftirqd/11
1882799295,7cyclictest7376-21sa11
1882799294,13cyclictest6055-21crond1
1882799294,13cyclictest27027-21sshd1
1882799293,12cyclictest21-21ksoftirqd/11
1882799291,25cyclictest13646-21systemd-logind1
1882099299,7cyclictest1-21systemd0
1882099294,3cyclictest121rcu_preempt0
1882099291,9cyclictest4297-21runrttasks0
1882099291,7cyclictest0-21swapper/00
1882099291,6cyclictest19890-21runrttasks0
1882099291,6cyclictest14095-21find0
1882099291,3cyclictest0-21swapper/00
70032282,3sleep0121rcu_preempt0
1882799287,4cyclictest10339-21processes1
1882799284,13cyclictest0-21swapper/11
1882799282,14cyclictest0-21swapper/11
1882799281,4cyclictest0-21swapper/11
1882799281,24cyclictest535-21systemd-journal1
1882799281,24cyclictest535-21systemd-journal1
1882799281,24cyclictest535-21systemd-journal1
18827992810,14cyclictest31340-21seq1
1882099286,7cyclictest5709-21sh0
1882099281,9cyclictest31092-21runrttasks0
1882099281,9cyclictest29769-21runrttasks0
1882099281,8cyclictest12436-21cat0
1882099281,24cyclictest13646-21systemd-logind0
18820992811,15cyclictest82550irq/133-enp2s0-0
180052280,5sleep010-21ksoftirqd/00
1882799276,5cyclictest5041-21sshd1
1882799276,4cyclictest27687-21kworker/u8:01
1882799276,3cyclictest21-21ksoftirqd/11
1882799273,19cyclictest13652-21sssd_kcm1
18827992721,2cyclictest0-21swapper/11
1882799272,12cyclictest0-21swapper/11
1882799272,12cyclictest0-21swapper/11
18827992720,4cyclictest17637-21cut1
1882099277,6cyclictest16819-21timerwakeupswit0
1882099276,5cyclictest121rcu_preempt0
1882099274,6cyclictest11502-21runrttasks0
1882099274,4cyclictest121rcu_preempt0
1882099274,3cyclictest121rcu_preempt0
1882099271,9cyclictest25723-21runrttasks0
1882099271,5cyclictest8295-21/usr/sbin/munin0
1882099271,3cyclictest0-21swapper/00
1882099271,24cyclictest535-21systemd-journal0
1882099271,23cyclictest535-21systemd-journal0
1882099271,23cyclictest13646-21systemd-logind0
1882099271,23cyclictest11502-21runrttasks0
1365998270,2rtkit-daemon0-21swapper/11
1882799264,11cyclictest27257-21ps1
1882799263,3cyclictest121rcu_preempt1
1882799262,12cyclictest0-21swapper/11
1882799262,12cyclictest0-21swapper/11
1882799262,12cyclictest0-21swapper/11
1882799261,9cyclictest6211-21find1
18827992619,4cyclictest9812-21sshd1
1882099262,11cyclictest0-21swapper/00
1882099261,8cyclictest11502-21runrttasks0
1882099261,8cyclictest0-21swapper/00
1882099261,7cyclictest20566-21kworker/0:10
1882099261,7cyclictest0-21swapper/00
1882099261,3cyclictest121rcu_preempt0
1882099261,11cyclictest19973-21dnf0
1882799259,4cyclictest0-21swapper/11
1882099251,9cyclictest10338-21processes0
18820992517,5cyclictest1-21systemd0
1882099251,6cyclictest20380-21memory0
1882099251,13cyclictest8554-21kworker/0:00
1882099251,10cyclictest21466-21runrttasks0
18820992419,3cyclictest15650-21switchtime0
18820992419,3cyclictest15650-21switchtime0
18820992417,5cyclictest82550irq/133-enp2s0-0
18820992417,4cyclictest1979-21/usr/sbin/munin0
153652241,3sleep015372-21ntp_states0
1882099231,9cyclictest0-21swapper/00
18820992316,4cyclictest11502-21runrttasks0
1882099225,5cyclictest10-21ksoftirqd/00
1882099221,8cyclictest0-21swapper/00
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none3
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
none2
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional