You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-29 - 02:02

x86 Intel Atom E3950 @1600 MHz, Linux 5.6.19-rt12 (Profile)

Latency plot of system in rack #9, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack9slot2 (updated Tue Mar 28, 2023 12:43:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
152682278203,63sleep10-21swapper/11
141282268179,17sleep30-21swapper/33
1591799255249,3cyclictest17804-21latency_hist3
155002245180,52sleep20-21swapper/22
156042242170,24sleep00-21swapper/00
1590599238235,2cyclictest0-21swapper/11
378221630,4sleep01590199cyclictest0
1590199136131,3cyclictest17848-21munin-node0
1590999105100,3cyclictest17935-21latency_hist2
30542690,2sleep20-21swapper/22
150222610,3sleep315012-21cron3
16522540,3sleep2507-21cron2
41502440,2sleep00-21swapper/00
101402440,2sleep30-21swapper/33
60402410,2sleep00-21swapper/00
236782390,1sleep00-21swapper/00
206402360,2sleep10-21swapper/11
206402360,2sleep10-21swapper/11
48842300,2sleep20-21swapper/22
15901992824,3cyclictest101rcuc/00
15909992613,12cyclictest28-21ksoftirqd/22
1590199252,6cyclictest9-21ksoftirqd/00
15901992522,2cyclictest101rcuc/00
306272240,1sleep30-21swapper/33
15917992418,3cyclictest26689-21tr3
1590199247,9cyclictest9-21ksoftirqd/00
1590199245,6cyclictest9-21ksoftirqd/00
1590199243,7cyclictest9-21ksoftirqd/00
1590199243,6cyclictest9-21ksoftirqd/00
1590199240,6cyclictest9-21ksoftirqd/00
1590199240,23cyclictest13469-21kworker/0:20
58272230,1sleep00-21swapper/00
15909992315,5cyclictest20999-21basename2
15905992315,5cyclictest505-21dbus-daemon1
1590199236,9cyclictest9-21ksoftirqd/00
1590199234,7cyclictest9-21ksoftirqd/00
15901992320,2cyclictest101rcuc/00
15901992320,2cyclictest101rcuc/00
223802220,2sleep10-21swapper/11
1590999223,17cyclictest7876-21sendmail-mta2
1590999223,17cyclictest29638-21latency_hist2
15909992217,3cyclictest5603-21cron2
15909992217,3cyclictest2427-21idleruntime-cro2
15909992215,4cyclictest11561-21sh2
1590999221,4cyclictest3896-21sendmail2
1590999221,18cyclictest15402-1kworker/2:0H2
15909992210,11cyclictest28-21ksoftirqd/22
15905992217,3cyclictest28704-21tr1
15905992216,4cyclictest9877-21sed1
1590199226,9cyclictest9-21ksoftirqd/00
1590199224,10cyclictest9-21ksoftirqd/00
1590199223,7cyclictest9-21ksoftirqd/00
1590199223,7cyclictest9-21ksoftirqd/00
1590199223,7cyclictest9-21ksoftirqd/00
1590199223,6cyclictest9-21ksoftirqd/00
1590199223,6cyclictest9-21ksoftirqd/00
1590199222,8cyclictest9-21ksoftirqd/00
1590199222,7cyclictest9-21ksoftirqd/00
15901992219,2cyclictest101rcuc/00
15901992218,3cyclictest101rcuc/00
15917992116,3cyclictest24561-21users3
15917992116,3cyclictest24561-21users3
15917992116,3cyclictest21350-21ntpq3
15917992116,3cyclictest21350-21ntpq3
15917992116,3cyclictest1284-21interrupts3
15917992115,4cyclictest3007-21threads3
15917992115,4cyclictest15870-21if_err_enp3s03
1590999219,11cyclictest28-21ksoftirqd/22
1590999214,15cyclictest15402-1kworker/2:0H2
1590999213,16cyclictest24935-21sh2
1590999213,16cyclictest24935-21sh2
1590999212,17cyclictest15040-21sendmail-mta2
1590999211,18cyclictest19732-21munin-run2
1590999211,17cyclictest15402-1kworker/2:0H2
15909992110,9cyclictest13174-21grep2
1590999210,19cyclictest9545-21cron2
1590999210,18cyclictest5872-21munin-run2
1590599212,17cyclictest14816-21cut1
15905992116,3cyclictest25936-21aten2_r9power_c1
15905992115,4cyclictest31122-21/usr/sbin/munin1
15905992115,3cyclictest12303-21sh1
1590599211,17cyclictest20304-21runrttasks1
1590199217,3cyclictest111rcu_preempt0
1590199215,9cyclictest9-21ksoftirqd/00
1590199213,7cyclictest9-21ksoftirqd/00
1590199213,7cyclictest9-21ksoftirqd/00
1590199213,7cyclictest9-21ksoftirqd/00
1590199213,6cyclictest9-21ksoftirqd/00
1590199213,6cyclictest9-21ksoftirqd/00
1590199212,7cyclictest9-21ksoftirqd/00
1590199212,7cyclictest9-21ksoftirqd/00
1590199212,7cyclictest9-21ksoftirqd/00
1590199212,3cyclictest9-21ksoftirqd/00
15901992118,2cyclictest101rcuc/00
1590199211,7cyclictest9-21ksoftirqd/00
1590199211,6cyclictest9-21ksoftirqd/00
15901992116,3cyclictest14204-21ls0
1591799203,14cyclictest11407-21grep3
15917992015,3cyclictest21232-21cat3
15917992015,3cyclictest15645-21seq3
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional