You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-31 - 05:27

x86 Intel Atom E3950 @1600 MHz, Linux 5.6.19-rt12 (Profile)

Latency plot of system in rack #9, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100, highest latencies:
System rack9slot2 (updated Fri Mar 31, 2023 00:43:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
191542251177,17sleep00-21swapper/00
191022246210,24sleep30-21swapper/33
190262229190,26sleep10-21swapper/11
191412228191,25sleep20-21swapper/22
1952199218212,4cyclictest505-21dbus-daemon0
1953299199193,4cyclictest24027-21turbostat2
1952999193187,3cyclictest322-21systemd-journal1
1953799191186,3cyclictest0-21swapper/33
385721450,4sleep01952199cyclictest0
381021450,3sleep20-21swapper/22
643321430,1sleep10-21swapper/11
2262721320,2sleep31953799cyclictest3
261582560,2sleep20-21swapper/22
139782520,2sleep30-21swapper/33
91992440,2sleep31953799cyclictest3
19537993714,20cyclictest11509-21users3
19537993613,20cyclictest27304-21swap3
75052350,3sleep228-21ksoftirqd/22
19537993515,18cyclictest839-21cat3
19537993513,19cyclictest31683-21timerwakeupswit3
19537993512,21cyclictest18932-21ntp_offset3
19537993512,20cyclictest4974-21missed_timers3
19537993415,17cyclictest11541-21open_files3
19537993414,18cyclictest17205-21cat3
19537993414,18cyclictest15829-21wc3
19537993413,18cyclictest31080-21open_files3
19537993413,18cyclictest2613-21expr3
19537993313,18cyclictest20501-21df3
19537993313,17cyclictest14353-21cpuspeed_turbos3
19537993313,17cyclictest14353-21cpuspeed_turbos3
19537993312,18cyclictest21446-21cat3
19537993311,3cyclictest25816-21unixbench_multi3
19529993314,17cyclictest18489-21df1
1953799329,4cyclictest6253-21grep3
19529993214,16cyclictest27465-21seq1
19529993213,17cyclictest30603-21cat1
19529993213,16cyclictest14228-21aten2_r9power_v1
19529993213,16cyclictest14228-21aten2_r9power_v1
19529993211,3cyclictest8555-21cat1
19529993210,4cyclictest22411-21date1
1953799319,4cyclictest2554-21date3
1953799319,3cyclictest202892chrt3
1953799318,5cyclictest322-21systemd-journal3
19537993111,3cyclictest8150-21date3
19537993111,2cyclictest30201-21cpuspeed_turbos3
19532993113,3cyclictest23790-21latency_hist2
1952999310,29cyclictest32263-21kworker/1:21
1953799309,3cyclictest8928-21cat3
1953799309,3cyclictest30532-21diskstats3
1953799309,3cyclictest17307-21switchtime3
1953799309,3cyclictest14145-21cat3
1953799308,3cyclictest5292-21cat3
1953799308,3cyclictest24963-21cut3
1953799302,10cyclictest990-21grep3
19529993014,14cyclictest28869-21sh1
19529993014,14cyclictest28869-21sh1
19529993012,3cyclictest13720-21seq1
19529993011,5cyclictest505-21dbus-daemon1
1953799299,3cyclictest27857-21head3
1953799299,3cyclictest13074-21fw_packets3
1953799298,3cyclictest27860-21cut3
1953799292,6cyclictest28520-21diskstats3
19529992914,12cyclictest32567-21/usr/sbin/munin1
1953799289,3cyclictest4200-21latency_hist3
1953799289,3cyclictest20666-21processes3
1953799288,3cyclictest10141-21date3
1953799287,3cyclictest26033-21sed3
1953799287,3cyclictest23967-21cat3
1953799287,3cyclictest13674-21seq3
19529992813,13cyclictest665-21runrttasks1
19529992811,3cyclictest322-21systemd-journal1
19529992810,3cyclictest2555-21cat1
1953799278,2cyclictest29047-21switchtime3
1953799278,2cyclictest29047-21switchtime3
19537992711,3cyclictest665-21runrttasks3
1952999279,4cyclictest19296-21latency1
19529992710,2cyclictest24666-21expr1
280772260,7sleep2281ksoftirqd/22
280772260,7sleep2281ksoftirqd/22
206442260,2sleep220650-21gltestperf2
1953799267,3cyclictest10087-21latency_hist3
1952999269,3cyclictest3032-21grep1
19529992611,3cyclictest6068-21latency_hist1
19529992611,3cyclictest3587-21ntp_kernel_pll_1
19529992611,2cyclictest22558-21/usr/sbin/munin1
19529992610,3cyclictest7560-21sh1
1952999259,4cyclictest9273-21processes1
1952999259,3cyclictest27187-21pmu-power1
1952999259,2cyclictest161092chrt1
1952999258,3cyclictest25315-21sed1
1952999255,4cyclictest0-21swapper/11
19529992513,2cyclictest5996-21/usr/sbin/munin1
19529992513,2cyclictest22058-21/usr/sbin/munin1
19529992512,3cyclictest665-21runrttasks1
19529992512,3cyclictest665-21runrttasks1
19529992512,3cyclictest665-21runrttasks1
19537992410,3cyclictest4400-21tr3
1953299244,18cyclictest10006-21cat2
19529992412,2cyclictest26529-21/usr/sbin/munin1
1953299234,17cyclictest31808-21cat2
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional