You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 00:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot2.osadl.org (updated Tue May 05, 2026 12:43:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
210342272180,24sleep20-21swapper/22
208722271186,69sleep30-21swapper/33
2133199254251,2cyclictest0-21swapper/11
203022249201,19sleep10-21swapper/11
209142246182,51sleep00-21swapper/00
2133599189183,4cyclictest27094-21strings2
2132699189185,2cyclictest0-21swapper/00
3054721500,2sleep32133999cyclictest3
274942620,3sleep327495-21aten2_r9power_v3
322012580,2sleep032199-21seq0
64582490,1sleep20-21swapper/22
161022490,1sleep10-21swapper/11
125922480,1sleep212513-21cstates2
25082380,3sleep20-21swapper/22
223042330,4sleep00-21swapper/00
2133199310,29cyclictest31828-21kworker/1:11
270012260,5sleep126999-21ls1
120502250,11sleep335-21ksoftirqd/33
247662240,1sleep20-21swapper/22
21335992416,4cyclictest24132-21apt-get2
21326992413,9cyclictest27054-21aten2_r9power_v0
204682240,2sleep30-21swapper/33
119282240,1sleep30-21swapper/33
2133599233,18cyclictest9873-21awk2
21335992318,3cyclictest19160-21munin-plugin-st2
21335992310,10cyclictest21545-21aten2_r9power_c2
21326992312,8cyclictest668-21runrttasks0
53882220,2sleep35851-21cmp3
52872220,1sleep10-21swapper/11
21339992218,3cyclictest35-21ksoftirqd/33
2133599227,2cyclictest30165-21latency_hist2
2133599223,17cyclictest26495-21latency_hist2
2133599223,17cyclictest24704-21cat2
2133599223,17cyclictest18119-21latency_hist2
21335992215,4cyclictest29953-21ntp_states2
2133599221,3cyclictest6124-21munin-run2
2133599221,3cyclictest518-21lockfile-create2
2133599221,19cyclictest2590-21munin-run2
2133599221,18cyclictest1978-21systemctl2
21331992217,3cyclictest30749-21ls1
21331992215,4cyclictest15853-21cat1
21331992215,4cyclictest10308-21sendmail-mta1
2133199220,20cyclictest31881-21kworker/1:01
2132699221,18cyclictest2852-21grep0
315822210,4sleep12133199cyclictest1
21339992116,3cyclictest35-21ksoftirqd/33
2133599212,18cyclictest20179-21sendmail2
2133599212,18cyclictest20179-21sendmail2
2133599212,17cyclictest0-21swapper/22
21335992116,3cyclictest1246-21munin-run2
21335992115,4cyclictest28248-21ntp_kernel_err2
2133599211,4cyclictest3282-21munin-run2
2133599211,18cyclictest25908-21procmail2
2133599211,18cyclictest10297-21sendmail-msp2
2133599211,17cyclictest1679-1kworker/2:0H2
2133599210,19cyclictest28596-21perf2
2133199213,16cyclictest24716-21wc1
21331992114,4cyclictest24712-21sed1
21326992115,4cyclictest27646-21sh0
21326992114,5cyclictest21528-21idleruntime-cro0
21339992016,3cyclictest35-21ksoftirqd/33
21339992015,3cyclictest4343-21forks3
21339992015,3cyclictest26267-21sed3
21339992015,3cyclictest25447-21seq3
21339992015,3cyclictest19480-21missed_timers3
21339992015,3cyclictest18570-21tr3
21339992014,4cyclictest9115-21gzip3
21339992014,4cyclictest16653-21users3
2133999200,18cyclictest16097-21sed3
2133599204,14cyclictest512-21dbus-daemon2
2133599202,16cyclictest8786-21latency_hist2
21335992017,2cyclictest0-21swapper/22
21335992015,3cyclictest6063-21aten2_r9power_v2
21335992015,3cyclictest24970-21acpi2
21335992015,3cyclictest24086-21sed2
21335992015,3cyclictest22682-21dump-pmu-power2
21335992015,3cyclictest19567-21ntp_kernel_pll_2
21335992015,3cyclictest17188-21open_inodes2
21335992015,3cyclictest13739-21idleruntime2
21335992014,4cyclictest6389-21apt-get2
21335992014,4cyclictest19545-21cat2
21335992014,4cyclictest14612-21date2
2133599201,3cyclictest23589-21dpkg2
21335992013,4cyclictest25229-21mailstats2
2133599201,17cyclictest1261-21cat2
2133599200,17cyclictest16052-21munin-run2
21331992015,3cyclictest24177-21sed1
21331992015,3cyclictest21963-21find1
21331992015,3cyclictest10957-21needreboot1
21331992014,4cyclictest3720-21ntpq1
21331992014,4cyclictest20008-21grep1
21331992014,3cyclictest32244-21basename1
21331992013,4cyclictest29763-21find1
21331992013,4cyclictest16561-21sort1
21331992012,5cyclictest17134-21df_inode1
21326992014,4cyclictest5897-21cut0
21326992014,4cyclictest30696-21sh0
21326992014,4cyclictest25849-21ntpq0
21326992014,4cyclictest23040-21awk0
21326992014,4cyclictest15935-21cat0
21326992014,4cyclictest11252-21sed0
21326992014,4cyclictest10491-21sed0
21326992014,3cyclictest1667-21sort0
21326992013,5cyclictest20605-21seq0
2132699200,17cyclictest9925-21wc0
208242200,3sleep220815-21perf2
2133999199,6cyclictest5949-21apt-get3
21339991916,2cyclictest0-21swapper/33
21339991916,2cyclictest0-21swapper/33
21339991916,2cyclictest0-21swapper/33
21339991916,2cyclictest0-21swapper/33
21339991916,2cyclictest0-21swapper/33
21339991914,3cyclictest9747-21unixbench-2d3
21339991914,3cyclictest2878-21if_err_enp3s03
21339991914,3cyclictest24965-21find3
21339991914,3cyclictest23746-21sed3
21339991914,3cyclictest23707-21ntp_states3
21339991914,3cyclictest13217-21sendmail_mailst3
21339991913,4cyclictest28602-21basename3
21339991913,4cyclictest21099-21cut3
21339991913,4cyclictest20656-21cut3
21339991913,4cyclictest1677-21ntpq3
2133999191,17cyclictest0-21swapper/33
21339991910,6cyclictest6389-21apt-get3
2133999190,17cyclictest512-21dbus-daemon3
2133599197,10cyclictest12222-21taskset2
21335991917,1cyclictest0-21swapper/22
21335991915,2cyclictest21484-21df2
21335991914,3cyclictest6890-21cat2
21335991914,3cyclictest3869-21processes2
21335991914,3cyclictest17207-21grep2
21335991914,3cyclictest14868-21interrupts2
21335991914,3cyclictest11475-21unixbench_singl2
2133599191,3cyclictest11886-21munin-run2
21335991913,4cyclictest31144-21grep2
21335991913,4cyclictest15319-21hostname2
2133599191,16cyclictest0-21swapper/22
2133599190,2cyclictest22571-21turbostat2
2133199192,16cyclictest0-21swapper/11
2133199192,15cyclictest0-21swapper/11
21331991916,2cyclictest0-21swapper/11
21331991916,2cyclictest0-21swapper/11
21331991915,2cyclictest29038-21/usr/sbin/munin1
21331991915,2cyclictest17312-21/usr/sbin/munin1
21331991915,2cyclictest1498-21/usr/sbin/munin1
21331991915,2cyclictest1302-21sed1
21331991915,2cyclictest12534-21uptime1
21331991914,3cyclictest2633-21sed1
21331991914,3cyclictest24111-21/usr/sbin/munin1
21331991913,4cyclictest8551-21cut1
21331991913,4cyclictest8234-21sed1
21331991913,4cyclictest4958-21cat1
21331991913,3cyclictest2894-21awk1
2132699192,4cyclictest9-21ksoftirqd/00
2132699192,15cyclictest19463-21sort0
21326991915,2cyclictest5931-21/usr/sbin/munin0
21326991915,2cyclictest2231-21/usr/sbin/munin0
21326991914,3cyclictest760-21/usr/sbin/munin0
21326991914,3cyclictest6370-21/usr/sbin/munin0
21326991914,3cyclictest6196-21cat0
21326991914,3cyclictest4155-21cat0
21326991914,3cyclictest31154-21latency0
21326991914,3cyclictest31120-21/usr/sbin/munin0
21326991914,3cyclictest29038-21/usr/sbin/munin0
21326991914,3cyclictest24583-21seq0
21326991914,3cyclictest22015-21sed0
21326991914,3cyclictest21496-21/usr/sbin/munin0
21326991914,3cyclictest15671-21diskstats0
21326991913,4cyclictest524-21in:imuxsock0
21326991913,4cyclictest25073-21awk0
21326991913,4cyclictest24040-21expr0
21326991913,4cyclictest19057-21seq0
21326991912,4cyclictest1573-21bsdmainutils0
21339991816,1cyclictest0-21swapper/33
21339991816,1cyclictest0-21swapper/33
21339991816,1cyclictest0-21swapper/33
21339991816,1cyclictest0-21swapper/33
21339991816,1cyclictest0-21swapper/33
21339991813,3cyclictest31583-21fw_packets3
21339991813,3cyclictest31213-21users3
21339991813,3cyclictest30438-21unixbench_singl3
21339991813,3cyclictest21460-21cat3
21339991813,3cyclictest18873-21sed3
21339991813,3cyclictest18873-21sed3
21339991813,3cyclictest1418-21unixbench_singl3
21339991813,3cyclictest13616-21seq3
21339991813,3cyclictest11253-21cat3
21339991811,4cyclictest8005-21acpi3
21339991811,4cyclictest3569-21seq3
2133999180,17cyclictest0-21swapper/33
2133999180,16cyclictest0-21swapper/33
21335991816,1cyclictest0-21swapper/22
21335991816,1cyclictest0-21swapper/22
21335991813,3cyclictest4827-21pmu-power2
21335991812,4cyclictest29225-21pluginstate2
21335991812,4cyclictest29225-21pluginstate2
2133199183,12cyclictest10840-21grep1
21331991816,1cyclictest0-21swapper/11
21331991816,1cyclictest0-21swapper/11
21331991816,1cyclictest0-21swapper/11
21331991816,1cyclictest0-21swapper/11
21331991814,2cyclictest760-21/usr/sbin/munin1
21331991814,2cyclictest5682-21cron1
21331991814,2cyclictest26742-21/usr/sbin/munin1
21331991814,2cyclictest18803-21/usr/sbin/munin1
21331991814,2cyclictest18339-21/usr/sbin/munin1
21331991814,2cyclictest18339-21/usr/sbin/munin1
21331991814,2cyclictest12162-21/usr/sbin/munin1
21331991813,3cyclictest7789-21sed1
21331991813,3cyclictest668-21runrttasks1
21331991813,3cyclictest668-21runrttasks1
21331991813,3cyclictest668-21runrttasks1
21331991813,3cyclictest5931-21/usr/sbin/munin1
21331991813,3cyclictest21982-21cat1
21331991813,3cyclictest21877-21needreboot1
21331991813,3cyclictest21496-21/usr/sbin/munin1
21331991813,3cyclictest12146-21/usr/sbin/munin1
21331991812,4cyclictest9953-21cat1
21331991811,4cyclictest26717-21basename1
21326991815,2cyclictest0-21swapper/00
21326991814,2cyclictest10564-21gltestperf0
21326991813,3cyclictest4671-21cat0
21326991813,3cyclictest31229-21seq0
21326991813,3cyclictest26198-21seq0
21326991813,3cyclictest25193-21readlink0
21326991813,3cyclictest24271-21ls0
21326991813,3cyclictest18339-21/usr/sbin/munin0
21326991813,3cyclictest18339-21/usr/sbin/munin0
21326991813,3cyclictest15028-21ls0
21326991813,3cyclictest11501-21awk0
21326991812,4cyclictest16364-21aten2.4-expect0
21326991812,4cyclictest14196-21seq0
21326991812,4cyclictest14027-21date0
2132699180,3cyclictest12926-21memory0
2132699180,15cyclictest32574-21sort0
2132699180,15cyclictest28323-21sort0
21339991713,2cyclictest598-21timerandwakeup3
21339991713,2cyclictest18119-21latency_hist3
21339991712,3cyclictest668-21runrttasks3
21339991712,3cyclictest35-21ksoftirqd/33
21339991712,3cyclictest35-21ksoftirqd/33
21339991712,3cyclictest3286-21idleruntime-cro3
21339991712,3cyclictest27132-21awk3
21339991712,3cyclictest16362-21cut3
2133999170,1cyclictest0-21swapper/33
2133999170,1cyclictest0-21swapper/33
2133599172,12cyclictest9545-21grep2
21335991713,3cyclictest30432-21apt2
21335991710,4cyclictest25156-21grep2
2133599170,15cyclictest0-21swapper/22
21331991713,2cyclictest25853-21latency_hist1
21331991712,3cyclictest29609-21cat1
21331991712,3cyclictest27641-21wc1
21331991712,3cyclictest20884-21cat1
21331991712,3cyclictest14882-21ls1
21331991711,4cyclictest17498-21sed1
2133199170,16cyclictest0-21swapper/11
21326991713,2cyclictest668-21runrttasks0
21326991712,3cyclictest668-21runrttasks0
21326991712,3cyclictest5123-21cat0
21326991712,3cyclictest28114-21cat0
21326991712,3cyclictest21135-21expr0
21326991711,4cyclictest6974-21basename0
21326991711,4cyclictest13158-21seq0
2132699170,15cyclictest325-21systemd-journal0
21339991613,2cyclictest0-21swapper/33
21339991610,4cyclictest23194-21grep3
2133999160,1cyclictest0-21swapper/33
2133199161,6cyclictest0-21swapper/11
21326991612,2cyclictest16902-21if_enp3s00
21326991611,3cyclictest29161-21seq0
21326991611,3cyclictest29161-21seq0
21326991611,3cyclictest25238-21ls0
21339991513,1cyclictest0-21swapper/33
2133199153,10cyclictest24167-21sort1
21326991510,3cyclictest668-21runrttasks0
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional