You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 12:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack9slot2.osadl.org (updated Fri Dec 05, 2025 00:43:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
305542288250,26sleep10-21swapper/11
3107399261256,3cyclictest0-21swapper/33
3106699261254,5cyclictest398-21perf1
3105899258252,4cyclictest377-21munin-run0
291172256185,24sleep00-21swapper/00
306172232195,24sleep30-21swapper/33
307292228192,24sleep20-21swapper/22
3107099121116,3cyclictest408-21awk2
25012620,3sleep09-21ksoftirqd/00
123492530,4sleep112215-21latency_hist1
256352440,3sleep023141-21kworker/u8:00
304112430,4sleep230413-21head2
144092390,1sleep00-21swapper/00
3107399320,30cyclictest9076-21kworker/3:13
31058993113,9cyclictest13922-21sendmail0
31070992812,14cyclictest10874-21latency_hist2
3107099270,9cyclictest22766-40mandb2
31073992620,4cyclictest842-21/usr/sbin/munin3
31070992517,5cyclictest505-21dbus-daemon2
31070992514,9cyclictest8844-21forks2
192772250,4sleep30-21swapper/33
3107399248,3cyclictest123512date3
3107099248,15cyclictest0-21swapper/22
3107099240,23cyclictest22688-21kworker/2:02
31066992418,4cyclictest21-21ksoftirqd/11
31073992317,4cyclictest30067-21sh3
31070992318,3cyclictest17136-21cut2
3107099231,4cyclictest24036-21sort2
31070992312,10cyclictest28-21ksoftirqd/22
31066992318,3cyclictest6131-21grep1
31058992316,4cyclictest6037-21apt-get0
31073992217,3cyclictest5014-21cut3
31073992217,3cyclictest20306-21missed_timers3
3107099223,17cyclictest2431-21latency_hist2
3107099223,17cyclictest2431-21latency_hist2
31070992216,4cyclictest23036-21df_inode2
31070992216,3cyclictest24097-21grep2
31070992215,4cyclictest17281-21sh2
3107099221,4cyclictest5752-21munin-run2
3107099221,19cyclictest19981-21df2
3107099221,18cyclictest4122-21munin-run2
264952220,2sleep20-21swapper/22
18422220,1sleep20-21swapper/22
7302210,3sleep0732-21apt-key0
3107399211,17cyclictest17784-21grep3
3107399211,17cyclictest17784-21grep3
3107399210,4cyclictest0-21swapper/33
3107099213,16cyclictest9867-21procmail2
3107099213,16cyclictest26946-21cat2
3107099212,17cyclictest14013-21cat2
31070992115,4cyclictest22692-21sh2
31070992115,3cyclictest12037-21cut2
3107099211,3cyclictest7695-1kworker/2:1H2
3107099211,3cyclictest3730-21munin-run2
3107099211,18cyclictest31000-21procmail2
3107099211,18cyclictest2082-21systemd-journal2
3107099211,17cyclictest32505-21cron2
31066992115,4cyclictest6805-21cat1
31066992114,4cyclictest505-21dbus-daemon1
31066992114,4cyclictest2084-21cron1
31066992114,4cyclictest2084-21cron1
3105899218,10cyclictest11004-21if_enp2s00
3105899212,16cyclictest19463-21ls0
3105899211,7cyclictest25981-21apt-get0
31058992116,3cyclictest1513-21seq0
31058992115,4cyclictest30260-21cut0
31058992115,4cyclictest21392-21diskstats0
31058992115,4cyclictest19311-21seq0
25722210,2sleep10-21swapper/11
31073992015,3cyclictest7775-21unixbench_singl3
31073992015,3cyclictest6459-21diskstats3
31073992015,3cyclictest5771-21sendmail3
31073992015,3cyclictest31153-21needreboot3
31073992015,3cyclictest21863-21unixbench_multi3
31073992015,3cyclictest20911-21acpi3
31073992015,3cyclictest1306-21irqstats3
31073992015,3cyclictest1306-21irqstats3
31073992015,3cyclictest1193-21ntpq3
31073992015,3cyclictest1193-21ntpq3
31073992014,4cyclictest9560-21wc3
31073992014,4cyclictest6390-21cut3
31073992014,4cyclictest25078-21seq3
31073992014,4cyclictest18550-21apt-get3
31073992014,4cyclictest12041-21pluginstate3
31073992014,3cyclictest17038-21gltestperf3
31073992013,4cyclictest31602-21expr3
31073992013,4cyclictest10907-21needreboot3
3107399201,17cyclictest0-21swapper/33
3107099202,16cyclictest28427-21latency_hist2
3107099202,16cyclictest14316-21sendmail2
31070992016,2cyclictest0-21swapper/22
31070992015,3cyclictest6196-21lockfile-create2
31070992015,3cyclictest5154-21df2
31070992015,3cyclictest25294-21cut2
31070992015,3cyclictest21302-21memory2
31070992014,4cyclictest2177-21cat2
31070992014,4cyclictest2177-21cat2
31070992014,4cyclictest12303-21grep2
31070992014,3cyclictest26756-21idleruntime-cro2
31070992014,3cyclictest20606-21readlink2
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional