You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 15:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot2.osadl.org (updated Thu Dec 25, 2025 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
182642309271,26sleep00-21swapper/00
181842255186,37sleep20-21swapper/22
181802254188,37sleep30-21swapper/33
181682228191,24sleep10-21swapper/11
520421690,4sleep01867099cyclictest0
210112580,2sleep00-21swapper/00
83272410,2sleep20-21swapper/22
168622410,1sleep10-21swapper/11
107332410,1sleep20-21swapper/22
198612390,3sleep119858-21idleruntime-cro1
4892350,1sleep00-21swapper/00
266822290,3sleep2271rcuc/22
99152260,5sleep0340-21systemd-journal0
18681992620,4cyclictest13699-21/usr/sbin/munin3
1868199248,14cyclictest15736-21latency_hist3
1868199234,17cyclictest9189-21sendmail-mta3
1868199234,17cyclictest26443-21sendmail-mta3
1868199234,17cyclictest25859-21sendmail-mta3
1868199234,17cyclictest21743-21sendmail-mta3
1868199234,17cyclictest17646-21sendmail-mta3
1868199234,17cyclictest1583-21sendmail-mta3
1868199234,17cyclictest13836-21sendmail-mta3
1868199234,17cyclictest12223-21sendmail-mta3
1868199233,18cyclictest24489-21sendmail-mta3
1868199233,18cyclictest24489-21sendmail-mta3
1868199233,18cyclictest22336-21sendmail-mta3
1868199233,17cyclictest35-21ksoftirqd/33
1868199231,4cyclictest13039-1kworker/3:2H3
327442220,3sleep232710-21cstates2
1868199224,16cyclictest30808-21sendmail-mta3
1868199224,16cyclictest20401-21sendmail-mta3
1868199224,16cyclictest15344-21sendmail-mta3
1868199223,17cyclictest8135-21sendmail-mta3
1868199223,17cyclictest6577-21sendmail-mta3
1868199223,17cyclictest5087-21sendmail-mta3
1868199223,17cyclictest35-21ksoftirqd/33
1868199223,17cyclictest32065-21sendmail-mta3
1868199223,17cyclictest27698-21sendmail-mta3
1868199223,17cyclictest25150-21sendmail-mta3
1868199223,17cyclictest23596-21sendmail-mta3
1868199223,17cyclictest20438-21sendmail-mta3
1868199223,17cyclictest19507-21sendmail-mta3
1868199223,17cyclictest16290-21sendmail-mta3
1868199223,17cyclictest13249-21sendmail-mta3
1868199223,17cyclictest10976-21sendmail-mta3
1868199223,17cyclictest10976-21sendmail-mta3
1868199222,18cyclictest993-21sendmail-mta3
1868199220,20cyclictest23255-21munin-run3
18679992217,3cyclictest32206-21sed2
18670992210,10cyclictest9-21ksoftirqd/00
308152210,1sleep00-21swapper/00
1868199213,17cyclictest13474-21awk3
1868199213,16cyclictest9774-21sendmail-mta3
18681992114,5cyclictest517-21dbus-daemon3
18681992114,4cyclictest5907-21df3
1868199211,3cyclictest340-21systemd-journal3
1868199211,3cyclictest10314-21munin-run3
1868199211,18cyclictest0-21swapper/33
1868199210,3cyclictest1837-21munin-run3
1867999211,8cyclictest18235-21sendmail-mta2
1867999211,7cyclictest520-21rs:main2
1867999211,7cyclictest25150-21sendmail-mta2
18679992117,2cyclictest28895-21grep2
18679992115,4cyclictest11120-21cron2
18679992115,4cyclictest11120-21cron2
18674992116,3cyclictest3815-21perf1
18674992113,6cyclictest517-21dbus-daemon1
18670992116,3cyclictest27079-21seq0
18670992115,4cyclictest13051-21diskstats0
206912200,2sleep10-21swapper/11
18681992015,3cyclictest2883-21/usr/sbin/munin3
18681992015,3cyclictest26049-21threads3
18681992014,4cyclictest22222-21users3
18681992013,4cyclictest31627-21df3
1868199200,18cyclictest17576-21munin-run3
1867999206,5cyclictest517-21dbus-daemon2
1867999205,5cyclictest517-21dbus-daemon2
1867999205,5cyclictest517-21dbus-daemon2
1867999201,7cyclictest340-21systemd-journal2
1867999201,3cyclictest28-21ksoftirqd/22
18679992012,5cyclictest81522sleep22
18679992011,4cyclictest15746-21sendmail2
1867999200,7cyclictest340-21systemd-journal2
1867999200,6cyclictest0-21swapper/22
1867999200,6cyclictest0-21swapper/22
1867499202,16cyclictest0-21swapper/11
18674992016,2cyclictest25550-21/usr/sbin/munin1
18674992015,3cyclictest29622-21/usr/sbin/munin1
18674992015,3cyclictest15425-21ntp_states1
18674992014,4cyclictest11894-21grep1
18674992014,4cyclictest11466-21grep1
18674992014,4cyclictest10330-21sh1
18674992013,4cyclictest30297-21date1
18674992013,4cyclictest26702-21run-parts1
18674992013,4cyclictest13404-21sh1
18674992013,4cyclictest10651-21tr1
18674992010,2cyclictest111rcu_preempt1
18670992014,4cyclictest3531-21sed0
18670992014,4cyclictest27739-21seq0
18670992014,4cyclictest19670-21sh0
18670992014,4cyclictest16509-21date0
18670992014,4cyclictest15480-21seq0
18670992014,3cyclictest22773-21needreboot0
18670992013,4cyclictest11019-21df_inode0
1867099201,17cyclictest517-21dbus-daemon0
1868199197,11cyclictest0-21swapper/33
18681991914,3cyclictest9724-21cpu3
18681991914,3cyclictest28781-21find3
18681991914,3cyclictest28781-21find3
18681991914,3cyclictest2370-21proc_pri3
18681991914,3cyclictest18508-21fw_packets3
18681991914,3cyclictest11139-21proc_pri3
18681991913,4cyclictest517-21dbus-daemon3
18681991913,4cyclictest2409-21sh3
18681991913,4cyclictest19232-21cat3
18681991913,4cyclictest17271-21cat3
1868199190,3cyclictest13039-1kworker/3:2H3
1868199190,17cyclictest6230-21cat3
1867999191,5cyclictest520-21rs:main2
18679991914,3cyclictest6600-21aten2.4-expect2
18679991914,3cyclictest24088-21sed2
18679991914,3cyclictest18761-21/usr/sbin/munin2
18679991913,4cyclictest517-21dbus-daemon2
18679991913,4cyclictest27698-21sendmail-mta2
18679991913,4cyclictest21743-21sendmail-mta2
18679991913,4cyclictest16337-21seq2
18679991910,5cyclictest517-21dbus-daemon2
18674991916,2cyclictest0-21swapper/11
18674991915,2cyclictest30427-21/usr/sbin/munin1
18674991915,2cyclictest21416-21unixbench_multi1
18674991914,3cyclictest6189-21sed1
18674991914,3cyclictest27705-21ntpq1
18674991914,3cyclictest27705-21ntpq1
18674991914,3cyclictest23262-21grep1
18674991913,4cyclictest22024-21cat1
18674991913,4cyclictest2120-21sed1
18674991913,4cyclictest19897-21/usr/sbin/munin1
18674991913,4cyclictest13220-21cat1
18674991913,3cyclictest26443-21sendmail-mta1
18674991912,4cyclictest6510-21apt-get1
18674991912,4cyclictest340-21systemd-journal1
18674991911,5cyclictest340-21systemd-journal1
18674991910,7cyclictest8111-21needreboot1
18670991915,2cyclictest27784-21cpu0
18670991914,3cyclictest6966-21uname0
18670991914,3cyclictest662-21runrttasks0
18670991914,3cyclictest634-21snmpd0
18670991914,3cyclictest634-21snmpd0
18670991914,3cyclictest28950-21kernelversion0
18670991914,3cyclictest28950-21kernelversion0
18670991914,3cyclictest23461-21wc0
18670991914,3cyclictest23366-21cat0
18670991914,3cyclictest20143-21cat0
18670991914,3cyclictest16918-21cpuspeed_turbos0
18670991914,3cyclictest16558-21needreboot0
18670991914,3cyclictest13067-21ntpq0
18670991914,3cyclictest10228-21sh0
18670991914,3cyclictest10228-21sh0
18670991913,4cyclictest6069-21seq0
18670991913,4cyclictest56750irq/130-enp2s00
18670991913,4cyclictest27810-21awk0
18670991913,4cyclictest27810-21awk0
18670991913,4cyclictest24652-21sh0
18670991913,4cyclictest24652-21sh0
18670991912,5cyclictest8095-21seq0
18670991912,4cyclictest340-21systemd-journal0
89742180,4sleep18973-21strings1
201092180,2sleep30-21swapper/33
18681991814,2cyclictest32096-21turbostat.cron3
18681991814,2cyclictest25646-21aten2_r9power_p3
18681991814,2cyclictest23338-21if_enp3s03
18681991814,2cyclictest23041-21ntp_states3
18681991812,4cyclictest8086-21cat3
18681991812,4cyclictest29144-21memory3
18681991812,4cyclictest28490-21cat3
18681991812,4cyclictest28490-21cat3
1867999189,5cyclictest25841-21sendmail-mta2
1867999188,8cyclictest13444-21cron2
1867999183,3cyclictest111rcu_preempt2
1867999183,2cyclictest111rcu_preempt2
18679991813,3cyclictest27336-21cron2
18679991813,3cyclictest2398-21expr2
18679991813,3cyclictest19196-21idleruntime2
18679991812,4cyclictest5711-21sed2
18679991812,4cyclictest31689-21grep2
18679991812,4cyclictest28-21ksoftirqd/22
18679991811,4cyclictest27036-21sort2
18679991811,4cyclictest27036-21sort2
18679991811,4cyclictest25859-21sendmail-mta2
1867999180,3cyclictest111rcu_preempt2
1867999180,16cyclictest0-21swapper/22
1867499189,3cyclictest111rcu_preempt1
1867499183,9cyclictest32379-21apt-get1
1867499183,9cyclictest13713-21apt-get1
18674991816,1cyclictest0-21swapper/11
18674991816,1cyclictest0-21swapper/11
18674991816,1cyclictest0-21swapper/11
18674991814,2cyclictest9332-21/usr/sbin/munin1
18674991814,2cyclictest9332-21/usr/sbin/munin1
18674991814,2cyclictest22140-21/usr/sbin/munin1
18674991813,3cyclictest7609-21cut1
18674991813,3cyclictest634-21snmpd1
18674991813,3cyclictest3642-21sort1
18674991813,3cyclictest22843-21/usr/sbin/munin1
18674991813,3cyclictest22843-21/usr/sbin/munin1
18674991813,3cyclictest1930-21dpkg1
18674991813,3cyclictest19169-21sed1
18674991813,3cyclictest18858-21aten2_r9power_p1
18674991813,2cyclictest662-21runrttasks1
18674991812,4cyclictest24002-21grep1
18674991812,4cyclictest14739-21sed1
18674991812,4cyclictest12614-21expr1
1867499181,1cyclictest0-21swapper/11
18674991811,4cyclictest16613-21ntpq1
18674991811,4cyclictest11172-21gpgv1
1867099184,9cyclictest18808-21apt-get0
18670991816,1cyclictest0-21swapper/00
18670991816,1cyclictest0-21swapper/00
18670991814,2cyclictest25314-21sh0
18670991814,2cyclictest11665-21/usr/sbin/munin0
18670991813,3cyclictest8444-21sh0
18670991813,3cyclictest6404-21seq0
18670991813,3cyclictest634-21snmpd0
18670991813,3cyclictest32452-21/usr/sbin/munin0
18670991813,3cyclictest31910-21hostname0
18670991813,3cyclictest30517-21sh0
18670991813,3cyclictest26096-21cut0
18670991813,3cyclictest24500-21expr0
18670991813,3cyclictest15419-21cat0
18670991812,3cyclictest662-21runrttasks0
18670991812,3cyclictest1524-21aten2.4-expect0
1867099181,15cyclictest0-21swapper/00
18670991811,4cyclictest22170-21hostname0
18681991713,2cyclictest29646-21aten2_r9power_c3
1867999179,5cyclictest518-21in:imuxsock2
1867999179,5cyclictest17646-21sendmail-mta2
1867999178,6cyclictest28898-21gltestperf2
1867999176,9cyclictest26314-21kworker/u8:22
1867999173,9cyclictest662-21runrttasks2
18679991715,1cyclictest0-21swapper/22
18679991715,1cyclictest0-21swapper/22
18679991713,2cyclictest662-21runrttasks2
18679991713,2cyclictest662-21runrttasks2
18679991712,3cyclictest4686-21cron2
18679991712,3cyclictest21808-21sed2
18679991712,3cyclictest2131-21sed2
18679991712,3cyclictest14221-21cut2
18679991711,4cyclictest12942-21grep2
18679991710,5cyclictest517-21dbus-daemon2
18679991710,5cyclictest517-21dbus-daemon2
18679991710,4cyclictest14395-21cron2
1867999170,16cyclictest0-21swapper/22
1867999170,16cyclictest0-21swapper/22
1867499173,8cyclictest6085-21apt-get1
1867499173,8cyclictest28403-21apt-get1
1867499172,10cyclictest16608-21apt-get1
18674991715,1cyclictest0-21swapper/11
18674991715,1cyclictest0-21swapper/11
18674991713,2cyclictest28281-21/usr/sbin/munin1
18674991713,2cyclictest20763-21munin-node1
18674991712,3cyclictest4038-21sort1
18674991712,3cyclictest26469-21expr1
18674991711,4cyclictest517-21dbus-daemon1
18674991711,4cyclictest16290-21sendmail-mta1
1867499170,15cyclictest31219-21kworker/1:01
18670991714,2cyclictest0-21swapper/00
18670991713,2cyclictest634-21snmpd0
18670991713,2cyclictest18635-21/usr/sbin/munin0
18670991713,2cyclictest13695-21/usr/sbin/munin0
18670991712,3cyclictest31790-21unixbench_singl0
18670991712,3cyclictest2489-21sendmail-mta0
18670991712,3cyclictest21233-21df0
18670991712,3cyclictest17398-21latency0
18670991712,3cyclictest10601-21sh0
18670991711,4cyclictest26633-21seq0
18670991711,3cyclictest30367-21aten2_r9power_e0
1867999169,5cyclictest7493-21grep2
18679991611,3cyclictest9851-21tr2
18679991611,3cyclictest662-21runrttasks2
18679991611,3cyclictest14394-21sed2
18679991611,3cyclictest11250irq/128-xhci_hc2
18670991612,2cyclictest662-21runrttasks0
18670991610,3cyclictest662-21runrttasks0
1867999159,3cyclictest8573-21aten2.4-expect2
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional