You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 06:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot5s.osadl.org (updated Mon Dec 22, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
248899290,23cyclictest313-21systemd-journal00:35:012
249199280,22cyclictest31945-21basename00:35:013
249199270,21cyclictest0-21swapper/320:15:023
248699270,7cyclictest0-21swapper/122:50:001
248899260,21cyclictest0-21swapper/200:10:022
248899260,0cyclictest0-21swapper/220:15:022
248599261,24cyclictest20431-21diskstats19:44:580
249199250,0cyclictest0-21swapper/300:10:023
2488992524,1cyclictest16115-21apt-get21:50:002
2491992422,1cyclictest8412-21latency_hist22:40:013
249199240,3cyclictest14435-21hddtemp_smartct21:45:013
249199240,22cyclictest26460-21sshd21:04:583
249199240,1cyclictest30821-21munin-plugin-st22:20:013
2488992420,3cyclictest26702-21cron00:25:002
2488992417,6cyclictest18511-21apt-get21:55:002
248899240,2cyclictest27194-21apt-get20:00:012
248899240,22cyclictest313-21systemd-journal21:04:582
2486992423,1cyclictest0-21swapper/122:05:001
2486992423,0cyclictest0-21swapper/100:15:011
2486992421,2cyclictest6083-21sed22:35:011
248699240,22cyclictest313-21systemd-journal21:45:011
248599240,3cyclictest27255-21munin-run20:00:010
248599240,23cyclictest21762-21awk20:55:010
248599240,23cyclictest19514-21latency_hist00:10:010
248599240,23cyclictest11167-21/usr/sbin/munin19:25:020
2491992322,0cyclictest0-21swapper/320:25:003
2491992320,2cyclictest24324-21cron00:20:003
249199230,2cyclictest3107-21cat20:15:013
249199230,22cyclictest5962-21awk22:35:013
249199230,22cyclictest27394-21munin-run20:00:013
249199230,22cyclictest22400-21apt-get19:49:583
249199230,22cyclictest19508-21turbostat.cron00:10:013
249199230,21cyclictest606-21dbus-daemon20:30:003
248899230,3cyclictest19307-21perf20:50:012
248899230,22cyclictest5956-21perf22:35:012
248899230,22cyclictest10299-21apt-get19:25:022
248899230,1cyclictest30820-21basename22:20:012
2486992321,1cyclictest0-21swapper/120:00:011
248699230,22cyclictest26725-21idleruntime-cro00:25:001
248699230,22cyclictest12054-21apt-get20:34:591
248599231,21cyclictest25405-21turbostat.cron23:15:010
248599230,22cyclictest622-21gdbus23:05:010
248599230,22cyclictest3705-21/usr/sbin/munin20:15:020
248599230,22cyclictest31430-21idleruntime-cro21:15:000
248599230,22cyclictest2854-21apt-get20:15:010
2491992220,1cyclictest27636-21apt-get23:20:023
2491992220,1cyclictest26722-21awk00:25:003
2491992220,1cyclictest0-21swapper/321:10:003
2491992218,3cyclictest17758-21apt-get22:59:593
249199220,21cyclictest17965-21cron19:40:013
249199220,1cyclictest7200-21apt-get19:19:593
249199220,1cyclictest0-21swapper/322:15:013
2488992222,0cyclictest7260-21apt-get20:25:002
2488992221,1cyclictest606-21dbus-daemon23:40:002
2488992220,1cyclictest9656-21apt-get20:30:002
2488992220,1cyclictest24313-21apt-get00:20:002
2488992219,2cyclictest7627-21cron19:20:012
248899220,2cyclictest8339-21latency_hist22:40:012
248899220,22cyclictest0-21swapper/223:15:002
248899220,21cyclictest0-21swapper/221:20:032
248899220,1cyclictest606-21dbus-daemon00:10:012
2486992220,1cyclictest32218-21cron23:30:001
2486992220,1cyclictest15498-21munin-plugin-st22:55:001
2486992220,1cyclictest10279-21cron19:25:021
248699220,21cyclictest9674-21dump-pmu-power20:30:001
248699220,21cyclictest8316-21munin-run22:40:011
248699220,21cyclictest19306-21idleruntime-cro20:50:011
248699220,21cyclictest11302-21apt-get21:39:581
248699220,21cyclictest0-21swapper/122:29:591
248699220,21cyclictest0-21swapper/121:15:001
248699220,1cyclictest5061-21apt-get23:40:011
248699220,1cyclictest4368-21apt-get21:25:021
248699220,1cyclictest30044-21idleruntime-cro20:05:011
248699220,1cyclictest17142-21basename00:05:011
2485992222,0cyclictest19772-21apt-get00:10:030
2485992220,1cyclictest29139-21munin-run00:30:000
2485992220,1cyclictest29046-21munin-run21:10:010
2485992220,1cyclictest24379-21munin-run00:20:000
248599220,21cyclictest6508-21apt-get21:29:590
248599220,21cyclictest62550irq/127-eno120:25:000
248599220,21cyclictest12184-21latency_hist20:35:000
248599220,1cyclictest6814-21irqstats22:35:020
248599220,1cyclictest29380-21apt-get00:30:020
2491992119,1cyclictest313-21systemd-journal23:40:003
249199210,21cyclictest0-21swapper/319:25:023
249199210,20cyclictest0-21swapper/323:45:013
249199210,1cyclictest8808-21phc2sys-jitter23:45:073
249199210,1cyclictest23318-21apt-get22:05:003
249199210,0cyclictest10576-21apt-get22:45:003
249199210,0cyclictest0-21swapper/321:20:033
2488992118,2cyclictest0-21swapper/222:59:592
2488992117,3cyclictest1311-21awk21:20:002
2488992113,6cyclictest313-21systemd-journal23:35:002
248899210,21cyclictest0-21swapper/223:04:592
248899210,20cyclictest14805-21apt-get19:34:582
248899210,20cyclictest0-21swapper/223:40:022
248899210,20cyclictest0-21swapper/222:05:052
248899210,0cyclictest0-21swapper/221:39:582
2486992121,0cyclictest0-21swapper/121:55:001
2486992120,1cyclictest14648-21apt20:40:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional