You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-05 - 02:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot5s.osadl.org (updated Tue Nov 04, 2025 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1401999260,24cyclictest313-21systemd-journal10:00:000
1403399250,0cyclictest0-21swapper/309:50:363
1403399250,0cyclictest0-21swapper/307:45:363
1403399242,21cyclictest6385-21awk10:15:003
1403399240,0cyclictest0-21swapper/312:00:373
1403399240,0cyclictest0-21swapper/310:30:353
14019992422,1cyclictest13-21ksoftirqd/009:30:000
14033992316,6cyclictest3964-21cron10:10:003
1403399230,22cyclictest12862-21awk11:35:003
1403399230,22cyclictest10578-21dpkg08:10:013
1402899230,22cyclictest7461-21cron09:10:002
1402899230,22cyclictest313-21systemd-journal08:35:002
1402899230,22cyclictest2669-21latency_hist09:00:012
1402899230,22cyclictest10443-21apt12:35:382
14024992321,1cyclictest29425-21apt-get09:55:361
14024992321,1cyclictest27297-21wc12:04:591
1402499230,22cyclictest3240-21cron11:15:001
1402499230,22cyclictest0-21swapper/109:10:371
1401999230,22cyclictest593-21dbus-daemon09:15:000
1401999230,22cyclictest0-21swapper/008:35:000
14033992222,0cyclictest28814-21apt-get07:40:363
14033992220,1cyclictest2163-21sendmail-msp12:20:013
14033992220,1cyclictest19523-21munin-plugin-st09:34:593
14033992220,1cyclictest19523-21munin-plugin-st09:34:593
14033992220,1cyclictest0-21swapper/308:55:013
1403399220,21cyclictest27841-21dump-pmu-power08:44:593
1403399220,21cyclictest0-21swapper/312:20:403
1403399220,21cyclictest0-21swapper/312:10:393
1403399220,21cyclictest0-21swapper/311:55:393
1403399220,21cyclictest0-21swapper/308:55:373
1403399220,1cyclictest5974-21apt-get11:20:373
14028992220,1cyclictest27304-21ls12:05:002
14028992220,1cyclictest24318-21dump-pmu-power09:45:012
14028992220,1cyclictest0-21swapper/211:25:372
1402899220,21cyclictest7797-21apt-get09:10:382
1402899220,21cyclictest6382-21munin-run10:14:592
1402899220,21cyclictest609-21polkitd09:40:012
1402899220,21cyclictest15740-21apt-get08:20:382
1402899220,21cyclictest0-21swapper/211:40:002
1402899220,1cyclictest28721-21apt-get11:00:392
1402899220,1cyclictest1146-21apt-get11:10:392
1402499220,21cyclictest30299-21perf08:50:011
1402499220,21cyclictest25438-21sendmail-msp08:40:001
1402499220,21cyclictest16382-21cron10:35:011
1402499220,21cyclictest0-21swapper/111:20:381
1402499220,21cyclictest0-21swapper/108:10:361
1402499220,21cyclictest0-21swapper/108:05:361
1402499220,21cyclictest0-21swapper/107:35:361
1402499220,21cyclictest0-21swapper/107:15:011
1402499220,0cyclictest0-21swapper/110:00:371
14019992222,0cyclictest0-21swapper/011:10:400
14019992221,0cyclictest3554-21apt-get11:15:390
14019992220,1cyclictest12319-21munin-run09:20:000
14019992220,1cyclictest0-21swapper/008:35:390
1401999220,21cyclictest598-21rs:main0
1401999220,21cyclictest18768-21idleruntime-cro07:20:010
1401999220,21cyclictest14685-21cron09:25:000
1401999220,21cyclictest0-21swapper/012:20:410
1401999220,21cyclictest0-21swapper/011:30:370
1401999220,1cyclictest0-21swapper/011:59:590
1403399212,18cyclictest0-21swapper/311:50:383
14033992120,1cyclictest21212-21munin-run10:45:003
14033992119,2cyclictest0-21swapper/312:25:363
14033992118,3cyclictest0-21swapper/309:15:383
14033992118,2cyclictest17843-21munin-run08:25:003
1403399210,20cyclictest6989-21apt-get10:15:023
1403399210,20cyclictest0-21swapper/312:34:593
1403399210,20cyclictest0-21swapper/311:45:383
1403399210,20cyclictest0-21swapper/310:35:383
1403399210,20cyclictest0-21swapper/309:55:383
1403399210,20cyclictest0-21swapper/308:00:373
1403399210,1cyclictest2299-21ntpq07:50:443
1403399210,1cyclictest0-21swapper/311:05:003
1403399210,1cyclictest0-21swapper/309:35:393
1403399210,0cyclictest0-21swapper/310:20:393
1403399210,0cyclictest0-21swapper/310:20:393
1403399210,0cyclictest0-21swapper/308:45:393
14028992121,0cyclictest0-21swapper/211:45:382
14028992121,0cyclictest0-21swapper/211:15:382
14028992120,0cyclictest0-21swapper/211:40:382
14028992119,1cyclictest0-21swapper/209:35:002
14028992119,1cyclictest0-21swapper/209:35:002
1402899210,21cyclictest0-21swapper/208:25:342
1402899210,20cyclictest11891-21apt-get10:25:392
1402899210,20cyclictest0-21swapper/211:55:392
1402899210,0cyclictest0-21swapper/212:15:372
14024992120,1cyclictest1244-21apt-get07:50:381
14024992120,1cyclictest0-21swapper/109:30:371
14024992120,1cyclictest0-21swapper/109:30:371
14024992120,0cyclictest0-21swapper/107:30:371
14024992118,1cyclictest0-21swapper/109:40:381
1402499210,20cyclictest18791-21idleruntime-cro10:40:011
1402499210,20cyclictest10444-21apt-get12:35:381
1402499210,20cyclictest0-21swapper/109:20:391
1402499210,1cyclictest12876-21awk11:35:001
1402499210,0cyclictest0-21swapper/111:25:371
14019992121,0cyclictest0-21swapper/008:45:390
14019992119,1cyclictest593-21dbus-daemon09:00:000
14019992119,1cyclictest10610-21munin-plugin-st08:10:010
14019992118,2cyclictest13-21ksoftirqd/008:25:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional