You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 14:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot5s.osadl.org (updated Mon Dec 01, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21880992523,1cyclictest0-21swapper/100:15:001
2188199240,23cyclictest18324-21sh00:35:002
2188099240,0cyclictest0-21swapper/121:57:561
2187999240,23cyclictest14724-21apt-get23:22:580
2188299231,1cyclictest23552-21latency_hist20:20:003
21880992321,1cyclictest1641-21cron23:15:001
21880992320,2cyclictest5964-21idleruntime-cro20:49:591
21880992320,2cyclictest4184-21sendmail-msp22:59:591
2188099230,2cyclictest11502-21idleruntime-cro19:55:001
2187999230,22cyclictest30761-21perf20:35:000
2187999230,22cyclictest28995-21perf22:45:010
21882992222,0cyclictest0-21swapper/323:52:563
21882992220,1cyclictest1446-21munin-run00:00:003
21882992220,1cyclictest14255-21lockfile-remove23:20:003
2188299220,21cyclictest0-21swapper/323:37:583
2188299220,21cyclictest0-21swapper/322:45:023
2188299220,21cyclictest0-21swapper/321:47:563
2188299220,21cyclictest0-21swapper/319:32:553
2188299220,21cyclictest0-21swapper/300:32:573
2188299220,1cyclictest8363-21munin-run20:55:003
2188299220,1cyclictest31884-21idleruntime-cro19:30:003
2188299220,1cyclictest0-21swapper/320:47:563
21881992222,0cyclictest0-21swapper/221:17:562
2188199220,21cyclictest2340-21apt19:37:562
2188199220,21cyclictest0-21swapper/222:50:012
2188199220,21cyclictest0-21swapper/222:17:552
2188199220,21cyclictest0-21swapper/220:40:012
2188199220,1cyclictest0-21swapper/223:45:002
21880992220,1cyclictest0-21swapper/122:35:001
2188099220,21cyclictest11304-21apt-get21:02:561
2188099220,21cyclictest0-21swapper/120:02:541
2188099220,21cyclictest0-21swapper/119:15:001
2188099220,21cyclictest0-21swapper/100:27:561
2188099220,21cyclictest0-21swapper/100:07:561
2188099220,1cyclictest9216-21apt-get00:17:561
2188099220,1cyclictest7735-21apt-get22:02:551
2188099220,1cyclictest6434-21apt-get20:52:571
21879992221,0cyclictest0-21swapper/021:27:570
2187999220,21cyclictest31233-21apt-get20:37:530
2187999220,21cyclictest27556-21apt-get19:22:540
2187999220,21cyclictest26737-21apt-get23:47:550
2187999220,21cyclictest21433-21cron23:35:010
2187999220,21cyclictest0-21swapper/019:42:570
2187999220,21cyclictest0-21swapper/000:17:560
2187999220,1cyclictest720-21apt-get20:40:010
2187999220,1cyclictest20448-21sendmail-msp21:20:000
21882992120,0cyclictest19846-21apt-get22:27:573
21882992119,1cyclictest743-21awk20:40:003
21882992119,1cyclictest16950-21sh22:20:003
21882992118,2cyclictest8724-21basename00:15:003
2188299210,20cyclictest0-21swapper/323:07:583
2188299210,20cyclictest0-21swapper/320:27:543
2188299210,1cyclictest15949-21munin-run00:30:003
2188299210,0cyclictest0-21swapper/321:07:573
2188299210,0cyclictest0-21swapper/320:40:013
21881992119,1cyclictest30535-21apt-get21:42:552
2188199210,20cyclictest16821-21apt-get20:07:552
2188199210,20cyclictest0-21swapper/223:07:582
2188199210,20cyclictest0-21swapper/221:07:562
2188199210,20cyclictest0-21swapper/220:52:572
2188199210,20cyclictest0-21swapper/219:52:582
2188199210,20cyclictest0-21swapper/219:22:542
2188199210,20cyclictest0-21swapper/200:17:552
2188199210,0cyclictest0-21swapper/223:22:582
21880992121,0cyclictest0-21swapper/123:52:561
21880992121,0cyclictest0-21swapper/122:17:561
21880992121,0cyclictest0-21swapper/121:27:571
21880992120,0cyclictest0-21swapper/123:42:571
21880992120,0cyclictest0-21swapper/123:27:571
2188099210,21cyclictest0-21swapper/119:17:581
2188099210,20cyclictest1633-21apt-get20:42:571
2188099210,20cyclictest0-21swapper/122:47:581
2188099210,20cyclictest0-21swapper/121:32:551
2188099210,0cyclictest13704-21apt-get21:07:571
2188099210,0cyclictest0-21swapper/120:17:541
2188099210,0cyclictest0-21swapper/100:02:551
21879992121,0cyclictest16099-21apt-get21:12:560
21879992121,0cyclictest0-21swapper/022:37:560
21879992121,0cyclictest0-21swapper/020:52:570
21879992121,0cyclictest0-21swapper/000:22:570
21879992120,1cyclictest598-21rs:main0
21879992120,1cyclictest22832-21turbostat21:25:000
21879992120,1cyclictest14032-21apt-get00:27:560
21879992120,1cyclictest12305-21apt-get23:17:560
21879992119,1cyclictest31778-21perf22:50:000
21879992119,1cyclictest27628-21latency_hist21:35:000
2187999210,20cyclictest0-21swapper/020:12:560
2187999210,20cyclictest0-21swapper/000:02:550
2187999210,0cyclictest9555-21apt-get19:52:580
2187999210,0cyclictest1756-21perf22:54:590
2187999210,0cyclictest17118-21apt-get23:27:560
2187999210,0cyclictest0-21swapper/000:07:570
21882992020,0cyclictest0-21swapper/322:57:563
21882992020,0cyclictest0-21swapper/322:32:553
21882992020,0cyclictest0-21swapper/321:02:563
21882992020,0cyclictest0-21swapper/319:52:583
21882992019,1cyclictest26551-21cron22:40:003
21882992018,1cyclictest4423-21apt-get00:07:573
2188299200,20cyclictest0-21swapper/323:29:593
2188299200,1cyclictest0-21swapper/323:02:563
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional