You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-21 - 21:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 50 highest latencies:
System rack5slot3s.osadl.org (updated Thu Aug 21, 2025 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
291662241163,25sleep00-21swapper/007:08:150
293012216163,39sleep20-21swapper/207:09:582
289922215141,24sleep10-21swapper/107:05:591
289942202164,25sleep30-21swapper/307:06:013
29403991081,2cyclictest0-21swapper/209:24:302
29403996662,2cyclictest26408-21/usr/sbin/munin09:25:252
29403996662,2cyclictest26408-21/usr/sbin/munin09:25:252
9122570,2sleep20-21swapper/208:30:142
93742540,4sleep123-21ksoftirqd/110:00:301
29403995350,2cyclictest0-21swapper/211:30:582
242802530,5sleep32940799cyclictest10:35:193
135402510,1sleep10-21swapper/112:40:011
2940399422,3cyclictest26496-21memory10:40:192
2939699421,29cyclictest4229-21/usr/sbin/munin11:05:271
2940399415,29cyclictest31204-40dnf07:10:332
2939699411,23cyclictest11219-21dump-pmu-power12:35:011
2940399404,6cyclictest14137-40dnf10:12:242
2939699402,35cyclictest20979-21ntp_states08:00:251
2939699401,27cyclictest0-21swapper/107:15:261
2939699391,29cyclictest6687-21expr11:10:141
29403993822,5cyclictest18049-21diskstats07:55:142
2940399381,5cyclictest13088-21awk11:25:162
2939699381,27cyclictest24427-21/usr/sbin/munin10:35:211
2939699381,26cyclictest18351-21/usr/sbin/munin09:10:231
2939699381,23cyclictest1130-21sh09:45:021
2940399373,3cyclictest86850irq/129-enp1s0-10:35:262
2940399371,7cyclictest29629-21memory08:20:192
2939699373,26cyclictest8170-21grep12:25:251
2939699371,28cyclictest4543-21grep07:25:141
2939699371,25cyclictest814-21sshd08:35:321
2939699370,27cyclictest0-21swapper/112:20:141
21972370,7sleep07-21ksoftirqd/009:45:180
2939699361,3cyclictest8687-21munin-run07:35:011
2939699361,21cyclictest0-21swapper/110:30:161
2939699361,21cyclictest0-21swapper/110:30:151
2940399353,5cyclictest5779-21/usr/sbin/munin09:55:192
2940399353,3cyclictest2363-21needreboot09:45:202
2940399351,5cyclictest4629-21latency_hist12:20:022
2940399351,31cyclictest9213-21find10:00:272
29396993519,13cyclictest13210-21grep10:10:191
29396993517,15cyclictest6421-21expr09:55:171
2939699351,3cyclictest14984-21latency_hist11:30:021
2939699350,24cyclictest0-21swapper/108:20:011
2940399343,6cyclictest4016-21ntp_states08:35:222
2940399341,6cyclictest0-21swapper/212:30:192
2940399341,5cyclictest3996-21latency_hist11:05:012
2940399341,4cyclictest0-21swapper/210:50:272
2940399341,30cyclictest20896-21diskstats09:15:152
2940399341,18cyclictest31299-21cat09:39:562
2939699341,4cyclictest27558-21awk10:45:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional