You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 03:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Tue Dec 02, 2025 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
305492235163,59sleep20-21swapper/219:08:142
304622230156,60sleep00-21swapper/019:07:060
305652204166,25sleep10-21swapper/119:08:251
305622204166,25sleep30-21swapper/319:08:233
307869910198,2cyclictest0-21swapper/223:23:022
30786999995,3cyclictest0-21swapper/220:32:142
30786998380,2cyclictest0-21swapper/200:11:052
30786997766,6cyclictest0-21swapper/221:30:332
115332770,3sleep30-21swapper/300:30:173
178682590,1sleep10-21swapper/123:30:251
11252580,4sleep121-21rcuc/119:15:021
155202510,5sleep115522-21pmu-power23:25:231
292192500,1sleep30-21swapper/321:30:163
30786994138,2cyclictest0-21swapper/222:38:592
3077499371,24cyclictest25210-21ntp_states21:20:220
108422360,18sleep010844-21kernelversion23:15:200
3078299339,6cyclictest17885-40dnf21:05:191
3077499321,19cyclictest0-21swapper/022:51:260
30792993112,5cyclictest1317-40dnf00:06:233
3078299315,17cyclictest0-21swapper/100:25:211
3077499312,12cyclictest11-21rcuc/020:22:500
30774993112,16cyclictest5674-21munin-run19:25:010
3079299309,5cyclictest0-21swapper/322:05:133
3078299301,21cyclictest26473-21ntp_states23:50:201
3077499301,23cyclictest0-21swapper/000:25:100
3079299291,6cyclictest19510-21sa121:10:013
3078299291,22cyclictest0-21swapper/120:15:181
3078299291,20cyclictest2541-21latency_hist21:45:021
3077499290,12cyclictest21185-21kworker/0:222:39:360
3077499290,10cyclictest0-21swapper/020:10:060
3079299283,16cyclictest0-21swapper/323:45:223
3079299283,16cyclictest0-21swapper/323:45:223
3079299281,18cyclictest0-21swapper/321:53:103
3078299288,10cyclictest30781-21cpu21:35:131
3078299288,10cyclictest30781-21cpu21:35:131
3078299284,12cyclictest0-21swapper/100:30:201
3078299282,13cyclictest0-21swapper/121:15:131
3078299280,22cyclictest0-21swapper/120:12:291
3077499281,12cyclictest0-21swapper/019:45:500
3077499281,11cyclictest0-21swapper/023:50:540
3079299276,13cyclictest86550irq/126-enp1s0-21:35:553
3079299276,13cyclictest86550irq/126-enp1s0-21:35:553
3079299270,17cyclictest0-21swapper/300:11:333
3078299272,15cyclictest0-21swapper/122:43:231
3078299272,15cyclictest0-21swapper/122:43:231
30782992713,12cyclictest28891-21kworker/u8:222:53:511
3078299271,24cyclictest25194-21awk23:50:001
3078299271,24cyclictest25194-21awk23:50:001
3077499271,9cyclictest0-21swapper/023:24:220
3077499271,14cyclictest0-21swapper/019:51:260
3077499271,12cyclictest30146-21df00:00:140
3077499271,10cyclictest0-21swapper/022:07:420
3077499271,10cyclictest0-21swapper/020:04:140
3077499270,14cyclictest0-21swapper/021:54:140
3077499270,13cyclictest0-21swapper/023:56:380
3077499270,12cyclictest0-21swapper/023:35:420
3079299263,16cyclictest0-21swapper/322:12:053
3079299261,19cyclictest0-21swapper/323:04:143
3079299261,18cyclictest0-21swapper/300:17:193
3078299262,15cyclictest0-21swapper/120:07:411
3078299261,22cyclictest4286-21latency23:00:201
3078299261,16cyclictest0-21swapper/119:59:361
3078299261,10cyclictest1951-21cpuspeed_turbos00:10:151
3077499267,3cyclictest0-21swapper/022:42:060
3077499267,3cyclictest0-21swapper/022:42:060
3077499264,12cyclictest17885-40dnf21:05:190
30774992620,3cyclictest9091-21/usr/sbin/munin23:10:250
3077499261,13cyclictest0-21swapper/023:00:140
3077499261,11cyclictest0-21swapper/023:45:340
3077499261,11cyclictest0-21swapper/023:45:340
3077499260,13cyclictest0-21swapper/021:31:260
3077499260,11cyclictest0-21swapper/021:11:420
3079299252,16cyclictest0-21swapper/322:40:433
3079299252,16cyclictest0-21swapper/322:40:433
3079299251,18cyclictest0-21swapper/323:54:363
3079299251,18cyclictest0-21swapper/323:41:343
3079299251,18cyclictest0-21swapper/322:53:093
3079299251,18cyclictest0-21swapper/322:27:433
3079299251,18cyclictest0-21swapper/300:03:563
3079299251,17cyclictest86550irq/126-enp1s0-21:46:273
3079299251,17cyclictest0-21swapper/323:38:553
3079299251,17cyclictest0-21swapper/322:22:063
3079299251,16cyclictest13280-21ntp_states23:20:223
30792992510,9cyclictest0-21swapper/321:44:083
3079299250,7cyclictest0-21swapper/323:59:503
3078299252,11cyclictest6942-21munin-run21:55:021
3078299252,11cyclictest17958-21ntp_states19:50:221
30782992513,3cyclictest0-21swapper/120:49:231
3078299251,21cyclictest768-21in:imjournal22:08:171
3078299251,21cyclictest14116-21sh22:10:131
3078299251,16cyclictest19509-21diskmemload22:02:291
3078299251,15cyclictest0-21swapper/120:55:481
3078299251,11cyclictest7843-21hddtemp_smartct21:55:191
3077499257,15cyclictest489-21munin-run19:15:000
3077499251,14cyclictest0-21swapper/020:33:580
3077499251,12cyclictest0-21swapper/022:48:460
3077499251,10cyclictest0-21swapper/021:16:300
3077499250,11cyclictest0-21swapper/022:57:260
3077499250,11cyclictest0-21swapper/020:08:060
3079299243,14cyclictest86550irq/126-enp1s0-22:15:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional