You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 16:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 50 highest latencies:
System rack7slot7s.osadl.org (updated Sat Nov 29, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3572210390,9sleep30-21swapper/307:08:143
3388210288,9sleep10-21swapper/107:05:501
361428270,8sleep00-21swapper/007:08:460
343628063,13sleep20-21swapper/207:06:272
379899290,28cyclictest0-21swapper/210:05:072
378899263,5cyclictest29565-21sed12:10:000
379899240,23cyclictest0-21swapper/211:46:392
378899243,5cyclictest20646-21ntp_kernel_err08:50:220
378899240,23cyclictest0-21swapper/009:36:190
380299214,10cyclictest0-21swapper/307:40:143
3802992120,1cyclictest0-21swapper/312:07:503
3794992118,2cyclictest11838-21sendmail10:40:001
379499210,20cyclictest0-21swapper/110:01:211
3788992117,3cyclictest0-21swapper/011:28:150
380299209,7cyclictest707-21apache211:08:553
3798992016,3cyclictest32-21ksoftirqd/208:00:012
378899204,4cyclictest4471-21/usr/sbin/munin12:15:160
378899204,15cyclictest3154-21perf11:25:000
3798991918,1cyclictest0-21swapper/208:45:152
378899194,5cyclictest23073-21ssh10:22:240
378899191,7cyclictest224-21systemd-journal11:03:300
378899191,6cyclictest19274-21perf08:50:000
3788991916,3cyclictest0-21swapper/009:42:440
380299180,1cyclictest0-21swapper/310:30:583
379899181,16cyclictest24048-21cat07:50:202
379899180,1cyclictest0-21swapper/210:45:282
378899189,8cyclictest18492-21grep11:10:230
3788991811,7cyclictest0-21swapper/010:06:020
3788991810,7cyclictest16145-21sh12:00:000
379899173,2cyclictest7395-21munin-run09:45:002
379899173,1cyclictest0-21swapper/210:55:152
379499170,3cyclictest0-21swapper/109:35:161
379499170,1cyclictest0-21swapper/111:27:311
378899179,3cyclictest13614-21tr10:15:170
378899179,2cyclictest24938-21/usr/sbin/munin10:50:220
378899179,2cyclictest11627-21tr11:05:150
378899178,2cyclictest7152-21head07:15:170
378899174,7cyclictest19557-21munin-run09:55:000
378899173,8cyclictest1291-21runrttasks11:50:510
378899170,5cyclictest0-21swapper/012:35:270
3798991615,1cyclictest0-21swapper/211:35:182
3798991611,3cyclictest16161-21cstates09:25:152
379499163,12cyclictest19079-21kworker/1:110:45:201
378899169,2cyclictest24362-21grep09:00:160
378899168,2cyclictest3667-21ssh09:15:140
378899168,2cyclictest29302-21ssh12:31:120
378899168,2cyclictest18855-21ssh09:26:550
378899168,2cyclictest13543-21ntp_states10:40:220
378899168,1cyclictest29448-21wc09:10:160
378899167,2cyclictest22288-21chrt12:04:570
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional