You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-03 - 02:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack4slot6s.osadl.org (updated Mon Nov 03, 2025 00:44:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2534822690,3sleep025349-21/usr/sbin/munin19:20:160
2705922090,3sleep027061-21ls19:25:300
2882921420,3sleep028833-21modprobe21:40:010
2627221320,2sleep026274-21idleruntime-cro21:30:010
21859213220,86sleep021921-21users19:05:260
3048621290,3chrt30487-21/usr/sbin/munin19:40:160
1935621290,3chrt19357-21sshd23:07:380
2646921260,3sleep026468-21forks21:30:150
2108021200,3sleep021081-21latency_hist21:10:000
225489911610,92cyclictest546-21ntp_states00:00:250
225489911310,88cyclictest23928-21/usr/sbin/munin19:15:250
22548991128,92cyclictest8005-21grep00:30:130
22548991128,90cyclictest2126-21/usr/sbin/munin00:05:290
22548991128,89cyclictest32571-21munin-run00:00:010
225489911210,88cyclictest7257-21ntp_states20:15:210
22548991119,87cyclictest14599-21/usr/sbin/munin22:50:210
22548991117,90cyclictest12148-21/usr/sbin/munin22:40:160
225489911110,90cyclictest23888-21df_inode21:20:170
225489911110,88cyclictest11892-21munin-run22:40:010
22548991108,87cyclictest30833-21chrt23:51:240
225489911010,86cyclictest2976-21munin-run20:00:000
225489911010,85cyclictest18483-21/usr/sbin/munin21:00:000
22548991099,86cyclictest23861-21memory23:25:210
22548991099,73cyclictest25038-21/usr/sbin/munin23:30:170
22548991098,88cyclictest4773-21cat22:10:290
22548991097,88cyclictest22945-21/usr/sbin/munin21:15:290
22548991096,89cyclictest6412-21seq22:17:330
225489910924,73cyclictest14044-21/usr/sbin/munin20:40:290
225489910911,83cyclictest14475-21latency_hist22:50:020
225489910911,82cyclictest3043-21df22:05:170
22548991089,87cyclictest22928-21ntp_states19:10:200
22548991088,88cyclictest5713-21ntpq00:20:210
22548991088,87cyclictest23257-21sshd23:22:410
22548991088,87cyclictest17455-21ntpq23:00:210
22548991088,86cyclictest9895-21open_inodes20:25:250
22548991088,86cyclictest29155-21df_inode19:35:130
22548991088,84cyclictest12145-21/usr/sbin/munin20:35:250
22548991087,89cyclictest29122-21ntp_states23:45:250
22548991087,87cyclictest26515-21runrttasks23:35:210
22548991087,87cyclictest20625-21chrt23:12:330
22548991087,86cyclictest4734-21/usr/sbin/munin20:05:250
22548991087,72cyclictest4332-21sed00:15:180
22548991086,89cyclictest16824-21sshd20:52:050
22548991086,88cyclictest8347-21/usr/sbin/munin22:25:210
22548991086,88cyclictest5974-21/usr/sbin/munin20:10:210
225489910827,71cyclictest2938-21latency_hist22:05:020
22548991079,86cyclictest8488-21memory20:20:200
22548991077,88cyclictest2979-21uname00:10:210
22548991077,86cyclictest27606-21df_inode23:40:120
22548991077,86cyclictest16075-21/usr/sbin/munin22:55:210
22548991068,86cyclictest10364-21runrttasks22:33:080
22548991068,82cyclictest21395-21memory21:10:180
22548991068,82cyclictest14745-21/usr/sbin/munin20:45:280
225489910628,68cyclictest442-21/usr/sbin/munin21:55:140
225489910625,70cyclictest370-21ntpd20:30:250
22548991059,82cyclictest18623-21/usr/sbin/munin21:00:250
22548991058,85cyclictest10477-21sendmail-msp00:40:010
22548991058,84cyclictest30192-21latency_hist21:45:010
22548991058,83cyclictest7013-21irqstats22:20:170
22548991058,80cyclictest324-21munin-node23:15:130
225489910510,70cyclictest7585-21chrt00:27:420
22548991046,86cyclictest30320-21/usr/sbin/munin21:45:130
225489910410,80cyclictest792-21awk19:50:210
22548991036,85cyclictest31781-21fw_packets19:45:160
225489910310,77cyclictest28116-21/usr/sbin/munin19:30:250
22548991026,84cyclictest3256-21irqstats20:00:170
225489910110,77cyclictest31552-21/usr/sbin/munin21:50:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional