You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-07 - 21:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack4slot6s.osadl.org (updated Thu Dec 07, 2023 12:44:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
165922310,3sleep01661-21grep08:50:350
1674121770,4sleep016747-21df_inode09:50:190
2253721490,4chrt22055-21/usr/sbin/munin08:05:350
2847921450,2sleep028478-21/usr/sbin/munin10:35:250
1035621340,3chrt10354-21grep07:20:020
1420121320,3chrt14199-21forks09:40:200
885721290,2sleep08856-21df11:25:200
1049521270,4chrt10496-21run-parts11:30:330
609921260,4chrt6100-21latency_hist11:15:010
482421230,2sleep04826-21sort11:10:020
2338921070,3sleep023436-21sendmail_mailtr12:20:330
2071721010,2sleep020716-21/usr/sbin/munin10:05:240
1971021000,4sleep019712-21users12:05:380
151052990,3sleep015155-21latency_hist11:50:000
79132980,4sleep07962-21systemctl11:20:320
263372980,3sleep026392-21tr08:20:350
147842980,3sleep014836-21timerandwakeup07:35:370
53262960,4sleep05341-21ntpq09:05:290
164672960,2sleep016468-21ls11:55:020
195822917,9sleep019629-21grep10:00:320
205932886,12sleep020598-21wc12:10:280
244252846,65sleep024443-21sed12:25:250
313752820,3sleep031445-21timerwakeupswit10:45:370
187712784,9sleep018773-21users07:50:380
667727720,34sleep06705-21irqstats07:05:240
219072775,61sleep021940-21latency_hist08:05:010
180852764,60sleep018107-21/usr/sbin/munin12:00:290
7202696,51sleep03300-21snmpd10:54:020
774999618,18cyclictest29782-21/usr/sbin/munin08:35:350
7749996019,14cyclictest24895-21seq10:20:350
774999598,19cyclictest25729-21/usr/sbin/munin10:25:220
7749995922,14cyclictest1551-21timerwakeupswit10:55:420
7749995910,16cyclictest7364-21munin-run11:20:020
774999579,17cyclictest25822-21grep12:30:260
774999577,15cyclictest32372-21/usr/sbin/munin08:45:280
7749995732,16cyclictest6881-21/usr/sbin/munin09:10:360
7749995732,16cyclictest12885-21/usr/sbin/munin09:35:210
7749995710,14cyclictest10519-21/usr/sbin/munin07:20:180
774999569,17cyclictest12132-21vmstat09:30:390
774999569,15cyclictest29740-21irqstats10:40:220
774999568,16cyclictest79482chrt09:15:300
774999568,16cyclictest23416-21ntp_states10:15:290
774999567,15cyclictest21849-21/usr/sbin/munin10:10:340
7749995633,15cyclictest11798-21/usr/sbin/munin07:25:190
7749995633,15cyclictest10727-21/usr/sbin/munin09:25:370
7749995631,16cyclictest15885-21/usr/sbin/munin07:40:270
7749995625,20cyclictest0-21swapper08:19:150
7749995610,19cyclictest22848-21awk12:20:000
7749995610,19cyclictest12522-21munin-run11:40:000
774999559,15cyclictest3300-21snmpd07:34:060
774999559,15cyclictest28796-21ntp_states08:30:320
774999557,16cyclictest27217-21/usr/sbin/munin08:25:260
774999557,16cyclictest23332-21/usr/sbin/munin08:10:330
774999557,16cyclictest2297-21/usr/sbin/munin11:00:370
774999557,15cyclictest9406-21/usr/sbin/munin09:20:330
7749995531,16cyclictest18091-21latency_hist07:50:010
7749995531,15cyclictest4314-21/usr/sbin/munin09:00:330
7749995522,21cyclictest3300-21snmpd11:55:520
7749995511,17cyclictest9100-21latency_hist07:15:010
7749995510,17cyclictest28000-21munin-run12:40:010
774999549,15cyclictest2471-21/usr/sbin/munin08:55:220
774999549,15cyclictest16707-21rs:main0
774999548,15cyclictest27197-21load10:30:250
7749995430,16cyclictest13387-21runrttasks11:41:320
774999539,15cyclictest18263-21sendmail-mta09:55:310
7749995329,16cyclictest32187-21runrttasks08:44:440
7749995310,14cyclictest19454-21/usr/sbin/munin07:55:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional