You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-14 - 05:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6s.osadl.org (updated Tue Oct 14, 2025 00:44:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2210221490,3chrt22104-21ntpq20:20:240
2487214521,32sleep02530-21irqstats19:05:160
1637121350,2sleep016372-21ntpq22:10:240
1134821280,3chrt11349-21awk21:50:290
3046921250,3sleep030472-21latency23:05:190
52321220,2sleep0524-21if_eth023:15:150
196982960,4sleep019767-21/usr/sbin/munin20:10:320
80682940,3sleep08113-21latency_hist23:45:020
102972928,70sleep010151-21/usr/sbin/munin19:35:180
158022880,3sleep015840-21sed00:15:010
316392836,63sleep031644-21df23:10:140
46232713,5sleep00-21swapper19:13:110
215862710,2sleep021585-21switchtime00:35:280
3593996322,14cyclictest29706-21runrttasks23:01:100
359399619,18cyclictest13497-21/usr/sbin/munin22:00:170
359399616,18cyclictest6350irq/103-63fec0019:55:290
3593996130,22cyclictest6867-21/usr/sbin/munin19:20:300
3593996110,18cyclictest23849-21/usr/sbin/munin22:40:310
288512610,3sleep028852-21idleruntime-cro20:50:000
359399608,18cyclictest17365-21/usr/sbin/munin22:15:210
359399607,17cyclictest21250-21/usr/sbin/munin22:30:330
3593996011,19cyclictest20910-21systemctl20:15:270
3593996011,19cyclictest18827-21ntp_states00:25:250
3593996010,17cyclictest19086-21munin-run20:10:000
359399599,15cyclictest13700-21/usr/sbin/munin00:05:260
359399598,16cyclictest11467-21/usr/sbin/munin19:40:280
359399597,18cyclictest18733-21grep22:20:140
359399597,15cyclictest17253-21/usr/sbin/munin00:20:170
3593995910,18cyclictest28874-21munin-run23:00:010
3593995910,18cyclictest24346-21wc20:30:010
3593995910,16cyclictest32435-21irqstats21:05:170
359399589,19cyclictest16515-21users00:15:300
359399589,18cyclictest5729-21/usr/sbin/munin21:30:180
359399589,18cyclictest4306-21/usr/sbin/munin23:30:130
359399589,16cyclictest22535-21/usr/sbin/munin22:35:250
359399589,15cyclictest26470-21df22:50:140
359399589,14cyclictest14336-21ntp_states19:50:280
359399588,16cyclictest8179-21/usr/sbin/munin23:45:130
359399588,15cyclictest6064-21sshd19:19:250
359399588,15cyclictest28976-21/usr/sbin/munin20:50:150
359399587,17cyclictest16045-21latency_hist22:10:020
359399587,16cyclictest12185-21/usr/sbin/munin21:55:250
3593995835,15cyclictest20116-21/usr/sbin/munin22:25:180
3593995835,13cyclictest4725-21/usr/sbin/munin21:25:210
3593995834,15cyclictest31505-21/usr/sbin/munin21:00:230
3593995834,14cyclictest7858-21/usr/sbin/munin19:25:210
3593995833,15cyclictest9165-21/usr/sbin/munin19:30:250
3593995812,17cyclictest16692-21df_inode20:00:150
3593995810,17cyclictest22189-21snmpd21:45:380
359399579,15cyclictest8330-21/usr/sbin/munin21:40:210
359399578,16cyclictest3164-21/usr/sbin/munin21:20:160
359399578,16cyclictest19960-21seq00:30:160
359399576,13cyclictest22189-21snmpd23:58:110
3593995716,15cyclictest251932chrt20:32:120
359399569,17cyclictest25754-21/usr/sbin/munin20:35:170
359399569,14cyclictest13329-21sort19:45:310
359399568,17cyclictest12064-21/usr/sbin/munin00:00:310
359399568,16cyclictest7311-21ntp_states21:35:240
3593995634,14cyclictest10308-21runrttasks23:52:270
3593995629,17cyclictest3751-21sshd23:26:320
3593995611,17cyclictest25723-21users22:45:300
359399558,17cyclictest1834-21/usr/sbin/munin21:15:130
359399558,14cyclictest1732-21/usr/sbin/munin23:20:260
3593995532,14cyclictest6562-21runrttasks23:38:340
3593995530,15cyclictest27045-21runrttasks20:40:440
359399548,16cyclictest30660-21sshd20:58:300
3593995224,15cyclictest985-21cron21:10:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional