You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 13:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack4slot6s.osadl.org (updated Sat Nov 22, 2025 00:44:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
524621470,2sleep05245-21irqstats19:40:200
515221410,4chrt5147-21ntp_states23:50:230
2135521410,3sleep021356-21sshd22:47:240
3116421390,4chrt31163-21idleruntime19:15:160
2362721320,3chrt23629-21timerandwakeup22:55:280
892121230,2sleep08922-21latency_hist19:55:020
1514721180,2sleep015150-21wc00:30:020
1668621100,3sleep016750-21/usr/sbin/munin00:35:220
1913721060,3sleep019138-21cut22:40:020
260121020,3sleep02618-21/usr/sbin/munin21:35:210
287262980,4sleep028779-21/usr/sbin/munin23:15:280
169772980,4sleep017006-21/usr/sbin/munin20:25:200
273162970,2sleep027315-21/usr/sbin/munin23:10:290
234352910,4sleep023461-21ntp_states20:50:190
108842880,4sleep0436-21sendmail-mta20:00:390
313042875,9sleep031357-21switchtime23:25:290
38442840,4sleep03861-21irqstats21:40:160
299762840,3sleep030031-21awk19:10:170
99132825,65sleep09976-21latency_hist00:10:010
282672820,2sleep028270-21latency_hist21:10:020
195242826,65sleep019528-21ntp_states22:40:240
220472800,3sleep022050-21grep20:45:180
115962800,3sleep011595-21/usr/sbin/munin00:15:230
131922790,2sleep013193-21systemctl22:15:270
247502786,60sleep024748-21ntp_states20:55:230
2848127419,31sleep028531-21df19:05:090
262762715,54sleep026285-21users23:05:290
75482700,2sleep07549-21basename00:00:160
29690996625,13cyclictest6972-21users19:45:280
29690996134,16cyclictest28412-21/usr/sbin/munin21:10:120
2969099608,16cyclictest22189-21snmpd21:27:110
2969099599,17cyclictest12832-21/usr/sbin/munin20:10:250
2969099598,16cyclictest18012-21/usr/sbin/munin20:30:200
2969099596,14cyclictest32744-21runrttasks23:30:280
2969099589,18cyclictest9176-21ntpq22:00:230
2969099589,18cyclictest32586-21memory19:20:210
2969099589,17cyclictest15446-21/usr/sbin/munin20:20:200
2969099589,16cyclictest21569-21sshd20:43:240
2969099589,16cyclictest15718-21awk00:30:280
2969099589,15cyclictest12631-21/usr/sbin/munin00:20:270
2969099588,17cyclictest24545-21irqstats23:00:170
2969099588,17cyclictest19347-21/usr/sbin/munin20:35:130
2969099588,17cyclictest15349-21/usr/sbin/munin22:25:250
2969099587,11cyclictest7866-21sshd21:55:240
29690995833,16cyclictest6368-21/usr/sbin/munin21:50:150
29690995833,16cyclictest5141-21/usr/sbin/munin21:45:140
29690995833,16cyclictest29631-21/usr/sbin/munin23:20:110
2969099579,15cyclictest21807-21/usr/sbin/munin22:50:280
2969099578,17cyclictest4791-21runrttasks23:50:010
2969099578,16cyclictest8947-21/usr/sbin/munin19:55:200
2969099578,16cyclictest10027-21/usr/sbin/munin00:10:260
2969099577,18cyclictest11977-21grep22:10:270
29690995733,14cyclictest2563-21df_inode19:30:150
29690995732,15cyclictest1489-21/usr/sbin/munin19:25:220
29690995711,16cyclictest108-21systemd-journal21:04:240
29690995711,15cyclictest16862-21/usr/sbin/munin22:30:200
2969099569,16cyclictest6425-21ntp_states23:55:200
2969099568,15cyclictest981-21/usr/sbin/munin23:35:240
2969099567,17cyclictest30972-21/usr/sbin/munin21:20:160
2969099567,17cyclictest30060-21find21:15:280
2969099567,16cyclictest10589-21mailstats22:05:260
29690995633,15cyclictest4047-21/usr/sbin/munin19:35:190
29690995632,14cyclictest14116-21/usr/sbin/munin22:20:110
29690995611,17cyclictest11848-21ntp_states20:05:230
2969099557,14cyclictest2588-21sshd23:40:250
2969099556,16cyclictest14625-21ls20:15:260
29690995510,16cyclictest1385-21/usr/sbin/munin21:30:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional