You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-19 - 02:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6s.osadl.org (updated Thu Jun 19, 2025 00:44:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30121570,2sleep0300-21entropy21:00:160
1181421440,2sleep011813-21if_err_eth023:50:180
1952721350,4chrt19528-21latency_hist22:15:010
786121310,2sleep07862-21idleruntime-cro21:29:590
547221280,3chrt5473-21latency_hist19:15:020
371821270,3chrt25266-21snmpd21:12:570
3245821230,4chrt32459-21latency_hist23:05:010
1457821140,3sleep014597-21ntp_states00:00:260
377721070,4sleep03803-21idleruntime-cro23:20:000
223772980,4sleep022444-21/usr/sbin/munin00:30:270
123022980,3sleep012329-21ntp_states19:40:210
104602950,3sleep010514-21sed21:40:010
106622900,4sleep010444-21/usr/sbin/munin23:45:260
51942860,4sleep0436-21sendmail-mta21:19:300
193482824,7sleep019379-21latency_hist00:20:020
326627820,33sleep03272-21ntp_states19:05:220
169152734,59sleep016987-21latency_hist22:05:010
4189996342,13cyclictest29857-21latency_hist22:55:020
4189996310,19cyclictest5235-21/usr/sbin/munin23:25:280
4189996218,13cyclictest25266-21snmpd20:08:280
418999618,24cyclictest23167-21sshd22:28:330
4189996127,24cyclictest21657-21users20:15:300
4189996011,17cyclictest21047-21ntp_states00:25:230
4189996010,18cyclictest27536-21/usr/sbin/munin20:40:130
418999599,18cyclictest23664-21/usr/sbin/munin20:25:300
418999599,17cyclictest30543-21runrttasks20:50:270
418999599,17cyclictest13061-21df_inode23:55:160
4189995910,16cyclictest5573-21/usr/sbin/munin19:15:290
4189995910,16cyclictest19488-21/usr/sbin/munin00:20:320
418999588,17cyclictest26073-21/usr/sbin/munin22:40:290
418999588,17cyclictest14613-21/usr/sbin/munin19:50:210
418999588,16cyclictest9459-21/usr/sbin/munin19:30:280
418999587,16cyclictest17300-21ntpq22:05:230
4189995834,14cyclictest4084-21/usr/sbin/munin23:20:210
4189995832,16cyclictest14508-21/usr/sbin/munin21:55:160
4189995832,15cyclictest1713-21/usr/sbin/munin21:05:200
4189995811,17cyclictest24811-21df22:35:120
4189995810,16cyclictest27356-21/usr/sbin/munin22:45:310
4189995810,15cyclictest5478-21/usr/sbin/munin21:20:130
418999579,16cyclictest9022-21sshd19:27:330
418999579,14cyclictest305302sleep022:55:340
418999578,14cyclictest7985-21/usr/sbin/munin21:30:280
418999578,14cyclictest10785-21grep19:35:150
418999577,18cyclictest6520-21/usr/sbin/munin23:30:220
4189995731,16cyclictest13035-21latency_hist21:50:000
4189995718,13cyclictest21169-21grep22:20:220
4189995710,18cyclictest9010-21awk23:40:000
4189995710,18cyclictest13432-21ntpq21:50:220
206992573,9sleep00-21swapper20:13:080
418999569,15cyclictest31719-21awk20:55:290
418999569,14cyclictest15818-21/usr/sbin/munin00:05:210
418999568,16cyclictest19737-21/usr/sbin/munin22:15:180
418999568,16cyclictest17206-21/usr/sbin/munin20:00:260
418999568,15cyclictest26418-21memory20:35:200
418999568,15cyclictest15882-21seq19:55:080
418999567,15cyclictest23474-21/usr/sbin/munin22:30:130
4189995634,13cyclictest23807-21/usr/sbin/munin00:35:340
4189995632,15cyclictest1883-21/usr/sbin/munin23:10:330
4189995621,12cyclictest17379-21switchtime00:10:260
4189995614,14cyclictest29030-21missed_timers20:45:220
418999559,13cyclictest22916-21wc20:20:300
418999558,15cyclictest10580-21/usr/sbin/munin21:40:290
418999557,17cyclictest10246-21seq23:44:360
418999557,15cyclictest7855-21seq19:23:300
4189995511,15cyclictest368-21/usr/sbin/munin23:05:230
418999546,18cyclictest13458-21/usr/sbin/munin19:45:170
418999546,16cyclictest24942-21grep20:30:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional