You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 03:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack4slot6s.osadl.org (updated Tue Nov 25, 2025 00:44:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1674321380,4chrt16744-21/usr/sbin/munin00:20:220
113821380,2sleep01140-21latency_hist19:10:020
497221370,4chrt4970-21irqstats23:35:180
1977621260,3chrt19778-21sort22:25:290
1448721170,3sleep014486-21proc_pri20:00:250
154392930,4sleep015441-21cpu20:05:110
38792920,4sleep03943-21ntp_kernel_pll_21:25:210
234552840,2sleep023456-21ntpq20:35:190
1117998049,17cyclictest18209-21memory20:15:210
230782790,3sleep023161-21latency_hist20:35:020
1117997750,14cyclictest30882-21df_inode23:10:130
1117997346,16cyclictest24420-21df22:45:130
1117997345,19cyclictest19648-21/usr/sbin/munin00:30:320
1117997341,22cyclictest17918-21irqstats00:25:170
93732710,2sleep09371-21grep21:45:280
1117997146,15cyclictest28112-21munin-run23:00:000
1117997142,18cyclictest11359-21/usr/sbin/munin00:00:130
1117997046,13cyclictest15165-21/usr/sbin/munin00:15:250
1117997045,16cyclictest20677-21df20:25:120
1117997041,16cyclictest20784-21chrt22:30:230
1117997038,22cyclictest28499-21irqstats20:55:170
1117997037,20cyclictest19338-21/usr/sbin/munin20:20:290
1117996945,14cyclictest15108-21latency_hist00:15:020
1117996944,15cyclictest17062-21/usr/sbin/munin20:10:240
1117996944,14cyclictest3608-21date21:25:000
1117996944,14cyclictest27131-21df_inode20:50:130
1117996943,17cyclictest10132-21/usr/sbin/munin21:50:130
1117996943,15cyclictest23141-21df_inode22:40:130
1117996943,14cyclictest20627-21ntp_states00:35:210
1117996942,14cyclictest5274-21ntpq21:30:250
1117996940,17cyclictest3823-21/usr/sbin/munin19:20:290
1117996930,24cyclictest12983-21irqstats19:55:170
1117996844,14cyclictest24809-21awk20:40:250
1117996844,14cyclictest11390-21chrt19:49:450
1117996841,16cyclictest1079-21/usr/sbin/munin21:15:170
1117996840,17cyclictest2654-21grep19:15:170
1117996840,17cyclictest2044-21seq23:24:210
1117996838,19cyclictest9486-21/usr/sbin/munin19:40:290
1117996827,15cyclictest8083-21grep19:35:270
1117996745,13cyclictest16494-21date22:15:000
1117996742,16cyclictest8766-21latency_hist21:45:010
1117996742,15cyclictest7431-21munin-run21:40:000
1117996742,14cyclictest32157-21grep23:15:130
1117996742,14cyclictest26044-21tr20:45:200
1117996741,16cyclictest5427-21/usr/sbin/munin19:25:240
1117996642,14cyclictest4056-21sed23:30:280
1117996641,15cyclictest11606-21grep19:50:120
1117996640,16cyclictest1490-21tr19:10:210
1117996640,14cyclictest29536-21runrttasks23:05:080
1117996542,14cyclictest958-21munin-run21:15:000
1117996542,13cyclictest6487-21ps23:40:250
1117996539,16cyclictest21826-21df22:35:130
1117996539,15cyclictest12852-21ntpq00:05:200
1117996538,15cyclictest16584-21runrttasks22:15:090
1117996535,18cyclictest11420-21/usr/sbin/munin21:55:200
1117996441,14cyclictest25901-21/usr/sbin/munin22:50:190
1117996441,12cyclictest3151-21chrt23:27:530
1117996440,15cyclictest9561-21runrttasks23:52:330
1117996440,15cyclictest19081-21munin-run22:25:000
1117996436,19cyclictest28310-21df_inode23:00:150
1117996432,20cyclictest31098-21irqstats21:05:160
1117996340,14cyclictest12792-21df_inode22:00:130
1117996338,14cyclictest30063-21sendmail_mailqu21:00:240
1117996334,16cyclictest10276-21ntp_states23:55:230
1117996139,13cyclictest6617-21sed19:30:210
1117996138,14cyclictest14306-21ntp_states22:05:210
1117996023,23cyclictest8665-21latency_hist23:50:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional