You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 10:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack4slot6s.osadl.org (updated Fri Apr 26, 2024 00:44:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1464022990,3sleep014638-21netstat22:50:210
2784222070,2sleep027841-21awk21:35:270
3042321610,2sleep030421-21open_inodes21:45:270
146821450,4chrt1469-21latency_hist22:00:020
3053821440,4chrt30286-21/usr/sbin/munin19:40:210
124521310,3sleep01247-21sort00:05:020
2691521280,3sleep026914-21switchtime19:25:300
1821621140,3sleep018219-21latency_hist23:05:020
1991221110,4sleep019581-21/usr/sbin/munin23:10:260
67821040,4sleep0676-21ntp_states19:50:220
224329910477,17cyclictest108-21systemd-journal21:28:490
22432999978,12cyclictest4721-21seq00:17:130
22432999876,13cyclictest24813-21df_inode23:30:130
22432999775,12cyclictest30500-21users23:50:290
22432999673,14cyclictest32267-21sshd21:52:500
22432999673,13cyclictest9445-21cpu20:25:090
138582960,4sleep013859-21sendmail-mta22:46:310
22432999574,13cyclictest28509-21/usr/sbin/munin23:45:010
22432999470,14cyclictest24618-21cron23:30:010
22432999460,21cyclictest12455-21chrt22:40:300
22432999373,11cyclictest2902-21ntp_states00:10:220
22432999272,13cyclictest5439-21munin-run20:10:020
22432999272,12cyclictest32036-21mailstats19:45:290
22432999171,12cyclictest3036-21df20:00:130
22432999171,12cyclictest1706-21memory22:00:170
22432999059,19cyclictest6497-21/usr/sbin/munin00:25:330
174692900,3sleep017520-21proc_pri20:55:270
22432998970,12cyclictest24577-21sshd19:16:490
22432998962,18cyclictest23700-21latency_hist19:15:000
22432998958,19cyclictest26369-21/usr/sbin/munin21:30:150
22432998957,19cyclictest8321-21/usr/sbin/munin20:20:170
22432998864,14cyclictest7946-21runrttasks00:30:180
22432998863,13cyclictest22693-21proc_pri21:15:290
22432998862,17cyclictest6989-21ntp_states22:20:240
22432998862,16cyclictest18811-21pluginstate21:00:270
22432998862,15cyclictest29170-21cat23:45:300
22432998858,18cyclictest11423-21sshd22:37:490
22432998857,20cyclictest21238-21/usr/sbin/munin21:10:170
22432998768,11cyclictest4279-21memory22:10:170
22432998765,14cyclictest29276-21open_files19:35:230
22432998765,13cyclictest7609-21runrttasks20:16:510
22432998763,15cyclictest22787-21uptime23:20:340
22432998762,14cyclictest13178-21munin-run20:40:010
22432998758,17cyclictest21144-21/usr/sbin/munin23:15:210
22432998662,15cyclictest5810-21runrttasks22:15:280
22432998658,16cyclictest31795-21vmstat23:55:320
22432998562,14cyclictest14830-21/usr/sbin/munin20:45:240
22432998561,13cyclictest26142-21if_err_eth023:35:160
22432998560,15cyclictest9271-21cpu22:30:120
22432998560,15cyclictest3925-21chrt22:09:450
22432998559,15cyclictest5372-21cat00:20:150
22432998558,16cyclictest15692-21/usr/sbin/munin22:55:190
22432998557,18cyclictest5555-21cpu20:10:090
22432998462,12cyclictest13721-21ps20:40:320
22432998461,13cyclictest9116-21/usr/sbin/munin00:35:130
22432998461,13cyclictest8468-21seq22:25:280
22432998460,14cyclictest25810-21runrttasks19:21:050
22432998458,17cyclictest19885-21if_eth021:05:140
22432998458,17cyclictest1929-21ntpq19:55:200
22432998458,14cyclictest1540-21missed_timers00:05:200
22432998457,18cyclictest24255-21/usr/sbin/munin21:20:290
22432998454,18cyclictest29043-21netstat21:40:170
22432998359,13cyclictest10820-21/usr/sbin/munin20:30:150
22432998356,17cyclictest28675-21runrttasks19:33:370
22432998262,12cyclictest18440-21irqstats23:05:150
22432998257,16cyclictest15878-21/usr/sbin/munin20:50:330
22432997955,13cyclictest22461-21latency_hist19:10:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional