You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-03 - 09:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack4slot6s.osadl.org (updated Thu Jul 03, 2025 00:44:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
956821410,4chrt9565-21ntp_states21:40:220
2252214118,33sleep02301-21awk19:05:120
2461521380,3chrt24617-21modprobe22:40:000
3264421370,4chrt32505-21/usr/sbin/munin23:10:200
248921340,2chrt2493-21cron23:20:000
418021280,3chrt4181-21ntpq23:25:200
1310921280,2sleep013107-21threads19:45:290
622021260,3chrt6219-21sshd23:33:510
2595821240,4chrt25959-21latency_hist22:45:010
1604621110,4sleep016087-21memory20:00:190
1731121010,4sleep017328-21open_files22:10:260
1095921000,3sleep011023-21grep21:45:280
123152950,3sleep012375-21timerandwakeup21:50:290
31592940,3sleep03231-21users23:20:300
141292946,11sleep014172-21cat00:05:010
289402935,14sleep028952-21latency20:50:170
186672928,12sleep018699-21netstat20:10:190
327602850,4sleep0338-21if_eth021:05:170
300842855,64sleep030086-21cpu20:55:140
213692845,10sleep021370-21ntp_states20:20:230
16022836,62sleep01646-21if_eth021:10:190
143372820,3sleep014339-21ls00:05:160
131732785,59sleep013177-21sh21:55:120
186922760,3sleep018741-21systemctl22:15:280
147182630,2sleep014719-21/usr/sbin/munin19:55:110
3457996224,14cyclictest23792-21irqstats20:30:200
345799618,19cyclictest19758-21/usr/sbin/munin20:15:150
3457996110,17cyclictest6683-21memory23:35:210
345799609,19cyclictest11829-21grep19:40:300
3457996010,16cyclictest28922-21open_files22:55:280
345799599,21cyclictest21166-21tr22:25:210
345799599,19cyclictest26060-21/usr/sbin/munin22:45:200
345799599,16cyclictest5240-21/usr/sbin/munin19:15:240
236122590,2sleep023613-21latency_hist20:30:030
345799589,16cyclictest6689-21/usr/sbin/munin21:30:310
345799588,17cyclictest15727-21/usr/sbin/munin22:05:290
345799588,16cyclictest16815-21/usr/sbin/munin00:15:260
345799586,38cyclictest3699-21chrt19:10:160
3457995817,15cyclictest269-21runrttasks00:22:310
3457995811,14cyclictest25266-21snmpd22:52:510
3457995810,16cyclictest27710-21memory20:45:200
3457995810,16cyclictest26236-21/usr/sbin/munin20:40:150
345799579,15cyclictest5654-21/usr/sbin/munin21:25:220
345799578,16cyclictest8908-21/usr/sbin/munin19:30:180
345799576,28cyclictest10142-21irqstats19:35:160
345799576,17cyclictest24922-21/usr/sbin/munin20:35:190
3457995733,15cyclictest2930-21/usr/sbin/munin21:15:180
3457995733,14cyclictest8735-21sshd21:36:500
3457995732,15cyclictest31275-21/usr/sbin/munin23:05:120
3457995713,15cyclictest19682-21df_inode22:20:180
3457995710,16cyclictest30216-21ntp_states23:00:230
345799569,17cyclictest23338-21munin-run22:34:590
345799569,17cyclictest23153-21awk00:40:000
345799568,14cyclictest15533-21/usr/sbin/munin00:10:300
345799568,13cyclictest19732-21open_inodes00:25:240
345799567,14cyclictest7437-21/usr/sbin/munin19:25:130
3457995632,16cyclictest21113-21/usr/sbin/munin00:30:300
3457995632,15cyclictest11733-21/usr/sbin/munin23:55:170
3457995631,16cyclictest15540-21runrttasks22:04:370
3457995616,14cyclictest87522chrt23:43:210
3457995610,16cyclictest4625-21ls21:20:270
345799558,16cyclictest6156-21/usr/sbin/munin19:20:270
345799558,14cyclictest14460-21latency_hist19:55:020
345799557,16cyclictest10561-21memory23:50:210
3457995510,18cyclictest9093-21grep23:45:150
3457995510,17cyclictest32066-21seq21:01:010
345799538,16cyclictest18015-21seq20:07:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional