You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-20 - 16:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

ARM Broadcom BCM2711 @1500 MHz, Linux 5.10.52-rt47-v7l (Profile)

Latency plot of shadow in rack #7, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a0-2 -p99 -i200 -h400 -t3 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack7slot4s.osadl.org (updated Mon Mar 20, 2023 12:45:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2342399779,32cyclictest12-21ksoftirqd/012:20:180
2342399674,41cyclictest22595-21ssh11:45:200
23423996711,27cyclictest28593-21ssh11:30:220
2342399602,6cyclictest131rcu_preempt12:30:190
2342399585,7cyclictest131rcu_preempt07:40:130
2342399584,29cyclictest25294-21ssh12:05:190
2342399565,34cyclictest2312-21ssh10:20:160
2342399564,8cyclictest131rcu_preempt08:05:160
23423995626,9cyclictest131rcu_preempt09:50:210
2340499563,28cyclictest26000-21ssh09:20:170
2342399557,5cyclictest131rcu_preempt08:45:160
2342399552,24cyclictest12-21ksoftirqd/007:20:150
2342399532,26cyclictest12-21ksoftirqd/008:40:130
2342399521,9cyclictest131rcu_preempt10:40:140
2342399521,22cyclictest13662-21sh11:40:130
2342399501,30cyclictest28955-21ssh09:40:170
2341299464,31cyclictest10430-21ssh12:15:150
23412994029,7cyclictest31629-21ssh10:55:160
2342399394,14cyclictest0-21swapper/011:20:150
2341299371,30cyclictest31787-21ssh10:00:180
2340499361,25cyclictest28647-21ssh10:35:170
2341299334,22cyclictest1636-21ssh12:10:170
23412993015,13cyclictest12-21ksoftirqd/007:15:160
23412992922,4cyclictest29559-21kthreadcore12:25:280
23412992823,3cyclictest17405-21grep10:10:210
23404992822,3cyclictest21423-21tr09:35:260
23404992818,8cyclictest13288-21latency_hist11:40:010
2342399264,12cyclictest0-21swapper/009:30:190
23423992619,5cyclictest29910-21unixbench_multi10:15:300
23423992619,4cyclictest31496-21fschecks_count11:50:200
23404992620,4cyclictest8598-21irqcore09:10:200
23423992519,4cyclictest19655-21sort11:25:160
23412992519,4cyclictest11322-21kthreadcore11:00:320
23423992419,3cyclictest3091-21apt09:05:010
23423992413,9cyclictest8418-21idleruntime10:05:200
23412992418,4cyclictest17677-21ssh10:45:350
2342399234,17cyclictest25447-21/usr/sbin/munin08:20:320
23423992317,4cyclictest25366-21unixbench_singl08:50:280
23423992316,5cyclictest8856-21kthreadcore08:35:210
2341299236,13cyclictest12-21ksoftirqd/012:00:180
23412992315,6cyclictest134-21systemd-journal11:20:010
23412992311,9cyclictest27480-21kthreadcore08:55:210
23412992310,9cyclictest6297-21kthreadcore07:25:200
23404992317,4cyclictest19584-21latency_hist07:40:010
23404992315,5cyclictest2820-21irqcore08:30:190
2342399223,7cyclictest0-21swapper/011:55:170
23423992217,3cyclictest13078-21tr10:25:230
23423992216,4cyclictest25514-21cut09:55:240
23412992216,4cyclictest2987-21ps09:25:200
23412992215,4cyclictest526-21usb-storage07:55:270
23404992210,9cyclictest29763-21timerandwakeup11:10:370
2342399219,9cyclictest7761-21kthreadcore08:00:280
2342399214,14cyclictest23030-21/usr/sbin/munin10:50:200
23423992114,5cyclictest19178-21kthreadcore09:15:300
23423992110,7cyclictest30886-21kthreadcore08:25:200
2340499213,11cyclictest0-21swapper/007:45:120
2340499210,16cyclictest23604-21cut07:10:160
2342399208,9cyclictest5620-21kthreadcore09:05:260
2342399204,12cyclictest23962-21usage_Anybus10:30:330
2342399203,12cyclictest12-21ksoftirqd/012:35:220
23412992015,3cyclictest16261-21grep08:10:180
2342399198,8cyclictest18215-21cat11:05:240
2341299199,7cyclictest10116-21apt-get07:30:160
2341299193,14cyclictest20899-21idleruntime08:15:170
23412991913,4cyclictest0-21swapper/007:50:160
2340499188,7cyclictest5325-21apt-get09:45:150
2342399147,5cyclictest23390-21cyclictest07:10:020
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional