You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-09-08 - 18:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot4s.osadl.org (updated Sun Sep 08, 2024 12:45:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
828399733,49cyclictest6044-21ssh10:35:141
828399634,44cyclictest17308-21ssh12:30:131
8307996137,12cyclictest25866irq/58-eth012:25:153
827299574,10cyclictest131rcu_preempt07:45:120
8307995628,17cyclictest25866irq/58-eth010:30:113
8307995029,10cyclictest25866irq/58-eth012:35:133
830799493,31cyclictest25866irq/58-eth011:25:143
827299493,11cyclictest24783-21ssh11:40:130
830799472,25cyclictest25866irq/58-eth011:55:133
8307994527,12cyclictest25866irq/58-eth009:40:133
828399451,36cyclictest19314-21ssh11:55:121
827299452,4cyclictest131rcu_preempt11:45:120
828399443,31cyclictest26589-21diskmemload12:35:121
827299441,35cyclictest22674-21ssh12:15:110
828399431,33cyclictest14482-21ssh10:40:121
8272994318,19cyclictest12-21ksoftirqd/009:35:120
827299431,35cyclictest26856-21ssh11:05:120
827299431,35cyclictest26856-21ssh11:05:110
8292994221,16cyclictest0-21swapper/208:45:112
827299421,29cyclictest13173-21ssh10:20:130
8292994121,7cyclictest1-21systemd07:10:132
827299412,8cyclictest0-21swapper/007:40:140
830799401,25cyclictest25866irq/58-eth009:35:143
8292994027,8cyclictest0-21swapper/212:20:122
827299401,35cyclictest4834-21ssh12:05:110
830799393,23cyclictest25866irq/58-eth010:10:123
8272993914,17cyclictest12-21ksoftirqd/010:25:140
827299391,24cyclictest28298-21ssh12:00:120
827299391,24cyclictest28298-21ssh12:00:110
830799383,24cyclictest25866irq/58-eth007:50:133
828399373,21cyclictest30357-21ssh11:25:141
827299371,10cyclictest23063-21sshd07:25:160
829299362,28cyclictest28838-21ssh12:17:012
827299361,9cyclictest20745-21diskstats08:30:210
827299361,10cyclictest27325-21unixbench_singl10:45:270
827299361,10cyclictest18516-21apt-key09:45:020
827299361,10cyclictest12092-21dpkg08:55:020
827299357,22cyclictest8801-21ssh10:55:130
827299351,9cyclictest7026-21fschecks_count11:30:160
827299351,9cyclictest29127-21if_eth110:10:170
827299351,10cyclictest6799-21ssh10:15:200
8307993418,12cyclictest25866irq/58-eth009:45:123
8307993418,12cyclictest25866irq/58-eth009:45:123
827299346,6cyclictest11613-21sendmail-msp10:00:040
827299342,8cyclictest0-21swapper/008:55:140
827299341,9cyclictest5700-21kthreadcore11:10:220
827299341,9cyclictest31361-21sendmail-msp12:20:050
827299341,11cyclictest27837-21grep08:00:330
827299341,11cyclictest10891-21latency_hist08:20:020
827299341,10cyclictest16131-21sed08:25:190
827299341,10cyclictest16131-21sed08:25:180
827299341,10cyclictest12047-21cut07:10:270
830799331,17cyclictest25866irq/58-eth011:10:143
827299338,4cyclictest25864-21munin-plugin-st12:35:000
827299331,9cyclictest15473-21cut10:40:200
827299331,9cyclictest15433-21kthreadcore12:10:200
827299331,9cyclictest1320-21proc_pri10:30:260
827299331,9cyclictest11837-21kthreadcore09:20:220
827299331,8cyclictest16237-21irqcore11:35:180
8272993317,13cyclictest12-21ksoftirqd/010:35:150
827299331,17cyclictest20370-21ssh10:05:130
827299331,10cyclictest22185-21fschecks_time09:05:170
827299331,10cyclictest19840-21cut09:25:200
827299331,10cyclictest10382-21kthreadcore12:25:220
8292993214,12cyclictest0-21swapper/210:30:122
828399325,7cyclictest21-21ksoftirqd/112:25:141
827299323,10cyclictest26205-21kthreadcore08:35:190
827299321,9cyclictest5983-21awk09:15:300
827299321,9cyclictest5983-21awk09:15:290
827299321,9cyclictest3850-21ls07:35:260
827299321,9cyclictest3486-21sh09:55:150
827299321,9cyclictest31541-21cut08:40:200
827299321,8cyclictest19100-21cron07:55:020
827299321,10cyclictest30098-21tr09:10:220
827299321,10cyclictest15532-21idleruntime-cro08:25:000
829299315,16cyclictest22146irq/40-dwc2_hso07:50:132
8292993122,4cyclictest0-21swapper/212:10:122
828399317,17cyclictest21-21ksoftirqd/108:50:111
827299314,6cyclictest26386-21ssh12:35:150
827299311,9cyclictest30360-21cut07:30:220
827299311,9cyclictest1971-21cat11:25:290
827299311,9cyclictest13457-21ssh11:50:220
827299311,8cyclictest2661-21apt-get08:45:110
827299311,8cyclictest21014-21awk11:20:010
827299311,8cyclictest17135-21grep07:15:270
827299311,12cyclictest21388-21ssh11:20:130
827299311,11cyclictest27365-21ssh09:50:120
827299311,11cyclictest25908-21/usr/sbin/munin09:30:240
827299310,9cyclictest22648-21mailstats09:45:280
827299310,9cyclictest22648-21mailstats09:45:270
830799303,18cyclictest25866irq/58-eth012:10:113
829299305,15cyclictest22146irq/40-dwc2_hso08:50:122
829299302,20cyclictest22146irq/40-dwc2_hso11:35:132
827299306,6cyclictest316-21sed08:05:300
827299301,8cyclictest23388-21grep11:55:290
827299301,7cyclictest18241-21fschecks_count07:20:150
827299301,7cyclictest18241-21fschecks_count07:20:150
827299301,10cyclictest2688-21kthreadcore10:50:220
827299301,10cyclictest20433-21ssh11:00:220
828399291,22cyclictest31807-21ssh12:20:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional