You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-11 - 23:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot4s.osadl.org (updated Mon Dec 11, 2023 12:45:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1439199796,44cyclictest27376-21sh12:10:230
1439199775,8cyclictest131rcu_preempt07:50:220
1439199733,46cyclictest994-21ssh11:55:200
1439199702,9cyclictest131rcu_preempt08:25:210
1439199662,11cyclictest131rcu_preempt07:30:210
1439199635,27cyclictest15919-21ssh11:45:220
1439199624,26cyclictest4682-21ssh10:40:180
1439199608,23cyclictest12-21ksoftirqd/008:50:230
1439199582,28cyclictest5106-21ssh09:15:170
1439199552,26cyclictest12-21ksoftirqd/009:00:220
1439199551,30cyclictest4605-21ssh11:20:180
1439199503,6cyclictest131rcu_preempt07:35:180
1439199474,17cyclictest29396-21ssh10:35:230
1439199465,31cyclictest12618-21ssh11:05:200
1439199463,18cyclictest4511-21diskmemload11:00:200
1439199443,24cyclictest28048-21ssh09:30:220
1439199443,17cyclictest13034-21ssh11:25:180
14391994318,4cyclictest0-21swapper/012:30:210
1439199431,16cyclictest21535-21ssh10:30:190
1439199413,21cyclictest21285-21ssh12:25:220
1439199393,5cyclictest131rcu_preempt10:20:220
1439199379,8cyclictest0-21swapper/010:15:180
14391993722,3cyclictest9750-21unixbench_singl08:10:590
1439199371,26cyclictest12468-21ssh12:20:200
1439199362,20cyclictest6316-21ssh12:35:210
1439199353,14cyclictest20456-21ssh09:25:260
1439199352,4cyclictest131rcu_preempt08:00:230
1439199343,20cyclictest12-21ksoftirqd/009:05:230
1439199325,7cyclictest0-21swapper/011:35:190
1439199323,20cyclictest13759-21ssh10:25:220
1439199312,14cyclictest18596-21ssh12:05:250
14391993120,4cyclictest24987-21kthreadcore11:30:310
1439199264,11cyclictest0-21swapper/008:45:230
14391992619,4cyclictest16400-21tr08:55:360
14391992519,4cyclictest524-21grep11:15:390
14391992517,6cyclictest5853-21latency_hist08:10:020
14391992418,4cyclictest22880-21/usr/sbin/munin10:10:260
14391992416,6cyclictest13669-21ssh10:45:300
14391992414,7cyclictest18609-21unixbench_multi07:45:410
14391992318,3cyclictest8729-21tr11:40:300
14391992318,3cyclictest22158-21cut11:10:280
14391992315,6cyclictest30314-21irqcore09:10:300
14391992314,7cyclictest0-21swapper/008:15:320
14391992313,7cyclictest4115-21cron11:00:000
14391992217,3cyclictest11213-21cut10:00:440
1439199221,19cyclictest3724-21xargs09:55:360
1439199221,15cyclictest15142-21ssh10:05:050
1439199219,9cyclictest20175-21kthreadcore09:45:270
1439199212,4cyclictest131rcu_preempt12:15:220
1439199212,3cyclictest131rcu_preempt07:15:200
14391992116,3cyclictest4127-21cut08:40:320
14391992113,6cyclictest17098-21ssh09:43:490
1439199211,17cyclictest9921-21grep12:00:260
1439199211,17cyclictest10400-21latency_hist09:40:020
14391992015,3cyclictest25525-21irqstats11:50:300
14391992013,4cyclictest24361-21ps10:50:430
14391992011,7cyclictest1-21systemd09:50:400
1439199199,7cyclictest28291-21cron07:25:020
14391991914,3cyclictest24796-21fschecks_count08:30:260
14391991912,5cyclictest14643-21cut07:10:250
14391991912,5cyclictest0-21swapper/007:40:340
14391991911,5cyclictest28025-21unixbench_singl07:55:380
1439199191,14cyclictest12903-21ssh09:20:240
1439199187,9cyclictest16413-21kthreadcore08:20:310
1439199169,5cyclictest29537-21fschecks_time08:35:280
1439199163,9cyclictest28917-21irqcore07:25:330
1439199141,10cyclictest14414-21latency_hist07:10:010
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional