You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-07 - 14:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot4s.osadl.org (updated Thu Dec 07, 2023 00:45:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
674999823,44cyclictest23866-21ssh22:10:190
674999822,49cyclictest6824-21sh21:40:190
674999622,13cyclictest9232-21ssh23:00:200
674999605,39cyclictest32144-21ssh22:15:210
674999581,35cyclictest1-21systemd19:15:210
674999542,25cyclictest15651-21ssh22:05:210
674999542,25cyclictest12-21ksoftirqd/000:20:210
6749995315,15cyclictest943-21ssh22:55:210
674999467,14cyclictest0-21swapper/021:45:230
674999442,25cyclictest22675-21ssh21:30:170
674999383,18cyclictest26363-21ssh00:10:210
6749993528,4cyclictest13629-21kthreadcore19:50:340
674999338,11cyclictest0-21swapper/000:30:210
6749993219,8cyclictest0-21swapper/022:20:180
674999312,22cyclictest25214-21ssh22:50:200
674999303,20cyclictest14402-21ssh21:25:200
674999282,18cyclictest30976-21ssh21:35:200
674999282,17cyclictest151rcuc/022:35:200
6749992821,5cyclictest20035-21processes22:25:350
6749992817,8cyclictest15958-21/usr/sbin/munin21:00:340
674999281,21cyclictest12-21ksoftirqd/000:05:230
674999276,11cyclictest12-21ksoftirqd/020:45:180
674999273,22cyclictest15276-21idleruntime-cro22:05:020
6749992711,6cyclictest12-21ksoftirqd/023:45:200
676199263,8cyclictest31294-21sh23:11:450
676199261,8cyclictest32267-21ssh23:32:290
6749992618,5cyclictest28924-21kthreadcore20:05:310
676199253,7cyclictest30356-21apt-get21:15:200
676199253,3cyclictest12-21ksoftirqd/022:30:100
676199252,9cyclictest17887-21irqstats21:05:250
676199243,4cyclictest12-21ksoftirqd/023:37:090
676199242,7cyclictest12-21ksoftirqd/023:20:210
676199241,8cyclictest22858-21ssh23:06:330
676199241,8cyclictest0-21swapper/019:10:220
676199241,14cyclictest26100-21ls21:10:350
674999245,12cyclictest0-21swapper/021:55:200
6749992419,3cyclictest25700-21tr21:50:320
6749992414,5cyclictest7552-21tail19:45:260
674999241,19cyclictest17764-21sort00:25:240
6749992410,10cyclictest2691-21cron20:15:010
676199233,5cyclictest12-21ksoftirqd/022:47:230
676199232,8cyclictest12-21ksoftirqd/023:26:130
676199232,7cyclictest30458-21cut19:35:280
676199232,2cyclictest0-21swapper/023:16:470
676199231,6cyclictest4490-21switchtime00:35:370
676199231,16cyclictest30924-21timerandwakeup23:50:480
6749992317,3cyclictest5136-21kthreadcore20:50:330
6749992315,5cyclictest7764-21fschecks_time20:20:250
6749992312,8cyclictest14041-21latency_hist21:25:010
676199224,4cyclictest0-21swapper/020:30:360
676199223,4cyclictest12-21ksoftirqd/000:16:180
676199221,8cyclictest0-21swapper/023:56:110
676199221,4cyclictest0-21swapper/000:00:160
6749992217,3cyclictest5878-21needreboot19:40:290
6749992215,5cyclictest14355-21cat23:40:440
6749992215,4cyclictest25029-21ntpq20:35:300
674999221,14cyclictest0-21swapper/020:40:200
6749992210,9cyclictest23219-21kthreadcore20:00:250
676199212,5cyclictest1217766ssh22:40:350
674999219,9cyclictest3500-21irqrtprio20:15:250
674999218,10cyclictest24644-21tail19:25:380
6749992115,4cyclictest18601-21tr19:55:340
6749992113,5cyclictest19536-21latency19:20:320
676199203,4cyclictest12-21ksoftirqd/020:55:270
676199191,9cyclictest25563-21/usr/sbin/munin19:30:200
676199191,10cyclictest12235-21apt-get20:25:050
676199186,6cyclictest6798-21wc19:10:020
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:493
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:492
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
none10:32:491
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional