You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-28 - 20:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot4s.osadl.org (updated Thu Sep 28, 2023 12:45:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1902399631,20cyclictest600-21rngd10:10:220
1902399623,37cyclictest18450-21ssh11:25:200
19009995711,23cyclictest12-21ksoftirqd/007:30:210
19009995624,14cyclictest151rcuc/008:30:180
19023995516,19cyclictest134-21systemd-journal10:00:190
1900999546,35cyclictest600-21rngd12:15:190
1903199382,22cyclictest12-21ksoftirqd/010:55:210
1903199372,29cyclictest11763-21ssh09:15:160
1902399373,21cyclictest31934-21sh09:50:220
1903199366,24cyclictest600-21rngd09:45:200
1900999362,25cyclictest0-21swapper/008:35:190
1900999352,24cyclictest12-21ksoftirqd/007:15:210
19031993125,4cyclictest20792-21latency_hist08:20:010
19023993123,5cyclictest10229-21grep11:20:330
1903199303,19cyclictest12-21ksoftirqd/009:40:210
1903199300,22cyclictest25355-21ssh12:05:220
19023993012,11cyclictest28396-21diskmemload12:25:190
1902399291,19cyclictest600-21rngd12:10:210
1900999282,18cyclictest600-21rngd11:30:210
1900999281,21cyclictest4263-21ssh09:10:230
19023992721,4cyclictest821-21threads07:55:400
19023992720,4cyclictest1461-21tail11:15:290
19009992715,6cyclictest0-21swapper/012:35:190
1900999271,24cyclictest8536-21grep10:15:440
1903199262,18cyclictest27390-21apt-get10:30:190
19023992619,4cyclictest11374-21cat08:40:380
1900999263,16cyclictest12-21ksoftirqd/008:10:210
19009992621,3cyclictest6057-21unixbench_singl09:30:400
19009992621,3cyclictest13296-21if_eth011:40:270
1902399259,3cyclictest131rcu_preempt10:39:310
1900999252,17cyclictest9798-21apt-get10:40:180
19031992419,3cyclictest21018-21kthreadcore07:10:350
19031992419,3cyclictest12-21ksoftirqd/010:00:020
1902399246,4cyclictest12-21ksoftirqd/011:11:590
1902399245,4cyclictest29337-21kworker/0:110:51:490
19023992419,3cyclictest12-21ksoftirqd/011:50:130
19023992411,4cyclictest12-21ksoftirqd/012:00:440
19023992411,3cyclictest131rcu_preempt11:08:540
19023992410,3cyclictest131rcu_preempt12:30:400
1903199232,8cyclictest0-21swapper/009:00:180
1902399231,19cyclictest29543-21cat08:25:510
1903199229,8cyclictest0-21swapper/007:25:200
19031992217,3cyclictest12027-21/usr/sbin/munin10:20:410
1902399229,6cyclictest131rcu_preempt09:20:540
1902399227,5cyclictest12-21ksoftirqd/009:27:310
1902399222,15cyclictest6652-21apt-get08:05:200
1902399222,14cyclictest0-21swapper/010:25:220
19023992217,3cyclictest5760-21unixbench_singl08:00:440
19023992210,9cyclictest22367-21cut08:55:250
19031992115,4cyclictest0-21swapper/008:45:060
19031992113,6cyclictest22048-21users08:51:020
19031992112,7cyclictest13861-21latency07:35:450
1902399219,3cyclictest131rcu_preempt11:48:520
1902399218,7cyclictest12-21ksoftirqd/011:00:220
1902399215,6cyclictest12-21ksoftirqd/009:35:150
19023992115,4cyclictest12-21ksoftirqd/012:23:280
1902399211,3cyclictest131rcu_preempt08:20:530
1900999219,5cyclictest12-21ksoftirqd/010:45:170
19031992013,5cyclictest0-21swapper/007:50:370
19031992012,5cyclictest0-21swapper/009:05:300
1902399204,7cyclictest12-21ksoftirqd/010:05:170
19023992013,4cyclictest12-21ksoftirqd/011:55:180
1902399200,4cyclictest600-21rngd11:37:540
1902399195,8cyclictest12-21ksoftirqd/007:10:020
19023991912,5cyclictest0-21swapper/007:45:380
19009991914,3cyclictest32206-21mailstats07:20:500
19009991712,3cyclictest15655-21irqcore07:40:400
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional