You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-23 - 05:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

ARM Broadcom BCM2711 @1500 MHz, Linux 5.10.52-rt47-v7l (Profile)

Latency plot of shadow in rack #7, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a0-2 -p99 -i200 -h400 -t3 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot4s.osadl.org (updated Thu Mar 23, 2023 00:45:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2860799461,37cyclictest10627-21ssh00:25:160
28586994611,24cyclictest12-21ksoftirqd/020:00:140
2858699454,26cyclictest12-21ksoftirqd/020:35:130
28586994325,10cyclictest28572-21cyclictest23:10:190
28607994233,7cyclictest0-21swapper/020:05:150
2860799419,18cyclictest0-21swapper/023:55:150
2859899391,22cyclictest0-21swapper/021:45:180
28598993830,5cyclictest32663-21fschecks_count22:20:210
28598993712,14cyclictest12-21ksoftirqd/020:30:140
2859899370,29cyclictest26060-21ssh00:35:170
2858699373,22cyclictest18449-21ssh00:30:190
2859899322,22cyclictest17247-21ssh22:50:190
2858699316,14cyclictest27734-21ssh23:35:190
2858699313,19cyclictest22579-21diskmemload21:35:160
28586993126,3cyclictest2924-21ps20:25:260
2858699312,18cyclictest0-21swapper/000:00:210
28586993112,14cyclictest0-21swapper/021:05:160
28598993010,11cyclictest151rcuc/023:00:190
28598992921,5cyclictest3700-21irqrtprio00:20:320
28586992924,3cyclictest19132-21sshd23:48:560
28586992921,5cyclictest21087-21kthreadcore00:10:250
28607992814,10cyclictest12-21ksoftirqd/020:50:140
28586992820,6cyclictest17265-21cut22:10:270
28586992812,5cyclictest2152-21ssh00:18:590
28607992720,5cyclictest17999-21needreboot21:30:420
28598992722,3cyclictest18940-21idleruntime-cro23:30:010
2858699272,16cyclictest21511-21ssh21:15:180
28586992721,4cyclictest31406-21irqcore20:55:270
28586992621,3cyclictest15127-21/usr/sbin/munin21:50:290
28586992514,7cyclictest0-21swapper/019:55:140
28598992419,3cyclictest2504-21latency_hist20:25:010
28598992417,5cyclictest12753-21sh22:45:390
28586992414,5cyclictest20266-21ssh23:50:170
28586992411,7cyclictest0-21swapper/020:10:140
2858699241,16cyclictest0-21swapper/021:55:150
28607992316,5cyclictest31355-21kthreadcore19:45:260
28607992316,5cyclictest30919-21grep23:15:410
28598992317,4cyclictest11623-21kthreadcore23:05:300
28598992317,3cyclictest32385-21switchtime19:10:430
28586992316,5cyclictest3472-21kthreadcore22:40:340
28586992316,5cyclictest21182-21kthreadcore23:30:340
28586992311,9cyclictest24871-21fschecks_time19:40:200
28586992311,10cyclictest32042-21fschecks_count22:00:260
2858699230,10cyclictest12069-21ssh21:27:360
28607992218,3cyclictest7898-21fschecks_count22:05:250
28607992215,5cyclictest27202-21tr22:35:310
28607992215,5cyclictest0-21swapper/023:40:340
28598992217,3cyclictest8162-21latency_hist21:05:010
2859899221,12cyclictest0-21swapper/000:08:440
28586992214,5cyclictest31219-21kthreadcore21:20:280
28586992211,9cyclictest27806-21needreboot22:15:330
2858699220,8cyclictest13362-21sh21:10:180
2858699220,7cyclictest12854-21diskmemload22:28:120
2858699220,18cyclictest0-21swapper/021:40:180
2860799213,11cyclictest0-21swapper/023:20:170
28598992110,9cyclictest6765-21kthreadcore19:20:250
28586992115,3cyclictest0-21swapper/019:35:140
28586992110,8cyclictest25599-21acpi22:55:160
28607992014,4cyclictest15345-21fschecks_time19:30:230
28607992013,5cyclictest21546-21cat20:45:020
28586992014,4cyclictest1542-21irqrtprio19:15:240
28586992012,5cyclictest25143-21sendmail_mailqu20:45:400
2858699200,7cyclictest12854-21diskmemload22:32:430
2859899190,14cyclictest25823-21grep20:15:270
2858699182,6cyclictest0-21swapper/019:50:140
28586991811,4cyclictest0-21swapper/019:25:150
2858699130,9cyclictest28587-21date19:10:020
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:173
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:172
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
none17:24:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional