You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-05 - 09:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Atom E3825 @1333 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of shadow in rack #9, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s.osadl.org (updated Tue Jul 05, 2022 00:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
292799912421212,24cyclictest29423-21apt-get19:25:121
292789911281080,36cyclictest572-21timerandwakeup19:30:310
288922693329,353sleep10-21swapper/119:21:331
292172564517,32sleep00-21swapper/019:24:570
2927899170148,4cyclictest31151-21pidof19:30:000
29279996863,3cyclictest0-21swapper/119:30:301
29279993913,16cyclictest22-21ksoftirqd/123:35:201
29279993822,5cyclictest22-21ksoftirqd/100:19:471
2927999381,18cyclictest16442-21apt-get20:15:191
29279993722,5cyclictest22-21ksoftirqd/123:51:301
29279993722,5cyclictest22-21ksoftirqd/122:35:331
29279993722,5cyclictest22-21ksoftirqd/121:04:211
29279993721,6cyclictest22-21ksoftirqd/123:06:241
29279993721,6cyclictest22-21ksoftirqd/100:35:081
29279993720,6cyclictest22-21ksoftirqd/119:53:131
134252371,32sleep12374-21NetworkManager22:55:301
84352361,31sleep18438-21apt-get00:10:111
29279993621,5cyclictest22-21ksoftirqd/122:19:161
29279993621,5cyclictest22-21ksoftirqd/122:07:501
29279993620,6cyclictest22-21ksoftirqd/123:12:551
29279993620,6cyclictest22-21ksoftirqd/119:47:511
29279993620,5cyclictest22-21ksoftirqd/122:32:051
29279993619,6cyclictest22-21ksoftirqd/123:16:101
29279993615,6cyclictest22-21ksoftirqd/123:25:111
29278993625,8cyclictest19164-21users00:35:310
9282350,4sleep041ktimersoftd/022:25:010
2927999358,7cyclictest21554-21needreboot00:45:001
2927999352,19cyclictest4477-21apt-get00:00:131
29279993520,6cyclictest22-21ksoftirqd/121:35:251
29279993520,5cyclictest22-21ksoftirqd/123:49:511
29279993520,5cyclictest22-21ksoftirqd/122:28:191
29279993520,5cyclictest22-21ksoftirqd/119:58:211
29279993520,5cyclictest22-21ksoftirqd/100:33:141
29279993513,8cyclictest22-21ksoftirqd/120:57:141
29279993512,7cyclictest22-21ksoftirqd/120:52:331
2927999351,21cyclictest19118-21ntp_states21:45:271
29279993512,12cyclictest17140-21needreboot21:40:241
2927999351,20cyclictest25737-21aten_r4power_vo23:30:171
47242341,29sleep04728-21pidof19:40:590
2927999349,13cyclictest22-21ksoftirqd/121:54:001
29279993419,5cyclictest22-21ksoftirqd/122:21:451
29279993419,5cyclictest22-21ksoftirqd/122:14:501
29279993419,5cyclictest22-21ksoftirqd/120:45:031
29279993413,6cyclictest22-21ksoftirqd/122:51:591
29279993412,8cyclictest22-21ksoftirqd/121:21:301
29279993412,7cyclictest22-21ksoftirqd/121:58:381
29279993411,7cyclictest5119-21munin-run19:45:001
29279993411,7cyclictest22-21ksoftirqd/120:35:371
29279993411,7cyclictest22-21ksoftirqd/120:33:351
2927999339,8cyclictest22-21ksoftirqd/123:57:561
2927999339,8cyclictest22-21ksoftirqd/122:04:521
2927999332,19cyclictest0-21swapper/120:25:221
29279993318,5cyclictest22-21ksoftirqd/121:15:551
29279993310,8cyclictest22-21ksoftirqd/120:23:211
2927899336,5cyclictest81rcu_preempt23:35:200
2927899334,4cyclictest81rcu_preempt23:25:120
151202331,4sleep115135-21ntp_states23:00:261
132492331,4sleep113368-21sed00:20:301
93542321,28sleep09414-21if_eth021:20:190
2927999322,9cyclictest11351-21uname21:25:221
2927999321,7cyclictest3274-21latency_hist19:40:011
2927899325,4cyclictest81rcu_preempt22:51:590
29278993212,13cyclictest26350-21ls23:30:270
276772321,5sleep10-21swapper/120:43:541
197532321,27sleep02297-21irqbalance21:47:270
141862321,4sleep126557-21snmpd20:06:181
99852311,4sleep10-21swapper/122:46:131
82332311,5sleep10-21swapper/100:09:381
2927999319,7cyclictest22-21ksoftirqd/100:45:481
2927999318,7cyclictest22-21ksoftirqd/100:53:471
2927899314,21cyclictest9860-21grep22:45:400
2927899311,5cyclictest81rcu_preempt22:09:280
2927899311,4cyclictest81rcu_preempt23:08:040
2927899311,4cyclictest81rcu_preempt20:57:150
2927899311,4cyclictest81rcu_preempt20:52:320
234332311,5sleep10-21swapper/123:23:241
88682301,5sleep00-21swapper/019:54:570
85182301,5sleep00-21swapper/021:18:300
29279993012,5cyclictest14653-21http_loadtime00:25:271
29278993020,6cyclictest30843-21unixbench_singl22:15:340
2927899301,4cyclictest81rcu_preempt23:13:130
2927899301,4cyclictest81rcu_preempt00:00:220
161272301,5sleep10-21swapper/120:11:551
98622291,5sleep00-21swapper/000:12:010
7232291,5sleep00-21swapper/023:50:040
40352291,5sleep00-21swapper/023:55:380
2927999298,6cyclictest22-21ksoftirqd/123:44:111
2927999297,12cyclictest22-21ksoftirqd/121:33:441
2927999295,8cyclictest22-21ksoftirqd/120:05:001
2927999294,22cyclictest0-21swapper/121:05:291
2927999294,19cyclictest7057-21diskstats22:40:181
2927999292,17cyclictest0-21swapper/121:10:091
2927899295,4cyclictest81rcu_preempt20:15:220
29278992921,5cyclictest10847-21aten_r4power_vo21:25:130
29278992919,6cyclictest25666-21cron22:05:000
2927899291,4cyclictest81rcu_preempt21:37:060
2927899291,4cyclictest81rcu_preempt20:35:370
2927899291,4cyclictest81rcu_preempt20:33:360
28902291,5sleep00-21swapper/019:36:520
159592291,5sleep00-21swapper/023:04:270
122332291,5sleep00-21swapper/020:00:350
80672281,5sleep00-21swapper/022:40:520
29278992817,6cyclictest6081-21unixbench_singl22:35:310
2927899281,4cyclictest81rcu_preempt21:58:370
27852281,5sleep00-21swapper/021:02:530
275712281,5sleep00-21swapper/020:42:460
23452281,5sleep00-21swapper/022:26:180
233682281,5sleep00-21swapper/000:49:190
232142281,5sleep00-21swapper/023:21:050
202642281,5sleep00-21swapper/020:25:000
199552281,5sleep00-21swapper/023:15:020
193612281,4sleep019423-21processes20:20:290
156092281,5sleep00-21swapper/000:27:330
142002281,5sleep00-21swapper/020:06:270
141242281,5sleep00-21swapper/021:32:540
140542281,5sleep00-21swapper/022:59:230
66752271,5sleep00-21swapper/019:46:410
326582271,5sleep00-21swapper/023:46:090
296272271,5sleep00-21swapper/020:49:330
293232271,5sleep00-21swapper/022:13:490
2927899277,16cyclictest0-21swapper/021:10:340
2927899274,6cyclictest21540-21apt00:45:000
2927899274,17cyclictest15402-21memory20:10:220
2927899273,19cyclictest13947-21munin-run00:25:010
2927899273,18cyclictest16705-21memory00:30:230
2927899272,19cyclictest3239-21df22:30:150
2927899271,20cyclictest11152-21ntp_states00:15:260
250102271,5sleep00-21swapper/000:51:500
179252271,5sleep00-21swapper/021:43:010
106492271,4sleep00-21swapper/019:58:530
2927899269,10cyclictest0-21swapper/000:08:490
29278992616,6cyclictest20902-21cat21:50:240
2927899261,4cyclictest81rcu_preempt23:44:110
2927899254,4cyclictest81rcu_preempt21:05:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional