You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-06 - 08:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #a, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Atom E3940 @1600 MHz, Linux 5.10.41-rt42 (Profile)

Latency plot of shadow in rack #a, slot #8
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackaslot8s.osadl.org (updated Wed Jul 06, 2022 00:45:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18900222197,96sleep10-21swapper/119:07:011
188222139103,25sleep00-21swapper/019:05:590
190602138102,25sleep20-21swapper/219:09:052
19113213598,26sleep30-21swapper/319:09:483
7382930,2sleep30-21swapper/322:07:503
241912670,1sleep00-21swapper/019:20:150
241912670,1sleep00-21swapper/019:20:150
108912630,1sleep30-21swapper/322:17:493
146892610,2sleep20-21swapper/223:55:332
42922530,2sleep10-21swapper/123:45:281
68302510,2sleep10-21swapper/100:20:521
303762510,2sleep10-21swapper/119:35:131
102852500,2sleep334-21ksoftirqd/320:03:363
225432460,2sleep228-21ksoftirqd/222:29:322
242712440,2chrt0-21swapper/221:59:422
22322380,8sleep132646-1kworker/u9:222:10:001
19403993310,5cyclictest20289-21strings19:10:191
19403993210,5cyclictest29677-21cat22:35:241
1940399318,6cyclictest16233-21cron21:20:001
19403993111,5cyclictest8682-21needreboot23:50:231
19403993111,5cyclictest1763-21seq20:59:561
19403993110,6cyclictest29951-21basename19:35:001
1940399309,5cyclictest23916-21smartctl22:30:261
19403993012,4cyclictest11919-21sh00:25:571
19403993012,4cyclictest11919-21sh00:25:571
19403993012,3cyclictest12319-21sh22:50:291
19403993011,3cyclictest9234-21sh21:44:451
19403993010,6cyclictest25756-21date23:35:191
19403993010,6cyclictest25756-21date23:35:191
1940399300,14cyclictest20787-21cron23:00:001
19405992913,13cyclictest15488-21perl00:30:163
1940399297,8cyclictest0-21swapper/100:10:401
19403992912,3cyclictest14323-21sh21:49:531
19403992911,4cyclictest788-21sh23:42:451
19403992911,3cyclictest16827-21latency_hist20:20:001
1940399286,8cyclictest0-21swapper/122:42:491
19403992811,3cyclictest6140-21sh22:13:211
19403992811,3cyclictest6085-21diskmemload23:57:181
19403992810,5cyclictest19291-21rt-features22:25:221
1940499278,12cyclictest55350irq/142-enp3s0-21:10:182
1940399272,7cyclictest19437-21apt-get20:25:111
1940399270,7cyclictest10511-21grep23:20:221
19402992716,7cyclictest55450irq/143-enp3s0-22:35:120
126622270,2sleep00-21swapper/022:20:070
19403992610,4cyclictest23381-21seq19:18:511
19402992624,1cyclictest0-21swapper/019:10:130
15502260,1sleep00-21swapper/023:11:320
316392250,1sleep20-21swapper/223:10:142
315772250,7sleep228-21ksoftirqd/200:14:352
19405992523,1cyclictest0-21swapper/319:10:183
1940499250,23cyclictest0-21swapper/219:10:112
1940399252,7cyclictest30166-21apt-get20:50:111
1940299253,16cyclictest15854-21ssh22:55:030
1940499240,11cyclictest20807-21idleruntime-cro23:00:002
266002230,2sleep00-21swapper/020:40:170
1940399231,7cyclictest13287-21tail20:10:161
1940299232,15cyclictest26782-21ssh21:30:130
19402992318,3cyclictest12-21ksoftirqd/020:20:000
53212220,1sleep20-21swapper/221:05:232
53212220,1sleep20-21swapper/221:05:232
48152220,18sleep04910-21cat21:05:180
48152220,18sleep04910-21cat21:05:180
42172220,4sleep36085-21diskmemload22:10:263
19405992214,6cyclictest19067-21ntp_states00:00:223
19405992212,7cyclictest32571-21df00:15:143
1940499222,14cyclictest9774-21ssh21:45:122
19405992115,4cyclictest19208-21sh23:30:003
19405992113,6cyclictest658-21sed19:40:173
19405992113,6cyclictest29766-21ls22:35:253
19405992113,6cyclictest13729-21ntpq20:10:213
19405992111,6cyclictest55150irq/140-enp3s0-23:55:123
1940499212,12cyclictest7637-21ssh22:15:122
19404992112,7cyclictest29658-21cron23:40:002
19404992112,7cyclictest29658-21cron23:40:002
19404992110,7cyclictest17287-21apt-get20:20:122
1940399212,13cyclictest26360-21ssh23:05:111
1940299218,11cyclictest12-21ksoftirqd/022:29:380
19402992113,6cyclictest7797-21python321:10:310
19402992113,6cyclictest27371-21ntp_states23:05:210
28142200,7sleep228-21ksoftirqd/222:40:442
219292200,3sleep20-21swapper/200:04:162
1940599209,9cyclictest4783-21sh23:46:123
1940599209,8cyclictest16992-21ntpq22:55:203
19405992014,4cyclictest896-21/usr/sbin/munin22:40:173
19405992014,3cyclictest22280-21grep21:25:163
19405992013,5cyclictest27983-21cat20:45:013
19405992013,5cyclictest26760-21seq22:00:483
19405992012,6cyclictest24283-21which20:35:163
19405992012,6cyclictest19055-21netstat22:25:203
1940599201,17cyclictest31846-21expr23:10:143
19405992011,6cyclictest21234-21sensors_temp00:35:233
1940499207,8cyclictest28-21ksoftirqd/200:20:122
1940499203,11cyclictest31925-21ssh21:35:102
1940499202,12cyclictest641-21runrttasks20:15:132
19404992014,4cyclictest5523-21sh21:40:182
19404992012,6cyclictest3242-21smartctl23:45:162
19404992012,6cyclictest30624-21tune2fs20:50:152
19404992012,6cyclictest19968-21apt-get00:35:112
1940499201,17cyclictest25991-21munin-run23:05:002
19404992011,6cyclictest834-21ntpq19:40:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional