You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-21 - 05:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7s.osadl.org (updated Sun Jul 21, 2024 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
848269423,653sleep3906-21/usr/sbin/munin23:51:363
1106825656,549sleep031494-1kworker/0:1H19:16:370
4431240337,302sleep14559-21unixbench_multi00:01:431
4431240337,302sleep14559-21unixbench_multi00:01:431
16647237311,343sleep325366-1kworker/3:2H21:16:313
16228230612,259sleep116311-21tr19:31:451
16228230612,259sleep116311-21tr19:31:451
12432284155,113sleep1634-21/usr/sbin/munin23:51:461
24159225815,226sleep024132-21latency_hist21:41:160
24159225815,226sleep024132-21latency_hist21:41:160
7818222010,198sleep27819-21cron20:51:142
15917222028,180sleep115953-21ntpq22:56:411
20133221817,180sleep120283-21latency_hist19:46:191
20133221817,180sleep120283-21latency_hist19:46:191
13386221813,164sleep113437-21fschecks_count21:06:521
3133022137,91sleep10-21swapper/120:21:321
3133022137,91sleep10-21swapper/120:21:321
7538220313,130sleep17683-21latency_hist22:31:171
1543219710,49sleep10-21swapper/122:11:341
27600219515,130sleep127614-21fschecks_count21:51:301
4338219027,145sleep04353-21apt22:21:140
26407218547,46sleep126446-21proc_pri21:46:421
1674121809,159sleep21166-21snmpd23:00:502
16265217814,113sleep116263-21munin-run21:16:171
6571217025,121sleep26595-21munin-run00:11:132
10557215415,31sleep110568-21modprobe22:41:141
20622215017,116sleep220668-21latency19:46:362
27204214955,39sleep127328-21timerwakeupswit20:06:461
27204214955,39sleep127328-21timerwakeupswit20:06:461
25155214812,124sleep125204-21fschecks_count23:26:341
7988214749,79sleep18153-21gpgv20:51:171
945421448,19sleep10-21swapper/119:11:331
23239214252,19sleep10-21swapper/119:56:161
10649214019,97sleep010825-21latency_hist19:16:170
12876213943,16sleep10-21swapper/122:46:431
12876213943,16sleep10-21swapper/122:46:431
10672213918,20sleep00-21swapper/022:41:170
12610213514,109sleep112675-21ls19:21:351
12610213514,109sleep112675-21ls19:21:351
2415213017,88sleep10-21swapper/123:56:341
19223213015,98sleep319343-21timerandwakeup23:06:453
13696213016,93sleep30-21swapper/321:06:583
5760212920,17sleep10-21swapper/100:06:401
12865212913,102sleep212802-21latency_hist00:31:172
3159121257,61sleep10-21swapper/123:46:331
17802212513,75sleep10-21swapper/119:36:451
16173212418,87sleep016263-21unin-run21:16:160
329212315,61sleep10-21swapper/120:26:291
26283212211,95sleep226330-21systemd-run20:06:152
26283212211,95sleep226330-21systemd-run20:06:152
20464212212,73sleep120516-21latency23:11:391
18273212214,79sleep318327-21fschecks_count21:21:323
4153212124,74sleep04137-21apt-get18:56:300
11724212112,52sleep10-21swapper/122:41:471
7275212029,51sleep10-21swapper/119:06:201
7275212029,51sleep10-21swapper/119:06:201
25113212014,92sleep125175-21fschecks_time20:01:331
25113212014,92sleep125175-21fschecks_time20:01:331
11568212017,17sleep10-21swapper/119:17:031
8346211931,34sleep18365-21apt20:51:251
22938211711,67sleep122973-21fschecks_count21:36:321
22938211711,67sleep122973-21fschecks_count21:36:321
31221211613,20sleep20-21swapper/220:21:252
31221211613,20sleep20-21swapper/220:21:252
23512211613,56sleep10-21swapper/123:21:251
1889211614,53sleep10-21swapper/120:31:261
1152021168,91sleep10-21swapper/100:26:271
1885521149,14sleep10-21swapper/123:06:341
31019211212,51sleep10-21swapper/122:01:401
24667211213,62sleep10-21swapper/121:41:371
23455211248,51sleep123466-21sort19:56:241
10713211221,70sleep210848-21grep00:21:482
10019211232,16sleep10-21swapper/120:56:341
19817211172,20sleep10-21swapper/121:26:301
21283211011,83sleep021284-21sshd23:14:090
408210922,69sleep0385-40mandb23:51:160
29737210931,27sleep129863-21cat21:56:431
29737210931,27sleep129863-21cat21:56:431
5080210827,23sleep10-21swapper/120:41:311
5080210827,23sleep10-21swapper/120:41:311
17273210746,47sleep117038-21/usr/sbin/munin23:01:341
14446210647,18sleep114517-21mailstats22:51:401
3439210528,17sleep10-21swapper/120:36:261
32251210515,48sleep10-21swapper/122:06:331
18785210514,78sleep018796-21acpi19:41:250
18785210514,78sleep018796-21acpi19:41:250
17159210549,21sleep117236-21readlink21:16:491
5062210411,77sleep25203-21latency_hist00:06:172
5062210411,77sleep25203-21latency_hist00:06:172
29819210416,74sleep329892-21grep23:41:343
28682210451,35sleep10-21swapper/123:36:431
28682210451,35sleep10-21swapper/123:36:431
31133210315,66sleep131321-21apt-config23:46:161
2125821035,11sleep10-21swapper/119:46:471
7046210227,50sleep27183-21grep19:06:172
5475210213,75sleep25516-21cut19:01:162
22134210220,11sleep10-21swapper/123:16:401
22134210220,11sleep10-21swapper/123:16:401
2951829910,75sleep029529-21ntp_states21:56:380
2951829910,75sleep029529-21ntp_states21:56:380
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional