You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-14 - 03:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7s.osadl.org (updated Sun Oct 13, 2024 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25024247511,448sleep225030-21cat10:25:132
25024247511,448sleep225030-21cat10:25:132
22682229513,268sleep122731-21ntpq12:00:181
17991226113,236sleep0194-21jbd2/mmcblk2p2-08:20:100
25871225910,235sleep025879-21ntpq12:10:230
3118422520,8sleep20-21swapper/210:45:102
3118422520,8sleep20-21swapper/210:45:102
5059222667,22sleep30-21swapper/307:39:573
13760222514,194sleep213879-21sed08:05:352
31286222213,25sleep30-21swapper/309:00:263
20229221414,184sleep320239-21find10:10:053
20229221414,184sleep320239-21find10:10:053
242102195142,30sleep30-21swapper/308:40:113
6931218421,144sleep37015-21fschecks_time07:45:143
21982217819,142sleep122003-21apt11:59:541
8485217214,140sleep38567-21fschecks_time07:50:143
23968217113,142sleep024020-21latency_hist08:39:560
11640217016,45sleep311672-21proc_pri11:25:253
175912169117,37sleep317775-21latency_hist08:19:573
175912169117,37sleep317775-21latency_hist08:19:573
96892168112,31sleep30-21swapper/309:35:253
96892168112,31sleep30-21swapper/309:35:253
26252216822,129sleep326257-21entropy07:05:133
31580216712,66sleep30-21swapper/310:45:213
31580216712,66sleep30-21swapper/310:45:213
28023216616,138sleep328082-21latency07:10:183
5405216312,70sleep34920-21/usr/sbin/munin11:05:233
5405216312,70sleep34920-21/usr/sbin/munin11:05:233
2080215913,64sleep32199-21date12:39:563
255721587,139sleep32559-21sshd09:14:223
26264215312,120sleep30-21swapper/308:45:203
16185215312,23sleep30-21swapper/311:40:303
11698215318,111sleep30-21swapper/308:00:153
1982521528,124sleep319509-21/usr/sbin/munin08:25:183
13161215214,125sleep313241-21fschecks_time08:05:163
3067214615,26sleep33120-21modprobe10:59:543
3067214615,26sleep33120-21modprobe10:59:543
3152921449,48sleep30-21swapper/307:20:113
14113214289,37sleep314000-21/usr/sbin/munin09:50:153
18663214119,14sleep30-21swapper/308:20:293
5269213714,64sleep35282-21basename07:40:053
2866213415,103sleep30-21swapper/309:15:073
502213216,101sleep3548-21latency_hist12:34:563
916212813,100sleep31047-21timerwakeupswit10:50:253
916212813,100sleep31047-21timerwakeupswit10:50:253
7796212813,103sleep37839-21cat11:14:553
7796212813,103sleep37839-21cat11:14:553
2666821289,104sleep326728-21cat10:30:153
2666821289,104sleep326728-21cat10:30:153
1808121280,10sleep20-21swapper/211:45:212
13351212711,25sleep30-21swapper/311:30:253
12325212628,79sleep212416-21tune2fs09:45:132
22703212562,46sleep30-21swapper/308:35:113
26015212212,94sleep326092-21grep12:10:263
28864212119,82sleep30-21swapper/308:54:573
10026212110,100sleep310070-21ntpq11:20:203
8248212012,96sleep38300-21cat11:15:163
20624211913,82sleep220230-21/usr/sbin/munin10:10:202
20624211913,82sleep220230-21/usr/sbin/munin10:10:202
749211817,84sleep1837-21mailstats10:50:231
749211817,84sleep1837-21mailstats10:50:231
27841211816,85sleep027907-21fschecks_time07:10:150
22918211814,14sleep30-21swapper/312:00:253
14544211611,16sleep30-21swapper/311:35:183
11751211513,88sleep111752-21sshd09:42:221
15970211414,20sleep316009-21ntpq09:55:193
7337211315,15sleep30-21swapper/309:29:563
7337211315,15sleep30-21swapper/309:29:563
24941211382,16sleep30-21swapper/310:25:103
24941211382,16sleep30-21swapper/310:25:103
509821120,6sleep00-21swapper/007:39:570
715211179,19sleep3775-21fschecks_time07:25:153
1239211113,82sleep21340-21timerandwakeup07:25:272
9938211012,82sleep30-21swapper/307:55:073
26929211011,13sleep30-21swapper/312:15:063
11164210871,21sleep30-21swapper/309:40:223
30093210712,15sleep30-21swapper/312:25:073
28040210711,14sleep30-21swapper/310:35:073
23390210777,14sleep30-21swapper/310:20:103
11279210714,71sleep111408-21latency_hist07:59:571
7654210616,71sleep00-21swapper/009:30:140
7654210616,71sleep00-21swapper/009:30:140
5757210610,79sleep05783-21proc_pri07:40:220
3231821068,14sleep30-21swapper/309:05:143
6203210517,61sleep15997-21/usr/sbin/munin09:25:141
6203210517,61sleep15997-21/usr/sbin/munin09:25:141
21566210570,16sleep30-21swapper/308:30:223
16113210522,68sleep116126-21cpu11:40:281
5219210368,20sleep35362-21grep09:20:283
32296210318,71sleep132420-21/usr/sbin/munin12:30:261
19161210310,14sleep30-21swapper/310:05:203
2266621018,13sleep00-21swapper/012:00:170
2233210171,18sleep32252-21df_inode07:30:123
16620210114,68sleep016626-21ntp_states08:15:220
16620210114,68sleep016626-21ntp_states08:15:220
29298210019,60sleep129327-21sendmail10:39:541
1924921006,14sleep30-21swapper/311:50:113
33812997,12sleep30-21swapper/311:00:063
33812997,12sleep30-21swapper/311:00:063
2113229912,67sleep30-21swapper/311:55:203
1832029812,11sleep30-21swapper/311:45:273
80412978,16sleep00-21swapper/011:15:080
78102976,12sleep30-21swapper/309:30:173
78102976,12sleep30-21swapper/309:30:173
2855129764,15sleep30-21swapper/312:20:103
732129619,61sleep27335-21latency_hist09:29:552
732129619,61sleep27335-21latency_hist09:29:552
3221929615,66sleep132370-21unixbench_multi07:20:331
2804229611,19sleep00-21swapper/010:35:080
296992958,15sleep30-21swapper/307:15:063
2645929511,71sleep026465-21ntpq08:45:250
2955529465,14sleep30-21swapper/308:55:213
406129316,64sleep24184-21cat11:00:252
406129316,64sleep24184-21cat11:00:252
155782936,12sleep30-21swapper/308:11:053
250012926,11sleep30-21swapper/312:08:243
134272925,12sleep30-21swapper/309:49:023
308382916,11sleep30-21swapper/310:44:283
1477829110,67sleep114866-21grep11:35:241
183022907,11sleep30-21swapper/310:03:273
183022907,11sleep30-21swapper/310:03:273
732228922,46sleep07386-21sendmail_mailqu07:45:230
512028911,62sleep25218-21cat09:20:272
2985028922,22sleep00-21swapper/012:24:560
2534228914,60sleep10-21swapper/110:25:201
2534228914,60sleep10-21swapper/110:25:201
227852895,12sleep30-21swapper/310:16:223
1954828916,58sleep219578-21awk11:50:182
1327728916,61sleep213350-21switchtime11:30:242
2559728817,55sleep025709-21apt-config08:44:570
3260828712,61sleep032653-21ntp_kernel_pll_09:05:190
1459228516,55sleep114667-21switchtime09:50:331
2725428324,37sleep127278-21munin-run08:49:541
1980528314,54sleep219822-21kernelversion08:25:172
2881328221,46sleep128838-21basename08:54:551
2667328212,54sleep126756-21mailstats07:05:281
2119728212,55sleep221239-21processes11:55:232
83428122,39sleep2894-21fschecks_time12:35:152
3120328015,31sleep20-21swapper/207:19:582
555327911,54sleep25567-21irqstats07:40:162
2746827912,53sleep127556-21basename12:15:241
2653527928,31sleep026561-21netstat07:05:190
1917127925,29sleep00-21swapper/010:05:210
794027715,46sleep27985-21ntp_kernel_pll_09:30:202
794027715,46sleep27985-21ntp_kernel_pll_09:30:202
568927711,12sleep10-21swapper/107:40:191
379627716,44sleep23802-21/usr/sbin/munin07:35:112
3271527718,22sleep00-21swapper/010:50:100
3271527718,22sleep00-21swapper/010:50:100
3116727723,38sleep10-21swapper/110:45:101
3116727723,38sleep10-21swapper/110:45:101
2206327717,44sleep222080-21cut10:15:162
1504427712,49sleep015073-21ntp_states08:10:210
498027620,36sleep15031-21munin-run07:39:551
3231527617,25sleep20-21swapper/209:05:132
1242927623,27sleep00-21swapper/011:29:540
314927517,25sleep10-21swapper/110:59:561
314927517,25sleep10-21swapper/110:59:561
2906427524,23sleep20-21swapper/207:14:572
2780527516,33sleep0370-21snmpd10:34:560
2780527516,33sleep0370-21snmpd10:34:560
1272327513,45sleep012725-21/usr/sbin/munin11:30:100
2671827317,41sleep226873-21latency_hist12:14:572
1185427316,39sleep211149-21/usr/sbin/munin11:25:282
920027214,26sleep00-21swapper/009:35:140
920027214,26sleep00-21swapper/009:35:140
1526427121,33sleep115386-21sed08:10:261
1356027119,30sleep013631-21munin-run09:49:550
717227015,35sleep17308-21unixbench_multi11:10:251
717227015,35sleep17308-21unixbench_multi11:10:251
3164727017,21sleep20-21swapper/212:30:102
2639927017,25sleep20-21swapper/208:45:232
254042709,43sleep10-21swapper/112:10:071
2144727021,33sleep221459-21netstat08:30:172
188362707,51sleep00-21swapper/011:49:150
140132706,52sleep10-21swapper/108:05:501
110627018,29sleep11221-21latency_hist09:09:561
349526916,27sleep00-21swapper/007:34:570
2791926919,28sleep00-21swapper/008:50:180
27462695,12sleep20-21swapper/210:55:452
27462695,12sleep20-21swapper/210:55:452
236326914,43sleep02429-21wc10:55:230
236326914,43sleep02429-21wc10:55:230
171126920,35sleep21738-21awk09:10:182
1486726917,31sleep20-21swapper/211:35:252
676026814,32sleep06465-21/usr/sbin/munin11:10:160
676026814,32sleep06465-21/usr/sbin/munin11:10:160
503026820,23sleep20-21swapper/211:05:132
503026820,23sleep20-21swapper/211:05:132
423826813,40sleep14375-21cat09:19:571
220122687,17sleep00-21swapper/008:30:400
1175426814,28sleep00-21swapper/008:00:160
110826810,44sleep01166-21sendmail_mailqu07:25:250
1077526821,24sleep20-21swapper/209:40:132
83826720,26sleep20-21swapper/210:50:242
83826720,26sleep20-21swapper/210:50:242
625126723,23sleep00-21swapper/011:09:560
625126723,23sleep00-21swapper/011:09:560
290826719,27sleep20-21swapper/207:30:272
2206626710,34sleep00-21swapper/011:59:570
201612677,49sleep00-21swapper/011:51:210
1619126717,35sleep116313-21timerandwakeup09:55:251
521326614,37sleep15230-21uname11:05:161
521326614,37sleep15230-21uname11:05:161
3056026612,37sleep230596-21/usr/sbin/munin12:25:222
2516826625,20sleep20-21swapper/212:09:562
1742226615,31sleep10-21swapper/110:00:181
1742226615,31sleep10-21swapper/110:00:181
1657626616,28sleep00-21swapper/011:40:440
602226516,27sleep00-21swapper/009:25:090
602226516,27sleep00-21swapper/009:25:090
3200526520,22sleep20-21swapper/207:20:302
2278926516,21sleep20-21swapper/208:35:142
1413226511,39sleep014133-21sshd08:07:230
1030826519,32sleep110442-21sed11:20:261
3085926410,38sleep130899-21idleruntime09:00:161
2988626415,23sleep10-21swapper/110:40:181
711526312,36sleep27173-21latency07:45:172
2648726312,32sleep226536-21/usr/sbin/munin10:30:102
2648726312,32sleep226536-21/usr/sbin/munin10:30:102
1963526318,27sleep119641-21ntp_states11:50:211
1803426314,20sleep10-21swapper/111:45:211
1799226317,28sleep117984-21apt-get08:20:111
2997426217,22sleep10-21swapper/107:15:161
29782626,39sleep00-21swapper/009:15:160
2722626219,18sleep20-21swapper/212:15:172
1857026217,19sleep20-21swapper/208:20:282
1847126218,18sleep00-21swapper/010:04:570
1847126218,18sleep00-21swapper/010:04:570
989626110,37sleep09927-21/usr/sbin/munin11:20:170
75352615,10sleep10-21swapper/109:29:581
75352615,10sleep10-21swapper/109:29:581
3140826113,23sleep00-21swapper/012:29:560
2540926113,27sleep00-21swapper/010:25:240
2540926113,27sleep00-21swapper/010:25:240
2361526116,23sleep20-21swapper/212:04:562
2248726119,19sleep00-21swapper/010:15:270
1750326119,26sleep217527-21munin-run08:19:562
1750326119,26sleep217527-21munin-run08:19:562
915526011,32sleep29188-21df09:35:122
915526011,32sleep29188-21df09:35:122
2375826012,30sleep023797-21ntpq10:20:190
116726018,22sleep10-21swapper/107:25:261
469625917,28sleep04728-21sed11:04:550
469625917,28sleep04728-21sed11:04:550
2946825920,19sleep00-21swapper/008:55:180
278892597,44sleep00-21swapper/012:15:350
1996525915,23sleep120015-21unin-run10:09:541
1631725913,22sleep20-21swapper/209:55:262
1364725917,25sleep113828-21apt-config09:49:561
1149125926,15sleep20-21swapper/208:00:062
3029925815,27sleep20-21swapper/210:40:272
3021225815,17sleep00-21swapper/007:15:230
2675725818,18sleep20-21swapper/207:05:292
25382585,11sleep00-21swapper/009:14:070
2422125819,20sleep00-21swapper/012:05:180
1781025816,23sleep20-21swapper/210:00:272
1781025816,23sleep20-21swapper/210:00:272
94632577,41sleep00-21swapper/007:52:290
496425711,21sleep00-21swapper/009:20:250
3012625714,20sleep00-21swapper/010:40:250
2958925711,19sleep10-21swapper/108:55:231
2906125716,24sleep229145-21tr12:20:262
2470225715,22sleep10-21swapper/110:24:561
1928825711,29sleep218680-21/usr/sbin/munin10:05:232
1213325718,18sleep10-21swapper/108:00:251
1003825718,20sleep20-21swapper/207:55:142
812725619,22sleep10-21swapper/111:15:131
33412565,17sleep10-21swapper/107:33:451
2934325612,18sleep20-21swapper/208:55:162
2260625614,22sleep10-21swapper/108:35:051
2034225615,22sleep10-21swapper/110:10:151
2034225615,22sleep10-21swapper/110:10:151
1466925615,14sleep20-21swapper/209:50:342
1399525614,24sleep013517-21apt-get09:50:040
120225613,23sleep11208-21ntp_states12:35:221
1068825613,25sleep010683-21apt-get09:40:070
1056925611,28sleep010690-21sed07:55:360
970225522,20sleep10-21swapper/107:54:561
3177225518,17sleep00-21swapper/010:45:260
3177225518,17sleep00-21swapper/010:45:260
3007025515,22sleep10-21swapper/112:25:051
2712925513,25sleep126462-21/usr/sbin/munin10:30:251
2712925513,25sleep126462-21/usr/sbin/munin10:30:251
2478825515,17sleep20-21swapper/208:40:272
1309625517,23sleep10-21swapper/111:30:191
707625412,19sleep10-21swapper/107:45:161
415725414,23sleep24168-21modprobe09:19:542
3222225412,19sleep00-21swapper/012:30:250
1175825412,17sleep10-21swapper/111:25:271
977325316,23sleep29836-21fw_packets11:20:152
473025314,17sleep10-21swapper/111:04:561
473025314,17sleep10-21swapper/111:04:561
3076325317,16sleep00-21swapper/009:00:140
2571125312,23sleep10-21swapper/108:44:581
2384225313,24sleep223848-21ntp_states10:20:212
17662535,9sleep00-21swapper/012:36:500
1638325312,22sleep20-21swapper/211:40:382
1426725311,26sleep014262-21apt-get11:35:070
3199225214,23sleep031998-21ntp_states07:20:280
2804425212,22sleep228111-21df10:35:102
2762825211,18sleep20-21swapper/208:50:112
2387525212,22sleep123932-21df12:05:111
2084325215,16sleep10-21swapper/108:29:561
3201925112,23sleep232174-21latency_hist09:04:572
2220125116,20sleep10-21swapper/110:15:191
2153625012,23sleep121542-21ntp_states08:30:201
2069425012,21sleep020710-21ntp_states10:10:220
2069425012,21sleep020710-21ntp_states10:10:220
2034625012,23sleep020438-21users08:25:270
1044525014,16sleep10-21swapper/109:39:551
1044525014,16sleep10-21swapper/109:39:551
803324912,21sleep28036-21apt-get11:15:062
2988324913,19sleep10-21swapper/112:24:571
189224912,19sleep10-21swapper/109:10:251
1691524913,14sleep00-21swapper/009:59:560
1459624910,20sleep20-21swapper/208:10:072
473624818,16sleep10-21swapper/109:20:181
951024511,20sleep2370-21snmpd07:53:082
277612457,17sleep10-21swapper/107:10:121
169652449,21sleep117068-21users08:15:271
169652449,21sleep117068-21users08:15:271
64932425,14sleep20-21swapper/211:10:102
64932425,14sleep20-21swapper/211:10:102
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional