You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 13:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Thu May 07, 2026 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
986428096,787sleep19905-21ntpq22:15:181
986428096,787sleep19905-21ntpq22:15:181
2261424636,446sleep1363-21snmpd21:13:521
25515245267,311sleep125567-21cat23:05:131
1984623978,376sleep119862-21awk21:05:041
4719239317,29sleep10-21swapper/123:40:231
8745228011,222sleep18838-21cut23:55:131
8745228011,222sleep18838-21cut23:55:131
25630221747,90sleep125650-21kernelversion19:40:151
2226022069,185sleep0363-21snmpd00:38:090
2226022069,185sleep0363-21snmpd00:38:090
6017219511,164sleep15525-21/usr/sbin/munin23:45:201
1923421898,169sleep119280-21grep19:21:131
1967218826,54sleep10-21swapper/121:51:111
17009218338,129sleep117075-21wc20:55:141
162782179104,23sleep10-21swapper/122:35:211
162782179104,23sleep10-21swapper/122:35:211
16029217822,140sleep116150-21timerwakeupswit19:10:231
260521758,153sleep12630-21netstat20:10:161
18909217511,15sleep00-21swapper/022:45:090
5058217410,149sleep15099-21munin-run20:19:531
1859221749,150sleep118684-21cat22:44:541
31623217220,52sleep10-21swapper/123:25:121
3035821727,14sleep10-21swapper/123:20:161
1569621688,146sleep115784-21grep20:50:221
23448216516,24sleep10-21swapper/121:15:211
30258215917,127sleep330275-21uname23:20:143
3093621548,134sleep131004-21basename21:40:131
25878215410,41sleep10-21swapper/121:24:541
22007215311,127sleep322117-21latency_hist19:29:553
1997721505,34sleep10-21swapper/122:48:251
1526721447,35sleep10-21swapper/100:15:161
14357214424,107sleep014423-21switchtime19:05:220
201621424,13sleep20-21swapper/221:51:122
965221417,13sleep00-21swapper/020:33:490
18402214020,100sleep218417-21fschecks_count21:00:122
821213817,98sleep10-21swapper/123:30:131
492521389,116sleep3363-21snmpd23:40:333
2220521388,52sleep10-21swapper/122:55:161
2160021359,54sleep10-21swapper/100:35:191
2160021359,54sleep10-21swapper/100:35:191
2186521345,32sleep10-21swapper/119:28:441
352621335,31sleep10-21swapper/123:37:521
3158821338,46sleep131577-21apt-get20:00:101
13763213320,95sleep113765-21sshd22:28:431
2241421329,45sleep122457-21ls19:30:141
2219121328,14sleep00-21swapper/022:55:150
1023321328,39sleep10-21swapper/100:00:051
1825921305,52sleep10-21swapper/119:15:441
1210121306,57sleep10-21swapper/122:22:131
322721297,40sleep10-21swapper/121:55:071
322721297,40sleep10-21swapper/121:55:071
20476212917,92sleep10-21swapper/122:50:111
13614212913,16sleep00-21swapper/000:10:140
13614212913,16sleep00-21swapper/000:10:140
31338212831,85sleep131347-21munin-run19:59:541
28190212832,82sleep128335-21sed23:14:551
823521279,17sleep10-21swapper/120:29:541
2436212614,91sleep22408-21apt-get23:35:192
418212416,10sleep10-21swapper/121:45:221
14541212425,87sleep114569-21users20:45:491
814321229,98sleep10-21swapper/123:52:061
814321229,98sleep10-21swapper/123:52:061
29209212217,93sleep1359-21ntpd21:35:041
29097212217,85sleep10-21swapper/119:50:211
1177121216,27sleep10-21swapper/100:05:021
1177121216,27sleep10-21swapper/100:05:021
14761212016,66sleep114883-21cat22:30:241
14761212016,66sleep114883-21cat22:30:241
8495211911,21sleep10-21swapper/122:10:211
20910211715,84sleep10-21swapper/100:34:541
23907211612,86sleep10-21swapper/123:01:011
15866211613,21sleep30-21swapper/320:50:243
18316211125,70sleep10-21swapper/121:00:071
12908211125,12sleep10-21swapper/120:42:221
28155210926,67sleep00-21swapper/023:14:540
7624210711,15sleep10-21swapper/122:09:531
2961521075,32sleep10-21swapper/123:19:111
2961521075,32sleep10-21swapper/123:19:111
6655210610,21sleep16666-21munin-run20:24:531
27105210618,11sleep10-21swapper/121:26:241
10476210621,33sleep10-21swapper/120:35:191
892521059,15sleep10-21swapper/120:30:191
660210518,12sleep10-21swapper/120:05:031
1846821058,15sleep10-21swapper/100:25:171
17715210518,12sleep10-21swapper/100:24:291
3202210435,37sleep20-21swapper/221:55:042
3202210435,37sleep20-21swapper/221:55:042
24060210410,23sleep115161-21cyclictest19:35:141
5524210318,58sleep0363-21snmpd20:20:120
20358210319,63sleep320441-21mailstats21:05:223
14457210218,11sleep10-21swapper/100:13:021
14457210218,11sleep10-21swapper/100:13:021
2648321017,15sleep30-21swapper/321:25:173
17215210120,58sleep317276-21sendmail_mailqu20:55:203
6231210027,50sleep06374-21grep23:45:230
2878121009,18sleep1363-21snmpd21:33:021
2737629922,50sleep227406-21cut21:29:522
273742978,13sleep10-21swapper/119:45:201
2406129513,70sleep224114-21cat23:01:272
1511329563,18sleep115261-21cat19:09:541
537629419,43sleep20-21swapper/220:20:062
1439729324,45sleep014538-21grep20:45:480
1171129319,55sleep011790-21timerwakeupswit22:20:220
1768029216,57sleep317257-21/usr/sbin/munin22:40:163
2506929118,50sleep325176-21latency_hist23:04:553
1657329136,24sleep00-21swapper/000:20:110
994928913,58sleep0225-21systemd-journal23:59:520
994928913,58sleep0225-21systemd-journal23:59:520
1179828914,58sleep211302-21apt-get20:39:572
3066928812,61sleep030797-21unixbench_multi23:20:230
2118728717,19sleep20-21swapper/221:09:532
1852928713,50sleep018602-21cut00:25:200
1073128718,48sleep210759-21munin-run22:19:512
1073128718,48sleep210759-21munin-run22:19:512
415728615,49sleep23973-21/usr/sbin/munin23:40:122
2380728620,48sleep023738-21apt-get23:00:520
2247728613,61sleep322572-21latency_hist00:39:533
2247728613,61sleep322572-21latency_hist00:39:533
2221928617,45sleep022238-21apt-get19:30:040
2154728613,53sleep221599-21users19:25:262
142328637,34sleep31557-21unixbench_singl20:05:253
1264728620,43sleep311809-21/usr/sbin/munin20:40:513
1624528525,34sleep20-21swapper/200:19:532
120728512,58sleep21303-21sed23:30:222
1917828419,46sleep219135-21apt-get19:20:292
581628316,55sleep35842-21kernelversion23:45:133
3213228315,46sleep032214-21find23:25:240
88282827,11sleep20-21swapper/222:10:272
62828213,54sleep0676-21/usr/sbin/munin23:30:080
2539228221,19sleep30-21swapper/323:05:113
57922816,41sleep10-21swapper/122:01:131
243028117,16sleep20-21swapper/220:10:122
1922628115,21sleep30-21swapper/322:45:173
2089328024,41sleep020908-21grep00:34:530
767427916,26sleep20-21swapper/222:09:542
3027727912,51sleep230361-21latency19:55:142
290527917,48sleep03026-21sed20:10:230
1494327919,32sleep20-21swapper/220:49:542
34472787,13sleep00-21swapper/021:55:140
34472787,13sleep00-21swapper/021:55:140
208262785,11sleep00-21swapper/021:05:550
1428127815,44sleep314395-21timerandwakeup20:45:473
2887027715,48sleep328930-21/usr/sbin/munin23:15:213
2887027715,48sleep328930-21/usr/sbin/munin23:15:213
1929927728,32sleep319321-21munin-run00:29:523
1488427727,28sleep20-21swapper/222:30:252
1488427727,28sleep20-21swapper/222:30:252
999727615,46sleep210016-21apt-get20:35:042
884127613,47sleep28899-21/usr/sbin/munin23:55:142
884127613,47sleep28899-21/usr/sbin/munin23:55:142
2774227642,17sleep20-21swapper/221:30:082
1349327613,48sleep213506-21vmstat22:25:252
100552766,49sleep30-21swapper/320:35:093
772727515,44sleep37873-21latency_hist22:09:553
2691427514,39sleep026908-21apt-get19:45:070
835927415,42sleep08361-21cron23:54:510
835927415,42sleep08361-21cron23:54:510
405427413,19sleep00-21swapper/020:15:150
3252327413,16sleep00-21swapper/021:45:130
3147127421,22sleep00-21swapper/021:40:240
243727418,35sleep32439-21apt-get23:35:203
2169327410,49sleep021838-21cat22:54:550
385927318,40sleep33865-21df_inode20:15:103
3195527325,26sleep20-21swapper/220:00:192
3140027320,29sleep30-21swapper/319:59:563
2977327318,39sleep329750-21latency_hist19:54:553
2742727316,41sleep016709-1kworker/0:0H21:29:540
2323027321,33sleep223300-21find22:59:532
2195527329,25sleep00-21swapper/019:29:520
1696227316,37sleep316996-21modprobe22:39:513
1696227316,37sleep316996-21modprobe22:39:513
137712738,14sleep30-21swapper/300:10:173
137712738,14sleep30-21swapper/300:10:173
2330127118,25sleep30-21swapper/322:59:543
2143327118,33sleep021427-21apt-get21:10:070
173802719,16sleep20-21swapper/222:40:112
1653927119,27sleep20-21swapper/220:54:552
164552716,17sleep00-21swapper/019:12:400
1081227122,27sleep00-21swapper/022:19:530
1081227122,27sleep00-21swapper/022:19:530
531327016,26sleep00-21swapper/023:44:540
325972705,10sleep00-21swapper/020:01:340
203027012,34sleep30-21swapper/321:51:133
159852707,12sleep00-21swapper/000:17:330
1162127028,23sleep30-21swapper/322:20:213
396926920,22sleep30-21swapper/321:55:253
396926920,22sleep30-21swapper/321:55:253
2966926925,29sleep229721-21modprobe23:19:522
2966926925,29sleep229721-21modprobe23:19:522
252392690,8sleep20-21swapper/219:39:552
1858926917,37sleep218620-21munin-run19:19:532
1615226919,31sleep216271-21users19:10:242
831126813,22sleep00-21swapper/022:10:160
354226817,25sleep30-21swapper/320:14:543
2274226815,23sleep20-21swapper/221:14:542
1911626815,23sleep00-21swapper/019:20:030
1393726815,32sleep013882-21latency_hist22:29:550
847326723,21sleep20-21swapper/220:30:072
2861526713,36sleep028672-21/usr/sbin/munin23:15:140
2861526713,36sleep028672-21/usr/sbin/munin23:15:140
189126713,35sleep31893-21cron23:34:513
1310326721,19sleep00-21swapper/000:09:540
1310326721,19sleep00-21swapper/000:09:540
828226620,30sleep30-21swapper/322:10:153
2617026613,37sleep326270-21users19:40:253
1504026617,29sleep315075-21munin-run19:09:523
1033126615,25sleep00-21swapper/000:00:130
481226516,22sleep20-21swapper/222:00:092
38926521,20sleep20-21swapper/223:29:542
3055226516,30sleep330677-21latency_hist21:39:543
3049426511,39sleep230586-21mailstats23:20:212
1929226517,33sleep219324-21proc_pri22:45:202
2355426413,37sleep223579-21latency_hist19:34:552
177732648,39sleep00-21swapper/019:15:190
1575426416,27sleep00-21swapper/022:35:080
1575426416,27sleep00-21swapper/022:35:080
1283326412,24sleep30-21swapper/322:25:133
296552635,15sleep20-21swapper/219:54:012
1926026311,36sleep219261-21sendmail-mta00:29:222
1788526315,33sleep317963-21sed19:15:223
178442635,12sleep00-21swapper/020:57:520
1144226315,21sleep00-21swapper/020:39:550
1772526212,35sleep017736-21sh22:40:170
175826212,35sleep01826-21/usr/sbin/munin21:51:060
140826215,23sleep30-21swapper/321:49:563
79302617,42sleep00-21swapper/020:26:380
719526118,22sleep30-21swapper/320:25:163
537726116,28sleep35372-21apt-get20:20:073
2974626116,22sleep20-21swapper/221:35:212
2351426116,27sleep223583-21/usr/sbin/munin21:15:222
2325026119,24sleep30-21swapper/321:15:153
1997826114,34sleep320013-21tr00:30:163
1637526114,24sleep20-21swapper/222:35:222
1637526114,24sleep20-21swapper/222:35:222
1084226120,22sleep30-21swapper/300:00:243
3016726021,20sleep00-21swapper/019:55:120
2198526017,26sleep30-21swapper/321:10:233
1628126025,19sleep30-21swapper/300:19:543
990925918,23sleep30-21swapper/323:59:513
990925918,23sleep30-21swapper/323:59:513
58152597,11sleep30-21swapper/322:01:313
2897125919,26sleep329005-21latency_hist21:34:543
287322598,42sleep00-21swapper/021:32:240
2750625924,20sleep30-21swapper/323:10:203
1429625921,21sleep30-21swapper/322:30:143
1429625921,21sleep30-21swapper/322:30:143
1331925915,28sleep013117-21apt-get20:44:550
115422598,14sleep20-21swapper/222:20:202
723225817,27sleep07265-21users22:05:240
279172586,12sleep20-21swapper/223:12:212
76012577,12sleep20-21swapper/223:50:212
76012577,12sleep20-21swapper/223:50:212
294325718,16sleep00-21swapper/023:35:410
2902325719,19sleep00-21swapper/019:50:200
2730925723,20sleep20-21swapper/219:45:172
2576925711,30sleep025809-21ps23:05:210
2431825715,21sleep00-21swapper/019:35:220
1911625717,24sleep319216-21users21:00:253
1148925722,21sleep20-21swapper/200:04:432
955125616,24sleep30-21swapper/322:15:123
955125616,24sleep30-21swapper/322:15:123
863225617,23sleep30-21swapper/320:30:123
2921425616,25sleep029207-21apt-get21:35:070
2453925617,19sleep20-21swapper/221:20:032
226972568,22sleep30-21swapper/319:30:203
1599425612,25sleep016091-21users20:50:250
58612556,10sleep00-21swapper/022:02:050
2164625515,20sleep20-21swapper/200:35:202
2164625515,20sleep20-21swapper/200:35:202
2086625515,18sleep20-21swapper/222:50:202
87325417,20sleep00-21swapper/020:05:140
3174525413,24sleep30-21swapper/323:25:143
1980725416,19sleep30-21swapper/319:21:273
1455325413,23sleep214683-21users19:05:242
129652545,10sleep20-21swapper/200:08:472
129652545,10sleep20-21swapper/200:08:472
3210225316,16sleep20-21swapper/221:44:542
2822425315,18sleep30-21swapper/319:49:543
258172535,11sleep00-21swapper/021:24:450
1648525312,24sleep316480-21apt-get00:20:063
129625317,20sleep20-21swapper/221:49:552
378825210,27sleep23858-21df20:15:092
2582325212,24sleep225829-21ntp_states19:40:202
2366725213,21sleep00-21swapper/021:15:240
562025116,16sleep20-21swapper/223:45:082
3179525114,21sleep331835-21if_eth020:00:163
2589825119,16sleep20-21swapper/223:05:232
1186625110,15sleep30-21swapper/300:05:083
1186625110,15sleep30-21swapper/300:05:083
841025012,17sleep30-21swapper/323:54:553
841025012,17sleep30-21swapper/323:54:553
2505125012,20sleep325110-21sendmail-msp19:39:533
1656025012,15sleep20-21swapper/200:20:092
1382725013,16sleep20-21swapper/200:10:202
1382725013,16sleep20-21swapper/200:10:202
2535524915,15sleep30-21swapper/321:20:243
164272497,33sleep30-21swapper/319:12:193
130324913,16sleep20-21swapper/220:05:242
3078824813,19sleep30-21swapper/321:40:073
2031424813,20sleep220451-21unixbench_singl00:30:232
1436924811,21sleep014418-21irqstats22:30:150
1436924811,21sleep014418-21irqstats22:30:150
745724610,16sleep20-21swapper/220:25:232
1963524612,21sleep00-21swapper/021:04:540
1682624614,19sleep216886-21fschecks_time20:55:112
2587124416,15sleep00-21swapper/019:40:220
204572416,13sleep30-21swapper/322:50:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional