You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 18:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Wed May 20, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20302254686,5450sleep017028-21kworker/0:209:57:230
1603525968,571sleep316086-21/usr/sbin/munin07:59:333
6158256815,537sleep16169-21ntpq10:55:231
7902242058,276sleep08058-21grep10:59:380
1905024076,365sleep019087-21awk08:09:310
363324046,386sleep03672-21ntpq12:29:280
363324046,386sleep03672-21ntpq12:29:280
10884233311,305sleep00-21swapper/007:44:190
10884233311,305sleep00-21swapper/007:44:190
20474229915,269sleep320505-21/usr/sbin/munin08:14:273
20474229915,269sleep320505-21/usr/sbin/munin08:14:273
24594226118,213sleep224603-21modprobe08:29:042
24594226118,213sleep224603-21modprobe08:29:042
2400225529,211sleep02492-21fschecks_time10:44:240
567822528,230sleep25630-21apt-get10:54:472
24523224512,218sleep324560-21unin-run11:54:053
6331224140,177sleep06418-21fschecks_time07:29:250
6331224140,177sleep06418-21fschecks_time07:29:250
1110122216,205sleep0363-21snmpd09:28:510
3796222019,176sleep13962-21tail07:19:371
3383221326,26sleep00-21swapper/007:19:270
11252221122,173sleep211286-21/usr/sbin/munin07:44:292
11252221122,173sleep211286-21/usr/sbin/munin07:44:292
10412221119,173sleep210499-21fschecks_time11:09:252
23799220434,23sleep00-21swapper/008:24:340
23799220434,23sleep00-21swapper/008:24:340
62222038,42sleep00-21swapper/012:19:300
9623219690,25sleep00-21swapper/009:24:070
9623219690,25sleep00-21swapper/009:24:070
2147121949,29sleep00-21swapper/008:19:050
2147121949,29sleep00-21swapper/008:19:050
24123218743,104sleep00-21swapper/010:09:260
24562218517,119sleep00-21swapper/011:54:060
840218029,29sleep0906-21fschecks_time10:39:230
887217834,99sleep0909-21latency_hist07:14:060
887217834,99sleep0909-21latency_hist07:14:060
3957217121,39sleep00-21swapper/010:49:240
1665621719,71sleep00-21swapper/009:44:350
28671216922,23sleep00-21swapper/008:39:360
51121689,122sleep0615-21latency_hist10:39:060
268021686,37sleep00-21swapper/008:59:390
1928216637,94sleep01966-21ntp_kernel_pll_07:14:310
22015216127,16sleep00-21swapper/010:04:050
1793521605,126sleep00-21swapper/011:32:330
4752215523,19sleep00-21swapper/007:24:240
4752215523,19sleep00-21swapper/007:24:240
25246215216,121sleep225255-21needreboot08:29:292
14701215225,87sleep014838-21unixbench_singl07:54:370
2229021429,47sleep00-21swapper/008:19:330
2229021429,47sleep00-21swapper/008:19:330
32458214153,76sleep032496-21latency_hist08:54:060
14935214014,82sleep00-21swapper/009:39:300
14935214014,82sleep00-21swapper/009:39:300
8749213435,39sleep20-21swapper/211:04:162
12016213151,65sleep012082-21ls11:14:240
12016213151,65sleep012082-21ls11:14:240
5712213011,78sleep00-21swapper/009:10:300
32381212913,93sleep00-21swapper/012:19:060
1587212812,101sleep01709-21latency_hist08:59:070
1446621289,81sleep014612-21grep11:20:140
1446621289,81sleep014612-21grep11:20:140
28292212611,99sleep228396-21latency_hist10:24:062
28292212611,99sleep228396-21latency_hist10:24:062
15780212630,83sleep015833-21tr11:24:340
15780212630,83sleep015833-21tr11:24:340
2255221228,48sleep00-21swapper/011:44:370
790721217,80sleep0363-21snmpd09:17:570
2623521208,74sleep026384-21latency_hist08:34:070
518421198,28sleep00-21swapper/012:34:290
518421198,28sleep00-21swapper/012:34:290
22917211811,68sleep023004-21timerandwakeup10:04:340
2608221168,93sleep026219-21grep10:14:350
2608221168,93sleep026219-21grep10:14:350
2322211610,70sleep02418-21sed12:24:350
3995211559,40sleep00-21swapper/009:04:360
20488211511,58sleep00-21swapper/011:40:130
1896211411,88sleep31926-21awk07:14:303
6969211210,63sleep00-21swapper/010:59:060
18957211227,15sleep00-21swapper/011:34:350
2761021119,65sleep027735-21wc10:19:360
2761021119,65sleep027735-21wc10:19:360
26166211142,53sleep00-21swapper/011:59:070
1049721116,50sleep00-21swapper/007:42:500
1109421108,13sleep30-21swapper/307:44:263
1109421108,13sleep30-21swapper/307:44:263
10970211016,78sleep111028-21fschecks_count07:44:241
10970211016,78sleep111028-21fschecks_count07:44:241
18260210927,15sleep00-21swapper/009:49:350
18260210927,15sleep00-21swapper/009:49:350
6933210814,77sleep36983-21if_eth009:14:253
31305210822,70sleep131392-21users07:05:031
31167210638,40sleep031304-21sed07:05:020
9097210534,31sleep00-21swapper/007:39:060
2960521056,59sleep00-21swapper/012:09:250
1564721058,72sleep210563-21kworker/2:107:59:242
4873210310,12sleep20-21swapper/207:24:262
4873210310,12sleep20-21swapper/207:24:262
2083421038,78sleep220841-21/usr/sbin/munin09:59:232
20340210310,75sleep120415-21/usr/sbin/munin08:14:251
20340210310,75sleep120415-21/usr/sbin/munin08:14:251
11170210318,69sleep311227-21cat09:29:073
14454210016,67sleep114512-21/usr/sbin/munin07:54:341
180229913,34sleep21895-21memory07:14:292
2853629710,36sleep00-21swapper/010:24:200
2805829715,66sleep128125-21/usr/sbin/munin08:39:211
2451029713,66sleep224521-21cron11:54:042
3133529629,51sleep331359-21grep10:34:053
2801629625,30sleep30-21swapper/312:04:233
2488729621,55sleep124926-21cut11:54:231
451529512,68sleep34635-21timerwakeupswit10:49:353
22502947,13sleep30-21swapper/312:24:343
746829326,45sleep27595-21unixbench_singl09:14:362
729829313,58sleep20-21swapper/210:59:242
847729217,61sleep18535-21basename09:19:231
847729217,61sleep18535-21basename09:19:231
3190329221,56sleep331944-21ls10:34:253
2689829211,67sleep326940-21processes08:34:343
2638029127,45sleep126424-21/usr/sbin/munin11:59:201
2643329029,49sleep026422-21apt-get08:34:190
1818328934,27sleep318256-21sort09:49:343
1818328934,27sleep318256-21sort09:49:343
1390128913,62sleep113964-21/usr/sbin/munin11:20:031
1390128913,62sleep113964-21/usr/sbin/munin11:20:031
142952889,62sleep2363-21snmpd09:39:072
1299228823,51sleep313070-21sed07:49:353
124322889,36sleep00-21swapper/007:49:200
62928715,56sleep1673-21cut12:19:311
490128718,54sleep34929-21cut12:34:243
490128718,54sleep34929-21cut12:34:243
108702879,63sleep00-21swapper/011:09:360
305202865,47sleep00-21swapper/008:44:450
1920528618,50sleep118634-21/usr/sbin/munin08:09:371
53932850,7sleep20-21swapper/212:34:342
53932850,7sleep20-21swapper/212:34:342
2843328512,60sleep228473-21ntp_kernel_pll_08:39:302
1767328527,18sleep00-21swapper/008:04:350
931128426,17sleep00-21swapper/011:04:350
502528416,48sleep15077-21interrupts12:34:261
502528416,48sleep15077-21interrupts12:34:261
3241628429,28sleep10-21swapper/112:19:071
276962848,42sleep027730-21latency_hist12:04:080
241928422,38sleep12561-21unixbench_multi12:24:361
155522847,14sleep00-21swapper/007:59:180
1327528420,32sleep20-21swapper/211:19:072
1327528420,32sleep20-21swapper/211:19:072
1254628415,54sleep312671-21cat11:14:353
1254628415,54sleep312671-21cat11:14:353
1236928417,48sleep111845-21/usr/sbin/munin11:14:331
1236928417,48sleep111845-21/usr/sbin/munin11:14:331
364728213,53sleep33716-21sensors_temp07:19:353
3171528230,35sleep331757-21awk07:09:053
2860628216,47sleep328669-21/usr/sbin/munin08:39:353
1006628216,29sleep10-21swapper/109:24:241
675828116,47sleep26826-21swap07:29:352
675828116,47sleep26826-21swap07:29:352
1583428117,24sleep10-21swapper/111:24:351
1583428117,24sleep10-21swapper/111:24:351
412228021,34sleep14262-21unixbench_singl09:04:371
220672800,7sleep20-21swapper/208:19:262
220672800,7sleep20-21swapper/208:19:262
524227916,38sleep25384-21latency_hist10:54:072
358127915,37sleep23645-21ps07:19:342
3231327918,39sleep332358-21latency07:09:293
3231327918,39sleep332358-21latency07:09:293
1093827925,27sleep111058-21sed11:09:371
1421527821,35sleep3225-21systemd-journal09:39:043
599927723,32sleep16141-21grep09:10:351
1333527710,52sleep113375-21ntp_kernel_pll_09:34:301
114112777,36sleep00-21swapper/009:29:200
1115927743,21sleep2307-21in:imuxsock09:29:062
2948327624,29sleep30-21swapper/312:09:203
3085627426,30sleep330867-21modprobe08:49:043
2790927422,36sleep00-21swapper/012:04:160
1495327414,38sleep314973-21munin-plugin-st11:24:043
1495327414,38sleep314973-21munin-plugin-st11:24:043
313172736,10sleep00-21swapper/010:33:490
2924427321,31sleep229248-21latency_hist12:09:062
2131327313,45sleep221315-21sshd08:17:052
2131327313,45sleep221315-21sshd08:17:052
2051127317,24sleep20-21swapper/209:59:062
1959827323,32sleep119635-21munin-run11:39:051
1295927315,39sleep00-21swapper/009:34:210
3139527214,36sleep20-21swapper/212:14:272
2309627217,36sleep10-21swapper/108:24:061
2309627217,36sleep10-21swapper/108:24:061
2301427215,15sleep20-21swapper/211:49:072
1752127219,33sleep10-21swapper/111:29:361
2987027121,29sleep20-21swapper/208:44:272
1424727114,23sleep30-21swapper/307:54:283
137382719,22sleep20-21swapper/207:54:072
517927020,32sleep25171-21apt-get09:09:192
2506827019,26sleep30-21swapper/308:29:253
2899326919,27sleep30-21swapper/310:24:323
285526911,44sleep22936-21cat10:44:342
1923226913,41sleep219246-21vmstat11:34:372
1177726916,23sleep10-21swapper/109:29:291
925026815,26sleep30-21swapper/311:04:343
3138826818,25sleep10-21swapper/110:34:071
3054126823,23sleep20-21swapper/207:04:242
2674626821,21sleep30-21swapper/310:19:063
2674626821,21sleep30-21swapper/310:19:063
1969826820,22sleep30-21swapper/311:39:073
175326816,34sleep21790-21df12:24:212
1535726818,26sleep20-21swapper/207:59:072
145352688,14sleep30-21swapper/309:39:203
145352688,14sleep30-21swapper/309:39:203
1050326813,15sleep30-21swapper/311:09:263
2480326715,31sleep224870-21df11:54:202
2224926721,27sleep30-21swapper/308:19:323
2224926721,27sleep30-21swapper/308:19:323
1243326720,24sleep10-21swapper/107:49:211
629926617,29sleep36326-21fschecks_count07:29:243
629926617,29sleep36326-21fschecks_count07:29:243
2561126613,24sleep20-21swapper/210:14:252
2561126613,24sleep20-21swapper/210:14:252
2296026621,28sleep322999-21modprobe11:49:043
2178626613,22sleep10-21swapper/111:44:221
2956626514,30sleep20-21swapper/212:09:232
293726521,23sleep30-21swapper/310:44:353
253122658,13sleep30-21swapper/311:54:343
250126511,39sleep12558-21cat10:44:251
1940026525,20sleep30-21swapper/308:09:393
78432647,37sleep10-21swapper/107:34:231
768826414,34sleep17752-21ps10:59:351
516926418,28sleep34678-21apt-get09:09:163
2773826418,18sleep10-21swapper/108:39:051
1809326419,19sleep30-21swapper/311:34:063
1708126420,27sleep10-21swapper/108:04:151
1520226423,17sleep20-21swapper/209:39:362
1520226423,17sleep20-21swapper/209:39:362
102326418,25sleep30-21swapper/310:39:263
3007926319,29sleep20-21swapper/210:29:192
2698526315,29sleep326981-21apt-get10:19:193
2698526315,29sleep326981-21apt-get10:19:193
934826219,26sleep20-21swapper/209:21:142
934826219,26sleep20-21swapper/209:21:142
93382626,12sleep20-21swapper/207:39:202
561126214,20sleep30-21swapper/310:54:163
3241326218,28sleep132447-21/usr/sbin/munin07:09:311
3241326218,28sleep132447-21/usr/sbin/munin07:09:311
1513526219,19sleep10-21swapper/109:39:351
1513526219,19sleep10-21swapper/109:39:351
811926115,27sleep20-21swapper/207:34:282
77872615,10sleep10-21swapper/109:16:251
45452617,10sleep30-21swapper/309:07:503
308926114,21sleep10-21swapper/109:04:051
2984026120,18sleep20-21swapper/210:29:072
275522615,11sleep30-21swapper/312:02:533
2382726127,19sleep10-21swapper/110:09:151
2269426120,21sleep20-21swapper/210:04:272
201262617,15sleep30-21swapper/311:39:153
1975726119,27sleep219760-21sshd08:12:042
1972626113,14sleep10-21swapper/109:54:371
1757026112,20sleep20-21swapper/208:04:332
1001726117,18sleep10-21swapper/107:39:361
59202605,12sleep10-21swapper/107:29:021
59202605,12sleep10-21swapper/107:29:021
457626018,24sleep10-21swapper/112:34:051
457626018,24sleep10-21swapper/112:34:051
377626011,35sleep23814-21ntpq09:04:302
1697726016,25sleep20-21swapper/211:29:242
749025918,27sleep37549-21latency10:59:293
2988225917,21sleep10-21swapper/112:09:301
2146525914,25sleep20-21swapper/211:44:062
182925916,18sleep30-21swapper/308:59:223
1675525913,26sleep10-21swapper/109:44:361
32525816,29sleep2386-21fschecks_count08:54:242
2768325814,28sleep20-21swapper/212:04:062
2206625821,23sleep10-21swapper/110:04:061
1148725814,25sleep311493-21diskstats09:29:233
103932585,36sleep30-21swapper/307:41:323
326525716,16sleep30-21swapper/312:29:193
326525716,16sleep30-21swapper/312:29:193
3151925710,30sleep131551-21awk08:49:311
259862577,37sleep10-21swapper/108:32:061
2361425717,16sleep10-21swapper/110:09:071
2342225716,27sleep323458-21fschecks_count08:24:253
2342225716,27sleep323458-21fschecks_count08:24:253
2334425718,20sleep10-21swapper/111:49:271
164422578,9sleep20-21swapper/211:28:152
164422578,9sleep20-21swapper/211:28:152
76825614,27sleep3843-21find12:19:333
67425611,28sleep2767-21mailstats12:19:322
29962566,11sleep20-21swapper/209:02:522
2793025613,26sleep127927-21apt-get12:04:171
2735225620,16sleep10-21swapper/110:19:291
2735225620,16sleep10-21swapper/110:19:291
2033625611,18sleep10-21swapper/111:40:101
83125513,26sleep1923-21/usr/sbin/munin08:54:361
70925520,21sleep30-21swapper/308:54:343
1770125514,25sleep217707-21df_inode09:49:212
1770125514,25sleep217707-21df_inode09:49:212
1731525516,19sleep30-21swapper/308:04:263
877425413,22sleep18768-21apt-get11:04:191
813125422,18sleep30-21swapper/307:34:293
752025414,19sleep10-21swapper/107:34:061
752025414,19sleep10-21swapper/107:34:061
3090925413,16sleep10-21swapper/108:49:061
3162425313,24sleep231616-21apt-get10:34:162
2853225313,24sleep128526-21apt-get10:24:171
1936425316,17sleep30-21swapper/309:54:273
1772825311,26sleep117837-21perl09:49:241
1772825311,26sleep117837-21perl09:49:241
1629025314,18sleep30-21swapper/309:44:253
1396525311,16sleep20-21swapper/211:20:042
1396525311,16sleep20-21swapper/211:20:042
74925214,22sleep1744-21apt-get10:39:161
492625214,19sleep30-21swapper/307:24:273
492625214,19sleep30-21swapper/307:24:273
3196825211,15sleep20-21swapper/208:49:402
3110025216,22sleep331106-21df_inode12:14:203
2651925216,15sleep20-21swapper/208:34:252
157202526,12sleep30-21swapper/311:24:333
157202526,12sleep30-21swapper/311:24:333
1555325212,23sleep115547-21apt-get07:59:191
92292518,34sleep30-21swapper/309:19:423
92292518,34sleep30-21swapper/309:19:423
2586825115,19sleep10-21swapper/110:14:321
2586825115,19sleep10-21swapper/110:14:321
2385625114,22sleep223923-21df10:09:202
353325010,17sleep20-21swapper/212:29:262
353325010,17sleep20-21swapper/212:29:262
235632509,17sleep30-21swapper/310:09:053
425224913,22sleep14288-21ntpq10:49:291
2075124913,15sleep30-21swapper/309:59:203
120624814,16sleep10-21swapper/107:14:121
3225524610,21sleep232312-21irqstats07:09:282
3225524610,21sleep232312-21irqstats07:09:282
3165624611,19sleep331729-21mailstats08:49:373
2382424514,17sleep10-21swapper/108:24:351
2382424514,17sleep10-21swapper/108:24:351
3161924412,15sleep10-21swapper/110:34:151
128724411,13sleep20-21swapper/210:39:332
123102438,14sleep20-21swapper/209:29:382
160832426,14sleep20-21swapper/209:44:202
238522408,15sleep30-21swapper/310:09:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional