You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 16:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Wed Aug 12, 2026 12:44:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
312342458213,4554sleep231203-21apt-get09:10:282
27841225119,2485sleep031209-1kworker/0:0H12:25:330
184682225112,2217sleep218487-21apt-get08:30:092
2367252624,485sleep32380-21/usr/sbin/munin09:20:263
276824989,477sleep12793-21awk11:05:211
25255243818,397sleep10-21swapper/110:35:001
2154024360,51sleep10-21swapper/112:05:221
13205239911,366sleep10-21swapper/109:55:261
2082623856,368sleep1367-21snmpd12:02:121
2223230025,265sleep1367-21snmpd07:37:541
32527229910,276sleep132569-21latency_hist09:14:591
4413226648,201sleep14453-21proc_pri11:10:261
4413226648,201sleep14453-21proc_pri11:10:261
32170226532,214sleep1231-21systemd-journal12:39:561
32170226532,214sleep1231-21systemd-journal12:39:561
3251225030,205sleep13332-21switchtime07:40:281
27367224010,194sleep127409-21sort07:15:201
27367224010,194sleep127409-21sort07:15:201
29407222446,19sleep10-21swapper/107:20:371
8400220210,177sleep18459-21latency09:40:191
20786219730,107sleep120932-21sed08:35:291
1024321977,175sleep110384-21latency_hist08:05:001
2230721959,15sleep10-21swapper/108:40:301
32401218530,143sleep132441-21ntpq07:30:231
32401218530,143sleep132441-21ntpq07:30:231
30672217915,81sleep10-21swapper/112:34:591
7917217631,111sleep18005-21cat07:55:271
1700217612,147sleep21837-21latency_hist09:20:012
18646217571,16sleep10-21swapper/108:30:371
17668217412,126sleep117704-21modprobe11:54:571
4322217211,85sleep04329-21sh07:45:160
4322217211,85sleep04329-21sh07:45:160
1600721697,36sleep10-21swapper/111:48:301
26506216436,59sleep126632-21latency_hist07:15:001
2652721628,14sleep00-21swapper/008:55:190
18136215610,82sleep126499-21munin-node08:30:001
28368214930,96sleep228394-21munin-run07:19:572
28368214930,96sleep228394-21munin-run07:19:572
24891214827,26sleep10-21swapper/112:15:241
24891214827,26sleep10-21swapper/112:15:241
29830214011,116sleep029868-21processes12:30:260
18079214029,89sleep10-21swapper/111:55:011
924821399,78sleep10-21swapper/111:25:281
2753721395,11sleep10-21swapper/108:59:561
8839213821,32sleep20-21swapper/209:40:292
30450213527,95sleep130470-21dpkg07:25:101
2286021355,16sleep00-21swapper/008:44:410
5507213428,90sleep15510-21cron07:49:571
5507213428,90sleep15510-21cron07:49:571
735521339,112sleep17433-21latency11:20:191
26751213312,77sleep126767-21modprobe10:39:571
26041213281,21sleep00-21swapper/008:54:590
631221319,38sleep10-21swapper/109:34:581
631221319,38sleep10-21swapper/109:34:581
705221306,109sleep10-21swapper/109:35:271
29124212713,39sleep129172-21latency_hist12:29:581
1647021279,37sleep10-21swapper/108:24:591
1293621278,108sleep1367-21snmpd11:39:131
377721268,102sleep10-21swapper/109:25:211
377721268,102sleep10-21swapper/109:25:211
11635212618,86sleep10-21swapper/108:08:391
25203212521,83sleep225237-21cut10:34:572
24895212528,47sleep10-21swapper/107:09:591
1666212530,83sleep11698-21cat09:20:001
652321249,80sleep16531-21modprobe11:16:561
1469621245,11sleep10-21swapper/108:18:001
2912221208,72sleep129156-21awk09:04:571
1138721190,7sleep20-21swapper/209:50:012
1138721190,7sleep20-21swapper/209:50:012
6814211820,77sleep26830-21uname09:35:202
1064821185,29sleep10-21swapper/109:46:131
1064821185,29sleep10-21swapper/109:46:131
2201521175,28sleep10-21swapper/110:23:531
1203021179,43sleep10-21swapper/108:10:131
19252211310,37sleep10-21swapper/110:15:131
30688210930,41sleep130750-21apt-config09:09:581
30688210930,41sleep130750-21apt-config09:09:581
14601210732,40sleep114643-21cpu10:00:151
3056521068,60sleep130601-21ntpq10:50:231
3056521068,60sleep130601-21ntpq10:50:231
18347210614,52sleep118416-21timerandwakeup10:10:281
4708210521,61sleep20-21swapper/207:45:262
4708210521,61sleep20-21swapper/207:45:262
25893210515,74sleep026031-21unixbench_singl07:10:300
31483210411,77sleep331518-21/usr/sbin/munin09:11:053
29895210432,50sleep229386-21/usr/sbin/munin09:05:272
29895210432,50sleep229386-21/usr/sbin/munin09:05:272
28895210420,52sleep228386-21apt-get07:20:102
2322210322,15sleep10-21swapper/109:20:241
1018621018,46sleep10-21swapper/111:30:131
1018621018,46sleep10-21swapper/111:30:131
29960210022,59sleep330032-21cat09:05:283
29960210022,59sleep330032-21cat09:05:283
23688210023,15sleep10-21swapper/110:29:591
754529918,67sleep27557-21open_files11:20:242
1148829910,41sleep10-21swapper/109:50:251
1148829910,41sleep10-21swapper/109:50:251
1299229816,68sleep313026-21basename11:39:563
549929712,70sleep35500-21http11:15:123
2920729711,71sleep329238-21/usr/sbin/munin07:20:313
1301829716,38sleep20-21swapper/209:55:112
224612969,11sleep20-21swapper/208:40:312
146242957,52sleep114668-21latency_hist11:44:591
2479929422,32sleep10-21swapper/108:50:151
1339829422,21sleep30-21swapper/311:40:173
3142929327,52sleep37819-21kworker/u8:310:54:573
3142929327,52sleep37819-21kworker/u8:310:54:573
2602529321,33sleep10-21swapper/112:20:131
2393129319,52sleep323962-21/usr/sbin/munin07:05:213
2343029322,33sleep10-21swapper/112:10:281
1233729111,65sleep012411-21find11:35:290
1211329117,46sleep00-21swapper/008:10:160
30829013,26sleep3382-21df09:15:133
860328926,42sleep38615-21modprobe07:59:573
2778128929,39sleep227298-21apt-get12:25:072
2611228916,55sleep226148-21/usr/sbin/munin12:20:182
1622828822,34sleep10-21swapper/110:05:151
2639428716,53sleep326000-21/usr/sbin/munin12:20:233
2578228713,60sleep225824-21latency_hist12:19:582
2578228713,60sleep225824-21latency_hist12:19:582
1586328717,53sleep30-21swapper/310:04:573
57682865,52sleep10-21swapper/107:50:061
3067228639,26sleep00-21swapper/009:09:570
3067228639,26sleep00-21swapper/009:09:570
2812228612,61sleep328179-21latency09:00:193
148642869,16sleep30-21swapper/311:45:133
297302855,49sleep10-21swapper/110:48:041
283352857,41sleep128354-21munin-run10:44:571
2315528513,54sleep20-21swapper/212:10:212
2138428522,47sleep221433-21grep08:39:582
18842855,47sleep10-21swapper/111:02:021
1144228520,44sleep011465-21munin-plugin-st11:34:560
1144228520,44sleep011465-21munin-plugin-st11:34:560
1822028411,57sleep00-21swapper/011:55:280
235992837,36sleep10-21swapper/108:45:231
1624128330,33sleep316287-21fschecks_count10:05:173
2015428211,50sleep220196-21sed12:00:232
172928219,38sleep0822-21/usr/sbin/munin11:00:560
3210728117,46sleep332114-21/usr/sbin/munin07:30:163
3210728117,46sleep332114-21/usr/sbin/munin07:30:163
2847128121,39sleep028604-21latency_hist07:19:590
2847128121,39sleep028604-21latency_hist07:19:590
839727822,27sleep00-21swapper/011:24:590
623827816,39sleep06378-21sed11:15:300
39552775,11sleep30-21swapper/309:25:273
39552775,11sleep30-21swapper/309:25:273
1492827721,39sleep315070-21cat08:20:003
2509127619,38sleep324696-21/usr/sbin/munin08:50:213
1689827615,38sleep017048-21unixbench_singl10:05:310
1484727528,28sleep014848-21cron08:19:570
783727412,28sleep00-21swapper/007:55:260
231502740,7sleep30-21swapper/308:45:073
812827318,34sleep08123-21apt-get09:40:100
476427314,44sleep24856-21latency_hist09:29:592
476427314,44sleep24856-21latency_hist09:29:592
2911427324,28sleep20-21swapper/210:45:272
2838227320,28sleep30-21swapper/310:44:593
270227315,43sleep32769-21df07:40:143
245592736,53sleep00-21swapper/007:06:350
2059727321,30sleep20-21swapper/210:19:582
1786827319,21sleep20-21swapper/210:10:172
1075127322,32sleep210845-21/usr/sbin/munin08:05:212
710627219,31sleep20-21swapper/207:54:592
2794027223,24sleep00-21swapper/009:00:160
2609927211,43sleep026169-21find10:35:270
2245927224,27sleep20-21swapper/210:25:162
881927113,38sleep38872-21/usr/sbin/munin11:25:183
863727114,17sleep20-21swapper/211:25:132
43932717,44sleep30-21swapper/311:10:243
43932717,44sleep30-21swapper/311:10:243
3199827118,23sleep00-21swapper/007:30:090
3199827118,23sleep00-21swapper/007:30:090
1946327110,42sleep30-21swapper/310:15:193
3192927021,25sleep00-21swapper/010:55:180
3173327022,30sleep031758-21munin-plugin-st07:29:570
2793027013,38sleep327990-21sshd12:25:403
2344227013,44sleep223536-21/usr/sbin/munin08:45:202
208922706,47sleep30-21swapper/310:20:163
1333827013,36sleep313467-21latency_hist08:15:003
1008127021,24sleep00-21swapper/009:45:230
1008127021,24sleep00-21swapper/009:45:230
3105626913,41sleep231119-21idleruntime12:35:172
3105626913,41sleep231119-21idleruntime12:35:172
2844626919,25sleep00-21swapper/010:45:000
2143526915,25sleep30-21swapper/308:40:003
1820626820,28sleep30-21swapper/310:10:263
2640826722,26sleep30-21swapper/307:14:583
1173026721,25sleep211727-21apt-get11:35:112
96462666,47sleep00-21swapper/011:26:450
2488126620,22sleep00-21swapper/012:15:230
2488126620,22sleep00-21swapper/012:15:230
2450726614,37sleep324511-21df_inode12:15:143
2450726614,37sleep324511-21df_inode12:15:143
1657626623,24sleep30-21swapper/311:50:183
1649726615,24sleep20-21swapper/211:50:172
1330126615,24sleep30-21swapper/309:55:283
3060326510,36sleep20-21swapper/210:50:242
3060326510,36sleep20-21swapper/210:50:242
301626518,25sleep00-21swapper/011:05:280
186002659,32sleep00-21swapper/008:30:310
322962647,44sleep132392-21sed10:55:281
238126417,25sleep20-21swapper/207:39:572
201726413,35sleep32030-21/usr/sbin/munin07:35:303
1873626416,28sleep30-21swapper/308:30:393
1143126414,36sleep310952-21apt-get09:50:033
1143126414,36sleep310952-21apt-get09:50:033
441726316,19sleep30-21swapper/307:45:193
441726316,19sleep30-21swapper/307:45:193
3026826310,38sleep030374-21grep10:50:180
3026826310,38sleep030374-21grep10:50:180
2596826317,21sleep20-21swapper/210:35:252
238326316,30sleep02440-21/usr/sbin/munin09:20:270
2306226319,23sleep00-21swapper/010:25:300
1670926318,31sleep20-21swapper/210:05:292
1045226316,30sleep310511-21/usr/sbin/munin11:30:193
1045226316,30sleep310511-21/usr/sbin/munin11:30:193
742926217,31sleep27485-21tune2fs07:55:162
333426219,26sleep20-21swapper/207:40:292
3178426213,33sleep231862-21latency_hist07:29:592
2664526214,27sleep20-21swapper/208:55:212
1803626219,22sleep00-21swapper/008:29:590
3251126111,29sleep332615-21/usr/sbin/munin10:55:303
3224826116,19sleep30-21swapper/312:39:583
3224826116,19sleep30-21swapper/312:39:583
2792726125,19sleep20-21swapper/209:00:142
2031726117,21sleep00-21swapper/008:35:200
663826022,17sleep30-21swapper/309:35:173
250022609,13sleep20-21swapper/208:50:202
2356326017,25sleep223557-21apt-get07:05:122
202932606,10sleep00-21swapper/010:17:020
1816226014,26sleep20-21swapper/211:55:062
1486226017,25sleep214854-21apt-get11:45:122
1377426016,25sleep00-21swapper/011:40:260
626525913,28sleep06311-21munin-run09:34:570
626525913,28sleep06311-21munin-run09:34:570
624325916,25sleep30-21swapper/307:50:243
279425917,26sleep22829-21/usr/sbin/munin11:05:222
2786925913,18sleep30-21swapper/307:15:303
2786925913,18sleep30-21swapper/307:15:303
2734425914,17sleep00-21swapper/010:40:200
250532595,42sleep30-21swapper/310:33:043
2447025914,18sleep00-21swapper/010:30:270
2390625911,35sleep0367-21snmpd12:11:560
2202925917,23sleep30-21swapper/308:40:243
2120125915,28sleep221211-21/usr/sbin/munin10:20:232
547225813,26sleep25490-21apt11:15:072
372925813,28sleep33862-21cat11:09:593
1671025814,25sleep316705-21apt-get08:25:133
1543625821,23sleep015473-21expr08:20:220
372625712,31sleep03776-21latency09:25:200
372625712,31sleep03776-21latency09:25:200
3090825715,24sleep030902-21apt-get12:35:100
3090825715,24sleep030902-21apt-get12:35:100
2728425716,19sleep00-21swapper/012:24:560
2324025712,18sleep00-21swapper/008:45:140
2134125715,24sleep021409-21/usr/sbin/munin12:05:180
1487025715,22sleep00-21swapper/010:00:220
1202625717,24sleep212023-21apt-get08:10:102
666525612,29sleep06760-21perl09:35:180
3180525614,19sleep20-21swapper/210:55:162
19682566,10sleep20-21swapper/211:03:082
1820125618,22sleep318181-21apt-get11:55:153
161012567,17sleep20-21swapper/208:20:522
1492525624,18sleep20-21swapper/208:19:592
1311825621,17sleep00-21swapper/009:55:250
1057625611,29sleep310663-21fschecks_time08:05:183
97025518,18sleep30-21swapper/311:00:383
3069025513,17sleep30-21swapper/307:25:203
2939825513,19sleep00-21swapper/007:20:360
2918925514,17sleep30-21swapper/310:45:283
1176225510,17sleep00-21swapper/009:50:360
1176225510,17sleep00-21swapper/009:50:360
922425414,21sleep09290-21memory08:00:220
892125415,24sleep28917-21apt-get08:00:122
508325414,23sleep35089-21diskstats09:30:163
508325414,23sleep35089-21diskstats09:30:163
3120725412,26sleep00-21swapper/009:10:090
2634325412,17sleep30-21swapper/308:55:143
2364525416,23sleep323685-21modprobe10:29:573
1571825414,23sleep015764-21users11:45:310
303282535,37sleep20-21swapper/212:31:132
2523225315,22sleep225236-21diskstats07:10:162
246125311,27sleep00-21swapper/007:39:590
174842535,37sleep00-21swapper/011:52:370
1178925314,19sleep00-21swapper/008:10:000
400925215,20sleep00-21swapper/007:45:000
320972529,17sleep20-21swapper/207:30:152
320972529,17sleep20-21swapper/207:30:152
2933725211,22sleep329356-21apt-get12:30:093
206992525,35sleep30-21swapper/312:00:403
919125122,15sleep30-21swapper/308:00:213
236025113,23sleep22366-21ntp_states09:20:252
897925013,21sleep39031-21users09:40:303
745325014,19sleep30-21swapper/311:20:213
59482508,33sleep20-21swapper/209:30:562
59482508,33sleep20-21swapper/209:30:562
1560725015,17sleep20-21swapper/210:01:412
1386525014,16sleep20-21swapper/211:40:282
1148925011,24sleep211457-21apt-get09:50:262
1148925011,24sleep211457-21apt-get09:50:262
967724913,20sleep39674-21apt-get09:45:103
967724913,20sleep39674-21apt-get09:45:103
526124912,16sleep20-21swapper/211:14:592
526124912,16sleep20-21swapper/211:14:592
107172499,23sleep210787-21sensors_temp11:30:262
107172499,23sleep210787-21sensors_temp11:30:262
57982489,20sleep00-21swapper/007:50:130
2133824810,22sleep221332-21apt-get12:05:162
2837224710,20sleep228381-21munin-run10:44:582
2104524613,17sleep00-21swapper/012:04:570
1778924610,20sleep017790-21diskstats10:10:150
117324611,18sleep00-21swapper/009:15:310
225942456,15sleep30-21swapper/312:09:573
2083924512,17sleep00-21swapper/010:20:130
1540524513,17sleep30-21swapper/308:20:213
39432448,20sleep00-21swapper/011:10:090
39432448,20sleep00-21swapper/011:10:090
2324924311,19sleep323264-21netstat12:10:223
1712624314,14sleep20-21swapper/208:25:252
259042428,15sleep30-21swapper/310:35:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional