You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-28 - 22:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7s.osadl.org (updated Fri Aug 28, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
312282547533,5429sleep027926-21kworker/0:108:22:180
12495280914,773sleep012560-21cpuspeed07:24:150
6370277412,746sleep16390-21/usr/sbin/munin10:29:251
1079725676,525sleep010805-21ntpq08:59:280
6210251320,477sleep26251-21ntpq07:04:232
12018243722,397sleep212042-21/usr/sbin/munin12:29:262
4430235921,321sleep14436-21/usr/sbin/munin10:24:161
3195923430,6sleep10-21swapper/110:09:011
6845233729,255sleep06699-21latency_hist08:49:020
21821231041,254sleep221855-21tune2fs11:19:172
2569922848,238sleep025851-21latency_hist09:49:020
4458226470,162sleep00-21swapper/010:24:190
6648226076,27sleep00-21swapper/012:14:020
3228522477,229sleep0367-21snmpd11:53:390
71342225104,21sleep00-21swapper/012:14:220
1411221351,149sleep01502-21apt-config11:59:000
7543221140,156sleep00-21swapper/010:34:170
32524220912,137sleep032560-21ntp_kernel_pll_10:09:210
11639219915,162sleep111656-21cut12:29:171
11273219334,120sleep011403-21grep10:44:300
2772221928,170sleep027870-21date11:39:010
21495218914,160sleep021518-21kernelversion09:34:200
18297218814,138sleep018354-21ls09:24:190
22778218521,104sleep00-21swapper/009:39:090
10275218144,109sleep0367-21snmpd10:43:370
22140218031,126sleep30-21swapper/307:54:183
30183217317,126sleep130342-21unixbench_multi11:44:271
12757217024,17sleep00-21swapper/010:49:310
1416216314,136sleep01463-21basename10:14:220
1416216314,136sleep01463-21basename10:14:220
7149216028,25sleep00-21swapper/007:09:010
2567215414,127sleep12645-21sed08:34:221
1310121549,103sleep00-21swapper/012:34:130
13841215313,44sleep313881-21ntpq09:09:243
934321509,12sleep10-21swapper/112:19:321
2940221458,122sleep029449-21ntpq09:59:240
2940221458,122sleep029449-21ntpq09:59:240
20472214512,92sleep020491-21apt-get07:49:110
20472214512,92sleep020491-21apt-get07:49:110
2014121429,118sleep019997-21latency_hist07:49:020
2014121429,118sleep019997-21latency_hist07:49:020
1649021358,115sleep016503-21awk07:34:330
25987213322,93sleep326017-21fschecks_count09:49:173
11763213114,98sleep311813-21/usr/sbin/munin12:29:193
30856212942,72sleep031012-21latency_hist11:49:030
2902521286,107sleep00-21swapper/008:14:350
5170212516,94sleep35174-21sh08:44:003
24816212522,76sleep10-21swapper/109:44:271
7402212421,40sleep00-21swapper/007:09:130
2819621249,75sleep028348-21sed09:54:310
2819621249,75sleep028348-21sed09:54:310
1476321238,100sleep014836-21date09:14:010
28003212210,96sleep228067-21switchtime09:54:292
28003212210,96sleep228067-21switchtime09:54:292
2108421227,81sleep0367-21snmpd11:14:470
14711212228,72sleep214717-21modprobe09:13:592
9714212116,62sleep00-21swapper/012:23:590
6419212027,79sleep36506-21timerandwakeup07:04:283
28656211916,82sleep028768-21grep11:39:300
2270211912,93sleep22271-21/usr/sbin/munin08:34:102
19918211835,29sleep020047-21sort11:14:020
1309421188,55sleep00-21swapper/009:08:160
398621179,96sleep0367-21snmpd10:22:540
398621179,96sleep0367-21snmpd10:22:540
17250211530,43sleep017262-21sshd07:39:170
357211360,43sleep0367-21snmpd08:27:510
26999211321,76sleep027080-21latency08:09:220
25917211320,77sleep326063-21awk08:04:323
25917211320,77sleep326063-21awk08:04:323
19184211319,79sleep319235-21sort11:09:293
192521127,57sleep00-21swapper/011:59:040
1049121129,66sleep010570-21grep12:24:270
1635021118,65sleep016495-21latency_hist09:19:020
870421100,32sleep3604-21kworker/u8:007:14:003
28520210923,45sleep30-21swapper/308:14:173
2328821099,64sleep023278-21apt-get11:24:150
2328821099,64sleep023278-21apt-get11:24:150
14754210913,18sleep20-21swapper/207:29:302
7510210828,36sleep00-21swapper/008:49:380
6184210831,60sleep16208-21netstat07:04:221
26066210814,79sleep00-21swapper/008:04:330
26066210814,79sleep00-21swapper/008:04:330
23376210819,26sleep10-21swapper/111:24:211
23376210819,26sleep10-21swapper/111:24:211
31131210623,26sleep00-21swapper/010:04:290
653121059,58sleep06657-21wc10:29:280
18865210523,60sleep319006-21sed09:24:303
13951210520,62sleep313917-21apt-get10:54:313
25577210120,56sleep225725-21unixbench_singl11:29:302
130321019,57sleep01388-21cat08:29:280
2285210011,32sleep12286-21sshd10:16:171
2285210011,32sleep12286-21sshd10:16:171
1445221007,33sleep00-21swapper/007:29:240
254042998,51sleep00-21swapper/011:29:280
2098029946,41sleep020990-21munin-run09:34:000
916829810,70sleep20-21swapper/210:39:192
397929810,28sleep23985-21ntp_states12:04:272
698729723,54sleep17136-21sort08:49:031
2175829719,60sleep321832-21/usr/sbin/munin09:34:273
872529523,56sleep28757-21sendmail10:38:592
183732959,39sleep00-21swapper/011:09:010
1213029510,38sleep00-21swapper/012:29:280
445129419,10sleep00-21swapper/012:04:450
109212947,49sleep00-21swapper/007:19:100
38712929,40sleep00-21swapper/008:39:130
1352029220,52sleep213610-21gpgv10:54:012
107112927,40sleep00-21swapper/007:19:020
645529134,41sleep36523-21switchtime10:29:273
25212906,38sleep00-21swapper/008:34:210
109442907,26sleep20-21swapper/207:19:122
249322898,42sleep024942-21munin-run08:04:010
249322898,42sleep024942-21munin-run08:04:010
2448428915,48sleep224330-21/usr/sbin/munin09:44:202
1257328925,39sleep112721-21grep09:04:291
2026528817,51sleep10-21swapper/107:49:031
2026528817,51sleep10-21swapper/107:49:031
1063028828,39sleep110651-21idleruntime-cro07:18:591
2423028517,53sleep124322-21timerandwakeup07:59:291
2423028517,53sleep124322-21timerandwakeup07:59:291
667728121,30sleep20-21swapper/208:49:002
608428020,19sleep20-21swapper/210:29:182
314872800,5sleep10-21swapper/111:49:271
2488927914,46sleep324330-21/usr/sbin/munin09:44:293
224282799,53sleep022478-21awk07:54:240
1288627915,45sleep113037-21head10:49:321
1986627825,26sleep10-21swapper/111:13:591
657027726,29sleep2289-21dbus-daemon12:14:002
2176027719,40sleep10-21swapper/107:54:001
2176027719,40sleep10-21swapper/107:54:001
2162127731,12sleep00-21swapper/011:19:030
1752427714,29sleep30-21swapper/311:04:283
1545627714,42sleep114976-21/usr/sbin/munin09:14:271
795427614,47sleep28025-21switchtime07:09:272
2499927623,25sleep20-21swapper/208:04:032
2499927623,25sleep20-21swapper/208:04:032
1684627617,33sleep20-21swapper/209:19:202
98052756,16sleep10-21swapper/108:56:181
518227521,27sleep10-21swapper/108:44:021
2978527513,37sleep129847-21sendmail-msp08:19:001
2120527517,25sleep20-21swapper/207:50:262
2120527517,25sleep20-21swapper/207:50:262
205727521,31sleep10-21swapper/108:34:011
1356327530,25sleep10-21swapper/112:34:261
1131627514,46sleep111360-21ntpq07:19:241
989027429,12sleep00-21swapper/008:57:220
90282748,47sleep30-21swapper/307:14:053
3166827421,38sleep231771-21grep11:49:332
1511027429,12sleep00-21swapper/010:57:590
1191027424,29sleep30-21swapper/310:49:013
867227323,23sleep30-21swapper/310:38:193
737527323,27sleep30-21swapper/312:14:293
2687927329,11sleep00-21swapper/009:50:190
1752227329,11sleep00-21swapper/009:19:510
1684927312,46sleep117001-21cat11:04:021
159412738,14sleep00-21swapper/010:59:240
1433427312,15sleep20-21swapper/210:54:502
673827220,31sleep31-21systemd08:49:013
3117827211,27sleep30-21swapper/311:49:223
2958427217,26sleep10-21swapper/109:59:291
2958427217,26sleep10-21swapper/109:59:291
1353827215,23sleep10-21swapper/109:09:181
2338727122,22sleep10-21swapper/107:59:011
2042327118,34sleep120573-21unixbench_singl09:29:291
1509327113,44sleep215158-21grep09:14:202
332127024,28sleep20-21swapper/210:19:292
332127024,28sleep20-21swapper/210:19:292
93326930,22sleep30-21swapper/308:29:193
3081426923,28sleep30-21swapper/311:49:013
266626913,23sleep30-21swapper/308:34:243
1155926916,37sleep311678-21timerandwakeup07:19:303
1009626916,38sleep310179-21latency_hist08:59:023
1367426825,26sleep30-21swapper/312:34:283
499026722,21sleep10-21swapper/112:09:021
2911326720,25sleep20-21swapper/209:59:182
2911326720,25sleep20-21swapper/209:59:182
1787826712,40sleep117893-21munin-run09:24:001
1361126716,30sleep313748-21gpgv10:54:023
1189626721,27sleep20-21swapper/210:49:002
686126615,25sleep10-21swapper/112:14:151
501526616,33sleep35143-21timerwakeupswit10:24:303
1910926610,39sleep219183-21sendmail_mailtr11:09:282
271442657,13sleep30-21swapper/308:09:253
1556526518,21sleep20-21swapper/207:34:112
1094226518,24sleep30-21swapper/308:59:313
3249526418,22sleep30-21swapper/310:09:203
2803026413,22sleep20-21swapper/211:39:152
3140626311,38sleep231443-21cat08:24:012
257426321,24sleep20-21swapper/210:19:002
257426321,24sleep20-21swapper/210:19:002
2287326318,26sleep20-21swapper/209:39:152
2257126311,35sleep122718-21cat09:39:021
1615726313,35sleep116222-21cat07:34:301
1360326314,21sleep20-21swapper/212:34:272
821426211,37sleep20-21swapper/212:19:002
28002626,31sleep10-21swapper/111:59:581
2752026216,29sleep127529-21/usr/sbin/munin09:54:161
2752026216,29sleep127529-21/usr/sbin/munin09:54:161
2646826221,18sleep20-21swapper/211:34:192
259102626,11sleep10-21swapper/111:31:391
245326222,19sleep30-21swapper/311:59:523
2344626218,27sleep223509-21/usr/sbin/munin11:24:222
2344626218,27sleep223509-21/usr/sbin/munin11:24:222
1571526219,24sleep30-21swapper/310:59:193
1009526217,25sleep30-21swapper/312:24:183
562126115,31sleep15702-21sed12:09:511
3268526119,21sleep30-21swapper/311:54:183
3136226117,31sleep131405-21sh08:24:001
2996826110,13sleep20-21swapper/211:44:242
239942617,13sleep30-21swapper/307:59:233
239942617,13sleep30-21swapper/307:59:233
2075526116,20sleep30-21swapper/307:50:153
2075526116,20sleep30-21swapper/307:50:153
2024226115,19sleep10-21swapper/111:14:191
1534926117,20sleep10-21swapper/107:34:011
1441326117,19sleep30-21swapper/307:29:233
1007826115,27sleep110087-21/usr/sbin/munin12:24:161
904526012,27sleep19038-21apt-get10:39:141
5112609,27sleep20-21swapper/208:29:022
3132726017,25sleep231471-21sed10:04:312
2691226018,18sleep20-21swapper/208:09:202
1633926015,27sleep316348-21/usr/sbin/munin09:19:013
1596026013,25sleep30-21swapper/307:34:243
1289026012,21sleep10-21swapper/107:24:241
777725913,27sleep10-21swapper/107:09:221
534725915,25sleep30-21swapper/312:09:413
2745025914,25sleep327445-21apt-get09:54:143
2745025914,25sleep327445-21apt-get09:54:143
2532025918,17sleep30-21swapper/311:29:273
2454525918,19sleep30-21swapper/311:28:593
2454525918,19sleep30-21swapper/311:28:593
1876525916,18sleep20-21swapper/207:44:162
1876525916,18sleep20-21swapper/207:44:162
1086625912,24sleep20-21swapper/208:59:302
814725816,29sleep18292-21sed10:34:301
2798725815,27sleep128024-21http08:13:591
2181425816,21sleep10-21swapper/111:19:161
2064025816,19sleep30-21swapper/311:14:293
2025325816,19sleep20-21swapper/211:14:202
893025720,19sleep20-21swapper/207:14:042
364525722,18sleep30-21swapper/312:04:203
318425711,21sleep10-21swapper/110:19:241
318425711,21sleep10-21swapper/110:19:241
271242575,10sleep20-21swapper/209:53:282
262625714,19sleep30-21swapper/310:19:013
182702576,10sleep10-21swapper/111:08:221
1630925713,25sleep216407-21users10:59:302
115342575,12sleep10-21swapper/110:44:561
891025613,20sleep30-21swapper/312:19:263
2912625618,21sleep329213-21fschecks_time09:59:193
2912625618,21sleep329213-21fschecks_time09:59:193
2852725614,25sleep228504-21apt-get08:14:202
2792825621,20sleep30-21swapper/311:39:083
275232567,17sleep30-21swapper/311:37:313
234612565,12sleep20-21swapper/207:59:022
234612565,12sleep20-21swapper/207:59:022
2317225613,24sleep123200-21nfs4_client09:39:221
2299625620,22sleep323004-21modprobe11:23:583
2003425618,20sleep30-21swapper/307:49:013
2003425618,20sleep30-21swapper/307:49:013
1766925614,19sleep20-21swapper/211:04:312
1389725617,24sleep113413-21apt-get10:54:081
1276625613,17sleep30-21swapper/307:24:223
769725514,20sleep10-21swapper/108:49:431
749625412,26sleep37508-21/usr/sbin/munin08:49:373
493425414,14sleep20-21swapper/210:24:292
3259825412,25sleep232592-21apt-get11:54:132
3220725416,16sleep30-21swapper/308:24:313
3106625411,20sleep30-21swapper/310:04:283
2104725414,15sleep20-21swapper/209:34:022
2057625417,18sleep20-21swapper/209:29:302
1991625418,18sleep30-21swapper/309:29:193
1767125417,18sleep20-21swapper/207:39:282
123225417,18sleep30-21swapper/310:14:173
868625312,23sleep28723-21irqstats12:19:212
281425312,24sleep32809-21apt-get10:19:133
281425312,24sleep32809-21apt-get10:19:133
185492539,16sleep10-21swapper/109:24:241
150325315,21sleep10-21swapper/111:59:011
1226125310,30sleep212290-21awk09:04:222
1188625312,24sleep311883-21apt-get09:04:113
397125215,22sleep24056-21perl08:39:192
3162825214,22sleep131647-21apt-get08:24:121
3144525216,18sleep30-21swapper/308:24:023
2324625213,23sleep323257-21ntp_states09:39:243
1847825213,16sleep10-21swapper/107:44:031
1716425212,23sleep317160-21apt-get07:39:123
1658425212,23sleep316579-21apt-get09:19:133
3220625112,23sleep132211-21diskstats10:09:141
1944325117,16sleep20-21swapper/209:29:012
1257025113,23sleep212576-21diskstats07:24:172
1033225113,22sleep110329-21apt-get08:59:121
911425012,24sleep39120-21df_inode10:39:163
2638025011,23sleep126375-21apt-get11:34:141
2268425012,21sleep20-21swapper/207:54:302
1000425011,23sleep29998-21apt-get12:24:132
2833324914,22sleep128378-21grep11:39:231
250524914,19sleep22585-21mailstats11:59:552
94124813,20sleep2969-21munin-run10:13:592
74924810,15sleep20-21swapper/208:29:142
721724812,18sleep20-21swapper/208:49:162
257292469,25sleep1364-21ntpd08:04:301
257292469,25sleep1364-21ntpd08:04:301
2597324412,16sleep10-21swapper/109:49:151
88382426,13sleep20-21swapper/208:54:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional