You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-12 - 16:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7s.osadl.org (updated Sat Sep 12, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40452268013,2648sleep020147-21kworker/u8:109:58:220
40452268013,2648sleep020147-21kworker/u8:109:58:220
186532258810,2560sleep118102-21kworker/u8:307:18:221
186532258810,2560sleep118102-21kworker/u8:307:18:221
25330276418,729sleep225354-21/usr/sbin/munin07:38:342
21569260313,572sleep321614-21/usr/sbin/munin10:53:323
25247238214,354sleep325290-21ntpq07:38:313
18826235452,278sleep118971-21grep10:43:371
18826235452,278sleep118971-21grep10:43:371
16488232823,285sleep216636-21sed08:53:402
9787229765,220sleep19807-21cut08:33:321
2998229617,208sleep13001-21cron08:13:051
2998229617,208sleep13001-21cron08:13:051
2316229011,83sleep10-21swapper/109:53:261
25752227976,126sleep125796-21ntpq09:23:431
11524225418,215sleep311668-21grep12:03:373
17811224151,177sleep117820-21modprobe10:43:041
17811224151,177sleep117820-21modprobe10:43:041
21509221953,107sleep121637-21latency_hist07:28:071
21509221953,107sleep121637-21latency_hist07:28:071
4558221384,104sleep14590-21sendmail08:18:061
16128220113,170sleep116148-21idleruntime-cro07:13:051
10010218618,109sleep110040-21cron10:18:051
7732217615,139sleep17754-21latency_hist08:28:071
19038216810,138sleep119075-21proc_pri12:28:341
18095216743,108sleep118174-21dpkg07:18:061
20046215743,102sleep120092-21cat10:48:291
20046215743,102sleep120092-21cat10:48:291
741721516,136sleep0201-21jbd2/mmcblk2p2-08:24:390
1474214164,22sleep10-21swapper/111:33:271
26704213814,107sleep026782-21/usr/sbin/munin07:43:290
15162213810,115sleep315199-21idleruntime10:33:303
15162213810,115sleep315199-21idleruntime10:33:303
23694213739,83sleep123738-21ntpq07:33:321
336213256,16sleep10-21swapper/109:47:331
15567213143,37sleep115647-21tune2fs12:18:251
28217212711,64sleep10-21swapper/109:33:071
14738212721,30sleep114704-21latency_hist10:33:071
31289212413,54sleep131305-21modprobe09:43:051
24402212413,98sleep024411-21df_inode11:03:220
32592212144,63sleep10-21swapper/111:28:351
2979521208,98sleep129934-21latency_hist09:38:081
2391321207,100sleep00-21swapper/011:01:240
765421199,93sleep17170-21/usr/sbin/munin10:08:321
1572421195,100sleep00-21swapper/008:53:170
17494211811,32sleep117558-21uname12:23:341
24260211720,19sleep10-21swapper/109:18:381
5949211647,11sleep10-21swapper/111:48:211
11586211612,90sleep011617-21idleruntime-cro10:23:050
14407211347,14sleep10-21swapper/108:48:301
11753211214,80sleep111874-21timerwakeupswit08:38:371
10307211238,18sleep10-21swapper/112:00:321
10939211119,27sleep10-21swapper/110:18:381
2589721105,11sleep10-21swapper/107:40:111
23139210915,15sleep10-21swapper/110:58:311
2049021095,90sleep120534-21ntpq12:33:311
32403210814,79sleep132432-21latency_hist08:03:081
17097210814,75sleep017191-21/usr/sbin/munin07:13:290
6997210732,17sleep10-21swapper/110:08:081
31017210710,13sleep10-21swapper/111:23:341
2641721057,14sleep10-21swapper/107:43:221
11854210435,15sleep10-21swapper/112:05:331
3488210317,69sleep03552-21lockfile-remove09:58:060
31047210221,65sleep331127-21mailstats11:23:363
27187210113,68sleep027240-21latency_hist11:13:070
27187210113,68sleep027240-21latency_hist11:13:070
19461210115,23sleep10-21swapper/109:03:361
17428210123,56sleep30-21swapper/308:58:293
17428210123,56sleep30-21swapper/308:58:293
597321006,11sleep10-21swapper/108:21:001
597321006,11sleep10-21swapper/108:21:001
30765210030,50sleep330767-21cron07:58:053
3044210013,73sleep23056-21kernelversion11:38:292
2112210014,70sleep32139-21awk08:08:313
2112210014,70sleep32139-21awk08:08:313
3227829922,53sleep032430-21sed09:43:360
1387129815,58sleep00-21swapper/010:28:340
2614929718,19sleep10-21swapper/111:08:281
2614929718,19sleep10-21swapper/111:08:281
2102429710,73sleep121113-21switchtime09:08:371
530929510,71sleep35350-21systemd-run10:03:053
530929510,71sleep35350-21systemd-run10:03:053
150262955,11sleep10-21swapper/112:16:191
1570829417,54sleep215848-21grep10:33:412
1570829417,54sleep215848-21grep10:33:412
1467829415,65sleep014742-21processes08:48:370
223772935,10sleep10-21swapper/110:57:011
1777429325,51sleep10-21swapper/108:58:351
1777429325,51sleep10-21swapper/108:58:351
177142930,9sleep00-21swapper/012:23:360
1376329318,57sleep213828-21/usr/sbin/munin07:03:342
1307629311,65sleep00-21swapper/008:43:320
192629219,39sleep20-21swapper/211:33:362
2962829114,62sleep029750-21timerandwakeup11:18:360
736729014,60sleep27423-21basename10:08:252
64829014,21sleep10-21swapper/108:03:321
963828911,64sleep09674-21ntp_kernel_pll_11:58:330
77328916,17sleep10-21swapper/109:48:301
1680228917,23sleep30-21swapper/312:23:073
221162888,18sleep10-21swapper/107:28:321
1525028815,51sleep10-21swapper/110:33:321
1525028815,51sleep10-21swapper/110:33:321
1187728813,27sleep20-21swapper/208:38:382
2566028710,19sleep10-21swapper/111:08:081
188832877,58sleep30-21swapper/309:03:223
1619528719,25sleep00-21swapper/007:13:080
844228615,53sleep10-21swapper/108:28:351
3011428656,13sleep10-21swapper/107:53:351
2496128612,58sleep325130-21cat09:23:083
3019228519,43sleep230329-21grep07:53:362
2596528519,42sleep226052-21fschecks_time11:08:252
2596528519,42sleep226052-21fschecks_time11:08:252
2155328517,46sleep221568-21/usr/sbin/munin10:53:312
160242858,25sleep116112-21cat08:53:311
1211028516,52sleep212143-21irqstats10:23:272
85942845,67sleep10-21swapper/111:56:571
53032845,47sleep10-21swapper/111:44:251
423128411,60sleep14254-21tune2fs09:58:551
423128411,60sleep14254-21tune2fs09:58:551
1913128420,38sleep319196-21grep07:18:373
1913128420,38sleep319196-21grep07:18:373
633528312,51sleep35851-21/usr/sbin/munin11:48:313
259828312,54sleep22631-21/usr/sbin/munin09:53:312
246528311,53sleep31-21systemd11:38:053
1241528214,13sleep10-21swapper/112:08:241
122442826,61sleep112291-21ntpq10:23:301
2877428121,29sleep30-21swapper/311:18:073
2768428118,25sleep20-21swapper/209:28:402
1896728117,45sleep218979-21fschecks_count09:03:252
1677928117,49sleep216800-21latency_hist12:23:062
2927128024,24sleep30-21swapper/307:53:093
292242808,16sleep129269-21unin-run07:53:071
219882807,15sleep10-21swapper/109:13:211
139012808,20sleep113920-21munin-run08:48:051
929927924,35sleep20-21swapper/210:13:342
2174827917,48sleep321794-21latency_hist09:13:073
2060927917,45sleep220689-21grep12:33:362
183027925,36sleep21852-21fschecks_count08:08:262
183027925,36sleep21852-21fschecks_count08:08:262
1624027918,29sleep30-21swapper/308:53:373
604827814,49sleep06089-21sort11:48:240
2217027810,15sleep30-21swapper/309:13:273
2782927710,51sleep10-21swapper/111:13:331
2742927715,45sleep227422-21apt-get11:13:212
2314927715,41sleep20-21swapper/210:58:322
2020527721,26sleep00-21swapper/009:08:070
1738127714,25sleep00-21swapper/008:58:260
1738127714,25sleep00-21swapper/008:58:260
877227616,25sleep20-21swapper/211:58:072
2301927613,41sleep323048-21irqstats10:58:293
217482766,52sleep30-21swapper/307:28:223
1862227623,28sleep018102-21kworker/u8:307:18:170
1862227623,28sleep018102-21kworker/u8:307:18:170
1826727627,28sleep30-21swapper/307:18:083
1489527615,26sleep30-21swapper/308:48:403
693527519,32sleep37017-21mailstats08:23:373
2681427519,41sleep226859-21grep07:43:312
2610027521,27sleep00-21swapper/009:23:500
199127511,49sleep22021-21sed09:53:072
936227414,31sleep30-21swapper/311:58:283
2740027423,30sleep30-21swapper/309:28:373
1524027422,30sleep30-21swapper/312:18:063
991927310,43sleep00-21swapper/008:33:350
463827311,49sleep34716-21cut08:18:083
3134127322,27sleep30-21swapper/309:43:073
286827318,34sleep32896-21fschecks_count11:38:263
2641427316,25sleep30-21swapper/307:43:193
433027227,24sleep20-21swapper/211:43:212
2599427217,35sleep326098-21timerandwakeup09:23:493
1069827210,34sleep30-21swapper/310:18:323
23312715,13sleep00-21swapper/011:36:210
1786227120,25sleep30-21swapper/310:43:063
1786227120,25sleep30-21swapper/310:43:063
145722715,11sleep20-21swapper/210:31:392
285327010,47sleep10-21swapper/111:38:241
2235327013,30sleep20-21swapper/209:13:302
1560427017,25sleep20-21swapper/207:08:422
752926926,23sleep00-21swapper/011:53:250
3218126914,39sleep232190-21diskstats11:28:232
2882526919,28sleep00-21swapper/009:33:310
1878426910,43sleep218549-21/usr/sbin/munin12:28:272
1867626921,26sleep20-21swapper/209:03:082
1867626921,26sleep20-21swapper/209:03:082
1341826920,32sleep213546-21/usr/sbin/munin08:43:382
302722687,12sleep10-21swapper/111:23:061
2991226810,42sleep029957-21/usr/sbin/munin07:53:300
2019826827,27sleep320199-21cpu07:23:213
2019826827,27sleep320199-21cpu07:23:213
922826715,26sleep30-21swapper/308:33:063
2779726718,24sleep00-21swapper/011:13:320
2095826718,26sleep20-21swapper/210:53:072
2095826718,26sleep20-21swapper/210:53:072
1865226712,26sleep30-21swapper/312:28:243
1395326719,31sleep30-21swapper/308:48:073
75072669,15sleep30-21swapper/311:53:243
3184626612,30sleep30-21swapper/309:43:273
3092726623,29sleep20-21swapper/211:23:312
2454726615,33sleep224570-21modprobe07:38:062
221526612,26sleep00-21swapper/008:08:360
221526612,26sleep00-21swapper/008:08:360
2214626624,22sleep20-21swapper/207:28:332
8892655,20sleep00-21swapper/011:32:410
613326529,21sleep06174-21systemd-run08:23:050
613326529,21sleep06174-21systemd-run08:23:050
1528026514,19sleep30-21swapper/307:08:353
746326411,37sleep07533-21cat10:08:270
668526419,21sleep30-21swapper/310:05:363
2624826419,28sleep326293-21/usr/sbin/munin11:08:303
2624826419,28sleep326293-21/usr/sbin/munin11:08:303
2179926416,23sleep00-21swapper/009:13:080
197322647,15sleep30-21swapper/310:48:233
197322647,15sleep30-21swapper/310:48:233
149632645,49sleep20-21swapper/212:15:312
495426317,31sleep24960-21/usr/sbin/munin08:18:232
495426317,31sleep24960-21/usr/sbin/munin08:18:232
2994426318,13sleep20-21swapper/211:18:552
2845726311,38sleep328492-21cpu09:33:223
2845426315,22sleep20-21swapper/207:48:352
2827926322,24sleep228418-21modprobe09:33:082
2667226314,31sleep20-21swapper/209:28:082
216192635,10sleep00-21swapper/009:12:030
1877326318,25sleep20-21swapper/207:18:272
1877326318,25sleep20-21swapper/207:18:272
1721526330,17sleep20-21swapper/207:13:312
1710126313,33sleep217107-21df_inode12:23:222
1210026314,25sleep00-21swapper/012:08:060
938126221,19sleep30-21swapper/310:13:353
456326217,19sleep20-21swapper/209:59:052
456326217,19sleep20-21swapper/209:59:052
451726218,23sleep30-21swapper/311:43:263
2478626219,23sleep20-21swapper/211:03:322
2183526216,19sleep00-21swapper/007:28:270
1575026211,27sleep00-21swapper/012:18:280
1355126214,31sleep013629-21sed07:03:280
794826111,33sleep07965-21/usr/sbin/munin08:28:180
2106526113,25sleep30-21swapper/312:34:053
2076626114,20sleep00-21swapper/012:33:380
1481526117,26sleep20-21swapper/208:48:392
1041626110,34sleep210491-21fschecks_time10:18:272
998926016,23sleep30-21swapper/308:33:383
871426016,27sleep08733-21apt-get10:13:160
496126018,26sleep34965-21/usr/sbin/munin08:18:243
496126018,26sleep34965-21/usr/sbin/munin08:18:243
378226022,21sleep30-21swapper/309:58:093
2908826010,35sleep329094-21diskstats11:18:233
202226015,30sleep32174-21latency_hist09:53:083
1745526015,28sleep017466-21/usr/sbin/munin10:38:390
1745526015,28sleep017466-21/usr/sbin/munin10:38:390
1459626019,24sleep314614-21munin-run07:08:073
1393126019,25sleep314023-21mailstats10:28:373
1308226023,20sleep30-21swapper/312:08:383
614425917,19sleep20-21swapper/211:48:262
2111425912,25sleep221235-21timerwakeupswit09:08:382
1871425911,33sleep018825-21sed10:43:360
1871425911,33sleep018825-21sed10:43:360
568525818,19sleep00-21swapper/011:48:080
56325813,24sleep30-21swapper/308:03:303
2691125817,25sleep026906-21apt-get09:28:220
191952587,12sleep30-21swapper/310:45:573
191952587,12sleep30-21swapper/310:45:573
409125719,16sleep00-21swapper/011:43:070
2796625714,27sleep027959-21apt-get07:48:210
121572579,32sleep00-21swapper/008:40:340
742525612,17sleep30-21swapper/310:08:263
2457225615,26sleep324627-21munin-run07:38:073
1811825615,18sleep20-21swapper/210:43:222
1811825615,18sleep20-21swapper/210:43:222
1763225613,26sleep317709-21/usr/sbin/munin12:23:363
1655625615,25sleep216548-21apt-get10:38:212
1655625615,25sleep216548-21apt-get10:38:212
631325510,19sleep00-21swapper/010:03:390
41025512,24sleep0458-21irqstats08:03:270
2174825511,18sleep00-21swapper/010:53:370
1415525513,24sleep00-21swapper/012:13:270
1223525520,20sleep00-21swapper/010:23:290
3106125414,24sleep331080-21apt-get07:58:173
239432548,29sleep20-21swapper/209:18:312
2045625413,23sleep020548-21users10:48:370
2045625413,23sleep020548-21users10:48:370
73802535,18sleep20-21swapper/208:24:122
44862534,10sleep20-21swapper/208:17:102
43182536,35sleep00-21swapper/008:15:060
2620825315,23sleep026144-21latency_hist07:43:080
2445325310,28sleep324307-21/usr/sbin/munin11:03:253
1854825316,18sleep00-21swapper/012:28:170
1364825311,27sleep013783-21cat12:13:070
113825315,18sleep00-21swapper/009:48:370
837425211,19sleep20-21swapper/208:28:322
309902529,24sleep031016-21ntp_states11:23:330
2046625217,20sleep220551-21cat07:23:282
2046625217,20sleep220551-21cat07:23:282
2021125211,23sleep020270-21df07:23:220
2021125211,23sleep020270-21df07:23:220
3133625114,20sleep231359-21irqstats07:58:292
2366225112,15sleep00-21swapper/007:33:310
1359725114,15sleep20-21swapper/212:13:052
920725012,22sleep28707-21apt-get11:58:152
91725014,20sleep30-21swapper/311:33:053
613725010,21sleep26207-21sensors_temp10:03:372
327302509,17sleep20-21swapper/208:03:252
1239725013,23sleep30-21swapper/308:43:073
3054124911,22sleep030633-21mailstats09:38:350
1374224919,15sleep10-21swapper/107:03:331
1630724815,17sleep00-21swapper/010:38:070
1630724815,17sleep00-21swapper/010:38:070
1232624612,17sleep30-21swapper/310:23:323
3031824515,14sleep20-21swapper/209:38:292
1106324512,17sleep20-21swapper/212:03:282
43524411,19sleep2473-21latency_hist09:48:062
318592438,17sleep00-21swapper/007:58:390
240242409,15sleep00-21swapper/009:18:330
98082395,13sleep20-21swapper/208:33:332
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional