You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 20:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Sat Jul 25, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
284502441116,4381sleep120826-21kworker/1:112:19:071
31403286348,68sleep20-21swapper/207:23:312
20934241921,382sleep120952-21cron11:58:031
20934241921,382sleep120952-21cron11:58:031
569524048,383sleep25767-21find07:43:372
626123319,304sleep11084-21kworker/u8:209:28:171
29959232531,159sleep229999-21uname07:18:382
17796231653,251sleep217802-21uname10:03:312
3320226718,60sleep20-21swapper/209:18:292
22194224466,90sleep20-21swapper/210:18:242
1769223016,196sleep01808-21ntp_kernel_pll_09:13:300
4230222814,121sleep24377-21unixbench_multi07:38:452
26518221658,89sleep20-21swapper/212:13:352
17188220911,103sleep20-21swapper/210:03:062
23418219513,165sleep123536-21cat10:23:081
10405216718,58sleep20-21swapper/207:58:392
496421669,145sleep25021-21latency_hist11:08:062
2754621619,15sleep20-21swapper/208:53:092
2411721609,56sleep20-21swapper/212:08:052
2721421540,13sleep00-21swapper/008:53:060
17061215454,46sleep20-21swapper/211:44:072
5817215237,102sleep25913-21apt-config09:28:062
13993215263,44sleep20-21swapper/208:08:492
896521519,119sleep20-21swapper/207:53:392
58721516,129sleep00-21swapper/007:28:330
165921487,16sleep20-21swapper/209:13:282
11557214741,30sleep20-21swapper/208:03:242
11557214741,30sleep20-21swapper/208:03:242
15893214413,116sleep216055-21latency_hist11:43:062
15893214413,116sleep216055-21latency_hist11:43:062
29367214310,79sleep20-21swapper/208:58:262
29367214310,79sleep20-21swapper/208:58:262
32645214010,69sleep232681-21ntp_kernel_err09:08:322
27632214024,95sleep20-21swapper/212:18:272
20876214049,72sleep20-21swapper/208:33:072
23661213814,111sleep023711-21cpuspeed10:23:230
24914213710,113sleep224964-21unin-run10:28:052
10129213615,106sleep310162-21ntp_kernel_err07:58:323
2979213419,98sleep33036-21sendmail-msp07:38:053
20977213362,14sleep20-21swapper/210:13:322
20178213318,12sleep20-21swapper/210:12:232
10773213317,12sleep20-21swapper/209:41:182
2674521329,60sleep226757-21apt-get10:33:182
23949213240,73sleep20-21swapper/208:43:042
16962213216,93sleep00-21swapper/008:18:360
14752213112,42sleep20-21swapper/209:53:332
122421317,13sleep20-21swapper/207:31:022
8057213018,37sleep20-21swapper/209:33:272
30304213011,60sleep230307-21cron12:28:042
14887212952,20sleep214881-21apt-get08:13:212
12511212826,77sleep112635-21latency_hist09:48:071
7358212714,99sleep37449-21timerandwakeup11:13:363
937121265,11sleep20-21swapper/211:20:132
937121265,11sleep20-21swapper/211:20:132
20954212610,50sleep20-21swapper/211:58:042
20954212610,50sleep20-21swapper/211:58:042
9621212425,77sleep39123-21apt-get09:38:163
1862212325,29sleep30-21swapper/310:58:063
12458212152,52sleep20-21swapper/209:48:042
126621209,100sleep21331-21latency_hist12:38:052
625621178,93sleep20-21swapper/209:28:142
29980211613,82sleep030072-21fschecks_time10:43:250
27055211649,18sleep20-21swapper/208:53:052
9943211419,79sleep110008-21latency09:38:431
256621147,90sleep20-21swapper/210:58:332
18517211211,84sleep318596-21/usr/sbin/munin08:23:353
1709221129,44sleep217213-21timerandwakeup08:18:382
29169211130,69sleep229241-21sh07:18:052
25896211027,69sleep226049-21awk10:28:382
13019211029,60sleep20-21swapper/209:48:292
25474210917,75sleep10-21swapper/110:28:291
30157210812,70sleep329862-21/usr/sbin/munin10:43:283
13307210821,67sleep112821-21apt-get08:08:151
1633321078,81sleep10-21swapper/111:43:171
1143021079,80sleep20-21swapper/211:28:212
8992210613,16sleep10-21swapper/111:18:351
8992210613,16sleep10-21swapper/111:18:351
28169210614,75sleep328210-21ls07:13:263
22492210632,24sleep20-21swapper/208:38:082
1945210528,63sleep22024-21cat07:33:282
19325210426,18sleep20-21swapper/208:28:062
32666210321,68sleep332711-21fschecks_count07:28:243
1207210321,63sleep1493-21/usr/sbin/munin10:53:361
31220210017,12sleep20-21swapper/210:48:082
2662421008,77sleep226769-21sed07:08:372
2549629925,17sleep225515-21munin-run08:48:052
3071529825,12sleep20-21swapper/209:03:192
295129821,41sleep30-21swapper/309:18:183
884229719,59sleep18964-21sort07:53:381
1295529713,25sleep20-21swapper/211:33:172
118629719,60sleep0225-21systemd-journal12:38:030
528729623,13sleep20-21swapper/211:08:262
3030829622,55sleep330371-21systemd-run12:28:053
2433329616,64sleep224335-21acpi07:03:162
868029515,23sleep10-21swapper/109:33:381
720329515,64sleep37259-21switchtime07:48:353
520729513,24sleep30-21swapper/311:08:233
3214629516,31sleep032280-21cut12:33:070
3214629516,31sleep032280-21cut12:33:070
165912959,17sleep30-21swapper/311:43:563
3068029320,33sleep20-21swapper/212:28:082
3068029320,33sleep20-21swapper/212:28:082
2770929314,64sleep127770-21fschecks_time08:53:491
2776529225,49sleep027781-21uname12:18:290
222772927,74sleep20-21swapper/208:36:502
1977129222,50sleep319859-21fschecks_time11:53:253
1977129222,50sleep319859-21fschecks_time11:53:253
1798529219,53sleep018051-21cat10:03:370
318022918,71sleep231410-21/usr/sbin/munin10:48:322
1119029126,32sleep30-21swapper/311:28:053
1119029126,32sleep30-21swapper/311:28:053
699829020,12sleep20-21swapper/211:13:272
2457329028,31sleep00-21swapper/007:03:270
12002900,9sleep10-21swapper/112:38:031
113329016,61sleep11199-21cat09:13:071
3047628920,54sleep130543-21cat09:03:061
3047628920,54sleep130543-21cat09:03:061
2171328918,54sleep121228-21/usr/sbin/munin11:58:321
79328828,35sleep00-21swapper/010:53:270
51128819,13sleep20-21swapper/210:53:162
2899828818,49sleep029117-21timerwakeupswit10:38:370
79312878,43sleep27940-21munin-run07:53:062
1812828710,15sleep20-21swapper/211:48:192
1268728717,50sleep11-21systemd11:33:041
235402860,6sleep30-21swapper/312:03:373
283362859,14sleep20-21swapper/210:38:192
1635828513,53sleep015850-21/usr/sbin/munin09:58:360
408328419,41sleep03510-21/usr/sbin/munin07:38:430
2951328412,55sleep029535-21/usr/sbin/munin12:23:340
265472840,7sleep10-21swapper/107:08:351
1078228418,11sleep20-21swapper/211:23:362
1078228418,11sleep20-21swapper/211:23:362
852128317,39sleep08679-21unixbench_multi09:33:370
589928310,16sleep00-21swapper/007:43:390
2735728313,51sleep027446-21/usr/sbin/munin10:33:400
2718028325,38sleep327194-21modprobe12:18:043
2277728321,36sleep322816-21fschecks_count08:38:253
828928220,43sleep38291-21ntp_states09:33:323
2673728221,16sleep10-21swapper/110:33:171
2563028229,33sleep325684-21munin-run07:08:053
726228118,45sleep07377-21/usr/sbin/munin07:48:360
2003328017,47sleep120047-21awk08:28:341
267702790,8sleep30-21swapper/307:08:373
221442788,34sleep20-21swapper/211:58:372
1343227821,23sleep30-21swapper/309:48:383
3209327612,42sleep10-21swapper/112:33:041
3209327612,42sleep10-21swapper/112:33:041
1548827619,30sleep00-21swapper/008:13:390
1003027619,41sleep110067-21latency07:58:301
625727519,35sleep35774-21apt-get09:28:153
1863727513,46sleep018699-21sendmail_mailst11:48:540
1889127418,27sleep319026-21grep11:48:573
1581227414,41sleep015840-21munin-run11:43:040
1581227414,41sleep015840-21munin-run11:43:040
458927322,25sleep10-21swapper/109:23:241
2421327320,29sleep10-21swapper/108:43:151
122982730,6sleep30-21swapper/308:03:483
122982730,6sleep30-21swapper/308:03:483
2605027215,41sleep326117-21users10:28:393
1763727219,24sleep30-21swapper/310:03:273
1596127216,34sleep316042-21grep09:58:273
124702727,51sleep00-21swapper/011:30:160
975127117,30sleep00-21swapper/009:38:330
2891527124,22sleep30-21swapper/310:38:363
1540027115,40sleep315485-21mailstats08:13:383
1400627122,36sleep114013-21modprobe09:53:041
1288327120,26sleep00-21swapper/009:48:270
60612705,11sleep30-21swapper/307:44:273
2880227021,27sleep10-21swapper/110:38:341
2799127015,16sleep30-21swapper/312:18:363
2567227028,20sleep20-21swapper/212:13:062
2416027019,30sleep123632-21/usr/sbin/munin10:23:361
2251027016,32sleep00-21swapper/010:18:300
205632706,45sleep00-21swapper/011:53:380
205632706,45sleep00-21swapper/011:53:380
1778027019,23sleep30-21swapper/308:23:073
1113927017,35sleep111169-21idleruntime-cro11:28:031
1113927017,35sleep111169-21idleruntime-cro11:28:031
438826918,25sleep00-21swapper/011:03:360
3079426916,22sleep30-21swapper/309:03:243
2737926920,29sleep127222-21latency_hist12:18:101
997126813,38sleep010061-21/usr/sbin/munin11:23:220
997126813,38sleep010061-21/usr/sbin/munin11:23:220
2953626819,32sleep10-21swapper/112:23:351
2616526818,23sleep00-21swapper/007:08:270
2438726814,40sleep024451-21idleruntime08:43:260
1263226810,45sleep0364-21snmpd08:05:480
1263226810,45sleep0364-21snmpd08:05:480
427026720,24sleep30-21swapper/311:03:353
340826719,30sleep13414-21ntp_states09:18:321
1498426720,28sleep10-21swapper/108:13:281
1434026715,28sleep30-21swapper/311:38:073
2711526624,22sleep30-21swapper/308:53:063
2500126515,19sleep10-21swapper/107:03:361
1166726521,25sleep00-21swapper/009:43:340
943726417,30sleep09461-21munin-run07:58:050
2185926420,24sleep00-21swapper/010:18:060
1466526418,20sleep30-21swapper/309:53:303
1181026414,32sleep311882-21find09:43:373
838326314,24sleep30-21swapper/311:18:203
838326314,24sleep30-21swapper/311:18:203
477326312,34sleep04861-21sed09:23:270
301082635,12sleep00-21swapper/008:59:050
301082635,12sleep00-21swapper/008:59:050
2474726319,23sleep30-21swapper/312:08:313
2154926312,36sleep121554-21sh10:15:041
825326214,33sleep38259-21df_inode07:53:233
62726218,24sleep10-21swapper/107:28:341
2400126217,18sleep00-21swapper/008:43:060
2374326217,24sleep30-21swapper/310:23:263
2098426224,20sleep30-21swapper/310:13:333
1868726223,21sleep10-21swapper/108:23:371
109272626,11sleep00-21swapper/008:01:520
318602616,17sleep30-21swapper/312:30:033
318602616,17sleep30-21swapper/312:30:033
2892326119,24sleep30-21swapper/308:58:073
182882616,13sleep00-21swapper/008:23:280
1655126119,25sleep116558-21sshd08:18:241
353926016,26sleep33532-21apt-get07:38:213
2132826012,32sleep321334-21diskstats11:58:213
3254925914,23sleep00-21swapper/009:08:300
3209125916,21sleep132207-21timerwakeupswit10:48:391
2443425915,26sleep024441-21diskstats12:08:240
2145225918,24sleep021484-21sshd08:33:290
2145225918,24sleep021484-21sshd08:33:290
167925915,18sleep00-21swapper/007:33:220
876325812,18sleep00-21swapper/011:18:300
876325812,18sleep00-21swapper/011:18:300
3042325816,21sleep30-21swapper/309:03:043
3042325816,21sleep30-21swapper/309:03:043
2928225817,17sleep00-21swapper/007:18:080
2821725818,24sleep00-21swapper/008:54:000
268725814,26sleep02779-21/usr/sbin/munin10:58:350
218625817,23sleep10-21swapper/110:58:241
2133625818,22sleep00-21swapper/011:58:230
1984025818,18sleep00-21swapper/008:28:290
1810725819,23sleep118125-21apt-get11:48:181
1143125821,17sleep30-21swapper/311:28:223
679425714,30sleep06796-21ntp_states09:29:050
592125714,27sleep36124-21latency_hist09:28:073
3243625717,29sleep00-21swapper/010:49:470
321782575,12sleep00-21swapper/007:26:390
2502325717,27sleep125148-21sed12:08:371
240182575,11sleep00-21swapper/012:07:270
1610825720,18sleep10-21swapper/109:58:291
67272569,19sleep00-21swapper/011:13:170
520925615,18sleep00-21swapper/011:08:240
319725615,24sleep03225-21irqstats09:18:270
2975925612,25sleep029796-21latency07:18:320
24232566,16sleep30-21swapper/309:15:193
2028325613,18sleep10-21swapper/110:13:061
1788625613,18sleep10-21swapper/110:03:341
1293825615,26sleep113029-21apt-config08:08:071
1293825615,26sleep113029-21apt-config08:08:071
67025513,24sleep3726-21users09:08:413
661125515,24sleep16629-21apt-get07:48:171
308512555,15sleep10-21swapper/110:44:191
2995225516,23sleep129958-21ntpq07:18:371
247052555,12sleep30-21swapper/308:43:343
2406725517,25sleep1292-21systemd-logind12:08:041
209925514,24sleep32096-21apt-get10:58:183
1516225514,17sleep10-21swapper/111:38:371
1516225514,17sleep10-21swapper/111:38:371
1305425511,18sleep00-21swapper/011:33:230
534625414,19sleep10-21swapper/107:43:281
53225412,16sleep30-21swapper/312:33:383
3103325413,23sleep331029-21apt-get07:23:193
2247625416,22sleep322508-21awk10:18:293
2148525415,19sleep10-21swapper/108:33:301
2148525415,19sleep10-21swapper/108:33:301
2023225415,21sleep320269-21modprobe10:13:043
78532534,15sleep10-21swapper/111:15:561
2970025315,21sleep329757-21irqstats07:18:313
2740925310,16sleep10-21swapper/107:13:081
2520325313,22sleep025199-21apt-get10:28:190
2119425314,23sleep321198-21diskstats08:33:243
2119425314,23sleep321198-21diskstats08:33:243
1728025316,22sleep017287-21users11:44:090
163825313,18sleep10-21swapper/109:13:271
1354025315,21sleep00-21swapper/008:08:380
1943225215,24sleep019441-21uname10:08:330
3183325113,22sleep331871-21ntpq10:48:333
269772519,28sleep327035-21irqstats10:33:313
1540825114,19sleep315458-21users11:38:393
1540825114,19sleep315458-21users11:38:393
1455625113,23sleep114569-21irqstats09:53:281
1334125115,17sleep30-21swapper/308:08:213
3071925014,20sleep130786-21df09:03:221
2628925016,18sleep10-21swapper/108:48:361
1325125015,20sleep112956-21/usr/sbin/munin11:33:281
1979724911,22sleep319836-21irqstats08:28:283
350724811,22sleep12998-21apt-get07:38:151
2719824814,19sleep00-21swapper/012:18:050
221224810,22sleep10-21swapper/107:33:351
3103624716,15sleep10-21swapper/107:23:211
542724610,18sleep10-21swapper/111:08:291
3202624613,19sleep00-21swapper/009:08:050
37272448,14sleep10-21swapper/111:03:211
2268924411,20sleep122686-21apt-get08:38:191
153832437,25sleep00-21swapper/009:55:490
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional