You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 17:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Wed Jul 22, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30752661116,6582sleep01146-21kworker/0:011:59:400
246182289011,2867sleep324593-21kworker/3:211:24:403
147852179912,1772sleep214778-21apt-get07:28:302
32190292935,882sleep332189-21systemd-run10:08:163
1168326159,588sleep311665-21apt-get12:28:363
1168326159,588sleep311665-21apt-get12:28:363
11668256713,538sleep211159-21apt-get12:28:272
11668256713,538sleep211159-21apt-get12:28:272
3098235910,336sleep33175-21mailstats08:33:453
28929232112,292sleep028998-21fw_packets08:13:360
70052288123,24sleep30-21swapper/308:48:183
29645228089,22sleep30-21swapper/309:58:403
6045224758,33sleep36202-21latency_hist10:28:183
88022236101,63sleep30-21swapper/312:18:433
4234223417,192sleep34297-21fschecks_time08:38:373
1286223343,175sleep31352-21date10:13:173
27723223271,51sleep30-21swapper/309:53:273
18426222219,69sleep018481-21sort09:23:340
18426222219,69sleep018481-21sort09:23:340
1439822188,198sleep3195-21jbd2/mmcblk2p2-07:26:573
1286221416,183sleep01299-21irqstats08:28:410
2321220141,20sleep30-21swapper/308:33:163
23349219812,170sleep323371-21modprobe11:23:153
4482219539,21sleep30-21swapper/312:04:153
7894219444,36sleep37950-21fschecks_count10:33:353
29508219310,171sleep029569-21cat09:58:370
9463219011,164sleep39530-21sed07:13:173
19041218915,152sleep318401-21/usr/sbin/munin09:23:493
19041218915,152sleep318401-21/usr/sbin/munin09:23:493
26267218832,16sleep30-21swapper/308:03:463
11776218818,25sleep30-21swapper/307:18:343
7325218120,136sleep17355-21fschecks_count08:48:321
2178021759,79sleep321496-21/usr/sbin/munin09:33:383
2665217017,18sleep30-21swapper/310:16:403
15485215911,18sleep30-21swapper/310:57:403
15485215911,18sleep30-21swapper/310:57:403
7512215813,131sleep37542-21awk10:33:143
7512215813,131sleep37542-21awk10:33:143
2643215769,30sleep32714-21switchtime11:58:463
10934215714,22sleep00-21swapper/010:43:160
1983021559,130sleep30-21swapper/307:43:403
738221487,13sleep00-21swapper/007:03:500
14549214724,102sleep214633-21latency_hist07:28:172
2787221446,12sleep00-21swapper/009:53:360
763214210,15sleep30-21swapper/308:28:163
31575214017,108sleep331637-21ls11:48:373
28763214010,118sleep328776-21acpi08:13:273
963521389,85sleep39607-21/usr/sbin/munin10:38:353
24181213721,91sleep00-21swapper/011:23:480
29900213518,70sleep20-21swapper/209:58:472
18178213410,11sleep30-21swapper/309:23:173
15666213318,16sleep00-21swapper/009:13:410
3108213120,92sleep30-21swapper/310:18:293
21492212719,90sleep021556-21sendmail_mailqu07:48:460
14377212711,39sleep30-21swapper/309:09:373
11177212440,69sleep311216-21apt-config12:28:163
11177212440,69sleep311216-21apt-config12:28:163
23895212190,14sleep30-21swapper/307:58:173
26284212011,43sleep30-21swapper/309:48:353
30510211920,79sleep030642-21grep11:43:460
2248221190,7sleep10-21swapper/107:53:181
15381211973,22sleep30-21swapper/309:13:363
27190211610,35sleep30-21swapper/311:33:403
14811211617,81sleep014882-21sensors_temp10:53:460
14811211617,81sleep014882-21sensors_temp10:53:460
16421211512,38sleep30-21swapper/307:33:353
1037921147,39sleep30-21swapper/308:58:313
5182211310,41sleep3364-21snmpd12:08:263
3510211018,77sleep13558-21grep10:18:401
25452210921,60sleep225583-21latency_hist08:03:172
25452210921,60sleep225583-21latency_hist08:03:172
9598210818,71sleep19094-21apt-get10:38:251
773210812,79sleep0785-21/usr/sbin/munin11:53:380
723721088,33sleep30-21swapper/308:48:263
1987621085,10sleep00-21swapper/011:08:550
9307210777,18sleep30-21swapper/308:53:473
151321078,88sleep1364-21snmpd11:54:571
1124821068,41sleep30-21swapper/310:43:313
709721050,6sleep00-21swapper/008:48:180
25259210547,18sleep30-21swapper/311:28:313
24614210511,65sleep30-21swapper/307:58:463
24614210511,65sleep30-21swapper/307:58:463
16555210418,70sleep216621-21modprobe09:18:152
26949210314,73sleep01-21systemd08:08:150
2356521038,84sleep323629-21ps09:38:423
22935210215,61sleep122981-21/usr/sbin/munin07:53:431
1301210015,22sleep11395-21memory08:28:421
1961429912,14sleep30-21swapper/311:08:463
1137129921,58sleep111416-21sendmail07:18:151
1048129919,61sleep00-21swapper/007:13:430
2472729811,15sleep30-21swapper/309:43:353
1674929810,16sleep10-21swapper/107:33:411
889329723,58sleep09050-21sed07:08:460
735229712,69sleep36717-21/usr/sbin/munin12:13:473
3117529710,49sleep331287-21date11:48:173
71929612,72sleep3771-21if_eth011:53:373
279229622,46sleep12824-21munin-run10:18:151
959929528,45sleep29611-21modprobe12:23:142
2723729521,58sleep30-21swapper/308:08:313
212882959,64sleep30-21swapper/309:33:173
1846729117,59sleep118548-21sed07:38:461
2973129014,51sleep10-21swapper/109:58:421
2839029047,23sleep30-21swapper/311:38:323
1791229021,52sleep30-21swapper/307:38:323
104932907,64sleep00-21swapper/012:23:450
104932907,64sleep00-21swapper/012:23:450
1293528913,16sleep10-21swapper/112:33:141
1293528913,16sleep10-21swapper/112:33:141
101012899,66sleep310098-21apt-get07:13:293
3163428811,60sleep30-21swapper/308:23:163
3098428824,32sleep20-21swapper/208:18:472
1248828711,60sleep012603-21sed10:48:170
1190928762,13sleep311917-21acpi09:03:273
1190928762,13sleep311917-21acpi09:03:273
2814728617,49sleep127724-21/usr/sbin/munin09:53:421
1422928619,10sleep30-21swapper/312:34:583
382928519,46sleep13847-21idleruntime-cro08:38:151
1584728515,55sleep30-21swapper/310:58:293
1584728515,55sleep30-21swapper/310:58:293
151552859,60sleep30-21swapper/307:28:393
1631128315,53sleep116315-21ntpq10:58:431
1631128315,53sleep116315-21ntpq10:58:431
3150328222,31sleep20-21swapper/211:48:362
2224928215,9sleep30-21swapper/307:53:003
1387928215,10sleep30-21swapper/310:51:553
1387928215,10sleep30-21swapper/310:51:553
1211128211,57sleep012155-21ntpq12:29:300
1211128211,57sleep012155-21ntpq12:29:300
2495228116,23sleep10-21swapper/111:28:171
2153628115,55sleep30-21swapper/311:15:163
1921228116,43sleep019229-21cat07:43:170
1847728118,51sleep30-21swapper/311:05:513
1847728118,51sleep30-21swapper/311:05:513
1114628121,47sleep211176-21idleruntime-cro12:28:152
1114628121,47sleep211176-21idleruntime-cro12:28:152
3017528011,54sleep130328-21latency_hist08:18:171
671227917,41sleep16539-21/usr/sbin/munin07:03:391
3149727819,37sleep131630-21wc10:03:461
2015627815,49sleep220219-21if_eth009:28:362
905127714,49sleep19060-21vmstat07:08:471
3124527612,49sleep231248-21sshd10:03:392
2900527619,38sleep229007-21cron09:58:142
1621727614,36sleep215825-21/usr/sbin/munin10:58:402
1621727614,36sleep215825-21/usr/sbin/munin10:58:402
137272767,50sleep20-21swapper/209:08:272
106272769,51sleep20-21swapper/208:58:382
2277827524,31sleep022799-21apt09:38:150
831027415,36sleep18311-21/usr/sbin/munin12:18:251
780227422,27sleep00-21swapper/010:33:280
2379927419,37sleep223946-21unixbench_singl09:38:452
1670627424,26sleep00-21swapper/007:33:400
490427322,28sleep00-21swapper/012:08:150
357727313,43sleep03642-21awk10:18:430
3219927315,42sleep232293-21memory08:23:392
2710627317,30sleep10-21swapper/111:33:381
2191827318,34sleep221966-21grep09:33:412
1362427311,18sleep20-21swapper/212:33:402
1282027322,27sleep20-21swapper/210:48:352
1282027322,27sleep20-21swapper/210:48:352
3219527224,25sleep00-21swapper/010:08:170
2370327226,29sleep10-21swapper/109:38:441
2264227222,25sleep00-21swapper/011:18:440
1725327216,32sleep017303-21awk09:18:420
1394727221,29sleep10-21swapper/112:33:471
107522726,45sleep20-21swapper/207:13:492
441727126,27sleep20-21swapper/208:38:402
3074527123,28sleep00-21swapper/008:18:410
2518927110,43sleep10-21swapper/111:28:291
2186727119,25sleep20-21swapper/211:18:172
1854927122,27sleep20-21swapper/207:38:472
1449827118,29sleep00-21swapper/007:28:150
680227018,23sleep10-21swapper/110:28:441
680227018,23sleep10-21swapper/110:28:441
2733327013,43sleep027427-21fschecks_time08:08:360
2697327013,40sleep227007-21/usr/sbin/munin11:33:352
2650027018,23sleep00-21swapper/011:33:160
71326921,24sleep10-21swapper/110:08:471
596526916,38sleep05989-21munin-run10:28:150
3195226915,37sleep032023-21/usr/sbin/munin11:48:460
2123026921,33sleep021244-21apt09:33:140
2108226917,19sleep10-21swapper/111:13:481
3242926813,27sleep00-21swapper/008:23:450
2986526820,28sleep10-21swapper/111:43:301
2742826821,25sleep10-21swapper/108:08:371
2006426814,20sleep10-21swapper/109:28:351
184826818,29sleep20-21swapper/211:58:162
149926818,29sleep00-21swapper/010:13:260
787926723,26sleep37897-21munin-run07:08:173
451926715,38sleep04556-21sed08:38:420
44826712,29sleep20-21swapper/210:08:442
1599926713,38sleep116000-21sshd07:32:401
1327526713,39sleep013343-21/usr/sbin/munin10:48:450
1327526713,39sleep013343-21/usr/sbin/munin10:48:450
1169526717,29sleep10-21swapper/109:03:171
655526612,28sleep26559-21apt-get07:03:282
2632226613,21sleep00-21swapper/009:48:360
2292526614,23sleep00-21swapper/007:53:420
510826523,21sleep20-21swapper/210:23:412
2606026521,24sleep10-21swapper/108:03:401
1448326518,28sleep014493-21modprobe12:38:140
948326418,26sleep10-21swapper/108:53:491
324042649,40sleep032422-21apt10:08:250
2680626416,23sleep20-21swapper/209:48:462
1436226417,23sleep20-21swapper/210:53:352
1436226417,23sleep20-21swapper/210:53:352
116592646,11sleep00-21swapper/007:18:230
808326316,22sleep20-21swapper/210:33:382
68312637,12sleep20-21swapper/208:46:432
2858626325,20sleep00-21swapper/011:38:370
2493926322,23sleep00-21swapper/009:43:400
2146826314,32sleep221475-21ntp_states07:48:442
205326313,23sleep20-21swapper/210:13:442
1968026318,29sleep119701-21modprobe09:28:151
1968026318,29sleep119701-21modprobe09:28:151
165132637,11sleep10-21swapper/109:17:421
129192634,11sleep20-21swapper/209:04:432
129192634,11sleep20-21swapper/209:04:432
1281226315,27sleep10-21swapper/110:48:341
1281226315,27sleep10-21swapper/110:48:341
96442629,38sleep09677-21latency_hist12:23:170
304026220,18sleep20-21swapper/208:33:442
2840326218,26sleep10-21swapper/111:38:341
2435526214,20sleep20-21swapper/211:23:502
2208726220,23sleep20-21swapper/211:18:292
2177026224,24sleep00-21swapper/011:18:150
206326217,26sleep12082-21apt-get11:58:281
1952926216,26sleep20-21swapper/211:08:452
179612624,48sleep10-21swapper/109:21:051
750626114,32sleep07522-21/usr/sbin/munin08:48:350
687026122,17sleep20-21swapper/210:28:452
687026122,17sleep20-21swapper/210:28:452
565326114,28sleep25660-21/usr/sbin/munin12:08:422
2807926122,20sleep00-21swapper/011:38:170
2595926113,32sleep126023-21latency_hist09:48:171
2235626119,20sleep10-21swapper/111:18:371
1871626115,33sleep218829-21latency_hist11:08:162
1871626115,33sleep218829-21latency_hist11:08:162
1288726111,37sleep2364-21snmpd07:22:282
569626016,23sleep10-21swapper/108:43:311
1866426013,21sleep00-21swapper/011:08:140
1866426013,21sleep00-21swapper/011:08:140
1504826017,23sleep00-21swapper/009:13:170
106272604,17sleep20-21swapper/210:39:552
776625918,20sleep10-21swapper/112:15:141
498525917,19sleep20-21swapper/212:08:172
340725916,26sleep23555-21cut12:03:172
2640825914,25sleep10-21swapper/109:48:371
2149525913,19sleep10-21swapper/109:33:281
2004025916,27sleep120132-21sed07:43:461
1329925915,27sleep113427-21apt-config09:08:171
1329925915,27sleep113427-21apt-config09:08:171
1206825917,22sleep10-21swapper/107:18:401
78792588,30sleep10-21swapper/110:33:331
1324725817,28sleep013298-21cmp09:08:160
1324725817,28sleep013298-21cmp09:08:160
102725815,25sleep21094-21df08:28:352
770725719,23sleep27773-21ps08:48:412
720725713,29sleep07214-21open_files12:13:440
673925721,20sleep00-21swapper/010:28:430
673925721,20sleep00-21swapper/010:28:430
2849925719,23sleep20-21swapper/211:38:352
2422025712,18sleep10-21swapper/107:58:361
2422025712,18sleep10-21swapper/107:58:361
2072025723,20sleep20-21swapper/207:48:152
1755325714,25sleep117617-21/usr/sbin/munin11:03:351
1755325714,25sleep117617-21/usr/sbin/munin11:03:351
469725615,23sleep14700-21apt-get10:23:281
2855125616,21sleep20-21swapper/208:13:182
1660625612,27sleep20-21swapper/207:33:382
1361025613,21sleep10-21swapper/107:23:401
2939825513,30sleep229491-21timerandwakeup08:13:462
2467925513,23sleep00-21swapper/007:58:470
2467925513,23sleep00-21swapper/007:58:470
1454525510,31sleep114250-21/usr/sbin/munin10:53:381
1454525510,31sleep114250-21/usr/sbin/munin10:53:381
1205325512,26sleep20-21swapper/210:43:472
1190625515,17sleep10-21swapper/110:43:461
938925415,19sleep00-21swapper/008:53:480
650325414,17sleep10-21swapper/112:13:171
57272546,13sleep00-21swapper/012:08:440
371425417,18sleep20-21swapper/210:18:452
1687325412,25sleep216867-21apt-get09:18:312
110692545,36sleep10-21swapper/112:27:171
110692545,36sleep10-21swapper/112:27:171
2519025310,15sleep20-21swapper/211:28:302
1884325311,18sleep20-21swapper/209:23:442
1884325311,18sleep20-21swapper/209:23:442
4822526,37sleep10-21swapper/108:25:071
47882526,34sleep10-21swapper/112:06:471
815125111,24sleep28147-21apt-get07:08:282
51182515,16sleep10-21swapper/108:39:361
3187325112,23sleep131879-21ntp_states11:48:431
257025114,24sleep02565-21apt-get08:33:300
1038125114,18sleep00-21swapper/008:58:320
926725013,21sleep29304-21ps08:53:462
728025011,19sleep20-21swapper/212:13:462
3116425012,22sleep231174-21munin-run11:48:162
1945925011,23sleep019455-21apt-get07:43:290
1895225013,21sleep118949-21apt-get11:08:281
1584925010,20sleep00-21swapper/010:58:300
1584925010,20sleep00-21swapper/010:58:300
1520225011,19sleep00-21swapper/007:28:400
1372524911,24sleep113220-21apt-get09:08:261
3078524810,16sleep10-21swapper/108:18:421
258982486,20sleep20-21swapper/208:03:372
2471924811,21sleep224726-21df_inode09:43:342
2308924712,17sleep20-21swapper/207:53:482
2309324510,20sleep023089-21apt-get09:38:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional