You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-10 - 17:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7s.osadl.org (updated Thu Sep 10, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23859258112,483sleep123993-21unixbench_singl10:44:101
23859258112,483sleep123993-21unixbench_singl10:44:101
193182312100,193sleep119332-21fschecks_count08:48:321
25206228987,102sleep10-21swapper/112:33:331
28747225281,103sleep128893-21unixbench_singl10:58:511
27040224467,159sleep127177-21unixbench_singl07:28:451
27040224467,159sleep127177-21unixbench_singl07:28:451
27682224271,151sleep127848-21date10:58:151
13058223852,168sleep113106-21ntpq11:53:391
11907223159,97sleep10-21swapper/108:24:051
9206222465,19sleep10-21swapper/108:18:161
26024222235,113sleep126027-21cron07:28:131
602221010,21sleep10-21swapper/111:13:371
7142220916,118sleep17208-21fschecks_time09:53:341
17899220241,94sleep20-21swapper/210:28:232
17899220241,94sleep20-21swapper/210:28:232
3295219329,85sleep10-21swapper/107:58:331
23736219114,162sleep123791-21idleruntime12:28:321
2265921896,169sleep122777-21expr12:23:431
7645217489,33sleep17787-21latency_hist08:13:151
25203217411,13sleep00-21swapper/012:33:320
2275821728,141sleep10-21swapper/108:58:381
310121709,92sleep10-21swapper/111:23:141
25937216869,18sleep10-21swapper/110:53:141
20740216513,91sleep120754-21modprobe10:38:121
8082216452,26sleep10-21swapper/111:38:291
7963216125,109sleep38044-21sort08:13:333
21285216112,111sleep020762-21apt-get10:38:230
21285216112,111sleep020762-21apt-get10:38:230
2134321608,137sleep121400-21grep07:13:181
1285215151,33sleep10-21swapper/109:33:391
1814214744,22sleep10-21swapper/107:53:321
11480214420,105sleep311524-21ntpq11:48:363
11039214140,16sleep10-21swapper/108:23:161
23641214011,17sleep10-21swapper/107:18:401
22559214010,76sleep122587-21munin-run10:43:121
22559214010,76sleep122587-21munin-run10:43:121
18641213111,63sleep10-21swapper/112:13:141
20761212810,103sleep320762-21/usr/sbin/munin08:53:233
20761212810,103sleep320762-21/usr/sbin/munin08:53:233
31070212757,52sleep10-21swapper/109:23:461
28371212733,77sleep10-21swapper/107:33:421
4955212610,51sleep10-21swapper/108:03:341
1172121258,104sleep111837-21cat11:48:431
3746212220,20sleep10-21swapper/109:43:161
18965212011,89sleep10-21swapper/112:13:301
4650211925,79sleep04719-21latency_hist11:28:140
3897211932,47sleep00-21swapper/009:43:230
23096211820,79sleep323077-21apt-get10:43:313
23096211820,79sleep323077-21apt-get10:43:313
4894211759,45sleep10-21swapper/111:28:311
18143211746,60sleep118177-21ps08:43:401
1065211721,78sleep2770-21/usr/sbin/munin09:33:322
19783211517,74sleep019877-21fschecks_time07:08:330
1745721158,22sleep10-21swapper/108:43:151
1745721158,22sleep10-21swapper/108:43:151
1080821139,49sleep110929-21ls10:03:431
14034211214,78sleep014072-21http08:33:130
27488210914,80sleep327520-21/usr/sbin/munin09:13:423
27488210914,80sleep327520-21/usr/sbin/munin09:13:423
15495210913,78sleep10-21swapper/112:03:121
3213621089,38sleep10-21swapper/109:28:381
1473210736,41sleep31532-21sendmail11:18:123
29148210642,17sleep10-21swapper/109:18:411
2523821069,44sleep125349-21latency_hist09:08:151
2487921069,82sleep224936-21latency_hist12:33:132
2380210642,27sleep12386-21grep09:38:281
1968221068,81sleep10-21swapper/107:08:261
6214210521,64sleep06168-21latency_hist11:33:150
5231210514,71sleep35208-21latency_hist09:48:153
4858210517,74sleep04954-21fschecks_time08:03:330
22207210515,74sleep322267-21cat12:23:333
16250210511,76sleep116293-21/usr/sbin/munin12:03:411
16250210511,76sleep116293-21/usr/sbin/munin12:03:411
12952210323,68sleep112987-21awk10:13:121
6440210211,14sleep00-21swapper/009:49:290
6440210211,14sleep00-21swapper/009:49:290
29318210218,22sleep30-21swapper/309:18:433
1016221018,79sleep110243-21cat11:43:421
13246210011,74sleep10-21swapper/110:13:281
568429913,40sleep10-21swapper/109:48:331
568429913,40sleep10-21swapper/109:48:331
2333529912,72sleep023441-21cat12:28:150
1582129921,61sleep315846-21munin-run08:38:133
2104929754,27sleep021122-21/usr/sbin/munin12:18:420
196129716,57sleep31767-21/usr/sbin/munin11:18:323
2511529621,43sleep225112-21apt-get12:33:262
1677429619,61sleep016818-21ntpq10:23:370
1510529618,58sleep10-21swapper/110:18:371
2171729415,65sleep221756-21cut07:13:322
1492229418,56sleep214986-21sort10:18:342
3139729312,64sleep117-21ksoftirqd/107:43:391
3139729312,64sleep117-21ksoftirqd/107:43:391
69632929,17sleep10-21swapper/111:33:401
1237829216,53sleep012517-21tail10:08:430
1590029111,17sleep10-21swapper/108:38:151
3241829015,63sleep232450-21latency_hist11:13:142
1326429017,51sleep312626-21/usr/sbin/munin11:53:453
2943628919,56sleep229447-21cpu07:38:272
134028910,19sleep11368-21sh07:53:121
867628812,36sleep10-21swapper/109:58:301
3170728811,22sleep10-21swapper/111:08:451
3125628812,60sleep230961-21/usr/sbin/munin07:43:362
3125628812,60sleep230961-21/usr/sbin/munin07:43:362
3245128724,28sleep30-21swapper/311:13:153
2326628715,52sleep223291-21fschecks_time10:43:542
2326628715,52sleep223291-21fschecks_time10:43:542
2173528716,24sleep221765-21munin-run12:23:122
263162868,14sleep10-21swapper/109:08:481
263162868,14sleep10-21swapper/109:08:481
2493828617,53sleep325080-21modprobe12:33:143
306782859,44sleep10-21swapper/111:06:231
306782859,44sleep10-21swapper/111:06:231
128502858,15sleep10-21swapper/108:28:291
981628410,62sleep0367-21snmpd10:02:370
2211928428,29sleep20-21swapper/208:58:142
2211928428,29sleep20-21swapper/208:58:142
810328320,35sleep30-21swapper/311:38:313
2699928319,15sleep10-21swapper/109:13:241
2699928319,15sleep10-21swapper/109:13:241
1948128313,17sleep20-21swapper/210:33:282
1236128315,29sleep20-21swapper/211:53:122
348528213,52sleep23549-21/usr/sbin/munin11:23:322
3189628112,55sleep031954-21if_eth009:28:330
2986228117,40sleep00-21swapper/009:23:120
2369628129,29sleep20-21swapper/209:03:152
1801228115,49sleep10-21swapper/110:28:311
1801228115,49sleep10-21swapper/110:28:311
2204428011,15sleep10-21swapper/108:58:131
2204428011,15sleep10-21swapper/108:58:131
3180127920,38sleep331893-21fschecks_time09:28:323
203372799,55sleep0367-21snmpd08:51:100
176862797,35sleep10-21swapper/110:28:141
3016927819,39sleep330306-21unixbench_singl07:38:453
33122777,37sleep10-21swapper/111:23:231
2985427719,44sleep10-21swapper/107:38:381
2762427722,28sleep30-21swapper/307:33:153
2762427722,28sleep30-21swapper/307:33:153
211232777,11sleep10-21swapper/112:18:431
1834627718,27sleep00-21swapper/008:43:430
985927619,39sleep39875-21/usr/sbin/munin10:03:133
212132760,8sleep00-21swapper/007:13:160
1351527615,44sleep313574-21/usr/sbin/munin10:13:353
2723427512,49sleep227237-21systemd-tmpfile10:55:292
2531027521,29sleep20-21swapper/210:49:032
2502927512,46sleep225045-21/usr/sbin/munin07:23:332
145532757,29sleep00-21swapper/008:33:250
2838827420,26sleep00-21swapper/009:18:150
2838827420,26sleep00-21swapper/009:18:150
2084327417,31sleep30-21swapper/310:38:143
1846827419,36sleep018501-21/usr/sbin/munin07:03:370
1830527420,39sleep318347-21sed10:28:373
1830527420,39sleep318347-21sed10:28:373
1333327419,42sleep013402-21fschecks_time10:13:320
1024627416,36sleep210403-21unixbench_multi11:43:432
2631427312,48sleep026373-21cpuspeed07:28:280
2631427312,48sleep026373-21cpuspeed07:28:280
1946227317,37sleep30-21swapper/307:08:163
1895127311,15sleep30-21swapper/312:13:283
1002427317,35sleep310089-21awk11:43:403
711527222,31sleep30-21swapper/311:33:423
288102726,11sleep00-21swapper/007:34:130
1255827216,34sleep012701-21latency_hist08:28:160
2991327118,21sleep20-21swapper/209:23:142
244927125,29sleep32455-21df_inode09:38:303
1935927122,32sleep11-21systemd07:08:141
1344927115,40sleep213568-21sed08:28:432
834027018,32sleep00-21swapper/008:13:430
2711227018,34sleep227146-21cut09:13:332
2711227018,34sleep227146-21cut09:13:332
2442227024,29sleep00-21swapper/009:03:420
2366427013,42sleep023668-21true09:03:130
1292327012,40sleep212954-21/usr/sbin/munin11:53:362
104052705,10sleep00-21swapper/008:19:280
1024627015,34sleep210339-21fschecks_time10:03:322
838426916,33sleep08429-21grep11:38:360
386126912,37sleep33942-21cut11:23:413
2671726916,22sleep20-21swapper/207:28:382
2671726916,22sleep20-21swapper/207:28:382
2095026914,37sleep020980-21apt-key10:38:150
533526815,37sleep25411-21switchtime08:03:432
313632686,48sleep00-21swapper/009:27:320
2677926815,33sleep326755-21latency_hist09:13:143
2677926815,33sleep326755-21latency_hist09:13:143
3087026719,28sleep30-21swapper/311:08:143
3087026719,28sleep30-21swapper/311:08:143
2964826722,28sleep00-21swapper/011:03:310
2964826722,28sleep00-21swapper/011:03:310
257992679,32sleep00-21swapper/009:08:380
257992679,32sleep00-21swapper/009:08:380
206472677,41sleep00-21swapper/008:53:160
206472677,41sleep00-21swapper/008:53:160
3113526619,24sleep30-21swapper/309:24:363
2428426618,25sleep30-21swapper/309:03:373
172162665,15sleep00-21swapper/008:40:560
172162665,15sleep00-21swapper/008:40:560
1162126626,27sleep20-21swapper/208:23:582
827426519,27sleep38298-21munin-run09:58:123
812926514,25sleep20-21swapper/208:13:362
225526510,39sleep22262-21open_files11:18:392
1914826518,21sleep00-21swapper/012:13:330
761426414,34sleep07643-21latency_hist08:13:140
677826423,23sleep30-21swapper/309:53:153
677826423,23sleep30-21swapper/309:53:153
3118326415,33sleep031195-21/usr/sbin/munin11:08:320
3009826413,34sleep230169-21sensors_temp11:03:412
3009826413,34sleep230169-21sensors_temp11:03:412
2544226421,19sleep30-21swapper/307:23:423
2384126429,16sleep30-21swapper/312:28:343
1995726415,29sleep30-21swapper/307:08:363
1941626425,18sleep20-21swapper/207:08:152
1587226416,26sleep00-21swapper/012:03:320
1587226416,26sleep00-21swapper/012:03:320
1300326418,22sleep30-21swapper/310:13:143
952126315,22sleep30-21swapper/308:18:303
601926311,35sleep36040-21modprobe08:08:123
3098626320,27sleep330987-21/usr/sbin/munin07:43:293
3098626320,27sleep330987-21/usr/sbin/munin07:43:293
2434826324,19sleep00-21swapper/010:48:120
2434826324,19sleep00-21swapper/010:48:120
2143326313,19sleep20-21swapper/210:39:102
2143326313,19sleep20-21swapper/210:39:102
1794226318,22sleep30-21swapper/308:43:343
113132638,39sleep30-21swapper/308:23:353
721126220,23sleep20-21swapper/209:53:352
618626219,20sleep30-21swapper/311:33:143
3234426221,23sleep20-21swapper/209:28:432
2854226217,27sleep328670-21/usr/sbin/munin07:33:443
2655726215,18sleep30-21swapper/310:53:363
154226216,21sleep00-21swapper/009:33:420
1520426215,33sleep315247-21tr10:18:393
11122625,12sleep00-21swapper/007:50:160
688626120,20sleep20-21swapper/211:33:372
64026114,31sleep2663-21ntp_states11:13:382
2365926118,22sleep00-21swapper/012:28:310
2281826119,25sleep322824-21ntp_states08:58:403
2196526119,20sleep30-21swapper/310:39:273
2196526119,20sleep30-21swapper/310:39:273
139026118,30sleep31468-21cat07:53:143
1287726114,29sleep312981-21perl08:28:313
2980826013,24sleep00-21swapper/007:38:370
271082607,41sleep00-21swapper/010:53:500
1859026014,30sleep318618-21modprobe12:13:123
1781426015,19sleep00-21swapper/012:08:400
1145726012,31sleep011603-21sed10:08:150
3229525916,25sleep00-21swapper/007:48:140
3229525916,25sleep00-21swapper/007:48:140
3043025915,25sleep230523-21memory09:23:352
243742599,25sleep20-21swapper/209:03:402
1554525921,15sleep30-21swapper/312:03:143
76925815,30sleep3776-21acpi09:33:213
57825818,17sleep00-21swapper/011:13:360
452425816,16sleep20-21swapper/208:03:152
399725818,24sleep24008-21diskstats09:43:292
363225815,26sleep23655-21/usr/sbin/munin09:43:132
2935825815,23sleep00-21swapper/011:03:150
2932125818,27sleep30-21swapper/311:03:143
2846425816,25sleep20-21swapper/207:33:432
2801525819,23sleep227991-21apt-get10:58:322
163125819,19sleep00-21swapper/007:53:270
1514425817,26sleep215234-21grep08:34:402
690225713,19sleep00-21swapper/011:33:390
327925716,25sleep33288-21df_inode07:58:313
25892578,36sleep20-21swapper/207:54:222
2099225714,18sleep20-21swapper/207:13:152
44825617,20sleep20-21swapper/207:48:372
245825614,18sleep00-21swapper/009:38:310
2055125617,16sleep30-21swapper/308:53:153
1901425612,28sleep219088-21/usr/sbin/munin12:13:312
1818025614,28sleep218254-21sendmail_mailtr08:43:412
1794825617,23sleep20-21swapper/212:08:422
171525619,18sleep30-21swapper/307:53:303
1346525614,24sleep213514-21irqstats10:13:342
1241325615,20sleep00-21swapper/011:53:140
2473725513,25sleep324775-21fschecks_count10:48:483
232925515,25sleep02398-21sensors_temp11:18:410
1715825515,17sleep30-21swapper/310:23:443
766425414,25sleep07782-21sed09:53:450
631025413,24sleep26304-21apt-get08:08:282
2557725414,22sleep025663-21users07:23:430
232042546,10sleep20-21swapper/212:27:122
2152025413,21sleep30-21swapper/307:13:203
1622625410,14sleep30-21swapper/308:38:333
1622625410,14sleep30-21swapper/308:38:333
2319325312,25sleep223210-21/usr/sbin/munin07:18:242
1640925317,15sleep20-21swapper/208:38:362
1640925317,15sleep20-21swapper/208:38:362
1401625315,20sleep00-21swapper/011:58:140
1792525211,23sleep017918-21apt-get10:28:260
1792525211,23sleep017918-21apt-get10:28:260
756825120,16sleep30-21swapper/308:13:133
2515425111,16sleep00-21swapper/010:49:010
2410025112,24sleep024123-21users07:18:470
1209925118,17sleep20-21swapper/210:08:372
2601525014,17sleep20-21swapper/209:08:442
2601525014,17sleep20-21swapper/209:08:442
1665125013,20sleep216744-21memory10:23:352
1618425014,16sleep20-21swapper/212:03:382
1618425014,16sleep20-21swapper/212:03:382
1423025013,20sleep00-21swapper/011:58:270
1054225012,16sleep30-21swapper/310:03:373
2068324914,18sleep30-21swapper/312:18:333
1636124913,16sleep30-21swapper/312:03:433
1636124913,16sleep30-21swapper/312:03:433
976624812,21sleep09823-21irqstats11:43:330
2321124812,20sleep323213-21apt-get07:18:253
992724712,19sleep20-21swapper/208:18:412
905224713,19sleep29058-21ntp_states09:58:402
1422724711,21sleep214224-21apt-get11:58:252
67242465,29sleep20-21swapper/209:53:102
67242465,29sleep20-21swapper/209:53:102
416624621,13sleep00-21swapper/007:59:170
1933624611,14sleep20-21swapper/208:48:332
501724511,18sleep20-21swapper/211:28:372
1608624312,15sleep00-21swapper/010:23:130
82792418,14sleep20-21swapper/211:38:342
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional