You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 15:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Wed Dec 24, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33302657918,6541sleep22822-21apt-get10:19:322
77692431818,4287sleep327549-21kworker/3:212:15:393
28407240327,3964sleep022850-21kworker/u8:111:39:340
59152207116,2040sleep320259-21kworker/3:008:44:383
242072189714,1870sleep115179-21kworker/1:109:41:391
13887217128,1689sleep124496-1kworker/1:1H09:10:041
31615216138,1447sleep031702-21/usr/sbin/munin11:49:390
72582813101,614sleep07299-21grep12:14:470
7489255711,506sleep07596-21fschecks_time08:49:400
12137243569,214sleep012202-21fschecks_time09:04:380
9147243028,390sleep09197-21if_eth008:54:450
23224241823,375sleep023225-21cron11:24:190
12377238217,350sleep112378-21sshd07:23:391
12377238217,350sleep112378-21sshd07:23:391
29852229655,125sleep030002-21latency_hist08:19:230
25078228914,259sleep125125-21ntpq09:44:461
23845227114,194sleep023989-21grep09:39:520
7040225558,181sleep07127-21xargs10:29:520
7040225558,181sleep07127-21xargs10:29:520
2938225253,177sleep03070-21cat10:19:220
11814223045,162sleep00-21swapper/009:04:220
3411222618,185sleep23429-21apt12:04:192
2754221428,174sleep02779-21kernelversion08:34:420
3159122088,25sleep07182-21cyclictest08:24:320
25131220815,176sleep025034-21/usr/sbin/munin11:29:400
2147222069,164sleep0369-21snmpd11:16:560
3215722056,163sleep00-21swapper/010:09:160
3215722056,163sleep00-21swapper/010:09:160
13299219417,165sleep113392-21cat07:24:521
13299219417,165sleep113392-21cat07:24:521
2477021879,14sleep00-21swapper/011:29:200
15097218414,156sleep015100-21cron09:14:190
11272217735,23sleep00-21swapper/007:19:420
11272217735,23sleep00-21swapper/007:19:420
29923217611,154sleep3369-21snmpd11:44:293
81272173105,52sleep18084-21/usr/sbin/munin12:19:211
19898217215,138sleep00-21swapper/011:11:390
7801216917,137sleep37733-21latency_hist10:34:233
9099216321,11sleep00-21swapper/010:37:230
28709216324,26sleep00-21swapper/009:54:580
16768216311,136sleep316915-21latency_hist09:19:233
115621638,13sleep00-21swapper/010:13:040
13606215922,117sleep113329-21apt-get09:09:241
17122215529,21sleep00-21swapper/007:39:210
951121525,111sleep00-21swapper/012:22:470
717921509,102sleep07257-21latency_hist08:49:240
1812621495,10sleep00-21swapper/009:23:080
5775214810,53sleep00-21swapper/012:09:510
2502121476,49sleep00-21swapper/008:03:080
12291214410,85sleep00-21swapper/012:30:060
1435121419,113sleep00-21swapper/007:29:400
596721405,50sleep00-21swapper/010:26:530
17372213811,112sleep217373-21cpu07:39:352
534721368,116sleep0369-21snmpd08:41:400
1898521359,110sleep00-21swapper/007:44:380
18607213417,73sleep00-21swapper/011:09:210
10965213318,100sleep310972-21ntpq08:59:493
11235212931,40sleep011352-21wc12:29:210
13610212817,96sleep313655-21ntp_kernel_pll_12:34:453
20466212521,88sleep3369-21snmpd11:14:373
2840212422,82sleep32916-21unin-run10:19:203
21652212424,78sleep121699-21awk11:19:191
9895212222,57sleep00-21swapper/007:14:500
1076121206,10sleep00-21swapper/010:43:370
3979211911,26sleep24071-21memory12:04:442
4166211712,84sleep34198-21/usr/sbin/munin12:04:493
3124721176,76sleep00-21swapper/008:23:190
25157211421,74sleep325252-21fschecks_time11:29:433
55321118,58sleep00-21swapper/011:54:320
222321119,54sleep00-21swapper/011:59:370
2329421106,48sleep00-21swapper/007:56:090
13948211017,69sleep314074-21grep10:54:223
12738211011,41sleep00-21swapper/010:49:420
29926210917,73sleep129927-21/usr/sbin/munin11:44:321
2815921095,48sleep00-21swapper/008:13:460
25519210850,43sleep025614-21perl08:04:410
12441210851,42sleep012586-21date10:49:220
21594210610,55sleep00-21swapper/009:34:390
1397221069,62sleep014001-21munin-run07:29:200
1397221069,62sleep014001-21munin-run07:29:200
11108210611,78sleep211185-21threads08:59:522
17836210510,84sleep017870-21ps07:39:500
1347721057,84sleep013214-21/usr/sbin/munin12:34:420
908210419,65sleep2423-21apt-get08:29:312
8460210414,74sleep38472-21awk12:19:393
21379210364,20sleep00-21swapper/009:34:230
18633210349,43sleep018717-21perl09:24:410
17391210319,69sleep217449-21cut11:04:392
1652621036,87sleep00-21swapper/009:17:430
740621028,52sleep00-21swapper/007:09:330
4315210215,53sleep00-21swapper/010:20:270
2731121029,62sleep0369-21snmpd09:51:510
2731121029,62sleep0369-21snmpd09:51:510
13326210220,64sleep213415-21tune2fs12:34:402
730210020,24sleep30-21swapper/308:29:243
2633029917,48sleep326386-21tune2fs09:49:403
2633029917,48sleep326386-21tune2fs09:49:403
256212986,10sleep00-21swapper/009:44:570
215622985,82sleep00-21swapper/007:51:490
215622985,82sleep00-21swapper/007:51:490
1613129812,49sleep00-21swapper/010:59:480
46402975,56sleep00-21swapper/012:05:100
1636529719,54sleep216447-21cat10:59:542
1426629714,68sleep114293-21cpu07:29:371
299512967,47sleep00-21swapper/011:44:350
2838529513,65sleep127871-21apt-get11:39:311
1457929520,54sleep214725-21grep09:10:302
708029411,66sleep00-21swapper/007:09:210
147729354,24sleep00-21swapper/008:30:260
2595329123,45sleep325978-21awk09:49:203
3062129014,62sleep030624-21cron10:04:190
2933729019,33sleep30-21swapper/309:59:343
142712909,19sleep014304-21grep10:54:390
131829021,41sleep21457-21unixbench_singl11:54:542
2561528910,64sleep125655-21if_eth008:04:421
1029228924,47sleep210433-21ls08:59:232
1086828829,30sleep10-21swapper/110:44:221
2849728725,35sleep20-21swapper/208:14:372
3245228624,39sleep332448-21apt-get10:09:353
2717628621,46sleep327252-21wc11:34:523
2717628621,46sleep327252-21wc11:34:523
1166628613,56sleep111185-21apt-get12:29:301
3049328516,48sleep230494-21sshd10:02:402
2795028531,38sleep028071-21ls11:39:220
2795028531,38sleep028071-21ls11:39:220
527728412,52sleep15316-21/usr/sbin/munin10:24:441
1181728315,51sleep311919-21/usr/sbin/munin07:20:143
1181728315,51sleep311919-21/usr/sbin/munin07:20:143
3015228213,50sleep230158-21diskstats08:19:372
2824728219,51sleep328286-21latency_hist08:14:213
993128017,41sleep39539-21/usr/sbin/munin10:39:443
621828025,37sleep16259-21ntpq07:04:461
2791427926,33sleep10-21swapper/109:54:431
641627815,42sleep16417-21/usr/sbin/munin10:29:321
641627815,42sleep16417-21/usr/sbin/munin10:29:321
1899927820,40sleep219093-21cut07:44:402
1118927824,34sleep10-21swapper/110:44:391
983727710,14sleep20-21swapper/210:39:432
497227715,42sleep24981-21/usr/sbin/munin10:24:372
405027725,21sleep30-21swapper/310:20:093
2785327721,37sleep227865-21modprobe11:39:192
2785327721,37sleep227865-21modprobe11:39:192
2994027513,44sleep130009-21/usr/sbin/munin09:59:521
1626727526,26sleep10-21swapper/107:34:501
752727420,34sleep27594-21fschecks_time07:09:392
2597427417,27sleep20-21swapper/208:04:512
1338627419,29sleep10-21swapper/110:49:561
845927314,13sleep20-21swapper/210:34:502
39927318,29sleep20-21swapper/210:09:462
2807427325,20sleep10-21swapper/111:39:231
2476527319,36sleep324766-21cron11:29:193
2069127313,40sleep220725-21/usr/sbin/munin07:49:412
2069127313,40sleep220725-21/usr/sbin/munin07:49:412
1090927323,29sleep10-21swapper/108:59:471
871027227,26sleep20-21swapper/208:54:222
654827211,47sleep36612-21cat12:14:223
2549227222,23sleep30-21swapper/308:04:403
2175227224,28sleep121776-21munin-run07:54:201
2175227224,28sleep121776-21munin-run07:54:201
191527217,27sleep10-21swapper/111:59:221
1807827218,24sleep30-21swapper/311:04:523
316727125,25sleep10-21swapper/108:34:511
280327120,32sleep22839-21cron10:19:192
1921927114,24sleep30-21swapper/311:09:443
3176527018,22sleep10-21swapper/108:24:411
2064927017,33sleep220024-21/usr/sbin/munin09:29:522
775626923,23sleep20-21swapper/210:34:222
775626923,23sleep20-21swapper/210:34:222
373526922,30sleep23760-21munin-run08:39:202
3090826917,21sleep30-21swapper/310:04:343
3090826917,21sleep30-21swapper/310:04:343
3027226923,20sleep10-21swapper/108:19:401
2820126912,24sleep30-21swapper/309:54:493
584026811,42sleep15889-21/usr/sbin/munin08:44:361
3155326815,36sleep231652-21timerwakeupswit10:04:502
3155326815,36sleep231652-21timerwakeupswit10:04:502
2299426824,24sleep10-21swapper/107:55:131
891626715,35sleep39073-21memory07:14:243
178972675,51sleep30-21swapper/309:20:083
1495826713,12sleep10-21swapper/110:54:521
42852669,25sleep20-21swapper/208:39:322
982126511,40sleep29829-21open_files07:14:482
321502659,14sleep20-21swapper/208:24:502
2288926514,37sleep2228-21systemd-journal11:19:572
136532655,17sleep30-21swapper/307:25:113
136532655,17sleep30-21swapper/307:25:113
592826416,27sleep26075-21grep12:09:532
460426414,26sleep30-21swapper/308:40:103
3125426413,37sleep231311-21latency_hist11:49:212
2018226425,21sleep10-21swapper/111:14:231
1622226418,20sleep30-21swapper/310:59:513
826826312,30sleep10-21swapper/110:34:451
3189426318,22sleep10-21swapper/111:49:451
307226323,19sleep10-21swapper/110:19:231
2885726320,21sleep30-21swapper/311:40:223
2505126310,27sleep20-21swapper/211:29:342
2351126316,28sleep223507-21apt-get11:24:332
1775926326,21sleep10-21swapper/111:04:461
1272326312,33sleep212724-21/usr/sbin/munin07:24:372
1272326312,33sleep212724-21/usr/sbin/munin07:24:372
116262636,13sleep20-21swapper/207:20:092
116262636,13sleep20-21swapper/207:20:092
951226219,28sleep19553-21/usr/sbin/munin08:54:541
893026218,27sleep38927-21apt-get08:54:363
632526216,26sleep20-21swapper/208:44:492
428026221,24sleep10-21swapper/112:04:511
37826221,23sleep3527-21sed11:54:233
2738826216,25sleep10-21swapper/111:34:541
1871826216,27sleep118768-21if_eth009:24:421
134526220,18sleep10-21swapper/110:14:221
967726121,20sleep10-21swapper/112:24:211
81512617,12sleep30-21swapper/310:34:433
517126113,24sleep30-21swapper/310:24:423
377226118,22sleep30-21swapper/308:39:213
2816626115,20sleep20-21swapper/209:54:482
196642617,14sleep20-21swapper/209:28:072
1953026118,25sleep219663-21sed11:09:522
1299926118,18sleep30-21swapper/312:34:213
1055026121,20sleep10-21swapper/112:24:541
2521326017,18sleep20-21swapper/208:04:232
241526016,30sleep12432-21cut11:59:421
2243326026,19sleep10-21swapper/111:19:481
1508626013,32sleep215097-21vmstat10:54:532
2327525921,17sleep30-21swapper/311:24:223
2210025917,19sleep20-21swapper/209:34:532
2188325917,16sleep30-21swapper/307:54:223
2188325917,16sleep30-21swapper/307:54:223
2050925919,24sleep320515-21ntp_states09:29:493
1848025915,26sleep318499-21apt-get09:24:323
2897225815,21sleep30-21swapper/308:14:503
184762584,10sleep30-21swapper/307:42:273
1444825822,21sleep30-21swapper/310:54:423
643925717,24sleep36436-21apt-get10:29:343
2845525717,24sleep228397-21apt-get11:40:082
2446225714,19sleep20-21swapper/209:44:222
2159725714,26sleep121664-21df09:34:401
814025618,21sleep28287-21cat12:19:222
759925619,16sleep10-21swapper/108:49:411
471825619,22sleep14759-21ntpq08:40:121
3015925616,26sleep330190-21grep08:19:383
272272566,14sleep20-21swapper/208:09:442
2651425616,19sleep20-21swapper/209:49:432
2651425616,19sleep20-21swapper/209:49:432
2242825622,20sleep20-21swapper/207:54:582
2056025617,17sleep10-21swapper/109:29:511
1918325620,22sleep119270-21sed07:44:431
1826825613,25sleep10-21swapper/109:24:221
164442566,11sleep20-21swapper/209:16:402
740425513,25sleep37400-21apt-get07:09:323
738725518,22sleep37382-21apt-get08:49:353
62812559,23sleep30-21swapper/307:04:483
2635825516,22sleep126467-21sed11:34:221
2371625513,18sleep10-21swapper/111:24:411
224725513,25sleep12223-21latency_hist08:34:221
2170725513,26sleep221730-21munin-run11:19:212
1601325517,23sleep216063-21if_eth007:34:432
1575925512,25sleep115752-21apt-get10:59:371
1569225512,19sleep10-21swapper/109:14:451
138525516,21sleep30-21swapper/308:30:213
1169825512,25sleep211689-21apt-get12:29:352
106702558,27sleep20-21swapper/212:24:552
804025415,17sleep10-21swapper/107:09:501
3149225414,24sleep231486-21apt-get11:49:332
2516325418,20sleep10-21swapper/108:04:221
1468625414,17sleep30-21swapper/307:29:473
1109925413,23sleep211097-21apt-get10:44:312
2624125314,22sleep126238-21apt-get09:49:341
2624125314,22sleep126238-21apt-get09:49:341
2494025316,21sleep20-21swapper/209:44:422
2315925312,24sleep323154-21apt-get09:39:353
174642536,12sleep20-21swapper/209:19:512
569525217,20sleep15701-21ntp_states12:09:481
318382526,15sleep10-21swapper/110:05:051
318382526,15sleep10-21swapper/110:05:051
2382925214,23sleep323846-21apt07:59:313
1562225215,22sleep215754-21cat07:34:222
1404425216,16sleep30-21swapper/309:10:193
1369425212,22sleep113700-21ntp_states12:34:471
103152526,11sleep10-21swapper/107:15:271
2167225115,20sleep321682-21diskstats09:34:423
1352925111,17sleep20-21swapper/210:49:572
1151125110,25sleep311556-21ntp_states10:44:453
1081625116,21sleep310829-21vmstat12:24:563
2895125014,20sleep128957-21ntp_states08:14:481
1246725013,14sleep20-21swapper/209:04:442
626124914,20sleep26280-21ntp_states07:04:472
461024910,18sleep10-21swapper/110:24:191
33002497,30sleep30-21swapper/312:02:513
1265624914,15sleep30-21swapper/309:04:493
2719724813,20sleep127226-21irqstats08:09:431
2235924813,18sleep322369-21diskstats07:54:393
2021024815,16sleep30-21swapper/307:49:223
1745424819,15sleep10-21swapper/107:39:381
183424711,22sleep31859-21munin-run11:59:203
837424611,20sleep28370-21apt-get12:19:342
1577724617,16sleep30-21swapper/307:34:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional