You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 18:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Sat Jul 04, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
261872778613,7758sleep012916-21kworker/0:212:29:030
21582210599,1043sleep15780-1kworker/1:2H12:14:461
12220267534,601sleep212322-21wc10:00:042
10496234583,211sleep210529-21grep08:14:202
10496234583,211sleep210529-21grep08:14:202
4678233818,295sleep04820-21grep11:19:540
25040231964,186sleep225078-21fschecks_count12:24:412
6618231619,279sleep06611-21apt-get09:44:350
12458225844,194sleep212506-21fschecks_count08:19:412
2460122518,227sleep0195-21jbd2/mmcblk2p2-10:39:520
2460122518,227sleep0195-21jbd2/mmcblk2p2-10:39:520
21732224229,193sleep121896-21unixbench_singl07:04:551
9345223910,217sleep0364-21snmpd09:53:240
9345223910,217sleep0364-21snmpd09:53:240
384223415,206sleep3443-21sendmail_mailqu07:39:493
1176223044,70sleep21186-21modprobe07:44:202
28567222212,195sleep328608-21ntpq09:09:463
28567222212,195sleep328608-21ntpq09:09:463
10881221018,165sleep20-21swapper/208:14:412
2184220871,20sleep20-21swapper/211:14:222
10287220828,124sleep20-21swapper/211:39:382
10287220828,124sleep20-21swapper/211:39:382
25943220445,147sleep225517-21/usr/sbin/munin10:44:472
8249220065,112sleep28311-21fschecks_time09:49:382
8249220065,112sleep28311-21fschecks_time09:49:382
17848219714,142sleep217930-21fschecks_time10:19:392
17522219113,82sleep217464-21latency_hist10:19:222
13017218814,129sleep2225-21systemd-journal11:49:192
13017218814,129sleep2225-21systemd-journal11:49:192
30890218413,21sleep00-21swapper/007:34:410
2783321809,158sleep0364-21snmpd09:08:580
2783321809,158sleep0364-21snmpd09:08:580
14656216912,142sleep014800-21latency_hist11:54:220
14656216912,142sleep014800-21latency_hist11:54:220
777421619,114sleep27806-21tune2fs08:04:392
23909216116,124sleep123940-21wc07:14:231
16692215917,49sleep00-21swapper/011:59:470
24679215517,122sleep124820-21unixbench_multi10:39:531
24679215517,122sleep124820-21unixbench_multi10:39:531
24274215441,58sleep224346-21munin-node07:14:282
22883214914,18sleep20-21swapper/210:34:532
32609214417,28sleep20-21swapper/209:24:222
29982214232,56sleep20-21swapper/209:14:412
29982214232,56sleep20-21swapper/209:14:412
22611214220,105sleep00-21swapper/007:09:370
8386213827,65sleep20-21swapper/211:34:212
474621338,69sleep24810-21sendmail-msp09:39:202
27705213345,49sleep227727-21cpu07:24:382
502421329,108sleep25061-21ps07:54:502
502421329,108sleep25061-21ps07:54:502
24657213113,102sleep324752-21fschecks_time07:14:413
32057212816,18sleep00-21swapper/009:19:520
21181212815,55sleep221401-21latency_hist12:14:232
19784212717,22sleep20-21swapper/210:24:522
657212614,75sleep2675-21grep09:24:432
31929212624,71sleep30-21swapper/309:19:513
27088212657,23sleep20-21swapper/210:49:352
27088212657,23sleep20-21swapper/210:49:352
17994212612,31sleep318124-21cat12:04:233
1520321239,79sleep215278-21grep10:09:492
23428211817,42sleep20-21swapper/212:19:522
21634211856,43sleep20-21swapper/208:49:212
30309211612,40sleep20-21swapper/210:59:412
16664211314,80sleep116150-21apt-get11:59:321
9947211212,80sleep15780-1kworker/1:2H09:54:341
9947211212,80sleep15780-1kworker/1:2H09:54:341
549221127,10sleep20-21swapper/211:24:242
11452211216,79sleep111576-21timerwakeupswit08:14:521
9968211037,50sleep20-21swapper/209:54:472
9968211037,50sleep20-21swapper/209:54:472
29817210946,50sleep229887-21switchtime07:29:512
25698210828,59sleep325850-21sed12:24:543
25303210740,53sleep225314-21latency_hist10:44:222
25303210740,53sleep225314-21latency_hist10:44:222
20512210718,58sleep120581-21grep08:44:561
13282210716,31sleep20-21swapper/211:49:312
13282210716,31sleep20-21swapper/211:49:312
6134210422,48sleep36129-21apt-get07:59:363
5540210420,48sleep30-21swapper/311:24:373
19019210422,66sleep319042-21kworker/u8:310:24:203
27465210311,76sleep027531-21date07:24:230
17441210318,63sleep317450-21modprobe10:19:193
15886210317,67sleep015922-21basename10:14:200
26635210217,21sleep20-21swapper/207:19:492
19998210219,62sleep120139-21unixbench_multi10:24:551
3121321007,36sleep20-21swapper/207:34:472
2861229922,57sleep328631-21apt-get10:54:333
2211729934,30sleep222160-21sh10:34:212
1826829919,63sleep218285-21modprobe08:39:202
146729913,74sleep21513-21grep07:44:362
130862998,36sleep20-21swapper/210:04:362
130862998,36sleep20-21swapper/210:04:362
2563129820,58sleep025687-21fschecks_count10:44:400
24042988,34sleep20-21swapper/211:14:352
151429815,70sleep31540-21df07:44:373
2394129731,25sleep224065-21latency_hist07:14:242
155029712,71sleep11559-21forks07:44:401
61229631,32sleep2673-21latency_hist11:09:222
235582967,34sleep20-21swapper/208:54:382
254552959,34sleep20-21swapper/208:59:472
254529510,71sleep00-21swapper/007:47:050
1525229510,33sleep20-21swapper/208:29:232
903729316,55sleep20-21swapper/211:34:462
237622930,6sleep30-21swapper/310:39:213
1010529310,68sleep310114-21fschecks_count09:55:043
1010529310,68sleep310114-21fschecks_count09:55:043
31029212,63sleep0358-21ntp_states07:39:460
132229218,29sleep10-21swapper/111:09:491
1232329210,63sleep312445-21/usr/sbin/munin10:00:053
2817129132,15sleep20-21swapper/209:09:372
2817129132,15sleep20-21swapper/209:09:372
2253329114,55sleep321898-21/usr/sbin/munin08:49:513
1709329125,19sleep20-21swapper/212:00:012
2398429012,56sleep124075-21mailstats08:54:501
221629015,18sleep20-21swapper/209:29:432
534228915,58sleep15491-21latency_hist11:24:231
3077028918,33sleep30-21swapper/307:34:323
546928815,57sleep25516-21ntpq09:39:452
2865228820,25sleep20-21swapper/210:54:402
1870028812,19sleep10-21swapper/112:04:491
737228726,45sleep20-21swapper/208:04:032
285628617,50sleep11919-21/usr/sbin/munin09:29:551
2098828630,31sleep20-21swapper/207:04:312
1621428616,45sleep316403-21latency_hist11:59:223
1621428616,45sleep316403-21latency_hist11:59:223
3098228511,59sleep131058-21/usr/sbin/munin09:19:211
3098228511,59sleep131058-21/usr/sbin/munin09:19:211
2943828512,53sleep10-21swapper/107:29:411
1926328518,17sleep20-21swapper/208:39:532
1573528522,46sleep20-21swapper/208:29:432
692528422,36sleep17009-21unixbench_singl07:59:541
1825628419,30sleep00-21swapper/010:19:490
1011828420,42sleep010168-21fschecks_time09:55:050
1011828420,42sleep010168-21fschecks_time09:55:050
598128311,18sleep30-21swapper/309:39:543
2849928324,43sleep20-21swapper/212:34:462
2159328326,19sleep221556-21apt-get12:14:512
921228210,57sleep19231-21apt-get08:09:311
921228210,57sleep19231-21apt-get08:09:311
456928211,57sleep34570-21sshd09:37:033
808528110,58sleep08121-21ntpq08:04:450
32012810,7sleep10-21swapper/111:14:531
2910328114,17sleep10-21swapper/110:54:511
2351128114,48sleep123516-21/usr/sbin/munin12:19:551
2038228115,33sleep00-21swapper/008:44:390
1391828118,26sleep00-21swapper/008:24:360
2825528029,26sleep10-21swapper/109:09:401
2825528029,26sleep10-21swapper/109:09:401
1925728021,11sleep20-21swapper/212:06:192
1664728016,36sleep10-21swapper/110:14:491
1512828012,47sleep20-21swapper/211:54:442
1512828012,47sleep20-21swapper/211:54:442
668727812,48sleep20-21swapper/209:44:372
1849827819,32sleep30-21swapper/312:04:433
717627722,35sleep37239-21grep11:29:423
2295227718,10sleep20-21swapper/208:51:192
1284327719,36sleep012886-21latency_hist10:04:220
894827625,28sleep30-21swapper/308:09:213
521627616,10sleep20-21swapper/211:23:552
3237627613,27sleep10-21swapper/111:04:521
2704627619,42sleep20-21swapper/212:29:502
85927517,34sleep0860-21cpu11:09:360
394327519,11sleep20-21swapper/207:50:102
394327519,11sleep20-21swapper/207:50:102
2758027516,11sleep20-21swapper/209:05:412
2758027516,11sleep20-21swapper/209:05:412
2735927519,35sleep127415-21latency10:49:421
2735927519,35sleep127415-21latency10:49:421
2642127517,25sleep30-21swapper/307:19:423
2531627520,39sleep325460-21latency_hist10:44:233
2531627520,39sleep325460-21latency_hist10:44:233
3095927411,48sleep030960-21sshd09:19:030
3095927411,48sleep030960-21sshd09:19:030
2505827419,23sleep00-21swapper/008:59:370
687727316,31sleep36889-21kernelversion09:44:433
214662739,47sleep00-21swapper/007:04:490
3117327212,45sleep130769-21/usr/sbin/munin07:34:461
2216927217,26sleep00-21swapper/010:34:230
1998727224,24sleep00-21swapper/008:44:230
865827114,39sleep18737-21/usr/sbin/munin09:49:491
865827114,39sleep18737-21/usr/sbin/munin09:49:491
2330627012,42sleep323441-21modprobe08:54:233
2148927021,32sleep321609-21timerwakeupswit10:29:543
2019527014,36sleep10-21swapper/112:09:461
1891327016,28sleep00-21swapper/012:04:520
1358927021,19sleep30-21swapper/310:04:503
1358927021,19sleep30-21swapper/310:04:503
1288927019,30sleep10-21swapper/110:04:231
70892687,49sleep00-21swapper/008:00:210
310626814,37sleep03215-21perl07:49:390
310626814,37sleep03215-21perl07:49:390
282482689,45sleep028316-21awk07:24:520
2741026813,36sleep327508-21users09:04:533
2741026813,36sleep327508-21users09:04:533
3071126716,25sleep30-21swapper/310:59:503
2293726717,31sleep023047-21apt-config12:19:220
1296926717,27sleep10-21swapper/108:19:531
1287726721,27sleep00-21swapper/008:19:520
989626612,38sleep19969-21systemd-run11:39:211
2679926619,26sleep326839-21modprobe10:49:203
3001826514,31sleep029223-21/usr/sbin/munin07:29:530
1528026518,23sleep30-21swapper/310:09:503
107426514,31sleep31213-21grep09:24:523
1626626412,38sleep016326-21fschecks_count10:14:400
152512649,12sleep00-21swapper/011:54:460
152512649,12sleep00-21swapper/011:54:460
114732649,40sleep011505-21munin-run11:44:210
114732649,40sleep011505-21munin-run11:44:210
2697526319,20sleep10-21swapper/112:29:491
2100526314,28sleep320509-21apt-get07:04:323
932526211,24sleep39420-21perl08:09:413
932526211,24sleep39420-21perl08:09:413
2158726211,33sleep321556-21apt-get12:14:483
206426219,23sleep30-21swapper/309:29:403
2039026216,30sleep320492-21timerandwakeup12:09:523
1423726211,37sleep10-21swapper/110:08:031
1423726211,37sleep10-21swapper/110:08:031
101972625,12sleep00-21swapper/008:10:310
101972625,12sleep00-21swapper/008:10:310
553626118,32sleep030769-1kworker/0:1H11:24:340
2750126113,31sleep027543-21ntp_states10:49:450
2750126113,31sleep027543-21ntp_states10:49:450
2685126114,29sleep126959-21latency_hist10:49:221
1971926121,18sleep30-21swapper/310:24:493
1829226117,26sleep318347-21munin-run08:39:213
1459626118,25sleep314748-21awk08:24:513
2475426012,27sleep00-21swapper/007:14:420
238126015,25sleep02400-21apt-get11:14:330
2277326016,25sleep122831-21users08:49:531
1989626014,24sleep30-21swapper/308:44:223
1768926018,22sleep10-21swapper/108:34:511
86292598,39sleep10-21swapper/108:05:151
325062596,18sleep10-21swapper/109:23:411
267725920,18sleep30-21swapper/311:14:443
2668725919,22sleep10-21swapper/109:04:391
2668725919,22sleep10-21swapper/109:04:391
2505325915,27sleep125048-21apt-get08:59:341
16182595,45sleep00-21swapper/009:28:570
1461225915,20sleep30-21swapper/311:54:213
1461225915,20sleep30-21swapper/311:54:213
515325814,17sleep00-21swapper/009:39:390
3000825814,25sleep30-21swapper/309:14:423
3000825814,25sleep30-21swapper/309:14:423
2989025819,17sleep30-21swapper/307:29:523
2647525814,26sleep026494-21apt-get12:29:310
2631725818,22sleep30-21swapper/309:04:213
1803125813,18sleep10-21swapper/110:19:421
2939125714,27sleep129393-21munin-run12:39:221
2902425720,19sleep30-21swapper/307:29:233
286162576,11sleep10-21swapper/107:24:571
2854425714,27sleep028620-21/usr/sbin/munin12:34:480
1528925713,26sleep115313-21ntp_states11:54:471
1528925713,26sleep115313-21ntp_states11:54:471
2814225615,19sleep30-21swapper/312:34:393
2521225613,20sleep10-21swapper/112:24:441
2282625618,22sleep00-21swapper/010:34:510
2014925617,18sleep00-21swapper/012:09:450
1250825611,32sleep312579-21fschecks_time08:19:423
79525512,31sleep1360-21ntpd09:24:461
50982554,10sleep30-21swapper/311:22:233
2124325513,25sleep121287-21ntpq10:29:471
1626325516,19sleep30-21swapper/308:29:523
1176325514,24sleep011830-21df11:44:370
1176325514,24sleep011830-21df11:44:370
455925412,25sleep04553-21apt-get07:54:360
455925412,25sleep04553-21apt-get07:54:360
2843025415,26sleep028443-21kernelversion09:09:430
2843025415,26sleep028443-21kernelversion09:09:430
2357925412,29sleep023580-21sshd12:20:030
1885725417,17sleep10-21swapper/108:39:431
1585825420,20sleep00-21swapper/008:29:450
1431725419,19sleep10-21swapper/108:24:451
1397825415,21sleep10-21swapper/111:49:511
1397825415,21sleep10-21swapper/111:49:511
1001925413,17sleep30-21swapper/311:39:233
882825315,22sleep38947-21sed09:49:513
882825315,22sleep38947-21sed09:49:513
661925310,17sleep10-21swapper/109:44:361
464625314,18sleep10-21swapper/107:54:411
464625314,18sleep10-21swapper/107:54:411
2745825313,21sleep30-21swapper/310:49:443
2745825313,21sleep30-21swapper/310:49:443
2471325317,18sleep30-21swapper/312:24:223
2192325313,24sleep021917-21apt-get08:49:360
1184625314,21sleep311906-21fschecks_time11:44:403
1184625314,21sleep311906-21fschecks_time11:44:403
863825213,23sleep08632-21apt-get11:34:350
793325214,23sleep07995-21users11:29:550
632525214,23sleep16326-21cron09:44:201
35925212,24sleep1370-21ntp_states07:39:471
243025214,17sleep00-21swapper/009:29:500
110825213,24sleep31131-21irqstats11:09:433
1078525213,23sleep010780-21apt-get08:14:350
1066925212,25sleep310675-21ntp_states11:39:473
1066925212,25sleep310675-21ntp_states11:39:473
591325115,17sleep10-21swapper/111:24:471
431525115,14sleep30-21swapper/307:54:233
431525115,14sleep30-21swapper/307:54:233
392525112,24sleep03944-21ntp_states09:34:460
3147725114,19sleep10-21swapper/111:04:201
2695225114,21sleep326958-21ntp_states12:29:473
2661425112,22sleep10-21swapper/107:19:481
2306325113,22sleep323069-21ntp_states07:09:493
1939825111,16sleep00-21swapper/010:24:420
1546125112,23sleep115456-21apt-get08:29:341
140192516,34sleep00-21swapper/010:05:110
140192516,34sleep00-21swapper/010:05:110
1226825112,22sleep10-21swapper/111:44:501
1226825112,22sleep10-21swapper/111:44:501
445925012,28sleep10-21swapper/109:35:361
3176325012,21sleep331760-21apt-get11:04:343
306025015,18sleep10-21swapper/107:49:361
306025015,18sleep10-21swapper/107:49:361
2034225012,22sleep319863-21apt-get08:44:303
1467625012,18sleep10-21swapper/110:09:361
1118025016,18sleep30-21swapper/308:14:463
3047024912,23sleep030483-21irqstats10:59:430
3176524814,18sleep00-21swapper/011:04:350
2346724811,21sleep023474-21apt-get08:54:320
834924610,21sleep18384-21awk11:34:201
259692468,24sleep126114-21cat07:19:241
228722469,22sleep122882-21ntpq10:34:521
463124511,19sleep34638-21df_inode07:54:393
463124511,19sleep34638-21df_inode07:54:393
170872457,15sleep00-21swapper/008:34:380
290912448,14sleep00-21swapper/010:54:500
1059323810,15sleep10-21swapper/111:39:451
1059323810,15sleep10-21swapper/111:39:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional