You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 05:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7s.osadl.org (updated Tue Sep 08, 2026 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
81192687716,6844sleep013319-21kworker/u8:323:23:510
81192687716,6844sleep013319-21kworker/u8:323:23:510
13269218909,1866sleep122259-1kworker/1:0H21:58:331
7705285015,652sleep27504-21apt-get23:23:242
18115265914,629sleep318139-21df23:53:373
22095256014,530sleep122103-21ntp_states20:43:481
28352250630,462sleep228430-21grep00:24:382
810249515,466sleep1811-21sshd23:00:381
511724957,451sleep25182-21awk23:13:522
2769623497,333sleep318004-1kworker/3:1H00:23:423
2245822947,276sleep0367-21snmpd00:08:120
1349322849,237sleep213559-21idleruntime21:59:272
19496227634,225sleep219515-21apt-get22:18:332
25526227318,217sleep225642-21rm22:38:232
4107225665,174sleep24174-21switchtime19:48:552
4107225665,174sleep24174-21switchtime19:48:552
28211225520,214sleep228299-21fschecks_time21:03:442
16510224425,207sleep216594-21perl22:08:442
15652224276,51sleep20-21swapper/223:43:562
6676223237,119sleep26748-21latency_hist19:58:232
26652223133,179sleep226714-21fschecks_time20:58:432
1090222212,196sleep31178-21apt-config23:03:233
2328122189,195sleep023307-21fschecks_count20:48:400
21157220112,67sleep20-21swapper/222:23:412
10747220011,152sleep210811-21mailstats20:08:532
30956219534,42sleep231011-21basename00:33:422
18067219012,166sleep218114-21grep23:53:362
25108217958,88sleep225168-21find19:13:542
25108217958,88sleep225168-21find19:13:542
25658217621,135sleep125713-21latency_hist00:18:221
15391217543,17sleep20-21swapper/220:23:432
2151217348,24sleep20-21swapper/221:23:382
32760217151,52sleep20-21swapper/221:18:252
3701216813,70sleep20-21swapper/221:28:392
24448216813,143sleep00-21swapper/022:33:450
20362216817,135sleep220381-21kernelversion20:38:492
697216531,51sleep20-21swapper/219:38:492
609216537,54sleep2594-21apt-get21:18:412
1831721616,13sleep00-21swapper/023:53:430
1500421619,141sleep215063-21cat22:03:432
7983215814,128sleep17504-21apt-get23:23:311
7983215814,128sleep17504-21apt-get23:23:311
30852215712,124sleep20-21swapper/219:33:242
17327215312,77sleep20-21swapper/220:28:522
29179215117,118sleep329247-21grep22:48:453
24150214829,57sleep10-21swapper/122:33:331
15575214710,122sleep115649-21find23:43:551
24466214413,27sleep224483-21munin-run20:53:222
11783214328,45sleep30-21swapper/320:13:343
2415214066,16sleep20-21swapper/219:43:542
2415214066,16sleep20-21swapper/219:43:542
3654213752,27sleep23725-21switchtime23:08:552
31090213611,50sleep20-21swapper/222:53:492
13468213570,16sleep20-21swapper/223:38:592
2977921347,13sleep00-21swapper/000:28:560
8887213216,48sleep20-21swapper/220:03:482
11648213210,38sleep20-21swapper/221:53:422
8808213117,98sleep18886-21fschecks_time20:03:471
25998213112,38sleep326065-21df22:38:403
25998213112,38sleep326065-21df22:38:403
2499421319,106sleep011111-21kworker/u8:120:53:400
1524212823,86sleep01054-21apt-get23:03:320
3220121267,57sleep20-21swapper/222:58:332
29307212617,34sleep20-21swapper/200:28:412
861621259,47sleep20-21swapper/223:24:092
861621259,47sleep20-21swapper/223:24:092
1433321258,105sleep0374-21sshd22:00:380
352212419,81sleep00-21swapper/022:58:520
26614212417,37sleep20-21swapper/219:18:472
24847212223,55sleep20-21swapper/200:13:512
7525211917,86sleep17623-21sed19:58:551
7525211917,86sleep17623-21sed19:58:551
14935211919,85sleep314449-21apt-get23:43:323
26081211830,36sleep20-21swapper/222:38:432
26081211830,36sleep20-21swapper/222:38:432
21546211731,63sleep321610-21sendmail_mailqu22:23:513
1875021169,68sleep218813-21awk20:33:522
1875021169,68sleep218813-21awk20:33:522
6908211321,71sleep36942-21cut21:38:413
29254211116,69sleep00-21swapper/019:28:210
31676211013,80sleep131677-21sshd22:55:381
2499621108,38sleep20-21swapper/220:53:422
13608211029,62sleep113123-21apt-get20:18:331
3520210920,69sleep03041-21apt-get19:48:320
3520210920,69sleep03041-21apt-get19:48:320
29696210969,18sleep20-21swapper/222:48:572
9644210827,43sleep29686-21tune2fs23:28:412
32428210728,41sleep232561-21sed19:38:252
6598210618,71sleep06635-21sh19:58:210
13160210514,76sleep013244-21apt-config20:18:240
5833210416,70sleep15898-21sendmail_mailst19:53:581
11517210413,17sleep30-21swapper/320:13:223
14140210352,34sleep20-21swapper/220:19:072
28621210125,55sleep20-21swapper/219:24:082
830829914,69sleep28388-21munin-run20:03:242
830829914,69sleep28388-21munin-run20:03:242
2088529914,70sleep121065-21latency_hist19:03:241
2088529914,70sleep121065-21latency_hist19:03:241
1545129911,72sleep015566-21timerandwakeup22:03:530
346329819,54sleep00-21swapper/021:28:240
2276729820,35sleep20-21swapper/200:08:382
2276729820,35sleep20-21swapper/200:08:382
372729711,26sleep30-21swapper/323:08:563
2326929734,25sleep223338-21switchtime19:08:532
2326929734,25sleep223338-21switchtime19:08:532
2943229613,66sleep129441-21/usr/sbin/munin21:08:231
2776429626,30sleep20-21swapper/222:43:442
2128929621,58sleep321353-21if_eth019:03:423
2128929621,58sleep321353-21if_eth019:03:423
1065729664,15sleep20-21swapper/221:48:532
3234629524,49sleep332365-21apt19:38:223
2621029414,60sleep026277-21df19:18:360
2502829417,56sleep324973-21apt-get20:54:083
180202937,12sleep30-21swapper/322:13:413
1270329339,43sleep212796-21systemd-run23:38:222
2967829220,33sleep20-21swapper/221:08:362
2571629235,17sleep20-21swapper/200:18:232
2242029242,27sleep20-21swapper/220:43:532
236902916,75sleep2367-21snmpd22:30:522
1987629141,32sleep20-21swapper/223:58:452
658429015,35sleep20-21swapper/221:38:242
1180829033,42sleep222462-21cyclictest20:13:372
2120428920,32sleep20-21swapper/200:03:342
196202899,55sleep00-21swapper/022:18:430
152428916,57sleep01595-21latency_hist19:43:230
1096328914,57sleep011124-21latency_hist23:33:240
1992628815,31sleep30-21swapper/323:58:463
1767328819,29sleep20-21swapper/223:52:032
3145928717,53sleep031470-21netstat19:33:460
305922865,72sleep00-21swapper/019:30:400
2783028628,39sleep027842-21cron21:03:210
2767828611,62sleep00-21swapper/000:23:350
153428612,56sleep21549-21apt-get23:03:342
89852856,13sleep30-21swapper/321:43:543
196092857,11sleep30-21swapper/322:18:423
185102858,35sleep20-21swapper/222:13:522
847028418,39sleep08194-21apt-get20:03:260
847028418,39sleep08194-21apt-get20:03:260
533128413,55sleep15484-21awk23:13:551
491728417,52sleep34967-21latency23:13:443
2870928315,44sleep328854-21tail19:24:093
299622829,45sleep30-21swapper/321:08:453
2471928227,30sleep10-21swapper/119:13:451
2471928227,30sleep10-21swapper/119:13:451
167342828,38sleep10-21swapper/123:48:471
632628118,43sleep36414-21/usr/sbin/munin23:18:413
203828116,49sleep31526-21/usr/sbin/munin23:03:553
1132428117,49sleep010852-21apt-get23:33:320
87892806,32sleep20-21swapper/221:43:492
2476728023,32sleep30-21swapper/300:13:483
1698128014,51sleep316988-21uname23:48:533
300772785,10sleep00-21swapper/022:49:560
1769327814,18sleep10-21swapper/122:13:231
1025127812,51sleep110371-21timerwakeupswit23:29:091
967827722,26sleep10-21swapper/121:48:241
70762777,32sleep20-21swapper/221:38:442
1324527725,23sleep10-21swapper/120:18:251
2097127617,35sleep00-21swapper/000:03:230
19752767,14sleep00-21swapper/019:43:440
19752767,14sleep00-21swapper/019:43:440
1672927623,32sleep00-21swapper/020:28:370
1122927626,29sleep10-21swapper/121:53:241
760427513,44sleep07723-21/usr/sbin/munin21:38:540
57427522,31sleep0594-21apt-get21:18:350
3256227518,37sleep032637-21apt-key21:18:230
1740927514,41sleep317531-21unixbench_multi20:28:533
2762827413,41sleep027708-21tune2fs22:43:420
1646627411,42sleep016362-21/usr/sbin/munin22:08:420
151782749,48sleep30-21swapper/320:23:363
812827321,26sleep10-21swapper/121:43:231
280727311,48sleep12808-21sshd19:45:381
280727311,48sleep12808-21sshd19:45:381
2269527323,26sleep30-21swapper/322:28:393
1155027313,26sleep00-21swapper/021:53:400
76027214,38sleep332637-21/usr/sbin/munin19:38:503
3213927218,25sleep00-21swapper/000:38:240
3165927214,42sleep131683-21ntp_states21:13:481
2270927221,33sleep122713-21diskstats22:28:411
1529927218,28sleep10-21swapper/122:03:501
3132527110,30sleep30-21swapper/321:13:423
2650727122,19sleep30-21swapper/300:18:533
2440127114,39sleep024479-21grep00:13:410
2156927124,29sleep221610-21/usr/sbin/munin19:03:492
2156927124,29sleep221610-21/usr/sbin/munin19:03:492
534727017,27sleep10-21swapper/121:33:421
2313627018,23sleep00-21swapper/000:08:490
2313627018,23sleep00-21swapper/000:08:490
2236827026,21sleep00-21swapper/019:08:230
2236827026,21sleep00-21swapper/019:08:230
2729926914,31sleep10-21swapper/122:43:221
2729926914,31sleep10-21swapper/122:43:221
212032699,41sleep10-21swapper/100:03:331
3007926815,21sleep10-21swapper/121:08:471
2309226816,36sleep123128-21ntpq19:08:481
2309226816,36sleep123128-21ntpq19:08:481
1280526829,21sleep30-21swapper/321:58:233
183126712,22sleep10-21swapper/123:03:491
1443626720,30sleep00-21swapper/023:43:210
2345626620,25sleep30-21swapper/320:48:433
2314826617,21sleep10-21swapper/100:08:501
2314826617,21sleep10-21swapper/100:08:501
2294826613,36sleep322957-21munin-run20:48:223
1086926619,22sleep30-21swapper/323:33:233
359026514,28sleep10-21swapper/123:08:541
2962626416,30sleep129695-21sensors_temp22:48:561
2564626418,25sleep325826-21gpgv22:38:243
1554926420,24sleep10-21swapper/120:23:461
1462926417,19sleep30-21swapper/322:03:243
1445326418,27sleep114505-21apt-config23:43:221
873426319,20sleep00-21swapper/021:43:470
580326313,34sleep35809-21ntp_states19:53:563
3197026314,20sleep00-21swapper/022:58:230
2760826318,26sleep327761-21apt-config19:23:243
2312326318,19sleep00-21swapper/022:28:520
2220226313,22sleep00-21swapper/022:26:460
1953826320,25sleep00-21swapper/020:38:220
1953826320,25sleep00-21swapper/020:38:220
1896626316,21sleep10-21swapper/120:33:551
1896626316,21sleep10-21swapper/120:33:551
1813826313,21sleep10-21swapper/122:13:431
393326212,36sleep13974-21ntpq19:48:491
393326212,36sleep13974-21ntpq19:48:491
2984926218,19sleep10-21swapper/100:28:571
279102620,46sleep10-21swapper/122:43:471
2056926213,25sleep00-21swapper/020:38:550
739326113,23sleep30-21swapper/319:58:533
739326113,23sleep30-21swapper/319:58:533
400926114,32sleep34015-21ntp_states19:48:513
400926114,32sleep34015-21ntp_states19:48:513
316926110,39sleep3367-21snmpd21:25:173
308762616,10sleep00-21swapper/021:12:340
308026115,28sleep03099-21apt-get23:08:370
2706526113,33sleep127112-21users19:18:541
1183226111,35sleep311838-21ntp_states23:34:033
552226018,19sleep00-21swapper/021:33:450
3147626018,27sleep131519-21ntpq19:33:471
3016326020,17sleep10-21swapper/119:28:551
2867926014,33sleep3367-21snmpd22:46:523
2728626012,21sleep10-21swapper/100:23:231
2596226017,25sleep025454-21apt-get22:38:330
2596226017,25sleep025454-21apt-get22:38:330
2278126017,26sleep30-21swapper/319:08:423
2278126017,26sleep30-21swapper/319:08:423
1751326011,11sleep30-21swapper/322:11:433
2962125912,22sleep30-21swapper/319:28:413
2855025913,32sleep128620-21sensors19:24:071
2597325915,26sleep026067-21latency_hist19:18:240
2597325915,26sleep026067-21latency_hist19:18:240
2338425920,21sleep30-21swapper/300:08:563
2338425920,21sleep30-21swapper/300:08:563
1319325919,24sleep30-21swapper/323:38:483
753425815,22sleep00-21swapper/023:23:220
3100125817,23sleep330608-21/usr/sbin/munin22:53:463
2771925815,22sleep10-21swapper/100:24:001
1635125811,33sleep0367-21snmpd20:27:120
831425713,25sleep38408-21memory23:24:023
831425713,25sleep38408-21memory23:24:023
61325715,25sleep1680-21df21:18:451
3087425713,22sleep10-21swapper/100:33:411
2022025717,26sleep320235-21fschecks_count20:38:463
2013225719,24sleep10-21swapper/123:58:521
1364925712,24sleep00-21swapper/020:18:480
1146525722,17sleep10-21swapper/121:53:371
188662566,36sleep00-21swapper/022:14:110
1261725614,25sleep112702-21apt-config23:38:211
1080525610,25sleep30-21swapper/321:48:543
1034925616,19sleep00-21swapper/020:08:430
871925512,25sleep38701-21apt-get20:03:413
762325513,22sleep10-21swapper/123:23:231
524725512,24sleep35243-21apt-get21:33:363
3266425513,23sleep132731-21df19:38:361
2331025512,25sleep123402-21perl20:48:411
17532554,11sleep30-21swapper/321:21:573
867525413,24sleep08194-21apt-get20:03:300
473525414,23sleep00-21swapper/023:13:410
307125412,25sleep33134-21munin-run19:48:233
307125412,25sleep33134-21munin-run19:48:233
2009225414,24sleep120083-21apt-get20:38:351
260525311,21sleep10-21swapper/121:23:491
2166025314,22sleep321666-21ntp_states00:03:473
1587425315,20sleep00-21swapper/023:43:580
271382527,36sleep00-21swapper/000:23:060
2163725212,25sleep021632-21apt-get20:43:350
2083225215,18sleep10-21swapper/122:23:241
1941325214,24sleep119494-21latency_hist23:58:241
1835725214,23sleep318363-21diskstats20:33:413
1835725214,23sleep318363-21diskstats20:33:413
1651125213,23sleep016519-21apt-get23:48:380
367825112,23sleep03697-21apt-get21:28:370
2861225114,17sleep00-21swapper/021:03:540
262462519,17sleep10-21swapper/120:58:221
1157025113,16sleep10-21swapper/120:13:241
1121925112,24sleep011228-21munin-run21:53:230
2701925010,15sleep10-21swapper/120:58:501
226912509,17sleep00-21swapper/019:08:350
226912509,17sleep00-21swapper/019:08:350
2115225011,23sleep121156-21diskstats22:23:401
3213224912,22sleep332137-21latency_hist00:38:233
2812724912,21sleep328197-21df21:03:413
2455924912,20sleep324582-21df_inode19:13:313
2455924912,20sleep324582-21df_inode19:13:313
1506424910,20sleep315106-21irqstats22:03:443
3009524810,15sleep30-21swapper/300:28:593
1494124810,20sleep30-21swapper/320:23:233
1723524717,16sleep10-21swapper/120:28:511
495924612,16sleep10-21swapper/121:33:221
435624613,17sleep30-21swapper/321:28:563
2741024311,20sleep327468-21users20:58:563
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional