You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-24 - 22:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7s.osadl.org (updated Mon Aug 24, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17513222506,2231sleep03063-21kworker/0:210:47:230
17513222506,2231sleep03063-21kworker/0:210:47:230
183792164035,1535sleep214537-21kworker/u8:210:50:272
46462127812,1250sleep04657-21/usr/sbin/munin11:49:150
705259017,554sleep0831-21/usr/sbin/munin08:09:460
29522236288,174sleep20-21swapper/207:59:342
6531234149,272sleep26593-21fschecks_time11:54:342
16189232624,280sleep116227-21grep12:24:321
5450232018,216sleep25600-21unixbench_multi08:24:462
221082307106,185sleep222140-21proc_pri07:34:432
1066322927,273sleep2367-21snmpd12:07:012
1066322927,273sleep2367-21snmpd12:07:012
10174228029,83sleep20-21swapper/210:24:322
28225225762,180sleep228261-21ntp_kernel_err07:54:382
17919224842,196sleep2367-21snmpd07:19:542
17919224842,196sleep2367-21snmpd07:19:542
2980223111,200sleep229118-21kworker/u8:008:19:172
2980223111,200sleep229118-21kworker/u8:008:19:172
21314222314,192sleep121384-21/usr/sbin/munin10:59:311
14641222157,89sleep20-21swapper/212:19:322
9527218734,37sleep30-21swapper/308:39:323
24455217921,81sleep20-21swapper/211:09:202
24455217921,81sleep20-21swapper/211:09:202
498221787,157sleep25074-21tune2fs11:49:332
10743217813,86sleep210878-21latency_hist08:44:162
14181217776,21sleep20-21swapper/208:54:332
23069217612,150sleep322587-21apt-get11:04:213
23069217612,150sleep322587-21apt-get11:04:213
16842217261,87sleep216985-21grep12:24:452
13875217012,143sleep313913-21ntp_kernel_pll_07:09:543
13875217012,143sleep313913-21ntp_kernel_pll_07:09:543
3007921666,106sleep20-21swapper/211:24:472
31459216210,55sleep20-21swapper/211:29:432
23483215915,24sleep023541-21sed07:39:340
12725215646,98sleep212788-21cat08:49:372
1555921518,89sleep20-21swapper/207:14:332
1400214845,87sleep21552-21gpgv11:39:162
2416421358,47sleep223675-21/usr/sbin/munin09:24:412
2416421358,47sleep223675-21/usr/sbin/munin09:24:412
15518213454,57sleep20-21swapper/210:39:462
3409213317,53sleep23449-21http10:04:142
1935421309,24sleep20-21swapper/207:24:462
17499212945,69sleep017575-21/usr/sbin/munin07:19:440
17499212945,69sleep017575-21/usr/sbin/munin07:19:440
7041212649,62sleep27190-21head08:29:462
27405212612,30sleep227512-21timerandwakeup09:34:422
27405212612,30sleep227512-21timerandwakeup09:34:422
269121269,15sleep00-21swapper/009:59:430
19294212549,23sleep213100-21cyclictest12:34:342
11692212416,92sleep311709-21apt10:29:253
3582212210,98sleep33615-21irqstats11:44:343
21836212121,81sleep321844-21modprobe09:19:133
14789212041,17sleep20-21swapper/207:14:172
14789212041,17sleep20-21swapper/207:14:172
31710211729,62sleep131865-21head08:04:461
26294211715,83sleep126346-21cut11:14:361
11952211617,17sleep20-21swapper/212:09:552
6787211529,19sleep20-21swapper/210:14:152
28158211550,13sleep20-21swapper/211:19:382
21269211221,71sleep10-21swapper/109:15:521
23300211114,78sleep123347-21fschecks_count07:39:311
2010921109,83sleep220248-21apt-config09:14:152
1201621097,12sleep30-21swapper/307:04:373
838721086,12sleep20-21swapper/211:59:382
31597210817,74sleep031709-21cat08:04:450
19805210873,17sleep20-21swapper/210:54:312
19805210873,17sleep20-21swapper/210:54:312
13325210811,78sleep113451-21users08:49:481
2577221076,17sleep20-21swapper/211:12:232
2577221076,17sleep20-21swapper/211:12:232
12153210711,20sleep00-21swapper/012:09:570
1401421066,12sleep20-21swapper/210:34:452
1401421066,12sleep20-21swapper/210:34:452
24845210521,65sleep324739-21/usr/sbin/munin07:44:343
7400210412,79sleep37439-21ntpq10:14:363
12252210417,71sleep00-21swapper/008:49:140
10442210422,67sleep110510-21ls10:24:391
4385210236,55sleep20-21swapper/208:23:042
4385210236,55sleep20-21swapper/208:23:042
289921026,16sleep20-21swapper/211:42:102
26576210228,55sleep20-21swapper/211:14:412
13044210212,70sleep213192-21gpgv07:09:162
82021000,8sleep10-21swapper/111:34:461
1242210014,69sleep01311-21http11:39:140
1763329915,25sleep20-21swapper/209:04:392
1197929964,19sleep20-21swapper/210:29:362
98472989,71sleep00-21swapper/012:04:370
98472989,71sleep00-21swapper/012:04:370
1973629830,42sleep00-21swapper/010:54:290
1973629830,42sleep00-21swapper/010:54:290
284212977,14sleep20-21swapper/209:39:312
1929229717,64sleep119384-21mailstats09:09:421
74922968,76sleep27510-21open_inodes10:14:392
221592968,76sleep222224-21ls09:19:322
221592968,76sleep222224-21ls09:19:322
1610629621,58sleep116132-21latency_hist10:44:131
352829510,29sleep20-21swapper/211:44:332
228829518,64sleep32363-21mailstats11:39:453
176229512,68sleep11267-21apt-get11:39:191
1315329410,68sleep113192-21idleruntime12:14:351
259072935,18sleep20-21swapper/207:47:482
166302936,73sleep20-21swapper/209:00:192
537129219,53sleep34872-21/usr/sbin/munin11:49:423
327232928,59sleep20-21swapper/208:09:362
237182929,70sleep023799-21switchtime11:05:110
237182929,70sleep023799-21switchtime11:05:110
211742927,76sleep00-21swapper/007:31:590
2056729219,54sleep020054-21apt-get09:14:300
1607129217,55sleep316114-21/usr/sbin/munin08:59:393
762029121,39sleep30-21swapper/308:34:153
1790729113,62sleep018058-21unixbench_multi09:04:450
1105129123,43sleep311245-21grep12:09:163
1105129123,43sleep311245-21grep12:09:163
88012906,17sleep20-21swapper/208:35:072
205222907,57sleep20-21swapper/207:29:392
402828912,14sleep00-21swapper/010:04:360
2805928917,59sleep028134-21cat11:19:360
2163228936,41sleep20-21swapper/209:16:342
1973428911,23sleep319729-21apt-get10:54:283
1973428911,23sleep319729-21apt-get10:54:283
1289328929,37sleep012924-21munin-run07:09:140
1409128715,34sleep30-21swapper/308:54:263
84912864,11sleep00-21swapper/010:19:170
2430828622,19sleep10-21swapper/109:24:441
2430828622,19sleep10-21swapper/109:24:441
2301928612,57sleep323167-21cat07:39:173
1543028612,23sleep00-21swapper/008:59:160
1526728616,55sleep015334-21sed07:14:230
3272828519,49sleep3231-21systemd-journal09:54:133
2716428516,52sleep027209-21/usr/sbin/munin09:34:360
2716428516,52sleep027209-21/usr/sbin/munin09:34:360
87062849,18sleep20-21swapper/210:19:322
227832848,59sleep20-21swapper/211:04:162
2070528313,53sleep320781-21timerandwakeup07:29:443
1649028316,43sleep116585-21fschecks_time10:44:331
1649028316,43sleep116585-21fschecks_time10:44:331
1635328318,44sleep116510-21unixbench_multi08:59:451
699928213,21sleep10-21swapper/110:14:181
265462828,18sleep20-21swapper/207:49:332
176562827,16sleep20-21swapper/210:49:142
176562827,16sleep20-21swapper/210:49:142
1294728234,26sleep10-21swapper/107:09:151
2053428120,18sleep30-21swapper/312:39:153
1631228117,48sleep316370-21irqstats12:24:343
39192808,21sleep23934-21apt-get10:04:262
3147028018,48sleep212-21rcu_sched09:49:282
2452428011,54sleep20-21swapper/207:44:162
2045428024,39sleep120491-21run-parts12:39:131
158272806,14sleep30-21swapper/307:14:383
313582798,19sleep231394-21ntpq08:04:392
182612790,5sleep30-21swapper/310:49:513
112722797,15sleep20-21swapper/208:44:402
8212787,13sleep20-21swapper/209:54:372
2812627818,42sleep028172-21latency07:54:360
259602788,13sleep20-21swapper/209:29:462
259602788,13sleep20-21swapper/209:29:462
1946127824,28sleep30-21swapper/309:09:443
304122778,13sleep20-21swapper/209:44:442
2139827717,36sleep021480-21cut10:59:340
1484827722,35sleep014844-21apt-get10:39:270
1224127715,47sleep312242-21cron08:49:133
139952768,57sleep214004-21modprobe12:16:132
1354027614,47sleep013543-21irqstats10:34:350
1354027614,47sleep013543-21irqstats10:34:350
808327514,45sleep38095-21df_inode11:59:313
777827517,28sleep30-21swapper/311:59:153
377427516,43sleep03851-21cat08:19:430
377427516,43sleep03851-21cat08:19:430
3097827513,43sleep031069-21/usr/sbin/munin11:29:330
1815227512,46sleep10-21swapper/112:29:441
176542758,51sleep20-21swapper/212:29:292
1324027516,24sleep30-21swapper/312:14:373
984027419,38sleep19883-21/usr/sbin/munin08:39:381
858427422,28sleep00-21swapper/008:34:450
3107027420,22sleep10-21swapper/111:29:341
1757627411,28sleep10-21swapper/107:19:451
1757627411,28sleep10-21swapper/107:19:451
786027318,40sleep37861-21sshd08:34:283
574827319,28sleep30-21swapper/310:09:363
363227323,25sleep10-21swapper/110:04:171
1494727318,37sleep315053-21tune2fs10:39:343
1461027322,27sleep10-21swapper/110:39:161
1461027322,27sleep10-21swapper/110:39:161
3006527215,41sleep130192-21cat07:59:461
2891327211,45sleep328983-21sensors09:39:443
1980327219,24sleep10-21swapper/107:29:131
172832729,52sleep00-21swapper/012:28:140
1072427216,28sleep00-21swapper/010:24:460
616827117,30sleep06327-21sed10:09:450
385227116,29sleep10-21swapper/108:19:441
385227116,29sleep10-21swapper/108:19:441
256832718,11sleep00-21swapper/007:44:550
2456427118,36sleep124560-21apt-get11:09:281
2456427118,36sleep124560-21apt-get11:09:281
1065527123,26sleep30-21swapper/310:24:453
830227021,28sleep00-21swapper/010:19:130
2837627018,18sleep10-21swapper/109:39:301
196012708,13sleep00-21swapper/012:34:400
47242699,45sleep30-21swapper/310:04:553
2725526920,26sleep30-21swapper/309:34:393
2725526920,26sleep30-21swapper/309:34:393
318352688,42sleep00-21swapper/009:49:380
651926714,37sleep06525-21df_inode11:54:320
3036626714,38sleep330377-21ntp_states09:44:413
2345326713,38sleep023487-21latency_hist09:24:150
2345326713,38sleep023487-21latency_hist09:24:150
2257426718,32sleep322587-21apt-get11:04:133
216226719,22sleep10-21swapper/108:14:431
216226719,22sleep10-21swapper/108:14:431
1987526724,21sleep00-21swapper/007:29:160
1346526717,31sleep013509-21/usr/sbin/munin07:09:300
1346526717,31sleep013509-21/usr/sbin/munin07:09:300
90462666,17sleep10-21swapper/112:01:061
3270326621,21sleep30-21swapper/311:34:363
2942326616,20sleep10-21swapper/111:24:331
2761126617,27sleep00-21swapper/007:54:150
2658026617,30sleep326669-21/usr/sbin/munin07:49:343
1384726619,35sleep013883-21latency_hist08:54:150
138426621,26sleep10-21swapper/108:14:151
2647726514,26sleep00-21swapper/011:14:390
2164326523,27sleep121644-21/usr/sbin/munin07:34:301
1802226518,26sleep00-21swapper/012:29:390
1770726513,36sleep317798-21apt-config10:49:153
1770726513,36sleep317798-21apt-config10:49:153
966426422,24sleep10-21swapper/112:04:341
966426422,24sleep10-21swapper/112:04:341
2004026418,28sleep020063-21munin-run09:14:130
1854526416,32sleep318515-21latency_hist09:09:163
1221726412,18sleep10-21swapper/110:29:441
686326313,34sleep06926-21/usr/sbin/munin08:29:440
519626323,25sleep15222-21munin-run10:09:131
406626325,23sleep10-21swapper/111:44:441
2787926315,23sleep10-21swapper/111:19:331
262626316,29sleep32689-21/usr/sbin/munin09:59:423
1944226318,22sleep00-21swapper/010:54:130
859626213,18sleep30-21swapper/310:19:243
67226215,27sleep00-21swapper/009:54:350
257222625,18sleep00-21swapper/011:11:450
257222625,18sleep00-21swapper/011:11:450
2224326217,28sleep122255-21/usr/sbin/munin09:19:351
2224326217,28sleep122255-21/usr/sbin/munin09:19:351
1983026213,27sleep10-21swapper/110:54:341
1983026213,27sleep10-21swapper/110:54:341
1611726211,12sleep10-21swapper/107:14:441
1503026219,25sleep315089-21/usr/sbin/munin12:19:413
769926120,26sleep17703-21cron11:59:131
620226116,32sleep06215-21cat11:54:150
305892618,42sleep00-21swapper/011:29:090
873326015,25sleep10-21swapper/108:34:461
869626019,22sleep10-21swapper/110:19:301
63426020,23sleep30-21swapper/308:09:453
595226015,20sleep10-21swapper/110:09:421
52332608,11sleep30-21swapper/308:24:433
3064826019,23sleep330777-21sort11:29:163
289626018,24sleep32925-21idleruntime-cro08:19:143
289626018,24sleep32925-21idleruntime-cro08:19:143
1125426018,22sleep10-21swapper/108:44:391
192762597,19sleep10-21swapper/110:52:041
190625914,22sleep10-21swapper/109:59:161
1475925916,24sleep114788-21wc07:14:161
1475925916,24sleep114788-21wc07:14:161
1305225911,31sleep013150-21tune2fs12:14:340
65325811,20sleep30-21swapper/309:54:343
53722589,29sleep10-21swapper/108:24:451
3065825812,32sleep130783-21unixbench_singl09:44:471
1739125819,22sleep10-21swapper/109:04:331
1516725811,30sleep115283-21sed12:19:431
31625716,18sleep10-21swapper/109:54:151
3139625719,19sleep30-21swapper/308:04:403
2586025723,18sleep10-21swapper/109:29:451
2586025723,18sleep10-21swapper/109:29:451
2500825711,28sleep025135-21latency_hist09:29:150
2500825711,28sleep025135-21latency_hist09:29:150
163825716,24sleep01705-21df08:14:300
163825716,24sleep01705-21df08:14:300
1204125713,19sleep30-21swapper/312:09:563
756925615,26sleep17595-21munin-run08:34:131
550725614,20sleep10-21swapper/111:49:441
3000925613,21sleep00-21swapper/009:44:330
2856625615,20sleep10-21swapper/107:54:451
2837525614,20sleep00-21swapper/009:39:290
2543525610,20sleep10-21swapper/111:09:561
2543525610,20sleep10-21swapper/111:09:561
1792625614,24sleep318020-21memory12:29:383
1156925514,20sleep10-21swapper/112:09:461
41902544,11sleep30-21swapper/308:20:313
41902544,11sleep30-21swapper/308:20:313
2950725414,24sleep029516-21df_inode07:59:320
1611625414,23sleep016126-21ntp_states08:59:400
990825317,16sleep00-21swapper/008:39:410
607825316,20sleep06230-21latency_hist08:29:160
2782725312,27sleep327828-21sshd07:54:233
2655525321,15sleep30-21swapper/309:34:153
2655525321,15sleep30-21swapper/309:34:153
247292536,34sleep10-21swapper/107:44:191
2370125314,23sleep323771-21df09:24:303
2370125314,23sleep323771-21df09:24:303
2340925218,14sleep30-21swapper/309:24:143
2340925218,14sleep30-21swapper/309:24:143
1409425212,23sleep114088-21apt-get08:54:281
1171125213,23sleep011713-21apt-get10:29:260
2661725115,20sleep326659-21ntp_states11:14:423
2580025115,14sleep00-21swapper/009:29:440
2580025115,14sleep00-21swapper/009:29:440
223125115,17sleep00-21swapper/011:39:420
2135125113,23sleep121379-21munin-run07:34:141
1746125116,18sleep30-21swapper/307:19:433
1746125116,18sleep30-21swapper/307:19:433
1366825112,15sleep30-21swapper/310:34:383
1366825112,15sleep30-21swapper/310:34:383
896925014,21sleep00-21swapper/012:00:130
272882505,10sleep10-21swapper/107:50:371
2508525013,21sleep325120-21ntp_states11:09:503
2508525013,21sleep325120-21ntp_states11:09:503
2375725016,18sleep30-21swapper/307:39:413
311572498,15sleep30-21swapper/311:29:363
2786324912,22sleep327872-21diskstats11:19:313
2164224914,18sleep00-21swapper/007:34:290
2959424814,16sleep30-21swapper/307:59:353
1278924812,21sleep312813-21irqstats08:49:383
280552477,13sleep10-21swapper/109:39:131
280552477,13sleep10-21swapper/109:39:131
1894224714,18sleep30-21swapper/307:24:393
1478324311,16sleep00-21swapper/012:19:340
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional