You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 11:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7s.osadl.org (updated Fri Jul 31, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6172546614,5439sleep222033-21kworker/2:000:03:332
1211726328,609sleep312161-21ntpq19:33:093
1211726328,609sleep312161-21ntpq19:33:093
1044323976,375sleep310515-21latency_hist21:12:463
6421229011,267sleep36434-21awk19:13:193
17369227022,226sleep317516-21unixbench_singl19:48:153
2239225957,19sleep30-21swapper/322:28:053
250502253106,31sleep30-21swapper/320:13:183
115112233128,39sleep311569-21fschecks_count22:58:083
3482221211,186sleep13567-21threads20:48:151
25446221115,181sleep325525-21awk21:58:153
6114220317,165sleep36206-21fschecks_time20:58:053
27593220313,28sleep30-21swapper/323:48:083
27593220313,28sleep30-21swapper/323:48:083
23454219799,82sleep222516-21/usr/sbin/munin23:33:182
14802218912,68sleep014949-21awk21:23:210
14802218912,68sleep014949-21awk21:23:210
19154218814,157sleep119155-21cron23:22:431
6493218322,22sleep10-21swapper/100:23:171
6493218322,22sleep10-21swapper/100:23:171
15442218117,27sleep30-21swapper/319:43:513
18471217819,136sleep30-21swapper/319:53:073
16918217615,146sleep116994-21timerandwakeup23:13:151
15690217515,140sleep30-21swapper/321:28:043
11834216624,118sleep211913-21fschecks_time19:33:042
11834216624,118sleep211913-21fschecks_time19:33:042
21435215811,121sleep30-21swapper/320:03:043
7652215610,135sleep37656-21entropy21:03:023
25378215616,122sleep025411-21idleruntime-cro23:42:440
26342215416,122sleep226460-21timerwakeupswit23:43:152
470521508,131sleep3364-21snmpd22:35:283
28528215013,25sleep00-21swapper/022:08:130
335321498,126sleep33393-21ps20:48:133
30642214910,113sleep30-21swapper/320:32:553
24762214911,30sleep30-21swapper/323:38:153
2145214912,24sleep02149-21df_inode22:28:020
19139214914,20sleep30-21swapper/323:22:333
6704214818,110sleep30-21swapper/300:23:193
6704214818,110sleep30-21swapper/300:23:193
29831214814,90sleep329829-21apt-get22:12:563
14058214712,121sleep114081-21grep21:23:021
14058214712,121sleep114081-21grep21:23:021
13085214412,115sleep013030-21latency_hist19:37:460
13085214412,115sleep013030-21latency_hist19:37:460
1358214316,94sleep30-21swapper/320:43:003
1986421385,10sleep30-21swapper/321:41:123
928721375,12sleep30-21swapper/322:49:203
90332137102,19sleep30-21swapper/300:33:003
224721357,12sleep00-21swapper/020:43:170
32216212814,19sleep20-21swapper/220:37:552
23172212813,45sleep323300-21timerwakeupswit23:33:153
2053221288,54sleep30-21swapper/323:25:323
32387212716,71sleep30-21swapper/320:38:043
14233212710,83sleep314289-21dpkg23:07:443
9363212514,40sleep39510-21grep19:23:163
9363212514,40sleep39510-21grep19:23:163
768821255,37sleep30-21swapper/322:43:393
2344212521,88sleep22491-21cat19:03:142
29780212410,62sleep30-21swapper/323:53:213
2208921236,56sleep30-21swapper/323:30:363
32456212210,15sleep00-21swapper/020:38:050
146821225,54sleep30-21swapper/322:23:453
452721218,47sleep34607-21tune2fs20:53:053
4148212014,92sleep34267-21latency_hist00:17:463
1311212010,93sleep20-21swapper/220:42:552
7568211770,32sleep37458-21/usr/sbin/munin00:28:043
3191121178,70sleep331993-21mailstats22:18:123
3191121178,70sleep331993-21mailstats22:18:123
28623211520,78sleep128752-21cat23:52:461
28623211520,78sleep128752-21cat23:52:461
1548321130,10sleep00-21swapper/019:43:510
1098421137,63sleep30-21swapper/321:13:113
1098421137,63sleep30-21swapper/321:13:113
7200211117,79sleep07243-21munin-run00:27:440
7200211117,79sleep07243-21munin-run00:27:440
2721721115,52sleep30-21swapper/320:21:533
10261211010,60sleep30-21swapper/322:53:113
1715321097,62sleep30-21swapper/321:33:003
10705210915,21sleep30-21swapper/319:28:173
4065210723,63sleep04111-21systemctl00:17:430
13168210721,63sleep20-21swapper/223:03:072
1500621065,65sleep30-21swapper/321:23:483
1500621065,65sleep30-21swapper/321:23:483
10326210613,76sleep210412-21fw_packets19:28:072
3035121058,66sleep026733-21kworker/0:223:57:450
11887210511,82sleep011401-21/usr/sbin/munin22:58:170
62521048,29sleep326563-1kworker/3:0H00:03:383
3736210465,15sleep30-21swapper/319:08:473
2876221049,78sleep328028-21/usr/sbin/munin22:08:163
940121037,74sleep00-21swapper/000:33:090
8890210318,68sleep18924-21irqstats19:23:061
8890210318,68sleep18924-21irqstats19:23:061
23349210326,66sleep323386-21ps20:08:133
5524210221,38sleep10-21swapper/119:13:011
24690210225,55sleep224096-21/usr/sbin/munin23:38:142
15712210211,15sleep00-21swapper/023:08:460
15712210211,15sleep00-21swapper/023:08:460
19975210112,72sleep020038-21mailstats23:23:150
1729210011,21sleep30-21swapper/300:08:183
16374210019,61sleep116376-21cron19:47:441
59529915,61sleep1491-21/usr/sbin/munin22:23:031
803029815,69sleep08054-21/usr/sbin/munin21:03:110
210522978,13sleep30-21swapper/321:43:183
1744529629,56sleep30-21swapper/323:16:003
65112959,18sleep36597-21grep22:42:463
229042946,12sleep00-21swapper/023:33:080
507429314,66sleep25206-21cat20:53:162
2692829316,60sleep326953-21munin-plugin-st23:47:443
71042919,16sleep30-21swapper/319:17:593
94632900,9sleep20-21swapper/200:33:102
235822898,14sleep30-21swapper/321:53:063
2225328921,26sleep00-21swapper/023:32:430
145272895,18sleep30-21swapper/319:42:013
223232889,14sleep30-21swapper/321:48:143
257628710,61sleep02732-21sed00:12:470
317782865,17sleep30-21swapper/300:01:443
278302866,11sleep30-21swapper/320:23:063
156062866,61sleep00-21swapper/021:28:010
1295528623,31sleep10-21swapper/123:02:581
1253128613,53sleep00-21swapper/021:18:200
3075428514,57sleep030775-21fschecks_count20:33:040
2671528512,16sleep20-21swapper/222:03:062
2492228518,35sleep10-21swapper/121:57:561
182712846,11sleep00-21swapper/021:35:560
1039128413,55sleep110395-21modprobe21:12:441
3273328320,46sleep0318-21wc22:22:450
3273328320,46sleep0318-21wc22:22:450
2985828318,40sleep30-21swapper/320:28:153
2194928318,44sleep222057-21wc20:03:152
196032835,11sleep30-21swapper/319:57:473
1922028313,51sleep019377-21latency_hist23:22:470
56202825,9sleep30-21swapper/300:22:263
446928217,51sleep04484-21grep00:18:040
274172825,11sleep30-21swapper/322:03:193
2659128210,56sleep026650-21fschecks_count22:03:040
124682827,11sleep30-21swapper/321:17:513
3152328119,40sleep231629-21tune2fs22:18:032
3152328119,40sleep231629-21tune2fs22:18:032
157532815,10sleep30-21swapper/323:09:183
157532815,10sleep30-21swapper/323:09:183
1860928021,41sleep218187-21/usr/sbin/munin19:53:102
568627912,53sleep25764-21basename22:38:132
299127929,26sleep10-21swapper/119:07:441
287532790,7sleep20-21swapper/223:52:462
287532790,7sleep20-21swapper/223:52:462
499527812,23sleep00-21swapper/022:37:470
1400227821,36sleep014142-21tail19:38:150
1032227825,26sleep20-21swapper/222:53:142
2621227717,46sleep026247-21awk22:02:440
2099827714,46sleep121051-21ls23:28:001
2611727615,45sleep226219-21cut20:18:052
2364127617,15sleep00-21swapper/021:53:070
3233127515,38sleep032124-21/usr/sbin/munin00:03:060
2938527519,24sleep20-21swapper/222:12:472
2228327527,26sleep20-21swapper/221:48:132
118432758,14sleep20-21swapper/222:58:152
825327421,28sleep00-21swapper/000:28:170
322927425,28sleep00-21swapper/019:07:470
1602127419,40sleep216050-21idleruntime-cro23:12:442
1602127419,40sleep216050-21idleruntime-cro23:12:442
2659627312,16sleep00-21swapper/020:18:150
675227212,46sleep16753-21cpu22:43:001
2142727212,45sleep221472-21grep23:28:342
2084827213,45sleep120917-21switchtime21:43:151
7982719,13sleep20-21swapper/222:23:082
759027126,25sleep20-21swapper/219:18:152
2313527115,27sleep00-21swapper/021:52:470
527827010,16sleep00-21swapper/019:12:520
252927018,37sleep22550-21awk22:28:122
418926916,26sleep10-21swapper/119:08:571
2181726919,33sleep021878-21grep20:03:130
1194926921,22sleep10-21swapper/121:17:451
1194926921,22sleep10-21swapper/121:17:451
28832686,13sleep20-21swapper/220:48:002
2021526810,14sleep20-21swapper/219:58:112
100442688,18sleep00-21swapper/021:08:190
955426721,23sleep00-21swapper/022:52:440
446626717,23sleep00-21swapper/020:53:020
257342677,14sleep20-21swapper/221:58:182
2570426721,29sleep20-21swapper/220:17:442
2460526719,22sleep10-21swapper/123:38:131
1201426714,37sleep212092-21cmp21:17:462
1201426714,37sleep212092-21cmp21:17:462
719126617,20sleep00-21swapper/019:18:040
645926619,26sleep10-21swapper/122:42:441
2813126616,34sleep128028-21/usr/sbin/munin22:08:011
2766826621,25sleep10-21swapper/120:23:041
2754826615,34sleep00-21swapper/020:22:550
2274926621,25sleep10-21swapper/123:33:051
2158526615,23sleep00-21swapper/021:47:460
960526519,20sleep20-21swapper/222:52:462
796826511,38sleep18037-21mailstats00:28:141
332026511,13sleep00-21swapper/020:48:100
136062657,49sleep20-21swapper/221:20:402
1011926516,23sleep00-21swapper/022:53:080
555826411,41sleep2364-21snmpd00:21:372
353026416,30sleep00-21swapper/019:07:550
34926417,22sleep10-21swapper/120:38:141
2422426418,20sleep10-21swapper/120:12:471
219126418,23sleep30-21swapper/319:03:103
199026417,22sleep10-21swapper/120:43:141
1952926412,34sleep119533-21diskstats23:23:041
1382726413,38sleep213919-21mailstats19:38:132
82512637,13sleep10-21swapper/119:21:161
602426315,25sleep20-21swapper/200:23:062
602426315,25sleep20-21swapper/200:23:062
3119626318,21sleep20-21swapper/223:58:162
2188026315,26sleep10-21swapper/120:03:141
122026322,22sleep10-21swapper/100:08:001
1089126312,36sleep010941-21/usr/sbin/munin21:13:080
1089126312,36sleep010941-21/usr/sbin/munin21:13:080
98292627,12sleep00-21swapper/019:26:400
98292627,12sleep00-21swapper/019:26:400
601726214,28sleep26011-21apt-get20:58:002
269552627,12sleep10-21swapper/120:18:321
2489826216,29sleep024918-21/usr/sbin/munin20:13:140
2345826217,31sleep123510-21cut21:53:041
1441926221,20sleep20-21swapper/221:23:112
1441926221,20sleep20-21swapper/221:23:112
124726212,20sleep20-21swapper/200:08:052
683426113,35sleep06839-21entropy22:43:030
377026113,28sleep13833-21/usr/sbin/munin22:33:041
317552618,40sleep20-21swapper/220:35:322
2865926117,23sleep20-21swapper/220:25:312
2620026110,23sleep00-21swapper/023:43:130
1942326118,27sleep219441-21/usr/sbin/munin23:22:572
1867726116,18sleep10-21swapper/119:53:131
1602126115,28sleep216057-21ntp_states21:28:112
1180326116,25sleep10-21swapper/122:58:141
814226020,22sleep20-21swapper/221:03:132
77812607,11sleep20-21swapper/222:44:512
2946526017,27sleep229471-21ntp_states23:53:162
293872606,13sleep20-21swapper/220:28:062
268626013,30sleep12820-21sort22:28:151
2593526017,25sleep125976-21ls23:43:061
1691526013,22sleep10-21swapper/121:32:461
583625914,21sleep00-21swapper/022:38:150
317225916,27sleep13212-21ntp_kernel_pll_00:13:121
3169925916,25sleep131792-21memory22:18:061
3169925916,25sleep131792-21memory22:18:061
3035425916,20sleep20-21swapper/222:13:352
1918625913,28sleep219199-21open_files21:38:122
1201725917,22sleep10-21swapper/119:33:071
1201725917,22sleep10-21swapper/119:33:071
80402588,34sleep28120-21switchtime00:28:152
58625817,24sleep00-21swapper/022:23:020
2852925817,22sleep00-21swapper/023:52:450
2852925817,22sleep00-21swapper/023:52:450
1570625820,21sleep20-21swapper/219:43:582
139652587,39sleep00-21swapper/023:04:180
1254925814,20sleep10-21swapper/121:18:251
1150425815,19sleep00-21swapper/019:32:460
794625714,27sleep17996-21awk21:03:081
3256425716,25sleep132600-21ntp_states00:03:111
3107625714,19sleep00-21swapper/023:58:140
2087825716,24sleep00-21swapper/020:00:310
1899525718,22sleep10-21swapper/121:38:071
1889225719,20sleep00-21swapper/019:53:160
1057525714,24sleep110724-21unixbench_singl22:53:171
1028925725,17sleep10-21swapper/119:28:061
310902566,39sleep00-21swapper/022:17:290
198362566,39sleep00-21swapper/021:40:480
1827225619,15sleep20-21swapper/223:18:082
1519925615,25sleep115222-21ntp_states23:08:151
1519925615,25sleep115222-21ntp_states23:08:151
2980925514,24sleep129330-21apt-get22:12:541
175732554,11sleep20-21swapper/219:48:182
173092556,37sleep00-21swapper/023:14:230
171362559,29sleep00-21swapper/019:48:120
996325417,16sleep20-21swapper/219:27:472
996325417,16sleep20-21swapper/219:27:472
3113525414,25sleep10-21swapper/120:33:131
2109225414,24sleep121102-21munin-run20:02:461
1700425416,21sleep20-21swapper/223:13:162
40132537,12sleep20-21swapper/200:17:052
58182529,20sleep10-21swapper/120:57:471
913425114,17sleep20-21swapper/221:08:012
3194125115,19sleep10-21swapper/100:02:471
3038025114,21sleep130405-21munin-run20:32:451
2649725112,22sleep126499-21apt-get22:02:571
248062518,23sleep124852-21/usr/sbin/munin20:13:111
2419025116,17sleep00-21swapper/020:12:460
1841025112,24sleep218412-21cron21:37:442
1344425111,23sleep113530-21fw_packets19:38:031
943225014,22sleep19462-21/usr/sbin/munin00:33:101
484625021,15sleep10-21swapper/100:18:131
2943225010,22sleep129464-21ntp_states23:53:151
2356325016,14sleep20-21swapper/220:08:162
2182225012,20sleep10-21swapper/121:48:001
356224911,22sleep23548-21apt-get19:08:022
3001524910,20sleep00-21swapper/020:28:160
907824814,16sleep10-21swapper/122:48:171
608824812,21sleep06094-21df_inode20:58:020
551224810,15sleep20-21swapper/219:12:582
1722324818,16sleep10-21swapper/121:33:021
1719424812,17sleep10-21swapper/119:48:131
36942478,15sleep20-21swapper/222:33:002
2337424710,18sleep20-21swapper/221:53:012
202512469,13sleep20-21swapper/221:42:562
644724013,13sleep10-21swapper/120:58:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional