You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-01 - 21:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Tue Sep 01, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
313622102511,999sleep329688-21kworker/3:007:56:043
24043250332,453sleep24319-21kworker/u8:010:59:002
8058237218,340sleep38061-21/usr/sbin/munin10:09:043
5673234112,306sleep15706-21latency_hist08:18:471
5937230631,72sleep20-21swapper/211:44:052
689822677,246sleep06906-21ntpq10:04:210
2249722627,240sleep222555-21sed10:54:082
1777223122,189sleep11814-21grep09:49:081
1777223122,189sleep11814-21grep09:49:081
32115223015,41sleep215429-21cyclictest09:43:442
32115223015,41sleep215429-21cyclictest09:43:442
101962229166,20sleep20-21swapper/210:14:162
11852222537,85sleep212005-21latency_hist12:03:462
227882218177,16sleep20-21swapper/207:29:152
8729221715,57sleep2231-21systemd-journal08:28:452
8729221715,57sleep2231-21systemd-journal08:28:452
13913221548,56sleep20-21swapper/210:28:452
32720220819,168sleep2396-21timerwakeupswit11:24:152
17091220449,68sleep217271-21users07:13:492
18315219746,50sleep218432-21grep07:14:182
30580219068,23sleep20-21swapper/207:54:062
1915821828,158sleep219200-21latency10:44:062
1915821828,158sleep219200-21latency10:44:062
20442217311,143sleep220521-21awk09:04:172
16985217226,110sleep20-21swapper/212:19:042
13047216611,143sleep1367-21snmpd12:04:581
3213216416,58sleep20-21swapper/211:34:162
2193021619,137sleep222020-21grep12:34:142
15010216149,52sleep20-21swapper/208:48:472
219842157110,32sleep222047-21mailstats09:09:132
16890215320,113sleep316951-21fschecks_time08:54:043
1594214753,22sleep20-21swapper/209:49:052
1594214753,22sleep20-21swapper/209:49:052
17074214131,89sleep20-21swapper/208:54:082
5936214044,25sleep20-21swapper/210:03:462
19293213918,95sleep20-21swapper/207:19:062
19293213918,95sleep20-21swapper/207:19:062
2940921378,91sleep229474-21processes11:14:142
2940921378,91sleep229474-21processes11:14:142
2595821379,105sleep20-21swapper/207:39:242
2595821379,105sleep20-21swapper/207:39:242
16454213743,44sleep216457-21cron12:18:442
2013213411,107sleep02085-21mailstats09:49:150
2013213411,107sleep02085-21mailstats09:49:150
11592213112,17sleep20-21swapper/210:19:122
2773021308,20sleep30-21swapper/309:29:003
2773021308,20sleep30-21swapper/309:29:003
1927921307,106sleep019286-21df_inode07:19:040
1927921307,106sleep019286-21df_inode07:19:040
29228212911,16sleep20-21swapper/207:49:132
29228212911,16sleep20-21swapper/207:49:132
9275212716,93sleep19313-21sed10:13:461
20955212732,84sleep220969-21grep10:49:192
28296212628,76sleep20-21swapper/209:29:152
28296212628,76sleep20-21swapper/209:29:152
1574212548,25sleep20-21swapper/211:29:112
1320121256,18sleep20-21swapper/208:41:082
1320121256,18sleep20-21swapper/208:41:082
16427212427,76sleep20-21swapper/210:34:222
3099221238,103sleep231021-21proc_pri11:19:142
18860212135,42sleep30-21swapper/310:43:553
18860212135,42sleep30-21swapper/310:43:553
1844921219,56sleep20-21swapper/212:24:052
12084212027,82sleep212075-21apt-get12:04:032
4096211814,52sleep24210-21latency_hist08:13:472
3042521175,12sleep20-21swapper/209:37:182
3042521175,12sleep20-21swapper/209:37:182
18881211724,79sleep218956-21mailstats08:59:122
6380211625,49sleep20-21swapper/208:19:122
27033211510,91sleep227178-21modprobe07:43:482
27033211510,91sleep227178-21modprobe07:43:482
25110211516,81sleep025142-21sh07:38:460
25110211516,81sleep025142-21sh07:38:460
583211311,88sleep2708-21ls09:44:172
1119521128,53sleep20-21swapper/208:34:182
1119521128,53sleep20-21swapper/208:34:182
4882211110,53sleep20-21swapper/211:39:162
27391210927,22sleep20-21swapper/211:09:012
20589210910,20sleep20-21swapper/212:29:172
2396621085,54sleep20-21swapper/209:14:222
22695210814,82sleep022741-21processes10:54:140
1515121085,54sleep20-21swapper/210:29:462
27303210719,65sleep327343-21fschecks_count07:44:063
27303210719,65sleep327343-21fschecks_count07:44:063
18885210717,65sleep118938-21sendmail07:18:451
9314210651,18sleep20-21swapper/210:13:472
3096210617,75sleep13127-21nfs_client11:34:111
1984221066,92sleep028659-21kworker/u8:212:28:510
1235210619,52sleep20-21swapper/208:03:592
852421047,66sleep20-21swapper/211:52:042
4046210416,74sleep0231-21systemd-journal08:13:450
996721025,55sleep20-21swapper/211:55:392
32653210118,27sleep20-21swapper/207:59:262
25809210131,59sleep225813-21modprobe11:03:572
1854210115,25sleep00-21swapper/011:29:170
32538210012,70sleep332561-21/usr/sbin/munin11:24:123
26810210012,74sleep00-21swapper/007:42:170
26810210012,74sleep00-21swapper/007:42:170
211532987,42sleep221200-21ntpq07:24:102
211532987,42sleep221200-21ntpq07:24:102
612229722,60sleep16174-21latency11:44:081
91052956,74sleep29192-21fschecks_time08:29:052
91052956,74sleep29192-21fschecks_time08:29:052
1699229523,51sleep117090-21munin-node07:13:481
326129419,51sleep20-21swapper/209:54:052
2405629328,39sleep324058-21apt-get10:59:093
223002938,67sleep00-21swapper/007:29:010
2202229315,64sleep322090-21cat12:34:153
2067929223,36sleep00-21swapper/010:49:010
1387929212,66sleep013942-21if_err_eth008:44:050
1110429229,38sleep311100-21apt-get10:18:573
2313629124,42sleep123224-21fschecks_time09:14:041
2147429124,30sleep10-21swapper/109:08:561
2679828913,60sleep026923-21timerandwakeup09:24:170
1832628919,41sleep118317-21apt-get12:23:591
1208528911,65sleep312086-21apt-get12:04:043
482328839,24sleep20-21swapper/208:14:162
2046128814,56sleep10-21swapper/107:23:451
2046128814,56sleep10-21swapper/107:23:451
1377028615,54sleep113779-21/usr/sbin/munin08:44:011
3245528513,55sleep032505-21awk11:24:090
2291028519,38sleep323052-21grep10:54:173
69462848,62sleep27037-21mailstats10:04:232
3231528412,52sleep132348-21irqstats11:24:061
3085728414,56sleep130897-21cpu09:38:591
3085728414,56sleep130897-21cpu09:38:591
3020528425,39sleep030224-21apt11:18:440
3020528425,39sleep030224-21apt11:18:440
136312849,16sleep20-21swapper/212:08:592
136312849,16sleep20-21swapper/212:08:592
1027728317,48sleep110279-21cron08:33:441
1027728317,48sleep110279-21cron08:33:441
1672528210,57sleep316726-21sshd10:34:593
903328113,47sleep08922-21/usr/sbin/munin11:54:040
320962818,54sleep00-21swapper/007:58:520
1062028121,40sleep010712-21fschecks_time11:59:040
961728016,42sleep39706-21fschecks_time10:14:043
272792805,41sleep20-21swapper/209:26:412
2064428014,29sleep30-21swapper/310:48:563
185792805,42sleep20-21swapper/210:43:342
1647428018,12sleep20-21swapper/208:53:152
196927915,45sleep32010-21grep09:49:143
196927915,45sleep32010-21grep09:49:143
2962427821,36sleep129767-21unixbench_multi11:14:171
2962427821,36sleep129767-21unixbench_multi11:14:171
2672727816,41sleep326791-21sshd09:24:163
1468827825,32sleep10-21swapper/107:05:001
254932779,13sleep20-21swapper/209:19:182
250452775,41sleep20-21swapper/207:37:592
250452775,41sleep20-21swapper/207:37:592
224932774,11sleep00-21swapper/009:10:200
2872227611,48sleep00-21swapper/011:13:470
2602927615,23sleep10-21swapper/111:04:081
2364927617,42sleep123841-21latency_hist10:58:471
210932769,53sleep121136-21ntp_offset10:49:221
2061827624,29sleep00-21swapper/009:04:190
1475827621,22sleep20-21swapper/207:05:022
949427513,25sleep30-21swapper/308:29:143
949427513,25sleep30-21swapper/308:29:143
2239827511,50sleep00-21swapper/012:35:040
1742927518,29sleep10-21swapper/110:39:051
878227416,28sleep10-21swapper/108:28:481
878227416,28sleep10-21swapper/108:28:481
3106427319,21sleep30-21swapper/309:39:053
3106427319,21sleep30-21swapper/309:39:053
2901227318,26sleep30-21swapper/311:14:033
2901227318,26sleep30-21swapper/311:14:033
1686127317,26sleep00-21swapper/012:19:020
638927218,27sleep30-21swapper/308:19:133
3220727213,26sleep30-21swapper/307:59:033
2002527223,28sleep30-21swapper/309:04:063
161242725,56sleep00-21swapper/012:14:340
60072710,6sleep30-21swapper/311:44:053
3213227112,13sleep10-21swapper/107:59:011
2033627121,33sleep120370-21/usr/sbin/munin09:04:121
1935927114,36sleep018861-21/usr/sbin/munin10:44:130
1935927114,36sleep018861-21/usr/sbin/munin10:44:130
1119227124,31sleep00-21swapper/010:19:020
2024927015,36sleep320283-21/usr/sbin/munin12:29:103
58542695,52sleep30-21swapper/310:03:153
2576226913,39sleep125771-21/usr/sbin/munin07:39:191
2576226913,39sleep125771-21/usr/sbin/munin07:39:191
2406626918,23sleep00-21swapper/010:59:140
2135426935,17sleep30-21swapper/307:24:163
2135426935,17sleep30-21swapper/307:24:163
2083526911,41sleep020890-21fschecks_count07:24:040
2083526911,41sleep020890-21fschecks_count07:24:040
1106626912,15sleep00-21swapper/008:34:160
1106626912,15sleep00-21swapper/008:34:160
64402685,12sleep10-21swapper/110:04:101
2331926818,34sleep023357-21latency09:14:080
1884126712,40sleep118878-21ps08:59:111
1736526713,28sleep00-21swapper/007:13:510
688126619,22sleep30-21swapper/310:04:203
499326618,31sleep15002-21/usr/sbin/munin09:59:091
442826624,20sleep00-21swapper/011:39:060
438826613,16sleep30-21swapper/311:39:053
3250226620,29sleep332598-21grep09:44:053
303242666,11sleep00-21swapper/009:35:590
303242666,11sleep00-21swapper/009:35:590
2770226612,37sleep127786-21mailstats07:44:161
2770226612,37sleep127786-21mailstats07:44:161
2517826622,23sleep10-21swapper/107:38:471
2517826622,23sleep10-21swapper/107:38:471
3125526511,43sleep00-21swapper/007:54:400
3080326516,32sleep130895-21/usr/sbin/munin11:19:091
1693026515,33sleep116984-21fw_packets12:19:031
1408526517,24sleep30-21swapper/307:04:023
47172647,13sleep00-21swapper/009:59:040
461026412,37sleep04704-21/usr/sbin/munin08:14:100
313926416,21sleep00-21swapper/009:54:030
3007426425,22sleep30-21swapper/307:53:463
3007426425,22sleep30-21swapper/307:53:463
300132648,11sleep00-21swapper/007:53:350
300132648,11sleep00-21swapper/007:53:350
2325926415,30sleep30-21swapper/309:14:073
1460526416,33sleep30-21swapper/310:29:103
952426321,28sleep39570-21cat11:54:153
2543126317,18sleep30-21swapper/307:38:493
2543126317,18sleep30-21swapper/307:38:493
1806726315,29sleep018143-21systemd-run08:58:460
1415626320,23sleep30-21swapper/308:44:123
83402627,12sleep00-21swapper/010:09:090
23512627,10sleep00-21swapper/008:06:550
1963426223,18sleep30-21swapper/312:28:463
1495426220,16sleep10-21swapper/112:13:461
1495426220,16sleep10-21swapper/112:13:461
1204126214,33sleep112042-21sshd10:19:351
86432616,15sleep00-21swapper/011:53:350
2715026115,28sleep00-21swapper/011:08:470
1552826117,23sleep00-21swapper/008:49:090
1539626117,22sleep00-21swapper/007:08:470
1396726114,20sleep10-21swapper/110:28:481
12752619,37sleep10-21swapper/111:29:061
1251726116,28sleep112546-21/usr/sbin/munin08:39:091
1251726116,28sleep112546-21/usr/sbin/munin08:39:091
1190826115,20sleep30-21swapper/308:38:473
1190826115,20sleep30-21swapper/308:38:473
1113826112,20sleep30-21swapper/311:59:153
95742609,32sleep00-21swapper/010:14:010
2852826016,31sleep028657-21latency_hist07:48:470
2852826016,31sleep028657-21latency_hist07:48:470
163452607,41sleep10-21swapper/112:17:171
1527926014,22sleep30-21swapper/312:14:053
1212226012,32sleep012139-21/usr/sbin/munin08:38:560
1212226012,32sleep012139-21/usr/sbin/munin08:38:560
297382597,37sleep10-21swapper/107:50:051
297382597,37sleep10-21swapper/107:50:051
2618525920,20sleep10-21swapper/109:24:011
2463725916,26sleep024631-21apt-get09:19:000
1794825914,21sleep00-21swapper/010:39:160
148662598,42sleep00-21swapper/012:13:250
148662598,42sleep00-21swapper/012:13:250
1466125913,27sleep114667-21ntp_states10:29:121
1020525915,19sleep10-21swapper/111:58:451
2239825813,32sleep122491-21fschecks_time07:29:061
1905525813,28sleep019181-21unixbench_multi08:59:140
1896525814,16sleep30-21swapper/307:18:473
1634325816,17sleep10-21swapper/110:34:211
753925715,26sleep07548-21df_inode08:24:030
753925715,26sleep07548-21df_inode08:24:030
3157325713,29sleep131608-21munin-run07:58:451
3062325717,18sleep10-21swapper/109:38:471
3062325717,18sleep10-21swapper/109:38:471
2928225716,24sleep329277-21apt-get09:34:003
2928225716,24sleep329277-21apt-get09:34:003
172325714,23sleep10-21swapper/108:04:141
1594225714,18sleep10-21swapper/108:49:181
126925712,20sleep00-21swapper/009:48:470
118025714,25sleep10-21swapper/109:48:191
101572576,41sleep00-21swapper/008:32:140
101572576,41sleep00-21swapper/008:32:140
592525614,25sleep05931-21df_inode11:44:030
269725612,19sleep30-21swapper/311:33:573
2504025614,19sleep30-21swapper/309:19:113
2285325614,23sleep30-21swapper/307:29:163
2142125619,22sleep121489-21cpuspeed12:34:001
2054125617,18sleep30-21swapper/307:23:473
2054125617,18sleep30-21swapper/307:23:473
1701625611,31sleep117073-21irqstats08:54:071
1312525617,19sleep00-21swapper/010:24:150
811225519,17sleep10-21swapper/111:49:161
342125516,17sleep10-21swapper/109:54:091
2738125513,25sleep327383-21apt-get11:08:583
272525513,26sleep02718-21apt-get11:34:020
2463825511,18sleep10-21swapper/109:19:011
2089125518,17sleep10-21swapper/107:24:051
2089125518,17sleep10-21swapper/107:24:051
1064525513,25sleep110654-21diskstats08:34:051
1064525513,25sleep110654-21diskstats08:34:051
561225415,17sleep10-21swapper/111:43:471
2648425414,24sleep326568-21sed11:04:183
1333825415,17sleep30-21swapper/310:24:183
783825312,16sleep30-21swapper/308:24:103
783825312,16sleep30-21swapper/308:24:103
592025312,24sleep15915-21apt-get08:18:591
2821625316,21sleep10-21swapper/109:29:141
2821625316,21sleep10-21swapper/109:29:141
254825313,17sleep30-21swapper/308:08:483
2018825315,17sleep10-21swapper/110:48:461
2018825315,17sleep10-21swapper/110:48:461
1735025314,16sleep30-21swapper/312:19:133
1428825312,23sleep014292-21diskstats10:29:030
117325316,22sleep31168-21apt-get11:29:003
2849725213,17sleep00-21swapper/009:29:170
2849725213,17sleep00-21swapper/009:29:170
2782425213,24sleep127847-21ntp_states11:09:121
305225111,23sleep33048-21apt-get09:53:583
2551525114,19sleep10-21swapper/111:03:471
2149725112,22sleep321493-21apt-get09:08:583
1987625114,21sleep10-21swapper/112:29:001
1741625114,23sleep317422-21df_inode10:39:033
1086925113,19sleep10-21swapper/110:18:471
3141125015,17sleep00-21swapper/009:39:140
3141125015,17sleep00-21swapper/009:39:140
278425012,21sleep12779-21apt-get08:08:581
1692925011,23sleep316976-21systemd-run07:13:463
1594225013,21sleep015944-21irqstats07:09:070
1488925013,23sleep314921-21munin-run12:13:443
1488925013,23sleep314921-21munin-run12:13:443
1208825011,19sleep00-21swapper/012:04:050
717724911,26sleep0367-21snmpd08:23:420
1881624914,17sleep30-21swapper/308:59:093
76132487,16sleep30-21swapper/311:49:063
28732488,14sleep30-21swapper/308:09:043
1183124815,15sleep10-21swapper/112:03:451
1840524712,21sleep018412-21diskstats12:24:030
3074024613,14sleep30-21swapper/311:19:073
3050124615,15sleep00-21swapper/011:18:560
2384724612,18sleep30-21swapper/307:34:003
2384724612,18sleep30-21swapper/307:34:003
1694624611,20sleep0367-21snmpd10:37:510
164212445,29sleep30-21swapper/308:52:353
433324010,16sleep30-21swapper/308:14:013
1222724010,16sleep30-21swapper/308:39:033
1222724010,16sleep30-21swapper/308:39:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional