You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-11 - 16:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7s.osadl.org (updated Sat Jul 11, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7202116012,1132sleep3722-21diskstats11:39:153
198182105726,972sleep319627-21latency_hist09:13:583
13357283325,794sleep113393-21ntpq07:09:251
30473269022,652sleep330545-21/usr/sbin/munin11:29:263
1083725748,548sleep010878-21ntpq12:09:200
739723667,347sleep1364-21snmpd08:34:061
739723667,347sleep1364-21snmpd08:34:061
3932322163,138sleep10-21swapper/111:38:571
18416230722,271sleep318419-21df09:09:133
23883229411,265sleep223947-21fw_packets11:09:152
19521229393,185sleep119560-21proc_pri10:54:241
12509228561,208sleep112640-21cmp07:08:571
3026722779,254sleep030308-21systemd-run08:03:560
2219227384,50sleep10-21swapper/109:59:181
14780225913,232sleep214824-21ntpq10:39:202
14780225913,232sleep214824-21ntpq10:39:202
6263225435,199sleep16415-21unixbench_singl11:54:271
31041223125,182sleep131126-21latency_hist09:48:571
8794222974,91sleep10-21swapper/110:19:241
14498221619,30sleep10-21swapper/110:39:141
14498221619,30sleep10-21swapper/110:39:141
12920221440,25sleep10-21swapper/110:34:141
28616221062,22sleep10-21swapper/111:24:161
9365219732,21sleep10-21swapper/108:39:191
9365219732,21sleep10-21swapper/108:39:191
8437219111,166sleep18556-21grep12:03:561
31865218840,18sleep10-21swapper/108:08:581
1307221869,13sleep00-21swapper/010:34:170
26554218520,150sleep126597-21cat11:18:551
2865221839,25sleep10-21swapper/109:39:281
26967218219,22sleep00-21swapper/011:19:140
24133217916,137sleep10-21swapper/107:43:581
15963217923,133sleep10-21swapper/110:44:111
15963217923,133sleep10-21swapper/110:44:111
15039217814,30sleep114917-21kworker/u8:008:58:571
668521758,154sleep16710-21fschecks_count10:14:161
668521758,154sleep16710-21fschecks_count10:14:161
22544217311,22sleep10-21swapper/107:38:571
3259021728,25sleep10-21swapper/109:53:571
24959217211,19sleep10-21swapper/111:13:261
21475217110,149sleep121508-21latency_hist09:18:561
1860021718,151sleep118678-21tr07:24:231
27355216318,129sleep10-21swapper/111:19:231
2607321599,137sleep126109-21basename09:33:551
2762121589,20sleep10-21swapper/109:38:551
10198215732,68sleep110228-21date12:08:571
505321536,51sleep10-21swapper/110:09:111
16662215229,39sleep10-21swapper/112:29:081
1741921498,94sleep10-21swapper/109:04:271
1741921498,94sleep10-21swapper/109:04:271
2841921485,28sleep10-21swapper/107:55:291
1171214891,28sleep10-21swapper/108:14:071
2741214715,95sleep12811-21sort11:44:261
2741214715,95sleep12811-21sort11:44:261
32188214516,26sleep20-21swapper/208:09:152
3105821425,27sleep10-21swapper/111:31:461
1106021429,87sleep10-21swapper/110:28:571
25087214010,115sleep025231-21cat11:13:570
13626214012,110sleep013645-21apt-get08:54:080
485821348,67sleep14932-21mailstats08:24:251
2535621346,27sleep10-21swapper/107:45:561
90621276,34sleep10-21swapper/109:54:261
90621276,34sleep10-21swapper/109:54:261
1876221248,59sleep10-21swapper/112:34:251
1876221248,59sleep10-21swapper/112:34:251
1593421248,52sleep10-21swapper/112:24:281
26336212329,34sleep10-21swapper/107:49:231
21992211710,92sleep122056-21cat09:19:211
32312211613,82sleep032368-21/usr/sbin/munin08:09:170
2899721168,17sleep10-21swapper/107:59:081
12012211517,25sleep312058-21users07:04:273
28421211315,82sleep028471-21cpuspeed11:24:100
24739211314,85sleep224788-21grep07:44:232
1467721139,16sleep10-21swapper/107:14:021
3572211217,63sleep03743-21apt-key11:48:570
3572211217,63sleep03743-21apt-key11:48:570
1966621128,16sleep10-21swapper/107:29:121
1748121125,33sleep10-21swapper/110:49:031
23466211112,76sleep10-21swapper/109:24:171
16196211123,63sleep216219-21latency_hist07:18:552
1944221095,26sleep10-21swapper/109:11:501
6147210868,18sleep10-21swapper/108:29:171
22411210521,57sleep322564-21tail09:19:313
22279210517,75sleep322371-21perl11:04:153
1216521057,66sleep10-21swapper/108:49:121
1216521057,66sleep10-21swapper/108:49:121
1198721057,64sleep111981-21apt-get12:14:101
1894210418,71sleep21899-21modprobe11:43:542
855921010,11sleep20-21swapper/212:03:562
12429210132,47sleep01-21systemd07:08:560
1088021017,31sleep10-21swapper/112:09:211
14021210029,55sleep10-21swapper/108:54:211
39882996,31sleep10-21swapper/111:49:231
39882996,31sleep10-21swapper/111:49:231
1531529918,63sleep315372-21grep08:59:163
321022987,31sleep10-21swapper/108:09:101
3116629621,60sleep231267-21timerandwakeup08:04:262
501129521,48sleep35146-21unixbench_multi08:24:273
3098729528,44sleep331011-21modprobe09:48:543
28082956,29sleep10-21swapper/108:19:121
221892946,29sleep10-21swapper/111:04:091
18032946,28sleep10-21swapper/111:42:441
2773429214,63sleep327883-21latency_hist09:38:573
2246529118,56sleep322503-21modprobe07:38:553
769328914,53sleep00-21swapper/008:34:170
769328914,53sleep00-21swapper/008:34:170
2030128917,47sleep020324-21fschecks_count09:14:470
44612885,28sleep10-21swapper/110:05:031
2302428812,61sleep023093-21/usr/sbin/munin11:04:290
177122885,30sleep10-21swapper/107:22:301
118452888,20sleep111854-21munin-run08:48:561
89972878,18sleep30-21swapper/308:39:093
89972878,18sleep30-21swapper/308:39:093
36128723,34sleep00-21swapper/009:54:080
36128723,34sleep00-21swapper/009:54:080
207212876,13sleep30-21swapper/307:31:243
2070728619,28sleep10-21swapper/110:59:131
99728513,56sleep01007-21/usr/sbin/munin11:39:200
1907428514,50sleep00-21swapper/012:34:280
1907428514,50sleep00-21swapper/012:34:280
1460428518,11sleep10-21swapper/112:20:521
409128420,50sleep24153-21sed08:23:572
2063328422,35sleep220627-21apt-get10:59:102
115072846,47sleep10-21swapper/110:29:171
115072846,47sleep10-21swapper/110:29:171
1967628320,43sleep219817-21dpkg09:13:572
1185528212,54sleep20-21swapper/208:48:572
3122628112,52sleep00-21swapper/011:33:550
2941728122,27sleep30-21swapper/309:43:583
2749428115,51sleep327613-21timerwakeupswit11:19:253
3073328026,29sleep230866-21uptime11:29:292
1755928014,33sleep00-21swapper/007:20:550
1254128020,40sleep212562-21munin-run10:33:552
1254128020,40sleep212562-21munin-run10:33:552
513927921,38sleep25223-21fschecks_time10:09:162
3125327914,50sleep331272-21apt-get09:49:073
1757827921,42sleep217589-21/usr/sbin/munin12:29:292
1043927922,38sleep210433-21apt-get12:09:102
1039327915,47sleep310514-21ls10:24:273
2683927822,30sleep20-21swapper/209:34:242
2096927816,39sleep221098-21sort07:33:572
1293327815,38sleep213022-21sort10:34:152
1019627818,25sleep00-21swapper/010:24:240
2831027715,31sleep20-21swapper/209:39:212
2645727716,46sleep026530-21switchtime07:49:260
227927722,31sleep30-21swapper/311:44:163
227927722,31sleep30-21swapper/311:44:163
146312770,8sleep30-21swapper/310:39:163
146312770,8sleep30-21swapper/310:39:163
1186227729,22sleep20-21swapper/207:04:262
886627615,24sleep00-21swapper/012:04:080
1960327613,39sleep019619-21apt-get09:13:540
1891127619,28sleep30-21swapper/312:34:273
1891127619,28sleep30-21swapper/312:34:273
2111027518,30sleep00-21swapper/010:59:240
1521627511,48sleep015283-21fschecks_time12:24:140
660227411,46sleep20-21swapper/210:14:132
660227411,46sleep20-21swapper/210:14:132
2349727423,29sleep20-21swapper/207:39:272
2501927323,29sleep025159-21sed07:44:300
1990227323,23sleep00-21swapper/007:29:190
194927314,41sleep21923-21/usr/sbin/munin09:59:112
1421927316,17sleep00-21swapper/012:19:260
1136727326,22sleep30-21swapper/310:29:153
1136727326,22sleep30-21swapper/310:29:153
2172427212,46sleep221744-21cpu09:19:142
1582927222,24sleep20-21swapper/208:59:272
97927122,26sleep20-21swapper/209:54:272
97927122,26sleep20-21swapper/209:54:272
2031527122,25sleep30-21swapper/310:58:543
1941727120,36sleep319455-21latency_hist07:28:583
1849727123,30sleep218556-21/usr/sbin/munin12:34:182
1849727123,30sleep218556-21/usr/sbin/munin12:34:182
177762716,17sleep30-21swapper/310:49:183
1217827116,39sleep312238-21/usr/sbin/munin08:49:143
1217827116,39sleep312238-21/usr/sbin/munin08:49:143
1165027120,30sleep00-21swapper/010:29:200
1165027120,30sleep00-21swapper/010:29:200
1069527112,12sleep30-21swapper/308:44:173
30427024,27sleep3333-21munin-run11:38:553
2382527016,24sleep20-21swapper/209:24:272
2071927018,30sleep30-21swapper/310:59:153
1410427015,24sleep30-21swapper/308:54:233
889826919,28sleep20-21swapper/210:19:252
706926911,21sleep00-21swapper/011:59:070
46126913,42sleep3562-21grep09:54:153
46126913,42sleep3562-21grep09:54:153
2972826914,33sleep229845-21latency_hist11:28:572
2817326928,21sleep20-21swapper/207:54:292
626826827,23sleep30-21swapper/310:13:253
2150926817,24sleep20-21swapper/209:18:572
1366326816,35sleep013782-21sed07:09:320
331726721,17sleep00-21swapper/010:03:570
2971926721,26sleep20-21swapper/209:44:092
2612426722,25sleep30-21swapper/309:33:573
836026621,27sleep38376-21apt12:03:543
3103626611,22sleep00-21swapper/008:04:240
281742660,10sleep226302-21kworker/2:011:23:552
192812667,15sleep00-21swapper/007:27:460
1566326619,23sleep00-21swapper/007:14:290
156412669,10sleep00-21swapper/010:43:330
156412669,10sleep00-21swapper/010:43:330
869526519,30sleep30-21swapper/308:38:563
869526519,30sleep30-21swapper/308:38:563
600526519,28sleep20-21swapper/211:54:242
462026518,25sleep20-21swapper/211:49:402
462026518,25sleep20-21swapper/211:49:402
3143126513,24sleep00-21swapper/009:49:160
1623126518,19sleep00-21swapper/010:44:180
1623126518,19sleep00-21swapper/010:44:180
89992647,26sleep00-21swapper/008:39:100
89992647,26sleep00-21swapper/008:39:100
89752647,12sleep30-21swapper/312:04:153
630926418,27sleep06319-21modprobe10:13:540
585026416,28sleep25869-21apt-get08:29:062
419826421,21sleep00-21swapper/011:49:300
419826421,21sleep00-21swapper/011:49:300
2990026416,28sleep029964-21/usr/sbin/munin09:44:310
2868226417,28sleep028723-21sendmail07:58:550
2394826414,21sleep30-21swapper/311:09:163
229052645,48sleep00-21swapper/009:22:590
2118526416,27sleep021206-21apt-get07:34:080
169922646,12sleep30-21swapper/309:04:163
169922646,12sleep30-21swapper/309:04:163
156626418,28sleep21606-21grep08:14:202
579226314,27sleep00-21swapper/011:54:180
2319726311,35sleep023239-21ntp_states07:39:210
1649626316,23sleep30-21swapper/310:44:253
1649626316,23sleep30-21swapper/310:44:253
1209526316,26sleep00-21swapper/008:49:110
1209526316,26sleep00-21swapper/008:49:110
1022926316,30sleep210375-21sed12:08:582
538326213,36sleep0364-21snmpd08:26:170
2644626218,23sleep00-21swapper/009:34:140
1914626214,24sleep00-21swapper/010:54:150
1837526218,24sleep20-21swapper/207:24:162
1724726211,36sleep317294-21switchtime12:29:263
1614426212,20sleep20-21swapper/210:44:162
1614426212,20sleep20-21swapper/210:44:162
1236026212,19sleep20-21swapper/212:14:232
1107826221,19sleep00-21swapper/008:44:270
899626115,27sleep28993-21apt-get08:39:082
899626115,27sleep28993-21apt-get08:39:082
559626112,33sleep35603-21diskstats11:54:133
227942618,12sleep20-21swapper/211:04:262
1735026118,25sleep00-21swapper/009:04:250
1735026118,25sleep00-21swapper/009:04:250
1413726128,17sleep30-21swapper/312:19:253
130452618,44sleep20-21swapper/208:49:502
130452618,44sleep20-21swapper/208:49:502
1283326120,25sleep312830-21apt-get10:34:083
493326015,31sleep25008-21find08:24:262
2718726018,19sleep30-21swapper/307:53:573
1801526017,28sleep218086-21sshd10:49:252
119726016,26sleep01191-21apt-get08:14:100
1031126023,18sleep20-21swapper/210:24:262
779225916,22sleep20-21swapper/208:34:192
779225916,22sleep20-21swapper/208:34:192
387125920,17sleep30-21swapper/310:04:213
250025915,22sleep00-21swapper/009:59:250
2336625914,26sleep00-21swapper/009:24:160
1654425914,26sleep016587-21latency_hist09:03:570
1643825915,23sleep20-21swapper/212:28:572
1337925917,26sleep013525-21sed12:18:570
944425815,16sleep30-21swapper/310:23:543
841925812,23sleep00-21swapper/010:19:150
3151325817,25sleep031509-21apt-get11:34:080
3148925817,23sleep20-21swapper/211:34:062
2521325816,19sleep00-21swapper/009:29:210
1660425818,24sleep216673-21grep07:19:152
344025721,22sleep23464-21munin-run11:48:552
344025721,22sleep23464-21munin-run11:48:552
2574825719,19sleep20-21swapper/211:14:242
1295025713,20sleep30-21swapper/307:09:073
347825614,24sleep23497-21apt-get10:04:072
3224825619,19sleep30-21swapper/308:09:163
2841925615,25sleep328414-21apt-get11:24:093
2802325617,19sleep00-21swapper/009:39:150
275625615,19sleep00-21swapper/008:19:060
1406525619,21sleep20-21swapper/212:19:242
435725513,19sleep30-21swapper/311:49:333
435725513,19sleep30-21swapper/311:49:333
323552558,35sleep20-21swapper/209:51:322
263792557,37sleep30-21swapper/311:16:393
2441725514,25sleep324421-21diskstats07:44:163
201325516,23sleep32023-21df_inode09:59:123
160725516,23sleep31649-21ntp_states08:14:213
2335425415,24sleep323364-21awk09:24:153
145842549,25sleep30-21swapper/307:14:003
1796525311,17sleep00-21swapper/010:49:230
3092325217,19sleep30-21swapper/308:04:193
2908325215,19sleep20-21swapper/207:59:142
2766525212,19sleep30-21swapper/307:54:183
1809625212,25sleep218107-21munin-run09:08:562
1809625212,25sleep218107-21munin-run09:08:562
1736825212,21sleep317421-21users07:19:293
1713325212,24sleep017139-21ntp_states12:29:230
1386925213,23sleep213919-21irqstats08:54:182
322325113,22sleep33234-21ntp_states08:19:223
2548525110,16sleep20-21swapper/209:29:272
2536025116,19sleep00-21swapper/011:14:130
268592504,11sleep20-21swapper/207:50:212
1123225012,20sleep311339-21users12:09:273
298032498,17sleep30-21swapper/307:59:273
1294924912,21sleep212437-21apt-get07:09:062
1253824816,17sleep30-21swapper/312:14:283
667024711,21sleep36676-21df_inode10:14:143
667024711,21sleep36676-21df_inode10:14:143
67322468,19sleep30-21swapper/308:29:273
611324614,14sleep00-21swapper/008:29:160
2278824514,17sleep30-21swapper/307:39:113
212862458,14sleep20-21swapper/207:34:142
1956124510,13sleep20-21swapper/210:54:252
1558224311,15sleep30-21swapper/312:24:213
70292429,17sleep00-21swapper/010:14:230
70292429,17sleep00-21swapper/010:14:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional