You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-01 - 20:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Wed Apr 01, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
292622122998,12228sleep217445-21kworker/u8:109:13:072
126582890011,8857sleep29657-21kworker/2:008:20:242
31060223145,2297sleep027798-21kworker/0:211:01:200
1523227858,765sleep215243-21ntpq11:52:342
32242506143,343sleep23237-21fschecks_count09:32:292
23636242526,344sleep223683-21ntpq07:12:322
1315723608,343sleep1191-21jbd2/mmcblk2p2-11:47:121
247342325142,162sleep224812-21mailstats08:57:442
247342325142,162sleep224812-21mailstats08:57:442
217723240,8sleep10-21swapper/107:47:271
304062316129,56sleep230525-21timerwakeupswit07:32:432
7702307134,27sleep20-21swapper/211:07:282
199082284131,34sleep20-21swapper/208:42:382
199082284131,34sleep20-21swapper/208:42:382
22168226219,219sleep322217-21latency_hist08:52:083
107222600,11sleep30-21swapper/307:42:363
28577225466,168sleep228627-21latency_hist12:37:072
27706224547,175sleep20-21swapper/207:27:092
2719122458,223sleep327199-21ntpq10:47:343
10244224363,92sleep20-21swapper/211:37:282
22063223879,141sleep20-21swapper/210:32:222
16843221516,140sleep216919-21mailstats11:57:352
32110221123,167sleep232259-21tail11:02:392
15990221117,178sleep216036-21ntpq10:12:312
12011221019,121sleep20-21swapper/211:42:332
18215220614,171sleep218251-21wc08:37:332
13749219414,87sleep20-21swapper/210:07:062
21885219013,165sleep221957-21switchtime07:07:392
26044218815,36sleep226077-21latency09:02:292
21045218641,117sleep021007-21latency_hist07:07:080
1657721809,155sleep216612-21ntpq08:32:322
8280217914,150sleep38328-21grep11:32:083
22870217616,130sleep20-21swapper/208:52:352
24195217414,58sleep023685-21apt-get08:57:180
24195217414,58sleep023685-21apt-get08:57:180
4891217016,137sleep24894-21cron11:22:052
4891217016,137sleep24894-21cron11:22:052
17629216614,19sleep20-21swapper/210:17:322
726221657,138sleep00-21swapper/008:02:330
1318921659,14sleep20-21swapper/211:47:212
6858216015,125sleep20-21swapper/208:02:232
12303216013,131sleep112422-21ls11:42:401
25559215811,36sleep20-21swapper/210:42:322
24232215818,64sleep20-21swapper/212:22:252
24232215818,64sleep20-21swapper/212:22:252
1908221518,104sleep20-21swapper/210:22:292
30318214713,120sleep230358-21ps10:57:342
192142147113,19sleep20-21swapper/212:07:072
28042214213,114sleep228139-21date10:52:092
31784214111,113sleep131846-21sendmail_mailst07:37:341
2501021419,16sleep20-21swapper/207:17:282
21229214110,119sleep221273-21ntpq08:47:302
29197214014,72sleep229227-21munin-run07:32:062
29197214014,72sleep229227-21munin-run07:32:062
10098213820,74sleep10-21swapper/111:37:231
2456521375,11sleep20-21swapper/210:37:522
2456521375,11sleep20-21swapper/210:37:522
9116213612,17sleep20-21swapper/209:52:082
13085213511,64sleep221087-21cyclictest08:22:222
5839213238,22sleep20-21swapper/211:22:382
2087421329,90sleep220912-21sed10:27:302
1347213210,86sleep21483-21date09:27:082
3194721288,13sleep00-21swapper/011:02:370
1142421289,63sleep211506-21mailstats09:57:412
3192021277,87sleep213441-21snmpd09:18:282
3192021277,87sleep213441-21snmpd09:18:282
1129921278,64sleep211298-21munin-run08:17:092
29731212421,83sleep329726-21apt-get07:32:233
882221237,36sleep20-21swapper/208:07:322
5307212313,50sleep20-21swapper/207:57:222
471121238,57sleep20-21swapper/209:37:222
21773212218,73sleep00-21swapper/007:07:370
17507211922,79sleep117520-21latency_hist08:37:071
24611211613,87sleep324711-21latency_hist07:17:093
9856211519,76sleep39981-21grep11:37:083
23626211514,36sleep123635-21/usr/sbin/munin07:12:301
9357211029,55sleep09350-21apt-get09:52:220
17001211019,71sleep00-21swapper/011:57:370
2757321079,14sleep20-21swapper/209:07:292
2757321079,14sleep20-21swapper/209:07:292
25454210716,74sleep325503-21wc12:27:073
25454210716,74sleep325503-21wc12:27:073
2108521078,15sleep20-21swapper/212:12:242
346221068,78sleep20-21swapper/207:52:172
346221068,78sleep20-21swapper/207:52:172
30644210516,72sleep130855-21sed09:17:091
26063210211,35sleep20-21swapper/212:27:302
26063210211,35sleep20-21swapper/212:27:302
2566210215,29sleep22688-21wc07:47:372
1404121029,37sleep20-21swapper/210:07:232
1296210211,60sleep00-21swapper/009:27:060
10139210248,38sleep110197-21/usr/sbin/munin08:12:281
287012997,36sleep20-21swapper/210:52:342
20102999,31sleep20-21swapper/209:27:332
718429810,69sleep07234-21if_eth011:27:330
2700229827,30sleep30-21swapper/312:32:073
2700229827,30sleep30-21swapper/312:32:073
2076529815,60sleep20-21swapper/212:12:082
1685529814,59sleep10-21swapper/110:17:071
1316229812,69sleep113171-21/usr/sbin/munin08:22:251
20212977,31sleep20-21swapper/211:12:162
20212977,31sleep20-21swapper/211:12:162
398729614,67sleep04065-21sendmail_mailtr07:52:360
398729614,67sleep04065-21sendmail_mailtr07:52:360
527729418,54sleep35371-21fschecks_time11:22:273
317212946,30sleep20-21swapper/207:37:312
1120029327,46sleep311228-21kernelversion09:57:303
70622926,28sleep20-21swapper/211:27:312
321629219,58sleep13223-21diskstats09:32:281
225662906,27sleep20-21swapper/212:17:132
225662906,27sleep20-21swapper/212:17:132
2109329021,20sleep10-21swapper/107:07:101
15512906,28sleep20-21swapper/207:45:512
1140429015,61sleep311444-21date11:42:093
280262890,9sleep00-21swapper/010:52:060
150022895,28sleep20-21swapper/208:27:312
150022895,28sleep20-21swapper/208:27:312
517328810,62sleep35195-21/usr/sbin/munin09:37:353
277628814,60sleep013441-21snmpd09:31:140
94472878,27sleep20-21swapper/211:32:522
74982877,27sleep20-21swapper/209:46:512
2828328715,53sleep028284-21/usr/sbin/munin10:52:230
3192228627,36sleep332047-21grep07:37:363
103742865,28sleep20-21swapper/209:54:022
1924028515,17sleep30-21swapper/312:07:083
3168128422,35sleep10-21swapper/111:02:301
2862328416,52sleep328783-21awk07:27:393
2862328416,52sleep328783-21awk07:27:393
867728314,50sleep38757-21latency08:07:293
3006328317,44sleep329832-21/usr/sbin/munin10:57:273
2113428310,53sleep00-21swapper/012:12:260
173822839,60sleep017445-21kworker/u8:110:17:180
2289428213,52sleep322956-21/usr/sbin/munin08:52:363
203192816,11sleep00-21swapper/008:44:010
203192816,11sleep00-21swapper/008:44:010
2796828021,37sleep028119-21unixbench_singl12:32:370
1762528020,39sleep117647-21idleruntime-cro12:02:061
84722790,6sleep00-21swapper/009:47:370
2268727923,27sleep30-21swapper/312:17:263
2268727923,27sleep30-21swapper/312:17:263
58327827,29sleep30-21swapper/311:07:253
2648027821,38sleep326502-21fschecks_count07:22:263
2468027820,26sleep00-21swapper/012:22:360
2468027820,26sleep00-21swapper/012:22:360
2459827814,45sleep124122-21/usr/sbin/munin12:22:331
2459827814,45sleep124122-21/usr/sbin/munin12:22:331
751727728,33sleep17545-21munin-run09:47:061
385427728,30sleep30-21swapper/307:52:313
385427728,30sleep30-21swapper/307:52:313
1930327711,29sleep30-21swapper/308:42:223
1930327711,29sleep30-21swapper/308:42:223
876127418,33sleep00-21swapper/008:07:300
676027416,23sleep00-21swapper/009:42:370
552027417,39sleep15573-21interrupts07:57:331
2808027422,32sleep013441-21snmpd09:07:400
2808027422,32sleep013441-21snmpd09:07:400
1954727423,29sleep00-21swapper/012:07:260
1815127420,33sleep318195-21ntp_offset08:37:303
104362746,18sleep10-21swapper/109:54:501
446927319,38sleep00-21swapper/009:37:080
1984727329,22sleep30-21swapper/307:02:283
1872027317,41sleep118804-21latency_hist10:22:081
2782127219,36sleep127882-21/usr/sbin/munin09:07:361
2782127219,36sleep127882-21/usr/sbin/munin09:07:361
196427220,23sleep10-21swapper/109:27:321
90827113,41sleep1953-21ntp_states11:07:311
2301527126,24sleep30-21swapper/310:33:123
2093727113,27sleep10-21swapper/108:47:251
2032227111,45sleep120465-21latency_hist10:27:081
28432700,7sleep30-21swapper/311:12:373
28432700,7sleep30-21swapper/311:12:373
256502709,12sleep10-21swapper/110:42:351
2113027013,39sleep021189-21/usr/sbin/munin08:47:280
2111527022,27sleep00-21swapper/010:27:360
1490727011,39sleep115001-21/usr/sbin/munin08:27:301
1490727011,39sleep115001-21/usr/sbin/munin08:27:301
1135227017,32sleep011378-21modprobe11:42:060
602026919,21sleep00-21swapper/009:42:080
2890126920,22sleep30-21swapper/310:52:393
2181126919,31sleep30-21swapper/310:32:073
860026821,23sleep10-21swapper/109:47:391
2785326813,30sleep30-21swapper/312:32:363
2596426819,27sleep00-21swapper/012:27:280
2596426819,27sleep00-21swapper/012:27:280
194126824,23sleep30-21swapper/307:47:223
1916926822,27sleep319220-21/usr/sbin/munin10:22:303
1866926821,32sleep3294-21rs:main3
1158026821,27sleep00-21swapper/009:57:430
576826717,36sleep35777-21ntpq07:57:403
491726723,21sleep10-21swapper/107:57:091
491726723,21sleep10-21swapper/107:57:091
2632126720,28sleep10-21swapper/112:27:371
2632126720,28sleep10-21swapper/112:27:371
2366626721,29sleep123694-21munin-run08:57:061
699026614,28sleep37068-21/usr/sbin/munin08:02:283
317622667,13sleep00-21swapper/007:37:330
2592426618,21sleep00-21swapper/009:02:260
2573326614,24sleep30-21swapper/310:42:373
2549026625,24sleep10-21swapper/107:17:391
1791426619,24sleep10-21swapper/112:02:221
1585626614,21sleep30-21swapper/310:12:283
1439426616,23sleep30-21swapper/308:27:083
1403926613,35sleep00-21swapper/010:07:210
1327826617,29sleep313335-21fschecks_count11:47:263
1130026615,31sleep30-21swapper/308:17:103
2259826512,21sleep00-21swapper/010:32:370
1359226520,28sleep00-21swapper/008:22:370
1221826528,20sleep00-21swapper/011:42:390
1213726514,32sleep311618-21/usr/sbin/munin11:42:383
537526416,31sleep05431-21if_eth011:22:280
2955726414,31sleep029603-21ntpq09:13:130
2214626415,35sleep122151-21entropy10:32:261
180192648,12sleep00-21swapper/008:37:270
3271926323,18sleep30-21swapper/311:07:083
3220326323,23sleep10-21swapper/109:22:061
3220326323,23sleep10-21swapper/109:22:061
2965926323,18sleep10-21swapper/110:57:091
277822636,45sleep10-21swapper/110:49:261
2131026316,26sleep10-21swapper/107:07:221
1522426319,21sleep30-21swapper/310:11:113
811526218,29sleep18148-21idleruntime-cro08:07:071
372126221,19sleep30-21swapper/311:17:263
372126221,19sleep30-21swapper/311:17:263
3229026214,26sleep00-21swapper/009:22:090
3229026214,26sleep00-21swapper/009:22:090
2954026221,18sleep30-21swapper/309:13:123
2272226214,30sleep00-21swapper/012:17:270
2272226214,30sleep00-21swapper/012:17:270
126832627,43sleep00-21swapper/008:20:430
756826117,20sleep30-21swapper/309:47:083
2586126114,22sleep30-21swapper/309:02:253
2031326114,26sleep120360-21users12:07:391
18582617,14sleep30-21swapper/309:27:293
50726013,17sleep00-21swapper/007:42:260
2742526019,22sleep10-21swapper/112:32:261
2096726019,21sleep10-21swapper/110:27:331
115102602,39sleep30-21swapper/308:17:183
298452590,7sleep00-21swapper/007:32:270
2533625916,24sleep325403-21systemctl07:17:373
212325913,28sleep02176-21/usr/sbin/munin07:47:270
158802596,10sleep10-21swapper/111:55:031
694125813,21sleep10-21swapper/111:27:171
2659125819,23sleep10-21swapper/107:22:281
166722588,38sleep00-21swapper/010:14:480
109282585,16sleep00-21swapper/008:13:280
2718125713,27sleep027295-21users07:22:390
2584625715,18sleep10-21swapper/109:02:231
2300325719,22sleep10-21swapper/112:17:321
2300325719,22sleep10-21swapper/112:17:321
2149825718,16sleep10-21swapper/112:12:351
2061325716,20sleep10-21swapper/108:47:091
2061325716,20sleep10-21swapper/108:47:091
175925720,21sleep00-21swapper/011:12:060
1635625717,24sleep316351-21apt-get11:57:193
1275425717,24sleep112773-21grep10:02:291
1248825714,18sleep30-21swapper/310:02:233
860725616,17sleep10-21swapper/111:32:261
838125618,17sleep30-21swapper/309:47:373
3095125614,25sleep330939-21apt-get09:17:243
3095125614,25sleep330939-21apt-get09:17:243
2518925614,25sleep025183-21apt-get10:42:220
249025613,29sleep12501-21ntp_states11:12:311
249025613,29sleep12501-21ntp_states11:12:311
245742565,15sleep10-21swapper/110:37:591
245742565,15sleep10-21swapper/110:37:591
2131225614,24sleep321304-21apt-get07:07:243
161562567,13sleep00-21swapper/008:32:180
1225025618,17sleep10-21swapper/110:02:081
561325516,22sleep15635-21ntp_states11:22:331
2985725513,24sleep129851-21apt-get10:57:211
2431425510,29sleep024433-21sed10:37:370
2431425510,29sleep024433-21sed10:37:370
1896025511,26sleep018954-21apt-get10:22:230
1791325513,26sleep017907-21apt-get12:02:210
1476825514,25sleep014779-21apt-get11:52:200
133725515,23sleep11346-21munin-run09:27:071
2794125414,24sleep127938-21apt-get07:27:201
2794125414,24sleep127938-21apt-get07:27:201
241962545,13sleep10-21swapper/108:57:191
241962545,13sleep10-21swapper/108:57:191
1775325412,26sleep117747-21apt-get08:37:201
59925319,18sleep10-21swapper/107:42:271
526525314,18sleep10-21swapper/109:37:371
380925313,20sleep00-21swapper/011:17:270
380925313,20sleep00-21swapper/011:17:270
2422325316,20sleep324219-21apt-get08:57:213
2422325316,20sleep324219-21apt-get08:57:213
2240825312,23sleep022403-21apt-get08:52:210
1153425313,23sleep111529-21apt-get08:17:201
943625215,23sleep39441-21diskstats09:52:253
538025213,22sleep00-21swapper/007:57:240
2794525213,22sleep028012-21df07:27:240
2794525213,22sleep028012-21df07:27:240
245512526,12sleep30-21swapper/310:37:403
245512526,12sleep30-21swapper/310:37:403
2128625211,27sleep321377-21load12:12:293
171672527,13sleep30-21swapper/308:33:383
1611325214,18sleep30-21swapper/311:57:073
927625111,14sleep10-21swapper/108:07:391
2292825111,18sleep00-21swapper/007:12:130
204725111,23sleep02043-21apt-get11:12:180
204725111,23sleep02043-21apt-get11:12:180
2005325113,21sleep220092-21memory07:02:312
147102517,17sleep00-21swapper/008:27:250
147102517,17sleep00-21swapper/008:27:250
1299425112,16sleep00-21swapper/010:02:360
877925016,18sleep00-21swapper/011:32:290
71725014,15sleep30-21swapper/309:22:373
453525011,19sleep10-21swapper/111:17:401
453525011,19sleep10-21swapper/111:17:401
314024912,22sleep33207-21df09:32:263
2540524911,22sleep00-21swapper/007:17:380
1468024911,19sleep30-21swapper/308:27:243
1468024911,19sleep30-21swapper/308:27:243
1333824811,18sleep00-21swapper/011:47:270
1991224710,21sleep319918-21ntp_states12:07:333
1449624712,19sleep114502-21ntp_states10:07:341
2969824612,13sleep10-21swapper/107:32:171
2731124610,17sleep30-21swapper/309:07:183
2731124610,17sleep30-21swapper/309:07:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional