You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 01:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Tue Jan 06, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10604257125,531sleep010640-21ntpq07:10:240
1532724048,342sleep015412-21timerandwakeup10:50:290
25487239619,359sleep225500-21/usr/sbin/munin09:40:222
11190235755,255sleep00-21swapper/012:20:290
21508232811,304sleep118875-21kworker/1:009:27:171
19632232517,292sleep219649-21cron07:39:582
19632232517,292sleep219649-21cron07:39:582
2187823087,286sleep221921-21ntpq07:45:232
3645230345,246sleep03272-21/usr/sbin/munin08:31:120
6518228129,50sleep00-21swapper/010:25:010
577922760,6sleep30-21swapper/310:20:273
19620224522,213sleep0366-21snmpd07:39:470
19620224522,213sleep0366-21snmpd07:39:470
10101224110,220sleep319609-1kworker/3:1H10:35:543
55112240124,52sleep00-21swapper/010:20:210
783322298,208sleep07875-21awk12:10:230
783322298,208sleep07875-21awk12:10:230
20666222810,204sleep020728-21apt-config11:09:580
25858222227,182sleep025928-21systemd07:59:580
19060221718,176sleep319216-21unixbench_multi07:35:313
19060221718,176sleep319216-21unixbench_multi07:35:313
23926221622,177sleep00-21swapper/009:35:230
1448122129,16sleep00-21swapper/010:50:000
1440022089,71sleep00-21swapper/009:05:190
9075219521,161sleep19183-21tune2fs12:15:171
16958218918,155sleep317115-21awk10:55:323
12177218411,113sleep012252-21switchtime10:40:280
18400218315,151sleep218467-21switchtime11:00:282
18400218315,151sleep218467-21switchtime11:00:282
591021767,48sleep00-21swapper/008:37:210
17933217145,112sleep018022-21fschecks_time11:00:170
17933217145,112sleep018022-21fschecks_time11:00:170
8337217034,95sleep08427-21fschecks_time10:30:180
8337217034,95sleep08427-21fschecks_time10:30:180
13671216917,63sleep00-21swapper/012:30:140
27989216338,107sleep00-21swapper/009:50:010
12338216140,80sleep012384-21systemctl08:59:580
549215921,121sleep3628-21fschecks_time10:05:183
25201215911,134sleep325278-21find07:55:293
12583215215,82sleep00-21swapper/012:25:250
27135215051,56sleep027159-21munin-plugin-st11:29:570
27135215051,56sleep027159-21munin-plugin-st11:29:570
22512214944,61sleep00-21swapper/009:30:270
630214845,55sleep00-21swapper/010:05:190
31862214711,78sleep00-21swapper/011:44:590
16228214611,121sleep016372-21sed12:35:510
10748214565,19sleep00-21swapper/010:36:160
1994921439,81sleep019973-21grep07:40:120
19526214312,116sleep019656-21timerwakeupswit09:20:290
19494214323,94sleep219587-21fschecks_time11:05:162
61421429,119sleep0736-21wc08:20:300
4167214145,18sleep00-21swapper/010:15:280
11617214118,31sleep30-21swapper/310:40:103
9524213914,55sleep00-21swapper/008:50:130
30041213849,30sleep00-21swapper/009:55:220
8010213128,34sleep30-21swapper/310:30:013
2119212759,49sleep00-21swapper/008:25:310
21498212455,16sleep00-21swapper/007:45:130
28000212117,89sleep128075-21cat08:05:211
23319212017,51sleep00-21swapper/007:50:220
977321194,104sleep00-21swapper/007:08:380
9186211910,95sleep29223-21if_err_eth012:15:182
308821146,41sleep00-21swapper/010:12:340
28685211352,43sleep00-21swapper/011:34:580
28685211352,43sleep00-21swapper/011:34:580
31626211015,81sleep331696-21cat10:00:213
31626211015,81sleep331696-21cat10:00:213
19164210922,27sleep30-21swapper/311:05:013
19164210922,27sleep30-21swapper/311:05:013
2915321088,47sleep029193-21basename11:35:180
8978210751,14sleep00-21swapper/012:15:120
6478210718,71sleep26561-21/usr/sbin/munin12:05:292
1702321076,10sleep00-21swapper/009:14:480
11565210717,76sleep111631-21awk08:55:271
29698210639,17sleep00-21swapper/008:10:240
20545210611,82sleep020568-21cut09:25:180
27960210514,73sleep228031-21sensors_temp11:30:282
27960210514,73sleep228031-21sensors_temp11:30:282
17827210517,21sleep30-21swapper/309:15:283
6070210310,73sleep00-21swapper/012:05:190
32072210328,64sleep032092-21dpkg11:45:070
22091210316,71sleep222127-21fschecks_count09:30:172
419210210,77sleep1453-21/usr/sbin/munin08:20:271
14905210211,14sleep10-21swapper/112:34:391
3224729914,65sleep132261-21/usr/sbin/munin10:00:321
3224729914,65sleep132261-21/usr/sbin/munin10:00:321
3144429933,22sleep00-21swapper/010:00:180
3144429933,22sleep00-21swapper/010:00:180
1761129918,67sleep117693-21/usr/sbin/munin09:15:221
1787629844,44sleep00-21swapper/007:32:170
872029720,58sleep28871-21head08:45:312
160329626,48sleep11644-21fschecks_count08:25:191
321929529,46sleep33280-21processes11:55:283
2827029526,51sleep00-21swapper/008:05:280
2617229535,16sleep00-21swapper/008:00:110
2349529526,46sleep123634-21grep11:15:291
315629441,18sleep03202-21ntpq11:55:250
77402938,72sleep07858-21date08:45:000
708729318,61sleep37217-21sed08:40:313
1183329323,49sleep111849-21idleruntime-cro12:24:581
2031929115,60sleep119924-21/usr/sbin/munin07:40:211
2915029018,39sleep00-21swapper/009:50:370
1047029017,60sleep110483-21grep10:36:091
639528915,59sleep16476-21mailstats12:05:281
461628919,50sleep24724-21latency_hist08:35:012
3031428915,51sleep130440-21latency_hist11:40:001
512328821,44sleep15160-21latency08:35:211
3209428815,57sleep132143-21sendmail08:19:581
3122028819,38sleep20-21swapper/208:15:232
1703528823,49sleep217062-21munin-plugin-st09:14:582
1413828817,58sleep014182-21ntpq07:20:250
870228714,56sleep28764-21/usr/sbin/munin07:05:182
3002128718,46sleep230166-21sed08:10:312
1759328713,56sleep00-21swapper/009:15:210
123822870,7sleep20-21swapper/210:40:292
120228730,43sleep09987-21cyclictest11:50:120
1189728617,55sleep111986-21/usr/sbin/munin10:40:201
3217328527,32sleep30-21swapper/308:20:003
280792850,6sleep10-21swapper/109:50:011
2374728523,40sleep223901-21unixbench_multi07:50:322
751728416,51sleep27551-21fschecks_count12:10:172
751728416,51sleep27551-21fschecks_count12:10:172
1201428311,55sleep212059-21ntp_states07:15:062
1201428311,55sleep212059-21ntp_states07:15:062
1509028213,52sleep215123-21/usr/sbin/munin10:50:222
1266528210,59sleep312742-21mailstats07:15:283
1266528210,59sleep312742-21mailstats07:15:283
2408528126,38sleep00-21swapper/011:20:000
1314328119,12sleep00-21swapper/007:16:380
1314328119,12sleep00-21swapper/007:16:380
598028013,50sleep36068-21fschecks_time12:05:173
43272808,61sleep04379-21sort12:00:140
1641928019,11sleep00-21swapper/010:55:210
1492828015,47sleep314968-21http12:34:573
1112028012,52sleep311188-21awk12:20:283
2206227929,29sleep30-21swapper/307:45:283
1274027924,32sleep20-21swapper/209:00:172
1249127927,28sleep10-21swapper/112:25:221
974427817,45sleep39746-21sshd07:08:173
452827814,49sleep14569-21/usr/sbin/munin12:00:191
1813627816,20sleep20-21swapper/207:35:012
1305227810,57sleep013088-21ntpq09:00:230
1048427816,45sleep210530-21ntpq10:36:102
2781527732,24sleep20-21swapper/208:05:182
2544927719,11sleep00-21swapper/011:23:110
2544927719,11sleep00-21swapper/011:23:110
1586127727,28sleep10-21swapper/109:10:171
1433527718,42sleep114414-21find07:20:311
1163227615,42sleep211054-21/usr/sbin/munin08:55:282
820427516,45sleep00-21swapper/008:45:210
53527517,41sleep3605-21/usr/sbin/munin08:20:293
3180227516,12sleep00-21swapper/008:16:180
2623927518,11sleep00-21swapper/009:43:020
2596427514,45sleep226114-21latency_hist08:00:012
1373327518,43sleep213757-21cpu07:20:152
1620227418,10sleep00-21swapper/007:25:380
1418727415,23sleep20-21swapper/209:05:092
954527323,30sleep19562-21munin-run10:34:591
954527323,30sleep19562-21munin-run10:34:591
2894627323,35sleep228960-21acpi11:35:082
247127313,29sleep20-21swapper/210:10:262
2188527317,35sleep321987-21wc11:11:273
743327215,21sleep30-21swapper/312:10:143
743327215,21sleep30-21swapper/312:10:143
2725227215,39sleep327330-21ls09:45:283
211522728,12sleep00-21swapper/011:10:020
188527210,45sleep20-21swapper/208:25:252
1700727227,29sleep324897-21systemd-journal07:30:183
1671827214,42sleep316788-21systemd-run12:39:583
552127128,26sleep10-21swapper/110:20:221
2481527113,42sleep324898-21mailstats11:20:273
2481527113,42sleep324898-21mailstats11:20:273
194842718,12sleep10-21swapper/111:05:151
92227011,44sleep2928-21ntp_states10:05:252
538627016,26sleep20-21swapper/210:20:192
3057827010,46sleep330610-21cut08:15:003
2862927024,26sleep10-21swapper/109:50:221
2646527022,23sleep10-21swapper/111:25:301
2646527022,23sleep10-21swapper/111:25:301
888526929,21sleep10-21swapper/107:05:211
2016026916,36sleep220216-21/usr/sbin/munin07:40:182
2497326820,24sleep10-21swapper/111:20:291
2497326820,24sleep10-21swapper/111:20:291
2246826816,38sleep322508-21ps09:30:263
166526814,38sleep11688-21/usr/sbin/munin11:50:251
1219326811,15sleep20-21swapper/212:25:152
1084126815,39sleep310976-21cat08:55:013
979726724,20sleep10-21swapper/108:50:231
923526719,33sleep19248-21sh08:49:581
1743526719,25sleep10-21swapper/107:30:281
960326618,28sleep29774-21apt-key10:35:002
960326618,28sleep29774-21apt-key10:35:002
3113726620,28sleep30-21swapper/310:00:013
2469626616,30sleep224723-21awk11:20:222
2469626616,30sleep224723-21awk11:20:222
1744826617,28sleep20-21swapper/209:15:192
1163226622,18sleep10-21swapper/107:15:011
1163226622,18sleep10-21swapper/107:15:011
886126522,19sleep30-21swapper/310:30:293
886126522,19sleep30-21swapper/310:30:293
2849526517,33sleep228503-21/usr/sbin/munin09:50:192
2820626516,34sleep328266-21find08:05:273
2675826520,29sleep126850-21/usr/sbin/munin08:00:281
2226826519,31sleep122280-21/usr/sbin/munin09:30:201
2021726526,20sleep30-21swapper/307:40:193
177726516,32sleep11751-21latency_hist10:10:001
1535326515,31sleep315359-21df_inode07:25:173
1467626512,21sleep30-21swapper/309:05:263
1330726515,35sleep213380-21fw_packets10:45:182
493926412,21sleep30-21swapper/312:00:293
483126422,24sleep24863-21munin-run10:19:582
3113126414,24sleep30-21swapper/311:40:303
3065926412,40sleep130762-21fschecks_time11:40:201
1504026416,22sleep30-21swapper/307:25:013
293532637,13sleep30-21swapper/309:53:153
2897326314,21sleep30-21swapper/311:35:133
2873126315,35sleep128768-21date11:34:591
2873126315,35sleep128768-21date11:34:591
2116026310,24sleep20-21swapper/211:10:082
1899926323,23sleep10-21swapper/109:20:181
567626221,19sleep20-21swapper/212:05:002
364726216,31sleep13708-21/usr/sbin/munin10:15:171
3157626211,37sleep231625-21irqstats10:00:202
3157626211,37sleep231625-21irqstats10:00:202
2592926220,21sleep10-21swapper/108:00:001
2540126215,20sleep10-21swapper/109:40:211
1822126219,23sleep10-21swapper/111:00:231
1822126219,23sleep10-21swapper/111:00:231
1681026219,25sleep116952-21sed12:40:001
127326216,30sleep21316-21date08:25:002
1017726215,28sleep20-21swapper/207:10:102
95262617,11sleep20-21swapper/208:50:152
887326114,28sleep38882-21/usr/sbin/munin08:45:323
3095126120,19sleep20-21swapper/211:40:252
2803226120,21sleep30-21swapper/311:30:293
2803226120,21sleep30-21swapper/311:30:293
2401126115,32sleep324082-21sh11:19:593
2186626120,23sleep10-21swapper/107:45:221
2008626110,38sleep30-21swapper/309:23:563
1605526122,22sleep20-21swapper/212:35:492
114392618,11sleep10-21swapper/107:14:411
720326016,27sleep27276-21/usr/sbin/munin10:25:272
532226017,23sleep30-21swapper/308:35:273
1565026015,20sleep20-21swapper/207:25:242
1363126015,28sleep113638-21/usr/sbin/munin10:45:251
1357826013,25sleep30-21swapper/309:00:383
3110525918,26sleep1286-21dbus-daemon09:59:591
2322425921,22sleep20-21swapper/211:15:262
2096425918,28sleep221047-21tr09:25:282
1239125911,19sleep30-21swapper/312:25:203
344525815,23sleep30-21swapper/308:31:073
302225816,17sleep10-21swapper/111:55:221
241752587,37sleep124176-21sshd07:53:171
2066125812,30sleep30-21swapper/311:09:573
1553825815,23sleep10-21swapper/109:10:011
41182576,12sleep10-21swapper/108:31:211
409525716,26sleep34164-21sensors_temp10:15:273
332425713,17sleep10-21swapper/110:15:011
2743925714,27sleep327440-21cron08:04:583
2667525719,23sleep226672-21apt-get09:45:102
120025713,27sleep31196-21apt-get11:50:113
303425620,20sleep30-21swapper/308:30:023
2955225612,16sleep10-21swapper/108:10:211
2353025614,21sleep30-21swapper/309:35:103
1648325615,24sleep116541-21irqstats10:55:221
247925521,18sleep30-21swapper/310:10:273
1658225513,24sleep316679-21users09:10:313
1626925515,24sleep216263-21apt-get10:55:152
1596025515,17sleep10-21swapper/107:25:311
1273425517,15sleep10-21swapper/109:00:161
100282557,11sleep30-21swapper/312:17:003
84525411,31sleep10-21swapper/111:49:081
716325419,20sleep10-21swapper/110:25:261
2616125411,25sleep226245-21memory11:25:232
2616125411,25sleep226245-21memory11:25:232
2489225414,23sleep225033-21sed09:40:012
1939325415,17sleep20-21swapper/209:20:272
1019725415,22sleep310196-21apt-get07:10:113
643025313,23sleep26426-21apt-get08:40:142
326272538,14sleep30-21swapper/311:45:273
275125312,22sleep20-21swapper/211:55:152
2512625313,24sleep325123-21apt-get09:40:113
1479225313,23sleep314798-21df_inode10:50:153
1447025315,23sleep314479-21munin-run10:49:593
769525217,15sleep10-21swapper/112:10:201
769525217,15sleep10-21swapper/112:10:201
516225213,23sleep25221-21memory08:35:222
2352025216,23sleep323023-21/usr/sbin/munin07:50:293
2115425214,22sleep120687-21apt-get11:10:031
1844625211,28sleep118453-21df_inode07:35:161
1844625211,28sleep118453-21df_inode07:35:161
1107725212,24sleep311072-21apt-get08:55:133
2685125116,17sleep20-21swapper/208:00:292
2668425112,23sleep326782-21users11:25:323
2668425112,23sleep326782-21users11:25:323
216632517,34sleep30-21swapper/309:29:173
1469325113,16sleep10-21swapper/110:50:091
3110925011,18sleep20-21swapper/210:00:002
149272505,11sleep20-21swapper/212:34:562
683024912,18sleep10-21swapper/108:40:251
2376624812,16sleep10-21swapper/109:35:201
1185024811,22sleep211882-21munin-run12:24:592
168924713,20sleep21755-21systemctl11:50:272
4562378,12sleep20-21swapper/211:45:302
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional