You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 19:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7s.osadl.org (updated Wed Jan 07, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
546427876,770sleep013514-1kworker/0:0H08:50:440
3031126835,667sleep124815-1kworker/1:0H08:25:381
1536249112,465sleep31577-21unin-run12:04:553
96942456144,201sleep19732-21fschecks_count12:30:131
21573244016,406sleep021512-21latency_hist07:59:570
1837231113,150sleep11986-21unixbench_singl10:20:281
15272227043,205sleep115322-21idleruntime-cro07:39:551
17912256132,31sleep11799-21acpi12:05:051
29406225343,189sleep129526-21latency_hist08:24:571
24627225241,189sleep124650-21awk08:09:551
17984224642,184sleep118074-21cut09:30:141
634522258,202sleep06420-21find10:35:250
10186222435,142sleep110248-21grep09:05:151
5826221635,26sleep10-21swapper/110:35:141
31606221615,181sleep131666-21sendmail_mailqu11:55:241
26164220613,170sleep126167-21cron11:39:541
8578220513,171sleep18604-21idleruntime-cro10:44:551
19174219640,100sleep10-21swapper/107:50:251
11750219158,26sleep10-21swapper/109:10:151
11750219158,26sleep10-21swapper/109:10:151
20704218512,55sleep120745-21systemctl09:39:551
24920217647,77sleep10-21swapper/108:10:111
9809217110,46sleep19812-21cron09:04:541
5109216552,85sleep35212-21apt-config07:09:573
1167216210,15sleep30-21swapper/310:20:143
6847215114,95sleep10-21swapper/107:14:551
21809214168,54sleep021864-21sort11:25:110
21809214168,54sleep021864-21sort11:25:110
15400214118,17sleep10-21swapper/111:04:571
6615214016,86sleep10-21swapper/108:54:081
2257321378,117sleep122562-21apt-get09:45:121
13925213719,43sleep114071-21grep09:15:281
4154213427,17sleep10-21swapper/108:45:241
17765213112,22sleep10-21swapper/107:45:241
3362212811,95sleep10-21swapper/112:10:061
3040421277,97sleep10-21swapper/110:10:111
29810212616,92sleep229331-21apt-get08:25:062
19195212218,87sleep319208-21latency_hist09:34:563
2072721219,60sleep120765-21ps11:20:241
2072721219,60sleep120765-21ps11:20:241
8615212010,17sleep10-21swapper/112:25:241
14102212014,91sleep314103-21/usr/sbin/munin11:01:083
31476211733,71sleep131565-21grep08:30:141
31476211733,71sleep131565-21grep08:30:141
2646721178,23sleep10-21swapper/108:15:121
22387211734,20sleep10-21swapper/108:00:261
10762211627,71sleep210777-21cut07:25:142
10762211627,71sleep210777-21cut07:25:142
8954211575,26sleep18992-21fschecks_count10:45:151
1730321148,40sleep10-21swapper/109:26:021
1730321148,40sleep10-21swapper/109:26:021
1136421145,10sleep00-21swapper/010:50:550
798121138,57sleep10-21swapper/107:15:241
7759211347,22sleep10-21swapper/112:24:481
32045211319,66sleep032135-21grep10:15:140
28006211212,45sleep10-21swapper/111:45:071
28006211212,45sleep10-21swapper/111:45:071
2762921125,11sleep10-21swapper/111:43:291
2762921125,11sleep10-21swapper/111:43:291
29229211010,46sleep10-21swapper/110:05:221
2842921106,11sleep10-21swapper/110:03:121
17134211020,77sleep217172-21grep07:45:092
10348211029,69sleep10-21swapper/107:24:241
10348211029,69sleep10-21swapper/107:24:241
1004021104,97sleep00-21swapper/010:48:490
1320621095,39sleep10-21swapper/110:56:371
12664210911,59sleep112817-21gpgv12:39:581
1208521095,11sleep10-21swapper/107:29:581
20747210813,54sleep10-21swapper/107:55:251
16185210810,42sleep10-21swapper/111:05:261
2217621077,11sleep10-21swapper/109:43:341
30375210614,76sleep030392-21/usr/sbin/munin10:10:050
20011210518,69sleep220033-21sort11:19:562
16648210411,61sleep1372-21ntpd07:42:211
4081210316,16sleep30-21swapper/308:45:223
25792210310,51sleep10-21swapper/109:55:131
25175210319,67sleep324877-21/usr/sbin/munin11:35:153
1773721039,41sleep10-21swapper/111:10:261
30837210115,66sleep330839-21cron11:54:543
1447829921,53sleep314503-21modprobe09:19:543
518629810,71sleep35284-21/usr/sbin/munin12:15:173
49152986,14sleep10-21swapper/112:15:111
2547429812,44sleep10-21swapper/109:54:561
58629734,48sleep1676-21grep08:35:151
58629734,48sleep1676-21grep08:35:151
109282977,37sleep10-21swapper/107:25:171
109282977,37sleep10-21swapper/107:25:171
233282967,47sleep10-21swapper/111:30:051
233282967,47sleep10-21swapper/111:30:051
1368929616,60sleep213186-21/usr/sbin/munin09:15:252
74002957,47sleep10-21swapper/108:55:221
33702958,39sleep13380-21munin-run08:44:561
1571229516,21sleep30-21swapper/311:05:163
389429324,52sleep33917-21munin-plugin-st10:29:553
104342936,34sleep10-21swapper/110:50:111
254429213,58sleep32692-21sed12:05:283
37322916,38sleep1745-21sendmail-mta10:27:511
147962917,44sleep10-21swapper/109:20:091
147962917,44sleep10-21swapper/109:20:091
52429031,44sleep1550-21kernelversion12:00:171
2026129015,35sleep00-21swapper/011:20:100
2026129015,35sleep00-21swapper/011:20:100
296322897,31sleep10-21swapper/111:50:111
910328818,37sleep30-21swapper/307:20:063
910328818,37sleep30-21swapper/307:20:063
550028816,58sleep05544-21latency_hist10:34:560
319452887,32sleep10-21swapper/110:15:071
3110328813,60sleep331144-21systemd-run08:29:563
3016328826,29sleep30-21swapper/310:09:563
289828814,55sleep22914-21uname10:25:172
1872228834,43sleep10-21swapper/111:15:111
152828826,45sleep21534-21modprobe12:04:542
1115728713,56sleep211221-21/usr/sbin/munin12:35:102
323828610,64sleep0366-21snmpd08:43:460
1932928520,49sleep319446-21sed07:50:273
733528417,46sleep37362-21awk08:55:193
338128424,28sleep20-21swapper/208:44:572
2866728423,35sleep30-21swapper/308:20:273
556928315,49sleep35387-21/usr/sbin/munin08:51:033
2420528321,37sleep20-21swapper/209:50:132
181772835,15sleep00-21swapper/007:47:090
1428628316,52sleep214339-21cat07:35:202
1401328326,39sleep014009-21apt-get11:00:080
594928213,49sleep36002-21/usr/sbin/munin10:35:163
2773628216,51sleep027798-21modprobe08:19:550
794328112,54sleep07979-21ntpq07:15:230
1850428122,36sleep018585-21cat09:30:250
1527428124,37sleep30-21swapper/309:20:233
1527428124,37sleep30-21swapper/309:20:233
1074728112,15sleep00-21swapper/007:25:120
1074728112,15sleep00-21swapper/007:25:120
3185428018,40sleep031996-21unixbench_singl11:55:270
2149228015,46sleep221525-21modprobe07:59:552
208828016,30sleep20-21swapper/212:05:192
53992797,28sleep10-21swapper/110:34:171
3112727915,36sleep30-21swapper/311:55:103
1036927913,49sleep010400-21latency09:05:180
700127815,36sleep27026-21munin-run10:39:552
2003427822,28sleep30-21swapper/311:19:573
344627714,48sleep30-21swapper/312:10:123
111282777,12sleep00-21swapper/012:35:040
3166927617,47sleep231736-21/usr/sbin/munin11:55:252
651027513,50sleep06538-21grep12:20:100
294042759,51sleep229472-21switchtime10:05:272
2632627523,34sleep20-21swapper/209:55:262
1176727523,25sleep20-21swapper/210:54:572
89142746,45sleep20-21swapper/209:00:192
84492749,17sleep00-21swapper/012:25:190
764227421,21sleep20-21swapper/208:55:272
2622227422,17sleep20-21swapper/208:14:572
1712827415,45sleep217164-21cpu11:10:112
1578927414,43sleep015846-21/usr/sbin/munin11:05:170
1382527418,27sleep00-21swapper/009:15:270
133072748,13sleep30-21swapper/310:57:573
931827316,37sleep39333-21modprobe12:29:543
82332735,55sleep30-21swapper/310:40:283
502327328,22sleep20-21swapper/207:09:562
2452727318,32sleep024538-21apt-get09:50:190
1760627319,30sleep30-21swapper/311:10:243
2294627227,10sleep10-21swapper/111:28:231
2294627227,10sleep10-21swapper/111:28:231
1227327217,25sleep00-21swapper/009:10:270
1227327217,25sleep00-21swapper/009:10:270
3260127122,26sleep30-21swapper/310:15:253
2922627115,21sleep00-21swapper/010:05:210
2851727117,42sleep028533-21open_inodes08:20:240
284022715,56sleep00-21swapper/010:02:510
1705227121,20sleep30-21swapper/309:25:273
1705227121,20sleep30-21swapper/309:25:273
157927116,29sleep00-21swapper/012:04:560
933827014,43sleep29385-21processes10:45:242
2721127013,41sleep227358-21awk08:15:292
2514027014,24sleep20-21swapper/211:35:142
1471227012,44sleep214807-21timerandwakeup11:01:232
1142327017,29sleep30-21swapper/309:09:573
316372695,11sleep30-21swapper/310:14:373
306602696,12sleep00-21swapper/011:52:370
2265126914,30sleep00-21swapper/009:45:150
830826817,27sleep00-21swapper/008:59:570
35652688,48sleep00-21swapper/010:25:400
2983826823,28sleep00-21swapper/008:25:080
1695626818,24sleep20-21swapper/209:25:262
1695626818,24sleep20-21swapper/209:25:262
390626723,23sleep00-21swapper/007:05:140
383026728,21sleep10-21swapper/107:05:111
2619026721,26sleep00-21swapper/009:55:240
1614726715,22sleep00-21swapper/007:40:260
650726616,31sleep26503-21apt-get12:20:082
1410326615,37sleep314163-21fschecks_time07:35:173
342226515,27sleep30-21swapper/308:44:583
2499126515,34sleep025083-21fschecks_time11:35:120
2467926514,24sleep30-21swapper/308:09:573
157726513,24sleep20-21swapper/210:20:252
105742657,17sleep00-21swapper/012:31:090
860626415,35sleep28622-21sh10:44:562
2645226420,23sleep20-21swapper/211:40:032
2645226420,23sleep20-21swapper/211:40:032
2226826414,33sleep222274-21ntp_states08:00:232
121402645,12sleep20-21swapper/209:10:252
121402645,12sleep20-21swapper/209:10:252
820626326,21sleep20-21swapper/207:15:292
754726314,33sleep37614-21df07:15:143
2781826317,19sleep30-21swapper/308:19:583
1998826310,38sleep01-21systemd07:54:560
104626320,20sleep30-21swapper/308:35:253
104626320,20sleep30-21swapper/308:35:253
716326216,27sleep37288-21grep12:20:263
2388326220,19sleep20-21swapper/209:49:572
2052126212,34sleep320538-21cut11:20:183
2052126212,34sleep320538-21cut11:20:183
1298226216,29sleep30-21swapper/309:14:583
1298226216,29sleep30-21swapper/309:14:583
361826117,28sleep23612-21apt-get08:45:092
3175826117,25sleep20-21swapper/208:30:192
3175826117,25sleep20-21swapper/208:30:192
2783126118,20sleep30-21swapper/311:44:563
2783126118,20sleep30-21swapper/311:44:563
2776626115,24sleep20-21swapper/210:00:232
2750626116,28sleep327564-21/usr/sbin/munin10:00:153
2313226114,22sleep00-21swapper/008:04:570
229726119,22sleep00-21swapper/012:05:250
2232326119,21sleep20-21swapper/209:44:562
2152826115,19sleep30-21swapper/309:40:253
1600026117,26sleep20-21swapper/209:24:132
1600026117,26sleep20-21swapper/209:24:132
3192426016,20sleep30-21swapper/308:30:243
3192426016,20sleep30-21swapper/308:30:243
290652607,44sleep30-21swapper/311:47:023
290652607,44sleep30-21swapper/311:47:023
2849626019,15sleep20-21swapper/211:45:242
2849626019,15sleep20-21swapper/211:45:242
229712606,13sleep30-21swapper/309:45:223
2207926013,31sleep321782-21/usr/sbin/munin11:25:183
2207926013,31sleep321782-21/usr/sbin/munin11:25:183
1047026017,23sleep20-21swapper/209:05:202
985925917,21sleep30-21swapper/309:04:563
3252425920,20sleep20-21swapper/210:15:242
2461625912,31sleep224646-21munin-run11:34:542
2461625912,31sleep224646-21munin-run11:34:542
2334025914,26sleep023359-21apt-get08:05:050
2005425915,25sleep020156-21/usr/sbin/munin09:35:260
1765825917,21sleep00-21swapper/009:29:570
1765825917,21sleep00-21swapper/009:29:570
997525815,22sleep20-21swapper/212:30:182
2952725817,24sleep229722-21apt-config08:24:582
2626625822,16sleep30-21swapper/308:14:583
2465925820,22sleep20-21swapper/208:09:562
182725820,20sleep20-21swapper/208:39:562
182725820,20sleep20-21swapper/208:39:562
155522588,13sleep20-21swapper/211:05:062
1449625817,16sleep00-21swapper/007:35:420
1346425818,19sleep00-21swapper/010:59:550
1104425818,23sleep30-21swapper/307:25:193
1104425818,23sleep30-21swapper/307:25:193
696225716,18sleep30-21swapper/307:14:573
264072579,30sleep30-21swapper/309:55:273
1961425716,21sleep20-21swapper/209:35:162
1249625726,17sleep20-21swapper/207:30:192
1237525718,18sleep00-21swapper/007:30:170
1166225716,19sleep30-21swapper/312:35:243
959425617,25sleep09631-21ps07:20:240
959425617,25sleep09631-21ps07:20:240
689625615,21sleep20-21swapper/207:14:562
336325615,25sleep23359-21apt-get12:10:072
2466725618,19sleep00-21swapper/011:34:560
2466725618,19sleep00-21swapper/011:34:560
2078425616,24sleep320879-21sed09:39:573
1559325618,23sleep215643-21/usr/sbin/munin07:40:122
1220225615,20sleep30-21swapper/307:30:083
106625614,28sleep01083-21/usr/sbin/munin10:20:070
398825515,20sleep00-21swapper/008:45:190
1479525515,23sleep014790-21apt-get09:20:080
1479525515,23sleep014790-21apt-get09:20:080
1362525517,20sleep20-21swapper/210:59:572
1011525515,22sleep310205-21grep12:30:233
2033225419,18sleep30-21swapper/307:55:153
165202545,17sleep30-21swapper/307:40:423
912825312,24sleep29122-21apt-get07:20:092
912825312,24sleep29122-21apt-get07:20:092
538625316,22sleep24893-21apt-get08:50:062
53362534,10sleep30-21swapper/310:33:263
2259825314,18sleep30-21swapper/308:00:283
183672538,37sleep00-21swapper/011:14:410
1803025310,18sleep30-21swapper/307:45:263
869525218,14sleep20-21swapper/212:25:252
759225214,15sleep00-21swapper/010:40:170
444825215,21sleep20-21swapper/210:30:182
3258125211,30sleep0366-21snmpd08:34:040
3258125211,30sleep0366-21snmpd08:34:040
3088925217,20sleep20-21swapper/211:54:572
242232528,19sleep30-21swapper/309:50:143
2384125215,18sleep30-21swapper/311:30:233
2384125215,18sleep30-21swapper/311:30:233
1105725214,17sleep30-21swapper/310:50:263
938625114,16sleep30-21swapper/310:45:253
1876525112,23sleep218771-21diskstats07:50:142
555825012,22sleep05047-21apt-get07:10:060
345225013,23sleep03547-21perl12:10:130
535124912,23sleep25375-21ntp_states12:15:202
499924913,22sleep05097-21perl12:15:140
2489224919,17sleep00-21swapper/008:10:060
1903824911,18sleep00-21swapper/011:15:180
2698224814,14sleep00-21swapper/011:40:210
2698224814,14sleep00-21swapper/011:40:210
2204424814,19sleep222078-21irqstats11:25:172
2204424814,19sleep222078-21irqstats11:25:172
2146424812,21sleep021480-21ntp_states09:40:220
1790024811,19sleep217970-21df09:30:112
862424712,13sleep00-21swapper/009:00:130
2810924410,21sleep028116-21diskstats11:45:140
2810924410,21sleep028116-21diskstats11:45:140
9512439,17sleep00-21swapper/008:35:220
9512439,17sleep00-21swapper/008:35:220
203312438,18sleep20-21swapper/211:20:122
203312438,18sleep20-21swapper/211:20:122
303982397,15sleep20-21swapper/210:10:072
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional