You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 19:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7s.osadl.org (updated Sun Aug 30, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13449262915,598sleep313460-21ntpq10:34:183
483244751,176sleep1512-21idleruntime-cro11:38:521
23907238920,349sleep124053-21grep09:24:241
23907238920,349sleep124053-21grep09:24:241
248332329144,166sleep124871-21fschecks_count09:29:121
14209231913,291sleep214214-21ntpq12:19:182
14209231913,291sleep214214-21ntpq12:19:182
2877522659,199sleep128861-21cut07:59:131
14825224634,194sleep114869-21ntp_offset07:14:191
974219239,141sleep11026-21cut08:14:111
19785219117,155sleep119930-21unixbench_multi07:29:251
389421859,158sleep13910-21latency_hist11:48:531
248021830,61sleep02484-21latency_hist11:43:540
248021830,61sleep02484-21latency_hist11:43:540
21413218213,151sleep121487-21latency_hist09:18:551
2941721819,22sleep10-21swapper/109:43:541
5483218011,143sleep15627-21apt-config11:53:541
13843217921,56sleep313884-21fschecks_count12:19:103
13843217921,56sleep313884-21fschecks_count12:19:103
966221788,156sleep19800-21latency_hist10:23:551
966221788,156sleep19800-21latency_hist10:23:551
293421726,12sleep10-21swapper/108:19:191
6342217113,24sleep10-21swapper/108:29:251
2771521708,150sleep127840-21cat11:19:221
18186216813,137sleep118129-21latency_hist12:33:541
9634216624,118sleep10-21swapper/112:04:231
9634216624,118sleep10-21swapper/112:04:231
3187421627,137sleep131987-21timerwakeupswit09:49:231
101921609,59sleep10-21swapper/111:39:041
101921609,59sleep10-21swapper/111:39:041
4316215910,134sleep14434-21timerwakeupswit10:04:331
15196215517,119sleep10-21swapper/110:39:251
1600921547,131sleep10-21swapper/107:19:071
11422215310,19sleep10-21swapper/110:29:031
2659821527,17sleep10-21swapper/111:17:161
22450215011,13sleep00-21swapper/011:04:110
15056214910,40sleep115091-21latency_hist12:23:531
15056214910,40sleep115091-21latency_hist12:23:531
2343121477,12sleep10-21swapper/111:06:301
867121446,11sleep10-21swapper/112:02:341
1490821437,12sleep10-21swapper/108:56:381
10032214212,114sleep110175-21apt-config08:43:541
1859621416,11sleep10-21swapper/107:26:061
927021395,11sleep20-21swapper/210:19:282
927021395,11sleep20-21swapper/210:19:282
136421395,11sleep10-21swapper/109:56:211
29159213722,95sleep029234-21grep11:24:210
749021359,111sleep17535-21ntpq08:34:171
1922121357,28sleep10-21swapper/110:54:061
25270213411,109sleep225307-21idleruntime-cro07:48:522
3154421339,107sleep10-21swapper/108:08:541
31445213312,102sleep031593-21latency_hist11:33:540
299482131101,13sleep10-21swapper/111:28:541
410621299,93sleep125654-1kworker/1:0H08:24:121
548921289,16sleep10-21swapper/110:09:131
17375212811,102sleep217433-21sendmail_mailtr12:29:232
17375212811,102sleep217433-21sendmail_mailtr12:29:232
1580521275,11sleep10-21swapper/112:24:211
1580521275,11sleep10-21swapper/112:24:211
1062821278,18sleep10-21swapper/108:45:071
1062821278,18sleep10-21swapper/108:45:071
2270921267,85sleep10-21swapper/107:39:221
2400921246,13sleep10-21swapper/111:09:121
2179921245,10sleep10-21swapper/111:00:241
2035321247,105sleep029562-1kworker/0:2H10:57:120
2198021238,103sleep121986-21munin-run07:38:531
1961521236,64sleep10-21swapper/112:38:181
2602721228,101sleep126091-21ps07:49:191
1341621216,9sleep10-21swapper/112:18:361
1341621216,9sleep10-21swapper/112:18:361
7216211977,29sleep112261-21cyclictest10:14:181
2401521196,98sleep00-21swapper/007:44:090
30818211816,87sleep230959-21unixbench_multi11:29:242
1708421165,12sleep10-21swapper/110:45:021
637321157,50sleep10-21swapper/111:54:421
31704211518,80sleep331778-21/usr/sbin/munin09:49:213
25163211518,80sleep025196-21awk11:13:520
1055421158,11sleep30-21swapper/308:45:053
1055421158,11sleep30-21swapper/308:45:053
1888121145,77sleep10-21swapper/110:53:141
2414021136,74sleep10-21swapper/107:44:191
31780211113,71sleep00-21swapper/009:49:220
2738321116,46sleep10-21swapper/107:54:161
13614211016,17sleep10-21swapper/108:53:551
3081521095,10sleep10-21swapper/109:47:371
2761821095,48sleep10-21swapper/109:36:391
12136210912,22sleep012156-21apt-get12:14:030
12136210912,22sleep012156-21apt-get12:14:030
1071921096,46sleep10-21swapper/112:09:111
1071921096,46sleep10-21swapper/112:09:111
1693321086,45sleep10-21swapper/109:04:051
2207821070,6sleep30-21swapper/307:38:553
1670621065,44sleep10-21swapper/109:03:531
1670621065,44sleep10-21swapper/109:03:531
14127210616,71sleep014160-21/usr/sbin/munin12:19:160
14127210616,71sleep014160-21/usr/sbin/munin12:19:160
3141421048,85sleep00-21swapper/008:07:480
288021038,41sleep10-21swapper/110:00:291
27136210314,75sleep227236-21fschecks_time11:19:112
21360210324,61sleep021507-21grep07:34:240
1394121037,43sleep10-21swapper/110:34:451
1348621036,44sleep10-21swapper/107:10:431
2979021015,43sleep10-21swapper/111:28:101
1945421016,41sleep10-21swapper/109:09:461
1096121005,41sleep10-21swapper/110:26:211
1096121005,41sleep10-21swapper/110:26:211
246929927,45sleep22466-21apt-get08:19:042
226632996,43sleep10-21swapper/109:20:441
226632996,43sleep10-21swapper/109:20:441
1222229915,68sleep212392-21latency_hist07:08:542
1743729715,26sleep20-21swapper/210:48:552
220332969,73sleep00-21swapper/011:03:260
608429514,64sleep36102-21fschecks_count11:54:363
259002940,7sleep30-21swapper/311:14:183
1092529413,19sleep00-21swapper/008:45:140
1092529413,19sleep00-21swapper/008:45:140
1421829217,59sleep213799-21/usr/sbin/munin08:54:172
718729114,59sleep27225-21modprobe11:58:512
238529127,30sleep30-21swapper/311:43:543
238529127,30sleep30-21swapper/311:43:543
55929015,59sleep2561-21sshd08:13:232
1731029022,55sleep317337-21cat07:23:533
1686028917,49sleep016861-21cpu12:29:080
1686028917,49sleep016861-21cpu12:29:080
378228816,54sleep03929-21latency_hist08:23:550
2743628812,61sleep327473-21sed11:19:163
179552885,11sleep10-21swapper/112:31:521
1351628813,26sleep20-21swapper/212:18:532
1351628813,26sleep20-21swapper/212:18:532
327132877,24sleep10-21swapper/108:09:341
2649828711,59sleep326015-21apt-get09:34:033
1516028715,56sleep313545-21kworker/u8:108:58:543
245228611,59sleep32550-21cat09:59:223
1346228510,62sleep013470-21ntpq10:34:190
924828312,50sleep29039-21/usr/sbin/munin12:04:122
924828312,50sleep29039-21/usr/sbin/munin12:04:122
844228328,27sleep30-21swapper/310:19:123
844228328,27sleep30-21swapper/310:19:123
186562836,10sleep30-21swapper/307:26:523
1173728323,40sleep211751-21apt-get08:48:522
1173728323,40sleep211751-21apt-get08:48:522
2544828220,31sleep20-21swapper/209:29:262
452528119,29sleep30-21swapper/308:24:223
3000528119,30sleep20-21swapper/208:03:542
2082128116,45sleep020962-21/usr/sbin/munin09:14:260
1965628020,35sleep20-21swapper/212:38:512
687727911,52sleep36977-21latency_hist08:33:553
498227917,38sleep25068-21cat10:08:542
2117327917,44sleep321221-21sed10:59:173
1897927911,18sleep00-21swapper/009:09:210
1219827930,31sleep112221-21wc07:08:531
1125427926,34sleep011299-21awk07:04:170
391427820,26sleep20-21swapper/211:48:542
268127810,44sleep32720-21fschecks_count11:44:113
2613727813,48sleep00-21swapper/011:14:240
1666627813,44sleep00-21swapper/009:03:520
1666627813,44sleep00-21swapper/009:03:520
1451127816,44sleep314603-21fschecks_time07:14:123
1119827816,44sleep310590-21/usr/sbin/munin12:09:223
1119827816,44sleep310590-21/usr/sbin/munin12:09:223
493127715,42sleep04957-21modprobe10:08:520
1647227716,41sleep216504-21proc_pri07:19:202
1353327723,34sleep213554-21modprobe08:53:522
155927615,45sleep21635-21systemd-run09:58:522
983227519,28sleep30-21swapper/312:04:253
983227519,28sleep30-21swapper/312:04:253
592427510,29sleep00-21swapper/011:54:050
2670027514,47sleep026737-21fschecks_time09:34:480
3231027418,39sleep332422-21/usr/sbin/munin11:34:223
1959327415,41sleep319629-21ntpq10:54:173
194027433,20sleep00-21swapper/008:16:070
90592739,16sleep00-21swapper/008:39:170
226872738,12sleep00-21swapper/007:39:210
2006727220,26sleep30-21swapper/309:14:083
1877027113,22sleep30-21swapper/312:34:163
129127116,29sleep30-21swapper/308:14:173
67527022,26sleep00-21swapper/011:38:550
305172705,13sleep30-21swapper/308:04:153
2768527022,29sleep00-21swapper/007:54:230
2449527017,16sleep20-21swapper/209:28:532
2449527017,16sleep20-21swapper/209:28:532
1764427016,28sleep20-21swapper/207:24:132
1002227014,40sleep310108-21perl10:24:133
1002227014,40sleep310108-21perl10:24:133
423026917,34sleep34263-21fschecks_count11:49:113
2048226916,39sleep2231-21systemd-journal10:58:522
2036026924,27sleep020371-21modprobe07:33:520
1762126916,27sleep00-21swapper/009:04:240
1655926918,32sleep316590-21munin-run12:28:513
1655926918,32sleep316590-21munin-run12:28:513
1058826917,28sleep00-21swapper/012:09:020
1058826917,28sleep00-21swapper/012:09:020
803526822,29sleep30-21swapper/310:18:523
2600026815,24sleep00-21swapper/009:33:510
51726717,36sleep2585-21apt-config11:38:532
2865926718,29sleep30-21swapper/309:39:243
2380326715,29sleep00-21swapper/009:24:230
2380326715,29sleep00-21swapper/009:24:230
1433426723,26sleep20-21swapper/210:38:532
94392665,17sleep00-21swapper/010:21:400
94392665,17sleep00-21swapper/010:21:400
2687126610,34sleep00-21swapper/007:53:550
2116326618,29sleep20-21swapper/210:59:162
174462669,12sleep20-21swapper/209:04:222
135682666,48sleep00-21swapper/007:11:470
1308326619,30sleep312137-21/usr/sbin/munin12:14:263
1308326619,30sleep312137-21/usr/sbin/munin12:14:263
125852667,48sleep00-21swapper/010:32:130
30412657,12sleep30-21swapper/308:19:213
1878826516,34sleep318827-21expr09:09:163
1464926518,22sleep30-21swapper/310:39:113
451326414,21sleep00-21swapper/011:49:160
2966026414,22sleep30-21swapper/309:44:083
108232645,12sleep20-21swapper/212:09:132
108232645,12sleep20-21swapper/212:09:132
369026318,25sleep30-21swapper/310:04:183
3023426315,33sleep230325-21sed09:44:232
2922126316,29sleep329293-21/usr/sbin/munin07:59:233
2685926313,34sleep326869-21munin-run07:53:543
2450526315,34sleep324583-21find11:09:233
1796026312,34sleep018005-21/usr/sbin/munin07:24:190
522026217,26sleep35290-21df10:09:073
336126217,23sleep00-21swapper/010:03:550
274772626,13sleep20-21swapper/207:54:172
2187126213,35sleep221922-21irqstats09:19:162
2187126213,35sleep221922-21irqstats09:19:162
1859026220,22sleep20-21swapper/209:09:112
1479326210,38sleep014824-21nfs_client07:14:180
2545326117,27sleep225449-21apt-get11:14:062
2521626119,23sleep20-21swapper/211:13:542
2327026112,35sleep323277-21df_inode09:24:103
2327026112,35sleep323277-21df_inode09:24:103
1288926116,19sleep20-21swapper/207:09:192
990326016,27sleep29894-21apt-get10:24:082
990326016,27sleep29894-21apt-get10:24:082
751026017,20sleep20-21swapper/211:59:072
63322608,40sleep00-21swapper/010:11:590
49026020,22sleep00-21swapper/009:54:140
2914126017,26sleep00-21swapper/007:59:200
2808426019,21sleep00-21swapper/009:39:040
2364426016,23sleep20-21swapper/207:43:552
1358126018,21sleep00-21swapper/008:53:540
882425910,34sleep08940-21latency_hist12:03:540
51552595,43sleep00-21swapper/008:27:180
3024225915,27sleep230238-21apt-get08:04:062
2876925922,21sleep30-21swapper/311:24:123
163625915,30sleep31689-21latency_hist09:58:533
1530425920,23sleep215300-21apt-get12:24:062
1530425920,23sleep215300-21apt-get12:24:062
1134525926,18sleep30-21swapper/307:04:203
1086525913,33sleep010866-21sshd10:25:070
1086525913,33sleep010866-21sshd10:25:070
935525817,20sleep30-21swapper/308:39:243
2901125820,22sleep20-21swapper/209:39:272
2858825816,19sleep20-21swapper/211:24:072
2165425815,27sleep321647-21apt-get09:19:093
2165425815,27sleep321647-21apt-get09:19:093
2041025815,20sleep20-21swapper/207:33:542
1542325816,27sleep015510-21tune2fs12:24:120
1542325816,27sleep015510-21tune2fs12:24:120
1406725819,17sleep20-21swapper/207:13:592
1037525815,19sleep00-21swapper/012:08:540
1037525815,19sleep00-21swapper/012:08:540
1776225722,19sleep20-21swapper/210:49:112
1449725719,23sleep014625-21cat08:54:230
801325612,25sleep38092-21awk11:59:253
676825615,24sleep26762-21apt-get10:14:062
530625615,19sleep20-21swapper/210:09:102
3176525619,18sleep30-21swapper/308:09:043
2703925615,23sleep027034-21apt-get11:19:040
200262566,38sleep30-21swapper/307:29:353
1852325614,24sleep318577-21users10:49:243
1583725617,20sleep00-21swapper/010:43:520
1504525616,19sleep20-21swapper/210:39:222
80392554,12sleep30-21swapper/308:34:353
684025514,19sleep00-21swapper/010:14:090
621925515,21sleep00-21swapper/008:29:240
3132725516,24sleep231411-21perl09:49:122
3095725513,27sleep030989-21sed09:48:530
2235625514,23sleep322351-21apt-get11:04:063
1973625516,19sleep00-21swapper/012:38:530
172892555,38sleep00-21swapper/010:47:400
1680225511,21sleep30-21swapper/310:44:243
1626325515,23sleep016282-21irqstats07:19:140
1165625516,21sleep311696-21/usr/sbin/munin10:29:143
2293025416,17sleep20-21swapper/211:04:212
2072525415,22sleep220732-21diskstats07:34:102
101525417,21sleep2510-21apt-get11:39:012
101525417,21sleep2510-21apt-get11:39:012
767025315,16sleep20-21swapper/208:34:222
2577025317,16sleep20-21swapper/207:49:122
2267925311,23sleep322685-21ntp_states07:39:203
556525211,24sleep25562-21apt-get08:29:052
3257825212,22sleep032692-21users08:09:250
2699625213,23sleep227032-21ntp_states09:34:552
2198325213,23sleep022022-21memory09:19:180
2198325213,23sleep022022-21memory09:19:180
1274425212,25sleep312816-21sed07:09:163
912225112,23sleep29146-21ntp_states08:39:192
414125117,14sleep20-21swapper/208:24:132
210592515,35sleep20-21swapper/209:15:292
1685825113,23sleep316851-21apt-get12:29:073
1685825113,23sleep316851-21apt-get12:29:073
318425014,14sleep20-21swapper/210:03:532
2401325012,22sleep324002-21apt-get07:44:083
125625014,19sleep21290-21/usr/sbin/munin08:14:162
422324911,16sleep20-21swapper/211:49:102
1703524912,21sleep317041-21diskstats09:04:113
1671624913,17sleep20-21swapper/209:03:542
1671624913,17sleep20-21swapper/209:03:542
1232324912,18sleep30-21swapper/308:49:093
786624812,16sleep00-21swapper/008:34:240
3014024810,14sleep30-21swapper/311:29:093
1897324813,21sleep018983-21munin-run10:53:530
255962477,17sleep30-21swapper/309:29:273
114512478,14sleep20-21swapper/210:29:082
333724611,17sleep00-21swapper/011:44:240
1584824511,15sleep30-21swapper/308:59:183
1584824511,15sleep30-21swapper/308:59:183
2717624112,14sleep30-21swapper/307:54:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional