You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 17:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7s.osadl.org (updated Thu May 07, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
51772776615,7736sleep13469-21kworker/1:009:04:511
51772776615,7736sleep13469-21kworker/1:009:04:511
30073210315,1012sleep028716-1kworker/0:1H12:05:120
596928118,787sleep06019-21unin-run07:24:510
596928118,787sleep06019-21unin-run07:24:510
20066276621,729sleep220076-21/usr/sbin/munin11:35:092
30051253929,489sleep323531-21kworker/u8:012:05:033
10230239369,259sleep010244-21fschecks_count09:20:080
25456233740,284sleep0309-21rs:main0
12371233241,194sleep012501-21unixbench_multi09:25:210
4392232081,186sleep04397-21cron07:19:500
25190230424,258sleep225244-21cpuspeed08:25:062
1436222978,275sleep014476-21cat11:15:210
2596822578,43sleep00-21swapper/010:10:240
16971225513,198sleep017022-21fschecks_count11:25:100
29591225111,193sleep029684-21latency_hist12:04:520
2546224540,144sleep02655-21munin-node07:14:540
8419223955,60sleep00-21swapper/007:30:200
937622380,8sleep20-21swapper/211:00:122
29545223651,163sleep029572-21grep08:39:500
22276223618,137sleep022294-21sh09:59:500
7569222710,203sleep07620-21ls07:29:520
337222266,14sleep00-21swapper/010:40:200
337222266,14sleep00-21swapper/010:40:200
6055222520,149sleep06146-21fschecks_time10:50:090
6695221458,142sleep06736-21dpkg12:34:510
6695221458,142sleep06736-21dpkg12:34:510
15327220218,43sleep00-21swapper/007:54:520
5159219916,121sleep05307-21unixbench_singl10:45:210
26155219710,147sleep026158-21cron11:54:500
8532218315,145sleep18679-21sed07:30:221
11805217858,109sleep0363-21snmpd11:08:300
23261217613,148sleep323280-21find10:00:253
23261217613,148sleep323280-21find10:00:253
9158217329,101sleep00-21swapper/009:15:200
26102216447,65sleep00-21swapper/008:25:250
19035216212,135sleep119109-21find11:30:201
12453215913,132sleep212472-21apt-get07:45:002
31041215410,128sleep231156-21cat10:25:242
13500215214,123sleep0363-21snmpd11:14:520
2976921507,11sleep30-21swapper/310:20:363
2976921507,11sleep30-21swapper/310:20:363
2285621507,14sleep00-21swapper/010:00:140
2285621507,14sleep00-21swapper/010:00:140
20184215028,108sleep020228-21cat11:35:120
2294521499,17sleep00-21swapper/011:44:530
2294521499,17sleep00-21swapper/011:44:530
24946214815,119sleep024981-21latency_hist08:24:520
19703214818,65sleep019738-21systemd-run11:34:510
50921466,12sleep00-21swapper/010:31:480
50921466,12sleep00-21swapper/010:31:480
20077214017,24sleep30-21swapper/311:35:103
3808213410,29sleep30-21swapper/310:40:473
3808213410,29sleep30-21swapper/310:40:473
3090521347,116sleep0363-21snmpd08:42:000
19488213410,74sleep019548-21find08:06:020
793721325,34sleep00-21swapper/009:10:350
25246213212,103sleep325265-21df_inode08:25:073
91621319,108sleep01038-21date07:09:530
1631213026,49sleep00-21swapper/010:36:080
481321297,110sleep0363-21snmpd09:00:300
481321297,110sleep0363-21snmpd09:00:300
7800212810,60sleep00-21swapper/010:55:140
7800212810,60sleep00-21swapper/010:55:140
15016212826,82sleep115060-21sendmail11:19:501
23344212511,98sleep123331-21apt-get11:45:061
6836212413,88sleep10-21swapper/107:25:211
32723212439,39sleep20-21swapper/207:05:232
9383212317,88sleep29457-21/usr/sbin/munin09:15:222
30032212221,84sleep229546-21apt-get12:05:022
32135212130,69sleep332228-21grep07:05:123
31293211841,66sleep031306-21awk10:25:260
14029211813,17sleep20-21swapper/207:50:052
16916211642,57sleep016969-21latency_hist07:59:520
335921155,28sleep00-21swapper/008:57:060
27813211416,86sleep00-21swapper/008:32:270
20778211430,25sleep00-21swapper/009:54:530
24215211311,85sleep224329-21users11:46:242
16437211338,18sleep00-21swapper/009:40:070
29949211215,81sleep329961-21/usr/sbin/munin08:40:093
2956621118,55sleep00-21swapper/010:20:330
2956621118,55sleep00-21swapper/010:20:330
27230211014,28sleep127235-21sort10:15:011
26674210928,67sleep026676-21apt-get11:55:020
23319210725,63sleep323322-21cron08:19:503
1858021050,14sleep318579-21fschecks_time11:30:093
28604210429,55sleep012-21rcu_sched10:19:530
17379210340,46sleep00-21swapper/008:00:170
9490210141,23sleep09068-21/usr/sbin/munin11:00:150
16514210019,70sleep00-21swapper/011:23:490
1892229920,59sleep218451-21apt-get08:05:032
321672986,79sleep00-21swapper/008:45:560
148429712,66sleep11518-21fschecks_time10:36:051
719829615,46sleep17184-21apt-get12:35:081
3231229611,72sleep332385-21grep08:45:593
1069429619,64sleep310765-21cut07:39:523
69082950,13sleep20-21swapper/207:25:212
334229533,13sleep00-21swapper/012:21:590
2665529422,49sleep326656-21/usr/sbin/munin11:55:013
670829331,51sleep01-21systemd09:09:500
670829331,51sleep01-21systemd09:09:500
3165429215,52sleep131639-21apt-get08:45:081
2400229233,17sleep00-21swapper/011:46:220
159542905,74sleep00-21swapper/009:38:380
1332929017,49sleep113380-21fschecks_count09:30:111
121342905,55sleep00-21swapper/007:44:050
731828926,39sleep20-21swapper/212:35:142
157512897,73sleep1194-21jbd2/mmcblk2p2-09:36:001
123328921,48sleep21292-21/usr/sbin/munin08:50:182
2852328817,52sleep228587-21modprobe10:19:502
316872878,21sleep00-21swapper/012:10:090
1247728720,51sleep00-21swapper/007:45:020
206928611,61sleep02113-21latency_hist08:54:520
922328512,20sleep30-21swapper/311:00:093
619228520,44sleep36342-21grep09:05:253
619228520,44sleep36342-21grep09:05:253
2853728514,16sleep10-21swapper/112:00:121
2581328420,41sleep125936-21timerwakeupswit08:25:211
1585128422,40sleep215890-21latency07:55:142
1061328423,40sleep110666-21sendmail07:39:501
98628318,45sleep2680-21/usr/sbin/munin12:15:112
2752828315,49sleep327563-21latency10:15:153
1848928310,34sleep018575-21switchtime09:45:200
1848928310,34sleep018575-21switchtime09:45:200
1756828321,39sleep117731-21grep11:25:231
385428211,57sleep0363-21snmpd12:25:060
1263028216,17sleep30-21swapper/307:45:093
1122328214,49sleep10-21swapper/111:05:201
818128119,44sleep28220-21ntpq07:30:142
2498328124,28sleep10-21swapper/108:24:531
1892128118,42sleep118451-21apt-get08:05:021
1454628114,19sleep20-21swapper/209:34:522
1324228118,47sleep00-21swapper/009:30:060
2124928020,11sleep00-21swapper/008:10:220
93552798,53sleep00-21swapper/007:35:050
424827918,28sleep10-21swapper/112:25:151
944727815,45sleep29510-21fschecks_time07:35:112
719727823,39sleep00-21swapper/012:35:070
2316927818,11sleep00-21swapper/008:17:530
602127718,29sleep20-21swapper/207:24:532
602127718,29sleep20-21swapper/207:24:532
3229427720,32sleep232425-21unixbench_multi12:10:232
234012769,22sleep10-21swapper/108:19:521
1895427625,24sleep30-21swapper/308:05:083
1040927621,28sleep10-21swapper/111:04:521
41127518,40sleep1438-21munin-run12:14:501
238627522,24sleep20-21swapper/212:20:082
1983927512,39sleep20-21swapper/209:50:192
150572758,53sleep215125-21ls09:35:122
1382727520,29sleep30-21swapper/311:15:083
2836027414,45sleep228367-21df_inode08:35:082
282227422,35sleep32851-21cpu07:14:573
2163127414,17sleep30-21swapper/311:40:073
2163127414,17sleep30-21swapper/311:40:073
1762827418,25sleep20-21swapper/208:00:232
1566727427,28sleep30-21swapper/307:55:113
790827310,41sleep20-21swapper/210:55:162
790827310,41sleep20-21swapper/210:55:162
253542730,7sleep30-21swapper/311:50:163
239727320,29sleep10-21swapper/108:55:101
2213927213,40sleep222218-21grep08:15:092
764927117,39sleep27770-21sed09:10:212
679227116,39sleep26936-21latency_hist09:09:522
679227116,39sleep26936-21latency_hist09:09:522
417627113,42sleep14320-21date10:44:531
417627113,42sleep14320-21date10:44:531
273072719,17sleep10-21swapper/111:55:321
186327120,27sleep30-21swapper/310:36:153
1753627120,36sleep317576-21grep08:00:203
127027116,38sleep11358-21fschecks_time07:10:101
635927023,21sleep30-21swapper/307:25:113
266492706,20sleep20-21swapper/211:54:562
126432707,14sleep30-21swapper/311:10:153
116927027,25sleep21166-21apt-get07:10:032
673726925,21sleep10-21swapper/112:34:521
673726925,21sleep10-21swapper/112:34:521
2428026917,27sleep30-21swapper/310:05:143
2331026921,29sleep322834-21apt-get11:45:003
1411426918,34sleep114126-21/usr/sbin/munin07:50:081
1130026923,24sleep20-21swapper/211:05:212
666226822,29sleep36687-21munin-run12:34:503
666226822,29sleep36687-21munin-run12:34:503
313462688,15sleep10-21swapper/110:25:551
3118326826,20sleep10-21swapper/108:44:521
275026815,40sleep22821-21netstat07:14:562
1851926817,20sleep20-21swapper/211:30:092
79226715,19sleep10-21swapper/110:34:521
79226715,19sleep10-21swapper/110:34:521
286726715,29sleep20-21swapper/210:40:062
286726715,29sleep20-21swapper/210:40:062
2799626723,27sleep128009-21apt08:34:501
2645026718,26sleep20-21swapper/210:10:342
1663326719,26sleep20-21swapper/211:24:522
70882667,12sleep10-21swapper/109:10:081
2271926617,23sleep20-21swapper/210:00:122
2271926617,23sleep20-21swapper/210:00:122
2197126618,32sleep1225-21systemd-journal09:55:551
1697026618,34sleep116840-21cron07:59:531
160426616,28sleep31627-21ntp_states07:10:163
1569326616,32sleep115313-21/usr/sbin/munin11:20:141
1453026618,26sleep30-21swapper/307:50:183
104026613,33sleep31175-21gpgv10:34:543
104026613,33sleep31175-21gpgv10:34:543
442926518,29sleep24499-21/usr/sbin/munin12:25:202
3261326516,35sleep232700-21timerwakeupswit10:30:332
3261326516,35sleep232700-21timerwakeupswit10:30:332
2875726516,30sleep328837-21/usr/sbin/munin12:00:183
287526521,22sleep10-21swapper/112:20:191
2872626513,25sleep20-21swapper/212:00:172
183772659,14sleep20-21swapper/209:45:182
183772659,14sleep20-21swapper/209:45:182
449626427,23sleep30-21swapper/309:00:213
449626427,23sleep30-21swapper/309:00:213
3115726413,21sleep30-21swapper/310:25:253
2590426412,38sleep325963-21if_err_eth010:10:233
2126926416,28sleep321303-21/usr/sbin/munin09:55:243
1460126418,22sleep30-21swapper/309:34:533
1300126417,24sleep30-21swapper/309:29:523
2087126316,26sleep120919-21/usr/sbin/munin08:10:151
1715326313,33sleep317184-21/usr/sbin/munin11:25:133
572026217,25sleep10-21swapper/109:05:151
572026217,25sleep10-21swapper/109:05:151
532126216,31sleep35423-21/usr/sbin/munin07:20:223
532126216,31sleep35423-21/usr/sbin/munin07:20:223
2181526217,25sleep30-21swapper/308:14:533
304462619,12sleep20-21swapper/208:40:212
2731026118,25sleep30-21swapper/308:30:203
251542616,12sleep10-21swapper/110:06:291
1974626115,28sleep119838-21/usr/sbin/munin09:50:181
1345826115,22sleep20-21swapper/211:14:502
1295026115,21sleep10-21swapper/109:29:501
72326013,33sleep1739-21awk08:50:011
645026021,22sleep10-21swapper/110:50:181
605126017,28sleep36053-21diskstats10:50:083
46226016,22sleep30-21swapper/312:14:523
3062026016,19sleep10-21swapper/112:05:291
3026826020,18sleep20-21swapper/210:24:552
3026826020,18sleep20-21swapper/210:24:552
2540226018,21sleep10-21swapper/111:50:191
249426017,26sleep32522-21idleruntime08:55:123
182626014,24sleep20-21swapper/210:36:142
549625914,29sleep20-21swapper/212:30:092
549625914,29sleep20-21swapper/212:30:092
2369025917,19sleep30-21swapper/308:20:063
2022925911,19sleep10-21swapper/111:35:131
18472595,43sleep00-21swapper/012:18:040
1819325917,18sleep20-21swapper/211:29:522
766625817,28sleep37724-21processes12:35:233
294572588,38sleep10-21swapper/108:38:421
2192225815,22sleep10-21swapper/111:40:131
2192225815,22sleep10-21swapper/111:40:131
1148925818,17sleep30-21swapper/307:40:213
53612579,36sleep30-21swapper/310:45:483
385225715,26sleep33847-21apt-get12:25:053
2305325714,28sleep123059-21ntp_states10:00:191
2305325714,28sleep123059-21ntp_states10:00:191
214962576,39sleep20-21swapper/208:11:252
1102725713,25sleep111119-21perl07:40:111
923725624,18sleep10-21swapper/109:15:211
34232565,11sleep30-21swapper/312:23:033
1321425618,23sleep313231-21apt09:30:003
1190725614,27sleep311940-21munin-run11:09:513
749825513,22sleep17512-21apt-get10:55:031
749825513,22sleep17512-21apt-get10:55:031
43212557,11sleep20-21swapper/210:44:542
2599325517,22sleep10-21swapper/110:10:251
1694025516,17sleep10-21swapper/109:40:201
1275225522,17sleep10-21swapper/107:45:111
1918225416,22sleep3284-21dbus-daemon09:49:513
1918225416,22sleep3284-21dbus-daemon09:49:513
128352548,34sleep20-21swapper/209:28:222
1131425415,19sleep20-21swapper/207:40:162
88852536,14sleep30-21swapper/307:32:293
826625314,16sleep30-21swapper/309:14:503
70325316,21sleep1698-21apt-get12:15:021
519125320,19sleep10-21swapper/107:20:201
519125320,19sleep10-21swapper/107:20:201
3163225311,19sleep20-21swapper/208:45:012
213912536,13sleep20-21swapper/211:39:542
213912536,13sleep20-21swapper/211:39:542
1565225312,15sleep10-21swapper/107:55:091
129325319,19sleep30-21swapper/308:50:193
1266425314,18sleep10-21swapper/111:10:171
107925318,20sleep30-21swapper/312:15:123
439925213,22sleep11-21systemd07:19:521
33292526,34sleep20-21swapper/208:56:442
3228525212,22sleep132314-21irqstats07:05:141
2680825217,21sleep226814-21df_inode08:30:072
2497825212,24sleep224982-21diskstats11:50:082
1837025214,23sleep118376-21ntp_states09:45:171
1837025214,23sleep118376-21ntp_states09:45:171
596625112,23sleep25962-21apt-get10:50:032
253232516,16sleep20-21swapper/210:08:402
1533525111,24sleep315331-21apt-get11:20:043
1939025013,16sleep30-21swapper/309:49:553
174522505,34sleep30-21swapper/309:42:363
1014525012,21sleep110213-21df09:20:051
283682498,14sleep30-21swapper/308:35:093
166482498,14sleep20-21swapper/209:40:132
1374724912,21sleep213744-21apt-get11:15:022
906124815,18sleep39153-21mailstats09:15:193
567724813,21sleep15710-21munin-run10:49:501
2361524812,17sleep20-21swapper/208:20:012
1061124814,16sleep20-21swapper/209:20:182
102212489,19sleep30-21swapper/309:20:073
396524713,17sleep20-21swapper/209:00:072
396524713,17sleep20-21swapper/209:00:072
2140824716,15sleep20-21swapper/209:55:272
2979624311,16sleep10-21swapper/110:20:551
2979624311,16sleep10-21swapper/110:20:551
80862387,12sleep30-21swapper/310:55:213
80862387,12sleep30-21swapper/310:55:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional