You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-27 - 22:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Thu Aug 27, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
137012144519,14390sleep023891-21kworker/u8:109:34:360
238502122614,1201sleep115274-21kworker/u8:408:24:201
238372116020,1061sleep015274-21kworker/u8:408:24:150
15632109716,1066sleep314299-21kworker/u8:307:14:213
284427767,757sleep02880-21ntpq12:24:260
3252273226,687sleep13261-21/usr/sbin/munin10:44:141
5155257215,541sleep05189-21ps07:24:320
22063254516,471sleep022128-21ls08:19:190
23128246730,415sleep023216-21fschecks_time10:04:240
1598524416,423sleep016032-21ntpq07:59:280
1348124290,9sleep30-21swapper/309:34:063
1348124290,9sleep30-21swapper/309:34:063
26503239610,372sleep226552-21ntpq10:14:272
4543237215,342sleep14554-21ntpq09:04:291
319142278127,29sleep031960-21fschecks_count07:09:220
31188226827,229sleep031233-21ntpq10:29:310
3176622636,240sleep00-21swapper/012:14:170
10810226179,157sleep00-21swapper/011:09:040
10810226179,157sleep00-21swapper/011:09:040
29929222627,60sleep030079-21dpkg08:44:060
1976922220,7sleep00-21swapper/008:09:330
20105222110,197sleep120162-21awk09:54:231
32602222017,36sleep10-21swapper/108:49:361
5416221966,82sleep05498-21latency_hist09:09:050
17376221335,51sleep017450-21switchtime09:44:330
804322039,176sleep08062-21fschecks_count10:59:230
30273220212,57sleep030282-21acpi08:44:140
30273220212,57sleep030282-21acpi08:44:140
1494621965,10sleep00-21swapper/007:55:000
19038219410,172sleep2201-21jbd2/mmcblk2p2-11:34:092
13839218615,154sleep20-21swapper/209:35:192
18442218516,150sleep00-21swapper/009:49:260
135921859,97sleep00-21swapper/007:14:100
6977218216,137sleep00-21swapper/009:14:050
25374218047,38sleep025406-21tune2fs11:54:220
25374218047,38sleep025406-21tune2fs11:54:220
1011321780,7sleep00-21swapper/007:39:330
20873217511,151sleep020911-21ntp_kernel_pll_08:14:300
1334217515,23sleep10-21swapper/108:54:281
6820217211,145sleep06215-21/usr/sbin/munin07:29:320
1550821657,147sleep00-21swapper/011:21:440
9338216411,134sleep00-21swapper/009:20:310
5099216414,134sleep05127-21kernelversion10:49:260
26753216310,133sleep00-21swapper/010:14:330
9042216225,121sleep29069-21basename07:39:032
14116216118,129sleep214189-21unin-run11:19:032
16288216022,23sleep00-21swapper/009:41:100
2566321598,28sleep00-21swapper/008:29:240
281612157128,18sleep028180-21munin-run12:04:030
29990215112,13sleep00-21swapper/010:24:350
3020321509,20sleep20-21swapper/212:09:142
3020321509,20sleep20-21swapper/212:09:142
20181214913,118sleep120203-21modprobe08:14:031
2499721485,110sleep00-21swapper/011:54:020
2499721485,110sleep00-21swapper/011:54:020
242521485,131sleep00-21swapper/010:39:490
8548214716,114sleep00-21swapper/009:19:060
1208421465,12sleep00-21swapper/011:11:020
1208421465,12sleep00-21swapper/011:11:020
10345214629,92sleep110398-21ls09:24:191
9592213617,104sleep19603-21awk11:04:201
9592213617,104sleep19603-21awk11:04:201
325121329,78sleep00-21swapper/010:44:130
901321319,86sleep00-21swapper/007:38:410
31563213019,83sleep331683-21sed10:29:383
2970921309,18sleep00-21swapper/012:09:040
2970921309,18sleep00-21swapper/012:09:040
17385212921,73sleep017367-21apt-get08:04:210
2476521266,106sleep024830-21if_eth010:09:240
1367721265,86sleep00-21swapper/007:53:350
2258821235,85sleep00-21swapper/010:02:060
30368212013,90sleep330393-21sh08:44:293
30368212013,90sleep330393-21sh08:44:293
491621195,12sleep00-21swapper/012:29:390
394821198,66sleep00-21swapper/007:19:350
1595221198,69sleep00-21swapper/011:24:140
361721185,81sleep00-21swapper/009:01:380
2870821175,81sleep00-21swapper/010:20:390
2179921175,81sleep00-21swapper/011:42:390
17348211638,53sleep10-21swapper/108:04:131
104921168,36sleep01126-21fschecks_time08:54:230
26715211525,71sleep126870-21wc08:34:051
23510211410,63sleep00-21swapper/011:49:050
2232621149,86sleep222343-21uname08:19:252
5632211227,44sleep30-21swapper/309:09:163
2796121125,12sleep00-21swapper/008:35:580
1596211019,72sleep11550-21apt-get07:14:481
3853210712,79sleep13824-21latency_hist09:04:051
21155210774,20sleep0289-21dbus-daemon09:59:030
1034421076,61sleep00-21swapper/009:24:180
8469210524,60sleep18474-21modprobe09:19:021
7639210423,65sleep11-21systemd10:59:031
31860210417,65sleep131952-21fschecks_time12:14:221
25684210215,71sleep225718-21ntp_kernel_pll_11:54:282
25684210215,71sleep225718-21ntp_kernel_pll_11:54:282
682321018,20sleep01-21systemd12:39:040
3140921005,83sleep00-21swapper/012:13:160
3140921005,83sleep00-21swapper/012:13:160
21151210025,58sleep321243-21mailstats11:39:313
2978429919,64sleep129942-21date12:09:051
2978429919,64sleep129942-21date12:09:051
2860429826,49sleep10-21swapper/108:39:221
594529710,71sleep35973-21munin-run07:29:033
1739829720,58sleep317367-21apt-get08:04:323
154432970,10sleep30-21swapper/307:59:063
621429513,67sleep16219-21sort07:29:131
2761029512,67sleep127757-21unixbench_singl11:59:361
191402948,15sleep00-21swapper/011:34:190
1411129461,19sleep10-21swapper/111:19:021
124929466,17sleep01256-21munin-run10:39:040
935429321,48sleep19417-21find09:20:321
1862429231,30sleep318696-21latency09:49:293
1761929214,12sleep20-21swapper/208:05:072
2347529115,60sleep323687-21latency_hist08:24:063
674029012,61sleep36817-21mailstats07:29:313
1314729035,36sleep00-21swapper/009:34:030
1314729035,36sleep00-21swapper/009:34:030
124992900,7sleep10-21swapper/107:49:191
3143728912,62sleep231560-21timerwakeupswit10:29:372
73552875,11sleep00-21swapper/010:55:230
523228720,53sleep35278-21ntp_offset10:49:293
318642876,12sleep00-21swapper/008:49:180
2385228719,51sleep223833-21apt-get08:24:212
184792877,11sleep00-21swapper/011:30:070
1809728711,19sleep218110-21munin-run09:49:032
1604928718,53sleep316113-21ps07:59:313
535128618,52sleep25385-21basename09:09:022
3036828620,53sleep330444-21fschecks_time12:09:513
3036828620,53sleep330444-21fschecks_time12:09:513
1597428617,36sleep10-21swapper/111:24:151
140742866,11sleep00-21swapper/011:18:330
120552866,11sleep00-21swapper/007:47:370
137562856,13sleep30-21swapper/309:35:163
530928426,31sleep20-21swapper/212:34:052
3219628417,45sleep131804-21/usr/sbin/munin07:09:271
2686628410,58sleep30-21swapper/311:59:183
155328412,59sleep214779-1kworker/2:1H07:14:162
1001528428,34sleep310108-21cat07:39:333
1688728317,43sleep116890-21/usr/sbin/munin09:44:221
1593628321,20sleep20-21swapper/209:39:352
81172825,11sleep30-21swapper/309:14:373
787228217,48sleep17905-21grep07:34:221
1919528221,17sleep20-21swapper/208:09:232
2032728117,43sleep320352-21ls11:39:033
3263728026,30sleep20-21swapper/210:34:262
2686528011,36sleep20-21swapper/211:59:172
1769928018,43sleep317713-21vmstat09:44:363
74827910,17sleep30-21swapper/307:14:053
2747427915,17sleep30-21swapper/310:19:043
141727922,27sleep30-21swapper/308:54:303
2529127818,45sleep125355-21cpuspeed11:54:191
2529127818,45sleep125355-21cpuspeed11:54:191
20822785,10sleep00-21swapper/012:23:010
514627710,45sleep20-21swapper/207:24:302
2047827725,29sleep20-21swapper/208:14:202
2739427622,34sleep127420-21modprobe10:19:021
2255627619,30sleep20-21swapper/211:44:272
312127422,24sleep30-21swapper/307:19:143
1731927427,24sleep30-21swapper/311:29:053
125727419,35sleep11343-21grep10:39:051
62127319,39sleep21-21systemd12:19:032
365127326,25sleep10-21swapper/107:19:321
2819727321,30sleep228222-21munin-run08:39:032
183542736,14sleep20-21swapper/209:49:202
1552327317,26sleep10-21swapper/109:39:261
984827114,25sleep10-21swapper/107:39:311
688527119,39sleep16951-21latency_hist12:39:051
599927123,22sleep10-21swapper/107:29:051
303127117,27sleep10-21swapper/112:24:311
2587727118,30sleep30-21swapper/310:14:043
2521527118,30sleep20-21swapper/210:09:352
2504627123,25sleep30-21swapper/311:54:053
2504627123,25sleep30-21swapper/311:54:053
163427118,28sleep10-21swapper/112:19:351
1010327122,24sleep30-21swapper/309:24:053
374327016,38sleep23817-21sed07:19:332
3136827016,34sleep131434-21cat10:29:361
3032127015,34sleep20-21swapper/208:44:282
3032127015,34sleep20-21swapper/208:44:282
1987027014,22sleep30-21swapper/309:54:133
1960627019,26sleep30-21swapper/308:09:323
1760727018,35sleep217610-21/usr/sbin/munin11:29:212
146427023,29sleep30-21swapper/310:39:113
138127011,28sleep20-21swapper/212:19:312
1376327020,23sleep20-21swapper/207:54:052
1236927014,42sleep112434-21sendmail_mailst09:29:321
1236927014,42sleep112434-21sendmail_mailst09:29:321
1146227023,23sleep30-21swapper/307:44:333
458826914,29sleep30-21swapper/310:49:043
117726912,31sleep30-21swapper/310:39:033
1115526915,35sleep211254-21fschecks_time11:09:222
1115526915,35sleep211254-21fschecks_time11:09:222
950926815,25sleep20-21swapper/211:04:172
950926815,25sleep20-21swapper/211:04:172
602926823,26sleep20-21swapper/212:34:292
327626820,27sleep23424-21grep08:59:342
2513426820,24sleep10-21swapper/110:09:341
209626818,23sleep20-21swapper/210:39:302
816526713,21sleep20-21swapper/210:59:252
2399626714,38sleep324005-21sshd08:25:113
2384026722,27sleep123947-21tune2fs11:49:221
2384026722,27sleep123947-21tune2fs11:49:221
229826727,22sleep20-21swapper/208:59:052
993526617,22sleep20-21swapper/207:39:322
829126624,21sleep30-21swapper/307:34:323
3234626614,32sleep30-21swapper/312:14:323
3149726629,23sleep2289-21dbus-daemon07:09:032
2967826616,33sleep3367-21snmpd12:09:033
2967826616,33sleep3367-21snmpd12:09:033
2173926620,31sleep121741-21cron08:19:031
1125526615,15sleep30-21swapper/311:09:233
1125526615,15sleep30-21swapper/311:09:233
1053526619,30sleep210584-21/usr/sbin/munin09:24:252
409526510,25sleep30-21swapper/309:04:193
2806926513,34sleep128083-21/usr/sbin/munin10:19:271
1798426513,22sleep30-21swapper/311:29:303
132382655,12sleep30-21swapper/311:14:483
1243526521,29sleep212503-21/usr/sbin/munin09:29:332
1243526521,29sleep212503-21/usr/sbin/munin09:29:332
2202526417,35sleep122110-21switchtime09:59:321
1776526414,34sleep117794-21irqstats11:29:241
1091326414,25sleep10-21swapper/107:44:191
2395026313,35sleep223953-21sshd10:04:422
2093826324,25sleep320975-21ps08:14:333
67942625,48sleep30-21swapper/312:38:543
316072629,38sleep031760-21latency_hist07:09:050
301726214,29sleep33075-21sendmail_mailqu08:59:313
153562627,11sleep20-21swapper/211:19:482
1311726217,24sleep30-21swapper/307:49:343
1077226222,24sleep310796-21ntp_states09:24:303
308262619,34sleep130899-21awk08:44:431
308262619,34sleep130899-21awk08:44:431
2901426117,25sleep20-21swapper/210:24:042
2950226013,29sleep229531-21irqstats10:24:242
2825726013,31sleep328326-21awk10:19:333
2740526019,22sleep10-21swapper/108:34:301
2560426015,29sleep325661-21/usr/sbin/munin08:29:233
840425915,17sleep30-21swapper/310:59:303
295982594,15sleep30-21swapper/308:41:463
2576525914,17sleep20-21swapper/208:29:262
2283025918,17sleep20-21swapper/210:04:052
1698225915,18sleep10-21swapper/108:04:051
67325820,24sleep2704-21munin-run07:14:042
565725816,26sleep25651-21apt-get09:09:192
366825818,26sleep23717-21awk10:44:352
3201025819,19sleep20-21swapper/208:49:252
2342625814,29sleep123462-21ntpq10:04:291
218992588,12sleep20-21swapper/211:43:582
1919625816,23sleep119257-21users09:49:391
637825716,19sleep30-21swapper/310:54:173
480625714,27sleep14824-21apt10:49:141
2868925715,28sleep20-21swapper/208:39:232
2144825711,18sleep30-21swapper/309:59:143
3063925619,22sleep130682-21ntp_offset07:04:271
2953225613,28sleep329589-21/usr/sbin/munin10:24:253
2571925612,19sleep30-21swapper/311:54:293
2571925612,19sleep30-21swapper/311:54:293
2200525618,20sleep10-21swapper/111:44:051
2081425616,20sleep20-21swapper/209:54:412
1257725613,25sleep112333-21apt-get11:14:061
1257725613,25sleep112333-21apt-get11:14:061
624125513,17sleep20-21swapper/207:29:182
590025519,20sleep15929-21irqstats09:09:261
3208025513,26sleep332133-21irqstats08:49:263
2331525512,26sleep123370-21systemd-run08:24:041
221125516,23sleep32359-21latency_hist12:24:053
73232544,38sleep20-21swapper/210:55:012
3024125414,23sleep330236-21apt-get07:04:163
2879125416,19sleep20-21swapper/212:04:292
2879125416,19sleep20-21swapper/212:04:292
2750025415,17sleep30-21swapper/308:34:323
1488525416,21sleep114891-21ntp_states11:19:311
928025313,24sleep28493-21apt-get09:19:522
436925314,23sleep14398-21nfs4_client12:29:281
3017225315,22sleep129694-21apt-get12:09:091
3017225315,22sleep129694-21apt-get12:09:091
2132625319,17sleep10-21swapper/111:39:331
1907025314,24sleep119065-21apt-get11:34:161
164232536,16sleep30-21swapper/309:42:553
1408325318,20sleep214089-21diskstats07:54:212
244925213,23sleep22442-21apt-get12:24:162
242892529,17sleep30-21swapper/310:09:033
1139525214,24sleep20-21swapper/207:44:322
83242516,14sleep20-21swapper/209:17:102
292952519,15sleep10-21swapper/110:24:191
2349425116,20sleep30-21swapper/311:49:043
1491525112,22sleep30-21swapper/311:19:333
1363725113,22sleep113160-21apt-get09:34:091
2379325018,13sleep20-21swapper/211:49:192
2379325018,13sleep20-21swapper/211:49:192
1000825017,17sleep30-21swapper/311:04:313
1000825017,17sleep30-21swapper/311:04:313
189424917,16sleep10-21swapper/110:39:251
1588724810,20sleep215950-21memory07:59:262
1605224712,20sleep216059-21diskstats11:24:202
56802458,14sleep20-21swapper/210:49:362
44422457,14sleep30-21swapper/312:29:303
1453824514,12sleep10-21swapper/107:54:331
242424010,15sleep30-21swapper/312:24:133
795923913,13sleep10-21swapper/110:59:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional