You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 21:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Sat Aug 01, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18169226045,2557sleep231432-21kworker/u8:110:22:552
91352216913,2137sleep39128-21apt-get08:12:543
327552838102,720sleep332764-21/usr/sbin/munin09:27:403
25950270817,675sleep126014-21/usr/sbin/munin07:23:011
11544270615,671sleep311672-21/usr/sbin/munin11:43:123
1094260216,567sleep31157-21/usr/sbin/munin09:28:093
24022254411,519sleep024032-21ntpq12:23:070
259924810,18sleep32075-21/usr/sbin/munin09:33:083
2732624657,448sleep2364-21snmpd07:27:512
25322459308,31sleep20-21swapper/211:17:392
1959024417,418sleep319600-21ntpq07:03:043
41582406115,238sleep24220-21latency_hist11:22:402
1554238086,278sleep11635-21memory11:13:021
7430232972,201sleep27554-21timerwakeupswit09:48:102
25127227332,89sleep20-21swapper/212:27:572
25127227332,89sleep20-21swapper/212:27:572
434226641,211sleep2577-21unixbench_singl11:08:142
2178722649,197sleep221821-21idleruntime-cro08:52:392
256542253128,105sleep225675-21apt10:47:382
12778225159,137sleep212888-21latency_hist10:07:402
1645422446,204sleep2364-21snmpd11:58:172
28936222784,112sleep20-21swapper/207:32:432
8895222641,53sleep20-21swapper/208:12:412
25559222241,55sleep20-21swapper/207:22:422
25559222241,55sleep20-21swapper/207:22:422
32501221772,122sleep20-21swapper/207:43:012
32501221772,122sleep20-21swapper/207:43:012
18590221611,146sleep2225-21systemd-journal12:07:382
20528221480,86sleep220407-21/usr/sbin/munin12:12:592
15395221018,141sleep215530-21cut08:32:402
3277220853,137sleep23315-21ntp_kernel_err07:53:032
9595220714,151sleep29671-21latency11:38:102
13937220727,60sleep20-21swapper/211:52:522
613022039,179sleep26207-21fschecks_time08:03:002
2304521848,158sleep223090-21ntp_kernel_pll_07:13:042
26758218332,82sleep226791-21fschecks_count12:32:582
9578218216,98sleep29597-21modprobe09:57:392
9578218216,98sleep29597-21modprobe09:57:392
1505921788,158sleep215084-21cut10:13:012
1306421749,11sleep00-21swapper/011:48:100
20300216751,63sleep220450-21latency_hist08:47:422
2175421596,80sleep20-21swapper/207:09:412
530621578,37sleep20-21swapper/209:42:572
2885321579,126sleep20-21swapper/209:13:102
1016821569,134sleep210247-21cat09:58:032
11888215513,50sleep20-21swapper/211:44:402
27866215013,119sleep127955-21mailstats07:28:101
13164214832,101sleep213297-21timerwakeupswit08:23:112
22743214615,117sleep222868-21timerwakeupswit08:53:122
17993214658,66sleep30-21swapper/312:03:473
13332214428,75sleep213362-21fschecks_count10:08:012
13332214428,75sleep213362-21fschecks_count10:08:012
5710214116,110sleep35860-21cut11:27:413
26534213924,24sleep20-21swapper/209:07:412
24971213611,109sleep225039-21latency_hist09:02:402
24971213611,109sleep225039-21latency_hist09:02:402
398021358,116sleep1364-21snmpd07:55:161
10945213517,47sleep20-21swapper/208:17:502
29909213128,69sleep229901-21apt-get09:17:542
730213027,37sleep20-21swapper/209:28:002
3432213010,80sleep23454-21sshd09:37:402
24883212941,27sleep20-21swapper/212:27:412
1780521287,85sleep217841-21ntpq08:38:062
27202212619,41sleep20-21swapper/210:52:392
4944212466,46sleep25009-21swap11:23:082
2611212221,83sleep00-21swapper/011:17:410
17108212112,91sleep00-21swapper/008:37:390
19677212025,68sleep20-21swapper/207:03:072
32714211921,37sleep20-21swapper/209:27:392
27134211921,83sleep327174-21proc_pri12:33:073
30805211815,89sleep330816-21awk07:38:013
17426211829,62sleep017419-21apt-get08:37:550
32012211710,41sleep20-21swapper/207:42:412
23031211721,25sleep10-21swapper/107:13:031
2199421175,30sleep20-21swapper/212:17:482
17636211732,68sleep217673-21http10:22:392
17636211732,68sleep217673-21http10:22:392
476721156,29sleep20-21swapper/209:40:312
20806211411,88sleep020814-21df07:07:570
3115621138,37sleep20-21swapper/211:03:132
29144211017,77sleep329208-21cpuspeed07:32:563
2812121100,8sleep10-21swapper/112:37:401
22010210820,66sleep022145-21grep10:33:150
376721076,36sleep00-21swapper/009:37:590
13370210716,72sleep113438-21uniq10:08:041
13370210716,72sleep113438-21uniq10:08:041
2496621050,14sleep30-21swapper/312:27:413
632210426,25sleep10-21swapper/109:27:591
20213210410,24sleep20-21swapper/210:28:082
20213210410,24sleep20-21swapper/210:28:082
29669210317,70sleep129804-21latency_hist09:17:411
16571210310,78sleep016573-21sshd11:59:410
25949210217,68sleep025999-21/usr/sbin/munin10:47:570
1525521007,14sleep00-21swapper/010:13:080
10619210018,69sleep010675-21latency_hist11:42:400
3244729920,23sleep10-21swapper/111:08:051
1658229820,34sleep20-21swapper/208:33:172
2488329713,71sleep024962-21mailstats10:43:080
238912975,12sleep20-21swapper/210:39:512
1613929720,49sleep116146-21sshd10:17:411
69492965,12sleep20-21swapper/211:29:182
592429612,64sleep00-21swapper/011:27:500
557429418,65sleep20-21swapper/208:00:262
3072229412,67sleep030772-21cpuspeed07:37:580
2860829428,43sleep31-21systemd07:32:403
2321929418,62sleep123256-21sed10:38:041
2060429413,64sleep020613-21/usr/sbin/munin08:47:570
1372729417,54sleep313788-21sendmail_mailqu10:08:143
1372729417,54sleep313788-21sendmail_mailqu10:08:143
136029418,36sleep20-21swapper/207:47:542
136029418,36sleep20-21swapper/207:47:542
725829319,60sleep17356-21cat11:32:401
101132935,35sleep20-21swapper/208:14:032
804229213,60sleep18110-21swap11:33:091
574529222,55sleep15760-21ls08:02:391
522229219,47sleep35197-21/usr/sbin/munin09:42:543
2311929217,60sleep323188-21latency10:38:023
2252829218,63sleep20-21swapper/210:37:372
2960729119,58sleep129639-21proc_pri07:33:111
2539329115,53sleep10-21swapper/112:28:041
2539329115,53sleep10-21swapper/112:28:041
218729117,56sleep12223-21fschecks_count09:32:591
2683229024,55sleep20-21swapper/207:24:442
2491929024,45sleep024934-21modprobe09:02:380
2491929024,45sleep024934-21modprobe09:02:380
201382907,49sleep20-21swapper/212:12:392
135402907,71sleep2364-21snmpd11:50:582
437628916,47sleep04395-21apt-get11:22:500
1122228912,60sleep011279-21sshd08:18:410
322712887,14sleep10-21swapper/107:42:561
322712887,14sleep10-21swapper/107:42:561
1942528814,56sleep119459-21awk10:27:381
883028717,44sleep08912-21gpgv11:37:400
1381728717,44sleep313948-21sort08:27:413
357528623,21sleep10-21swapper/111:18:101
2947828619,29sleep20-21swapper/210:58:042
2776728622,29sleep20-21swapper/210:53:042
3071028518,50sleep330717-21/usr/sbin/munin11:03:023
734628419,45sleep17427-21switchtime09:48:091
273622849,34sleep20-21swapper/209:08:092
2425728420,50sleep124399-21unixbench_multi12:23:121
2254428417,46sleep322055-21/usr/sbin/munin08:53:083
1160728421,47sleep111691-21find08:18:501
2414628312,58sleep024156-21pluginstate10:42:400
1684628312,52sleep116933-21gpgv12:02:401
687028214,18sleep30-21swapper/309:47:593
841028018,44sleep08426-21sort09:53:010
841028018,44sleep08426-21sort09:53:010
487728016,46sleep14942-21grep11:23:071
2449428027,29sleep30-21swapper/310:42:593
2425628023,40sleep124337-21find08:58:111
2425628023,40sleep124337-21find08:58:111
2251528013,50sleep122534-21ntp_states08:53:061
1665527915,18sleep00-21swapper/010:18:040
1665527915,18sleep00-21swapper/010:18:040
79532786,14sleep20-21swapper/211:33:052
448927810,14sleep00-21swapper/007:57:570
2747027817,42sleep327489-21apt-get10:52:523
1553127835,24sleep30-21swapper/308:32:413
1024827819,41sleep39874-21/usr/sbin/munin09:58:043
457227718,32sleep30-21swapper/307:58:003
2090827726,29sleep30-21swapper/312:13:083
1935227711,51sleep119416-21ps12:08:101
270892769,56sleep326563-1kworker/3:0H10:51:113
1621727518,39sleep316364-21grep11:58:103
2641127412,15sleep30-21swapper/307:23:113
1005527420,27sleep30-21swapper/311:38:193
1001627413,42sleep00-21swapper/008:13:120
262472737,52sleep00-21swapper/009:04:440
204527321,28sleep00-21swapper/007:48:120
204527321,28sleep00-21swapper/007:48:120
1985727329,26sleep020037-21sed07:03:090
821627214,24sleep30-21swapper/311:33:113
2402527224,24sleep30-21swapper/308:58:053
2402527224,24sleep30-21swapper/308:58:053
2028227216,31sleep10-21swapper/108:47:411
1813627218,34sleep017650-21apt-get10:22:490
1784727219,28sleep10-21swapper/110:22:421
1784727219,28sleep10-21swapper/110:22:421
173227225,26sleep10-21swapper/107:48:051
173227225,26sleep10-21swapper/107:48:051
1647427219,35sleep116579-21timerandwakeup08:33:161
1433627222,26sleep10-21swapper/108:28:031
221922715,11sleep30-21swapper/310:33:183
1271227115,40sleep112777-21dpkg10:07:391
424327020,25sleep00-21swapper/007:57:410
3254627013,25sleep30-21swapper/311:08:073
2999527011,22sleep30-21swapper/309:17:593
2203827024,20sleep30-21swapper/307:12:413
3091826912,22sleep10-21swapper/107:38:031
2866526919,32sleep028662-21munin-run07:32:410
2257826910,13sleep00-21swapper/008:53:090
2081526918,36sleep120817-21diskstats07:07:581
2757026813,37sleep127579-21diskstats10:52:591
3100126723,25sleep10-21swapper/111:03:081
2550726716,34sleep325529-21modprobe07:22:383
2550726716,34sleep325529-21modprobe07:22:383
765826612,38sleep37664-21df_inode08:07:583
3174026613,28sleep00-21swapper/009:23:130
2529726625,24sleep30-21swapper/309:02:573
2266726612,26sleep00-21swapper/007:12:540
1531526617,30sleep015331-21apt-get08:32:380
889826520,20sleep30-21swapper/309:53:123
889826520,20sleep30-21swapper/309:53:123
652426520,27sleep36577-21/usr/sbin/munin08:03:093
1896826510,41sleep318996-21cut12:07:593
1844826515,34sleep318144-21/usr/sbin/munin10:23:083
1107426514,35sleep111126-21interrupts11:43:021
261426415,27sleep30-21swapper/307:52:393
261426415,27sleep30-21swapper/307:52:393
207112649,16sleep10-21swapper/112:13:021
1421026415,31sleep014233-21irqstats11:53:020
1318026419,23sleep10-21swapper/111:48:111
364726324,20sleep30-21swapper/309:37:503
3131326320,23sleep00-21swapper/011:03:150
3121626316,29sleep031270-21sshd09:22:410
2333326320,24sleep30-21swapper/312:22:413
1479326311,15sleep30-21swapper/310:12:543
826226218,29sleep10-21swapper/108:08:121
223022626,14sleep10-21swapper/110:34:411
214202626,10sleep00-21swapper/012:14:020
2103326218,19sleep30-21swapper/310:32:413
2103326218,19sleep30-21swapper/310:32:413
208622626,16sleep00-21swapper/010:31:050
208622626,16sleep00-21swapper/010:31:050
1309326219,22sleep10-21swapper/108:23:101
3262626115,25sleep00-21swapper/007:43:030
3262626115,25sleep00-21swapper/007:43:030
2563326118,18sleep00-21swapper/012:28:110
2563326118,18sleep00-21swapper/012:28:110
2008226112,19sleep10-21swapper/110:28:031
2008226112,19sleep10-21swapper/110:28:031
1298226113,30sleep313062-21switchtime11:48:093
109492615,11sleep10-21swapper/109:59:521
331826016,25sleep33360-21ntp_states07:53:043
2980426019,23sleep00-21swapper/007:33:140
2967426018,22sleep30-21swapper/310:58:093
2767926012,30sleep027737-21if_err_eth010:53:020
2238926013,32sleep10-21swapper/112:18:071
1961126020,22sleep10-21swapper/107:03:061
416125915,18sleep10-21swapper/109:38:081
3259425914,17sleep00-21swapper/011:08:080
2916025926,18sleep00-21swapper/010:57:580
2549425918,26sleep325525-21/usr/sbin/munin12:28:063
2549425918,26sleep325525-21/usr/sbin/munin12:28:063
2463425916,19sleep00-21swapper/007:18:030
2463425916,19sleep00-21swapper/007:18:030
2052925914,27sleep120523-21apt-get08:47:541
149052595,12sleep30-21swapper/311:53:383
2832325814,27sleep328317-21apt-get09:12:553
257825816,26sleep32609-21munin-run11:17:403
2100825812,27sleep321065-21/usr/sbin/munin08:48:083
1055625814,26sleep110740-21sshd08:17:411
842825714,24sleep18531-21perl09:53:021
842825714,24sleep18531-21perl09:53:021
1888525714,27sleep018949-21/usr/sbin/munin12:07:560
1604225719,20sleep30-21swapper/308:33:063
93192569,24sleep10-21swapper/111:37:571
2943725616,19sleep10-21swapper/110:58:031
2686025613,25sleep326920-21fschecks_time09:07:583
2230025616,25sleep022388-21sed12:18:060
1750325617,24sleep317509-21diskstats08:37:583
1167625614,23sleep011765-21users11:43:130
116125610,18sleep00-21swapper/009:28:100
346425518,17sleep00-21swapper/011:18:090
3175825515,24sleep131843-21memory09:23:141
2878525512,20sleep00-21swapper/009:13:080
284725515,23sleep32843-21apt-get11:17:523
2688225512,12sleep00-21swapper/012:33:000
2266525512,26sleep322660-21apt-get07:12:533
2023025511,18sleep30-21swapper/308:47:393
1755225514,22sleep10-21swapper/112:03:371
1735725512,23sleep017425-21df12:03:120
1289025513,18sleep30-21swapper/310:07:413
802925414,23sleep08045-21ntp_states08:08:070
540625418,18sleep00-21swapper/009:42:590
1404725415,22sleep10-21swapper/111:52:591
1076825413,23sleep010801-21users09:58:140
657925315,19sleep00-21swapper/008:03:100
2594525312,24sleep125942-21apt-get10:47:541
1873225313,24sleep118785-21cat08:42:411
1767525313,18sleep30-21swapper/310:22:403
1767525313,18sleep30-21swapper/310:22:403
1100325314,23sleep310947-21apt-get08:18:283
71412525,10sleep30-21swapper/311:31:453
529625210,18sleep10-21swapper/109:42:561
253992528,35sleep10-21swapper/107:21:151
253992528,35sleep10-21swapper/107:21:151
1950225215,15sleep00-21swapper/008:43:080
697125114,16sleep00-21swapper/009:48:000
2677025112,23sleep026767-21apt-get09:07:510
2626525112,20sleep00-21swapper/007:23:080
612825012,23sleep16129-21diskstats08:02:591
210025013,21sleep00-21swapper/009:32:540
1352025012,22sleep013579-21latency10:08:070
1352025012,22sleep013579-21latency10:08:070
3234824812,22sleep332240-21/usr/sbin/munin07:42:583
3234824812,22sleep332240-21/usr/sbin/munin07:42:583
2728124712,15sleep10-21swapper/109:08:081
2570124714,18sleep125786-21mailstats09:03:081
1153924718,16sleep00-21swapper/010:02:580
2439624411,18sleep10-21swapper/110:42:531
125842448,13sleep00-21swapper/008:22:570
299742436,14sleep10-21swapper/109:17:571
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional