You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-21 - 18:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Fri Aug 21, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
153552666612,6641sleep015292-21kworker/0:007:47:200
188612314011,3114sleep018825-21apt-get11:24:590
92372110211,1076sleep318636-1kworker/3:0H10:54:373
9140252019,486sleep39184-21ntpq09:09:473
3615248410,461sleep13653-21fschecks_count12:19:421
19414247516,442sleep319475-21/usr/sbin/munin11:26:153
17428241114,383sleep317476-21ntpq11:19:493
17428241114,383sleep317476-21ntpq11:19:493
857239516,359sleep1922-21fschecks_time08:44:461
318223848,364sleep13226-21ntpq10:34:491
1880623759,350sleep118825-21apt-get11:24:351
287582329155,154sleep10-21swapper/110:14:261
1697322580,7sleep20-21swapper/211:19:272
13349224075,106sleep113478-21timerwakeupswit07:39:581
5658223750,90sleep10-21swapper/108:59:401
5658223750,90sleep10-21swapper/108:59:401
3843223661,158sleep13975-21latency_hist08:54:271
3137722318,208sleep131472-21perl12:04:441
16259221831,171sleep116281-21idleruntime-cro09:34:241
24347220521,165sleep024341-21apt-get09:59:390
7214220416,19sleep10-21swapper/110:49:261
7214220416,19sleep10-21swapper/110:49:261
30625220313,176sleep030702-21cat08:35:040
17153220211,129sleep10-21swapper/107:54:271
183421958,167sleep11916-21timerandwakeup10:29:561
2867219318,158sleep32901-21cut10:34:433
15465219044,66sleep10-21swapper/111:14:381
1765321864,171sleep00-21swapper/009:37:260
20890218353,109sleep120950-21fschecks_time08:04:531
17622217914,31sleep00-21swapper/011:19:540
17622217914,31sleep00-21swapper/011:19:540
13922217823,141sleep113987-21cpuspeed11:09:411
25097217524,130sleep325156-21basename08:19:243
25097217524,130sleep325156-21basename08:19:243
30703216814,70sleep10-21swapper/108:35:051
28540216677,18sleep10-21swapper/111:54:511
754421599,135sleep17635-21grep10:49:431
30346215711,131sleep130459-21latency_hist10:19:261
31188215631,70sleep131277-21cat10:19:551
548321536,135sleep10-21swapper/110:42:441
18308214715,113sleep218321-21apt-get11:24:242
18308214715,113sleep218321-21apt-get11:24:242
21492213816,102sleep021556-21cat09:49:460
28996213515,104sleep028991-21apt-get10:14:370
26100213511,109sleep126226-21cat08:20:031
26100213511,109sleep126226-21cat08:20:031
805321349,54sleep10-21swapper/107:24:521
8077212613,18sleep00-21swapper/010:49:540
14712212540,71sleep114743-21idleruntime-cro09:29:241
6882212314,80sleep10-21swapper/107:19:551
26072212215,25sleep226131-21basename10:04:462
9210212041,61sleep10-21swapper/110:54:351
1517221199,97sleep114237-21/usr/sbin/munin07:44:591
20986211814,19sleep10-21swapper/109:49:261
24125211748,30sleep10-21swapper/111:39:541
20470211611,71sleep20-21swapper/211:29:412
6047211441,53sleep10-21swapper/107:19:271
6047211441,53sleep10-21swapper/107:19:271
455821128,86sleep00-21swapper/008:54:540
2989211235,56sleep10-21swapper/107:09:461
9369211132,45sleep10-21swapper/112:38:361
2666211115,80sleep32675-21df_inode08:50:293
16755211114,82sleep116797-21if_eth009:34:451
360721108,16sleep00-21swapper/012:19:410
1186721100,6sleep30-21swapper/309:19:273
22358210933,34sleep10-21swapper/111:34:491
28998210823,25sleep20-21swapper/210:14:392
28783210849,36sleep30-21swapper/311:54:573
23993210839,32sleep10-21swapper/109:58:591
12052210734,13sleep12496-21cyclictest11:04:041
11667210711,84sleep111715-21cat09:19:261
11112210733,14sleep10-21swapper/107:34:371
9678210619,71sleep39766-21fschecks_time07:29:463
29710210632,35sleep10-21swapper/111:59:361
19643210532,14sleep10-21swapper/108:00:011
19643210532,14sleep10-21swapper/108:00:011
11905210432,33sleep10-21swapper/109:19:381
6266210332,40sleep10-21swapper/112:28:311
2756021030,9sleep30-21swapper/308:24:573
9665210236,33sleep10-21swapper/107:29:441
32395210118,63sleep332432-21grep10:24:453
29735210119,67sleep029729-21apt-get11:59:390
28214210136,12sleep10-21swapper/108:29:201
2388210135,51sleep10-21swapper/112:14:501
1363421019,55sleep113681-21unin-run11:09:251
31121005,60sleep10-21swapper/108:42:561
31121005,60sleep10-21swapper/108:42:561
2903221009,53sleep10-21swapper/108:30:041
23906210031,12sleep10-21swapper/108:14:421
23906210031,12sleep10-21swapper/108:14:421
10898210012,73sleep210968-21fschecks_time10:59:412
77962995,62sleep10-21swapper/112:33:191
1857529811,70sleep00-21swapper/009:39:520
176252989,78sleep117669-21latency07:54:481
43292975,11sleep00-21swapper/010:39:320
2561429712,71sleep125619-21modprobe10:04:241
191829722,50sleep22072-21unixbench_multi10:29:572
986129624,50sleep29913-21latency07:29:492
84712967,72sleep10-21swapper/109:09:251
3249529627,11sleep10-21swapper/110:24:471
1139229617,63sleep311407-21irqstats07:34:473
2585729512,68sleep025880-21ntp_states08:19:580
2585729512,68sleep025880-21ntp_states08:19:580
1040629515,66sleep310410-21entropy09:14:443
404229419,33sleep00-21swapper/010:39:240
2119829313,17sleep10-21swapper/109:49:341
534029226,45sleep25359-21sendmail08:59:252
202029127,46sleep22084-21sort12:14:432
515229013,62sleep25161-21/usr/sbin/munin12:24:402
100732907,47sleep10-21swapper/109:14:261
170512899,17sleep10-21swapper/111:19:391
170512899,17sleep10-21swapper/111:19:391
493728812,54sleep20-21swapper/207:14:472
493728812,54sleep20-21swapper/207:14:472
2813828817,47sleep028157-21apt-get11:54:380
1589228720,33sleep00-21swapper/007:49:420
1418628722,47sleep30-21swapper/311:09:473
1354628727,27sleep30-21swapper/309:24:453
404928520,47sleep34163-21date07:14:283
259892857,65sleep126069-21tune2fs10:04:451
216492847,13sleep10-21swapper/111:34:251
184432849,13sleep10-21swapper/109:39:491
1230228415,47sleep012336-21/usr/sbin/munin09:19:500
341228323,37sleep23567-21unixbench_multi07:09:552
226528312,58sleep02374-21dpkg08:49:330
293228214,51sleep02988-21/usr/sbin/munin07:09:450
270282827,15sleep10-21swapper/111:49:511
270282827,15sleep10-21swapper/111:49:511
1663228214,47sleep316522-21/usr/sbin/munin09:34:433
2651328110,55sleep026617-21wc10:04:560
2274428112,49sleep022763-21apt-get09:54:340
150328130,32sleep30-21swapper/307:04:473
4632806,14sleep10-21swapper/112:09:411
1239428026,34sleep012412-21modprobe07:39:240
746027920,28sleep30-21swapper/312:29:583
3260027925,28sleep20-21swapper/212:09:262
2936527921,39sleep329399-21ntp_kernel_err10:14:483
253127819,43sleep22523-21apt-get08:49:392
2319927831,11sleep10-21swapper/108:10:021
164127828,24sleep00-21swapper/007:04:530
1008327816,17sleep20-21swapper/209:14:272
321252778,52sleep20-21swapper/210:24:362
708727612,51sleep27095-21open_files12:29:532
173927623,28sleep10-21swapper/107:04:541
965827526,30sleep20-21swapper/210:54:572
699427517,27sleep30-21swapper/309:04:263
699427517,27sleep30-21swapper/309:04:263
2669827520,28sleep30-21swapper/311:49:453
2669827520,28sleep30-21swapper/311:49:453
601027423,26sleep00-21swapper/007:19:260
601027423,26sleep00-21swapper/007:19:260
120227410,13sleep00-21swapper/010:29:350
943027316,22sleep00-21swapper/012:39:240
75527320,36sleep3801-21awk12:09:473
2514927315,44sleep325222-21grep11:44:443
2514927315,44sleep325222-21grep11:44:443
3063227216,40sleep330657-21df_inode10:19:413
2477327219,35sleep324793-21modprobe11:44:243
62492718,48sleep30-21swapper/307:19:373
3023327116,18sleep30-21swapper/308:34:553
279392719,14sleep00-21swapper/011:54:260
279392719,14sleep00-21swapper/011:54:260
254222716,12sleep20-21swapper/208:19:402
254222716,12sleep20-21swapper/208:19:402
1548727133,19sleep20-21swapper/209:29:532
317062706,13sleep30-21swapper/312:04:513
2723627024,21sleep20-21swapper/211:49:562
2723627024,21sleep20-21swapper/211:49:562
220627022,26sleep30-21swapper/308:49:323
183227016,37sleep21989-21unixbench_singl07:04:552
98562698,11sleep00-21swapper/009:12:110
603426913,40sleep26078-21ntpq08:59:492
603426913,40sleep26078-21ntpq08:59:492
1807526918,31sleep218234-21unixbench_singl07:54:572
1304926913,40sleep213210-21unixbench_multi11:04:542
121332699,15sleep30-21swapper/311:04:263
515026816,34sleep35251-21/usr/sbin/munin10:39:563
235842688,16sleep00-21swapper/011:39:400
202762689,46sleep00-21swapper/008:02:180
202762689,46sleep00-21swapper/008:02:180
1619726818,24sleep20-21swapper/207:49:482
92626722,20sleep20-21swapper/208:44:472
73492679,49sleep00-21swapper/007:22:200
661926715,20sleep20-21swapper/207:19:482
1158826716,26sleep00-21swapper/009:19:250
553926612,21sleep00-21swapper/012:24:500
2878826621,28sleep228800-21/usr/sbin/munin08:29:572
206232666,11sleep00-21swapper/009:45:260
1090126617,32sleep011026-21latency_hist07:34:280
505126517,18sleep30-21swapper/312:24:333
41612658,43sleep10-21swapper/108:54:431
321002656,12sleep30-21swapper/308:39:553
321002656,12sleep30-21swapper/308:39:553
30662659,46sleep00-21swapper/012:17:310
2522726521,25sleep00-21swapper/011:44:450
2522726521,25sleep00-21swapper/011:44:450
2312126510,27sleep30-21swapper/308:10:003
923926412,25sleep09230-21apt-get10:54:380
3221326410,25sleep00-21swapper/010:24:420
260192645,28sleep10-21swapper/111:45:311
260192645,28sleep10-21swapper/111:45:311
1812926411,20sleep20-21swapper/209:39:422
1560726416,26sleep20-21swapper/207:49:282
1462526421,19sleep30-21swapper/307:44:483
74482638,35sleep30-21swapper/310:49:363
3212526320,25sleep00-21swapper/008:39:560
3212526320,25sleep00-21swapper/008:39:560
298532638,20sleep30-21swapper/308:34:263
2764826320,20sleep00-21swapper/008:24:590
2566526321,22sleep30-21swapper/310:04:263
1637926319,21sleep30-21swapper/307:49:533
1372826323,22sleep20-21swapper/209:24:482
1361226313,32sleep313624-21vmstat07:40:003
935226215,30sleep09478-21latency_hist07:29:270
503226215,32sleep35059-21awk07:14:483
503226215,32sleep35059-21awk07:14:483
2755826221,19sleep30-21swapper/310:09:433
2064926217,22sleep20-21swapper/208:04:302
1163826219,25sleep20-21swapper/207:34:542
806026121,22sleep20-21swapper/207:24:572
321226118,18sleep30-21swapper/312:19:243
3021726114,21sleep20-21swapper/208:34:542
2382726115,27sleep023823-21apt-get08:14:370
2382726115,27sleep023823-21apt-get08:14:370
2078126114,21sleep00-21swapper/011:29:470
1916926123,21sleep20-21swapper/207:59:372
1877726120,25sleep018921-21gpgv07:59:270
118802619,37sleep211881-21/usr/sbin/munin09:19:352
435726012,24sleep20-21swapper/210:39:382
322826019,22sleep20-21swapper/210:34:502
3175226011,35sleep2231-21systemd-journal10:23:192
2535426016,23sleep225329-21apt-get08:19:362
2535426016,23sleep225329-21apt-get08:19:362
2169926021,19sleep30-21swapper/311:34:273
1288226010,24sleep00-21swapper/011:04:520
3156025918,21sleep00-21swapper/012:04:480
2795125915,26sleep00-21swapper/010:09:520
1852825912,32sleep318571-21ntp_offset09:39:513
1557325914,27sleep315643-21/usr/sbin/munin09:29:543
4682589,29sleep2351-21/usr/sbin/munin12:09:422
3189125816,26sleep031953-21latency_hist10:24:260
28642589,12sleep00-21swapper/008:50:340
2193325815,27sleep021929-21apt-get11:34:360
1404225810,26sleep20-21swapper/207:44:272
683725713,26sleep06894-21/usr/sbin/munin12:29:470
2736725719,22sleep20-21swapper/208:24:532
2296725710,31sleep223120-21awk08:09:592
1087325718,21sleep20-21swapper/209:14:552
479025612,19sleep30-21swapper/312:24:253
1680525616,22sleep00-21swapper/011:19:260
1565225611,29sleep015785-21sed09:29:550
1460125616,20sleep00-21swapper/011:09:570
951125514,24sleep29610-21latency_hist12:39:262
767525514,25sleep27681-21ntp_states09:04:582
744725515,23sleep27444-21apt-get10:49:352
3209325512,25sleep20-21swapper/208:39:542
3209325512,25sleep20-21swapper/208:39:542
2753425514,18sleep20-21swapper/210:09:422
2249625513,24sleep022548-21interrupts08:09:490
1283525517,24sleep312873-21processes11:04:513
590125414,24sleep05896-21apt-get10:44:370
590125414,24sleep05896-21apt-get10:44:370
1599725419,16sleep30-21swapper/311:14:523
1088325412,25sleep010892-21df_inode10:59:390
800525312,24sleep37525-21apt-get07:24:333
736525313,24sleep37426-21perl09:04:513
565725313,23sleep05651-21apt-get08:59:390
565725313,23sleep05651-21apt-get08:59:390
2506325313,24sleep225057-21apt-get11:44:392
2506325313,24sleep225057-21apt-get11:44:392
2144125315,23sleep321490-21irqstats09:49:453
1918625311,23sleep319254-21df07:59:463
1918625311,23sleep319254-21df07:59:463
1476625310,19sleep00-21swapper/009:29:270
2980925212,24sleep329818-21diskstats11:59:423
269002524,12sleep30-21swapper/310:06:043
221382526,35sleep20-21swapper/209:50:002
212472526,11sleep20-21swapper/208:05:022
1975925215,20sleep20-21swapper/209:44:432
1326825212,19sleep00-21swapper/007:39:570
772625110,16sleep00-21swapper/009:05:000
2840925113,22sleep228432-21irqstats11:54:482
1734225112,22sleep317350-21apt-get07:54:383
38025012,23sleep0375-21apt-get12:09:360
3104825014,17sleep20-21swapper/212:04:252
2348825011,27sleep223504-21awk11:39:342
219102508,20sleep30-21swapper/311:34:353
207525012,23sleep32131-21users10:29:583
2562024915,18sleep20-21swapper/210:04:252
2402924912,21sleep224057-21munin-run09:59:252
2322124911,22sleep323228-21ntp_states09:54:493
2220624915,18sleep20-21swapper/211:34:462
2073924912,18sleep320809-21df08:04:433
1873324911,21sleep218321-21apt-get11:24:282
1443324912,23sleep214521-21mailstats11:09:552
590324711,18sleep20-21swapper/210:44:392
590324711,18sleep20-21swapper/210:44:392
408524711,21sleep34152-21df08:54:413
2851524714,18sleep00-21swapper/008:29:390
1654624711,20sleep216542-21apt-get09:34:372
863924612,16sleep30-21swapper/312:34:503
2052824612,20sleep320575-21users09:44:563
2073624513,18sleep00-21swapper/008:04:400
2548724212,14sleep30-21swapper/308:19:413
2548724212,14sleep30-21swapper/308:19:413
58982407,16sleep30-21swapper/310:44:363
58982407,16sleep30-21swapper/310:44:363
35212407,16sleep20-21swapper/212:19:352
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional