You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 15:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7s.osadl.org (updated Thu Aug 06, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
55772866418,8628sleep019869-21kworker/0:108:42:460
58072304011,3015sleep222807-21kworker/u8:007:02:412
58072304011,3015sleep222807-21kworker/u8:007:02:412
48542237611,2351sleep11148-21kworker/u8:212:08:171
311692110314,1053sleep131171-21sshd10:05:091
11887279513,768sleep211973-21/usr/sbin/munin09:02:502
10045275816,724sleep210085-21/usr/sbin/munin08:57:412
10045275816,724sleep210085-21/usr/sbin/munin08:57:412
29000261913,591sleep328993-21apt-get11:42:353
29000261913,591sleep328993-21apt-get11:42:353
5157251919,485sleep25149-21apt-get08:42:352
15891248218,446sleep215905-21/usr/sbin/munin10:57:542
31101244675,168sleep131104-21cron08:22:201
31101244675,168sleep131104-21cron08:22:201
2685123609,337sleep026900-21ntpq08:07:460
11490233518,256sleep111583-21fschecks_time09:02:411
625227113,215sleep1825-21apt-config10:12:241
10299226316,110sleep110338-21wc08:57:481
10299226316,110sleep110338-21wc08:57:481
7747223936,186sleep17822-21switchtime10:32:501
19555223312,207sleep319594-21ntpq09:27:453
14665222036,28sleep10-21swapper/107:27:511
23955221962,101sleep10-21swapper/111:26:191
2310221713,187sleep32248-21latency_hist10:17:223
1302222120,7sleep10-21swapper/109:07:361
19952220318,37sleep119963-21modprobe07:47:201
29665219930,26sleep10-21swapper/108:17:481
1221218615,153sleep11368-21latency_hist11:57:231
17351218013,152sleep017397-21unin-run09:22:210
24225217451,27sleep10-21swapper/109:42:451
17332217110,120sleep10-21swapper/109:22:101
966216815,91sleep10-21swapper/108:27:491
493821649,131sleep00-21swapper/012:08:280
12675216311,136sleep012561-21/usr/sbin/munin12:32:420
21473216213,109sleep121620-21awk09:32:521
17722215611,108sleep117727-21entropy09:22:391
17241215211,40sleep117331-21fschecks_time07:37:401
18994215016,80sleep119009-21awk11:07:541
19907214913,121sleep219925-21uname11:12:432
19907214913,121sleep219925-21uname11:12:432
14970214718,55sleep10-21swapper/109:12:461
14678214632,38sleep114739-21sendmail-msp10:57:201
7471214112,111sleep07559-21tune2fs07:07:390
21499214117,90sleep10-21swapper/111:17:431
3066721380,6sleep30-21swapper/310:02:523
352221365,118sleep00-21swapper/010:18:400
26613213617,99sleep326746-21grep11:32:503
23831213524,47sleep00-21swapper/009:42:320
518213421,93sleep0624-21wc10:12:230
8645213251,44sleep18672-21munin-run07:12:201
6040213056,56sleep36073-21/usr/sbin/munin10:27:483
1432212915,55sleep18707-21munin-node11:57:311
2056721288,85sleep1364-21snmpd11:13:031
2056721288,85sleep1364-21snmpd11:13:031
1662021248,14sleep10-21swapper/111:02:371
2230212137,19sleep10-21swapper/110:17:201
21880212134,25sleep10-21swapper/107:52:411
3991212015,93sleep14037-21ntp_kernel_pll_08:37:461
16908211914,92sleep116981-21date07:37:231
16908211914,92sleep116981-21date07:37:231
25585211563,35sleep125605-21modprobe11:32:201
19424211520,79sleep219574-21latency_hist11:12:232
2311821140,9sleep223076-21munin-run07:57:212
31629211317,19sleep20-21swapper/210:07:362
29461211316,76sleep00-21swapper/011:42:480
29461211316,76sleep00-21swapper/011:42:480
9700211210,39sleep10-21swapper/112:22:421
5793211218,55sleep10-21swapper/108:42:511
4783211220,70sleep24944-21unixbench_multi10:22:542
1041221125,10sleep00-21swapper/007:14:460
20495211159,26sleep10-21swapper/109:32:231
15265211111,84sleep015346-21latency10:57:440
13205211150,44sleep10-21swapper/112:32:551
23454211029,58sleep323494-21fschecks_count07:57:403
23770210910,65sleep123817-21ntpq07:57:461
3101210820,76sleep23177-21cut12:02:402
3101210820,76sleep23177-21cut12:02:402
26008210812,16sleep10-21swapper/109:47:501
22675210816,49sleep10-21swapper/109:37:441
12368210816,53sleep10-21swapper/112:32:221
14122210718,75sleep214214-21sort07:27:392
1221210718,68sleep01363-21unixbench_singl08:27:520
3051210611,37sleep10-21swapper/110:17:491
11581210620,65sleep211589-21modprobe10:47:202
10084210649,42sleep110231-21sed10:42:231
22201210519,69sleep322247-21/usr/sbin/munin07:52:473
21501210550,42sleep121531-21munin-run07:52:211
29097210313,57sleep10-21swapper/109:57:511
29097210313,57sleep10-21swapper/109:57:511
31575210211,79sleep131618-21basename08:22:401
2792821020,7sleep20-21swapper/208:12:232
22392210212,74sleep022414-21fschecks_count09:37:390
1097021029,74sleep00-21swapper/007:17:360
890721017,14sleep10-21swapper/107:12:251
13043210125,52sleep013124-21tune2fs09:07:400
26721210042,19sleep17142-21cyclictest08:07:431
872429913,53sleep10-21swapper/108:52:481
868529912,74sleep28691-21sh07:12:222
515929916,67sleep35229-21df08:42:363
307902999,17sleep10-21swapper/111:47:381
3075529830,40sleep230774-21apt-get11:47:312
1256929820,64sleep012664-21perl07:22:410
253412977,50sleep10-21swapper/108:02:461
635529628,26sleep10-21swapper/107:03:051
635529628,26sleep10-21swapper/107:03:051
2899829610,69sleep10-21swapper/111:42:331
2899829610,69sleep10-21swapper/111:42:331
12112967,74sleep00-21swapper/011:57:220
56452959,49sleep10-21swapper/110:27:371
269532959,46sleep10-21swapper/109:52:381
105692959,46sleep10-21swapper/110:42:431
685029412,67sleep36937-21mailstats12:12:473
716829310,44sleep10-21swapper/108:47:471
149972936,12sleep10-21swapper/110:57:371
539329217,48sleep10-21swapper/110:27:211
3204729127,45sleep332068-21modprobe11:52:203
576829034,31sleep30-21swapper/307:02:303
576829034,31sleep30-21swapper/307:02:303
3110929023,24sleep20-21swapper/208:22:212
3110929023,24sleep20-21swapper/208:22:212
2206329014,60sleep022114-21sed07:52:440
1973029025,42sleep319746-21fschecks_count11:12:403
1973029025,42sleep319746-21fschecks_count11:12:403
2199028916,25sleep20-21swapper/209:37:212
3166428815,59sleep331747-21sed08:22:423
172312888,13sleep00-21swapper/007:37:380
76262879,18sleep10-21swapper/112:17:211
144528726,43sleep00-21swapper/010:13:480
535228612,56sleep00-21swapper/010:27:200
618628522,29sleep00-21swapper/007:03:000
618628522,29sleep00-21swapper/007:03:000
3200028516,50sleep332045-21/usr/sbin/munin10:07:453
2463428521,40sleep024651-21awk08:02:210
920328426,26sleep00-21swapper/012:22:200
340028425,25sleep30-21swapper/308:37:243
88412830,6sleep30-21swapper/308:52:493
279632839,20sleep128047-21mailstats11:37:491
204932836,19sleep00-21swapper/009:32:220
1734628318,48sleep317347-21cron09:22:203
3054628225,26sleep00-21swapper/008:18:070
3054628225,26sleep00-21swapper/008:18:070
845628123,23sleep30-21swapper/310:37:203
244322810,6sleep30-21swapper/309:42:503
130562815,42sleep10-21swapper/110:51:231
493928023,36sleep35083-21grep08:42:243
32832805,43sleep10-21swapper/108:37:131
301328022,41sleep10-21swapper/112:02:351
301328022,41sleep10-21swapper/112:02:351
950527922,36sleep29644-21unixbench_singl10:37:522
710127912,49sleep37135-21/usr/sbin/munin08:47:453
3269127917,39sleep2278-21dbus-daemon08:27:222
313227913,52sleep23221-21threads10:17:502
292702796,18sleep20-21swapper/208:14:102
2828727928,23sleep20-21swapper/209:57:232
17102790,6sleep20-21swapper/210:13:532
1165727918,33sleep30-21swapper/307:17:523
660527815,44sleep06624-21uname12:12:400
1632627820,28sleep30-21swapper/311:02:233
1266527811,20sleep10-21swapper/107:22:421
118612786,41sleep10-21swapper/107:18:061
2611427725,28sleep20-21swapper/209:47:512
1881027721,30sleep30-21swapper/307:42:423
155227712,48sleep21640-21/usr/sbin/munin11:57:402
1564727620,32sleep20-21swapper/207:32:362
1564727620,32sleep20-21swapper/207:32:362
1068727523,31sleep30-21swapper/310:42:453
385627417,42sleep33830-21latency_hist10:22:233
279892747,10sleep00-21swapper/009:54:300
1927327411,47sleep219333-21fschecks_time09:27:402
418627323,25sleep20-21swapper/208:37:512
2350327325,27sleep023653-21unixbench_singl11:22:500
1836827323,26sleep30-21swapper/311:07:443
1565627320,29sleep30-21swapper/307:32:373
1565627320,29sleep30-21swapper/307:32:373
1207027310,48sleep012196-21cat09:02:520
994727212,45sleep39954-21ntp_states12:22:483
89892726,11sleep10-21swapper/112:19:351
2658727223,25sleep30-21swapper/308:07:413
2618027229,23sleep30-21swapper/308:07:203
1832027215,24sleep218485-21sed09:22:522
892327115,24sleep20-21swapper/207:12:262
2435827113,37sleep223832-21/usr/sbin/munin09:42:502
1123927121,19sleep30-21swapper/312:27:403
1113327112,34sleep20-21swapper/212:27:392
2642527035,21sleep126506-21switchtime11:32:481
1878427026,22sleep20-21swapper/207:42:412
1635927018,24sleep20-21swapper/209:17:432
601126930,27sleep25617-21/usr/sbin/munin10:27:472
2826626911,31sleep00-21swapper/008:12:380
184726915,37sleep31884-21awk11:57:453
1663526918,31sleep316667-21tune2fs11:02:393
1379126914,34sleep213911-21latency_hist07:27:232
3013126814,34sleep330150-21kernelversion08:17:583
3013126814,34sleep330150-21kernelversion08:17:583
292826817,32sleep22013-21/usr/sbin/munin08:32:552
2338726818,21sleep30-21swapper/311:22:493
2237326810,16sleep20-21swapper/209:37:372
1458026817,36sleep314588-21diskstats09:12:363
2519526722,24sleep20-21swapper/208:02:432
2145426714,36sleep021498-21irqstats11:17:420
2072926716,36sleep220803-21tr07:47:502
2011026712,40sleep020150-21processes11:12:490
2011026712,40sleep020150-21processes11:12:490
1510026712,41sleep015101-21sshd07:30:000
914326617,34sleep39187-21ntp_kernel_err10:37:453
370326615,32sleep03794-21/usr/sbin/munin08:37:410
2789726512,40sleep227907-21ntp_states11:37:462
2403626521,19sleep20-21swapper/211:27:202
2131626521,18sleep20-21swapper/211:17:402
2100226512,32sleep021061-21/usr/sbin/munin09:32:430
1318826517,26sleep20-21swapper/209:07:422
802526419,26sleep20-21swapper/212:17:382
495326418,18sleep20-21swapper/212:08:302
2983526418,20sleep00-21swapper/010:02:220
2983526418,20sleep00-21swapper/010:02:220
1876526411,37sleep018776-21df_inode07:42:390
131302649,14sleep20-21swapper/210:52:212
1309326416,26sleep30-21swapper/307:22:523
301226312,37sleep00-21swapper/012:02:340
301226312,37sleep00-21swapper/012:02:340
258562637,42sleep00-21swapper/008:03:100
1277526312,34sleep312561-21/usr/sbin/munin12:32:453
91962628,15sleep30-21swapper/312:22:153
3039326216,22sleep20-21swapper/211:47:222
3039326216,22sleep20-21swapper/211:47:222
2791726218,28sleep00-21swapper/011:37:480
253892626,11sleep00-21swapper/011:29:490
1810526211,35sleep318165-21/usr/sbin/munin09:22:493
1332426218,26sleep212561-21/usr/sbin/munin12:32:562
876026112,29sleep28840-21/usr/sbin/munin08:52:492
3058626114,32sleep230666-21readlink10:02:522
242532616,44sleep20-21swapper/211:27:242
2155226119,20sleep30-21swapper/307:52:233
1323826112,33sleep013379-21latency_hist10:52:230
797226021,23sleep20-21swapper/208:52:202
768126018,28sleep07746-21awk10:32:490
230926013,31sleep02404-21cut08:32:440
2051726016,23sleep00-21swapper/007:47:440
1786026017,26sleep217955-21latency_hist11:07:222
782325917,22sleep20-21swapper/210:32:512
456425913,22sleep30-21swapper/310:22:513
3231125915,17sleep30-21swapper/311:52:323
2558325915,20sleep30-21swapper/309:47:393
1471125919,20sleep20-21swapper/209:12:392
1447725918,23sleep00-21swapper/009:12:280
585025814,20sleep30-21swapper/312:09:403
149702586,10sleep30-21swapper/307:28:173
1295625819,20sleep30-21swapper/309:07:353
769525720,18sleep20-21swapper/212:17:222
2916725716,19sleep20-21swapper/209:57:522
2916725716,19sleep20-21swapper/209:57:522
277225714,25sleep00-21swapper/012:02:220
2632625715,25sleep226332-21ntp_states11:32:452
1844525716,24sleep318455-21munin-run07:42:223
1803525711,27sleep218049-21/usr/sbin/munin07:37:532
1691825613,24sleep00-21swapper/011:02:440
1350625615,19sleep20-21swapper/210:52:412
1103625615,25sleep011031-21apt-get12:27:330
110125616,23sleep30-21swapper/308:27:513
301525515,19sleep30-21swapper/312:02:373
301525515,19sleep30-21swapper/312:02:373
2888825512,32sleep328908-21netstat09:57:443
2888825512,32sleep328908-21netstat09:57:443
134232557,12sleep30-21swapper/310:52:383
1000125517,17sleep30-21swapper/307:12:513
2467625410,23sleep224686-21systemd-run08:02:232
1884825412,17sleep00-21swapper/011:07:530
949125313,23sleep29487-21apt-get12:22:352
2745025313,24sleep327445-21apt-get11:37:353
14492539,13sleep20-21swapper/208:28:312
983625213,23sleep39832-21apt-get08:57:343
983625213,23sleep39832-21apt-get08:57:343
958925210,23sleep00-21swapper/012:22:410
877325213,23sleep08768-21apt-get10:37:330
572225215,22sleep05728-21diskstats10:27:410
3020525213,15sleep00-21swapper/010:02:420
1893925212,24sleep018948-21munin-run09:27:220
713725112,24sleep07165-21ntp_states08:47:460
3139425114,15sleep00-21swapper/008:22:350
1194825112,23sleep311847-21/usr/sbin/munin10:47:383
1032025115,23sleep010316-21apt-get10:42:340
960325016,18sleep00-21swapper/008:57:230
3260525014,18sleep20-21swapper/211:52:432
2881525016,16sleep30-21swapper/308:13:063
3074824912,22sleep030273-21apt-get11:47:250
2626324910,17sleep00-21swapper/011:32:430
2255624912,21sleep322578-21irqstats09:37:423
1197424919,14sleep30-21swapper/309:02:513
1138524912,22sleep211391-21ntp_states07:17:462
1011024910,19sleep00-21swapper/008:57:430
1011024910,19sleep00-21swapper/008:57:430
2676824815,18sleep30-21swapper/309:52:243
258152488,15sleep00-21swapper/009:47:440
746524711,22sleep37469-21diskstats07:07:383
2080524713,18sleep30-21swapper/309:32:383
1557224710,20sleep015639-21df07:32:340
1557224710,20sleep015639-21df07:32:340
2457324510,21sleep324596-21irqstats11:27:423
2123224212,14sleep30-21swapper/311:17:373
121712419,15sleep00-21swapper/010:47:430
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional