You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-19 - 15:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Wed Aug 19, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1157826587,636sleep011668-21grep10:19:510
1157826587,636sleep011668-21grep10:19:510
13292258341,396sleep00-21swapper/012:06:150
398823994,383sleep00-21swapper/011:36:520
8160239628,281sleep08230-21switchtime11:50:000
26180236032,78sleep00-21swapper/011:05:020
14284233112,306sleep314294-21ntpq12:09:583
30880232312,297sleep230917-21ntpq07:54:572
21312227420,236sleep321344-21/usr/sbin/munin10:49:593
31813224976,86sleep00-21swapper/009:40:020
12763224274,95sleep012800-21idleruntime08:40:170
1169224071,21sleep00-21swapper/009:45:070
17204223841,141sleep00-21swapper/010:37:120
1819022356,217sleep018215-21ntpq07:14:570
22801223017,20sleep00-21swapper/010:55:000
27145222950,118sleep027181-21latency_hist07:44:330
27145222950,118sleep027181-21latency_hist07:44:330
13101222722,145sleep00-21swapper/010:24:480
22375222264,93sleep022436-21sendmail_mailqu09:10:060
6763221411,188sleep06869-21ls08:20:470
22817221110,182sleep022923-21tune2fs07:29:510
1479220812,181sleep11545-21fschecks_time11:30:271
19057220236,150sleep219066-21/usr/sbin/munin10:44:332
18928220110,172sleep018973-21ntp_offset12:24:570
1632219716,162sleep01666-21ps08:05:000
1632219716,162sleep01666-21ps08:05:000
2445721968,164sleep00-21swapper/011:00:010
18456219111,116sleep018459-21cron08:59:320
3139219013,163sleep03157-21basename09:54:310
3524218414,15sleep10-21swapper/109:54:531
20700218112,87sleep020307-21/usr/sbin/munin09:04:570
2092221807,15sleep00-21swapper/010:49:480
29344217416,138sleep00-21swapper/007:49:580
16580217411,147sleep016720-21grep07:10:040
28700217367,39sleep00-21swapper/007:49:330
21442217111,26sleep00-21swapper/007:24:540
390221698,99sleep0367-21snmpd08:13:320
2767321685,109sleep00-21swapper/009:27:340
32260216722,124sleep132272-21kernelversion11:24:541
5513216610,135sleep00-21swapper/010:00:410
2549221665,150sleep00-21swapper/007:39:080
2549221665,150sleep00-21swapper/007:39:080
2392421669,79sleep024006-21cut09:15:020
1100621599,118sleep011032-21cut11:59:580
4586215868,19sleep00-21swapper/009:58:150
3048521588,71sleep00-21swapper/007:54:460
15352215716,25sleep20-21swapper/208:49:322
15762215411,129sleep215801-21ntpq12:14:572
15762215411,129sleep215801-21ntpq12:14:572
2963421505,29sleep00-21swapper/009:34:410
5824214619,22sleep20-21swapper/211:44:332
1678021467,49sleep00-21swapper/008:52:530
1034421465,11sleep00-21swapper/008:33:150
27032214518,106sleep127069-21ps09:25:011
700721438,76sleep06774-21/usr/sbin/munin10:04:530
30539214223,93sleep330600-21fschecks_time11:19:513
9606214121,105sleep20-21swapper/211:54:592
25606213915,108sleep225545-21latency_hist07:39:342
25606213915,108sleep225545-21latency_hist07:39:342
1384021398,94sleep00-21swapper/012:09:470
7984213711,112sleep38025-21ntpq11:49:553
28585213710,68sleep028649-21ps09:30:000
15936213619,103sleep215940-21diskstats07:09:502
15425213611,109sleep015571-21cat08:49:340
22973213514,60sleep010422-21kworker/u8:212:39:340
22973213514,60sleep010422-21kworker/u8:212:39:340
31723213450,73sleep031745-21munin-run11:24:320
10389213010,65sleep010451-21awk10:15:030
2604821295,10sleep00-21swapper/009:21:320
524421278,66sleep0367-21snmpd08:15:540
31763212713,99sleep231892-21sort11:24:342
8101212512,89sleep28123-21/usr/sbin/munin08:25:012
18811211829,78sleep00-21swapper/010:42:330
16023211712,89sleep316068-21/usr/sbin/munin08:49:583
9789211610,91sleep29866-21timerandwakeup08:30:022
19172211315,75sleep00-21swapper/008:59:560
28478211217,78sleep328684-21latency_hist11:14:343
15529211237,49sleep015562-21grep07:09:320
1593211114,81sleep11626-21basename09:49:321
7898210948,31sleep00-21swapper/008:24:550
5057210910,82sleep00-21swapper/011:40:030
32501210963,31sleep031974-21/usr/sbin/munin11:25:010
1993621090,5sleep10-21swapper/112:29:331
4886210718,75sleep34925-21ntpq11:39:583
1808721075,50sleep00-21swapper/012:22:340
1808721075,50sleep00-21swapper/012:22:340
17707210713,80sleep117734-21grep10:39:471
22881210621,67sleep122911-21munin-run12:39:311
22881210621,67sleep122911-21munin-run12:39:311
28387210311,78sleep228425-21wc09:29:542
16265210319,71sleep116362-21timerandwakeup08:50:041
28116210218,68sleep228259-21unixbench_singl07:45:032
19851210121,58sleep00-21swapper/010:45:030
19851210121,58sleep00-21swapper/010:45:030
26839210010,75sleep326882-21cat09:24:553
2314929823,47sleep223170-21grep09:14:322
2296129820,61sleep322970-21grep12:39:333
2296129820,61sleep322970-21grep12:39:333
2775829720,56sleep327802-21ntpq07:44:563
1589229610,66sleep00-21swapper/010:34:330
1251829619,61sleep112008-21apt-get08:39:421
3267129558,17sleep00-21swapper/008:00:030
3267129558,17sleep00-21swapper/008:00:030
182229526,16sleep00-21swapper/011:30:340
1205629510,70sleep012126-21munin-run08:39:330
3132329421,56sleep131366-21fschecks_count09:39:511
2901829420,50sleep329107-21fschecks_time11:15:353
2886829421,13sleep00-21swapper/011:14:470
2735029220,14sleep00-21swapper/011:09:540
162682925,12sleep20-21swapper/210:34:512
917029120,33sleep00-21swapper/011:54:490
2004029015,60sleep220079-21awk07:20:162
1637929022,45sleep216523-21grep08:50:052
2142228949,25sleep021570-21latency_hist12:34:330
1965128918,54sleep00-21swapper/007:20:060
59732887,64sleep25555-21apt-get08:19:362
1566328831,37sleep00-21swapper/012:14:550
1566328831,37sleep00-21swapper/012:14:550
87672879,15sleep00-21swapper/010:09:580
307402877,21sleep30-21swapper/307:54:543
1765928716,45sleep316954-21/usr/sbin/munin12:20:033
1765928716,45sleep316954-21/usr/sbin/munin12:20:033
3060828613,19sleep20-21swapper/209:35:322
770428514,54sleep27790-21fschecks_time11:49:502
2093628527,31sleep20-21swapper/210:49:502
1898328514,57sleep218992-21ntpq12:24:592
553528424,38sleep25555-21apt-get08:19:322
1380328419,50sleep213828-21awk08:44:312
586628313,51sleep15930-21/usr/sbin/munin10:00:501
2365728324,41sleep323720-21sendmail-msp10:59:323
209828319,43sleep22246-21head11:30:402
1633228324,38sleep116396-21find07:10:011
65352820,7sleep30-21swapper/311:44:573
1453828223,32sleep20-21swapper/207:04:542
1039828211,57sleep1367-21snmpd11:59:181
256128126,27sleep20-21swapper/209:50:012
232882815,11sleep10-21swapper/109:14:351
1899328119,42sleep319030-21ps12:25:003
99022808,15sleep30-21swapper/310:14:493
73202807,56sleep00-21swapper/011:49:320
436728022,39sleep34458-21fschecks_time08:14:523
2240428018,37sleep122396-21apt-get10:54:491
2117428017,27sleep10-21swapper/107:24:471
1435527928,33sleep314397-21fschecks_count07:04:513
1082427912,54sleep110878-21fschecks_count11:59:541
924027814,45sleep38324-21/usr/sbin/munin10:10:053
280052787,36sleep20-21swapper/211:10:172
1468627812,51sleep114739-21users12:10:041
2632127622,34sleep226337-21cat09:24:332
2471527621,35sleep324864-21grep11:00:043
2122427615,43sleep221148-21/usr/sbin/munin07:24:482
2094927620,24sleep10-21swapper/107:24:351
1484627622,31sleep10-21swapper/110:29:541
961827518,35sleep30-21swapper/311:55:003
960927520,31sleep10-21swapper/110:14:311
2710127522,36sleep327143-21true07:44:323
2710127522,36sleep327143-21true07:44:323
1906727515,29sleep30-21swapper/307:19:323
432427414,44sleep24333-21/usr/sbin/munin09:55:062
2954627427,25sleep10-21swapper/107:50:031
2631627410,14sleep10-21swapper/111:05:031
3206827313,31sleep10-21swapper/107:59:481
3206827313,31sleep10-21swapper/107:59:481
1363127311,42sleep113702-21/usr/sbin/munin10:25:011
1047527322,31sleep10-21swapper/110:15:041
2063327227,23sleep320778-21wc10:49:343
2063327227,23sleep320778-21wc10:49:343
1945327217,19sleep20-21swapper/209:00:022
1740627216,23sleep20-21swapper/208:54:532
1349527217,35sleep313558-21awk10:24:593
734927122,31sleep17367-21munin-run08:24:311
1738127115,29sleep10-21swapper/112:19:571
1738127115,29sleep10-21swapper/112:19:571
1724727117,35sleep20-21swapper/212:19:542
1724727117,35sleep20-21swapper/212:19:542
1665927120,34sleep316688-21munin-plugin-st12:19:303
1665927120,34sleep316688-21munin-plugin-st12:19:303
2527227015,25sleep30-21swapper/309:19:543
2226627014,23sleep30-21swapper/309:10:003
1940327013,26sleep20-21swapper/210:44:532
1940327013,26sleep20-21swapper/210:44:532
272026915,22sleep30-21swapper/309:50:023
3259926820,32sleep332669-21sensors08:00:023
3259926820,32sleep332669-21sensors08:00:023
823326715,30sleep10-21swapper/111:50:011
308826720,23sleep30-21swapper/308:09:563
272126720,26sleep20-21swapper/208:09:472
2280426710,12sleep30-21swapper/307:29:503
2030626716,30sleep320316-21acpi09:04:433
1964926718,30sleep319617-21apt-get07:20:053
85002666,13sleep30-21swapper/308:25:063
678926621,20sleep20-21swapper/211:45:012
3221326610,11sleep20-21swapper/207:59:532
3221326610,11sleep20-21swapper/207:59:532
1198926618,30sleep312028-21munin-run08:39:323
98752656,12sleep20-21swapper/210:14:442
605926517,29sleep16053-21apt-get11:44:441
332626522,20sleep10-21swapper/108:10:021
2942426516,24sleep10-21swapper/109:34:341
2307826516,28sleep20-21swapper/210:55:072
116826512,36sleep10-21swapper/108:04:451
116826512,36sleep10-21swapper/108:04:451
101826519,20sleep30-21swapper/309:45:063
302526417,26sleep20-21swapper/211:34:522
240282648,42sleep224099-21latency_hist07:34:332
2216926421,18sleep10-21swapper/109:09:581
1048726419,27sleep10-21swapper/108:34:331
3006326310,13sleep10-21swapper/109:34:581
2809126317,20sleep30-21swapper/309:29:433
2216226314,25sleep10-21swapper/110:54:331
1674026322,16sleep10-21swapper/112:19:331
1674026322,16sleep10-21swapper/112:19:331
1436626318,18sleep20-21swapper/212:10:012
1197226315,14sleep10-21swapper/110:20:001
1197226315,14sleep10-21swapper/110:20:001
367626221,25sleep33697-21irqstats09:54:553
2787826221,19sleep20-21swapper/209:29:342
2016026211,34sleep120164-21diskstats12:29:501
1906726211,33sleep319214-21sed10:44:343
144226218,26sleep31536-21memory08:04:553
144226218,26sleep31536-21memory08:04:553
927126116,21sleep30-21swapper/308:29:513
512626120,20sleep10-21swapper/111:40:041
2571026117,26sleep20-21swapper/211:04:522
1468526115,26sleep114721-21ntp_states07:04:571
1360126118,22sleep30-21swapper/312:09:333
1213626122,23sleep312261-21timerwakeupswit10:20:033
1213626122,23sleep312261-21timerwakeupswit10:20:033
1205526123,20sleep20-21swapper/210:20:012
1205526123,20sleep20-21swapper/210:20:012
1200226120,23sleep2289-21dbus-daemon12:04:322
523926017,26sleep24706-21apt-get09:59:462
38912607,41sleep10-21swapper/111:35:361
3034326012,19sleep30-21swapper/309:35:043
2023926019,28sleep320297-21/usr/sbin/munin12:29:523
136826018,26sleep31416-21awk11:30:093
316372596,11sleep30-21swapper/309:39:573
2800225918,20sleep10-21swapper/107:45:021
2609825919,19sleep30-21swapper/311:05:013
2343825917,24sleep20-21swapper/209:14:482
208225915,29sleep21145-21/usr/sbin/munin08:05:062
208225915,29sleep21145-21/usr/sbin/munin08:05:062
1804525917,24sleep118067-21irqstats07:14:541
161012594,11sleep30-21swapper/310:34:403
140042597,40sleep20-21swapper/210:25:552
2421025818,26sleep124243-21irqstats10:59:541
1775025814,21sleep30-21swapper/308:55:023
1306525820,21sleep30-21swapper/308:40:293
1247325815,22sleep20-21swapper/212:04:522
761425716,18sleep10-21swapper/108:24:441
723625715,26sleep17252-21ntp_states10:04:581
717025712,24sleep30-21swapper/308:22:153
33725714,24sleep3443-21users11:25:043
3203825719,22sleep232137-21users09:40:042
292602570,8sleep20-21swapper/207:49:552
274452575,11sleep10-21swapper/111:09:551
2436525719,17sleep10-21swapper/107:34:531
2436525719,17sleep10-21swapper/107:34:531
2248425715,19sleep30-21swapper/307:29:343
1992125716,21sleep10-21swapper/109:03:001
14192575,15sleep20-21swapper/209:47:192
881225618,18sleep20-21swapper/210:10:002
716625610,19sleep30-21swapper/310:04:563
2894225619,22sleep329011-21df07:49:493
2886025615,25sleep228350-21apt-get11:14:452
251782568,37sleep20-21swapper/211:03:432
2007925620,19sleep20-21swapper/212:29:472
81125517,21sleep20-21swapper/211:29:312
3048725511,26sleep130554-21df07:54:471
2478325516,18sleep30-21swapper/309:19:333
1877525516,18sleep30-21swapper/308:59:473
1658325516,22sleep116589-21ntp_states10:34:591
484325416,18sleep10-21swapper/108:15:031
2199325419,19sleep222037-21ntpq12:34:562
2199325419,19sleep222037-21ntpq12:34:562
1457725410,30sleep31-21systemd08:45:013
1080925410,20sleep10-21swapper/108:34:491
2481325311,22sleep30-21swapper/307:35:033
2481325311,22sleep30-21swapper/307:35:033
2311525313,20sleep10-21swapper/107:29:561
2054025317,17sleep10-21swapper/109:04:541
1646725313,16sleep30-21swapper/307:10:033
1113825312,27sleep311183-21grep12:00:013
249922526,16sleep10-21swapper/109:19:401
1584125211,21sleep20-21swapper/210:34:312
1930625111,19sleep20-21swapper/207:19:352
1546525112,23sleep315475-21users10:30:043
3020125012,21sleep130215-21munin-run11:19:331
1976025011,21sleep119766-21ntp_states10:45:001
1976025011,21sleep119766-21ntp_states10:45:001
1848425015,21sleep118535-21munin-run08:59:331
268442497,29sleep20-21swapper/207:41:162
268442497,29sleep20-21swapper/207:41:162
541224812,15sleep30-21swapper/310:00:403
315792486,11sleep10-21swapper/111:22:521
2033224810,21sleep220327-21apt-get09:04:472
707224710,19sleep27165-21memory10:04:552
294224611,14sleep30-21swapper/311:34:493
122372469,16sleep20-21swapper/208:39:352
145482459,19sleep114554-21ntp_states08:44:591
304024410,20sleep13041-21sshd09:53:151
2718324211,15sleep10-21swapper/107:44:341
2718324211,15sleep10-21swapper/107:44:341
1354924110,14sleep10-21swapper/112:09:311
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional