You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-02 - 18:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Wed Sep 02, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1700219107,1889sleep028919-21kworker/0:207:09:230
20704211968,1131sleep320711-21ntpq09:49:093
15664245756,383sleep315809-21latency_hist11:18:433
1374243068,306sleep31410-21ntpq12:14:063
2668623647,298sleep3367-21snmpd11:53:393
70762307138,23sleep30-21swapper/310:49:123
150012257139,25sleep30-21swapper/307:49:023
150012257139,25sleep30-21swapper/307:49:023
8356225216,217sleep18410-21cpuspeed07:28:581
18383225110,126sleep318532-21unixbench_singl11:24:163
2604122508,231sleep3367-21snmpd10:06:533
27184222584,67sleep30-21swapper/311:53:523
27086221650,24sleep30-21swapper/310:09:113
27086221650,24sleep30-21swapper/310:09:113
3584220628,39sleep33725-21unixbench_singl08:54:143
4783220213,174sleep34903-21timerwakeupswit12:24:113
13216219912,171sleep313298-21mailstats11:09:113
13216219912,171sleep313298-21mailstats11:09:113
31243218418,124sleep30-21swapper/310:24:013
29695218432,137sleep329775-21tune2fs10:19:013
4613218212,21sleep30-21swapper/308:59:033
4613218212,21sleep30-21swapper/308:59:033
20399217619,136sleep30-21swapper/308:04:163
19569217613,51sleep30-21swapper/311:29:053
12980216713,112sleep312985-21modprobe07:43:413
2289216215,131sleep22301-21ntp_states07:10:502
1100215933,27sleep00-21swapper/007:08:420
30115215610,134sleep230191-21systemctl10:19:122
339521557,13sleep30-21swapper/310:38:593
3229121529,108sleep332330-21grep12:09:063
2278821508,103sleep322822-21ps11:39:103
43121458,124sleep30-21swapper/310:29:023
1657821428,16sleep30-21swapper/307:54:033
242402141103,19sleep30-21swapper/311:44:033
21470214110,91sleep30-21swapper/308:09:093
2704321408,73sleep327135-21latency_hist08:28:433
2704321408,73sleep327135-21latency_hist08:28:433
1841321378,94sleep318451-21processes07:59:123
1564121369,93sleep30-21swapper/309:33:593
314521338,90sleep33153-21munin-run10:38:433
15331213328,48sleep315404-21date09:33:433
7948213210,58sleep30-21swapper/312:34:133
18697213212,29sleep018716-21cpu09:43:570
24188212932,55sleep30-21swapper/308:18:583
900621285,86sleep30-21swapper/310:54:533
1243721286,31sleep30-21swapper/309:23:493
1243721286,31sleep30-21swapper/309:23:493
10110212711,100sleep19629-21apt-get07:33:501
6257212596,16sleep30-21swapper/312:29:123
28622212510,78sleep328768-21latency_hist08:33:433
28622212510,78sleep328768-21latency_hist08:33:433
2514212313,43sleep30-21swapper/307:10:553
27946212115,90sleep028069-21timerwakeupswit08:29:120
27946212115,90sleep028069-21timerwakeupswit08:29:120
9771211854,48sleep39822-21munin-run07:33:443
6779211613,86sleep06797-21apt07:23:520
5962211613,82sleep05972-21acpi09:03:520
1896621169,19sleep30-21swapper/309:44:043
27200211516,82sleep027340-21unixbench_singl10:09:120
27200211516,82sleep027340-21unixbench_singl10:09:120
13508211524,31sleep30-21swapper/307:44:063
3068921149,38sleep30-21swapper/308:39:043
407021129,66sleep34117-21ntpq07:14:063
2207721128,64sleep322086-21munin-run11:38:423
25124211115,79sleep225172-21if_eth010:04:022
27208211016,77sleep126704-21apt-get11:53:541
2446321105,10sleep30-21swapper/310:01:283
755021098,61sleep30-21swapper/309:08:563
2302021095,74sleep30-21swapper/309:58:173
19883210915,79sleep220036-21awk11:29:122
5019210820,74sleep05074-21latency_hist07:18:430
3895210612,52sleep30-21swapper/312:23:433
1807321067,11sleep30-21swapper/309:39:243
10364210611,81sleep310367-21cron09:18:413
9304210513,20sleep20-21swapper/207:29:442
539621058,34sleep30-21swapper/310:44:083
26004210516,75sleep226063-21latency08:24:062
26004210516,75sleep226063-21latency08:24:062
10089210510,34sleep30-21swapper/310:59:093
2922521047,63sleep329261-21ntpq08:34:083
17549210414,77sleep217593-21cat09:39:072
1016210416,64sleep21216-21apt-key08:48:442
31231210218,69sleep131237-21df_inode10:23:591
24049210212,68sleep124180-21unixbench_multi09:59:121
247821016,61sleep3367-21snmpd08:52:373
6884210032,31sleep30-21swapper/307:23:593
654129920,18sleep30-21swapper/309:04:113
419329916,68sleep14267-21cat08:58:441
1776329918,20sleep00-21swapper/007:58:440
97829820,59sleep21116-21unixbench_singl10:29:132
2916029842,36sleep30-21swapper/311:59:043
2397229710,72sleep024046-21find09:59:110
1973429515,60sleep019805-21/usr/sbin/munin11:29:100
1762029516,54sleep017122-21cron11:23:530
75829411,68sleep0834-21latency_hist12:13:430
542829418,61sleep15514-21mailstats10:44:101
1244129417,57sleep211957-21apt-get09:23:522
1244129417,57sleep211957-21apt-get09:23:522
1144229133,43sleep311478-21latency11:04:023
3048929022,47sleep230491-21/usr/sbin/munin08:38:592
5552895,72sleep30-21swapper/308:46:033
3166628911,31sleep00-21swapper/008:43:420
1722128917,47sleep217351-21latency_hist11:23:432
1172428918,55sleep111791-21sort07:38:591
1014328921,33sleep30-21swapper/307:33:573
230612878,15sleep30-21swapper/308:14:093
118228736,32sleep11286-21sed07:08:431
89028619,47sleep11014-21wc08:48:431
2083428618,51sleep120844-21/usr/sbin/munin11:33:591
1364328612,56sleep213688-21/usr/sbin/munin07:44:092
1194328610,63sleep311984-21gpgv09:23:413
690328526,41sleep17006-21fschecks_time07:24:011
304512858,17sleep330554-21perl12:04:013
127022859,55sleep20-21swapper/211:08:532
127022859,55sleep20-21swapper/211:08:532
2081428414,22sleep20-21swapper/208:08:432
1436328220,44sleep214403-21fschecks_count11:14:022
387228113,46sleep13366-21/usr/sbin/munin10:39:131
77162800,6sleep00-21swapper/012:34:080
2828328010,34sleep30-21swapper/310:14:043
2735828013,50sleep027391-21fschecks_time11:54:170
158612808,56sleep30-21swapper/311:18:553
1583728015,49sleep015854-21apt11:18:520
332127920,38sleep13460-21grep12:19:131
3171427819,43sleep131766-21latency_hist08:43:431
2879127815,47sleep128921-21uptime10:14:141
2268427822,32sleep20-21swapper/208:14:002
80527719,38sleep0830-21munin-run08:48:420
64052775,12sleep30-21swapper/307:22:183
1448727619,26sleep00-21swapper/011:14:040
1180827623,25sleep00-21swapper/007:39:020
39042750,7sleep20-21swapper/210:39:132
3008827518,39sleep030117-21munin-run08:38:410
167127515,43sleep11655-21apt-get07:09:031
1415127514,42sleep00-21swapper/009:29:150
2365927417,40sleep023808-21sort11:43:430
575027317,27sleep00-21swapper/009:03:440
575027317,27sleep00-21swapper/009:03:440
198842736,12sleep20-21swapper/209:47:462
2777427216,24sleep20-21swapper/211:54:272
2013827221,34sleep120245-21timerwakeupswit08:04:141
1888027212,43sleep118916-21/usr/sbin/munin09:44:021
2625227123,22sleep10-21swapper/111:49:131
2418627117,29sleep10-21swapper/108:18:561
241602717,39sleep20-21swapper/208:18:532
998927016,28sleep20-21swapper/210:59:042
423727014,22sleep00-21swapper/012:24:000
2355227012,23sleep20-21swapper/209:59:012
617926928,24sleep20-21swapper/212:29:112
3237426921,30sleep232379-21/usr/sbin/munin07:04:002
832926813,38sleep08330-21munin-node07:28:530
366926816,38sleep13671-21cpu07:13:561
2997826817,36sleep030018-21grep10:19:060
1612926823,24sleep00-21swapper/007:53:440
1612926823,24sleep00-21swapper/007:53:440
136342688,11sleep10-21swapper/107:44:081
780326721,21sleep20-21swapper/210:53:432
390626712,26sleep00-21swapper/012:23:440
344126719,29sleep20-21swapper/207:13:492
2767826726,25sleep20-21swapper/208:29:062
2767826726,25sleep20-21swapper/208:29:062
259026717,30sleep22587-21apt-get12:18:532
242126713,25sleep10-21swapper/110:34:131
1593926723,25sleep20-21swapper/209:34:062
625426617,23sleep20-21swapper/210:48:432
2236226621,22sleep20-21swapper/208:13:442
2529226522,23sleep10-21swapper/110:04:051
208426525,18sleep00-21swapper/010:34:030
773526421,21sleep10-21swapper/109:09:021
3252726422,25sleep10-21swapper/112:09:121
3016726422,20sleep20-21swapper/208:38:432
2286026416,26sleep10-21swapper/108:14:031
2206726418,27sleep00-21swapper/009:54:060
1792726415,19sleep20-21swapper/211:24:072
178426420,24sleep10-21swapper/108:49:241
159842646,12sleep10-21swapper/111:19:021
124322645,46sleep20-21swapper/211:08:372
3091326311,15sleep10-21swapper/110:23:431
2259826321,21sleep10-21swapper/111:39:041
1076326321,22sleep20-21swapper/209:19:002
507626214,17sleep10-21swapper/107:18:441
3246626219,24sleep20-21swapper/210:28:442
251726213,33sleep21787-21/usr/sbin/munin10:34:142
2100726220,20sleep00-21swapper/011:34:020
1695126218,17sleep00-21swapper/007:54:120
1607826217,24sleep216095-21munin-run07:53:422
1607826217,24sleep216095-21munin-run07:53:422
1207226215,21sleep10-21swapper/109:23:431
850626124,18sleep10-21swapper/110:54:111
764626116,21sleep00-21swapper/009:09:010
433826123,23sleep10-21swapper/112:24:011
303202617,42sleep00-21swapper/012:03:500
2887826115,26sleep20-21swapper/211:58:592
2596026117,25sleep226030-21sensors_temp11:49:102
2299926114,29sleep023035-21ntpq08:14:060
1947026118,23sleep10-21swapper/111:29:031
1193026116,23sleep20-21swapper/207:39:042
858026016,20sleep10-21swapper/112:38:431
778826017,26sleep27821-21irqstats09:09:032
768726010,16sleep00-21swapper/010:52:530
571826011,33sleep25739-21awk07:19:102
451526011,37sleep14520-21/usr/sbin/munin08:59:011
451526011,37sleep14520-21/usr/sbin/munin08:59:011
2919226012,32sleep029228-21ntpq11:59:050
2892226021,23sleep228934-21/usr/sbin/munin10:14:152
2436726017,22sleep00-21swapper/011:44:080
2104826010,35sleep021146-21users09:49:140
1557226015,25sleep115566-21apt-get09:33:571
141626011,33sleep01417-21sshd10:32:220
1015526017,22sleep00-21swapper/010:59:100
866225914,29sleep08776-21sed10:54:140
70625919,20sleep20-21swapper/212:13:412
700825919,23sleep20-21swapper/207:24:022
568425911,23sleep00-21swapper/010:44:130
2619725913,21sleep00-21swapper/008:24:120
2619725913,21sleep00-21swapper/008:24:120
2432725917,23sleep224333-21ntp_states11:44:062
189652596,12sleep20-21swapper/208:00:322
1565025918,25sleep015656-21diskstats09:34:000
1528025912,27sleep115294-21apt09:33:411
144832595,11sleep00-21swapper/007:48:070
1248925916,19sleep00-21swapper/011:08:430
1037225923,18sleep00-21swapper/009:18:420
3161925823,21sleep00-21swapper/010:24:100
2928425816,25sleep129290-21ntp_states08:34:101
1789725816,23sleep117926-21irqstats11:24:061
1401325815,26sleep114008-21apt-get09:28:561
1401325815,26sleep114008-21apt-get09:28:561
70272574,18sleep20-21swapper/209:05:522
599025715,17sleep10-21swapper/109:03:571
549925711,19sleep00-21swapper/007:19:040
3275325722,18sleep30-21swapper/307:04:093
292302570,7sleep10-21swapper/111:59:051
24552575,15sleep00-21swapper/008:52:220
1769625719,17sleep20-21swapper/207:58:422
938525615,16sleep20-21swapper/210:58:442
918225617,20sleep20-21swapper/209:13:592
785025613,24sleep27947-21/usr/sbin/munin12:34:122
3096025612,19sleep20-21swapper/212:04:122
2774425615,24sleep127257-21/usr/sbin/munin08:29:091
2774425615,24sleep127257-21/usr/sbin/munin08:29:091
2069225619,17sleep20-21swapper/209:49:082
2006425618,19sleep00-21swapper/008:04:130
1645525618,19sleep10-21swapper/107:54:011
108125616,24sleep11082-21diskstats12:14:001
632625514,25sleep00-21swapper/012:29:130
2866825513,20sleep00-21swapper/010:14:130
2419025515,18sleep00-21swapper/008:18:590
2298325516,22sleep20-21swapper/211:39:132
227525513,24sleep22298-21munin-run12:18:412
1542425517,23sleep10-21swapper/107:49:131
1542425517,23sleep10-21swapper/107:49:131
339925414,23sleep03467-21df10:39:000
3165825415,16sleep10-21swapper/112:08:431
2648025415,23sleep126547-21df10:08:571
2648025415,23sleep126547-21df10:08:571
2238825411,26sleep122473-21threads09:54:161
2141525412,22sleep10-21swapper/108:09:071
2064625427,14sleep10-21swapper/109:49:071
1554525417,18sleep10-21swapper/111:18:411
14392549,32sleep1367-21snmpd10:32:391
1014825412,24sleep210133-21apt-get07:34:002
285225313,23sleep22846-21apt-get08:53:572
2387225313,24sleep123867-21apt-get11:43:521
227192535,37sleep20-21swapper/209:54:252
1715025315,22sleep117217-21df09:38:571
1714825316,19sleep00-21swapper/009:38:560
1068725312,16sleep00-21swapper/009:18:580
909525212,22sleep19089-21apt-get09:13:541
2492525215,18sleep00-21swapper/010:03:560
148932528,17sleep20-21swapper/209:29:302
970625113,22sleep19766-21/usr/sbin/munin10:58:591
39552515,35sleep00-21swapper/008:56:410
2699125115,22sleep10-21swapper/108:28:411
2699125115,22sleep10-21swapper/108:28:411
235525113,16sleep00-21swapper/012:18:430
1408025115,19sleep00-21swapper/009:28:590
1408025115,19sleep00-21swapper/009:28:590
2551425015,17sleep00-21swapper/011:49:000
1318225011,24sleep113188-21ntp_states11:09:091
1318225011,24sleep113188-21ntp_states11:09:091
1117025014,20sleep111167-21apt-get11:03:521
1013025013,15sleep00-21swapper/007:33:540
695624917,19sleep16996-21ps10:49:101
2647224913,20sleep226468-21apt-get10:08:542
2647224913,20sleep226468-21apt-get10:08:542
2150824913,20sleep021514-21ntp_states08:09:100
1839424915,18sleep10-21swapper/107:59:101
2084524815,14sleep20-21swapper/211:34:002
1298224810,22sleep012998-21irqstats11:09:030
1298224810,22sleep012998-21irqstats11:09:030
457124612,20sleep24594-21ntp_states12:24:062
489224510,21sleep24906-21awk08:59:102
489224510,21sleep24906-21awk08:59:102
581424413,17sleep15883-21fschecks_time12:29:021
3203924410,14sleep20-21swapper/208:44:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional