You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 19:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7s.osadl.org (updated Thu Sep 24, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32403265211,626sleep032420-21/usr/sbin/munin09:07:320
24797236611,336sleep124878-21mailstats12:07:571
1745423336,316sleep3367-21snmpd11:43:283
27255230716,276sleep227301-21/usr/sbin/munin07:07:492
281392298101,179sleep39382-21kworker/u8:207:12:223
290792269133,119sleep329126-21latency_hist08:57:253
24960226152,192sleep324254-21/usr/sbin/munin12:07:593
6430225354,181sleep35940-21/usr/sbin/munin07:42:513
6863224317,208sleep36893-21idleruntime-cro11:12:223
31373224314,213sleep231446-21sendmail_mailtr09:02:542
18138224317,208sleep218228-21tune2fs11:47:432
19140223518,200sleep119134-21apt-get10:07:421
4422222243,59sleep30-21swapper/309:22:253
20461221815,138sleep320581-21apt-config10:12:253
11475221112,178sleep311563-21fschecks_time09:43:013
1530219712,171sleep21608-21find10:52:542
6295218531,44sleep36377-21fschecks_time09:27:423
296921828,159sleep33061-21fschecks_time07:32:503
2765421828,162sleep327639-21apt-get12:17:403
2765421828,162sleep327639-21apt-get12:17:403
13143218216,145sleep013267-21cat11:32:260
14950217714,147sleep014951-21sshd11:37:350
31447217556,57sleep30-21swapper/309:02:553
160172174101,17sleep30-21swapper/308:12:563
5917217320,132sleep0231-21systemd-journal09:27:230
751421658,14sleep30-21swapper/307:47:363
20272216313,126sleep320414-21grep11:52:533
2398121569,108sleep30-21swapper/312:07:223
2398121569,108sleep30-21swapper/312:07:223
193221538,35sleep30-21swapper/309:12:483
6055215215,123sleep26056-21entropy07:42:422
60421505,31sleep30-21swapper/307:25:193
60421505,31sleep30-21swapper/307:25:193
67221496,106sleep30-21swapper/310:52:233
67221496,106sleep30-21swapper/310:52:233
4127214860,49sleep30-21swapper/311:02:413
12724214618,110sleep30-21swapper/308:02:503
24054214510,123sleep324102-21awk10:22:383
16032214333,97sleep316092-21cpuspeed09:57:393
1239214345,86sleep31-21systemd09:12:233
32034213916,22sleep10-21swapper/110:47:481
32034213916,22sleep10-21swapper/110:47:481
1842621389,114sleep318468-21sed11:47:483
30800213527,58sleep30-21swapper/312:27:423
23539213542,33sleep30-21swapper/308:37:473
8732213431,16sleep30-21swapper/311:17:353
4976213415,104sleep25057-21cat07:37:542
26907213221,66sleep30-21swapper/310:32:243
17289213228,93sleep317326-21ntp_states08:17:483
5969213110,108sleep26042-21date09:27:252
30331213131,13sleep30-21swapper/310:42:383
30331213131,13sleep30-21swapper/310:42:383
2723421296,110sleep00-21swapper/008:49:350
2831212818,85sleep02833-21apt-get07:32:350
822121269,100sleep30-21swapper/309:32:513
25791212611,44sleep30-21swapper/312:12:313
25791212611,44sleep30-21swapper/312:12:313
12909212625,82sleep30-21swapper/309:47:373
10075212628,86sleep310122-21ntpq09:39:053
29709212432,37sleep329295-21/usr/sbin/munin08:57:503
1473021246,10sleep30-21swapper/308:08:563
2503121238,58sleep325067-21ntpq08:42:483
14456212348,25sleep30-21swapper/309:52:383
1993921227,29sleep30-21swapper/308:27:343
2970321216,12sleep30-21swapper/310:38:383
11810212115,92sleep311820-21acpi11:27:363
247521206,27sleep30-21swapper/310:57:323
1184821206,11sleep30-21swapper/308:01:413
22592211910,94sleep322682-21fschecks_time10:17:423
4695211810,19sleep30-21swapper/307:37:473
466221168,68sleep30-21swapper/309:22:373
2116921168,61sleep30-21swapper/311:57:373
2116921168,61sleep30-21swapper/311:57:373
32432211528,61sleep132423-21apt-get09:07:371
27651211518,80sleep127114-21apt-get12:17:381
27651211518,80sleep127114-21apt-get12:17:381
22187211519,77sleep022227-21munin-run10:17:220
2151421159,18sleep30-21swapper/308:32:383
1028021127,38sleep30-21swapper/311:22:363
2760921107,43sleep30-21swapper/310:32:483
14636211016,37sleep314656-21modprobe11:37:223
31814210711,18sleep00-21swapper/010:47:390
31814210711,18sleep00-21swapper/010:47:390
3151921074,91sleep00-21swapper/007:20:270
26643210718,50sleep30-21swapper/308:47:483
26179210712,16sleep20-21swapper/208:47:352
2134221079,64sleep321386-21ntpq10:13:053
12277210618,71sleep112335-21cut08:02:401
30553210515,15sleep10-21swapper/110:42:441
30553210515,15sleep10-21swapper/110:42:441
1763621057,40sleep317658-21df10:02:393
1194210422,68sleep01130-21latency_hist12:37:240
14164210223,53sleep014186-21awk09:52:230
1040021028,49sleep30-21swapper/307:57:253
1938621015,10sleep30-21swapper/308:23:383
2930829919,64sleep229382-21cat10:37:522
2882929927,45sleep228821-21apt-get07:12:382
882129814,64sleep08914-21fschecks_time11:17:400
924729719,24sleep20-21swapper/207:52:442
1305029615,20sleep213091-21users08:02:532
2509729519,60sleep225133-21wc08:42:512
2578129416,59sleep025863-21mailstats07:02:510
2881929320,14sleep30-21swapper/307:12:353
1133629316,61sleep110842-21apt-get09:42:341
2380729219,41sleep023951-21grep08:37:520
1543529146,31sleep315499-21mailstats11:37:503
2787529013,20sleep00-21swapper/012:18:260
2787529013,20sleep00-21swapper/012:18:260
2381229018,22sleep10-21swapper/110:22:241
2744828929,36sleep127473-21awk08:52:231
205572888,60sleep00-21swapper/008:27:550
149628810,15sleep30-21swapper/307:27:493
917328717,52sleep19336-21latency_hist09:37:251
218528623,41sleep12189-21cron10:57:221
3195428512,56sleep231956-21sshd07:22:352
3195428512,56sleep231956-21sshd07:22:352
799628412,55sleep28059-21sendmail_mailqu07:47:512
776528416,11sleep30-21swapper/311:12:503
979428320,48sleep19927-21awk07:52:551
691528326,28sleep10-21swapper/111:12:241
3089928349,22sleep330981-21mailstats07:17:523
2994328324,41sleep30-21swapper/312:22:573
824028225,30sleep10-21swapper/107:47:541
2043028214,55sleep220470-21ps08:27:532
176602827,14sleep00-21swapper/010:02:400
1074628216,19sleep10-21swapper/111:22:501
470228011,52sleep14825-21timerwakeupswit11:02:551
322922806,13sleep30-21swapper/312:32:343
9302798,39sleep30-21swapper/310:52:393
3219427919,18sleep10-21swapper/109:07:251
910427812,16sleep10-21swapper/111:17:451
666227813,46sleep20-21swapper/209:27:492
316732786,60sleep00-21swapper/012:28:030
2804127818,38sleep127714-21/usr/sbin/munin08:52:471
217542780,7sleep20-21swapper/211:57:512
217542780,7sleep20-21swapper/211:57:512
106127716,21sleep00-21swapper/007:27:380
63727519,33sleep2663-21munin-run10:52:222
63727519,33sleep2663-21munin-run10:52:222
2947927515,27sleep20-21swapper/212:22:482
2662727524,31sleep20-21swapper/207:07:252
2345527517,38sleep123494-21ntpq08:37:451
2241127527,23sleep10-21swapper/108:32:571
2005527510,49sleep120099-21grep08:27:441
1096027516,45sleep011085-21cat11:22:530
3051027417,42sleep130562-21latency_hist12:27:231
2163327414,39sleep021662-21proc_pri11:57:500
2163327414,39sleep021662-21proc_pri11:57:500
2797927315,35sleep20-21swapper/212:18:282
2797927315,35sleep20-21swapper/212:18:282
1579227317,26sleep20-21swapper/209:57:252
2606827213,46sleep226108-21ps10:27:542
2586527225,25sleep10-21swapper/107:02:521
1866227221,33sleep10-21swapper/111:47:541
1733727217,41sleep217350-21open_files08:17:512
1555927224,27sleep215618-21sshd08:12:472
1434527221,29sleep10-21swapper/108:07:531
437027122,29sleep04391-21idleruntime-cro09:22:220
2709527118,35sleep127118-21munin-run12:17:221
2709527118,35sleep127118-21munin-run12:17:221
2114227111,37sleep220892-21/usr/sbin/munin10:13:002
1696027121,33sleep10-21swapper/108:17:421
2912627011,15sleep10-21swapper/110:37:471
2723027013,40sleep227239-21/usr/sbin/munin10:32:392
2968926913,39sleep029176-21/usr/sbin/munin12:22:540
2762726924,23sleep10-21swapper/107:07:561
2713426925,21sleep20-21swapper/212:17:232
2713426925,21sleep20-21swapper/212:17:232
233542699,46sleep023407-21users10:17:550
147426922,25sleep20-21swapper/207:27:482
761126818,23sleep00-21swapper/011:12:470
322972688,46sleep10-21swapper/112:32:361
287626815,25sleep00-21swapper/009:17:250
2810926821,25sleep20-21swapper/208:52:482
2594526820,31sleep026072-21latency_hist08:47:250
2402326815,36sleep124028-21acpi10:22:321
2005926815,23sleep00-21swapper/011:52:500
3035526712,41sleep030363-21df10:42:390
3035526712,41sleep030363-21df10:42:390
1096026722,24sleep00-21swapper/009:42:250
3229826613,33sleep232342-21/usr/sbin/munin12:32:372
313262660,7sleep00-21swapper/009:02:510
311626611,36sleep13179-21/usr/sbin/munin09:17:381
134526613,38sleep11491-21modprobe09:12:261
1132626616,32sleep011335-21/usr/sbin/munin09:42:330
593926517,22sleep10-21swapper/107:42:331
279626518,27sleep22822-21munin-run09:17:232
2372226510,41sleep00-21swapper/012:04:000
2372226510,41sleep00-21swapper/012:04:000
1346726518,26sleep10-21swapper/111:32:431
954126417,27sleep19032-21apt-get09:37:331
2729826418,22sleep00-21swapper/012:17:250
2729826418,22sleep00-21swapper/012:17:250
2092626419,17sleep20-21swapper/211:57:242
1975126422,27sleep00-21swapper/010:07:570
933726313,25sleep20-21swapper/209:37:262
716426318,25sleep00-21swapper/007:46:360
3166826315,30sleep231697-21munin-run07:22:232
3135026315,22sleep10-21swapper/112:27:561
2841626316,26sleep128440-21munin-run10:37:221
2620526312,23sleep00-21swapper/010:27:570
2553126321,22sleep20-21swapper/212:12:222
191302637,13sleep00-21swapper/008:22:540
1818026317,25sleep00-21swapper/008:22:260
490826217,32sleep11-21systemd07:37:531
351426228,19sleep20-21swapper/207:33:012
3196026219,21sleep10-21swapper/107:22:381
3196026219,21sleep10-21swapper/107:22:381
3073026212,29sleep230749-21apt-get12:27:372
2997326214,30sleep130098-21timerwakeupswit08:57:561
2923526212,35sleep029280-21ntp_states07:12:480
675226018,25sleep16815-21swap09:27:521
2774126017,26sleep027733-21apt-get08:52:380
2609826016,24sleep326196-21users07:02:543
255042605,11sleep00-21swapper/012:12:000
2197526016,23sleep00-21swapper/008:32:520
1078626012,26sleep20-21swapper/211:22:512
818025923,21sleep10-21swapper/111:14:221
2349025915,20sleep20-21swapper/212:02:532
2349025915,20sleep20-21swapper/212:02:532
1642225913,31sleep016459-21/usr/sbin/munin09:57:480
1374125918,25sleep213732-21apt-get08:07:382
135532595,11sleep20-21swapper/211:32:442
561225814,28sleep05607-21apt-get11:07:380
442625811,32sleep00-21swapper/007:37:400
359725810,27sleep20-21swapper/209:17:522
3249325816,18sleep00-21swapper/007:22:540
3249325816,18sleep00-21swapper/007:22:540
2715625820,19sleep00-21swapper/010:32:370
2653025812,23sleep10-21swapper/110:28:101
259725817,25sleep02691-21tune2fs10:57:450
1373725815,27sleep013738-21sshd08:07:360
1073725820,16sleep10-21swapper/107:57:431
105525818,24sleep11052-21apt-get07:27:351
442925719,15sleep20-21swapper/211:02:482
325652575,11sleep20-21swapper/209:07:422
3018025713,24sleep10-21swapper/107:17:251
2978025712,21sleep20-21swapper/208:57:532
2472125720,20sleep10-21swapper/108:42:421
85692567,12sleep20-21swapper/211:17:262
843925622,17sleep20-21swapper/209:32:542
2295425617,24sleep222959-21ntp_states10:17:492
1821225615,22sleep10-21swapper/110:02:541
177262565,12sleep00-21swapper/011:46:560
1202525613,24sleep112083-21if_eth011:27:471
1083525614,27sleep20-21swapper/207:57:442
751825513,25sleep07510-21apt-get07:47:370
570725516,19sleep20-21swapper/211:07:452
347825517,21sleep10-21swapper/110:58:351
3105625518,18sleep10-21swapper/107:17:541
2685725517,15sleep00-21swapper/007:07:350
230525512,25sleep00-21swapper/010:57:250
2151325515,25sleep221505-21apt-get08:32:372
1958925514,24sleep119586-21apt-get11:52:341
1529325515,22sleep00-21swapper/008:12:400
2224925414,22sleep122265-21munin-run10:17:231
1972525418,22sleep20-21swapper/208:27:242
1781225417,21sleep10-21swapper/111:47:251
1495425419,16sleep20-21swapper/211:37:372
1346225412,25sleep013466-21diskstats11:32:420
1136725415,24sleep211347-21apt-get09:42:432
707225313,22sleep07111-21users09:27:550
468025316,19sleep10-21swapper/109:22:391
2989225314,17sleep00-21swapper/008:57:550
273125314,23sleep22780-21irqstats10:57:472
250432537,36sleep20-21swapper/210:23:552
2272225313,25sleep122714-21apt-get12:02:361
2272225313,25sleep122714-21apt-get12:02:361
1950725311,23sleep20-21swapper/210:07:512
1445125313,24sleep014447-21apt-get09:52:350
122662537,17sleep20-21swapper/211:27:522
951925214,22sleep09525-21ntp_states07:52:500
2423825215,17sleep00-21swapper/010:22:440
1603025212,24sleep116023-21apt-get09:57:371
1486225211,24sleep114907-21ntp_states09:52:481
1335325215,17sleep10-21swapper/109:47:471
293625113,15sleep10-21swapper/107:32:481
1878825118,18sleep10-21swapper/108:22:471
1318925113,21sleep213273-21memory09:47:442
1121725115,21sleep00-21swapper/007:57:550
462425015,16sleep00-21swapper/011:02:540
2167325016,20sleep10-21swapper/111:57:511
2167325016,20sleep10-21swapper/111:57:511
1767525011,15sleep20-21swapper/210:02:422
1558025015,16sleep10-21swapper/111:37:521
1246025013,18sleep00-21swapper/008:02:430
2329724913,19sleep223354-21irqstats08:37:422
775224814,18sleep00-21swapper/009:32:360
3089624814,15sleep20-21swapper/210:42:532
3089624814,15sleep20-21swapper/210:42:532
2882824814,16sleep00-21swapper/010:37:420
1775824816,19sleep217779-21munin-run11:47:222
1697624814,19sleep20-21swapper/209:58:222
1804924513,15sleep00-21swapper/011:47:370
157072458,15sleep10-21swapper/108:12:501
756524310,16sleep20-21swapper/211:12:452
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional