You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-21 - 05:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Fri Aug 21, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4097296212952,70sleep30-21swapper/33
40972842126108,12sleep10-21swapper/11
409717528758,11sleep20-21swapper/22
409738227855,17sleep00-21swapper/00
1803172340,3sleep2180318-21cpuspeed_turbos2
409759499241,19cyclictest398728-21chrt3
409759499232,17cyclictest0-21swapper/33
409759499231,14cyclictest0-21swapper/33
409759499216,12cyclictest0-21swapper/33
409759499211,16cyclictest0-21swapper/33
409759499211,15cyclictest0-21swapper/33
3416462202,13sleep0342934-21/usr/sbin/munin0
4097594991916,1cyclictest0-21swapper/33
409759499191,15cyclictest0-21swapper/33
409759499191,15cyclictest0-21swapper/33
409759499191,15cyclictest0-21swapper/33
409759499191,14cyclictest0-21swapper/33
409759499191,14cyclictest0-21swapper/33
409759499191,14cyclictest0-21swapper/33
409759499191,14cyclictest0-21swapper/33
409759499191,14cyclictest0-21swapper/33
409759499191,14cyclictest0-21swapper/33
409759499191,14cyclictest0-21swapper/33
409759499191,14cyclictest0-21swapper/33
409759499191,14cyclictest0-21swapper/33
409759499182,11cyclictest351791-21taskset3
409759499182,11cyclictest343158-21taskset3
4097594991814,2cyclictest0-21swapper/33
4097594991812,4cyclictest0-21swapper/33
4097594991811,4cyclictest0-21swapper/33
409759499181,14cyclictest0-21swapper/33
409759499181,14cyclictest0-21swapper/33
409759499181,14cyclictest0-21swapper/33
409759499181,14cyclictest0-21swapper/33
409759499181,14cyclictest0-21swapper/33
409759499181,14cyclictest0-21swapper/33
409759499181,14cyclictest0-21swapper/33
409759499181,14cyclictest0-21swapper/33
409759499181,14cyclictest0-21swapper/33
409759499181,14cyclictest0-21swapper/33
409759499181,13cyclictest0-21swapper/33
409759499181,13cyclictest0-21swapper/33
409759499181,13cyclictest0-21swapper/33
409759499181,13cyclictest0-21swapper/33
1236762180,2sleep1123675-21sendmail_mailqu1
680352171,12sleep269598-21kthreadcore2
4097594991714,1cyclictest0-21swapper/33
4097594991712,3cyclictest0-21swapper/33
409759499171,13cyclictest0-21swapper/33
409759499171,13cyclictest0-21swapper/33
409759499171,13cyclictest0-21swapper/33
409759499171,13cyclictest0-21swapper/33
409759499170,4cyclictest0-21swapper/33
409759499170,14cyclictest0-21swapper/33
409759499170,14cyclictest0-21swapper/33
1981962171,4sleep0198305-21ps0
838242161,2sleep10-21swapper/11
41257492161,4sleep21-21systemd2
409759499161,3cyclictest0-21swapper/33
4097594991613,1cyclictest0-21swapper/33
409759499161,12cyclictest0-21swapper/33
409759499160,14cyclictest0-21swapper/33
409759499160,14cyclictest0-21swapper/33
409759499160,13cyclictest0-21swapper/33
409759499160,13cyclictest0-21swapper/33
409759499160,13cyclictest0-21swapper/33
3161992161,4sleep131703-21diskmemload1
2661552161,3sleep20-21swapper/22
1792132160,1sleep00-21swapper/00
1180832161,10sleep00-21swapper/00
665502151,9sleep166621-21munin-run1
473112151,4sleep131703-21diskmemload1
4097594991513,1cyclictest0-21swapper/33
409759499151,12cyclictest0-21swapper/33
409759499151,10cyclictest0-21swapper/33
409759499151,10cyclictest0-21swapper/33
409759499150,13cyclictest0-21swapper/33
409759499150,12cyclictest21102-21chrt3
409759499150,12cyclictest0-21swapper/33
409759499150,11cyclictest0-21swapper/33
3692992150,5sleep2364699-21sendmail-msp2
3449682151,5sleep1344982-21ssh1
3353482151,8sleep031703-21diskmemload0
2239322151,10sleep10-21swapper/11
1540622153,6sleep1154086-21apt-get1
1367272151,7sleep0136755-21ssh0
889612141,9sleep284024-21sendmail-msp2
41156172141,4sleep14115839-21cstates1
409759499148,3cyclictest41312832sleep33
4097594991411,2cyclictest0-21swapper/33
4097594991411,2cyclictest0-21swapper/33
3980932141,9sleep0398107-21ssh0
380952144,3sleep20-21swapper/22
3802062141,3sleep131703-21diskmemload1
3630932141,3sleep231703-21diskmemload2
2845672141,8sleep131703-21diskmemload1
2558722140,2sleep20-21swapper/22
1689092141,2sleep00-21swapper/00
669802131,2sleep166978-21apt-get1
632292131,8sleep263232-21ssh2
409759499130,2cyclictest0-21swapper/33
364632131,8sleep036662-21sed0
3449282131,6sleep20-21swapper/22
3347782131,6sleep2335024-21users2
3156212131,3sleep0315636-21ssh0
3076342131,8sleep0307649-21ssh0
3003592130,3sleep031703-21diskmemload0
2486602131,8sleep1248671-21sh1
2470092131,7sleep031703-21diskmemload0
2051802131,5sleep10-21swapper/11
1850002131,3sleep1185014-21ssh1
1801472132,5sleep031703-21diskmemload0
1169802130,9sleep231703-21diskmemload2
1008272131,3sleep0100841-21ssh0
843552121,6sleep131703-21diskmemload1
41471622121,7sleep24147393-21expr2
3811612120,8sleep0381175-21ssh0
3656172121,7sleep1365812-21cut1
3645682121,7sleep1364582-21ssh1
3253272121,7sleep2325338-21ssh2
3080622127,2sleep20-21swapper/22
2817022121,6sleep231703-21diskmemload2
2373072121,7sleep2237321-21ssh2
2373072121,7sleep2237321-21ssh2
2161322121,7sleep1217701-21grep1
2104702121,6sleep2210540-21/usr/sbin/munin2
1962882121,5sleep20-21swapper/22
1889082120,3sleep031703-21diskmemload0
1212102121,7sleep0122717-21cut0
1150292121,7sleep1110508-21/usr/sbin/munin1
1035842121,7sleep2105221-21grep2
990722112,4sleep231703-21diskmemload2
484812110,1sleep00-21swapper/00
41891502111,4sleep04189169-21apt-get0
41471402111,5sleep14147159-21apt-get1
3975612111,3sleep20-21swapper/22
3802172111,6sleep2380232-21ssh2
373142110,2sleep137328-21ssh1
3296192111,6sleep1329945-21grep1
3205792111,6sleep031703-21diskmemload0
2671262111,3sleep20-21swapper/22
2663492111,5sleep131703-21diskmemload1
2498042111,3sleep10-21swapper/11
2488662111,3sleep2248878-21ssh2
2404882111,3sleep00-21swapper/00
2404882111,3sleep00-21swapper/00
235212111,6sleep125256-21cut1
2112142110,2sleep00-21swapper/00
2047282111,3sleep20-21swapper/22
188922111,5sleep220052-21memory2
1590032111,5sleep0159014-21ssh0
1540962111,6sleep2154219-21cpuspeed_turbos2
1497422110,1sleep00-21swapper/00
1453372111,5sleep131703-21diskmemload1
1436902111,6sleep131703-21diskmemload1
1264432111,5sleep231703-21diskmemload2
998302101,4sleep131703-21diskmemload1
893212100,1sleep00-21swapper/00
823422100,1sleep20-21swapper/22
730392101,2sleep00-21swapper/00
538642100,6sleep154017-21switchtime1
41877522101,5sleep14187902-21grep1
41629602101,4sleep24163155-21expr2
41528952101,5sleep04153026-21kthreadcore0
41418512101,4sleep24141870-21apt-get2
41315642100,1sleep10-21swapper/11
41132632100,2sleep20-21swapper/22
41050392101,3sleep20-21swapper/22
3910782101,4sleep1391099-21apt-get1
3872022101,4sleep231703-21diskmemload2
3823472100,6sleep131703-21diskmemload1
3707802101,3sleep031703-21diskmemload0
3618982101,2sleep00-21swapper/00
3544422101,3sleep20-21swapper/22
3538022101,3sleep031703-21diskmemload0
3221662100,1sleep10-21swapper/11
3158032101,3sleep20-21swapper/22
2994492100,1sleep10-21swapper/11
2931252101,4sleep231703-21diskmemload2
2907522100,2sleep20-21swapper/22
2828632101,2sleep10-21swapper/11
2819382101,3sleep031703-21diskmemload0
2743762100,5sleep031703-21diskmemload0
2719902101,4sleep131703-21diskmemload1
2638322101,2sleep00-21swapper/00
2559562100,1sleep00-21swapper/00
2364372100,2sleep1236587-21ssh1
2364372100,2sleep1236587-21ssh1
2297392100,1sleep20-21swapper/22
2291132101,2sleep00-21swapper/00
2226452101,2sleep20-21swapper/22
2197412101,3sleep031703-21diskmemload0
2126572101,2sleep10-21swapper/11
1784362101,3sleep20-21swapper/22
1679892101,5sleep1168000-21ssh1
1631002101,5sleep2163138-21grep2
1515272101,2sleep20-21swapper/22
149752102,4sleep215033-21pmu-power2
1420572101,3sleep20-21swapper/22
1346372101,4sleep031703-21diskmemload0
1083922100,1sleep00-21swapper/00
1072082101,3sleep10-21swapper/11
75553291,3sleep031703-21diskmemload0
64328290,2sleep00-21swapper/00
49454291,3sleep249174-21sendmail-msp2
46133291,2sleep20-21swapper/22
4176696291,4sleep24177380-21cat2
4173981291,4sleep04175143-21cut0
4158268291,4sleep04159010-21grep0
4151001291,4sleep04151126-21netstat0
4136117291,2sleep0106713-21snmpd0
4130997291,4sleep14131076-21munin-run1
4126072291,3sleep04126068-21apt-get0
4121323291,4sleep14121488-21tr1
4109804290,1sleep00-21swapper/00
389944290,1sleep00-21swapper/00
352936291,3sleep131703-21diskmemload1
308519291,2sleep10-21swapper/11
292365290,5sleep031703-21diskmemload0
26725291,3sleep226744-21apt-get2
190146291,4sleep1191553-21cut1
176614291,5sleep1136350-21kworker/u16:3+rpciod1
16191291,2sleep00-21swapper/00
135735291,3sleep10-21swapper/11
133326290,1sleep20-21swapper/22
11418291,4sleep111534-21irqstats1
6494281,3sleep08079-21grep0
54391281,2sleep00-21swapper/00
4193970280,1sleep10-21swapper/11
4169795281,3sleep14171520-21kthreadcore1
4162938280,2sleep10-21swapper/11
4157729281,2sleep14157988-21df_inode1
4157096280,1sleep20-21swapper/22
4141518280,2sleep00-21swapper/00
4136020280,2sleep20-21swapper/22
4125636280,1sleep00-21swapper/00
4115595280,2sleep00-21swapper/00
4114378281,3sleep04114427-21ntp_states0
4110452281,3sleep14110299-21/usr/sbin/munin1
4102609280,2sleep00-21swapper/00
4098346281,3sleep24099389-21kthreadcore2
4097776280,2sleep10-21swapper/11
5072270,1sleep10-21swapper/11
4186080271,3sleep04187751-21latency0
4183938270,2sleep20-21swapper/22
4179235271,2sleep24179573-21kthreadcore2
4175144271,3sleep10-21swapper/11
4172973270,4sleep00-21swapper/00
4167885270,4sleep00-21swapper/00
4152382270,2sleep10-21swapper/11
4145740271,1sleep14145859-21strings1
4142092271,3sleep00-21swapper/00
4127368270,3sleep20-21swapper/22
4109821270,1sleep10-21swapper/11
404271,2sleep00-21swapper/00
31502270,1sleep10-21swapper/11
27582271,2sleep00-21swapper/00
25545271,2sleep00-21swapper/00
20254271,2sleep120365-21rt-features1
10464271,3sleep20-21swapper/22
5183260,1sleep20-21swapper/22
4191387260,2sleep24189151-21/usr/sbin/munin2
4183441260,1sleep00-21swapper/00
4178700261,2sleep10-21swapper/11
4161939261,2sleep20-21swapper/22
4137130261,2sleep20-21swapper/22
4117841260,2sleep24119395-21latency2
10573261,2sleep110574-21pool-udisksd1
4136361250,1sleep10-21swapper/11
21430250,1sleep20-21swapper/22
15545250,3sleep00-21swapper/00
4168460240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional