You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 12:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Thu Apr 16, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4155549211753,59sleep30-21swapper/33
415561129254,12sleep20-21swapper/22
415578928263,12sleep10-21swapper/11
415574727553,6sleep00-21swapper/00
4385672420,3sleep30-21swapper/33
398332380,2sleep30-21swapper/33
2924932241,19sleep092744-21diskmemload0
415597799217,11cyclictest0-21swapper/33
4155977992118,1cyclictest0-21swapper/33
4155977992116,2cyclictest66950irq/132-enp1s0-TxRx-33
415597799211,16cyclictest0-21swapper/33
415597799211,15cyclictest0-21swapper/33
415597799201,16cyclictest0-21swapper/33
415597799201,15cyclictest434074-21taskset3
415597799201,15cyclictest0-21swapper/33
3888312201,3sleep10-21swapper/11
1010452201,2sleep00-21swapper/00
4155977991916,1cyclictest0-21swapper/33
4155977991915,2cyclictest0-21swapper/33
4155977991914,3cyclictest0-21swapper/33
4155977991912,4cyclictest0-21swapper/33
415597799191,15cyclictest162204-21chrt3
415597799191,14cyclictest0-21swapper/33
415597799191,14cyclictest0-21swapper/33
415597799190,15cyclictest389263-21taskset3
4155977991815,1cyclictest0-21swapper/33
4155977991811,4cyclictest0-21swapper/33
415597799181,14cyclictest0-21swapper/33
415597799181,14cyclictest0-21swapper/33
415597799181,14cyclictest0-21swapper/33
415597799181,14cyclictest0-21swapper/33
415597799181,14cyclictest0-21swapper/33
415597799181,14cyclictest0-21swapper/33
415597799181,14cyclictest0-21swapper/33
415597799181,14cyclictest0-21swapper/33
415597799181,14cyclictest0-21swapper/33
415597799181,14cyclictest0-21swapper/33
415597799181,14cyclictest0-21swapper/33
415597799181,14cyclictest0-21swapper/33
415597799181,14cyclictest0-21swapper/33
415597799181,14cyclictest0-21swapper/33
415597799180,16cyclictest0-21swapper/33
415597799180,15cyclictest0-21swapper/33
415597799180,14cyclictest0-21swapper/33
415597799180,14cyclictest0-21swapper/33
415597799180,14cyclictest0-21swapper/33
4144962181,4sleep0414511-21ssh0
3715612181,2sleep192744-21diskmemload1
415597799175,2cyclictest0-21swapper/33
415597799171,13cyclictest0-21swapper/33
415597799171,13cyclictest0-21swapper/33
415597799171,13cyclictest0-21swapper/33
415597799171,13cyclictest0-21swapper/33
415597799171,13cyclictest0-21swapper/33
415597799170,14cyclictest0-21swapper/33
3885622171,2sleep00-21swapper/00
3543352171,3sleep00-21swapper/00
3356542170,7sleep20-21swapper/22
2116352171,3sleep20-21swapper/22
1413082171,11sleep2141334-21systemctl2
1326602171,3sleep20-21swapper/22
4467612161,4sleep092744-21diskmemload0
4155977991614,1cyclictest0-21swapper/33
4155977991614,1cyclictest0-21swapper/33
4155977991614,1cyclictest0-21swapper/33
415597799160,15cyclictest0-21swapper/33
415597799160,14cyclictest0-21swapper/33
415597799160,14cyclictest0-21swapper/33
415597799160,13cyclictest0-21swapper/33
415597799160,13cyclictest0-21swapper/33
415597799160,13cyclictest0-21swapper/33
415597799160,13cyclictest0-21swapper/33
415597799160,13cyclictest0-21swapper/33
415597799160,13cyclictest0-21swapper/33
3353392161,4sleep192744-21diskmemload1
2125342161,2sleep00-21swapper/00
2050512160,3sleep00-21swapper/00
1455052167,2sleep2171rcu_preempt2
4516852151,3sleep192744-21diskmemload1
415597799159,3cyclictest4190171-21sleep3
415597799158,3cyclictest83238-21taskset3
4155977991512,2cyclictest0-21swapper/33
415597799150,13cyclictest0-21swapper/33
415597799150,12cyclictest0-21swapper/33
2683142151,3sleep10-21swapper/11
2304592151,4sleep192744-21diskmemload1
1431492151,1sleep00-21swapper/00
1112302151,4sleep2111795-21kthreadcore2
415597799141,2cyclictest0-21swapper/33
4155977991412,1cyclictest0-21swapper/33
3271502141,7sleep10-21swapper/11
3105222140,2sleep00-21swapper/00
2844782141,9sleep2284492-21ssh2
2656302140,3sleep20-21swapper/22
2656302140,3sleep20-21swapper/22
1793662141,3sleep292744-21diskmemload2
1679242141,2sleep20-21swapper/22
610382132,5sleep161057-21apt-get1
503832131,8sleep150641-21df_inode1
4260192131,8sleep0426031-21rm0
415597799138,2cyclictest0-21swapper/33
4155977991310,2cyclictest0-21swapper/33
415597799130,9cyclictest0-21swapper/33
3972882131,7sleep192744-21diskmemload1
3551082131,3sleep1355119-21ssh1
3045482131,8sleep2306199-21tr2
2597272131,8sleep1259802-21tune2fs1
2597272131,8sleep1259802-21tune2fs1
2574942131,3sleep0257504-21ssh0
2503082131,8sleep1250537-21cat1
2469842131,6sleep244-21ksoftirqd/22
2127512131,7sleep192744-21diskmemload1
1887882131,8sleep0188802-21ssh0
1155512131,3sleep0115565-21ssh0
1078582131,8sleep0107865-21ssh0
4439862121,5sleep2444017-21ssh2
4405362121,3sleep0440547-21ssh0
4242322120,3sleep2424246-21ssh2
41891132121,6sleep24189159-21ntpq2
41732332121,5sleep24173286-21ntp_states2
3968692121,7sleep0396883-21ssh0
3386062121,5sleep1338637-21ssh1
2752152121,5sleep092744-21diskmemload0
2583112121,5sleep10-21swapper/11
2415672121,7sleep2241784-21wc2
2385702121,7sleep092744-21diskmemload0
231082122,5sleep023127-21apt-get0
183312121,7sleep118828-21cat1
183312121,7sleep118828-21cat1
1455682121,7sleep1145811-21ssh1
1048002121,7sleep1105875-21memory1
990582111,4sleep192744-21diskmemload1
974332111,6sleep297541-21processes2
917092111,5sleep291755-21ntpq2
757502111,5sleep075804-21ntpq0
719692111,5sleep272178-21hddtemp_smartct2
490832111,5sleep149129-21ntpq1
450372111,4sleep245294-21df_inode2
4346912111,5sleep192744-21diskmemload1
4236662111,3sleep10-21swapper/11
41846452110,1sleep10-21swapper/11
4170302111,5sleep292744-21diskmemload2
41640322111,6sleep24165351-21tr2
41639602111,5sleep14164031-21irqstats1
4103402110,7sleep1412022-21grep1
4073792111,5sleep192744-21diskmemload1
4059882111,5sleep20-21swapper/22
3913752111,5sleep2391605-21df_inode2
3887922111,4sleep20-21swapper/22
3819632111,6sleep1381976-21ssh1
3643582110,1sleep10-21swapper/11
3605432111,5sleep2360592-21ntpq2
3559992111,5sleep092744-21diskmemload0
3341962111,5sleep0334322-21rt-features0
3215362111,6sleep0323042-21ps0
3196212111,4sleep192744-21diskmemload1
3163822111,5sleep2316440-21ntp_states2
3023152111,4sleep192744-21diskmemload1
2859822111,5sleep2286250-21df2
2403332111,5sleep192744-21diskmemload1
231302110,7sleep123328-21ls1
2300662111,6sleep292744-21diskmemload2
1979772112,4sleep2198005-21apt-get2
1864302111,3sleep10-21swapper/11
1690572111,3sleep00-21swapper/00
1597732111,4sleep292744-21diskmemload2
1455352111,5sleep0145567-21ssh0
1367012111,6sleep1136713-21rm1
1297102111,6sleep1131357-21cut1
1258862111,4sleep092744-21diskmemload0
124322111,4sleep212451-21apt-get2
879632101,5sleep088173-21hddtemp_smartct0
76152101,5sleep27771-21cut2
68482101,4sleep06874-21munin-run0
619362101,6sleep263651-21kthreadcore2
552792100,2sleep20-21swapper/22
4599132101,2sleep20-21swapper/22
4597972101,4sleep192744-21diskmemload1
4402642101,4sleep292744-21diskmemload2
4265162104,1sleep20-21swapper/22
4264892101,3sleep00-21swapper/00
41561572101,4sleep04156415-21df_inode0
4063072104,3sleep092744-21diskmemload0
3780592101,4sleep2378120-21ntpq2
3743432101,5sleep0374435-21irqstats0
3715212101,2sleep20-21swapper/22
3475372101,2sleep20-21swapper/22
3442772101,3sleep00-21swapper/00
3386382101,4sleep2338908-21df_inode2
3270152101,6sleep2327026-21ssh2
3162542101,5sleep0316312-21ntpq0
3033672101,3sleep192744-21diskmemload1
3002812101,3sleep00-21swapper/00
2993742101,4sleep2299599-21users2
2942192101,4sleep192744-21diskmemload1
2831452100,1sleep00-21swapper/00
2813252101,4sleep1281382-21ntpq1
2744292101,2sleep20-21swapper/22
2650472100,1sleep00-21swapper/00
2650472100,1sleep00-21swapper/00
2579602101,3sleep20-21swapper/22
2418262100,4sleep00-21swapper/00
2209992101,3sleep20-21swapper/22
2171092102,4sleep1218797-21grep1
2055652101,4sleep192744-21diskmemload1
1957962100,2sleep10-21swapper/11
1934212101,4sleep0193478-21ssh0
1776992101,4sleep192744-21diskmemload1
1767742101,5sleep0176788-21ssh0
1685722101,6sleep192744-21diskmemload1
1595572101,4sleep192744-21diskmemload1
1253012101,4sleep192744-21diskmemload1
1250012101,2sleep20-21swapper/22
1018312101,6sleep2101850-21acpi2
92735291,4sleep192839-21ls1
82357291,4sleep282376-21apt-get2
71764291,4sleep171968-21/usr/sbin/munin1
67876291,3sleep169658-21kthreadcore1
66929291,4sleep067875-21grep0
452675291,3sleep092744-21diskmemload0
435137291,3sleep192744-21diskmemload1
4173126291,4sleep04173183-21ntpq0
4169673290,5sleep14171176-21kthreadcore1
4159304291,5sleep14160099-21missed_timers1
369054291,4sleep0369215-21head0
32810291,4sleep032857-21ntpq0
228791291,2sleep00-21swapper/00
1967291,5sleep22090-21diskstats2
194545291,4sleep2194559-21ssh2
185981291,2sleep20-21swapper/22
17804291,4sleep218059-21df2
17804291,4sleep218059-21df2
159691291,2sleep00-21swapper/00
133220291,4sleep0133232-21ssh0
117028291,2sleep10-21swapper/11
60164280,4sleep20-21swapper/22
4180407281,4sleep04182084-21tr0
39679280,3sleep139698-21apt-get1
33096280,4sleep133167-21find1
216122281,3sleep0217108-21grep0
1530280,1sleep00-21swapper/00
87208270,1sleep00-21swapper/00
87106270,1sleep10-21swapper/11
81821270,1sleep20-21swapper/22
81820270,4sleep10-21swapper/11
60586270,1sleep10-21swapper/11
56539271,3sleep058236-21kthreadcore0
50915271,3sleep051660-21kthreadcore0
44746271,3sleep20-21swapper/22
4192073270,3sleep24193869-21kthreadcore2
4178632270,4sleep04178763-21mailstats0
4175697271,3sleep20-21swapper/22
4174435270,2sleep10-21swapper/11
4163750271,3sleep04163462-21/usr/sbin/munin0
38966270,1sleep20-21swapper/22
38423270,1sleep10-21swapper/11
2374271,2sleep10-21swapper/11
17407270,1sleep00-21swapper/00
81948260,4sleep00-21swapper/00
71337260,1sleep20-21swapper/22
61037260,1sleep00-21swapper/00
43504260,2sleep043696-21strings0
4190994261,2sleep14192072-21kthreadcore1
4160101260,2sleep20-21swapper/22
34877261,2sleep00-21swapper/00
28682260,2sleep228190-21apt-get2
28026260,1sleep20-21swapper/22
22837260,4sleep00-21swapper/00
22837260,4sleep00-21swapper/00
17423260,1sleep10-21swapper/11
12038260,1sleep00-21swapper/00
48941250,1sleep00-21swapper/00
4189979250,1sleep10-21swapper/11
4184235250,1sleep20-21swapper/22
12167251,2sleep10-21swapper/11
4185372240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional