You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-03 - 06:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Fri Jul 03, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27528211856,57sleep30-21swapper/33
2762128653,10sleep20-21swapper/22
2769528358,10sleep10-21swapper/11
2778928060,14sleep00-21swapper/00
4826182221,7sleep1482653-21/usr/sbin/munin1
2796199221,16cyclictest0-21swapper/33
2796199211,17cyclictest0-21swapper/33
2796199211,17cyclictest0-21swapper/33
27961992111,6cyclictest0-21swapper/33
2796199211,12cyclictest0-21swapper/33
2791342211,5sleep1279140-21sh1
27961992012,4cyclictest0-21swapper/33
2796199201,16cyclictest0-21swapper/33
27961991916,1cyclictest0-21swapper/33
2796199191,14cyclictest66950irq/132-enp1s0-TxRx-33
2796199191,14cyclictest0-21swapper/33
2796199191,14cyclictest0-21swapper/33
2796199191,14cyclictest0-21swapper/33
2796199191,14cyclictest0-21swapper/33
2796199191,14cyclictest0-21swapper/33
2796199191,14cyclictest0-21swapper/33
2796199191,14cyclictest0-21swapper/33
2796199191,14cyclictest0-21swapper/33
2796199191,14cyclictest0-21swapper/33
2796199191,14cyclictest0-21swapper/33
2796199191,14cyclictest0-21swapper/33
2796199191,14cyclictest0-21swapper/33
2796199191,14cyclictest0-21swapper/33
2796199191,14cyclictest0-21swapper/33
3268202181,12sleep2326831-21ssh2
3268202181,12sleep2326831-21ssh2
2800962181,13sleep0155687-21diskmemload0
2796199181,14cyclictest0-21swapper/33
2796199181,14cyclictest0-21swapper/33
2796199181,14cyclictest0-21swapper/33
2796199181,14cyclictest0-21swapper/33
2796199181,14cyclictest0-21swapper/33
2796199181,14cyclictest0-21swapper/33
2796199181,14cyclictest0-21swapper/33
2796199181,13cyclictest0-21swapper/33
2796199181,13cyclictest0-21swapper/33
2796199181,13cyclictest0-21swapper/33
2796199181,13cyclictest0-21swapper/33
2796199181,13cyclictest0-21swapper/33
2796199180,15cyclictest0-21swapper/33
2796199180,15cyclictest0-21swapper/33
2796199180,14cyclictest0-21swapper/33
1875362181,3sleep10-21swapper/11
1689622181,3sleep10-21swapper/11
4567942171,5sleep2155687-21diskmemload2
3543992171,3sleep10-21swapper/11
27961991711,4cyclictest0-21swapper/33
27961991711,3cyclictest0-21swapper/33
27961991711,3cyclictest0-21swapper/33
2796199171,13cyclictest0-21swapper/33
2796199171,13cyclictest0-21swapper/33
2796199171,13cyclictest0-21swapper/33
2796199171,12cyclictest0-21swapper/33
27961991710,3cyclictest0-21swapper/33
2457502171,3sleep20-21swapper/22
1938272179,2sleep20-21swapper/22
1401982171,8sleep0140194-21apt-get0
1192452171,5sleep2119500-21df2
572902161,10sleep258904-21cut2
4379042161,2sleep10-21swapper/11
2796199161,3cyclictest0-21swapper/33
2796199161,2cyclictest134582-21taskset3
2796199161,13cyclictest0-21swapper/33
2796199161,12cyclictest0-21swapper/33
2796199160,13cyclictest0-21swapper/33
2796199160,13cyclictest0-21swapper/33
2796199160,13cyclictest0-21swapper/33
2796199160,12cyclictest0-21swapper/33
2796199160,12cyclictest0-21swapper/33
1861892161,4sleep2155687-21diskmemload2
1040702161,3sleep1104611-21kthreadcore1
4901752151,4sleep2155687-21diskmemload2
4489882152,8sleep0449010-21apt-get0
3262302151,10sleep1326455-21ssh1
3262302151,10sleep1326455-21ssh1
3204302151,2sleep00-21swapper/00
2796199153,8cyclictest0-21swapper/33
2796199151,3cyclictest0-21swapper/33
2796199151,10cyclictest114005-21chrt3
2796199150,12cyclictest0-21swapper/33
2796199150,12cyclictest0-21swapper/33
2796199150,12cyclictest0-21swapper/33
2796199150,12cyclictest0-21swapper/33
1560622151,10sleep0156081-21cpu0
1139832150,2sleep20-21swapper/22
555112141,4sleep151181-21/usr/sbin/munin1
4735602141,7sleep1473606-21munin-run1
4656842140,10sleep0465866-21cat0
4024942141,4sleep1402508-21ssh1
3709742141,3sleep1370986-21ssh1
3375952141,8sleep0155687-21diskmemload0
3372402141,9sleep1337252-21ssh1
2796199149,2cyclictest0-21swapper/33
2796199148,4cyclictest92729-21chrt3
2796199141,1cyclictest0-21swapper/33
2796199140,12cyclictest0-21swapper/33
1776792141,3sleep2155687-21diskmemload2
1398172140,1sleep10-21swapper/11
5038302131,6sleep10-21swapper/11
4971412131,8sleep1497155-21ssh1
4397102131,8sleep1440351-21cat1
4356692131,3sleep20-21swapper/22
4122572130,8sleep2155687-21diskmemload2
3391102131,8sleep1340187-21grep1
2634722131,8sleep1263483-21ssh1
2472472132,7sleep10-21swapper/11
2146352131,3sleep1214795-21cut1
1959212131,7sleep1155687-21diskmemload1
569522121,7sleep157288-21cut1
514612121,8sleep051513-21fschecks_count0
4988462121,7sleep2498858-21ssh2
4405482121,7sleep2440806-21cstates2
4295862121,5sleep20-21swapper/22
4291642121,7sleep1429173-21ssh1
4104392121,7sleep1410451-21ssh1
3856472121,8sleep0385658-21diskmemload0
3615952121,6sleep0155687-21diskmemload0
3054742121,5sleep1305631-21diskstats1
2887702121,7sleep1288799-21apt-get1
2870352121,6sleep1155687-21diskmemload1
2796199121,7cyclictest108978-21taskset3
2722382121,2sleep20-21swapper/22
2546062121,7sleep2254620-21ssh2
1806672121,7sleep0155687-21diskmemload0
1709832121,7sleep0155687-21diskmemload0
1235552121,7sleep0123800-21/usr/sbin/munin0
973262111,6sleep097583-21unixbench_singl0
722062111,5sleep072409-21diskstats0
721192111,5sleep272138-21apt-get2
5037242110,2sleep00-21swapper/00
4961212111,6sleep0155687-21diskmemload0
4890852111,5sleep0155687-21diskmemload0
4216292111,5sleep0155687-21diskmemload0
3855682111,3sleep10-21swapper/11
3759692111,6sleep0371809-21/usr/sbin/munin0
3688402111,4sleep2155687-21diskmemload2
3634722112,4sleep0363498-21apt-get0
3298872111,3sleep20-21swapper/22
3261202112,4sleep0555-21dbus-daemon0
3261202112,4sleep0555-21dbus-daemon0
3195572111,3sleep20-21swapper/22
3130862111,5sleep0155687-21diskmemload0
2859122110,2sleep20-21swapper/22
2632992113,4sleep2431ktimers/22
2358412111,4sleep00-21swapper/00
2298762111,3sleep20-21swapper/22
2279262110,5sleep10-21swapper/11
2229022111,6sleep0223132-21kthreadcore0
2215222111,4sleep2155687-21diskmemload2
2115772111,5sleep2155687-21diskmemload2
1890602111,2sleep00-21swapper/00
1720822110,1sleep00-21swapper/00
1296962111,4sleep2129715-21apt-get2
1140702111,5sleep0114273-21diskstats0
1087832110,7sleep2108977-21cstates2
1035412111,5sleep2103798-21df2
930342101,3sleep10-21swapper/11
616432101,5sleep00-21swapper/00
4958222100,3sleep20-21swapper/22
4803212101,4sleep0155687-21diskmemload0
4739412101,4sleep2473639-21sendmail-msp2
4637212101,3sleep20-21swapper/22
4624652100,4sleep10-21swapper/11
4595612101,5sleep0461239-21tr0
4385352101,5sleep0438233-40find0
4357372102,3sleep0155687-21diskmemload0
4206132101,2sleep20-21swapper/22
4200122100,1sleep10-21swapper/11
4193522101,4sleep0155687-21diskmemload0
4102812101,4sleep0155687-21diskmemload0
3941172101,4sleep2155687-21diskmemload2
3936802101,3sleep0155687-21diskmemload0
3866782101,4sleep2155687-21diskmemload2
3781392101,4sleep1155687-21diskmemload1
3748062101,4sleep2375818-21memory2
3600532100,2sleep10-21swapper/11
3586522100,4sleep2359087-21memory2
3520582101,2sleep00-21swapper/00
3516612100,3sleep20-21swapper/22
3454982100,1sleep20-21swapper/22
3443482101,2sleep00-21swapper/00
3184822101,2sleep10-21swapper/11
2982292101,4sleep1299864-21ssh1
2975432101,5sleep0298227-21kthreadcore0
2955842101,4sleep0155687-21diskmemload0
2893222101,5sleep2289407-21grep2
2868372101,4sleep0155687-21diskmemload0
2714562101,3sleep10-21swapper/11
2690132100,4sleep20-21swapper/22
2688422101,6sleep0155687-21diskmemload0
2615382101,4sleep0155687-21diskmemload0
2529742101,4sleep0155687-21diskmemload0
2439232101,2sleep00-21swapper/00
2358502101,4sleep1155687-21diskmemload1
2124702101,2sleep10-21swapper/11
2056712101,4sleep0205686-21ssh0
2037832101,4sleep1155687-21diskmemload1
1691682100,1sleep20-21swapper/22
1613572101,3sleep1155687-21diskmemload1
1509992101,4sleep2151210-21hddtemp_smartct2
1404622101,4sleep2140586-21perl2
87823291,3sleep088077-21df0
473930291,2sleep10-21swapper/11
47253291,4sleep048928-21kthreadcore0
45666291,4sleep045679-21cron0
449609291,4sleep1450528-21grep1
44756291,4sleep244847-21proc_pri2
40694291,3sleep10-21swapper/11
40398291,4sleep140409-21cron1
402279291,4sleep2402290-21ssh2
400957291,2sleep00-21swapper/00
393407291,4sleep1393417-21ssh1
310563291,4sleep2155687-21diskmemload2
297247291,4sleep2297360-21perl2
28123290,1sleep20-21swapper/22
235417291,3sleep20-21swapper/22
221730291,3sleep0155687-21diskmemload0
202888290,6sleep2202899-21ssh2
201847291,4sleep0202069-21ssh0
177388291,2sleep10-21swapper/11
161017291,2sleep20-21swapper/22
102329291,4sleep1102456-21systemctl1
51197280,2sleep20-21swapper/22
50895280,1sleep10-21swapper/11
470977281,2sleep20-21swapper/22
33447281,3sleep00-21swapper/00
28696281,3sleep028742-21kthreadcore0
246683280,2sleep10-21swapper/11
155313281,1sleep00-21swapper/00
146600280,1sleep10-21swapper/11
145489281,2sleep00-21swapper/00
140164280,3sleep1139888-21apt-get1
133903280,4sleep1134108-21cat1
128517281,3sleep00-21swapper/00
124766280,4sleep10-21swapper/11
108761280,2sleep10-21swapper/11
107403281,3sleep0103519-21/usr/sbin/munin0
98266271,2sleep00-21swapper/00
97677270,1sleep20-21swapper/22
82567270,1sleep00-21swapper/00
82182270,1sleep10-21swapper/11
77306270,2sleep00-21swapper/00
76922270,1sleep10-21swapper/11
71728270,1sleep20-21swapper/22
67458271,3sleep00-21swapper/00
66418270,1sleep10-21swapper/11
61057270,1sleep00-21swapper/00
50678270,1sleep20-21swapper/22
35423270,2sleep20-21swapper/22
155618270,1sleep10-21swapper/11
139502270,1sleep00-21swapper/00
129694270,1sleep00-21swapper/00
129270270,1sleep20-21swapper/22
124133270,1sleep10-21swapper/11
92442260,1sleep10-21swapper/11
87323260,4sleep10-21swapper/11
81933260,1sleep20-21swapper/22
71676260,1sleep10-21swapper/11
61933260,2sleep20-21swapper/22
29421261,2sleep10-21swapper/11
145448261,2sleep20-21swapper/22
134953261,2sleep20-21swapper/22
118252261,2sleep10-21swapper/11
113620260,1sleep00-21swapper/00
98030250,1sleep20-21swapper/22
91678250,1sleep20-21swapper/22
82557250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional