You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-09 - 10:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Thu Apr 09, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
44747221640,1sleep290-21kswapd02
38558721310,2sleep20-21swapper/22
4153057212063,51sleep30-21swapper/33
415283428666,12sleep20-21swapper/22
415283328354,10sleep10-21swapper/11
415285627453,15sleep00-21swapper/00
1818992320,2sleep2431ktimers/22
4153230993019,3cyclictest0-21swapper/33
3591452301,7sleep2359211-21ntpq2
415323099241,19cyclictest31283-21taskset3
415323099231,6cyclictest0-21swapper/33
415323099231,18cyclictest0-21swapper/33
415323099231,12cyclictest0-21swapper/33
415323099221,2cyclictest0-21swapper/33
415323099221,18cyclictest0-21swapper/33
415323099221,17cyclictest0-21swapper/33
415323099221,15cyclictest0-21swapper/33
3281412221,17sleep00-21swapper/00
415323099212,8cyclictest0-21swapper/33
4153230992117,2cyclictest0-21swapper/33
415323099211,3cyclictest1875992sleep33
415323099211,2cyclictest2651312sleep33
415323099211,16cyclictest448589-21taskset3
415323099210,18cyclictest0-21swapper/33
415323099210,12cyclictest0-21swapper/33
3436022211,5sleep290194-21diskmemload2
415323099203,7cyclictest0-21swapper/33
415323099203,7cyclictest0-21swapper/33
415323099203,7cyclictest0-21swapper/33
415323099202,8cyclictest0-21swapper/33
415323099202,7cyclictest0-21swapper/33
415323099201,8cyclictest90206-21turbostat3
4153230992018,1cyclictest0-21swapper/33
415323099201,16cyclictest0-21swapper/33
415323099201,15cyclictest66950irq/132-enp1s0-TxRx-33
415323099201,15cyclictest432248-21taskset3
415323099201,15cyclictest0-21swapper/33
415323099200,3cyclictest150792sleep33
415323099200,2cyclictest2557692sleep33
415323099200,16cyclictest1423782sleep33
415323099200,12cyclictest0-21swapper/33
3533962202,7sleep190194-21diskmemload1
415323099197,2cyclictest0-21swapper/33
415323099193,7cyclictest0-21swapper/33
4153230991913,3cyclictest0-21swapper/33
4153230991912,4cyclictest0-21swapper/33
415323099191,15cyclictest0-21swapper/33
415323099191,15cyclictest0-21swapper/33
415323099191,15cyclictest0-21swapper/33
415323099191,15cyclictest0-21swapper/33
415323099191,14cyclictest0-21swapper/33
415323099191,14cyclictest0-21swapper/33
415323099191,14cyclictest0-21swapper/33
415323099191,14cyclictest0-21swapper/33
415323099191,14cyclictest0-21swapper/33
415323099190,15cyclictest66950irq/132-enp1s0-TxRx-33
415323099188,1cyclictest0-21swapper/33
415323099181,14cyclictest0-21swapper/33
415323099181,13cyclictest0-21swapper/33
415323099180,3cyclictest41712672sleep33
415323099180,14cyclictest41818202sleep33
4138812181,2sleep20-21swapper/22
415323099171,13cyclictest0-21swapper/33
415323099171,13cyclictest0-21swapper/33
415323099171,12cyclictest0-21swapper/33
415323099171,12cyclictest0-21swapper/33
415323099170,14cyclictest0-21swapper/33
415323099170,14cyclictest0-21swapper/33
2535312172,8sleep0253595-21ntpq0
415323099160,13cyclictest0-21swapper/33
415323099160,13cyclictest0-21swapper/33
3779532161,2sleep10-21swapper/11
3698142161,2sleep00-21swapper/00
3610342161,4sleep0361036-21ssh0
942932151,9sleep194629-21/usr/sbin/munin1
518892151,8sleep251938-21ntpq2
4252402151,3sleep290194-21diskmemload2
415323099157,4cyclictest74487-21taskset3
4153230991512,2cyclictest0-21swapper/33
415323099151,11cyclictest96332sleep33
415323099150,13cyclictest0-21swapper/33
415323099150,12cyclictest0-21swapper/33
415323099150,11cyclictest0-21swapper/33
2893122150,2sleep10-21swapper/11
2581312151,6sleep00-21swapper/00
1919562151,5sleep090194-21diskmemload0
1580802151,10sleep2158095-21ssh2
1161412150,2sleep00-21swapper/00
4572322141,3sleep190194-21diskmemload1
415323099144,7cyclictest69962-21taskset3
415323099140,11cyclictest0-21swapper/33
4141892141,1sleep10-21swapper/11
3264112141,7sleep190194-21diskmemload1
2463222141,8sleep190194-21diskmemload1
2460372141,7sleep290194-21diskmemload2
2124652141,2sleep00-21swapper/00
1938292141,9sleep1193843-21ssh1
1867982140,3sleep090194-21diskmemload0
892282130,6sleep089288-21ntp_offset0
641202131,8sleep164325-21sed1
4569552131,8sleep0456968-21ssh0
4414172131,6sleep00-21swapper/00
4401702132,8sleep2440181-21sh2
3964882131,7sleep190194-21diskmemload1
3886932131,7sleep190194-21diskmemload1
3801342130,2sleep20-21swapper/22
3678612131,8sleep2367917-21ntpq2
3473222131,4sleep0348968-21cut0
3007382131,6sleep00-21swapper/00
2894832132,3sleep24153225-21cyclictest2
2649652131,8sleep290194-21diskmemload2
2637362131,7sleep190194-21diskmemload1
2282442130,2sleep290194-21diskmemload2
2047192131,7sleep190194-21diskmemload1
1782292131,8sleep2178240-21ssh2
1416592131,8sleep2141674-21sshd2
731822121,5sleep273223-21ntpq2
4474112122,5sleep1447470-21ntpq1
4408192121,5sleep10-21swapper/11
3432292120,1sleep10-21swapper/11
3099942124,3sleep04153225-21cyclictest0
2989322121,3sleep2298944-21ssh2
2837662121,5sleep20-21swapper/22
2755892121,7sleep00-21swapper/00
2370632125,4sleep04153225-21cyclictest0
2112082121,6sleep190194-21diskmemload1
1802262121,3sleep1181897-21kthreadcore1
1752162121,7sleep0175224-21ssh0
1341512121,8sleep2134166-21ssh2
90002111,5sleep29049-21ntpq2
837032111,4sleep083844-21ntpq0
798182111,5sleep280076-21df_inode2
625712111,5sleep162620-21ntpq1
464342111,7sleep046555-21ntpq0
4431792111,5sleep00-21swapper/00
4339162113,4sleep24153225-21cyclictest2
4331282111,3sleep00-21swapper/00
4312652111,4sleep190194-21diskmemload1
41810942111,5sleep24181140-21ntpq2
41574252111,5sleep14157482-21ntpq1
41539812111,6sleep24155487-21kthreadcore2
4081572111,5sleep0408390-21df_inode0
4064042111,4sleep290194-21diskmemload2
4035102111,4sleep1403566-21ntpq1
3804102111,3sleep00-21swapper/00
3347412110,6sleep190194-21diskmemload1
3343612111,3sleep00-21swapper/00
3251542111,4sleep290194-21diskmemload2
320462111,5sleep132117-21irqstats1
3104752112,4sleep290194-21diskmemload2
3018132111,4sleep190194-21diskmemload1
2927062111,3sleep00-21swapper/00
2823852111,4sleep190194-21diskmemload1
2664452111,4sleep290194-21diskmemload2
2395122110,1sleep20-21swapper/22
2223622111,4sleep290194-21diskmemload2
2217292111,5sleep10-21swapper/11
1964552110,1sleep00-21swapper/00
1769052111,5sleep190194-21diskmemload1
1670752111,2sleep10-21swapper/11
1667092111,3sleep00-21swapper/00
1567432111,5sleep1156804-21ntpq1
1480122111,5sleep2143684-21/usr/sbin/munin2
1425632111,4sleep190194-21diskmemload1
1348592111,2sleep00-21swapper/00
1341402110,1sleep190194-21diskmemload1
1243162111,3sleep00-21swapper/00
1230312111,2sleep20-21swapper/22
1072732111,3sleep00-21swapper/00
962122101,3sleep00-21swapper/00
946302101,4sleep294761-21ntpq2
890562101,4sleep289177-21ntpq2
691352100,1sleep00-21swapper/00
585482101,4sleep258790-21df_inode2
466052101,5sleep246650-21ntpq2
4580592101,4sleep290194-21diskmemload2
422382101,5sleep142458-21sed1
41935752101,4sleep04193828-21df0
41922752101,5sleep04192323-21ntpq0
41731432101,6sleep14174912-21kthreadcore1
4171942101,5sleep0417412-21tail0
41663672101,3sleep04166386-21apt-get0
41536902101,4sleep04153902-21hddtemp_smartct0
4043472101,3sleep00-21swapper/00
3606342100,1sleep10-21swapper/11
3440282100,2sleep00-21swapper/00
3327452101,3sleep20-21swapper/22
3193222101,3sleep00-21swapper/00
3160462101,2sleep20-21swapper/22
3081682101,3sleep190194-21diskmemload1
2722652101,4sleep190194-21diskmemload1
265352100,5sleep126745-21hddtemp_smartct1
2569792101,2sleep20-21swapper/22
2492252101,3sleep190194-21diskmemload1
2472222100,6sleep0247234-21ssh0
2296052100,1sleep00-21swapper/00
2183082101,5sleep0218372-21ssh0
2113222100,1sleep20-21swapper/22
206542101,5sleep020656-21cron0
1964832101,4sleep2196507-21apt-get2
1657172101,3sleep290194-21diskmemload2
1585602101,3sleep00-21swapper/00
153032101,4sleep115334-21munin-run1
1498682101,4sleep190194-21diskmemload1
1442802100,7sleep0144841-21kthreadcore0
143172104,3sleep24153225-21cyclictest2
1303992101,6sleep0130486-21pmu-power0
1228072101,4sleep190194-21diskmemload1
1134802100,2sleep20-21swapper/22
1049552100,2sleep20-21swapper/22
1039982102,5sleep1104144-21sed1
74999291,4sleep275424-21cat2
63903291,4sleep064119-21diskstats0
53757291,4sleep255380-21cut2
53153291,3sleep153172-21apt-get1
4907291,3sleep14926-21apt-get1
423140291,4sleep1423151-21ssh1
4186780291,4sleep04186859-21/usr/sbin/munin0
4183181291,4sleep24184014-21kthreadcore2
4171972291,3sleep24172096-21perl2
4165608290,3sleep10-21swapper/11
397439291,2sleep00-21swapper/00
395949291,2sleep20-21swapper/22
381635291,4sleep0381768-21diskstats0
368045291,4sleep1368200-21ssh1
32118291,4sleep233414-21grep2
315984291,4sleep1315995-21ssh1
267431290,5sleep0268424-21ssh0
24978291,3sleep025027-21ntpq0
238388291,3sleep190194-21diskmemload1
229414291,3sleep190194-21diskmemload1
188241291,4sleep2188390-21grep2
113729291,2sleep10-21swapper/11
78817282,3sleep00-21swapper/00
51794280,1sleep10-21swapper/11
42499280,2sleep10-21swapper/11
4193829281,3sleep14193872-21fschecks_count1
4171693280,1sleep00-21swapper/00
353316280,1sleep20-21swapper/22
20425280,1sleep20-21swapper/22
15042281,2sleep072-21kcompactd00
89925270,1sleep10-21swapper/11
79224270,1sleep10-21swapper/11
53447271,3sleep053661-21smartctl0
47818270,1sleep00-21swapper/00
4623270,1sleep20-21swapper/22
4191290271,3sleep24192145-21missed_timers2
4186548271,2sleep10-21swapper/11
4181803270,1sleep10-21swapper/11
4171339270,1sleep10-21swapper/11
4171317270,1sleep20-21swapper/22
4165517270,1sleep00-21swapper/00
4164838271,2sleep20-21swapper/22
37177270,2sleep00-21swapper/00
26241270,2sleep20-21swapper/22
25758270,1sleep10-21swapper/11
80356261,2sleep10-21swapper/11
74135260,1sleep10-21swapper/11
68574260,1sleep20-21swapper/22
4189535261,2sleep10-21swapper/11
4181987260,4sleep00-21swapper/00
36620261,2sleep20-21swapper/22
31041260,4sleep00-21swapper/00
25355260,2sleep20-21swapper/22
19957261,2sleep119961-21mailstats1
9105250,1sleep00-21swapper/00
58958250,1sleep00-21swapper/00
31836240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional