You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-14 - 13:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat Mar 14, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4112858212856,67sleep30-21swapper/33
411312229355,10sleep20-21swapper/22
411277627959,13sleep10-21swapper/11
411278527858,14sleep00-21swapper/00
411325399251,19cyclictest66950irq/132-enp1s0-TxRx-33
411325399246,14cyclictest84013-21taskset3
4113253992416,5cyclictest420074-21taskset3
411325399241,15cyclictest0-21swapper/33
411325399231,18cyclictest269840-21taskset3
3785422231,16sleep0380212-21grep0
411325399221,17cyclictest359564-21chrt3
1745222221,8sleep2174787-21df2
4113253992112,5cyclictest66950irq/132-enp1s0-TxRx-33
411325399211,16cyclictest66950irq/132-enp1s0-TxRx-33
411325399211,14cyclictest0-21swapper/33
411325399210,18cyclictest0-21swapper/33
411325399210,18cyclictest0-21swapper/33
411325399210,16cyclictest3404482sleep33
4113253992015,3cyclictest0-21swapper/33
4113253992013,4cyclictest67335-21chrt3
411325399201,2cyclictest0-21swapper/33
411325399201,15cyclictest66950irq/132-enp1s0-TxRx-33
411325399201,15cyclictest0-21swapper/33
411325399201,15cyclictest0-21swapper/33
411325399191,6cyclictest321515-21taskset3
4113253991916,1cyclictest0-21swapper/33
4113253991915,2cyclictest0-21swapper/33
411325399191,4cyclictest2189-21taskset3
4113253991911,5cyclictest0-21swapper/33
411325399191,14cyclictest0-21swapper/33
411325399191,14cyclictest0-21swapper/33
411325399191,14cyclictest0-21swapper/33
411325399191,14cyclictest0-21swapper/33
411325399191,14cyclictest0-21swapper/33
411325399191,14cyclictest0-21swapper/33
411325399191,14cyclictest0-21swapper/33
411325399190,17cyclictest0-21swapper/33
2404962191,3sleep00-21swapper/00
846972181,3sleep00-21swapper/00
411325399187,8cyclictest4125872-21turbostat3
4113253991816,1cyclictest0-21swapper/33
411325399181,14cyclictest182789-21taskset3
411325399181,14cyclictest0-21swapper/33
411325399181,14cyclictest0-21swapper/33
411325399181,14cyclictest0-21swapper/33
411325399181,14cyclictest0-21swapper/33
411325399181,14cyclictest0-21swapper/33
411325399181,14cyclictest0-21swapper/33
411325399181,14cyclictest0-21swapper/33
411325399181,14cyclictest0-21swapper/33
411325399181,14cyclictest0-21swapper/33
411325399181,13cyclictest0-21swapper/33
411325399181,13cyclictest0-21swapper/33
3420222181,13sleep0342202-21cstates0
41523192171,11sleep14152368-21ntpq1
411325399176,8cyclictest40131-21turbostat3
411325399171,13cyclictest0-21swapper/33
3578322171,2sleep00-21swapper/00
2325192171,2sleep00-21swapper/00
2293412171,5sleep1231060-21kthreadcore1
2177232171,5sleep250768-21diskmemload2
2148042171,3sleep00-21swapper/00
1886452171,2sleep20-21swapper/22
411325399167,6cyclictest4169867-21turbostat3
411325399166,7cyclictest4125505-21taskset3
411325399163,8cyclictest3102-21taskset3
411325399161,13cyclictest0-21swapper/33
411325399161,13cyclictest0-21swapper/33
411325399161,13cyclictest0-21swapper/33
411325399161,12cyclictest0-21swapper/33
411325399161,12cyclictest0-21swapper/33
411325399160,13cyclictest0-21swapper/33
411325399160,13cyclictest0-21swapper/33
411325399160,13cyclictest0-21swapper/33
411325399160,13cyclictest0-21swapper/33
411325399160,12cyclictest0-21swapper/33
3550172160,1sleep20-21swapper/22
2706872162,9sleep150768-21diskmemload1
2580442163,9sleep2258111-21ld2
1727602161,2sleep20-21swapper/22
1524582161,5sleep2152537-21ssh2
952872154,7sleep095436-21expr0
770012151,8sleep277038-21munin-run2
411325399151,2cyclictest0-21swapper/33
4113253991510,3cyclictest0-21swapper/33
411325399150,12cyclictest0-21swapper/33
3221702151,11sleep2322181-21sh2
2955032151,2sleep00-21swapper/00
2505182151,9sleep150768-21diskmemload1
1728812151,2sleep00-21swapper/00
651102141,4sleep165123-21ssh1
564702141,2sleep10-21swapper/11
41368272144,5sleep14136852-21munin-run1
4126962142,7sleep1412722-21apt-get1
411325399148,3cyclictest41748622sleep33
4113253991411,2cyclictest0-21swapper/33
411325399140,12cyclictest0-21swapper/33
411325399140,12cyclictest0-21swapper/33
3936372141,9sleep2393648-21ssh2
3674382141,4sleep1367452-21ssh1
3118742141,8sleep150768-21diskmemload1
2773712140,8sleep10-21swapper/11
2151202141,9sleep150768-21diskmemload1
1796732141,9sleep1179683-21ssh1
1641232141,2sleep00-21swapper/00
462242131,8sleep246295-21irqstats2
411325399131,1cyclictest0-21swapper/33
4102722131,3sleep2410283-21ssh2
391182131,8sleep039171-21/usr/sbin/munin0
3871662131,8sleep1388798-21tr1
3636802131,6sleep2363734-21ntpq2
3300022131,2sleep10-21swapper/11
2860632131,2sleep20-21swapper/22
2238922131,3sleep1223895-21ssh1
1975442131,2sleep10-21swapper/11
15572131,6sleep01603-21ntpq0
907372121,7sleep286152-21/usr/sbin/munin2
907372121,7sleep286152-21/usr/sbin/munin2
57572121,7sleep07001-21memory0
573062121,7sleep057317-21ssh0
41901902121,7sleep24190243-21ntpq2
41866452121,6sleep14187868-21cut1
41812772121,7sleep04181373-21kthreadcore0
4172032121,5sleep20-21swapper/22
41487502121,7sleep04149274-21cat0
41410572121,6sleep04141146-21ntpq0
4002512121,7sleep150768-21diskmemload1
3912672121,3sleep0391280-21ssh0
3549572121,6sleep1355013-21ntpq1
2874692121,6sleep150768-21diskmemload1
2248392121,5sleep00-21swapper/00
2026172121,2sleep10-21swapper/11
1840602121,7sleep1185636-21cut1
1727472120,7sleep150768-21diskmemload1
1562732121,6sleep11-21systemd1
1098122121,7sleep1109825-21ssh1
991452111,5sleep299198-21ntpq2
861542112,5sleep086174-21apt-get0
861542112,5sleep086174-21apt-get0
728532111,4sleep072909-21ntpq0
601482111,5sleep260364-21hddtemp_smartct2
458062111,5sleep046013-21diskstats0
41632172111,5sleep14163263-21ntpq1
41484882111,6sleep24148542-21fschecks_count2
41175602111,5sleep14117608-21ntpq1
3725292111,5sleep2372586-21ntpq2
353382111,5sleep235547-21hddtemp_smartct2
3423132111,5sleep2342537-21hddtemp_smartct2
3395532110,7sleep0339565-21ssh0
3284402111,5sleep2328496-21ntpq2
3154882111,5sleep0315510-21apt-get0
2979842111,5sleep2298250-21df2
2627492111,3sleep00-21swapper/00
2607542111,6sleep0260768-21ssh0
2590382112,4sleep150768-21diskmemload1
2517182111,6sleep0251733-21ssh0
2247682111,2sleep20-21swapper/22
2085902110,3sleep00-21swapper/00
19552111,4sleep22171-21users2
1832582111,5sleep0183283-21apt-get0
1633082111,4sleep150768-21diskmemload1
1460482111,4sleep150768-21diskmemload1
1390972111,6sleep2139122-21apt-get2
1346612111,4sleep20-21swapper/22
1302142111,5sleep1130363-21diskstats1
1288712111,3sleep2128883-21ssh2
1255572111,7sleep1125618-21/usr/sbin/munin1
1254902110,3sleep0125547-21ntpq0
1176632111,5sleep150768-21diskmemload1
1125922111,5sleep2112819-21df_inode2
1029752111,4sleep150768-21diskmemload1
919212101,3sleep150768-21diskmemload1
919212101,3sleep150768-21diskmemload1
857062100,2sleep10-21swapper/11
816182101,4sleep281676-21ssh2
768902101,4sleep150768-21diskmemload1
639992101,4sleep064056-21ntpq0
569832101,2sleep20-21swapper/22
4188092101,3sleep00-21swapper/00
41630752101,4sleep04163216-21ntpq0
41578602100,5sleep14157908-21ntpq1
41541152101,5sleep04154325-21hddtemp_smartct0
41478792101,4sleep04147800-31find0
41478752101,4sleep14147800-31find1
4035202101,4sleep2555-21dbus-daemon2
3834632101,4sleep150768-21diskmemload1
3724762101,4sleep1372527-21ntpq1
3595022101,2sleep00-21swapper/00
3441602101,5sleep150768-21diskmemload1
3382512100,6sleep2338264-21rm2
3246152101,4sleep0324824-21ssh0
3210902101,3sleep150768-21diskmemload1
3057012101,4sleep150768-21diskmemload1
3032552100,1sleep00-21swapper/00
2973462101,4sleep150768-21diskmemload1
2949682101,2sleep20-21swapper/22
294602101,5sleep229634-21grep2
2804362101,4sleep0280463-21apt-get0
2789012102,2sleep00-21swapper/00
2523102101,4sleep250768-21diskmemload2
2413842101,5sleep1241396-21diskmemload1
2351512101,2sleep20-21swapper/22
2085102101,3sleep20-21swapper/22
1984572101,4sleep050768-21diskmemload0
1797122101,2sleep00-21swapper/00
1607962101,3sleep20-21swapper/22
1184582101,5sleep0118472-21ssh0
1100702101,3sleep20-21swapper/22
1087912101,3sleep00-21swapper/00
4181379291,4sleep14183005-21cut1
4169839290,1sleep10-21swapper/11
4142660291,4sleep24142165-21apt-get2
4138395291,4sleep14140144-21tr1
4132295291,4sleep24132939-21tr2
4127583291,4sleep04129336-21cut0
4121565291,5sleep14123232-21kthreadcore1
411991291,4sleep1412002-21ssh1
4116521290,5sleep24117388-21missed_timers2
409477290,3sleep050768-21diskmemload0
40903291,4sleep241001-21grep2
401723290,1sleep00-21swapper/00
381372290,3sleep20-21swapper/22
376024291,2sleep00-21swapper/00
333534291,5sleep10-21swapper/11
310919291,4sleep2310979-21ntpq2
306649291,4sleep0306662-21ssh0
28418291,4sleep128469-21ntpq1
275877291,2sleep20-21swapper/22
268621291,3sleep250768-21diskmemload2
240293291,2sleep20-21swapper/22
23796290,3sleep072-21kcompactd00
199030290,2sleep20-21swapper/22
16292291,4sleep217634-21memory2
16292291,4sleep217634-21memory2
147864291,4sleep0147892-21apt-get0
130083291,4sleep0130209-21cpuspeed_turbos0
4186573281,3sleep04186644-21irqstats0
4180308280,1sleep00-21swapper/00
4170423281,3sleep04170633-21hddtemp_smartct0
4170156281,4sleep24170219-21ls2
4168694281,2sleep04168835-21ntpq0
4164621280,3sleep24164243-21apt-get2
4118769281,3sleep24119481-21kthreadcore2
4118522281,3sleep04118569-21systemd-run0
39990280,1sleep10-21swapper/11
34584281,3sleep234586-21modprobe2
33779281,3sleep033832-21ld0
144346280,4sleep0144359-21sh0
8425270,2sleep10-21swapper/11
8029270,1sleep10-21swapper/11
4179622272,2sleep14179719-21processes1
4170134270,3sleep14170153-21apt-get1
4160742271,3sleep20-21swapper/22
4142117270,1sleep20-21swapper/22
4131723270,2sleep00-21swapper/00
4126133270,1sleep20-21swapper/22
4121306270,4sleep04121564-21cat0
3080270,2sleep20-21swapper/22
24006270,1sleep10-21swapper/11
14263270,3sleep0221rcuc/00
14263270,3sleep0221rcuc/00
13323270,1sleep20-21swapper/22
50402260,1sleep10-21swapper/11
45447260,1sleep10-21swapper/11
4185598261,2sleep20-21swapper/22
4158578260,4sleep20-21swapper/22
4130553261,2sleep14130790-21unixbench_singl1
31204260,2sleep10-21swapper/11
24686261,2sleep024900-21smartctl0
19464261,2sleep20-21swapper/22
1851260,3sleep11954-21/usr/sbin/munin1
17822260,2sleep10-21swapper/11
17822260,2sleep10-21swapper/11
12281261,2sleep00-21swapper/00
42521250,2sleep00-21swapper/00
4175918250,2sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional