You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 11:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Fri Apr 10, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2369204212062,54sleep30-21swapper/33
236902528165,10sleep10-21swapper/11
236928927854,16sleep20-21swapper/22
236898627754,17sleep00-21swapper/00
236942699250,22cyclictest0-21swapper/33
25922382222,14sleep12500794-21diskmemload1
236942699220,13cyclictest0-21swapper/33
27083972210,1sleep00-21swapper/00
2369426992117,2cyclictest0-21swapper/33
236942699211,3cyclictest0-21swapper/33
27686462201,3sleep20-21swapper/22
236942699201,16cyclictest0-21swapper/33
236942699201,15cyclictest0-21swapper/33
2369426992010,6cyclictest2786390-21taskset3
236942699200,2cyclictest0-21swapper/33
26399792191,14sleep22640016-21perf2
236942699191,7cyclictest2629955-21chrt3
2369426991915,2cyclictest0-21swapper/33
236942699191,15cyclictest0-21swapper/33
236942699191,14cyclictest0-21swapper/33
236942699191,14cyclictest0-21swapper/33
236942699191,14cyclictest0-21swapper/33
236942699191,14cyclictest0-21swapper/33
236942699191,14cyclictest0-21swapper/33
236942699191,14cyclictest0-21swapper/33
236942699191,14cyclictest0-21swapper/33
236942699190,16cyclictest0-21swapper/33
236942699190,16cyclictest0-21swapper/33
27956482189,6sleep12500794-21diskmemload1
27583742181,3sleep00-21swapper/00
2369426991812,3cyclictest0-21swapper/33
236942699181,14cyclictest0-21swapper/33
236942699181,14cyclictest0-21swapper/33
236942699181,14cyclictest0-21swapper/33
236942699181,14cyclictest0-21swapper/33
236942699181,14cyclictest0-21swapper/33
236942699181,14cyclictest0-21swapper/33
236942699181,14cyclictest0-21swapper/33
236942699181,14cyclictest0-21swapper/33
236942699181,14cyclictest0-21swapper/33
236942699181,13cyclictest0-21swapper/33
236942699181,13cyclictest0-21swapper/33
236942699181,13cyclictest0-21swapper/33
236942699181,13cyclictest0-21swapper/33
236942699180,15cyclictest0-21swapper/33
236942699180,14cyclictest2392661-21chrt3
236942699180,14cyclictest0-21swapper/33
236942699180,14cyclictest0-21swapper/33
27697092171,3sleep00-21swapper/00
25417702171,3sleep20-21swapper/22
236942699176,8cyclictest2398132-21turbostat3
236942699176,8cyclictest2398132-21turbostat3
236942699171,6cyclictest2767024-21taskset3
2369426991711,3cyclictest0-21swapper/33
2369426991711,3cyclictest0-21swapper/33
236942699171,13cyclictest0-21swapper/33
236942699171,13cyclictest0-21swapper/33
236942699171,13cyclictest0-21swapper/33
236942699171,13cyclictest0-21swapper/33
236942699171,13cyclictest0-21swapper/33
236942699171,12cyclictest0-21swapper/33
236942699171,12cyclictest0-21swapper/33
236942699170,14cyclictest0-21swapper/33
236942699170,14cyclictest0-21swapper/33
236942699170,14cyclictest0-21swapper/33
236942699170,13cyclictest0-21swapper/33
28036332161,5sleep02803643-21ssh0
25769942160,1sleep10-21swapper/11
25400252161,11sleep02540170-21ssh0
25092152161,4sleep12500794-21diskmemload1
236942699168,4cyclictest0-21swapper/33
236942699161,3cyclictest0-21swapper/33
2369426991611,3cyclictest0-21swapper/33
236942699161,13cyclictest0-21swapper/33
236942699161,13cyclictest0-21swapper/33
236942699161,12cyclictest0-21swapper/33
236942699161,11cyclictest0-21swapper/33
236942699160,13cyclictest0-21swapper/33
236942699160,13cyclictest0-21swapper/33
236942699160,13cyclictest0-21swapper/33
28542462151,3sleep10-21swapper/11
28365142151,10sleep12836528-21ssh1
28365142151,10sleep12836528-21ssh1
28297282151,2sleep20-21swapper/22
25071252150,3sleep00-21swapper/00
25007522150,2sleep30-21swapper/33
236942699151,9cyclictest23930572sleep33
236942699150,13cyclictest0-21swapper/33
236942699150,13cyclictest0-21swapper/33
28483512142,7sleep02848408-21sh0
27955162149,2sleep20-21swapper/22
27767242141,2sleep22500794-21diskmemload2
27154882141,3sleep22500794-21diskmemload2
26917852141,4sleep22500794-21diskmemload2
26648212141,2sleep20-21swapper/22
26280862142,7sleep10-21swapper/11
26213252140,2sleep00-21swapper/00
26017192141,8sleep12500794-21diskmemload1
25401722141,7sleep12540233-21ntpq1
236942699143,8cyclictest0-21swapper/33
28272552130,9sleep12827278-21switchtime1
28103382130,3sleep20-21swapper/22
27864602131,6sleep00-21swapper/00
27583462131,8sleep22758360-21ssh2
27330392130,2sleep00-21swapper/00
27275972131,8sleep22727714-21irqstats2
26927312131,8sleep12692953-21/usr/sbin/munin1
26894362131,6sleep10-21swapper/11
26827692131,8sleep22500794-21diskmemload2
26715892131,8sleep12671604-21ssh1
26480982131,8sleep02648111-21ssh0
26010632131,2sleep20-21swapper/22
25835982131,7sleep02500794-21diskmemload0
25554792131,2sleep20-21swapper/22
25118692131,7sleep12513583-21cut1
25007862131,8sleep0578-21rs:main0
24469812131,7sleep12447007-21munin-run1
28567022121,8sleep02856718-21ssh0
28560902121,7sleep22500794-21diskmemload2
27854412121,4sleep20-21swapper/22
27400322121,6sleep02740088-21ntp_states0
27363232121,3sleep22736721-21cut2
27304312121,3sleep12731111-21ssh1
27235762121,7sleep12723587-21ssh1
26914722121,7sleep02691485-21rm0
26638592121,5sleep10-21swapper/11
26077952122,6sleep02605392-21/usr/sbin/munin0
26029962121,7sleep02603010-21ssh0
25962652121,5sleep20-21swapper/22
25683062121,7sleep02568318-21rm0
25506192121,6sleep02500794-21diskmemload0
25332022120,3sleep02533216-21ssh0
25155242121,6sleep22500794-21diskmemload2
24349462121,6sleep12435003-21ntpq1
23736932121,7sleep22373744-21ld2
23696042121,8sleep1764-21sshd1
28192962111,4sleep20-21swapper/22
28038532111,3sleep20-21swapper/22
27921752111,4sleep00-21swapper/00
27501102111,5sleep12750121-21ssh1
27440452111,5sleep12744081-21munin-run1
27146752111,6sleep02714677-21ssh0
27067292111,4sleep22500794-21diskmemload2
26994872111,3sleep20-21swapper/22
26833542111,5sleep12683368-21ssh1
26735852111,3sleep20-21swapper/22
26565782111,5sleep00-21swapper/00
26466262111,4sleep12500794-21diskmemload1
26301242111,6sleep02630136-21ssh0
26229372111,5sleep22623081-21diskstats2
26219702111,4sleep22500794-21diskmemload2
26181062111,5sleep12618258-21ntpq1
25880272111,3sleep00-21swapper/00
25750292111,2sleep00-21swapper/00
25591672111,5sleep00-21swapper/00
25584342111,6sleep12558445-21ssh1
25341672110,2sleep10-21swapper/11
25268782112,4sleep02500794-21diskmemload0
25182932110,1sleep00-21swapper/00
25023182111,3sleep22503952-21kthreadcore2
24954802111,5sleep12495501-21munin-run1
24787682117,2sleep22457306-21kworker/2:2+events_freezable2
24137012111,6sleep22413750-21ntpq2
23874882111,4sleep02387536-21munin-run0
23811052111,4sleep22381153-21ntpq2
23748632111,6sleep02375614-21grep0
28630772101,2sleep20-21swapper/22
28573512101,2sleep00-21swapper/00
28474232101,4sleep12500794-21diskmemload1
28445912101,2sleep22844632-21ssh2
28312982101,2sleep20-21swapper/22
28312982101,2sleep20-21swapper/22
28201582101,3sleep00-21swapper/00
28195842101,3sleep10-21swapper/11
28059072101,4sleep02805986-21irqstats0
28007612101,5sleep12800916-21ntpq1
27852862101,3sleep12500794-21diskmemload1
27786022101,3sleep12500794-21diskmemload1
27707782101,6sleep02770980-21gltestperf0
27680362100,3sleep10-21swapper/11
27596312100,3sleep10-21swapper/11
27527222101,5sleep02752763-21perf0
27246342101,4sleep22500794-21diskmemload2
27245662101,2sleep00-21swapper/00
27096462100,2sleep10-21swapper/11
27060142100,1sleep10-21swapper/11
26925932101,4sleep02692728-21diskstats0
26812052101,4sleep02500794-21diskmemload0
26715772101,3sleep00-21swapper/00
26648492100,1sleep00-21swapper/00
26568932101,3sleep12500794-21diskmemload1
26566052101,4sleep22500794-21diskmemload2
26478272101,3sleep20-21swapper/22
26369492100,1sleep00-21swapper/00
26106352101,4sleep12500794-21diskmemload1
25797222101,4sleep22579943-21hddtemp_smartct2
25762572101,4sleep22500794-21diskmemload2
25684762101,2sleep20-21swapper/22
25661922101,4sleep12566248-21ntpq1
25495752104,2sleep20-21swapper/22
25495022101,3sleep10-21swapper/11
25333232101,4sleep22500794-21diskmemload2
25244582101,6sleep12500794-21diskmemload1
25183212101,2sleep20-21swapper/22
24462392102,5sleep02446329-21timerandwakeup0
24406092101,4sleep12440652-21ntpq1
24261022101,4sleep02426173-21irqstats0
24189812101,4sleep22419030-21ntpq2
24181332101,4sleep02418880-21sed0
24069202101,5sleep22408197-21memory2
23938792101,6sleep02395546-21cut0
23934382101,5sleep22393577-21sort2
2858282292,3sleep10-21swapper/11
2835617292,3sleep02835666-21ntpq0
2835617292,3sleep02835666-21ntpq0
2827874290,1sleep00-21swapper/00
2812565291,4sleep12812578-21ssh1
2744739291,4sleep22744875-21ssh2
2638113291,3sleep12500794-21diskmemload1
2611146291,3sleep22500794-21diskmemload2
2581392291,4sleep12583095-21cut1
2483916294,2sleep22484157-21head2
2479216291,3sleep12478983-21apt-get1
2473897290,2sleep10-21swapper/11
2465859290,1sleep00-21swapper/00
2452572291,3sleep12452591-21apt-get1
2431225290,1sleep00-21swapper/00
2430945291,4sleep22431193-21cat2
2420252291,3sleep22420271-21apt-get2
2399224291,4sleep22400068-21cut2
2399224291,4sleep22400068-21cut2
2386540290,4sleep22386596-21ntpq2
2490731281,3sleep02490943-21smartctl0
2489541280,2sleep00-21swapper/00
2484829280,2sleep20-21swapper/22
2468578280,2sleep00-21swapper/00
2468578280,2sleep00-21swapper/00
2462791280,1sleep00-21swapper/00
2447263281,2sleep02447282-21apt-get0
2441353280,1sleep00-21swapper/00
2430081280,1sleep10-21swapper/11
2429975280,1sleep20-21swapper/22
2404856281,3sleep02405214-21kthreadcore0
2398629280,3sleep02398131-21apt-get0
2398629280,3sleep02398131-21apt-get0
2377001281,2sleep10-21swapper/11
2373799281,4sleep02373879-21awk0
2500619270,1sleep10-21swapper/11
2495230270,1sleep20-21swapper/22
2488998270,4sleep10-21swapper/11
2478976271,3sleep02479213-21apt-key0
2468067270,1sleep10-21swapper/11
2462913270,1sleep20-21swapper/22
2462614270,1sleep10-21swapper/11
2457380270,1sleep00-21swapper/00
2425224270,1sleep00-21swapper/00
2419975270,1sleep10-21swapper/11
2413567270,2sleep00-21swapper/00
2409628271,3sleep12409644-21cpu1
2403509270,1sleep10-21swapper/11
2403509270,1sleep10-21swapper/11
2397825270,1sleep10-21swapper/11
2388574271,3sleep02390260-21kthreadcore0
2383007271,2sleep10-21swapper/11
2484251260,4sleep00-21swapper/00
2453719261,2sleep20-21swapper/22
2447839261,2sleep10-21swapper/11
2441873260,1sleep20-21swapper/22
2437992261,2sleep20-21swapper/22
2405217261,2sleep10-21swapper/11
2392728260,1sleep20-21swapper/22
2392503260,1sleep10-21swapper/11
2500531250,3sleep20-21swapper/22
2472668250,1sleep10-21swapper/11
2472668250,1sleep10-21swapper/11
2463226250,1sleep20-21swapper/22
2424789250,2sleep12424953-21vmstat1
2468296240,1sleep20-21swapper/22
2468296240,1sleep20-21swapper/22
2447041240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional