You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 10:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Sun May 03, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2432055212153,64sleep30-21swapper/33
243688728973,10sleep20-21swapper/22
243547128852,10sleep10-21swapper/11
243208427752,14sleep00-21swapper/00
29135062241,11sleep02913727-21hddtemp_smartct0
2437164992421,1cyclictest0-21swapper/33
243716499241,16cyclictest2660514-21chrt3
2437164992321,1cyclictest0-21swapper/33
2437164992321,1cyclictest0-21swapper/33
2437164992319,2cyclictest0-21swapper/33
2437164992220,1cyclictest0-21swapper/33
2437164992220,1cyclictest0-21swapper/33
2437164992220,1cyclictest0-21swapper/33
2437164992218,2cyclictest0-21swapper/33
2437164992217,3cyclictest0-21swapper/33
243716499221,18cyclictest0-21swapper/33
243716499221,17cyclictest2818919-21taskset3
243716499221,14cyclictest0-21swapper/33
25924762211,2sleep00-21swapper/00
2437164992118,1cyclictest0-21swapper/33
2437164992118,1cyclictest0-21swapper/33
2437164992118,1cyclictest0-21swapper/33
2437164992118,1cyclictest0-21swapper/33
2437164992118,1cyclictest0-21swapper/33
2437164992117,2cyclictest0-21swapper/33
2437164992117,2cyclictest0-21swapper/33
2437164992117,1cyclictest0-21swapper/33
243716499211,16cyclictest0-21swapper/33
243716499210,17cyclictest0-21swapper/33
243716499205,12cyclictest0-21swapper/33
243716499205,12cyclictest0-21swapper/33
243716499202,15cyclictest0-21swapper/33
2437164992018,1cyclictest0-21swapper/33
2437164992018,1cyclictest0-21swapper/33
2437164992018,1cyclictest0-21swapper/33
2437164992017,1cyclictest0-21swapper/33
2437164992016,2cyclictest0-21swapper/33
243716499201,14cyclictest0-21swapper/33
27348202192,8sleep02567751-21diskmemload0
2437164991917,1cyclictest0-21swapper/33
2437164991917,1cyclictest0-21swapper/33
2437164991917,1cyclictest0-21swapper/33
2437164991917,1cyclictest0-21swapper/33
2437164991916,2cyclictest0-21swapper/33
2437164991916,1cyclictest0-21swapper/33
2437164991916,1cyclictest0-21swapper/33
2437164991915,2cyclictest0-21swapper/33
2437164991915,2cyclictest0-21swapper/33
2437164991914,2cyclictest0-21swapper/33
243716499191,15cyclictest2868888-21taskset3
28678592181,7sleep12567751-21diskmemload1
26682612180,2sleep20-21swapper/22
243716499186,1cyclictest0-21swapper/33
243716499185,1cyclictest0-21swapper/33
2437164991816,1cyclictest0-21swapper/33
2437164991815,1cyclictest0-21swapper/33
2437164991815,1cyclictest0-21swapper/33
2437164991815,1cyclictest0-21swapper/33
243716499181,14cyclictest0-21swapper/33
243716499180,16cyclictest0-21swapper/33
29172642171,10sleep12917353-21ntpq1
27590672171,2sleep10-21swapper/11
26990642171,12sleep22699108-21ssh2
26932592171,3sleep00-21swapper/00
2437164991715,1cyclictest0-21swapper/33
2437164991715,1cyclictest0-21swapper/33
2437164991714,1cyclictest0-21swapper/33
2437164991714,1cyclictest0-21swapper/33
2437164991713,2cyclictest0-21swapper/33
2437164991713,2cyclictest0-21swapper/33
27773682161,10sleep12567751-21diskmemload1
27428132161,2sleep20-21swapper/22
2437164991614,1cyclictest0-21swapper/33
2437164991614,1cyclictest0-21swapper/33
2437164991613,1cyclictest0-21swapper/33
2437164991613,1cyclictest0-21swapper/33
2437164991612,2cyclictest0-21swapper/33
243716499161,13cyclictest0-21swapper/33
243716499160,13cyclictest0-21swapper/33
243716499160,13cyclictest0-21swapper/33
28351182151,2sleep00-21swapper/00
28281202150,3sleep22567751-21diskmemload2
27109792151,6sleep22710989-21ssh2
25900082151,4sleep12567751-21diskmemload1
2437164991513,1cyclictest0-21swapper/33
2437164991511,2cyclictest0-21swapper/33
29180782141,7sleep20-21swapper/22
28446832144,2sleep2171rcu_preempt2
27621912141,7sleep02762270-21irqstats0
26579562141,4sleep02657970-21ssh0
26411552141,9sleep12641169-21ssh1
26322352141,4sleep12632245-21ssh1
25840682140,2sleep00-21swapper/00
25836292141,3sleep12567751-21diskmemload1
24612942141,9sleep22461389-21/usr/sbin/munin2
24373382142,7sleep12437357-21apt-get1
28759182131,7sleep02567751-21diskmemload0
27911832131,7sleep22791242-21ntpq2
27607822131,6sleep22567751-21diskmemload2
27334142131,2sleep10-21swapper/11
27186932131,3sleep12718704-21ssh1
26860272131,5sleep272-21kcompactd02
26592172131,8sleep12659230-21sh1
26508182131,7sleep00-21swapper/00
26003822131,8sleep22600393-21ssh2
25681352131,8sleep22568208-21/usr/sbin/munin2
25077562131,8sleep22507808-21ldconfig2
28951532120,2sleep00-21swapper/00
28506592121,3sleep22850669-21ssh2
28189972120,1sleep10-21swapper/11
28172882121,8sleep02817300-21ssh0
27826362121,7sleep22782694-21ssh2
27276812121,7sleep22727692-21ssh2
27174552121,5sleep20-21swapper/22
27084122121,3sleep00-21swapper/00
26831622121,7sleep02683173-21ssh0
26231072121,5sleep00-21swapper/00
26161492121,3sleep22616161-21ssh2
26069392121,6sleep02567751-21diskmemload0
26007052121,6sleep12567751-21diskmemload1
25887732121,5sleep22588865-21ntpq2
25505512121,5sleep12550692-21ntpq1
25039872121,7sleep02503687-21/usr/sbin/munin0
28962722111,3sleep20-21swapper/22
28781892110,2sleep22878200-21diskmemload2
28605682110,7sleep02860579-21ssh0
28541502111,5sleep22854416-21df2
28246802111,5sleep02824739-21ntpq0
28198572111,4sleep22567751-21diskmemload2
28095572111,3sleep00-21swapper/00
28061132111,5sleep12567751-21diskmemload1
27937022110,3sleep0221rcuc/00
27754922111,7sleep22567751-21diskmemload2
27510422110,2sleep20-21swapper/22
27344172111,4sleep20-21swapper/22
26924722111,5sleep12567751-21diskmemload1
26852742111,4sleep12567751-21diskmemload1
26843052111,3sleep20-21swapper/22
26731332111,6sleep12673187-21sh1
26436402111,3sleep20-21swapper/22
26338182111,4sleep02567751-21diskmemload0
26268672112,4sleep22626891-21apt-get2
26186052111,6sleep22618630-21sh2
26164152110,7sleep02616423-21ssh0
26057262111,4sleep22605786-21ntpq2
25934262110,7sleep02567751-21diskmemload0
25805312111,5sleep22580588-21ntpq2
25721862111,6sleep12567751-21diskmemload1
25612582111,6sleep02561396-21netstat0
29103382100,1sleep00-21swapper/00
29081202101,4sleep12908766-21memory1
29013922101,4sleep02567751-21diskmemload0
28941192101,5sleep12894131-21ssh1
28925262101,3sleep20-21swapper/22
28853032101,4sleep12567751-21diskmemload1
28768992101,5sleep12876910-21ssh1
28684572101,4sleep02567751-21diskmemload0
28674502101,3sleep20-21swapper/22
28591712100,1sleep10-21swapper/11
28513462101,3sleep00-21swapper/00
28459062101,4sleep12846013-21perl1
28373062101,3sleep00-21swapper/00
28338642101,3sleep20-21swapper/22
28263342100,4sleep1331ktimers/11
28093952101,3sleep22567751-21diskmemload2
28029582101,3sleep20-21swapper/22
27975422101,5sleep12799255-21cat1
27940372102,3sleep12567751-21diskmemload1
27824852101,5sleep12782635-21/usr/sbin/munin1
27787682100,1sleep00-21swapper/00
27774972101,2sleep00-21swapper/00
27676242101,3sleep10-21swapper/11
27617512101,4sleep22761968-21diskstats2
27517452100,2sleep1171rcu_preempt1
27373052101,5sleep02738749-21kthreadcore0
27263812101,4sleep12567751-21diskmemload1
27108292101,4sleep12567751-21diskmemload1
27016682101,4sleep12567751-21diskmemload1
27015112101,2sleep00-21swapper/00
26767412100,1sleep00-21swapper/00
26740292101,5sleep20-21swapper/22
26657172101,4sleep12567751-21diskmemload1
26626722101,4sleep02567751-21diskmemload0
26568302101,3sleep20-21swapper/22
26515842101,4sleep12567751-21diskmemload1
26415462101,4sleep22567751-21diskmemload2
26351902101,4sleep02567751-21diskmemload0
26253182101,4sleep12567751-21diskmemload1
26155722101,4sleep12567751-21diskmemload1
25732802101,3sleep00-21swapper/00
25520552101,4sleep22552258-21diskstats2
25506932101,4sleep22550739-21ntpq2
25309152101,5sleep02531127-21hddtemp_smartct0
25309152101,5sleep02531127-21hddtemp_smartct0
25095582101,5sleep02510514-21kthreadcore0
24755172101,5sleep02475558-21ntpq0
24432942101,4sleep02444385-21diskstats0
24414292101,4sleep22441479-21ntpq2
2901403290,1sleep10-21swapper/11
2879593291,4sleep02879649-21grep0
2879296291,3sleep20-21swapper/22
2838262291,4sleep12839884-21grep1
2833109290,4sleep12833174-21ntpq1
2800516290,1sleep00-21swapper/00
2760572291,2sleep00-21swapper/00
2751781291,2sleep00-21swapper/00
2742143291,3sleep10-21swapper/11
2724853291,3sleep02567751-21diskmemload0
2711437291,5sleep02711602-21cstates0
2608576291,2sleep10-21swapper/11
2564388291,4sleep12566192-21grep1
2551600290,1sleep00-21swapper/00
2531128291,4sleep12531220-21cut1
2531128291,4sleep12531220-21cut1
2528841291,4sleep12529264-21/usr/sbin/munin1
2527032292,3sleep02527378-21kthreadcore0
2504203291,5sleep12504496-21kthreadcore1
2473006291,4sleep12474791-21cut1
2459355291,5sleep12459480-21netstat1
2454095291,4sleep02454150-21ntpq0
2909832281,3sleep22909843-21ssh2
2552542281,3sleep12553811-21kthreadcore1
2552470281,3sleep02552541-21irqstats0
2534717281,3sleep22534763-21ntpq2
2534717281,3sleep22534763-21ntpq2
2525279281,3sleep22525296-21apt2
2520446280,1sleep00-21swapper/00
2519188280,1sleep00-21swapper/00
2518288284,1sleep20-21swapper/22
2496616280,4sleep2421rcuc/22
2493009281,3sleep02492489-21apt-get0
2488218281,3sleep22489890-21kthreadcore2
2487435280,2sleep10-21swapper/11
2481516280,2sleep10-21swapper/11
2466112280,2sleep10-21swapper/11
2465159282,3sleep02465294-21timerwakeupswit0
2459489281,3sleep20-21swapper/22
2454446281,3sleep22450036-21/usr/sbin/munin2
2451525283,2sleep12453307-21kthreadcore1
2444682280,2sleep10-21swapper/11
2558051271,2sleep20-21swapper/22
2557339270,2sleep10-21swapper/11
2546261270,1sleep20-21swapper/22
2541310270,2sleep00-21swapper/00
2537963271,3sleep0221rcuc/00
2536282271,2sleep12536495-21smartctl1
2519906270,3sleep12519415-21apt-get1
2503106270,1sleep00-21swapper/00
2497839270,1sleep10-21swapper/11
2487034270,1sleep10-21swapper/11
2486166271,2sleep20-21swapper/22
2481987270,4sleep00-21swapper/00
2476780270,2sleep00-21swapper/00
2476772270,1sleep20-21swapper/22
2465602270,1sleep10-21swapper/11
2444704271,2sleep20-21swapper/22
2437639271,2sleep00-21swapper/00
2567549260,1sleep00-21swapper/00
2567478260,4sleep20-21swapper/22
2542131261,2sleep10-21swapper/11
2535986260,1sleep20-21swapper/22
2519262260,4sleep10-21swapper/11
2513824260,1sleep20-21swapper/22
2510517261,2sleep10-21swapper/11
2492239260,4sleep00-21swapper/00
2476419260,1sleep20-21swapper/22
2471020260,1sleep00-21swapper/00
2466108260,1sleep20-21swapper/22
2460220260,4sleep00-21swapper/00
2524971250,1sleep20-21swapper/22
2503417250,1sleep20-21swapper/22
2502734250,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional