You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 23:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Wed Aug 12, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2553378212569,52sleep30-21swapper/33
255331228153,12sleep20-21swapper/22
255357028062,12sleep10-21swapper/11
255333027853,7sleep00-21swapper/00
28718082260,2sleep30-21swapper/33
30114192221,9sleep23011461-21basename2
255375099221,17cyclictest2925868-21taskset3
27254322211,8sleep02725446-21ssh0
255375099211,16cyclictest0-21swapper/33
30246982201,8sleep12681815-21diskmemload1
27049472200,2sleep20-21swapper/22
255375099203,14cyclictest2897622-21taskset3
2553750992011,6cyclictest30345812sleep33
255375099201,15cyclictest0-21swapper/33
255375099201,15cyclictest0-21swapper/33
255375099201,15cyclictest0-21swapper/33
255375099198,7cyclictest2634505-21turbostat3
2553750991911,5cyclictest0-21swapper/33
255375099191,15cyclictest0-21swapper/33
255375099191,15cyclictest0-21swapper/33
255375099191,15cyclictest0-21swapper/33
255375099191,14cyclictest29315122sleep33
255375099191,14cyclictest2723135-21taskset3
255375099191,14cyclictest0-21swapper/33
255375099191,14cyclictest0-21swapper/33
255375099191,14cyclictest0-21swapper/33
255375099191,14cyclictest0-21swapper/33
255375099191,14cyclictest0-21swapper/33
29598902180,2sleep2563-21systemd-logind2
29098862181,4sleep12911176-21sh1
2553750991812,3cyclictest0-21swapper/33
255375099181,14cyclictest0-21swapper/33
255375099181,14cyclictest0-21swapper/33
255375099181,14cyclictest0-21swapper/33
255375099181,14cyclictest0-21swapper/33
255375099181,14cyclictest0-21swapper/33
255375099181,14cyclictest0-21swapper/33
255375099181,14cyclictest0-21swapper/33
255375099181,14cyclictest0-21swapper/33
255375099181,14cyclictest0-21swapper/33
255375099181,13cyclictest0-21swapper/33
255375099181,13cyclictest0-21swapper/33
255375099181,13cyclictest0-21swapper/33
255375099181,13cyclictest0-21swapper/33
255375099180,15cyclictest0-21swapper/33
255375099180,14cyclictest0-21swapper/33
255375099180,14cyclictest0-21swapper/33
28471372171,3sleep20-21swapper/22
2553750991711,4cyclictest0-21swapper/33
255375099171,14cyclictest0-21swapper/33
255375099171,13cyclictest2681840-21turbostat3
255375099171,13cyclictest0-21swapper/33
255375099171,13cyclictest0-21swapper/33
255375099171,13cyclictest0-21swapper/33
255375099171,13cyclictest0-21swapper/33
255375099170,14cyclictest0-21swapper/33
255375099170,14cyclictest0-21swapper/33
255375099170,14cyclictest0-21swapper/33
255375099170,14cyclictest0-21swapper/33
255375099170,14cyclictest0-21swapper/33
255375099170,14cyclictest0-21swapper/33
30368312161,3sleep12681815-21diskmemload1
30340212161,4sleep23034029-21ssh2
30200752161,11sleep13020140-21ssh1
29181562161,5sleep12917848-21/usr/sbin/munin1
29059692161,6sleep22905983-21ssh2
28815392160,2sleep20-21swapper/22
28314302161,3sleep20-21swapper/22
28289202161,4sleep02828934-21ssh0
27506402161,2sleep20-21swapper/22
27326052161,3sleep10-21swapper/11
27080792160,1sleep10-21swapper/11
255375099162,9cyclictest2582267-21taskset3
255375099161,3cyclictest0-21swapper/33
2553750991612,2cyclictest0-21swapper/33
255375099160,13cyclictest0-21swapper/33
255375099160,13cyclictest0-21swapper/33
29934182151,2sleep00-21swapper/00
28552502152,4sleep12681815-21diskmemload1
25915022157,4sleep12591617-21ntp_kernel_err1
25544942152,9sleep12555321-21kthreadcore1
255375099152,8cyclictest2554217-21taskset3
2553750991512,2cyclictest0-21swapper/33
2553750991512,1cyclictest0-21swapper/33
255375099150,13cyclictest0-21swapper/33
255375099150,12cyclictest0-21swapper/33
255375099150,12cyclictest0-21swapper/33
255375099150,11cyclictest25976222sleep33
30089932141,3sleep10-21swapper/11
29779792141,5sleep02978173-21kthreadcore0
29461402141,9sleep22943206-21sendmail-msp2
29251682140,2sleep2171rcu_preempt2
28982512141,6sleep22898264-21ssh2
28664462141,6sleep22866454-21ssh2
28277172141,6sleep20-21swapper/22
27413682142,7sleep22681815-21diskmemload2
26882992147,2sleep22681815-21diskmemload2
255375099149,4cyclictest0-21swapper/33
255375099141,2cyclictest0-21swapper/33
255375099141,12cyclictest0-21swapper/33
255375099141,10cyclictest0-21swapper/33
255375099140,12cyclictest0-21swapper/33
255375099140,11cyclictest0-21swapper/33
255375099140,11cyclictest0-21swapper/33
30277412131,2sleep0171rcu_preempt0
29757712131,7sleep12681815-21diskmemload1
29329552130,9sleep22681815-21diskmemload2
29006712132,5sleep02900699-21apt-get0
28830472131,8sleep02883057-21ssh0
28715362131,6sleep12681815-21diskmemload1
28551942130,2sleep02681815-21diskmemload0
27249612131,3sleep12724973-21ssh1
27248742131,2sleep20-21swapper/22
26102592131,8sleep10-21swapper/11
26021962131,7sleep22598059-21/usr/sbin/munin2
25664832131,7sleep22566221-21sendmail-msp2
30448182121,7sleep13044832-21ssh1
30006592121,4sleep20-21swapper/22
29935952121,7sleep22993608-21sh2
29837522121,4sleep20-21swapper/22
29663252121,7sleep02966339-21ssh0
29663252121,7sleep02966339-21ssh0
29413922120,3sleep12941406-21ssh1
29343082121,7sleep00-21swapper/00
29323112120,2sleep12932325-21ssh1
29174092121,7sleep02917421-21ssh0
28991512120,1sleep00-21swapper/00
28979472121,6sleep12681815-21diskmemload1
28825242121,2sleep10-21swapper/11
28539882121,5sleep20-21swapper/22
27944712121,7sleep12794486-21ssh1
27943102121,7sleep02794321-21ssh0
27867282120,3sleep02786742-21ssh0
27679122121,5sleep20-21swapper/22
27679122121,5sleep20-21swapper/22
27610172121,7sleep22761028-21sh2
27507322121,7sleep12750746-21ssh1
27501532121,2sleep00-21swapper/00
26960972121,3sleep12696111-21ssh1
26709622121,2sleep1106713-21snmpd1
26081852121,7sleep22608264-21munin-run2
25770352121,5sleep02577054-21apt-get0
30442382111,4sleep22681815-21diskmemload2
30009322111,3sleep00-21swapper/00
29936782113,3sleep12681815-21diskmemload1
29602512112,4sleep22960252-21apt-get2
29602512112,4sleep22960252-21apt-get2
29491002110,4sleep00-21swapper/00
28454162110,1sleep00-21swapper/00
28391592112,3sleep02681815-21diskmemload0
28141382112,4sleep22814162-21apt-get2
28141272111,6sleep12814137-21ssh1
27963332110,2sleep10-21swapper/11
27859122111,4sleep12681815-21diskmemload1
27766702111,5sleep12681815-21diskmemload1
27766702111,5sleep12681815-21diskmemload1
27600752114,3sleep10-21swapper/11
27095092111,6sleep02711021-21cut0
26964272111,4sleep22681815-21diskmemload2
26607962111,6sleep02660977-21wc0
26390242111,6sleep02639252-21unixbench_multi0
26294562110,7sleep22629233-21sendmail-msp2
25644042111,6sleep12565114-21cat1
30377002101,3sleep00-21swapper/00
30342002100,1sleep00-21swapper/00
30190522101,3sleep00-21swapper/00
30187782101,4sleep22681815-21diskmemload2
30086282100,1sleep00-21swapper/00
29838362101,2sleep10-21swapper/11
29602292101,5sleep12960250-21apt1
29602292101,5sleep12960250-21apt1
29597122101,2sleep10-21swapper/11
29591062104,1sleep00-21swapper/00
29498482100,1sleep10-21swapper/11
29353372100,4sleep00-21swapper/00
29228222101,5sleep02922836-21ssh0
29145722100,1sleep20-21swapper/22
29065522100,2sleep10-21swapper/11
28893952101,2sleep10-21swapper/11
28632892100,1sleep10-21swapper/11
28580592101,4sleep22681815-21diskmemload2
28577742101,2sleep00-21swapper/00
28466622101,2sleep10-21swapper/11
28190802101,4sleep00-21swapper/00
28133482101,3sleep00-21swapper/00
28132642101,4sleep12681815-21diskmemload1
28122062101,3sleep22681815-21diskmemload2
28036202101,2sleep00-21swapper/00
27882112101,5sleep22788355-21grep2
27771372100,2sleep2171rcu_preempt2
27771372100,2sleep2171rcu_preempt2
27617372101,4sleep12762004-21df1
27617372101,4sleep12762004-21df1
27406622101,2sleep10-21swapper/11
27314612101,4sleep02681815-21diskmemload0
27170122101,3sleep20-21swapper/22
27060422101,2sleep00-21swapper/00
26881282101,4sleep12681815-21diskmemload1
26821142101,2sleep00-21swapper/00
26762272101,3sleep072-21kcompactd00
26505172101,4sleep22650289-21sendmail-msp2
26294852100,6sleep02629668-21expr0
26283782101,4sleep12628466-21/usr/sbin/munin1
26090552101,5sleep02610255-21kthreadcore0
26032602101,3sleep12603262-21apt-get1
25771942101,4sleep22577324-21diskstats2
25718162101,4sleep22571818-21apt-get2
3026012290,2sleep20-21swapper/22
3000199291,3sleep12681815-21diskmemload1
2975941291,4sleep22975953-21ssh2
2973138291,4sleep02973330-21sed0
2941657291,4sleep22941671-21ssh2
2888551291,2sleep00-21swapper/00
2884003290,3sleep22681815-21diskmemload2
2831400291,4sleep12831429-21ssh1
2827174291,4sleep12827323-21timerandwakeup1
2784844291,2sleep20-21swapper/22
2777893291,2sleep00-21swapper/00
2777893291,2sleep00-21swapper/00
2767122291,4sleep02767136-21ssh0
2767122291,4sleep02767136-21ssh0
2752946290,1sleep00-21swapper/00
2740167291,2sleep00-21swapper/00
2715667291,2sleep10-21swapper/11
2698163291,2sleep00-21swapper/00
2681574290,1sleep20-21swapper/22
2672421291,4sleep12673839-21grep1
2650806290,1sleep10-21swapper/11
2645276291,3sleep22645279-21apt-get2
2640273291,4sleep12640376-21perl1
2634485291,5sleep12634554-21latency_hist1
2598067291,4sleep02598079-21apt-get0
2588105294,2sleep244-21ksoftirqd/22
2586463291,4sleep02582245-21/usr/sbin/munin0
2558690290,1sleep00-21swapper/00
2872179281,3sleep02872190-21ssh0
2801902281,3sleep22801913-21ssh2
2726454281,2sleep20-21swapper/22
2681801281,3sleep02682034-21latency_hist0
2665727281,3sleep1106713-21snmpd1
2661088281,3sleep02661279-21expr0
2657624281,3sleep12657929-21kthreadcore1
2634756280,2sleep10-21swapper/11
2625068282,3sleep02626309-21kthreadcore0
2619556281,3sleep02620763-21kthreadcore0
2613774280,2sleep10-21swapper/11
2603032280,1sleep00-21swapper/00
2592614280,1sleep20-21swapper/22
2577608281,3sleep12578922-21kthreadcore1
2568610281,3sleep12570218-21kthreadcore1
2561186281,2sleep22561205-21apt-get2
2558723280,1sleep20-21swapper/22
2673840271,2sleep20-21swapper/22
2671101270,1sleep20-21swapper/22
2654647270,4sleep00-21swapper/00
2649917271,2sleep10-21swapper/11
2639415270,1sleep20-21swapper/22
2624211270,1sleep20-21swapper/22
2623660270,1sleep20-21swapper/22
2618510270,1sleep20-21swapper/22
2618428270,1sleep00-21swapper/00
2602081271,3sleep12602194-21processes1
2597505270,1sleep00-21swapper/00
2592828270,2sleep12592847-21apt-get1
2582261270,2sleep20-21swapper/22
2576711270,1sleep00-21swapper/00
2576701270,1sleep10-21swapper/11
2566462271,2sleep00-21swapper/00
2670511261,2sleep00-21swapper/00
2665837260,1sleep20-21swapper/22
2660672261,2sleep22553745-21cyclictest2
2647177261,2sleep00-21swapper/00
2644626260,4sleep00-21swapper/00
2640377260,3sleep20-21swapper/22
2619068260,1sleep10-21swapper/11
2613189260,3sleep20-21swapper/22
2587527260,2sleep00-21swapper/00
2587007260,4sleep10-21swapper/11
2680992250,1sleep10-21swapper/11
2561259250,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional