You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 18:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Thu May 07, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2544441212052,63sleep30-21swapper/33
254416128556,12sleep10-21swapper/11
254427628050,12sleep20-21swapper/22
254414728054,14sleep00-21swapper/00
2544575992522,1cyclictest0-21swapper/33
2544575992521,2cyclictest0-21swapper/33
2544575992320,2cyclictest0-21swapper/33
2544575992311,6cyclictest28765452sleep33
26993192221,16sleep22675585-21diskmemload2
26993192221,16sleep22675585-21diskmemload2
254457599227,13cyclictest0-21swapper/33
2544575992219,2cyclictest0-21swapper/33
254457599221,17cyclictest3006847-21taskset3
29053602210,12sleep02675585-21diskmemload0
2544575992119,1cyclictest0-21swapper/33
2544575992119,1cyclictest0-21swapper/33
2544575992118,1cyclictest0-21swapper/33
2544575992118,1cyclictest0-21swapper/33
2544575992118,1cyclictest0-21swapper/33
2544575992118,1cyclictest0-21swapper/33
2544575992117,2cyclictest0-21swapper/33
2544575992117,2cyclictest0-21swapper/33
254457599211,15cyclictest3020678-21taskset3
2544575992018,1cyclictest0-21swapper/33
2544575992018,1cyclictest0-21swapper/33
2544575992018,1cyclictest0-21swapper/33
2544575992017,2cyclictest0-21swapper/33
2544575992017,2cyclictest0-21swapper/33
2544575992016,2cyclictest0-21swapper/33
2544575992016,2cyclictest0-21swapper/33
2544575992016,2cyclictest0-21swapper/33
254457599201,16cyclictest0-21swapper/33
254457599201,14cyclictest2863894-21chrt3
254457599201,14cyclictest0-21swapper/33
254457599200,18cyclictest0-21swapper/33
254457599199,6cyclictest2803718-21turbostat3
254457599192,14cyclictest66950irq/132-enp1s0-TxRx-33
2544575991917,1cyclictest0-21swapper/33
2544575991917,1cyclictest0-21swapper/33
2544575991915,2cyclictest0-21swapper/33
2544575991915,2cyclictest0-21swapper/33
2544575991914,3cyclictest0-21swapper/33
2544575991913,4cyclictest0-21swapper/33
254457599190,3cyclictest0-21swapper/33
254457599190,16cyclictest0-21swapper/33
29722502181,3sleep20-21swapper/22
28273072180,4sleep02675585-21diskmemload0
27934262181,2sleep20-21swapper/22
2544575991816,1cyclictest0-21swapper/33
2544575991815,1cyclictest0-21swapper/33
2544575991814,2cyclictest0-21swapper/33
2544575991812,3cyclictest0-21swapper/33
254457599181,14cyclictest0-21swapper/33
254457599181,14cyclictest0-21swapper/33
254457599181,14cyclictest0-21swapper/33
254457599180,1cyclictest0-21swapper/33
28040652171,11sleep12804087-21find1
25955202171,4sleep02595067-21apt-get0
2544575991714,1cyclictest0-21swapper/33
2544575991713,2cyclictest0-21swapper/33
254457599171,13cyclictest0-21swapper/33
254457599171,13cyclictest0-21swapper/33
254457599171,13cyclictest0-21swapper/33
254457599171,11cyclictest2633227-21chrt3
254457599171,11cyclictest2633227-21chrt3
254457599170,14cyclictest0-21swapper/33
30124752161,9sleep272-21kcompactd02
29973182160,4sleep20-21swapper/22
29869352161,2sleep10-21swapper/11
29869352161,2sleep10-21swapper/11
29709162160,5sleep10-21swapper/11
28864782161,2sleep20-21swapper/22
27924942161,5sleep02792509-21ssh0
27787222160,3sleep10-21swapper/11
2544575991614,1cyclictest0-21swapper/33
2544575991614,1cyclictest0-21swapper/33
2544575991613,1cyclictest0-21swapper/33
2544575991613,1cyclictest0-21swapper/33
2544575991613,1cyclictest0-21swapper/33
254457599161,12cyclictest0-21swapper/33
254457599160,3cyclictest2589552-21taskset3
254457599160,13cyclictest0-21swapper/33
29875412151,3sleep02675585-21diskmemload0
29875412151,3sleep02675585-21diskmemload0
29049082150,1sleep20-21swapper/22
28438262150,3sleep00-21swapper/00
27757412151,3sleep22675585-21diskmemload2
27672402151,2sleep00-21swapper/00
27502612151,4sleep02675585-21diskmemload0
27086022152,3sleep02708611-21sh0
26811612151,9sleep02675585-21diskmemload0
2544575991513,1cyclictest0-21swapper/33
2544575991512,1cyclictest0-21swapper/33
2544575991512,1cyclictest0-21swapper/33
254457599150,3cyclictest0-21swapper/33
254457599150,13cyclictest0-21swapper/33
254457599150,13cyclictest0-21swapper/33
254457599150,12cyclictest0-21swapper/33
30318372140,2sleep20-21swapper/22
30073252141,9sleep13007496-21expr1
29960992141,9sleep00-21swapper/00
29794582141,4sleep22979472-21ssh2
29146992141,3sleep02914864-21cstates0
28482692141,9sleep12849933-21tr1
28127712140,8sleep02675585-21diskmemload0
27525342141,2sleep10-21swapper/11
26896832141,2sleep20-21swapper/22
30201592131,5sleep13020417-21sh1
29538862131,5sleep00-21swapper/00
28857472131,7sleep02675585-21diskmemload0
28685302131,6sleep12868784-21users1
28628022131,3sleep02675585-21diskmemload0
28210432131,6sleep12821101-21munin-run1
28113432130,8sleep02675585-21diskmemload0
27851512132,2sleep2171rcu_preempt2
27538012131,8sleep12754919-21cut1
27251042131,8sleep12725117-21ssh1
26844112132,4sleep10-21swapper/11
25778002136,4sleep02577914-21cat0
29861952121,5sleep22986251-21ntpq2
29861952121,5sleep22986251-21ntpq2
29787192121,7sleep12978733-21ssh1
29624082121,6sleep12962418-21ssh1
29230962126,3sleep00-21swapper/00
29120812121,6sleep22912093-21ssh2
29031952120,8sleep12675585-21diskmemload1
28810402121,7sleep12881102-21fschecks_count1
28768732121,7sleep02876987-21ssh0
28427012121,6sleep22842767-21ntp_states2
28120892121,2sleep20-21swapper/22
28020232121,3sleep02802037-21ssh0
28009242121,7sleep22675585-21diskmemload2
27779392121,7sleep02777953-21ssh0
27423292121,7sleep02675585-21diskmemload0
27171352121,7sleep12717150-21ssh1
27093842121,8sleep22709395-21ssh2
26276142121,7sleep02627641-21perf0
26240362121,7sleep12625815-21grep1
26062842121,3sleep12606415-21date1
26059432120,6sleep072-21kcompactd00
25498542121,7sleep22550017-21sed2
30053792111,5sleep22675585-21diskmemload2
29984432110,2sleep10-21swapper/11
29509072110,6sleep12675585-21diskmemload1
29454422111,3sleep20-21swapper/22
29364602111,3sleep00-21swapper/00
29273312111,5sleep12927398-21ntp_states1
29128562111,6sleep02912867-21ssh0
28779532111,6sleep12877957-21ssh1
28638622111,4sleep20-21swapper/22
28625942111,5sleep22675585-21diskmemload2
28512172111,5sleep22851281-21ntpq2
28448692111,4sleep10-21swapper/11
28360082111,6sleep02675585-21diskmemload0
28345402111,6sleep22834793-21unixbench_singl2
28260622111,4sleep22675585-21diskmemload2
28129222111,5sleep22813180-21df2
27361492112,4sleep22736170-21apt-get2
27252392111,5sleep02675585-21diskmemload0
27167332111,4sleep20-21swapper/22
27153432110,2sleep00-21swapper/00
26900492111,3sleep00-21swapper/00
26444332112,5sleep12645398-21grep1
26373852111,6sleep12637500-21/usr/sbin/munin1
26373852111,6sleep12637500-21/usr/sbin/munin1
26332052111,5sleep22633224-21apt-get2
26332052111,5sleep22633224-21apt-get2
26284482111,6sleep02629826-21tr0
26281652111,5sleep22628374-21hddtemp_smartct2
26212852110,7sleep12621332-21ntpq1
26121632111,5sleep12612372-21hddtemp_smartct1
25561972111,5sleep12556243-21ntpq1
30294422101,3sleep10-21swapper/11
30237352101,5sleep03024203-21sh0
30064342101,4sleep02675585-21diskmemload0
29790992101,4sleep02675585-21diskmemload0
29566802101,4sleep22675585-21diskmemload2
29557672101,3sleep20-21swapper/22
29462062101,2sleep10-21swapper/11
29460452101,3sleep00-21swapper/00
29369922100,2sleep20-21swapper/22
29368832100,1sleep10-21swapper/11
29198852101,3sleep20-21swapper/22
29130112101,4sleep12675585-21diskmemload1
28969242102,3sleep10-21swapper/11
28952012101,3sleep20-21swapper/22
28949892101,4sleep02675585-21diskmemload0
28787432100,3sleep20-21swapper/22
28692502101,6sleep02869253-21ssh0
28621502101,4sleep12675585-21diskmemload1
28469502101,4sleep02846968-21apt-get0
28357342101,3sleep10-21swapper/11
28263612101,4sleep12826375-21ssh1
27872602101,4sleep12675585-21diskmemload1
27680262101,2sleep20-21swapper/22
27602852101,3sleep20-21swapper/22
27531022100,2sleep00-21swapper/00
27415702100,1sleep10-21swapper/11
27240552101,3sleep20-21swapper/22
27077572100,7sleep12707768-21sh1
27004532101,4sleep12675585-21diskmemload1
27004532101,4sleep12675585-21diskmemload1
26823392101,4sleep12675585-21diskmemload1
26755722101,4sleep02675605-21munin-run0
26752042101,6sleep22675214-21sshd2
26598772101,5sleep22659940-21/usr/sbin/munin2
26545072101,2sleep20-21swapper/22
26215712101,4sleep22621706-21/usr/sbin/munin2
25955962101,4sleep22595615-21apt-get2
25804212101,4sleep22582149-21tr2
25785792100,4sleep12578523-31find1
25680822101,4sleep12568101-21apt-get1
25586012101,5sleep22560340-21kthreadcore2
3020569290,1sleep20-21swapper/22
3019791291,2sleep00-21swapper/00
3012221292,1sleep00-21swapper/00
3006247291,2sleep10-21swapper/11
2965103291,3sleep02675585-21diskmemload0
2956921291,3sleep02675585-21diskmemload0
2928094290,1sleep20-21swapper/22
2920278291,4sleep12920290-21ssh1
2795876291,4sleep12795958-21grep1
2785695291,3sleep00-21swapper/00
2777142291,3sleep12675585-21diskmemload1
2766962291,3sleep12675585-21diskmemload1
2750195291,4sleep22750207-21ssh2
2733946290,1sleep10-21swapper/11
2733747291,4sleep02733750-21ssh0
2730579291,4sleep22731671-21memory2
2699105291,2sleep00-21swapper/00
2699105291,2sleep00-21swapper/00
2675889291,4sleep22675900-21ssh2
2665229291,4sleep12665490-21df_inode1
2638549291,4sleep22638627-21grep2
2611612291,4sleep02611672-21grep0
2584664290,4sleep22584683-21apt-get2
2579721291,4sleep12580418-21kthreadcore1
2558024290,5sleep12558600-21cut1
2670512281,2sleep12670531-21apt-get1
2665214281,3sleep02665206-21/usr/sbin/munin0
2659856281,3sleep12659875-21apt-get1
2649189280,2sleep20-21swapper/22
2629827281,3sleep12631643-21kthreadcore1
2589425280,1sleep00-21swapper/00
2579152280,4sleep02578523-31find0
2573433280,5sleep22573533-21cpuspeed_turbos2
2567593280,1sleep10-21swapper/11
2562821281,3sleep00-21swapper/00
2556251281,4sleep22556301-21awk2
2544735280,1sleep10-21swapper/11
2654026270,1sleep00-21swapper/00
2653078270,2sleep10-21swapper/11
2648657270,1sleep00-21swapper/00
2645400271,3sleep20-21swapper/22
2627264270,3sleep20-21swapper/22
2611873270,2sleep20-21swapper/22
2611255270,1sleep10-21swapper/11
2606614270,3sleep20-21swapper/22
2600591270,1sleep10-21swapper/11
2589992270,2sleep10-21swapper/11
2589713270,1sleep10-21swapper/11
2572423270,1sleep20-21swapper/22
2562408270,1sleep00-21swapper/00
2552627271,3sleep02552817-21kthreadcore0
2669560261,2sleep20-21swapper/22
2663590260,2sleep02663869-21strings0
2659315260,4sleep10-21swapper/11
2642535261,2sleep10-21swapper/11
2633480260,3sleep02633514-21fschecks_count0
2633480260,3sleep02633514-21fschecks_count0
2617196260,2sleep00-21swapper/00
2613857261,2sleep02615686-21kthreadcore0
2590015261,2sleep22590203-21cstates2
2567802260,1sleep20-21swapper/22
2654783250,2sleep00-21swapper/00
2638817250,1sleep00-21swapper/00
2604574250,1sleep20-21swapper/22
2593894250,1sleep00-21swapper/00
2571931250,1sleep00-21swapper/00
2545039240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional