You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 19:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Tue Jun 16, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
794086212054,61sleep30-21swapper/33
79394328267,10sleep10-21swapper/11
79419827955,7sleep00-21swapper/00
79400227963,10sleep20-21swapper/22
9478942221,10sleep2924897-21diskmemload2
794407992211,7cyclictest9406452sleep33
79440799221,17cyclictest924899-21turbostat3
10473042221,9sleep11047519-21grep1
79440799219,8cyclictest66950irq/132-enp1s0-TxRx-33
79440799201,2cyclictest0-21swapper/33
79440799201,15cyclictest66950irq/132-enp1s0-TxRx-33
79440799201,15cyclictest1258423-21taskset3
79440799200,18cyclictest0-21swapper/33
79440799200,16cyclictest949870-21taskset3
12082752201,3sleep00-21swapper/00
79440799199,3cyclictest0-21swapper/33
79440799192,11cyclictest898557-21chrt3
79440799191,4cyclictest1084479-21chrt3
794407991912,4cyclictest66950irq/132-enp1s0-TxRx-33
794407991911,5cyclictest66950irq/132-enp1s0-TxRx-33
79440799191,15cyclictest1250667-21taskset3
79440799191,15cyclictest0-21swapper/33
79440799191,14cyclictest66950irq/132-enp1s0-TxRx-33
79440799191,14cyclictest0-21swapper/33
79440799191,14cyclictest0-21swapper/33
79440799191,14cyclictest0-21swapper/33
79440799191,14cyclictest0-21swapper/33
794407991910,5cyclictest0-21swapper/33
79440799190,16cyclictest66950irq/132-enp1s0-TxRx-33
79440799190,16cyclictest66950irq/132-enp1s0-TxRx-33
11739822191,2sleep0924897-21diskmemload0
10829442191,13sleep2924897-21diskmemload2
79440799189,5cyclictest0-21swapper/33
79440799185,1cyclictest0-21swapper/33
794407991815,1cyclictest66950irq/132-enp1s0-TxRx-33
79440799181,14cyclictest0-21swapper/33
79440799181,14cyclictest0-21swapper/33
79440799181,14cyclictest0-21swapper/33
79440799181,14cyclictest0-21swapper/33
79440799181,14cyclictest0-21swapper/33
79440799181,13cyclictest0-21swapper/33
79440799181,13cyclictest0-21swapper/33
79440799181,13cyclictest0-21swapper/33
79440799181,13cyclictest0-21swapper/33
79440799181,13cyclictest0-21swapper/33
79440799181,13cyclictest0-21swapper/33
79440799181,12cyclictest0-21swapper/33
79440799180,15cyclictest0-21swapper/33
79440799180,15cyclictest0-21swapper/33
11571992181,14sleep00-21swapper/00
79440799175,11cyclictest0-21swapper/33
794407991713,2cyclictest0-21swapper/33
794407991711,4cyclictest0-21swapper/33
794407991711,3cyclictest0-21swapper/33
79440799171,13cyclictest0-21swapper/33
79440799170,14cyclictest0-21swapper/33
79440799170,14cyclictest0-21swapper/33
79440799170,14cyclictest0-21swapper/33
11944522171,7sleep01196081-21grep0
11642642171,3sleep10-21swapper/11
11310292171,13sleep00-21swapper/00
10251582171,12sleep01025163-21rm0
9737022161,3sleep00-21swapper/00
8653582160,2sleep30-21swapper/33
794407991612,2cyclictest0-21swapper/33
794407991612,2cyclictest0-21swapper/33
794407991611,3cyclictest0-21swapper/33
79440799161,12cyclictest829318-21taskset3
79440799161,12cyclictest0-21swapper/33
79440799161,12cyclictest0-21swapper/33
79440799160,13cyclictest0-21swapper/33
79440799160,13cyclictest0-21swapper/33
12764132161,4sleep1924897-21diskmemload1
11997502161,2sleep10-21swapper/11
11908882161,3sleep10-21swapper/11
11908882161,3sleep10-21swapper/11
11674132163,4sleep2171rcu_preempt2
11301402161,8sleep21130199-21ntpq2
9337282150,1sleep10-21swapper/11
8240702151,10sleep2825498-21kthreadcore2
79440799158,4cyclictest839043-21chrt3
794407991512,2cyclictest0-21swapper/33
79440799151,12cyclictest0-21swapper/33
79440799150,13cyclictest0-21swapper/33
79440799150,13cyclictest0-21swapper/33
79440799150,12cyclictest0-21swapper/33
12249322150,3sleep00-21swapper/00
12163712150,1sleep10-21swapper/11
11430792151,9sleep11143160-21irqstats1
10986832151,8sleep10-21swapper/11
10752652151,4sleep01075276-21ssh0
10011892157,4sleep01002641-21grep0
794407991412,1cyclictest0-21swapper/33
79440799140,13cyclictest0-21swapper/33
12592302140,2sleep10-21swapper/11
12322252141,3sleep11232236-21ssh1
10845982141,7sleep21084811-21diskstats2
10833162141,8sleep1924897-21diskmemload1
10586492141,3sleep01058660-21ssh0
10495022141,3sleep00-21swapper/00
10226072141,7sleep1924897-21diskmemload1
9901262131,8sleep1924897-21diskmemload1
9485072131,7sleep1924897-21diskmemload1
9148042131,6sleep2915013-21hddtemp_smartct2
8925902130,1sleep00-21swapper/00
7987622131,2sleep00-21swapper/00
79440799139,3cyclictest0-21swapper/33
79440799130,1cyclictest0-21swapper/33
12587612131,3sleep01258773-21ssh0
11300082131,8sleep11130130-21ssh1
11254492131,8sleep21125463-21ssh2
10323552131,8sleep01032367-21ssh0
10001992131,1sleep00-21swapper/00
9880562121,6sleep2988123-21ntp_states2
9739102121,8sleep20-21swapper/22
9729032121,6sleep1924897-21diskmemload1
9316772121,2sleep1931688-21ssh1
9312052121,2sleep20-21swapper/22
8505862121,7sleep2850780-21gltestperf2
8181932122,4sleep1818212-21apt-get1
12754242124,5sleep21275432-21sh2
12661442121,6sleep1924897-21diskmemload1
12660452121,5sleep00-21swapper/00
12591962121,7sleep21259202-21ssh2
11923752121,7sleep2924897-21diskmemload2
11923752121,7sleep2924897-21diskmemload2
11513102121,7sleep11151445-21gltestperf1
11234112120,8sleep01123422-21sh0
10993792121,3sleep01099380-21ssh0
10567512121,6sleep2924897-21diskmemload2
9595022111,6sleep1960507-21grep1
9569382111,4sleep2924897-21diskmemload2
9547132111,5sleep1954771-21ntpq1
9424972111,5sleep0942698-21hddtemp_smartct0
9224442111,5sleep1923724-21memory1
9089052111,4sleep1908953-21munin-run1
8973232111,5sleep1897379-21ntpq1
8813972111,6sleep1881483-21proc_pri1
8813412111,5sleep0881395-21ntpq0
8726962110,7sleep0874349-21tr0
8618232111,6sleep2863312-21tr2
8489962111,5sleep1849043-21ntpq1
8289712111,5sleep0828989-21apt-get0
7996572110,7sleep2800320-21ntp_kernel_pll_2
12764512111,2sleep00-21swapper/00
12433222111,5sleep21243346-21apt-get2
12353662111,4sleep00-21swapper/00
11902542111,4sleep00-21swapper/00
11902542111,4sleep00-21swapper/00
11809382111,5sleep21180995-21ntpq2
11556502111,5sleep21155902-21users2
11502122112,6sleep2924897-21diskmemload2
11492092111,6sleep01149213-21ssh0
11416572111,6sleep01141671-21ssh0
11007642111,5sleep20-21swapper/22
10915382115,2sleep10-21swapper/11
10739602111,3sleep10-21swapper/11
10303092111,5sleep11030369-21ntpq1
10061742111,5sleep1924897-21diskmemload1
9918062101,3sleep00-21swapper/00
9833522101,4sleep1924897-21diskmemload1
9828072101,4sleep0924897-21diskmemload0
9814382101,3sleep2924897-21diskmemload2
9658492101,2sleep20-21swapper/22
9587932101,2sleep00-21swapper/00
9565032101,4sleep0924897-21diskmemload0
9417342101,4sleep0941772-21munin-run0
9248872101,5sleep2924902-21sh2
9119272101,4sleep2913069-21memory2
9091652101,4sleep0909183-21apt-get0
8575412101,5sleep1859292-21grep1
12597162101,2sleep20-21swapper/22
12511632101,6sleep01-21systemd0
12355532102,3sleep10-21swapper/11
12322372100,6sleep21232251-21ssh2
12321852101,3sleep00-21swapper/00
12241392101,3sleep10-21swapper/11
12188532101,5sleep21218959-21kthreadcore2
12141922101,4sleep01214253-21ntpq0
12140452100,5sleep290-21kswapd02
12073512100,4sleep20-21swapper/22
12016422101,5sleep11201674-21ssh1
11840722101,2sleep10-21swapper/11
11731922101,4sleep1924897-21diskmemload1
11731062101,2sleep20-21swapper/22
11655632101,3sleep00-21swapper/00
11408312101,3sleep20-21swapper/22
11227912100,1sleep10-21swapper/11
11166002101,4sleep2924897-21diskmemload2
11066392101,4sleep1924897-21diskmemload1
10969332101,4sleep21096990-21ssh2
10753782101,2sleep21075392-21sshd2
10672132101,2sleep20-21swapper/22
10650772101,4sleep1924897-21diskmemload1
10432962101,3sleep20-21swapper/22
10400932100,1sleep00-21swapper/00
10396332101,4sleep2924897-21diskmemload2
10336172101,3sleep2924897-21diskmemload2
10155052101,5sleep21015516-21ssh2
10154292101,3sleep00-21swapper/00
10058692101,4sleep2924897-21diskmemload2
998533291,3sleep2924897-21diskmemload2
992915291,5sleep1994126-21kthreadcore1
938798291,4sleep2938808-21ssh2
932543290,1sleep00-21swapper/00
915087291,4sleep0916454-21grep0
866590291,4sleep1866689-21cut1
856470291,4sleep0857540-21cat0
854396291,4sleep1854450-21ntpq1
834315291,3sleep1834334-21apt-get1
828494291,4sleep172-21kcompactd01
828451291,4sleep0828436-31find0
823172290,2sleep00-21swapper/00
806326291,3sleep0806371-21ntpq0
798551291,3sleep1798647-21ntpq1
1240899291,2sleep20-21swapper/22
1200106291,2sleep20-21swapper/22
1182340291,3sleep00-21swapper/00
1134183291,4sleep11134205-21apt1
1117142291,2sleep10-21swapper/11
1109253291,4sleep01109282-21apt-get0
1106018291,2sleep00-21swapper/00
1080742291,4sleep01080755-21sensors_temp0
1064970291,4sleep01064984-21ssh0
1057092291,3sleep1924897-21diskmemload1
1039906290,1sleep10-21swapper/11
1017819291,5sleep21018038-21/usr/sbin/munin2
1014343291,3sleep1924897-21diskmemload1
916456281,3sleep10-21swapper/11
908779281,3sleep2908780-21sshd2
897381281,3sleep2897466-21ps2
893779281,3sleep0894885-21grep0
892241281,4sleep1892480-21grep1
886581280,4sleep20-21swapper/22
885879280,1sleep00-21swapper/00
877225280,2sleep20-21swapper/22
870662280,2sleep20-21swapper/22
861532281,3sleep0861745-21hddtemp_smartct0
849823280,1sleep20-21swapper/22
844970281,2sleep00-21swapper/00
844154281,3sleep1844338-21/usr/sbin/munin1
813436281,3sleep0814705-21kthreadcore0
812475280,1sleep10-21swapper/11
808129281,4sleep0808899-21cut0
799469280,2sleep20-21swapper/22
1250430280,3sleep1924897-21diskmemload1
1090393280,2sleep00-21swapper/00
923906271,2sleep00-21swapper/00
910238270,4sleep10-21swapper/11
904651270,3sleep0906255-21kthreadcore0
903305270,1sleep00-21swapper/00
887302270,1sleep10-21swapper/11
876937270,1sleep10-21swapper/11
861242270,2sleep10-21swapper/11
844531270,1sleep00-21swapper/00
839646271,2sleep20-21swapper/22
839047270,1sleep20-21swapper/22
834000270,1sleep20-21swapper/22
833811270,1sleep10-21swapper/11
818846270,4sleep2783536-21kworker/2:1+events2
810636271,2sleep20-21swapper/22
805253271,3sleep1806138-21cat1
898535260,1sleep20-21swapper/22
866568260,2sleep00-21swapper/00
850859260,2sleep00-21swapper/00
817717260,4sleep10-21swapper/11
817620260,1sleep20-21swapper/22
903515250,3sleep10-21swapper/11
887601250,1sleep20-21swapper/22
872221250,1sleep20-21swapper/22
855887250,2sleep20-21swapper/22
834194240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional