You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 08:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat Apr 18, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
93324321330,4sleep2421rcuc/22
556410212267,51sleep30-21swapper/33
97648021160,2sleep190-21kswapd01
55622628466,12sleep10-21swapper/11
55630128251,12sleep20-21swapper/22
55631427656,14sleep00-21swapper/00
9993792230,2sleep20-21swapper/22
9388102231,10sleep0687052-21diskmemload0
55659399231,14cyclictest0-21swapper/33
55659399221,17cyclictest913535-21taskset3
55659399221,17cyclictest853539-21taskset3
7109432210,6sleep0687052-21diskmemload0
556593992117,2cyclictest0-21swapper/33
55659399211,16cyclictest981740-21taskset3
55659399211,16cyclictest938797-21taskset3
55659399211,16cyclictest0-21swapper/33
55659399211,15cyclictest0-21swapper/33
55659399210,17cyclictest1035688-21taskset3
7356652201,7sleep1735719-21ntpq1
55659399206,12cyclictest0-21swapper/33
556593992016,2cyclictest0-21swapper/33
55659399201,3cyclictest0-21swapper/33
556593992012,6cyclictest0-21swapper/33
556593992012,5cyclictest0-21swapper/33
55659399201,16cyclictest0-21swapper/33
55659399201,15cyclictest0-21swapper/33
556593992010,7cyclictest772387-21chrt3
55659399200,18cyclictest0-21swapper/33
55659399200,18cyclictest0-21swapper/33
55659399200,17cyclictest0-21swapper/33
8611172191,3sleep00-21swapper/00
7721852192,6sleep2687052-21diskmemload2
55659399191,15cyclictest0-21swapper/33
55659399191,14cyclictest0-21swapper/33
55659399191,14cyclictest0-21swapper/33
55659399191,14cyclictest0-21swapper/33
55659399191,12cyclictest0-21swapper/33
9110402181,3sleep00-21swapper/00
7033672181,3sleep00-21swapper/00
55659399187,9cyclictest888793-21turbostat3
55659399181,15cyclictest0-21swapper/33
55659399181,14cyclictest903467-21taskset3
556593991811,4cyclictest0-21swapper/33
55659399181,14cyclictest0-21swapper/33
55659399181,14cyclictest0-21swapper/33
55659399181,14cyclictest0-21swapper/33
55659399181,14cyclictest0-21swapper/33
55659399181,14cyclictest0-21swapper/33
55659399181,14cyclictest0-21swapper/33
55659399181,14cyclictest0-21swapper/33
55659399181,13cyclictest0-21swapper/33
55659399181,13cyclictest0-21swapper/33
55659399181,13cyclictest0-21swapper/33
55659399181,13cyclictest0-21swapper/33
55659399180,16cyclictest0-21swapper/33
55659399180,15cyclictest0-21swapper/33
55659399180,15cyclictest0-21swapper/33
9926572171,3sleep20-21swapper/22
7924732171,6sleep1792522-21systemctl1
7628662171,4sleep1687052-21diskmemload1
6823112171,4sleep0682521-21hddtemp_smartct0
5753742171,3sleep2576366-21kthreadcore2
55659399176,8cyclictest654807-21turbostat3
55659399171,14cyclictest0-21swapper/33
55659399171,13cyclictest0-21swapper/33
55659399171,13cyclictest0-21swapper/33
9733402161,2sleep00-21swapper/00
9054522161,4sleep1687052-21diskmemload1
8957112161,3sleep1687052-21diskmemload1
8455282160,3sleep10-21swapper/11
8302072160,4sleep1321rcuc/11
8233042161,8sleep2823371-21ntp_states2
7627522169,3sleep00-21swapper/00
7567112161,2sleep00-21swapper/00
556593991614,1cyclictest0-21swapper/33
556593991613,1cyclictest0-21swapper/33
55659399161,13cyclictest0-21swapper/33
55659399161,12cyclictest0-21swapper/33
55659399160,13cyclictest0-21swapper/33
55659399160,13cyclictest0-21swapper/33
55659399160,13cyclictest0-21swapper/33
55659399160,13cyclictest0-21swapper/33
55659399160,13cyclictest0-21swapper/33
10537422161,3sleep20-21swapper/22
10461292161,4sleep1687052-21diskmemload1
10461292161,4sleep1687052-21diskmemload1
9295832151,3sleep2687052-21diskmemload2
7577372151,8sleep2757952-21diskstats2
7478412151,7sleep20-21swapper/22
7139782151,3sleep1687052-21diskmemload1
6894402151,6sleep2691168-21cut2
55659399155,7cyclictest585971-21taskset3
55659399151,2cyclictest0-21swapper/33
55659399151,11cyclictest627643-21chrt3
55659399150,2cyclictest0-21swapper/33
55659399150,13cyclictest0-21swapper/33
55659399150,13cyclictest0-21swapper/33
55659399150,11cyclictest0-21swapper/33
10455012151,9sleep20-21swapper/22
10455012151,9sleep20-21swapper/22
9297132141,9sleep0929723-21ssh0
9211372140,3sleep10-21swapper/11
8788782141,7sleep20-21swapper/22
8415602141,9sleep2841575-21ssh2
7127222141,8sleep1687052-21diskmemload1
55659399141,2cyclictest0-21swapper/33
55659399140,2cyclictest0-21swapper/33
55659399140,12cyclictest0-21swapper/33
55659399140,12cyclictest0-21swapper/33
10547792141,8sleep1687052-21diskmemload1
10533812141,9sleep0687052-21diskmemload0
10425832140,2sleep00-21swapper/00
10425832140,2sleep00-21swapper/00
10263562141,3sleep01026367-21ssh0
10055222140,2sleep2421rcuc/22
9820582131,3sleep0982072-21ssh0
9457592131,8sleep0945863-21/usr/sbin/munin0
9223422131,8sleep0922352-21ssh0
8932692131,6sleep0893370-21ntpq0
8879692131,7sleep1687052-21diskmemload1
8519052131,7sleep20-21swapper/22
8419372131,7sleep1687052-21diskmemload1
7753782131,7sleep0775614-21expr0
7488882132,5sleep1748917-21apt-get1
7356122131,7sleep0735656-21ntpq0
7308282130,6sleep20-21swapper/22
55659399130,11cyclictest0-21swapper/33
9900812127,1sleep10-21swapper/11
9492722120,7sleep2687052-21diskmemload2
8438792121,6sleep0843893-21ssh0
8273822121,7sleep0827442-21systemd-run0
8197202121,4sleep1821278-21kthreadcore1
8146302121,7sleep0814763-21sendmail_mailqu0
7752602121,5sleep1687052-21diskmemload1
7025192121,5sleep10-21swapper/11
6860512121,5sleep2686097-21ntpq2
6483342121,3sleep0648451-21ld0
6356802121,7sleep0637497-21cut0
6331672121,5sleep10-21swapper/11
6322132121,6sleep0632267-21ntpq0
6088912121,7sleep1610639-21expr1
5695012121,7sleep2569753-21df2
5608822121,5sleep1560929-21ntpq1
10125392125,3sleep20-21swapper/22
10102212121,7sleep01010235-21ssh0
10082102121,7sleep1687052-21diskmemload1
9922702111,3sleep00-21swapper/00
9734512111,4sleep1687052-21diskmemload1
9631122111,5sleep0963176-21/usr/sbin/munin0
9629002111,4sleep2963052-21ntpq2
9508042111,6sleep1951867-21cut1
9322362111,4sleep1687052-21diskmemload1
9046032111,3sleep20-21swapper/22
8945202110,3sleep20-21swapper/22
8804572111,5sleep2880723-21df2
8775542111,6sleep1687052-21diskmemload1
8687102111,4sleep1687052-21diskmemload1
8349192111,4sleep20-21swapper/22
8103452111,5sleep2810605-21df2
8075612111,6sleep1807573-21ssh1
8065662110,7sleep2806580-21ssh2
7344382111,5sleep2735466-21memory2
7268632111,4sleep0726911-21ntpq0
7218662110,2sleep0721879-21ssh0
6964152110,7sleep2696429-21ssh2
6761212111,5sleep0676214-21munin-run0
6659022111,5sleep0666012-21diskstats0
6653452111,5sleep172-21kcompactd01
6653452111,5sleep172-21kcompactd01
5966982114,3sleep1597540-21grep1
5798762111,5sleep1579926-21munin-run1
5681922111,4sleep0568241-21ntpq0
5572822110,7sleep0557536-21grep0
10374082111,3sleep10-21swapper/11
10370252111,3sleep20-21swapper/22
10193872111,6sleep01019397-21ssh0
10193072111,3sleep10-21swapper/11
9817272100,1sleep20-21swapper/22
9687562105,2sleep20-21swapper/22
9568262102,3sleep2687052-21diskmemload2
9567992100,2sleep00-21swapper/00
9467952101,3sleep10-21swapper/11
9381692101,4sleep1687052-21diskmemload1
9217582101,3sleep2687052-21diskmemload2
9040412101,3sleep00-21swapper/00
8885172101,4sleep0687052-21diskmemload0
8711132101,3sleep00-21swapper/00
8691162100,2sleep20-21swapper/22
8616022101,4sleep2687052-21diskmemload2
8613882100,1sleep10-21swapper/11
8144472101,5sleep1814502-21ntpq1
7998212101,3sleep0687052-21diskmemload0
7920072101,3sleep00-21swapper/00
7815302101,3sleep20-21swapper/22
7725202101,3sleep1687052-21diskmemload1
7714002101,2sleep00-21swapper/00
7551272101,3sleep20-21swapper/22
7476642101,4sleep0687052-21diskmemload0
7465732101,4sleep1687052-21diskmemload1
7293432101,4sleep1687052-21diskmemload1
7113212101,2sleep20-21swapper/22
6937502100,1sleep00-21swapper/00
6930082101,4sleep1687052-21diskmemload1
6377622101,5sleep2637810-21ntpq2
6215382101,4sleep2621586-21ntpq2
6169882101,5sleep00-21swapper/00
6121422101,4sleep2612161-21apt-get2
6070802101,4sleep2607294-21hddtemp_smartct2
5952632101,4sleep1595507-21users1
5801592101,4sleep1580414-21df1
5621112101,4sleep2563618-21df_inode2
10289722101,4sleep1687052-21diskmemload1
10266732101,3sleep2687052-21diskmemload2
10015952101,2sleep10-21swapper/11
998438291,3sleep0687052-21diskmemload0
963826291,2sleep10-21swapper/11
911936290,1sleep10-21swapper/11
911172291,4sleep2911238-21sed2
877292291,2sleep00-21swapper/00
850812291,4sleep0850823-21ssh0
831994291,4sleep0832056-21/usr/sbin/munin0
799592290,3sleep20-21swapper/22
797865291,2sleep10-21swapper/11
788349291,4sleep2788410-21ntpq2
722080290,6sleep2722093-21rm2
685999290,4sleep1686049-21ntpq1
681549290,1sleep00-21swapper/00
660422291,4sleep2660597-21cat2
660422291,4sleep2660597-21cat2
659163291,4sleep0659218-21ntpq0
654542294,3sleep2431ktimers/22
649726291,3sleep0649745-21apt-get0
639089291,4sleep1639308-21cstates1
633263290,2sleep1171rcu_preempt1
622774291,4sleep0622792-21apt0
621645291,4sleep0621787-21mailstats0
600244291,4sleep2600289-21ntpq2
580137291,3sleep0580156-21apt-get0
570013291,4sleep1570412-21cut1
1030192292,4sleep01031774-21cut0
808205281,3sleep0808219-21ssh0
650916281,3sleep10-21swapper/11
644399281,2sleep10-21swapper/11
626895281,4sleep2626955-21ntp_states2
606448280,1sleep10-21swapper/11
606322280,1sleep20-21swapper/22
601466281,2sleep00-21swapper/00
585486281,3sleep0585725-21cstates0
568243281,3sleep1568300-21ntpq1
681530270,1sleep10-21swapper/11
675862270,1sleep10-21swapper/11
670734270,1sleep10-21swapper/11
669743270,2sleep20-21swapper/22
659868270,1sleep20-21swapper/22
645651271,2sleep20-21swapper/22
643958270,1sleep20-21swapper/22
639067270,2sleep00-21swapper/00
633057270,1sleep20-21swapper/22
622765270,1sleep10-21swapper/11
618033271,2sleep1618984-21kthreadcore1
607373271,3sleep0608887-21tail0
600105270,3sleep00-21swapper/00
590812270,2sleep20-21swapper/22
590335270,3sleep20-21swapper/22
585026270,1sleep20-21swapper/22
561558270,1sleep20-21swapper/22
681697260,1sleep20-21swapper/22
665316260,1sleep00-21swapper/00
665316260,1sleep00-21swapper/00
660007260,4sleep10-21swapper/11
612131260,4sleep10-21swapper/11
590290260,1sleep10-21swapper/11
579758260,4sleep00-21swapper/00
574328260,1sleep00-21swapper/00
675766250,3sleep20-21swapper/22
595669250,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional