You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-08 - 14:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Wed Apr 08, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
852231211755,57sleep30-21swapper/33
85707428455,12sleep10-21swapper/11
85654628456,6sleep20-21swapper/22
85689227956,6sleep00-21swapper/00
85738499231,17cyclictest11456292sleep33
85738499230,19cyclictest0-21swapper/33
85738499221,14cyclictest0-21swapper/33
857384992210,1cyclictest0-21swapper/33
85738499214,13cyclictest1182021-21taskset3
85738499211,16cyclictest12002602sleep33
85738499208,1cyclictest0-21swapper/33
85738499201,16cyclictest0-21swapper/33
85738499201,16cyclictest0-21swapper/33
85738499201,16cyclictest0-21swapper/33
85738499201,15cyclictest1249792-21taskset3
85738499201,15cyclictest1048175-21taskset3
85738499201,15cyclictest1048175-21taskset3
85738499201,15cyclictest0-21swapper/33
85738499200,13cyclictest0-21swapper/33
85738499193,12cyclictest0-21swapper/33
85738499191,15cyclictest0-21swapper/33
85738499191,14cyclictest0-21swapper/33
85738499191,14cyclictest0-21swapper/33
85738499191,14cyclictest0-21swapper/33
85738499191,14cyclictest0-21swapper/33
85738499191,14cyclictest0-21swapper/33
85738499191,14cyclictest0-21swapper/33
857384991910,6cyclictest0-21swapper/33
10569422191,3sleep21056957-21ssh2
8812272181,3sleep0881246-21apt-get0
85738499181,4cyclictest907587-21taskset3
85738499181,14cyclictest0-21swapper/33
85738499181,14cyclictest0-21swapper/33
85738499181,14cyclictest0-21swapper/33
85738499181,14cyclictest0-21swapper/33
85738499181,14cyclictest0-21swapper/33
85738499181,14cyclictest0-21swapper/33
85738499181,14cyclictest0-21swapper/33
85738499181,14cyclictest0-21swapper/33
85738499181,14cyclictest0-21swapper/33
85738499181,14cyclictest0-21swapper/33
85738499181,14cyclictest0-21swapper/33
85738499181,14cyclictest0-21swapper/33
85738499181,14cyclictest0-21swapper/33
85738499181,13cyclictest1354404-21chrt3
85738499181,13cyclictest0-21swapper/33
85738499181,13cyclictest0-21swapper/33
85738499180,14cyclictest9231712sleep33
85738499180,14cyclictest0-21swapper/33
85738499180,14cyclictest0-21swapper/33
10845032181,2sleep10-21swapper/11
10514262181,3sleep00-21swapper/00
85738499178,5cyclictest918536-21turbostat3
857384991714,1cyclictest0-21swapper/33
857384991713,2cyclictest0-21swapper/33
85738499171,13cyclictest0-21swapper/33
85738499171,13cyclictest0-21swapper/33
85738499170,14cyclictest0-21swapper/33
85738499170,14cyclictest0-21swapper/33
85738499170,13cyclictest0-21swapper/33
13289212170,2sleep10-21swapper/11
12677652171,5sleep01267778-21ssh0
857384991613,1cyclictest0-21swapper/33
85738499160,13cyclictest0-21swapper/33
85738499160,13cyclictest0-21swapper/33
85738499160,13cyclictest0-21swapper/33
85738499160,13cyclictest0-21swapper/33
85738499160,13cyclictest0-21swapper/33
85738499160,13cyclictest0-21swapper/33
85738499160,13cyclictest0-21swapper/33
85738499160,13cyclictest0-21swapper/33
12171492162,9sleep0988928-21diskmemload0
11806682161,4sleep1988928-21diskmemload1
11553882161,4sleep1988928-21diskmemload1
11355202160,2sleep20-21swapper/22
11021792161,4sleep1988928-21diskmemload1
10137332161,3sleep20-21swapper/22
9989872151,10sleep01000504-21kthreadcore0
9735912151,9sleep2973691-21irqstats2
9068562151,3sleep1902733-21/usr/sbin/munin1
857384991512,2cyclictest0-21swapper/33
85738499151,11cyclictest0-21swapper/33
85738499150,13cyclictest0-21swapper/33
85738499150,12cyclictest0-21swapper/33
85738499150,12cyclictest0-21swapper/33
13065882151,2sleep00-21swapper/00
12881232152,9sleep00-21swapper/00
12303772151,9sleep2988928-21diskmemload2
11991532151,3sleep1988928-21diskmemload1
11624772150,1sleep10-21swapper/11
10834212151,10sleep01083435-21ssh0
10597922150,3sleep2988928-21diskmemload2
10395292151,4sleep01039542-21rm0
10234002151,2sleep20-21swapper/22
9957832141,3sleep1995794-21ssh1
9058992140,3sleep20-21swapper/22
85738499146,4cyclictest9879482sleep33
857384991412,1cyclictest0-21swapper/33
13467652141,8sleep1988928-21diskmemload1
12768162141,4sleep11276827-21ssh1
12624102141,3sleep21262439-21apt-get2
12347042141,2sleep00-21swapper/00
11384532140,2sleep10-21swapper/11
9367832130,9sleep0938619-21grep0
13209032130,2sleep2988928-21diskmemload2
13148752131,6sleep00-21swapper/00
12697572132,3sleep10-21swapper/11
12603022131,2sleep2988928-21diskmemload2
12530212131,8sleep11253033-21ssh1
12441202131,8sleep01244134-21ssh0
11997142131,8sleep01199726-21ssh0
11898512134,2sleep1171rcu_preempt1
11702162130,5sleep01170299-21find0
11523722131,8sleep21152436-21ntp_offset2
11176162131,4sleep01117766-21wc0
10917752132,2sleep1171rcu_preempt1
10485162131,7sleep1988928-21diskmemload1
10485162131,7sleep1988928-21diskmemload1
9178322121,7sleep0917975-21expr0
8806422120,1sleep00-21swapper/00
8708682121,3sleep2871912-21kthreadcore2
8654952121,7sleep0866811-21grep0
13413192120,2sleep00-21swapper/00
13319882121,7sleep21331991-21ssh2
12542392121,7sleep01254991-21grep0
12509262121,5sleep00-21swapper/00
12170032121,5sleep1988928-21diskmemload1
11471012121,7sleep21147115-21ssh2
11085592121,7sleep01103969-21/usr/sbin/munin0
11045582121,7sleep21105077-21grep2
10994212121,5sleep01099477-21ntpq0
10751052120,3sleep01075119-21ssh0
10569862120,8sleep1988928-21diskmemload1
10494132121,5sleep00-21swapper/00
10494132121,5sleep00-21swapper/00
10309602122,4sleep1988928-21diskmemload1
10073392121,5sleep01007474-21diskstats0
10033602120,1sleep20-21swapper/22
9787852111,5sleep2978995-21hddtemp_smartct2
9677812111,5sleep0967800-21apt-get0
9501982111,6sleep2950278-21timerandwakeup2
9452082111,7sleep1945209-21sshd1
9330582111,6sleep2933497-21strings2
9292102111,5sleep1929237-21munin-run1
9068042111,5sleep0906854-21ntpq0
8914222111,6sleep2255-21systemd-journal2
13576392111,4sleep2988928-21diskmemload2
13569612110,7sleep1988928-21diskmemload1
13406182110,7sleep1988928-21diskmemload1
12929252111,5sleep21292988-21ntpq2
12611242111,4sleep1988928-21diskmemload1
12412972111,5sleep1988928-21diskmemload1
12252172111,4sleep2988928-21diskmemload2
12168092112,5sleep20-21swapper/22
12050272111,5sleep21205151-21ntpq2
11885492111,4sleep2988928-21diskmemload2
11729882110,2sleep10-21swapper/11
11542142111,3sleep00-21swapper/00
11274832111,5sleep1988928-21diskmemload1
11097542110,6sleep1988928-21diskmemload1
10857932111,6sleep21085828-21grep2
10662502110,2sleep00-21swapper/00
10650882111,4sleep1988928-21diskmemload1
10403112111,4sleep20-21swapper/22
10399502111,3sleep10-21swapper/11
10313072111,6sleep01031319-21ssh0
10158532110,6sleep1988928-21diskmemload1
10054312111,6sleep11005442-21ssh1
9969182101,2sleep20-21swapper/22
9790962101,6sleep0980643-21cut0
9630052101,5sleep2963028-21kthreadcore2
9555662101,4sleep2955625-21ntpq2
9514472101,4sleep1951703-21df1
9282682101,4sleep2928321-21ntp_states2
9139522101,5sleep2914052-21sed2
9097012100,6sleep0911496-21kthreadcore0
13553132101,5sleep01355327-21ssh0
13470332101,3sleep20-21swapper/22
13405792101,3sleep2988928-21diskmemload2
13238652101,5sleep01324091-21diskstats0
13192122100,5sleep11319272-21ntpq1
13130122101,3sleep1988928-21diskmemload1
13062262101,5sleep21306238-21rm2
13028602101,4sleep1988928-21diskmemload1
13015732101,5sleep21301678-21ntpq2
12958622101,3sleep00-21swapper/00
12892592101,4sleep11289342-21irqstats1
12842252101,5sleep21284288-21/usr/sbin/munin2
12809562100,6sleep11282567-21tr1
12766652101,5sleep21276678-21ssh2
12499332100,3sleep20-21swapper/22
12361002101,4sleep21236126-21apt-get2
12255232101,3sleep1988928-21diskmemload1
12080972101,3sleep00-21swapper/00
12013012101,4sleep1988928-21diskmemload1
11962592101,4sleep21196381-21/usr/sbin/munin2
11801712101,4sleep2988928-21diskmemload2
11623422100,1sleep20-21swapper/22
11610692101,5sleep01161129-21ntpq0
11464712101,3sleep1988928-21diskmemload1
11374302101,3sleep00-21swapper/00
11293082101,4sleep0988928-21diskmemload0
11291722100,4sleep20-21swapper/22
11192292100,2sleep20-21swapper/22
10998922100,1sleep20-21swapper/22
10934312101,2sleep00-21swapper/00
10744062101,4sleep1988928-21diskmemload1
10743082101,4sleep2988928-21diskmemload2
10310712101,4sleep2988928-21diskmemload2
10228662101,3sleep00-21swapper/00
995513291,2sleep00-21swapper/00
962423291,3sleep1962442-21apt-get1
941522291,4sleep0943278-21grep0
931242291,4sleep1933055-21kthreadcore1
928161291,4sleep0928209-21ntpq0
902409290,3sleep172-21kcompactd01
902409290,3sleep172-21kcompactd01
891411290,5sleep1891335-31find1
862504290,1sleep10-21swapper/11
1301730291,4sleep01301795-21ld0
1276486291,4sleep01276500-21ssh0
1228643291,4sleep11230376-21grep1
1223456291,3sleep0988928-21diskmemload0
1189376291,2sleep00-21swapper/00
1179380291,2sleep00-21swapper/00
1170559291,2sleep20-21swapper/22
1147588290,3sleep0988928-21diskmemload0
1119474291,3sleep1988928-21diskmemload1
1086370291,3sleep2988928-21diskmemload2
1042218291,4sleep21042229-21ssh2
1042218291,4sleep21042229-21ssh2
1012286291,3sleep1988928-21diskmemload1
988229281,3sleep0983835-21/usr/sbin/munin0
984384281,3sleep2985049-21grep2
978210281,4sleep0978280-21systemd-run0
972171281,3sleep2972265-21sed2
949845281,3sleep00-21swapper/00
939626280,2sleep10-21swapper/11
934556281,3sleep0934580-21munin-plugin-st0
922891281,3sleep2922947-21modprobe2
891410280,4sleep0891335-31find0
885968281,3sleep1802-21snmpd1
885939280,1sleep20-21swapper/22
1338717280,2sleep00-21swapper/00
968586271,3sleep10-21swapper/11
967229270,1sleep00-21swapper/00
961753270,1sleep10-21swapper/11
958340271,3sleep0960114-21kthreadcore0
951975271,3sleep00-21swapper/00
950638270,1sleep10-21swapper/11
945158270,1sleep20-21swapper/22
939587270,1sleep20-21swapper/22
918784270,2sleep10-21swapper/11
913737271,2sleep1913951-21smartctl1
897434271,3sleep20-21swapper/22
897434271,3sleep20-21swapper/22
893508271,3sleep00-21swapper/00
875179270,1sleep10-21swapper/11
869891270,1sleep20-21swapper/22
862579270,1sleep20-21swapper/22
857537271,3sleep0857556-21apt-get0
980644261,2sleep10-21swapper/11
973412261,2sleep10-21swapper/11
961593260,1sleep20-21swapper/22
912022260,1sleep20-21swapper/22
901975260,1sleep00-21swapper/00
901975260,1sleep00-21swapper/00
892313261,2sleep10-21swapper/11
880850260,1sleep10-21swapper/11
880744260,1sleep20-21swapper/22
874455261,2sleep00-21swapper/00
865008260,2sleep10-21swapper/11
987757250,1sleep10-21swapper/11
923746250,3sleep00-21swapper/00
911500250,2sleep10-21swapper/11
896010250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional