You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 09:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Wed May 20, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
638628211858,54sleep30-21swapper/33
64345428470,9sleep10-21swapper/11
64341627860,12sleep20-21swapper/22
64346427757,14sleep00-21swapper/00
64386699261,20cyclictest1132832-21turbostat3
643866992513,8cyclictest800751-21sleep3
64386699215,13cyclictest0-21swapper/33
64386699214,13cyclictest998924-21taskset3
64386699211,17cyclictest0-21swapper/33
7986552201,3sleep20-21swapper/22
64386699201,7cyclictest905631-21taskset3
643866992015,3cyclictest0-21swapper/33
643866992015,3cyclictest0-21swapper/33
643866992012,5cyclictest699027-21taskset3
64386699201,16cyclictest0-21swapper/33
64386699201,15cyclictest1078859-21taskset3
64386699201,15cyclictest0-21swapper/33
64386699201,15cyclictest0-21swapper/33
64386699201,14cyclictest1098313-21chrt3
64386699191,5cyclictest790788-21taskset3
64386699191,15cyclictest0-21swapper/33
64386699191,14cyclictest0-21swapper/33
64386699191,14cyclictest0-21swapper/33
64386699191,14cyclictest0-21swapper/33
64386699190,7cyclictest888046-21taskset3
64386699189,5cyclictest693915-21turbostat3
643866991812,3cyclictest0-21swapper/33
64386699181,14cyclictest938008-21chrt3
64386699181,14cyclictest0-21swapper/33
64386699181,14cyclictest0-21swapper/33
64386699181,14cyclictest0-21swapper/33
64386699181,14cyclictest0-21swapper/33
64386699181,14cyclictest0-21swapper/33
64386699181,14cyclictest0-21swapper/33
64386699181,13cyclictest0-21swapper/33
64386699181,13cyclictest0-21swapper/33
64386699180,2cyclictest0-21swapper/33
10686092181,3sleep10-21swapper/11
10501042181,3sleep20-21swapper/22
9412912171,3sleep10-21swapper/11
9232292171,2sleep00-21swapper/00
8241692171,3sleep20-21swapper/22
643866991714,2cyclictest0-21swapper/33
643866991713,2cyclictest0-21swapper/33
64386699171,14cyclictest0-21swapper/33
64386699171,13cyclictest1035362-21taskset3
64386699171,13cyclictest0-21swapper/33
64386699171,13cyclictest0-21swapper/33
64386699171,13cyclictest0-21swapper/33
64386699171,13cyclictest0-21swapper/33
64386699171,10cyclictest889030-21taskset3
64386699170,14cyclictest0-21swapper/33
64386699170,14cyclictest0-21swapper/33
64386699170,14cyclictest0-21swapper/33
64386699170,13cyclictest0-21swapper/33
10961142171,3sleep10-21swapper/11
7799922162,4sleep2774243-21diskmemload2
64386699164,9cyclictest731293-21turbostat3
64386699161,3cyclictest0-21swapper/33
64386699161,3cyclictest0-21swapper/33
643866991612,2cyclictest0-21swapper/33
64386699161,14cyclictest0-21swapper/33
64386699161,13cyclictest0-21swapper/33
64386699161,13cyclictest0-21swapper/33
643866991610,3cyclictest0-21swapper/33
64386699160,13cyclictest0-21swapper/33
64386699160,13cyclictest0-21swapper/33
64386699160,13cyclictest0-21swapper/33
10151162161,9sleep21015172-21ntpq2
8984772151,4sleep2899635-21cut2
8343272151,4sleep10-21swapper/11
7582532151,5sleep0758266-21latency_hist0
64386699150,13cyclictest0-21swapper/33
64386699150,12cyclictest0-21swapper/33
64386699150,12cyclictest0-21swapper/33
64386699150,12cyclictest0-21swapper/33
64386699150,12cyclictest0-21swapper/33
11318242151,2sleep20-21swapper/22
11043642150,11sleep11104377-21rm1
10772822151,3sleep00-21swapper/00
10624382151,3sleep0774243-21diskmemload0
10356802151,3sleep10-21swapper/11
10259172150,3sleep10-21swapper/11
9805212141,5sleep1980658-21systemctl1
9745452141,8sleep10-21swapper/11
9660672141,2sleep00-21swapper/00
9567252141,8sleep0774243-21diskmemload0
9454302141,8sleep2945581-21ntp_192.168.1142
9192822141,2sleep10-21swapper/11
9136952140,3sleep10-21swapper/11
9039912141,4sleep1904002-21ssh1
8461172141,9sleep1847737-21cut1
8067172140,2sleep10-21swapper/11
7629202141,3sleep1758511-21/usr/sbin/munin1
7268272140,2sleep20-21swapper/22
64386699148,3cyclictest672419-21chrt3
64386699141,2cyclictest0-21swapper/33
643866991411,2cyclictest0-21swapper/33
64386699140,2cyclictest0-21swapper/33
64386699140,11cyclictest0-21swapper/33
11157192141,8sleep172-21kcompactd01
11025792141,9sleep01102640-21ntpq0
10009322142,8sleep0774243-21diskmemload0
9890592131,8sleep2989119-21/usr/sbin/munin2
9406022131,2sleep1774243-21diskmemload1
8719972131,8sleep1872094-21cut1
8600192131,7sleep00-21swapper/00
7039992131,7sleep1704184-21users1
6525162131,9sleep10-21swapper/11
64386699131,2cyclictest0-21swapper/33
64386699130,10cyclictest752329-21chrt3
11157522131,6sleep21116017-21df2
10852242131,3sleep1774243-21diskmemload1
10798542130,2sleep20-21swapper/22
10792362131,3sleep11079247-21ssh1
10436742131,7sleep1774243-21diskmemload1
10341272131,8sleep21034137-21ssh2
10324682131,6sleep01032530-21ntpq0
9976902121,6sleep2997784-21ntpq2
9905772121,6sleep0774243-21diskmemload0
9661852122,2sleep2171rcu_preempt2
9314952121,5sleep00-21swapper/00
8804542121,2sleep00-21swapper/00
8419222121,3sleep0841933-21ssh0
8116202121,7sleep2813294-21grep2
8066222121,5sleep20-21swapper/22
7626262121,6sleep0762680-21ntpq0
7192902121,5sleep2719472-21memory2
6941792121,6sleep0694434-21df0
11400072121,3sleep1774243-21diskmemload1
11316622121,7sleep11131677-21ssh1
10982862121,5sleep2774243-21diskmemload2
10440902121,7sleep2774243-21diskmemload2
9916362111,5sleep1774243-21diskmemload1
9831962111,5sleep2774243-21diskmemload2
9756882111,4sleep0774243-21diskmemload0
9543122111,5sleep1954362-21ntpq1
9381492111,7sleep2938160-21ssh2
9315212111,3sleep20-21swapper/22
9295042111,2sleep10-21swapper/11
9111522111,7sleep2911415-21unixbench_singl2
8705562110,1sleep20-21swapper/22
8626492111,7sleep1862661-21rm1
8580972112,4sleep2858195-21ntpq2
8429392111,2sleep10-21swapper/11
8325812110,3sleep2832595-21ssh2
8052152111,5sleep0805279-21ntpq0
7980902111,3sleep10-21swapper/11
7682182111,6sleep0768452-21sed0
7526152111,5sleep2753090-21awk2
7360242111,5sleep0736237-21users0
7087402111,4sleep1708881-21ntpq1
6969782111,7sleep1698054-21memory1
6837662111,5sleep0683976-21hddtemp_smartct0
6727902111,4sleep0672809-21apt-get0
6660372111,5sleep0666178-21ntpq0
6621372111,5sleep2662398-21df_inode2
6481622111,4sleep0648208-21ntpq0
6481622111,4sleep0648208-21ntpq0
11249872111,5sleep01125084-21irqstats0
11231532110,6sleep00-21swapper/00
11130952110,1sleep20-21swapper/22
10694282110,8sleep21069443-21ssh2
10248902111,5sleep0774243-21diskmemload0
10248122111,6sleep2774243-21diskmemload2
10175062111,4sleep00-21swapper/00
10079892111,4sleep2774243-21diskmemload2
9807102101,5sleep0980896-21sed0
9558482101,3sleep20-21swapper/22
9490372101,3sleep00-21swapper/00
9394862101,4sleep0774243-21diskmemload0
9215002101,2sleep20-21swapper/22
9023862101,5sleep0902592-21/usr/sbin/munin0
8879782101,3sleep20-21swapper/22
8774162101,3sleep20-21swapper/22
8770392101,4sleep0774243-21diskmemload0
8706262101,2sleep00-21swapper/00
8589562101,4sleep1774243-21diskmemload1
8520242101,2sleep20-21swapper/22
8505262101,4sleep0774243-21diskmemload0
8414872101,2sleep20-21swapper/22
8259482101,3sleep00-21swapper/00
8245112101,2sleep10-21swapper/11
8154542101,4sleep0774243-21diskmemload0
8142532101,3sleep10-21swapper/11
7985322101,4sleep0774243-21diskmemload0
7914482101,4sleep0774243-21diskmemload0
7902782101,2sleep20-21swapper/22
7836302101,3sleep10-21swapper/11
7792432100,1sleep00-21swapper/00
7427852101,4sleep2743682-21grep2
7259652101,4sleep2725987-21munin-run2
7196102101,4sleep0719651-21ntpq0
7098172101,3sleep20-21swapper/22
7035452101,4sleep2703595-21ntpq2
6888392101,4sleep2689097-21df_inode2
6834952101,5sleep2683669-21cstates2
6723162100,3sleep072-21kcompactd00
6626822101,5sleep1662718-21kthreadcore1
6573222101,5sleep1657968-21kthreadcore1
6542302101,4sleep2655326-21memory2
11409422100,1sleep00-21swapper/00
11393192101,3sleep20-21swapper/22
11070232101,3sleep0774243-21diskmemload0
10973052101,4sleep0774243-21diskmemload0
10885462101,5sleep01088558-21ssh0
10810832101,2sleep20-21swapper/22
10694562101,4sleep0774243-21diskmemload0
10607942100,2sleep11060808-21ssh1
10514122101,4sleep1774243-21diskmemload1
10502802101,3sleep00-21swapper/00
10166182101,3sleep10-21swapper/11
10022992101,5sleep01002332-21rm0
10017452101,4sleep11001759-21ssh1
906449291,3sleep0774243-21diskmemload0
894096291,2sleep00-21swapper/00
891731291,4sleep1893132-21ssh1
889487291,4sleep2889709-21if_enp1s02
879982291,3sleep1880308-21ssh1
834116291,5sleep0834124-21sh0
779872291,3sleep10-21swapper/11
774234291,4sleep1774317-21rm1
774234291,4sleep1774317-21rm1
769738294,2sleep2656184-21kworker/2:0-events2
769738294,2sleep2656184-21kworker/2:0-events2
747524291,3sleep1747543-21apt-get1
732097291,4sleep1732772-21kthreadcore1
731281291,4sleep1731284-21cron1
731265290,1sleep00-21swapper/00
703658291,4sleep0703718-21grep0
1106925291,4sleep11106936-21ssh1
1095371290,3sleep2774243-21diskmemload2
1062316291,2sleep20-21swapper/22
1045321291,2sleep00-21swapper/00
1008825291,4sleep11008836-21ssh1
971504281,2sleep20-21swapper/22
963764281,3sleep1963776-21ssh1
747211280,2sleep00-21swapper/00
735621280,3sleep20-21swapper/22
720436280,1sleep10-21swapper/11
688515280,1sleep10-21swapper/11
678700281,3sleep20-21swapper/22
661855281,3sleep2661896-21systemd-run2
763862270,2sleep20-21swapper/22
763260270,1sleep20-21swapper/22
747096270,1sleep10-21swapper/11
736868270,2sleep20-21swapper/22
714421271,3sleep10-21swapper/11
688818270,2sleep10-21swapper/11
678419271,3sleep0678595-21gltestperf0
677623270,1sleep10-21swapper/11
672270270,1sleep20-21swapper/22
656316270,1sleep00-21swapper/00
648255270,1sleep20-21swapper/22
648255270,1sleep20-21swapper/22
648210270,2sleep10-21swapper/11
648210270,2sleep10-21swapper/11
767746260,2sleep10-21swapper/11
748590261,2sleep20-21swapper/22
741849260,1sleep00-21swapper/00
741013260,2sleep10-21swapper/11
710499261,2sleep0710702-21gltestperf0
692767260,1sleep00-21swapper/00
676926260,2sleep20-21swapper/22
753730251,1sleep10-21swapper/11
752552250,3sleep00-21swapper/00
725097250,1sleep10-21swapper/11
723747250,1sleep00-21swapper/00
710228250,1sleep20-21swapper/22
705099250,2sleep00-21swapper/00
670310250,1sleep10-21swapper/11
769456240,1sleep00-21swapper/00
769456240,1sleep00-21swapper/00
694505240,1sleep20-21swapper/22
678130240,1sleep10-21swapper/11
657130240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional