You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 14:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Mon Mar 23, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
606151211656,55sleep30-21swapper/33
60631828555,11sleep10-21swapper/11
60617328158,6sleep00-21swapper/00
60565128061,11sleep20-21swapper/22
8157342340,2sleep10-21swapper/11
606547992318,3cyclictest0-21swapper/33
60654799231,18cyclictest0-21swapper/33
606547992213,6cyclictest9820832sleep33
60654799221,17cyclictest0-21swapper/33
8878372219,8sleep2889486-21tr2
60654799211,3cyclictest0-21swapper/33
60654799211,16cyclictest743042-21taskset3
8838602200,2sleep20-21swapper/22
60654799201,7cyclictest989857-21taskset3
60654799201,16cyclictest0-21swapper/33
60654799201,15cyclictest0-21swapper/33
60654799201,15cyclictest0-21swapper/33
60654799200,18cyclictest0-21swapper/33
60654799191,5cyclictest769846-21taskset3
60654799191,15cyclictest0-21swapper/33
60654799191,15cyclictest0-21swapper/33
60654799191,15cyclictest0-21swapper/33
60654799191,15cyclictest0-21swapper/33
60654799191,15cyclictest0-21swapper/33
60654799191,14cyclictest66950irq/132-enp1s0-TxRx-33
60654799191,14cyclictest0-21swapper/33
60654799191,14cyclictest0-21swapper/33
60654799191,14cyclictest0-21swapper/33
60654799191,14cyclictest0-21swapper/33
60654799191,14cyclictest0-21swapper/33
7815742181,12sleep2781215-21/usr/sbin/munin2
606547991812,4cyclictest720764-21chrt3
60654799181,14cyclictest0-21swapper/33
60654799181,14cyclictest0-21swapper/33
60654799181,14cyclictest0-21swapper/33
60654799181,14cyclictest0-21swapper/33
60654799181,14cyclictest0-21swapper/33
60654799181,14cyclictest0-21swapper/33
60654799181,14cyclictest0-21swapper/33
60654799181,14cyclictest0-21swapper/33
60654799181,14cyclictest0-21swapper/33
60654799181,14cyclictest0-21swapper/33
60654799181,14cyclictest0-21swapper/33
60654799181,14cyclictest0-21swapper/33
60654799181,14cyclictest0-21swapper/33
60654799181,14cyclictest0-21swapper/33
60654799181,13cyclictest705056-21turbostat3
60654799181,13cyclictest0-21swapper/33
60654799180,14cyclictest0-21swapper/33
10846092181,3sleep00-21swapper/00
10233392180,9sleep1736922-21diskmemload1
10185392181,13sleep01018790-21cut0
9549242171,12sleep1954935-21ssh1
8381382171,10sleep1838195-21ntpq1
7438782171,4sleep1736922-21diskmemload1
6942762170,1sleep10-21swapper/11
606547991715,1cyclictest0-21swapper/33
606547991715,1cyclictest0-21swapper/33
60654799171,14cyclictest0-21swapper/33
606547991711,3cyclictest0-21swapper/33
60654799171,13cyclictest0-21swapper/33
60654799171,13cyclictest0-21swapper/33
9957452161,9sleep1995837-21ntpq1
8650662161,4sleep2736922-21diskmemload2
8071892161,2sleep00-21swapper/00
8061792161,2sleep10-21swapper/11
7767362160,7sleep10-21swapper/11
60654799161,13cyclictest0-21swapper/33
60654799161,12cyclictest0-21swapper/33
60654799161,12cyclictest0-21swapper/33
60654799160,13cyclictest0-21swapper/33
10686542161,4sleep01068668-21ssh0
10322902162,9sleep1736922-21diskmemload1
10322902162,9sleep1736922-21diskmemload1
9898302150,1sleep10-21swapper/11
9885402151,9sleep0988551-21fwupd0
9170412151,7sleep0917101-21ntpq0
9033162151,4sleep2736922-21diskmemload2
60654799151,3cyclictest0-21swapper/33
606547991512,1cyclictest0-21swapper/33
60654799151,11cyclictest0-21swapper/33
60654799150,13cyclictest0-21swapper/33
60654799150,13cyclictest0-21swapper/33
60654799150,13cyclictest0-21swapper/33
60654799150,12cyclictest0-21swapper/33
60654799150,12cyclictest0-21swapper/33
60654799150,12cyclictest0-21swapper/33
60654799150,11cyclictest0-21swapper/33
10851842151,3sleep1736922-21diskmemload1
10534562151,10sleep10-21swapper/11
9902022141,9sleep2990216-21ssh2
8953272141,8sleep1736922-21diskmemload1
8940762141,2sleep00-21swapper/00
8669432142,8sleep1736922-21diskmemload1
8230992141,3sleep1736922-21diskmemload1
7807542141,8sleep2736922-21diskmemload2
7801312141,9sleep0780146-21ssh0
60654799149,2cyclictest0-21swapper/33
606547991411,2cyclictest0-21swapper/33
606547991410,2cyclictest0-21swapper/33
60654799140,2cyclictest0-21swapper/33
60654799140,2cyclictest0-21swapper/33
60654799140,11cyclictest0-21swapper/33
10076212140,3sleep1736922-21diskmemload1
9812472131,5sleep00-21swapper/00
9739782130,2sleep10-21swapper/11
9727452131,8sleep0972759-21ssh0
9447672131,2sleep1944780-21ssh1
9284962130,2sleep00-21swapper/00
8746532131,3sleep2874664-21ssh2
8739292131,7sleep1736922-21diskmemload1
8222512131,7sleep2736922-21diskmemload2
8153372130,3sleep2815351-21ssh2
8031712131,6sleep2803226-21ntpq2
7720612131,8sleep2772072-21ssh2
7040632131,6sleep2704112-21ntpq2
6667842131,6sleep1666825-21ntpq1
606547991310,2cyclictest0-21swapper/33
60654799130,11cyclictest0-21swapper/33
11041622130,2sleep1736922-21diskmemload1
10965322131,5sleep20-21swapper/22
10930272131,3sleep11093040-21ssh1
10681082131,8sleep1736922-21diskmemload1
10523912131,3sleep01052405-21ssh0
10411102131,8sleep1736922-21diskmemload1
9992752120,3sleep2999290-21ssh2
9975762121,7sleep0997588-21ssh0
9565482121,5sleep1956573-21apt-get1
9445992121,7sleep0944614-21ssh0
9293212121,6sleep1736922-21diskmemload1
9208552121,7sleep1920866-21ssh1
8620362121,7sleep0863752-21cut0
8292762121,6sleep2829366-21ntpq2
7422352121,5sleep00-21swapper/00
7146192121,5sleep2714660-21ntpq2
6883852121,7sleep0688536-21cat0
6454732121,5sleep0645519-21ntpq0
6407372121,3sleep1555-21dbus-daemon1
6081092124,4sleep1609829-21grep1
6081092124,4sleep1609829-21grep1
10611292121,7sleep0736922-21diskmemload0
10300272121,7sleep21030690-21grep2
10300272121,7sleep21030690-21grep2
10102452121,7sleep11011880-21tr1
9794642111,5sleep20-21swapper/22
9729292110,2sleep20-21swapper/22
9643892111,7sleep00-21swapper/00
9471622111,3sleep20-21swapper/22
9381782111,4sleep2736922-21diskmemload2
9302792111,4sleep00-21swapper/00
9116022111,3sleep00-21swapper/00
9113032111,4sleep1736922-21diskmemload1
9040262111,5sleep2904053-21apt-get2
8838512111,4sleep1736922-21diskmemload1
8513352111,5sleep0851597-21df0
8487012110,2sleep1848713-21ssh1
8456082111,5sleep2846638-21memory2
8338392111,5sleep2736922-21diskmemload2
7944872110,7sleep0794557-21ssh0
7873632111,3sleep10-21swapper/11
7633712111,3sleep00-21swapper/00
7526922111,4sleep00-21swapper/00
7460772111,5sleep2746341-21df2
7459462111,4sleep1736922-21diskmemload1
7437932111,4sleep2736922-21diskmemload2
7265792111,5sleep0726831-21df0
7164722111,6sleep2717495-21kthreadcore2
7054002111,5sleep0705603-21diskstats0
6987662111,5sleep2698823-21ntp_states2
6827402111,5sleep0682787-21ntpq0
6736532111,5sleep2673865-21hddtemp_smartct2
6735292111,5sleep1673652-21diskstats1
6721352111,6sleep0672184-21ntpq0
6397822111,6sleep2639829-21ntpq2
6344772111,5sleep2634523-21ntpq2
6118172111,5sleep0611840-21munin-run0
6118172111,5sleep0611840-21munin-run0
10877952112,4sleep01087823-21apt-get0
10616212111,5sleep21061876-21df2
10573892111,3sleep20-21swapper/22
10507802111,5sleep1736922-21diskmemload1
10483102111,4sleep21048368-21ntpq2
10154762111,6sleep21015490-21ssh2
10070142111,4sleep00-21swapper/00
9797042101,4sleep1736922-21diskmemload1
9572842101,5sleep2958646-21ssh2
9553722101,3sleep00-21swapper/00
9550432102,4sleep2886534-21kworker/u16:0+rpciod2
9362892104,3sleep10-21swapper/11
9011232101,3sleep00-21swapper/00
8576142101,3sleep10-21swapper/11
8304322101,3sleep00-21swapper/00
8251542101,2sleep10-21swapper/11
8142452100,3sleep00-21swapper/00
7983682100,7sleep1798379-21sh1
7958442101,4sleep2736922-21diskmemload2
7869522100,1sleep00-21swapper/00
7705712101,4sleep00-21swapper/00
7704722101,3sleep1736922-21diskmemload1
7549302101,4sleep2736922-21diskmemload2
7212782100,1sleep20-21swapper/22
7200362101,6sleep0720085-21pmu-power0
7056042101,5sleep1705770-21tr1
6630282101,4sleep2663237-21hddtemp_smartct2
6571262101,4sleep0657174-21munin-run0
6449402101,5sleep2645253-40gst-plugin-scan2
6414342101,4sleep190-21kswapd01
6344242101,5sleep1634475-21ntpq1
6291832101,4sleep0629239-21ntpq0
6238302101,4sleep2623880-21ntpq2
6192132106,2sleep00-21swapper/00
6192132106,2sleep00-21swapper/00
6146922101,4sleep2614901-21hddtemp_smartct2
6146922101,4sleep2614901-21hddtemp_smartct2
6098302101,5sleep2610657-21missed_timers2
6098302101,5sleep2610657-21missed_timers2
11009482101,5sleep01101101-21mailstats0
10945632101,4sleep2736922-21diskmemload2
10843422101,4sleep2736922-21diskmemload2
10760362100,3sleep00-21swapper/00
10709692102,4sleep21071768-21tr2
10424022100,2sleep00-21swapper/00
10240092101,4sleep2736922-21diskmemload2
10160662101,4sleep01016076-21ssh0
10056062101,3sleep20-21swapper/22
922160291,4sleep2922530-21cut2
919594291,2sleep20-21swapper/22
886429291,3sleep1886439-21ssh1
883577290,2sleep00-21swapper/00
874777290,3sleep00-21swapper/00
851652291,5sleep2851879-21idleruntime2
842575290,3sleep00-21swapper/00
833940291,4sleep0834165-21expr0
824268290,6sleep0824281-21rm0
761135290,3sleep1736922-21diskmemload1
684031290,4sleep20-21swapper/22
663308291,4sleep0664449-21tr0
640865291,4sleep0640792-31find0
619335291,4sleep1619336-21sshd1
619335291,4sleep1619336-21sshd1
1070358291,5sleep11070389-21apt1
1041929290,1sleep20-21swapper/22
1031563291,3sleep01026644-21/usr/sbin/munin0
1031563291,3sleep01026644-21/usr/sbin/munin0
732145281,3sleep1732276-21grep1
694640280,3sleep0694659-21apt-get0
694379281,3sleep2694394-21latency_hist2
673939281,3sleep0675309-21kthreadcore0
662405280,1sleep20-21swapper/22
661437280,4sleep0661484-21ntpq0
652129281,3sleep1652284-21cstates1
635378280,1sleep00-21swapper/00
625080280,3sleep2625099-21apt-get2
623647280,1sleep00-21swapper/00
736209271,3sleep00-21swapper/00
731859271,3sleep2731869-21find2
731282270,1sleep20-21swapper/22
726005270,1sleep10-21swapper/11
720851270,1sleep10-21swapper/11
715423270,1sleep00-21swapper/00
705310270,1sleep20-21swapper/22
695476271,3sleep1696733-21kthreadcore1
682584271,3sleep2678679-21/usr/sbin/munin2
672896270,1sleep10-21swapper/11
656434271,3sleep2656443-21switchtime2
650979271,3sleep1651117-21grep1
646760270,3sleep20-21swapper/22
620255271,3sleep1620417-21cat1
730669260,2sleep10-21swapper/11
726114260,1sleep00-21swapper/00
704780260,2sleep0704781-21pool-udisksd0
683456260,1sleep10-21swapper/11
658619261,2sleep10-21swapper/11
651557260,1sleep00-21swapper/00
629957260,1sleep10-21swapper/11
704677250,1sleep10-21swapper/11
693504250,2sleep00-21swapper/00
688845250,3sleep10-21swapper/11
668475250,1sleep20-21swapper/22
710899240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional