You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-27 - 15:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Thu Aug 27, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
125284921310,2sleep20-21swapper/22
773259212972,53sleep30-21swapper/33
9517952950,2sleep20-21swapper/22
77302328669,11sleep10-21swapper/11
77323228264,12sleep20-21swapper/22
77322028252,7sleep00-21swapper/00
12484182261,2sleep00-21swapper/00
9777982241,16sleep0978069-21/usr/sbin/munin0
773439992318,2cyclictest0-21swapper/33
773439992218,2cyclictest0-21swapper/33
773439992210,7cyclictest1223721-21turbostat3
11030222222,15sleep2901661-21diskmemload2
77343999210,17cyclictest0-21swapper/33
12040662211,3sleep00-21swapper/00
12040662211,3sleep00-21swapper/00
8016932201,9sleep2801749-21/usr/sbin/munin2
77343999202,13cyclictest960807-21taskset3
773439992012,5cyclictest0-21swapper/33
77343999201,16cyclictest0-21swapper/33
773439992011,5cyclictest66950irq/132-enp1s0-TxRx-33
77343999201,15cyclictest1026694-21taskset3
11308752201,3sleep10-21swapper/11
8897582191,13sleep0890042-21cat0
77343999194,13cyclictest0-21swapper/33
77343999191,15cyclictest0-21swapper/33
77343999191,14cyclictest0-21swapper/33
77343999191,14cyclictest0-21swapper/33
77343999191,14cyclictest0-21swapper/33
77343999191,14cyclictest0-21swapper/33
77343999191,14cyclictest0-21swapper/33
12388072191,8sleep11238821-21ssh1
10346182191,14sleep01034628-21ssh0
10259252191,3sleep00-21swapper/00
9660992181,4sleep0901661-21diskmemload0
77343999186,8cyclictest1054435-21taskset3
773439991815,1cyclictest0-21swapper/33
77343999181,14cyclictest66950irq/132-enp1s0-TxRx-33
77343999181,14cyclictest66950irq/132-enp1s0-TxRx-33
77343999181,14cyclictest0-21swapper/33
77343999181,14cyclictest0-21swapper/33
77343999181,14cyclictest0-21swapper/33
77343999181,14cyclictest0-21swapper/33
77343999181,14cyclictest0-21swapper/33
77343999181,14cyclictest0-21swapper/33
77343999181,13cyclictest0-21swapper/33
77343999181,13cyclictest0-21swapper/33
77343999180,15cyclictest66950irq/132-enp1s0-TxRx-33
77343999180,14cyclictest0-21swapper/33
77343999180,14cyclictest0-21swapper/33
12138202181,5sleep0901661-21diskmemload0
9862152171,6sleep1985930-21sendmail-msp1
8744462171,12sleep1874516-21ls1
77343999171,4cyclictest0-21swapper/33
773439991713,2cyclictest0-21swapper/33
773439991713,2cyclictest0-21swapper/33
77343999171,14cyclictest0-21swapper/33
77343999171,13cyclictest0-21swapper/33
77343999171,13cyclictest0-21swapper/33
77343999171,13cyclictest0-21swapper/33
77343999171,13cyclictest0-21swapper/33
77343999171,13cyclictest0-21swapper/33
77343999171,13cyclictest0-21swapper/33
77343999171,12cyclictest0-21swapper/33
77343999170,14cyclictest0-21swapper/33
77343999170,14cyclictest0-21swapper/33
77343999170,14cyclictest0-21swapper/33
77343999170,14cyclictest0-21swapper/33
77343999170,14cyclictest0-21swapper/33
77343999170,13cyclictest0-21swapper/33
77343999170,13cyclictest0-21swapper/33
11975002171,6sleep2901661-21diskmemload2
11311932171,11sleep01131369-21grep0
9346542160,2sleep00-21swapper/00
86454621612,2sleep2848836-21kworker/2:2+events_freezable2
77343999169,4cyclictest806984-21sleep3
773439991613,1cyclictest0-21swapper/33
77343999161,13cyclictest0-21swapper/33
77343999161,12cyclictest0-21swapper/33
773439991610,4cyclictest0-21swapper/33
77343999160,3cyclictest0-21swapper/33
77343999160,13cyclictest0-21swapper/33
77343999160,13cyclictest0-21swapper/33
77343999160,13cyclictest0-21swapper/33
77343999160,13cyclictest0-21swapper/33
77343999160,13cyclictest0-21swapper/33
77343999160,13cyclictest0-21swapper/33
11119952161,10sleep2901661-21diskmemload2
10933432160,2sleep01093354-21ssh0
10805062166,6sleep01081386-21cut0
9607752152,5sleep20-21swapper/22
9257902150,1sleep20-21swapper/22
773439991511,2cyclictest0-21swapper/33
77343999150,13cyclictest0-21swapper/33
77343999150,12cyclictest0-21swapper/33
77343999150,12cyclictest0-21swapper/33
12151932151,9sleep21215257-21munin-run2
11144912151,4sleep11115999-21ssh1
11113772151,2sleep00-21swapper/00
10034042152,8sleep01003428-21apt-get0
9834702141,9sleep1983483-21ssh1
9594962141,7sleep2901661-21diskmemload2
9565502141,4sleep1956707-21/usr/sbin/munin1
9182052141,3sleep2901661-21diskmemload2
773439991411,2cyclictest0-21swapper/33
773439991410,2cyclictest0-21swapper/33
11985832141,7sleep2901661-21diskmemload2
11985832141,7sleep2901661-21diskmemload2
11961992141,8sleep0901661-21diskmemload0
11642812141,4sleep11164417-21cut1
11536792140,4sleep2901661-21diskmemload2
11393662142,6sleep01139382-21apt-get0
11023702142,8sleep0901661-21diskmemload0
9923862131,3sleep2992401-21ssh2
9834842131,8sleep2983497-21sh2
9098172131,2sleep20-21swapper/22
8636552131,8sleep0863819-21cut0
8279222131,8sleep1828050-21cat1
7871382131,8sleep239542-21systemd-journal2
773439991310,1cyclictest0-21swapper/33
12407462131,8sleep21240754-21ssh2
12247992131,4sleep21226246-21kthreadcore2
11468592131,8sleep11146873-21ssh1
11202572131,4sleep21120270-21ssh2
11053902132,5sleep11105392-21apt-get1
10733892131,2sleep00-21swapper/00
10500862131,6sleep21050141-21ntp_states2
10168042131,7sleep1901661-21diskmemload1
9759292122,6sleep0901661-21diskmemload0
9433322121,7sleep1943554-21cat1
9237862121,7sleep1901661-21diskmemload1
8287752121,3sleep1829416-21kthreadcore1
8125352122,5sleep0812553-21apt-get0
12571172128,1sleep00-21swapper/00
12162372121,7sleep21217751-21kthreadcore2
11868382121,3sleep11186848-21ssh1
11868382121,3sleep11186848-21ssh1
11540502121,2sleep01154061-21ssh0
10870532121,7sleep11087063-21ssh1
10591122121,7sleep21054095-21sendmail-msp2
10352172121,7sleep11035230-21ssh1
9758902111,5sleep1901661-21diskmemload1
9502812110,1sleep00-21swapper/00
9433262111,5sleep0901661-21diskmemload0
9335062111,3sleep20-21swapper/22
9321332111,4sleep1901661-21diskmemload1
9175822111,4sleep0901661-21diskmemload0
9106372111,6sleep1910793-21cstates1
8653532111,4sleep2865565-21hddtemp_smartct2
8497672111,6sleep0850004-21kthreadcore0
8353902111,6sleep0837126-21grep0
8229632112,4sleep2822982-21apt-get2
8226882111,6sleep2822815-21latency_hist2
8177762111,5sleep0818035-21df_inode0
8075262111,6sleep2807640-21fschecks_time2
7960652110,1sleep00-21swapper/00
7809482111,5sleep0781151-21diskstats0
7737432111,5sleep0773890-21diskstats0
12487912111,6sleep21248805-21ssh2
12399522110,3sleep00-21swapper/00
12071352112,4sleep11207148-21apt-get1
11772292111,5sleep01177311-21ntp_states0
11710132111,5sleep1901661-21diskmemload1
11560972111,6sleep01155869-21sendmail-msp0
11383932111,3sleep20-21swapper/22
11303722110,7sleep11130386-21ssh1
11271962111,6sleep0901661-21diskmemload0
11027172116,1sleep1901661-21diskmemload1
10945892111,4sleep2901661-21diskmemload2
10906532111,6sleep11092247-21kthreadcore1
10770002111,4sleep20-21swapper/22
10707582111,2sleep10-21swapper/11
10703142110,7sleep0901661-21diskmemload0
10607982111,3sleep00-21swapper/00
10519552111,4sleep0901661-21diskmemload0
10417042111,6sleep01041843-21systemctl0
10252922111,4sleep1901661-21diskmemload1
10186682111,4sleep2901661-21diskmemload2
10006702111,4sleep2901661-21diskmemload2
9918302101,4sleep0901661-21diskmemload0
9740672101,2sleep20-21swapper/22
9088162101,3sleep00-21swapper/00
9024022101,5sleep1902514-21fschecks_time1
8969682101,4sleep1897075-21perl1
8916692101,6sleep1891736-21fschecks_count1
8913822100,1sleep00-21swapper/00
8756312101,3sleep2875650-21apt-get2
8335132101,3sleep20-21swapper/22
8072272102,1sleep00-21swapper/00
8019672101,4sleep1801986-21apt-get1
7911672101,4sleep1791223-21munin-run1
7738912101,4sleep1774100-21hddtemp_smartct1
12549532103,3sleep10-21swapper/11
12483902101,4sleep1901661-21diskmemload1
12310722101,4sleep0901661-21diskmemload0
12296682101,2sleep10-21swapper/11
12219952101,3sleep10-21swapper/11
12195032101,3sleep01219693-21strings0
11987872101,4sleep11199012-21df_inode1
11987872101,4sleep11199012-21df_inode1
11877712101,5sleep21187783-21ssh2
11877712101,5sleep21187783-21ssh2
11867722101,4sleep0901661-21diskmemload0
11867722101,4sleep0901661-21diskmemload0
11788072101,4sleep2901661-21diskmemload2
11730892101,4sleep1901661-21diskmemload1
11653152101,6sleep21166769-21tr2
11634172100,6sleep21163431-21ssh2
11557862100,3sleep10-21swapper/11
11207122101,2sleep00-21swapper/00
10830092100,6sleep2901661-21diskmemload2
10689582101,4sleep2901661-21diskmemload2
10532322100,4sleep10-21swapper/11
10430462101,5sleep1901661-21diskmemload1
10374372101,4sleep21037456-21apt-get2
10340612101,4sleep2901661-21diskmemload2
10254542101,3sleep2901661-21diskmemload2
10095412101,4sleep2901661-21diskmemload2
10091952101,5sleep11009209-21ssh1
10024032101,2sleep00-21swapper/00
10018242100,4sleep1901661-21diskmemload1
965767291,5sleep1901661-21diskmemload1
957476291,4sleep0957489-21ssh0
944017291,5sleep1944047-21fschecks_count1
941625291,4sleep2941639-21ssh2
919016291,4sleep0919219-21diskstats0
886156291,3sleep2886352-21expr2
880888291,4sleep2881044-21cstates2
870330291,4sleep0870108-21sendmail-msp0
859826291,2sleep10-21swapper/11
843983290,3sleep2844001-21apt-get2
839889291,4sleep1841543-21grep1
838763291,3sleep0838765-21apt-get0
813358291,4sleep1814966-21cut1
801391290,2sleep10-21swapper/11
786107292,3sleep089-1kworker/0:1H-kblockd0
780862291,3sleep2780881-21apt-get2
773600290,3sleep2773619-21apt-get2
1194262291,2sleep10-21swapper/11
1170912291,4sleep0901661-21diskmemload0
1145117291,4sleep21145128-21ssh2
1127170291,3sleep21121986-21sendmail-msp2
1076655291,4sleep1901661-21diskmemload1
1059740291,5sleep10-21swapper/11
1016969291,2sleep00-21swapper/00
886134281,2sleep10-21swapper/11
849526281,2sleep24192556-21in:imuxsock2
843703281,3sleep2843730-21latency_hist2
807233280,4sleep1807236-21sshd-auth1
793242280,5sleep2794982-21cut2
779046281,3sleep1780239-21cut1
897958271,2sleep00-21swapper/00
885509270,1sleep10-21swapper/11
880477270,1sleep00-21swapper/00
880434270,1sleep10-21swapper/11
869756270,1sleep10-21swapper/11
869740270,1sleep00-21swapper/00
850005271,2sleep10-21swapper/11
848921270,1sleep00-21swapper/00
848911270,1sleep10-21swapper/11
838259272,3sleep1331ktimers/11
833142270,1sleep20-21swapper/22
833006271,3sleep0833008-21modprobe0
821993271,3sleep10-21swapper/11
817223271,2sleep24191614-21gpm2
806650270,1sleep00-21swapper/00
801495270,1sleep00-21swapper/00
796145270,1sleep10-21swapper/11
891388260,2sleep20-21swapper/22
872357261,2sleep20-21swapper/22
859263260,1sleep00-21swapper/00
827585260,4sleep00-21swapper/00
802529260,2sleep2802572-21kthreadcore2
901052250,1sleep20-21swapper/22
854824250,2sleep10-21swapper/11
854527250,1sleep20-21swapper/22
881160240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional