You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-20 - 21:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Thu Aug 20, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
112072021960,4sleep1321rcuc/11
121419921360,2sleep10-21swapper/11
102198221350,2sleep00-21swapper/00
799043212368,51sleep30-21swapper/33
798847210789,11sleep20-21swapper/22
79881629059,12sleep10-21swapper/11
79894027751,17sleep00-21swapper/00
8701382430,2sleep00-21swapper/00
79920599251,14cyclictest0-21swapper/33
12241442230,4sleep0205-21jbd2/sda2-80
11859072239,6sleep21185920-21diskmemload2
79920599222,15cyclictest1041008-21chrt3
79920599222,14cyclictest1241287-21chrt3
9363902216,10sleep1936653-21df1
79920599211,17cyclictest0-21swapper/33
79920599211,16cyclictest0-21swapper/33
8224832201,6sleep0822744-21df_inode0
79920599202,12cyclictest1198133-21taskset3
79920599201,6cyclictest11249712sleep33
79920599201,15cyclictest0-21swapper/33
79920599201,15cyclictest0-21swapper/33
12415822201,6sleep11241794-21hddtemp_smartct1
10793512201,13sleep21079959-21sed2
79920599193,13cyclictest0-21swapper/33
799205991916,1cyclictest0-21swapper/33
79920599191,15cyclictest66950irq/132-enp1s0-TxRx-33
79920599191,15cyclictest66950irq/132-enp1s0-TxRx-33
79920599191,15cyclictest0-21swapper/33
79920599191,15cyclictest0-21swapper/33
79920599191,15cyclictest0-21swapper/33
79920599191,15cyclictest0-21swapper/33
79920599191,15cyclictest0-21swapper/33
79920599191,14cyclictest0-21swapper/33
79920599191,14cyclictest0-21swapper/33
79920599191,14cyclictest0-21swapper/33
79920599191,14cyclictest0-21swapper/33
79920599191,12cyclictest0-21swapper/33
11518182191,2sleep00-21swapper/00
8963412181,12sleep1896550-21hddtemp_smartct1
79920599181,6cyclictest864175-21taskset3
799205991812,3cyclictest0-21swapper/33
79920599181,14cyclictest66950irq/132-enp1s0-TxRx-33
79920599181,14cyclictest0-21swapper/33
79920599181,14cyclictest0-21swapper/33
79920599181,14cyclictest0-21swapper/33
79920599181,14cyclictest0-21swapper/33
79920599181,14cyclictest0-21swapper/33
79920599181,14cyclictest0-21swapper/33
79920599181,13cyclictest0-21swapper/33
79920599181,13cyclictest0-21swapper/33
79920599181,13cyclictest0-21swapper/33
79920599180,15cyclictest0-21swapper/33
79920599180,14cyclictest0-21swapper/33
11189472181,3sleep00-21swapper/00
799205991715,1cyclictest0-21swapper/33
79920599171,13cyclictest0-21swapper/33
79920599171,13cyclictest0-21swapper/33
79920599171,13cyclictest0-21swapper/33
79920599171,13cyclictest0-21swapper/33
79920599171,13cyclictest0-21swapper/33
79920599171,13cyclictest0-21swapper/33
79920599171,13cyclictest0-21swapper/33
79920599171,13cyclictest0-21swapper/33
79920599170,13cyclictest0-21swapper/33
79920599170,13cyclictest0-21swapper/33
12233482172,7sleep2106713-21snmpd2
11806322172,8sleep11180745-21perl1
11452582171,5sleep11145518-21latency_hist1
11020402179,3sleep1927305-21diskmemload1
9331422161,2sleep10-21swapper/11
79920599161,12cyclictest0-21swapper/33
79920599161,12cyclictest0-21swapper/33
79920599160,13cyclictest0-21swapper/33
79920599160,13cyclictest0-21swapper/33
79920599160,13cyclictest0-21swapper/33
79920599160,13cyclictest0-21swapper/33
79920599160,13cyclictest0-21swapper/33
79920599160,13cyclictest0-21swapper/33
79920599160,12cyclictest817218-21taskset3
12756422161,10sleep0927305-21diskmemload0
12408452161,2sleep20-21swapper/22
11629812161,4sleep0927305-21diskmemload0
11354562161,3sleep10-21swapper/11
10994622160,1sleep00-21swapper/00
10235802161,2sleep10-21swapper/11
9844572151,2sleep20-21swapper/22
8273512150,1sleep20-21swapper/22
799205991512,2cyclictest0-21swapper/33
79920599150,2cyclictest0-21swapper/33
79920599150,13cyclictest0-21swapper/33
79920599150,13cyclictest0-21swapper/33
79920599150,12cyclictest0-21swapper/33
12743152151,8sleep1927305-21diskmemload1
12412262151,9sleep01241236-21ssh0
12396492151,2sleep10-21swapper/11
12329262151,8sleep01233147-21hddtemp_smartct0
12034202151,8sleep0927305-21diskmemload0
10651442151,3sleep11065147-21sh1
10136452151,8sleep072-21kcompactd00
79920599140,11cyclictest0-21swapper/33
79920599140,11cyclictest0-21swapper/33
79920599140,11cyclictest0-21swapper/33
12665832141,3sleep01266585-21ssh0
11772502140,3sleep1927305-21diskmemload1
11347072141,8sleep2927305-21diskmemload2
10825002141,7sleep0927305-21diskmemload0
10748722140,3sleep00-21swapper/00
10400112142,6sleep2927305-21diskmemload2
10397842141,8sleep0927305-21diskmemload0
10315592140,2sleep00-21swapper/00
10026802141,7sleep0927305-21diskmemload0
9800012131,3sleep1980015-21ssh1
9613152131,8sleep0961328-21sh0
8770832131,4sleep1878692-21cut1
8539852131,4sleep2853767-21sendmail-msp2
79920599131,8cyclictest854978-21taskset3
12847282131,4sleep20-21swapper/22
12725792131,8sleep21272593-21ssh2
12663532130,2sleep20-21swapper/22
12564912131,8sleep0927305-21diskmemload0
12412522132,5sleep21241276-21apt-get2
12304102131,6sleep2927305-21diskmemload2
11510362131,7sleep1927305-21diskmemload1
11408302131,8sleep01141003-21ssh0
11271592131,6sleep2927305-21diskmemload2
11267172131,8sleep0927305-21diskmemload0
10148912131,7sleep21014906-21ssh2
9783022121,2sleep20-21swapper/22
9713182122,4sleep1971346-21apt-get1
9675942121,6sleep2927305-21diskmemload2
9625712122,5sleep1962568-21apt-get1
9443292121,4sleep00-21swapper/00
9117722122,5sleep1911791-21apt-get1
8870912121,7sleep1888337-21cut1
12926802121,5sleep10-21swapper/11
12846802121,6sleep0927305-21diskmemload0
12043432121,5sleep134-21ksoftirqd/11
11625812121,7sleep11153912-21sh1
10659182121,5sleep20-21swapper/22
10565002121,7sleep11056514-21ssh1
10045652121,5sleep10-21swapper/11
9802092111,5sleep0980343-21diskstats0
9783822112,4sleep0927305-21diskmemload0
9589792110,1sleep10-21swapper/11
9511862110,1sleep00-21swapper/00
9176002110,7sleep0918723-21cut0
9065442111,5sleep0906562-21apt-get0
9017912111,4sleep1901907-21irqstats1
8531642111,7sleep1853328-21/usr/sbin/munin1
8165832111,6sleep1816585-21modprobe1
8051722111,5sleep1806410-21hddtemp_smartct1
12320782111,2sleep10-21swapper/11
12207792111,6sleep01220790-21ssh0
11962602111,4sleep2927305-21diskmemload2
11951702111,4sleep1927305-21diskmemload1
11718502111,5sleep21171990-21diskstats2
11701602111,5sleep2927305-21diskmemload2
11617222111,6sleep21161733-21ssh2
11513212110,2sleep20-21swapper/22
11418452110,7sleep21141856-21ssh2
11281562110,1sleep00-21swapper/00
11186192111,4sleep2927305-21diskmemload2
11020032111,6sleep21102014-21ssh2
10907552111,6sleep21090769-21ssh2
10901742111,4sleep1927305-21diskmemload1
10828812110,1sleep10-21swapper/11
10746912111,4sleep2927305-21diskmemload2
10683202111,6sleep11069885-21cut1
10476592111,4sleep0927305-21diskmemload0
10409772111,3sleep20-21swapper/22
10384682110,2sleep10-21swapper/11
9970212101,3sleep00-21swapper/00
9969452101,3sleep20-21swapper/22
9679872101,4sleep0927305-21diskmemload0
9538152101,3sleep2953838-21apt-get2
9505342101,4sleep2950548-21ssh2
9429112101,3sleep2927305-21diskmemload2
9338502101,4sleep0927305-21diskmemload0
9171962101,4sleep1917317-21diskstats1
8791182101,5sleep0879173-21/usr/sbin/munin0
8520752100,1sleep00-21swapper/00
8172202101,4sleep0817239-21apt-get0
8172072101,4sleep1816921-21apt-get1
12833102101,3sleep10-21swapper/11
12808632101,2sleep20-21swapper/22
12748272101,3sleep0927305-21diskmemload0
12502012101,4sleep21250417-21hddtemp_smartct2
12208862101,2sleep10-21swapper/11
11933512101,5sleep01193476-21awk0
11812982103,3sleep01182821-21kthreadcore0
11716822101,3sleep00-21swapper/00
11678452101,3sleep1927305-21diskmemload1
11597012101,4sleep0927305-21diskmemload0
11169682100,1sleep10-21swapper/11
11042172101,5sleep01104269-21kthreadcore0
11006132100,1sleep20-21swapper/22
10987112100,1sleep10-21swapper/11
10584202101,2sleep00-21swapper/00
10564572100,3sleep20-21swapper/22
10548372101,2sleep00-21swapper/00
10473692101,2sleep10-21swapper/11
10203072101,2sleep10-21swapper/11
10118492100,1sleep10-21swapper/11
10116052101,3sleep2927305-21diskmemload2
10023902100,6sleep21002402-21ssh2
995156291,4sleep1995170-21ssh1
945036290,1sleep10-21swapper/11
927709291,3sleep2927712-21apt-get2
921889290,1sleep20-21swapper/22
900201291,4sleep0900346-21cut0
894733290,1sleep20-21swapper/22
891082291,4sleep1891292-21hddtemp_smartct1
885203290,4sleep10-21swapper/11
869778291,2sleep1869780-21apt-get1
863547294,2sleep00-21swapper/00
856440291,4sleep0857899-21latency0
841038291,4sleep2842153-21memory2
826696291,4sleep1826918-21sed1
811891290,1sleep20-21swapper/22
804431291,4sleep0805171-21cat0
803739291,3sleep1803983-21/usr/sbin/munin1
799898291,4sleep2800222-21cat2
1263847291,3sleep1927305-21diskmemload1
1255079291,2sleep10-21swapper/11
1212426291,3sleep20-21swapper/22
1206486291,2sleep00-21swapper/00
1199757291,4sleep21201427-21kthreadcore2
1084612292,3sleep04192556-21in:imuxsock0
1023651290,3sleep20-21swapper/22
901627281,3sleep0901339-21/usr/sbin/munin0
878694281,3sleep2874796-21sendmail-msp2
869279280,1sleep10-21swapper/11
864540280,2sleep20-21swapper/22
859903281,3sleep2860759-21cut2
843501280,2sleep00-21swapper/00
833531281,3sleep1834000-21kthreadcore1
832970280,3sleep2832751-21sendmail-msp2
821917280,1sleep20-21swapper/22
922345271,3sleep00-21swapper/00
922311270,1sleep20-21swapper/22
915521270,2sleep0915757-21strings0
911794271,2sleep20-21swapper/22
901908270,3sleep2901943-21kthreadcore2
892650271,2sleep0894370-21kthreadcore0
886127271,2sleep00-21swapper/00
884988270,3sleep00-21swapper/00
880318270,2sleep20-21swapper/22
874588270,1sleep20-21swapper/22
869438270,1sleep00-21swapper/00
863221270,3sleep10-21swapper/11
853994271,2sleep1854013-21apt-get1
849311271,2sleep20-21swapper/22
848314270,1sleep20-21swapper/22
843497270,1sleep10-21swapper/11
843078270,1sleep00-21swapper/00
842871270,1sleep10-21swapper/11
832978271,2sleep0833001-21apt-get0
827714270,2sleep20-21swapper/22
810854270,4sleep20-21swapper/22
922320260,4sleep10-21swapper/11
911168260,1sleep20-21swapper/22
885551260,1sleep20-21swapper/22
811867260,1sleep00-21swapper/00
911370250,2sleep10-21swapper/11
895756250,1sleep20-21swapper/22
830558250,2sleep00-21swapper/00
827693250,1sleep10-21swapper/11
799651250,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional