You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-28 - 04:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Sat Mar 28, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
782997212953,72sleep30-21swapper/33
78778928354,14sleep00-21swapper/00
78769228172,6sleep10-21swapper/11
78778627760,11sleep20-21swapper/22
788152992813,12cyclictest0-21swapper/33
788152992723,2cyclictest0-21swapper/33
7883072261,12sleep2788326-21apt-get2
788152992321,1cyclictest0-21swapper/33
78815299231,18cyclictest0-21swapper/33
78815299224,14cyclictest1206078-21taskset3
78815299222,16cyclictest0-21swapper/33
788152992220,1cyclictest0-21swapper/33
788152992219,2cyclictest0-21swapper/33
78815299216,12cyclictest0-21swapper/33
78815299215,14cyclictest0-21swapper/33
78815299213,14cyclictest66950irq/132-enp1s0-TxRx-33
788152992119,1cyclictest0-21swapper/33
788152992119,1cyclictest0-21swapper/33
788152992119,1cyclictest0-21swapper/33
788152992119,1cyclictest0-21swapper/33
788152992118,2cyclictest0-21swapper/33
788152992118,1cyclictest0-21swapper/33
788152992118,1cyclictest0-21swapper/33
788152992117,2cyclictest0-21swapper/33
788152992111,7cyclictest995003-21taskset3
78815299211,16cyclictest0-21swapper/33
11917312210,2sleep20-21swapper/22
788152992018,1cyclictest0-21swapper/33
788152992018,1cyclictest0-21swapper/33
788152992017,1cyclictest0-21swapper/33
788152992017,1cyclictest0-21swapper/33
788152992017,1cyclictest0-21swapper/33
788152992016,2cyclictest0-21swapper/33
788152992016,2cyclictest0-21swapper/33
788152992016,2cyclictest0-21swapper/33
788152992016,2cyclictest0-21swapper/33
788152992016,2cyclictest0-21swapper/33
788152992016,2cyclictest0-21swapper/33
788152992013,3cyclictest1136760-21taskset3
78815299201,16cyclictest0-21swapper/33
78815299201,14cyclictest0-21swapper/33
788152991917,1cyclictest0-21swapper/33
788152991917,1cyclictest0-21swapper/33
788152991915,2cyclictest0-21swapper/33
788152991915,2cyclictest0-21swapper/33
788152991914,2cyclictest0-21swapper/33
788152991914,2cyclictest0-21swapper/33
788152991910,6cyclictest907933-21turbostat3
788152991910,6cyclictest907933-21turbostat3
10841592191,3sleep20-21swapper/22
9721542181,5sleep0972424-21df_inode0
788152991816,1cyclictest0-21swapper/33
788152991815,1cyclictest0-21swapper/33
788152991814,2cyclictest0-21swapper/33
788152991813,2cyclictest0-21swapper/33
788152991813,2cyclictest0-21swapper/33
10406712181,3sleep10-21swapper/11
9497682171,5sleep0949828-21ntpq0
8803292171,5sleep1880378-21ntpq1
788152991715,1cyclictest0-21swapper/33
788152991714,1cyclictest0-21swapper/33
788152991714,1cyclictest0-21swapper/33
788152991713,2cyclictest0-21swapper/33
788152991713,2cyclictest0-21swapper/33
788152991713,2cyclictest0-21swapper/33
788152991713,2cyclictest0-21swapper/33
788152991713,2cyclictest0-21swapper/33
788152991712,2cyclictest0-21swapper/33
788152991712,2cyclictest0-21swapper/33
78815299171,13cyclictest0-21swapper/33
78815299170,13cyclictest0-21swapper/33
12591272171,3sleep20-21swapper/22
12349202171,5sleep2918879-21diskmemload2
11464982171,6sleep1918879-21diskmemload1
11368352171,4sleep1918879-21diskmemload1
9938462161,11sleep0993911-21sh0
9879532160,2sleep20-21swapper/22
9545042160,3sleep1954509-21cut1
9357872161,3sleep10-21swapper/11
9073672161,10sleep2907552-21users2
9073672161,10sleep2907552-21users2
78815299163,2cyclictest0-21swapper/33
788152991614,1cyclictest0-21swapper/33
788152991614,1cyclictest0-21swapper/33
788152991613,1cyclictest0-21swapper/33
788152991613,1cyclictest0-21swapper/33
788152991613,1cyclictest0-21swapper/33
78815299160,13cyclictest0-21swapper/33
12684532161,9sleep2918879-21diskmemload2
11536362161,2sleep00-21swapper/00
11103552161,2sleep10-21swapper/11
10497262161,4sleep1918879-21diskmemload1
10491182161,2sleep20-21swapper/22
10400022161,11sleep01040013-21ssh0
9966122151,5sleep1996626-21ssh1
8176002150,3sleep20-21swapper/22
788152991513,1cyclictest0-21swapper/33
12872892151,9sleep2918879-21diskmemload2
12507152151,9sleep01250728-21ssh0
11028872151,3sleep1918879-21diskmemload1
10937332151,9sleep1918879-21diskmemload1
10554362151,8sleep01055493-21ntpq0
10149252151,4sleep11014940-21ssh1
10067392151,2sleep00-21swapper/00
10067392151,2sleep00-21swapper/00
9717302141,6sleep1971811-21unin-run1
8910552141,9sleep1891141-21awk1
8704302140,1sleep10-21swapper/11
12178002141,3sleep2918879-21diskmemload2
11727732141,2sleep00-21swapper/00
11249882140,3sleep1918879-21diskmemload1
10947612141,8sleep2918879-21diskmemload2
10776672141,3sleep01077696-21apt-get0
10757172141,6sleep10-21swapper/11
10327732141,2sleep1918879-21diskmemload1
10116982141,4sleep21011779-21ssh2
9323262131,8sleep2932338-21ssh2
9016432131,7sleep0901699-21ntpq0
12687372131,8sleep01268752-21ssh0
12336712131,6sleep00-21swapper/00
12152972131,7sleep1918879-21diskmemload1
11981132131,8sleep01198124-21ssh0
11126382131,8sleep01112731-21ls0
10210852131,7sleep11021096-21ssh1
9809012121,5sleep0981161-21df0
9715652121,4sleep00-21swapper/00
9620172121,5sleep00-21swapper/00
9434652121,6sleep1918879-21diskmemload1
8659962121,7sleep0866168-21/usr/sbin/munin0
8544862120,1sleep10-21swapper/11
12605382121,7sleep11260549-21ssh1
12160992121,2sleep00-21swapper/00
11798232121,5sleep00-21swapper/00
11356542121,6sleep0918879-21diskmemload0
10852652121,7sleep11085279-21sh1
10767082121,6sleep2918879-21diskmemload2
10575942121,5sleep1918879-21diskmemload1
10214012121,7sleep21021413-21sshd2
9989812111,6sleep1999677-21cat1
9989812111,6sleep1999677-21cat1
9984082111,5sleep2998676-21df_inode2
9984082111,5sleep2998676-21df_inode2
9870712111,3sleep10-21swapper/11
9770542111,6sleep1977067-21sh1
9632792110,7sleep2963291-21ssh2
9498302111,5sleep1949897-21ntp_states1
9234522111,5sleep1923502-21ntpq1
9155082116,2sleep00-21swapper/00
8650982110,1sleep00-21swapper/00
8643462111,5sleep2864401-21ntpq2
8550732111,5sleep0855196-21diskstats0
8442552111,5sleep0844274-21apt-get0
8376982111,5sleep0837754-21ntpq0
8292342111,6sleep0830949-21grep0
12872232111,4sleep1918879-21diskmemload1
12843422111,5sleep01284410-21ntpq0
12791102111,7sleep01279120-21ssh0
12781602114,3sleep2421rcuc/22
12755532111,5sleep11275616-21ssh1
12689972111,4sleep1918879-21diskmemload1
12511402111,2sleep10-21swapper/11
12426192111,4sleep2918879-21diskmemload2
12068002110,6sleep0918879-21diskmemload0
11987312111,4sleep1918879-21diskmemload1
11912022111,6sleep01191216-21ssh0
11728962111,3sleep20-21swapper/22
11726352111,7sleep11172650-21ssh1
11612902111,5sleep11161347-21ntpq1
11564992111,5sleep1918879-21diskmemload1
11182102111,4sleep2918879-21diskmemload2
11176302111,7sleep134-21ksoftirqd/11
11032282111,3sleep00-21swapper/00
10729142111,5sleep01072970-21ntpq0
10655072111,4sleep1918879-21diskmemload1
10487932110,3sleep01048805-21ssh0
10310222111,3sleep00-21swapper/00
10211252110,3sleep00-21swapper/00
9786372100,1sleep20-21swapper/22
9520962101,4sleep2918879-21diskmemload2
9418842101,5sleep2918879-21diskmemload2
9283672101,3sleep00-21swapper/00
9242072101,4sleep2918879-21diskmemload2
9142482101,4sleep2914364-21irqstats2
9125612101,5sleep2912611-21gcc2
9069512101,5sleep0906983-21ntpq0
9069512101,5sleep0906983-21ntpq0
8855692101,4sleep2885626-21ntpq2
8818512101,4sleep1882061-21hddtemp_smartct1
8643032101,4sleep1864344-21ntpq1
8522842101,4sleep2853488-21memory2
8391872101,4sleep1839293-21perl1
8338642101,5sleep1833989-21cut1
8229732101,4sleep2823228-21df2
8110432101,4sleep0811090-21ntpq0
12408632101,4sleep1918879-21diskmemload1
12345102101,4sleep1918879-21diskmemload1
12246152101,4sleep1918879-21diskmemload1
12184502101,3sleep2918879-21diskmemload2
12051592101,4sleep11205208-21ntpq1
11875692100,7sleep11187616-21ssh1
11799592101,3sleep2918879-21diskmemload2
11523182101,4sleep21152462-21ntpq2
11283352101,3sleep20-21swapper/22
11233312101,6sleep01124987-21grep0
11186922101,6sleep01118706-21ssh0
11018732101,3sleep20-21swapper/22
10943822101,2sleep00-21swapper/00
10677872101,4sleep00-21swapper/00
10363642101,4sleep21037410-21memory2
10252032101,3sleep20-21swapper/22
997579291,3sleep2918879-21diskmemload2
958667291,4sleep2958760-21ssh2
941291290,3sleep00-21swapper/00
926814291,4sleep0926826-21sh0
892787291,4sleep2893673-21grep2
888357291,4sleep0890137-21grep0
872823293,3sleep2874659-21kthreadcore2
871511291,4sleep1872821-21cut1
844861291,4sleep1846467-21grep1
838429290,2sleep20-21swapper/22
826839290,3sleep0826980-21ntpq0
812286291,3sleep0812305-21apt-get0
806653291,3sleep2806412-21apt-get2
801912291,4sleep2803331-21grep2
1257204291,3sleep0918879-21diskmemload0
1245012290,3sleep2918879-21diskmemload2
1243469291,2sleep00-21swapper/00
1206175291,2sleep2918879-21diskmemload2
1197988291,2sleep20-21swapper/22
1174355291,3sleep1918879-21diskmemload1
1164917291,2sleep20-21swapper/22
1157625291,4sleep01158009-21grep0
1144532290,2sleep21144544-21ssh2
1139249291,3sleep01139273-21apt-get0
1109609291,3sleep20-21swapper/22
1056774291,4sleep21056788-21ssh2
1015217291,2sleep00-21swapper/00
903351281,3sleep1903422-21irqstats1
903351281,3sleep1903422-21irqstats1
901701280,4sleep1901786-21ps1
897526280,3sleep2897545-21apt-get2
883665281,3sleep0885409-21sed0
880946280,1sleep00-21swapper/00
821976281,3sleep0822100-21cat0
801055281,3sleep2801305-21sed2
796273281,3sleep0796388-21fschecks_time0
1224999281,2sleep00-21swapper/00
1134679281,3sleep21134727-21ntpq2
1060593281,3sleep21060642-21kthreadcore2
913276270,1sleep00-21swapper/00
908988271,2sleep1909174-21kthreadcore1
897046270,1sleep00-21swapper/00
896980270,1sleep10-21swapper/11
876241270,2sleep20-21swapper/22
870937271,2sleep00-21swapper/00
870562270,1sleep20-21swapper/22
859637270,1sleep10-21swapper/11
854907270,2sleep20-21swapper/22
854649271,2sleep00-21swapper/00
849145270,1sleep20-21swapper/22
843002271,3sleep00-21swapper/00
822951270,2sleep10-21swapper/11
807216271,2sleep10-21swapper/11
806309270,1sleep10-21swapper/11
805816270,4sleep00-21swapper/00
800729272,3sleep1331ktimers/11
788607270,4sleep1788826-21idleruntime1
918541260,1sleep10-21swapper/11
890800260,2sleep20-21swapper/22
828528261,2sleep10-21swapper/11
813623261,2sleep10-21swapper/11
842825250,1sleep20-21swapper/22
821506250,1sleep10-21swapper/11
815371250,1sleep20-21swapper/22
828575240,1sleep20-21swapper/22
788013240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional