You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-21 - 10:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Sun Jun 21, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
970666212356,62sleep30-21swapper/33
97050028263,12sleep20-21swapper/22
97049428062,12sleep10-21swapper/11
97054727757,14sleep00-21swapper/00
97098399231,18cyclictest1049667-21taskset3
97098399211,16cyclictest1430184-21taskset3
13919832211,7sleep11391998-21ssh1
11038852211,9sleep01103896-21ssh0
97098399205,11cyclictest1206824-21taskset3
970983992011,6cyclictest1406916-21taskset3
97098399201,15cyclictest0-21swapper/33
97098399193,14cyclictest66950irq/132-enp1s0-TxRx-33
97098399192,12cyclictest1408600-21taskset3
970983991916,2cyclictest0-21swapper/33
97098399191,5cyclictest1061622-21taskset3
97098399191,15cyclictest0-21swapper/33
97098399191,15cyclictest0-21swapper/33
97098399191,15cyclictest0-21swapper/33
97098399191,15cyclictest0-21swapper/33
97098399191,14cyclictest0-21swapper/33
97098399191,14cyclictest0-21swapper/33
97098399191,14cyclictest0-21swapper/33
97098399191,14cyclictest0-21swapper/33
97098399191,13cyclictest0-21swapper/33
97098399190,16cyclictest0-21swapper/33
97098399189,6cyclictest0-21swapper/33
97098399182,13cyclictest66950irq/132-enp1s0-TxRx-33
970983991815,2cyclictest0-21swapper/33
970983991814,2cyclictest0-21swapper/33
97098399181,14cyclictest0-21swapper/33
97098399181,14cyclictest0-21swapper/33
97098399181,14cyclictest0-21swapper/33
97098399181,14cyclictest0-21swapper/33
97098399181,14cyclictest0-21swapper/33
97098399181,14cyclictest0-21swapper/33
97098399181,14cyclictest0-21swapper/33
97098399181,14cyclictest0-21swapper/33
97098399181,14cyclictest0-21swapper/33
97098399181,13cyclictest0-21swapper/33
97098399181,13cyclictest0-21swapper/33
97098399181,13cyclictest0-21swapper/33
97098399181,13cyclictest0-21swapper/33
97098399181,13cyclictest0-21swapper/33
97098399180,3cyclictest0-21swapper/33
97098399180,15cyclictest66950irq/132-enp1s0-TxRx-33
97098399180,15cyclictest0-21swapper/33
97098399180,14cyclictest1093153-21chrt3
9714262171,5sleep2971635-21hddtemp_smartct2
97098399171,3cyclictest0-21swapper/33
97098399171,13cyclictest0-21swapper/33
97098399171,13cyclictest0-21swapper/33
97098399171,13cyclictest0-21swapper/33
97098399171,13cyclictest0-21swapper/33
97098399171,13cyclictest0-21swapper/33
97098399171,13cyclictest0-21swapper/33
97098399171,13cyclictest0-21swapper/33
97098399171,13cyclictest0-21swapper/33
970983991710,4cyclictest0-21swapper/33
97098399170,14cyclictest0-21swapper/33
97098399170,14cyclictest0-21swapper/33
14234832171,4sleep01098695-21diskmemload0
13459752171,5sleep21098695-21diskmemload2
97098399162,9cyclictest999347-21taskset3
97098399161,3cyclictest0-21swapper/33
97098399161,3cyclictest0-21swapper/33
97098399161,12cyclictest0-21swapper/33
97098399161,11cyclictest1020305-21chrt3
97098399160,13cyclictest0-21swapper/33
97098399160,13cyclictest0-21swapper/33
14156582161,3sleep20-21swapper/22
13224952161,10sleep21322506-21ssh2
13023312168,4sleep1331ktimers/11
11621222161,2sleep20-21swapper/22
97098399150,13cyclictest0-21swapper/33
97098399150,12cyclictest0-21swapper/33
97098399150,12cyclictest0-21swapper/33
13778942151,3sleep20-21swapper/22
12705522150,1sleep20-21swapper/22
12472012151,3sleep11098695-21diskmemload1
12366632152,8sleep01098695-21diskmemload0
12306372151,3sleep11098695-21diskmemload1
97098399140,12cyclictest0-21swapper/33
97098399140,11cyclictest10412972sleep33
14228062140,3sleep10-21swapper/11
14054212141,8sleep01405431-21ssh0
13911072140,2sleep2421rcuc/22
13719582140,1sleep00-21swapper/00
13717782140,3sleep11098695-21diskmemload1
13314872142,8sleep21098695-21diskmemload2
12902632141,3sleep21098695-21diskmemload2
12642882141,8sleep11264300-21ssh1
12560792141,9sleep01256130-2190
12466412141,8sleep01098695-21diskmemload0
12220872141,3sleep11098695-21diskmemload1
11789842147,3sleep01178997-21rm0
11297332141,4sleep21129744-21ssh2
10627972141,8sleep11063388-21cut1
10520592141,9sleep21052156-21grep2
97098399138,3cyclictest10302152sleep33
14405992131,3sleep21440602-21ssh2
14399912131,7sleep01098695-21diskmemload0
14235712131,3sleep21423576-21ssh2
13196912131,8sleep11319702-21ssh1
13029262131,6sleep00-21swapper/00
12640822131,8sleep01098695-21diskmemload0
12621572131,4sleep21262171-21ssh2
12560092131,2sleep10-21swapper/11
12154322131,8sleep01215493-21fschecks_count0
11974922131,8sleep11098695-21diskmemload1
11558062131,6sleep00-21swapper/00
11218412131,7sleep11121852-21ssh1
11205982131,8sleep21120609-21ssh2
10925392131,7sleep11092658-21find1
9889242121,5sleep1989177-21df1
14474122121,5sleep10-21swapper/11
13834392122,4sleep11383467-21apt-get1
13569582121,7sleep01357138-21if_err_enp1s00
13531872120,2sleep21098695-21diskmemload2
13232302122,4sleep21323258-21apt-get2
12707132121,6sleep01098695-21diskmemload0
12393692121,7sleep21239380-21ssh2
11973032121,1sleep00-21swapper/00
11897362121,6sleep11098695-21diskmemload1
11891282121,7sleep21189142-21ssh2
11547242121,5sleep10-21swapper/11
11473062121,5sleep10-21swapper/11
11328512121,7sleep21134295-21cut2
11114752123,5sleep21111544-21ls2
10363242121,6sleep11036462-21grep1
9961282111,6sleep1996201-21kthreadcore1
9717092111,6sleep0972999-21cut0
14472742112,4sleep21098695-21diskmemload2
14157402110,2sleep11415754-21ssh1
14064052111,6sleep21406415-21ssh2
13979702111,4sleep21098695-21diskmemload2
13794662111,5sleep01098695-21diskmemload0
13785992111,5sleep10-21swapper/11
13315722111,5sleep01331574-21apt-get0
13106282111,5sleep21310703-21ntp_states2
12976722111,5sleep10-21swapper/11
12870302111,6sleep01287043-21ssh0
12811282111,5sleep11281252-21cat1
12791492111,5sleep01098695-21diskmemload0
12482242111,5sleep21248487-21df2
12302772111,5sleep21230291-21ssh2
12233722111,5sleep01223384-21apt-get0
11984432110,4sleep10-21swapper/11
11952372111,7sleep21195249-21sh2
11880032111,5sleep01098695-21diskmemload0
11809792110,3sleep20-21swapper/22
11791402111,3sleep10-21swapper/11
11725722111,4sleep01098695-21diskmemload0
11639992111,5sleep11098695-21diskmemload1
11484602111,5sleep01148539-21munin-run0
11471232110,5sleep20-21swapper/22
11322132112,4sleep11132216-21apt-get1
11125442111,4sleep01098695-21diskmemload0
10832212111,5sleep11083223-21apt-get1
10465652111,5sleep11046562-21apt-get1
10271302111,6sleep11028840-21kthreadcore1
10202842111,4sleep21020302-21apt-get2
10098382111,5sleep01010097-21df_inode0
9994802101,4sleep0999615-21diskstats0
9877572101,5sleep2555-21dbus-daemon2
9761812101,4sleep0976441-21users0
14463482101,4sleep01446601-21ssh0
14300642100,3sleep10-21swapper/11
14133432101,4sleep01413346-21ssh0
13878112101,3sleep01381053-40sort0
13717392100,6sleep21371753-21ssh2
13627492101,4sleep10-21swapper/11
13548162101,3sleep00-21swapper/00
13460142101,3sleep10-21swapper/11
13374132100,1sleep10-21swapper/11
13299382100,1sleep00-21swapper/00
13122692101,4sleep01098695-21diskmemload0
13015192101,4sleep21302107-21memory2
12952002101,4sleep01295211-21ssh0
12830892101,5sleep11283695-21kthreadcore1
12780652101,5sleep21278076-21ssh2
12697892101,3sleep10-21swapper/11
12404592101,5sleep21241537-21cut2
12383682101,4sleep11238378-21ssh1
12207382100,6sleep21220749-21sh2
12137542101,4sleep11098695-21diskmemload1
12119332101,3sleep20-21swapper/22
12067182101,4sleep01098695-21diskmemload0
11984262101,4sleep01198441-21ssh0
11574412101,2sleep00-21swapper/00
11390452101,2sleep00-21swapper/00
11301982101,3sleep10-21swapper/11
11237172101,3sleep00-21swapper/00
11222842101,3sleep00-21swapper/00
11122372100,1sleep10-21swapper/11
11052952100,2sleep10-21swapper/11
11045132101,3sleep20-21swapper/22
10964332101,4sleep01097572-21memory0
10934272101,5sleep01093596-21cat0
10826392105,2sleep10-21swapper/11
10775652100,2sleep10-21swapper/11
10676702101,4sleep11067793-21diskstats1
10504512101,6sleep01050563-21/usr/sbin/munin0
10322422101,5sleep01033918-21cut0
10252672100,1sleep10-21swapper/11
10036612101,4sleep21003909-21users2
999616291,4sleep1999825-21hddtemp_smartct1
978912291,4sleep2979141-21cut2
978394291,4sleep1978398-21find1
1441201290,3sleep10-21swapper/11
1430651291,2sleep20-21swapper/22
1425164291,2sleep00-21swapper/00
1405291290,1sleep10-21swapper/11
1397253290,2sleep00-21swapper/00
1363181290,3sleep21098695-21diskmemload2
1352946291,2sleep11098695-21diskmemload1
1339800290,1sleep00-21swapper/00
1323550290,1sleep10-21swapper/11
1320815291,2sleep00-21swapper/00
1314015291,3sleep11098695-21diskmemload1
1288661291,2sleep20-21swapper/22
1203879290,3sleep20-21swapper/22
1165289291,4sleep10-21swapper/11
1156331291,3sleep21098695-21diskmemload2
1082609290,1sleep20-21swapper/22
1072468291,4sleep00-21swapper/00
1057023291,2sleep00-21swapper/00
1041290291,3sleep21041008-21apt-get2
1029562290,1sleep20-21swapper/22
1019757290,1sleep20-21swapper/22
1015073291,4sleep01015258-21expr0
1005164291,4sleep01006594-21kthreadcore0
992963281,3sleep2993086-21mailstats2
988580280,1sleep00-21swapper/00
984242281,3sleep10-21swapper/11
971236281,3sleep1971425-21diskstats1
1165957281,3sleep21166368-21cut2
1098394280,1sleep20-21swapper/22
1091696281,3sleep21092340-21/usr/sbin/munin2
1076893281,3sleep21077038-21switchtime2
1066653280,1sleep00-21swapper/00
1057838281,3sleep11059456-21grep1
1040883281,5sleep2970978-21cyclictest2
1036032281,3sleep01036034-21sendmail0
1035482280,2sleep20-21swapper/22
1025216280,1sleep00-21swapper/00
1006595281,3sleep11008369-21tr1
994697272,1sleep0251irq_work/00
988909270,2sleep00-21swapper/00
1088114270,1sleep00-21swapper/00
1084064271,2sleep20-21swapper/22
1072740270,3sleep01072758-21apt-get0
1067310271,2sleep20-21swapper/22
1066887270,1sleep20-21swapper/22
1051799271,2sleep00-21swapper/00
1046188270,1sleep10-21swapper/11
1025583271,3sleep00-21swapper/00
1012851270,4sleep10-21swapper/11
1009814270,2sleep20-21swapper/22
1008849271,3sleep21009108-21unixbench_singl2
998979262,2sleep2970978-21cyclictest2
1098408260,4sleep10-21swapper/11
1061976260,3sleep20-21swapper/22
1052934261,2sleep10-21swapper/11
1047974261,2sleep20-21swapper/22
1046032260,1sleep00-21swapper/00
1035625260,1sleep10-21swapper/11
1019751260,4sleep10-21swapper/11
1077820240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional