You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 11:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Tue Jun 30, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
151366121260,2sleep00-21swapper/00
1341179212160,56sleep30-21swapper/33
134109328163,12sleep10-21swapper/11
134103228157,7sleep00-21swapper/00
134111927961,12sleep20-21swapper/22
134136899220,2cyclictest0-21swapper/33
134136899216,12cyclictest0-21swapper/33
17502332201,14sleep11750547-21grep1
134136899201,2cyclictest0-21swapper/33
1341368992011,5cyclictest0-21swapper/33
134136899201,15cyclictest0-21swapper/33
134136899200,9cyclictest1492973-21taskset3
134136899200,16cyclictest15419992sleep33
134136899194,12cyclictest0-21swapper/33
134136899193,13cyclictest0-21swapper/33
134136899192,14cyclictest66950irq/132-enp1s0-TxRx-33
134136899191,5cyclictest0-21swapper/33
1341368991913,3cyclictest66950irq/132-enp1s0-TxRx-33
1341368991912,4cyclictest0-21swapper/33
134136899191,15cyclictest0-21swapper/33
134136899191,14cyclictest0-21swapper/33
134136899191,14cyclictest0-21swapper/33
134136899191,14cyclictest0-21swapper/33
134136899191,14cyclictest0-21swapper/33
17837332181,13sleep21783746-21rm2
15985952181,13sleep21598606-21ssh2
1341368991814,2cyclictest0-21swapper/33
1341368991814,2cyclictest0-21swapper/33
1341368991814,2cyclictest0-21swapper/33
1341368991813,2cyclictest0-21swapper/33
1341368991813,2cyclictest0-21swapper/33
1341368991812,4cyclictest0-21swapper/33
1341368991811,4cyclictest0-21swapper/33
134136899181,14cyclictest0-21swapper/33
134136899181,14cyclictest0-21swapper/33
134136899181,14cyclictest0-21swapper/33
134136899181,14cyclictest0-21swapper/33
134136899181,14cyclictest0-21swapper/33
134136899181,14cyclictest0-21swapper/33
134136899181,14cyclictest0-21swapper/33
134136899181,14cyclictest0-21swapper/33
134136899181,14cyclictest0-21swapper/33
134136899181,14cyclictest0-21swapper/33
134136899181,13cyclictest0-21swapper/33
134136899181,13cyclictest0-21swapper/33
134136899181,13cyclictest0-21swapper/33
134136899181,13cyclictest0-21swapper/33
134136899181,13cyclictest0-21swapper/33
134136899181,13cyclictest0-21swapper/33
134136899180,15cyclictest0-21swapper/33
134136899180,14cyclictest0-21swapper/33
18018662171,3sleep10-21swapper/11
17684372171,3sleep00-21swapper/00
17425962171,10sleep21742815-21hddtemp_smartct2
134136899178,5cyclictest1401044-21turbostat3
134136899174,9cyclictest0-21swapper/33
134136899171,4cyclictest0-21swapper/33
1341368991714,2cyclictest0-21swapper/33
134136899171,3cyclictest0-21swapper/33
134136899171,13cyclictest0-21swapper/33
134136899171,13cyclictest0-21swapper/33
134136899170,14cyclictest0-21swapper/33
134136899170,14cyclictest0-21swapper/33
17749422160,7sleep21774955-21ssh2
17492602161,10sleep01469106-21diskmemload0
17225122161,10sleep01469106-21diskmemload0
16730262161,2sleep10-21swapper/11
16670152161,2sleep20-21swapper/22
15846712161,1sleep00-21swapper/00
15429212161,4sleep11469106-21diskmemload1
15184802160,2sleep10-21swapper/11
15010242161,6sleep01501036-21ssh0
134136899167,6cyclictest1458624-21turbostat3
134136899161,3cyclictest0-21swapper/33
1341368991613,1cyclictest0-21swapper/33
134136899161,13cyclictest0-21swapper/33
134136899160,13cyclictest0-21swapper/33
134136899160,13cyclictest0-21swapper/33
134136899160,12cyclictest0-21swapper/33
17105672151,4sleep21469106-21diskmemload2
16838202151,2sleep20-21swapper/22
16812022151,2sleep10-21swapper/11
16723032151,10sleep20-21swapper/22
16515662150,2sleep10-21swapper/11
16503342151,2sleep20-21swapper/22
16482752151,4sleep11469106-21diskmemload1
15925292151,9sleep01469106-21diskmemload0
15676632150,1sleep10-21swapper/11
15490462151,2sleep10-21swapper/11
13961972151,9sleep11396354-21diskstats1
1341368991513,1cyclictest0-21swapper/33
1341368991513,1cyclictest0-21swapper/33
1341368991512,1cyclictest0-21swapper/33
1341368991511,2cyclictest0-21swapper/33
17935222141,8sleep20-21swapper/22
17412012141,1sleep20-21swapper/22
17408252141,3sleep11740835-21ssh1
17087752140,2sleep1171rcu_preempt1
15922552141,4sleep11592268-21sh1
14065512141,9sleep01406564-21grep0
134136899143,8cyclictest0-21swapper/33
1341368991412,1cyclictest0-21swapper/33
134136899140,2cyclictest0-21swapper/33
18173062131,8sleep21817320-21ssh2
17839562131,2sleep00-21swapper/00
16673372131,7sleep01469106-21diskmemload0
16643532131,8sleep11664422-21ssh1
16307812130,3sleep01469106-21diskmemload0
16073122131,6sleep00-21swapper/00
15940362131,6sleep11594170-21diskstats1
15579272131,8sleep11557941-21ssh1
15352462131,7sleep01469106-21diskmemload0
15194502130,2sleep00-21swapper/00
15168312131,4sleep21516845-21ssh2
14656072131,7sleep21467306-21cut2
14481532131,8sleep11448268-21sed1
14324482131,8sleep01432526-21cat0
18089282121,5sleep00-21swapper/00
17672122121,3sleep11767222-21ssh1
17158612121,6sleep11469106-21diskmemload1
17019972121,7sleep21703612-21ssh2
16896482121,7sleep11689658-21ssh1
16027392121,7sleep11603552-21cat1
15768512121,5sleep11576917-21unin-run1
15325092121,7sleep11532517-21ssh1
14820492121,5sleep21482210-21grep2
14408832121,6sleep11441835-21memory1
14272112121,7sleep11-21systemd1
18170242111,4sleep01469106-21diskmemload0
18159612111,3sleep10-21swapper/11
18082202111,4sleep11469106-21diskmemload1
17776552111,2sleep10-21swapper/11
17666492111,5sleep21469106-21diskmemload2
17505512111,6sleep21751051-21cut2
17483242111,3sleep10-21swapper/11
17418892111,5sleep01469106-21diskmemload0
17236082111,4sleep20-21swapper/22
17175632111,5sleep11717774-21diskstats1
17054212111,5sleep01705656-21users0
16980732110,1sleep20-21swapper/22
16904872111,6sleep01690498-21ssh0
16563222111,5sleep01469106-21diskmemload0
16497932110,1sleep00-21swapper/00
16403282110,7sleep21640340-21rm2
16403142110,2sleep10-21swapper/11
16259352111,4sleep10-21swapper/11
16196092111,6sleep01621170-21cut0
15763272111,6sleep21576341-21ssh2
15688482111,4sleep01469106-21diskmemload0
15654792111,3sleep20-21swapper/22
15588022111,5sleep21469106-21diskmemload2
15508422111,6sleep01469106-21diskmemload0
15407052111,2sleep00-21swapper/00
15027092111,6sleep21502723-21ssh2
14933412111,1sleep10-21swapper/11
14908782111,6sleep21469106-21diskmemload2
14827732110,2sleep00-21swapper/00
14282762111,6sleep11429926-21kthreadcore1
14120512111,5sleep01412261-21hddtemp_smartct0
14117602111,4sleep10-21swapper/11
13493752111,6sleep11350116-21cut1
18027392101,4sleep21802967-21df_inode2
18000492101,2sleep00-21swapper/00
17941972101,3sleep21469106-21diskmemload2
17914542101,4sleep01469106-21diskmemload0
17867232101,5sleep11786783-21kthreadcore1
17755482101,4sleep01469106-21diskmemload0
17748892101,3sleep10-21swapper/11
17604472100,2sleep0171rcu_preempt0
17323462100,1sleep20-21swapper/22
17322852101,2sleep00-21swapper/00
17091082101,4sleep01469106-21diskmemload0
16933162101,4sleep01693396-21irqstats0
16515882101,2sleep20-21swapper/22
16407902101,3sleep00-21swapper/00
16316012101,4sleep11469106-21diskmemload1
16250492101,3sleep20-21swapper/22
16169452101,3sleep21469106-21diskmemload2
15855122101,5sleep21585517-21ssh2
15664902100,1sleep01566501-21ssh0
15575762101,4sleep01469106-21diskmemload0
15246142101,3sleep10-21swapper/11
15242262101,2sleep20-21swapper/22
15087702101,5sleep01508781-21ssh0
15083932101,4sleep11469106-21diskmemload1
15009002101,2sleep20-21swapper/22
14942982101,4sleep11469106-21diskmemload1
14909482101,4sleep01469106-21diskmemload0
14740972101,4sleep01469106-21diskmemload0
14384082101,5sleep21438512-21cat2
14327172101,2sleep20-21swapper/22
14013182101,5sleep21401382-21cpuspeed_turbos2
13855702101,3sleep00-21swapper/00
13794382101,4sleep21379630-21users2
13792542101,5sleep11379437-21sed1
13595952101,6sleep10-21swapper/11
13593072101,3sleep21359326-21apt-get2
1732385293,2sleep11732396-21ssh1
1692695291,3sleep11469106-21diskmemload1
1684573290,1sleep20-21swapper/22
1681999290,4sleep01469106-21diskmemload0
1673065291,3sleep01469106-21diskmemload0
1626641291,2sleep20-21swapper/22
1611250291,5sleep11612788-21kthreadcore1
1610956291,4sleep01611248-21kthreadcore0
1607813291,4sleep21607827-21ssh2
1593628290,2sleep00-21swapper/00
1578107291,4sleep11579608-21cut1
1576920290,1sleep20-21swapper/22
1551721291,2sleep20-21swapper/22
1536246291,3sleep21469106-21diskmemload2
1534257291,2sleep20-21swapper/22
1483422290,1sleep10-21swapper/11
1470116291,5sleep11471369-21kthreadcore1
1469733291,3sleep20-21swapper/22
1459195291,4sleep11459405-21hddtemp_smartct1
1443204291,2sleep00-21swapper/00
1432877291,3sleep01433008-21diskstats0
1423893291,5sleep01425621-21grep0
1421978291,4sleep21-21systemd2
1400268291,4sleep21400468-21timerwakeupswit2
1381315291,4sleep21382955-21cut2
1364551291,2sleep10-21swapper/11
1364545291,4sleep01364550-21sort0
1341312290,1sleep20-21swapper/22
1464130281,2sleep01464149-21apt-get0
1458900280,2sleep20-21swapper/22
1453117280,4sleep10-21swapper/11
1448713281,3sleep01448848-21expr0
1395457280,1sleep10-21swapper/11
1386180281,3sleep11387739-21kthreadcore1
1380304280,3sleep11380301-21apt-get1
1374428280,2sleep00-21swapper/00
1374424281,1sleep10-21swapper/11
1359036281,3sleep21359091-21systemd-run2
1347269281,3sleep21346798-21munin-node2
1464698271,3sleep11465606-21cut1
1454234271,3sleep01455230-21kthreadcore0
1448982271,2sleep20-21swapper/22
1442777270,1sleep00-21swapper/00
1437578270,1sleep10-21swapper/11
1422249270,2sleep20-21swapper/22
1421747270,1sleep10-21swapper/11
1417017270,2sleep00-21swapper/00
1411782271,3sleep21411884-21expr2
1406527270,1sleep20-21swapper/22
1405929270,1sleep00-21swapper/00
1401296270,1sleep10-21swapper/11
1395849271,2sleep00-21swapper/00
1391101270,2sleep21391313-21smartctl2
1387741271,3sleep20-21swapper/22
1384618271,2sleep01384862-21/usr/sbin/munin0
1375947271,2sleep00-21swapper/00
1360509271,2sleep01361407-21kthreadcore0
1354144271,3sleep10-21swapper/11
1353860271,2sleep00-21swapper/00
1346355270,1sleep00-21swapper/00
1346172270,1sleep10-21swapper/11
1455233261,2sleep10-21swapper/11
1448079260,1sleep20-21swapper/22
1432345260,1sleep20-21swapper/22
1408054261,2sleep10-21swapper/11
1391410261,2sleep00-21swapper/00
1348811260,1sleep00-21swapper/00
1458725250,2sleep00-21swapper/00
1453953250,1sleep20-21swapper/22
1373942250,1sleep20-21swapper/22
1364332250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional