You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 08:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Mon Apr 06, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1176134212058,55sleep30-21swapper/33
117618427962,11sleep20-21swapper/22
117588127857,14sleep00-21swapper/00
117589227656,10sleep10-21swapper/11
117636599291,7cyclictest16015592sleep33
117636599221,13cyclictest0-21swapper/33
117636599215,13cyclictest1535135-21turbostat3
117636599211,7cyclictest1558844-21taskset3
1176365992111,7cyclictest1497441-21taskset3
117636599211,16cyclictest66950irq/132-enp1s0-TxRx-33
117636599211,16cyclictest1649290-21taskset3
117636599211,16cyclictest0-21swapper/33
117636599211,16cyclictest0-21swapper/33
117636599211,15cyclictest1470751-21chrt3
13485042201,2sleep00-21swapper/00
117636599204,9cyclictest1455393-21taskset3
1176365992016,2cyclictest0-21swapper/33
1176365992015,3cyclictest0-21swapper/33
1176365992011,6cyclictest0-21swapper/33
117636599201,16cyclictest0-21swapper/33
117636599201,15cyclictest66950irq/132-enp1s0-TxRx-33
117636599201,14cyclictest1351406-21chrt3
117636599201,14cyclictest1220995-21taskset3
117636599200,1cyclictest0-21swapper/33
117636599200,18cyclictest0-21swapper/33
117636599191,7cyclictest1656271-21taskset3
117636599191,5cyclictest0-21swapper/33
117636599191,14cyclictest1570876-21chrt3
117636599191,14cyclictest0-21swapper/33
117636599191,14cyclictest0-21swapper/33
117636599191,14cyclictest0-21swapper/33
117636599191,11cyclictest0-21swapper/33
15876022181,2sleep00-21swapper/00
1176365991812,4cyclictest1231847-21chrt3
1176365991812,4cyclictest0-21swapper/33
117636599181,15cyclictest0-21swapper/33
117636599181,14cyclictest0-21swapper/33
117636599181,14cyclictest0-21swapper/33
117636599181,14cyclictest0-21swapper/33
117636599181,14cyclictest0-21swapper/33
117636599181,14cyclictest0-21swapper/33
117636599181,14cyclictest0-21swapper/33
117636599181,13cyclictest0-21swapper/33
117636599181,13cyclictest0-21swapper/33
117636599181,13cyclictest0-21swapper/33
16036952171,4sleep20-21swapper/22
15414032170,3sleep00-21swapper/00
15335762171,4sleep21533587-21ssh2
117636599179,4cyclictest12428482sleep33
1176365991712,3cyclictest0-21swapper/33
1176365991711,4cyclictest0-21swapper/33
1176365991711,3cyclictest0-21swapper/33
117636599171,13cyclictest0-21swapper/33
117636599171,12cyclictest0-21swapper/33
117636599171,12cyclictest0-21swapper/33
117636599170,14cyclictest0-21swapper/33
117636599170,14cyclictest0-21swapper/33
117636599170,13cyclictest0-21swapper/33
117636599170,13cyclictest0-21swapper/33
16678142160,4sleep11306540-21diskmemload1
16484172161,2sleep20-21swapper/22
15358122161,6sleep21535930-21cpuspeed_turbos2
13487192161,3sleep11306540-21diskmemload1
117636599166,7cyclictest1210874-21chrt3
117636599166,7cyclictest1210874-21chrt3
1176365991612,2cyclictest0-21swapper/33
117636599161,13cyclictest0-21swapper/33
117636599160,13cyclictest0-21swapper/33
117636599160,13cyclictest0-21swapper/33
117636599160,13cyclictest0-21swapper/33
117636599160,13cyclictest0-21swapper/33
117636599160,12cyclictest0-21swapper/33
16478442151,4sleep11306540-21diskmemload1
16319292151,4sleep21631940-21ssh2
15886682151,2sleep00-21swapper/00
15682692151,4sleep11306540-21diskmemload1
15510892151,4sleep01551101-21ssh0
15330972151,3sleep11306540-21diskmemload1
14813462151,3sleep20-21swapper/22
14716492150,3sleep10-21swapper/11
14268492151,2sleep00-21swapper/00
14057312150,11sleep11407449-21cut1
14034752150,3sleep00-21swapper/00
14003792150,9sleep11306540-21diskmemload1
11949042151,3sleep01194923-21apt-get0
117636599156,5cyclictest1200253-21taskset3
117636599150,12cyclictest0-21swapper/33
16401352141,9sleep11640137-21ssh1
15957862141,9sleep21595796-21ssh2
15577822141,2sleep11306540-21diskmemload1
14185882141,7sleep11306540-21diskmemload1
13941752142,8sleep11306540-21diskmemload1
13577542141,4sleep21357768-21ssh2
13560212141,8sleep11356265-21users1
13055482141,4sleep11305597-21ntpq1
12638412140,2sleep10-21swapper/11
11886992140,2sleep1321rcuc/11
117636599147,4cyclictest1263856-21chrt3
1176365991412,1cyclictest0-21swapper/33
1176365991412,1cyclictest0-21swapper/33
117636599140,2cyclictest0-21swapper/33
117636599140,12cyclictest0-21swapper/33
16580352130,1sleep20-21swapper/22
16294002131,8sleep01629414-21ssh0
16104662131,8sleep21610524-21ntpq2
15486412131,6sleep11548732-21ntpq1
15350242131,4sleep01535026-21ssh0
14870792131,5sleep11487137-21ntpq1
14529682131,3sleep01452980-21ssh0
14293022131,8sleep11429314-21ssh1
14101322131,5sleep20-21swapper/22
13654002130,2sleep00-21swapper/00
13654002130,2sleep00-21swapper/00
13516762131,9sleep01351742-21fschecks_count0
13489262131,8sleep21348940-21ssh2
13235602131,6sleep00-21swapper/00
13228732131,8sleep21322884-21ssh2
117636599130,10cyclictest1226372-21chrt3
16297092121,3sleep11629724-21ssh1
16213442121,7sleep11621356-21ssh1
16062592121,5sleep11606287-21apt-get1
16043372121,5sleep11306540-21diskmemload1
15167502124,3sleep01306540-21diskmemload0
14887622121,3sleep01488776-21ssh0
14848512121,7sleep21486588-21kthreadcore2
14527422121,7sleep21452758-21sshd2
14348592121,7sleep21435074-21sed2
13670512121,7sleep21367059-21ssh2
13670512121,7sleep21367059-21ssh2
13070402121,7sleep21306539-21apt-get2
12540642121,7sleep01254889-21tr0
12369262120,1sleep10-21swapper/11
12096192121,5sleep21209668-21ntpq2
11768192121,8sleep01176948-21grep0
117636599127,3cyclictest0-21swapper/33
16666532111,5sleep11306540-21diskmemload1
16660712112,2sleep00-21swapper/00
16647252110,5sleep21306540-21diskmemload2
16557772110,4sleep10-21swapper/11
16206982111,4sleep20-21swapper/22
16191482111,5sleep01619207-21ntpq0
16065842111,5sleep01606807-21/usr/sbin/munin0
15761162111,3sleep20-21swapper/22
15515532111,4sleep21306540-21diskmemload2
15363252111,5sleep11536410-21irqstats1
15158482110,7sleep21306540-21diskmemload2
15152192111,4sleep11306540-21diskmemload1
15084362110,4sleep20-21swapper/22
14999772111,7sleep01499993-21ssh0
14958722111,6sleep11495933-21ntpq1
14919482111,5sleep21492168-21hddtemp_smartct2
14798072111,4sleep11306540-21diskmemload1
14790802111,4sleep00-21swapper/00
14620442110,2sleep00-21swapper/00
14549632110,7sleep11306540-21diskmemload1
14470072111,5sleep11306540-21diskmemload1
14432342111,5sleep21443283-21ntpq2
14007542111,5sleep21306540-21diskmemload2
13823302111,5sleep11382531-21users1
13772222111,6sleep21368536-21turbostat.cron2
13411252111,2sleep01341135-21ssh0
13302752111,4sleep11306540-21diskmemload1
13205162111,5sleep11320573-21ntpq1
13147952112,4sleep11306540-21diskmemload1
12801402110,5sleep21280159-21apt-get2
12797422110,1sleep10-21swapper/11
12416032111,5sleep01241652-21ntpq0
12254232111,5sleep11225564-21ntpq1
12215392111,5sleep21221558-21apt-get2
11897422111,5sleep21189865-21diskstats2
16729802101,2sleep20-21swapper/22
16685142103,3sleep01669479-21grep0
16559702100,1sleep00-21swapper/00
16412402101,3sleep00-21swapper/00
16383542101,3sleep20-21swapper/22
16016272101,5sleep01601686-21ntpq0
15942492101,2sleep10-21swapper/11
15840422101,5sleep11584092-21ntpq1
15798592101,4sleep20-21swapper/22
15783912100,2sleep01578399-21ssh0
15775872101,4sleep11306540-21diskmemload1
15675392101,3sleep00-21swapper/00
15667162100,1sleep20-21swapper/22
15259562101,2sleep20-21swapper/22
15244792101,3sleep10-21swapper/11
15047592101,4sleep11306540-21diskmemload1
15000352101,3sleep00-21swapper/00
14703392101,3sleep20-21swapper/22
14632042101,2sleep20-21swapper/22
14616482101,2sleep10-21swapper/11
14472032101,3sleep01306540-21diskmemload0
14344792101,4sleep01306540-21diskmemload0
14274872101,3sleep20-21swapper/22
14207392101,4sleep21306540-21diskmemload2
14190422101,2sleep00-21swapper/00
13913992102,4sleep01391411-21sh0
13907032101,5sleep21390835-21grep2
13852152101,4sleep01306540-21diskmemload0
13828452101,3sleep20-21swapper/22
13745252100,1sleep10-21swapper/11
13694672101,3sleep01369760-21kthreadcore0
13665812101,4sleep11306540-21diskmemload1
13665812101,4sleep11306540-21diskmemload1
13403782101,4sleep21306540-21diskmemload2
13311862101,4sleep01306540-21diskmemload0
13138652101,3sleep00-21swapper/00
13017362101,5sleep21301837-21grep2
12910802100,6sleep01291311-21cat0
12668922101,4sleep01268042-21memory0
12484592101,4sleep11248583-21perl1
12315492100,1sleep10-21swapper/11
12256742100,6sleep01225739-21ls0
11882622101,4sleep21188308-21ntpq2
1637878290,1sleep00-21swapper/00
1558034291,4sleep01558211-21vmstat0
1554999291,4sleep21556761-21cut2
1517853290,2sleep00-21swapper/00
1471581291,2sleep00-21swapper/00
1435790291,3sleep11306540-21diskmemload1
1411681291,3sleep01306540-21diskmemload0
1333868290,3sleep11306540-21diskmemload1
1331158291,2sleep20-21swapper/22
1302010291,4sleep01302738-21grep0
1278968291,4sleep21279024-21pmu-power2
1264159291,2sleep20-21swapper/22
1242871291,4sleep01243126-21df0
1228497291,4sleep21230294-21tr2
1216213290,4sleep01216232-21apt-get0
1211446291,4sleep01212323-21cut0
1211446291,4sleep01212323-21cut0
1190149290,5sleep11191568-21kthreadcore1
1177101291,4sleep21178108-21grep2
1301197281,3sleep11301218-21perf1
1297881281,2sleep01299715-21kthreadcore0
1295673280,3sleep172-21kcompactd01
1289636280,4sleep21289749-21ps2
1280438281,1sleep10-21swapper/11
1274815281,3sleep01274834-21apt-get0
1270045281,3sleep00-21swapper/00
1254890281,4sleep11256651-21cut1
1216493281,3sleep21216596-21perl2
1216235280,1sleep10-21swapper/11
1176949280,1sleep10-21swapper/11
1301005270,1sleep20-21swapper/22
1291615270,3sleep21293306-21cut2
1286072271,3sleep01287612-21grep0
1273561270,2sleep10-21swapper/11
1258831270,2sleep00-21swapper/00
1242489270,1sleep10-21swapper/11
1237310270,3sleep20-21swapper/22
1232193270,2sleep00-21swapper/00
1231635270,1sleep00-21swapper/00
1215726270,1sleep20-21swapper/22
1215726270,1sleep20-21swapper/22
1205558270,2sleep10-21swapper/11
1204138270,2sleep10-21swapper/11
1200231270,2sleep20-21swapper/22
1199814270,1sleep20-21swapper/22
1195920271,3sleep11197626-21kthreadcore1
1194639270,1sleep00-21swapper/00
1181758272,2sleep00-21swapper/00
1284513260,2sleep00-21swapper/00
1274534261,2sleep20-21swapper/22
1253785261,2sleep20-21swapper/22
1253106260,1sleep20-21swapper/22
1253031260,4sleep00-21swapper/00
1247807260,1sleep10-21swapper/11
1237142260,1sleep20-21swapper/22
1212324261,2sleep10-21swapper/11
1212324261,2sleep10-21swapper/11
1289579250,1sleep10-21swapper/11
1264484250,1sleep10-21swapper/11
1263204250,1sleep20-21swapper/22
1247828251,2sleep20-21swapper/22
1200510250,2sleep00-21swapper/00
1205853240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional