You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-17 - 19:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Fri Apr 17, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1454552212957,68sleep30-21swapper/33
145453628556,10sleep20-21swapper/22
145445128162,12sleep10-21swapper/11
144980227260,6sleep00-21swapper/00
17521712281,15sleep01752217-21awk0
18749692260,4sleep2421rcuc/22
145500099231,18cyclictest1580680-21taskset3
145500099231,18cyclictest1580680-21taskset3
145500099221,17cyclictest1811368-21taskset3
18397432210,11sleep244-21ksoftirqd/22
1455000992117,2cyclictest0-21swapper/33
1455000992114,3cyclictest66950irq/132-enp1s0-TxRx-33
145500099211,15cyclictest0-21swapper/33
145500099201,16cyclictest0-21swapper/33
18829452191,3sleep00-21swapper/00
17240022191,2sleep00-21swapper/00
168930021911,5sleep11585761-21diskmemload1
16724212191,2sleep00-21swapper/00
145500099199,6cyclictest66950irq/132-enp1s0-TxRx-33
145500099191,16cyclictest0-21swapper/33
145500099191,15cyclictest0-21swapper/33
145500099191,14cyclictest66950irq/132-enp1s0-TxRx-33
1455000991911,4cyclictest1569484-21taskset3
145500099191,14cyclictest0-21swapper/33
145500099191,14cyclictest0-21swapper/33
145500099191,14cyclictest0-21swapper/33
145500099191,14cyclictest0-21swapper/33
145500099190,13cyclictest0-21swapper/33
17305752181,11sleep01730632-21ntpq0
15159362181,5sleep21516016-21apt-config2
1455000991816,1cyclictest0-21swapper/33
1455000991814,3cyclictest0-21swapper/33
1455000991813,2cyclictest18559842sleep33
145500099181,14cyclictest66950irq/132-enp1s0-TxRx-33
145500099181,14cyclictest0-21swapper/33
145500099181,14cyclictest0-21swapper/33
145500099181,14cyclictest0-21swapper/33
145500099181,14cyclictest0-21swapper/33
145500099181,14cyclictest0-21swapper/33
145500099181,14cyclictest0-21swapper/33
145500099181,14cyclictest0-21swapper/33
145500099181,14cyclictest0-21swapper/33
145500099181,14cyclictest0-21swapper/33
145500099181,14cyclictest0-21swapper/33
145500099181,14cyclictest0-21swapper/33
145500099181,13cyclictest0-21swapper/33
145500099181,13cyclictest0-21swapper/33
145500099180,14cyclictest18196562sleep33
17849022171,3sleep00-21swapper/00
16267852171,2sleep00-21swapper/00
16006492171,2sleep10-21swapper/11
15914002171,3sleep00-21swapper/00
1455000991712,3cyclictest0-21swapper/33
1455000991711,3cyclictest1882428-21taskset3
145500099171,13cyclictest0-21swapper/33
145500099171,13cyclictest0-21swapper/33
145500099171,13cyclictest0-21swapper/33
145500099171,13cyclictest0-21swapper/33
145500099171,13cyclictest0-21swapper/33
145500099171,13cyclictest0-21swapper/33
145500099171,13cyclictest0-21swapper/33
145500099171,13cyclictest0-21swapper/33
145500099170,14cyclictest0-21swapper/33
145500099170,13cyclictest0-21swapper/33
19257192161,5sleep21897045-21kworker/u16:1+rpciod2
19072032161,2sleep10-21swapper/11
17696402161,3sleep21769660-21apt-get2
17666572161,3sleep10-21swapper/11
17353602162,4sleep21735580-21hddtemp_smartct2
16790762161,2sleep20-21swapper/22
16790762161,2sleep20-21swapper/22
1455000991613,1cyclictest0-21swapper/33
145500099161,12cyclictest1542721-21chrt3
145500099160,13cyclictest0-21swapper/33
145500099160,13cyclictest0-21swapper/33
145500099160,13cyclictest0-21swapper/33
145500099160,13cyclictest0-21swapper/33
145500099160,13cyclictest0-21swapper/33
145500099160,13cyclictest0-21swapper/33
145500099160,12cyclictest0-21swapper/33
145500099160,12cyclictest0-21swapper/33
18825552151,4sleep11585761-21diskmemload1
18037642151,3sleep11585761-21diskmemload1
16781102150,3sleep00-21swapper/00
16781102150,3sleep00-21swapper/00
16390182151,9sleep01639240-21smartctl0
16019042150,1sleep00-21swapper/00
145500099156,5cyclictest14774612sleep33
145500099151,3cyclictest0-21swapper/33
145500099151,11cyclictest14835622sleep33
145500099150,13cyclictest0-21swapper/33
145500099150,13cyclictest0-21swapper/33
145500099150,12cyclictest0-21swapper/33
145500099150,12cyclictest0-21swapper/33
145500099150,11cyclictest0-21swapper/33
18798972141,8sleep21880151-21/usr/sbin/munin2
18628552141,2sleep20-21swapper/22
18618672141,6sleep11862019-21ntp_192.168.1141
17945672141,3sleep21585761-21diskmemload2
17879722141,7sleep01788106-21diskstats0
17492212141,2sleep10-21swapper/11
17241092141,8sleep11585761-21diskmemload1
17084962141,9sleep21708510-21cron2
16900462141,4sleep01690057-21ssh0
1455000991412,1cyclictest0-21swapper/33
1455000991412,1cyclictest0-21swapper/33
145500099140,12cyclictest0-21swapper/33
19518872131,6sleep00-21swapper/00
19428482130,2sleep2171rcu_preempt2
19426822131,2sleep11585761-21diskmemload1
19063022131,5sleep00-21swapper/00
18921832131,3sleep11892194-21ssh1
18846102131,8sleep21885726-21tr2
18303232131,7sleep00-21swapper/00
18021252131,5sleep20-21swapper/22
16612972131,7sleep11585761-21diskmemload1
16364022130,3sleep20-21swapper/22
16260862131,8sleep11626096-21ssh1
15377952132,5sleep11537814-21apt-get1
19512022121,8sleep11951215-21ssh1
19420582121,5sleep00-21swapper/00
19337542121,7sleep11933765-21ssh1
19126202121,7sleep11585761-21diskmemload1
18550432121,5sleep10-21swapper/11
18460972120,8sleep21846110-21sh2
18304992121,6sleep21830509-21ssh2
18122942121,7sleep01812306-21ssh0
17587802121,5sleep20-21swapper/22
17052502121,7sleep11705261-21ssh1
16718392121,7sleep21671850-21ssh2
16603672121,6sleep01660424-21ntpq0
16543742121,5sleep00-21swapper/00
16018772126,2sleep21499681-21kworker/2:0+events_freezable2
15903252121,5sleep11590376-21ntpq1
15588142120,1sleep10-21swapper/11
15095782121,6sleep11509622-21ntpq1
14935632121,7sleep21493617-21ld2
19330272111,4sleep21585761-21diskmemload2
19318642111,5sleep01931926-21ntpq0
19262012110,2sleep00-21swapper/00
19174162111,4sleep21585761-21diskmemload2
19056822111,6sleep21905746-21ntpq2
18733572111,4sleep11585761-21diskmemload1
18474022111,5sleep11585761-21diskmemload1
18454172111,4sleep00-21swapper/00
18306832111,4sleep11585761-21diskmemload1
18197362111,4sleep11585761-21diskmemload1
18055032110,1sleep20-21swapper/22
18048632111,3sleep00-21swapper/00
17607802111,3sleep10-21swapper/11
17605632111,3sleep00-21swapper/00
17236242111,6sleep21723635-21ssh2
17044162111,5sleep01704487-21ntp_states0
16994412111,5sleep11585761-21diskmemload1
16991952111,3sleep20-21swapper/22
16982632111,6sleep01698270-21ssh0
16872602111,6sleep21687279-21/usr/sbin/munin2
16690772111,6sleep11669143-21ntpq1
16608122111,5sleep21661068-21users2
16392432110,7sleep11639352-21ps1
16291532111,3sleep20-21swapper/22
16106612110,1sleep20-21swapper/22
15916682111,3sleep20-21swapper/22
15647042111,4sleep21564723-21apt-get2
15525442111,5sleep11552584-21ntpq1
15484512111,4sleep00-21swapper/00
15324692111,5sleep21532488-21apt-get2
14890992111,4sleep11489033-31find1
14841652111,5sleep01484336-21diskstats0
19508112101,3sleep20-21swapper/22
19228472101,2sleep11923029-21strings1
19176492100,7sleep01917662-21sh0
18985612101,3sleep11585761-21diskmemload1
18927422101,4sleep21892761-21apt-get2
18883202101,5sleep01888415-21/usr/sbin/munin0
18718402100,1sleep00-21swapper/00
18609112101,4sleep01861866-21memory0
18570852101,4sleep21585761-21diskmemload2
18384712101,4sleep11838481-21ssh1
18373102101,4sleep01585761-21diskmemload0
18143172101,3sleep00-21swapper/00
18128952101,5sleep11812906-21ssh1
17881072101,4sleep11788330-21hddtemp_smartct1
17857172101,4sleep11585761-21diskmemload1
17841772101,6sleep21784191-21ssh2
17772422101,3sleep01585761-21diskmemload0
17763582101,3sleep11585761-21diskmemload1
17613312102,4sleep01761497-21ssh0
17437562101,3sleep20-21swapper/22
17418082101,3sleep11585761-21diskmemload1
17329712101,6sleep20-21swapper/22
17322952101,4sleep11585761-21diskmemload1
17143052101,4sleep11585761-21diskmemload1
16755662103,3sleep11677241-21cut1
16755662103,3sleep11677241-21cut1
16516162101,4sleep11651666-21ntpq1
16473652101,3sleep20-21swapper/22
16302252101,4sleep11630363-21perl1
16199452101,1sleep1171rcu_preempt1
16115902101,4sleep01585761-21diskmemload0
15798522101,4sleep11580054-21users1
15712012101,5sleep21572931-21kthreadcore2
15700352101,2sleep10-21swapper/11
15008012101,5sleep11502312-21kthreadcore1
14989592101,4sleep01499008-21ntpq0
14891202100,1sleep20-21swapper/22
14605112101,5sleep11461279-21kthreadcore1
14603532100,4sleep10-21swapper/11
1898191291,2sleep00-21swapper/00
1819548291,4sleep21819562-21ssh2
1775705291,2sleep20-21swapper/22
1739250290,4sleep01739310-21ntpq0
1716332291,2sleep20-21swapper/22
1712975291,4sleep01713073-21ntpq0
1643702291,2sleep20-21swapper/22
1629953291,2sleep00-21swapper/00
1619171291,2sleep00-21swapper/00
1612987291,5sleep21613904-21kthreadcore2
1603939291,4sleep11604141-21grep1
1559387291,2sleep10-21swapper/11
1551089291,3sleep21552355-21memory2
1535970291,4sleep11536461-21grep1
1526167290,5sleep21521815-21/usr/sbin/munin2
1515699291,2sleep10-21swapper/11
1510279290,1sleep00-21swapper/00
1505262291,4sleep01505386-21sed0
1495166291,5sleep21495382-21idleruntime2
1482815291,3sleep01482847-21ntpq0
1475205291,4sleep01477011-21cut0
1473896291,4sleep21473967-21irqstats2
1849012281,2sleep00-21swapper/00
1580245280,2sleep20-21swapper/22
1536585281,2sleep00-21swapper/00
1525810280,3sleep01525858-21ntpq0
1515011281,3sleep01510871-21/usr/sbin/munin0
1459458281,3sleep01459506-21kworker/u16:40
1455659281,3sleep21455821-21head2
1574850270,4sleep00-21swapper/00
1564698270,1sleep10-21swapper/11
1560433270,4sleep20-21swapper/22
1553798271,1sleep21553817-21apt-get2
1547945270,1sleep20-21swapper/22
1547188270,2sleep10-21swapper/11
1542603270,1sleep00-21swapper/00
1542139270,1sleep20-21swapper/22
1532169270,1sleep20-21swapper/22
1531898270,1sleep10-21swapper/11
1531198270,2sleep00-21swapper/00
1522385270,3sleep11523641-21cat1
1521554271,2sleep11-21systemd1
1521521270,1sleep00-21swapper/00
1507195270,3sleep21509005-21kthreadcore2
1505092270,1sleep20-21swapper/22
1493384270,2sleep11493557-21strings1
1483731270,1sleep10-21swapper/11
1478309270,1sleep10-21swapper/11
1473025270,1sleep20-21swapper/22
1472873270,4sleep00-21swapper/00
1467598270,1sleep20-21swapper/22
1585713260,1sleep10-21swapper/11
1585713260,1sleep10-21swapper/11
1585688260,1sleep00-21swapper/00
1585688260,1sleep00-21swapper/00
1580700261,2sleep20-21swapper/22
1580700261,2sleep20-21swapper/22
1579734261,2sleep00-21swapper/00
1569688260,4sleep00-21swapper/00
1558795260,4sleep00-21swapper/00
1547092260,2sleep00-21swapper/00
1516636260,2sleep20-21swapper/22
1499738260,1sleep10-21swapper/11
1494298260,1sleep00-21swapper/00
1483457260,1sleep20-21swapper/22
1468081260,1sleep11468100-21apt-get1
1463332260,2sleep01464929-21kthreadcore0
1559076250,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional