You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-30 - 19:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Thu Jul 30, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
138459621370,3sleep00-21swapper/00
1102007212062,51sleep30-21swapper/33
1102007212062,51sleep30-21swapper/33
110176028755,11sleep10-21swapper/11
110176028755,11sleep10-21swapper/11
110179628354,10sleep20-21swapper/22
110179628354,10sleep20-21swapper/22
110193228156,7sleep00-21swapper/00
110193228156,7sleep00-21swapper/00
15833042380,3sleep11583308-21switchtime1
110224799231,18cyclictest1367539-21taskset3
110224799221,18cyclictest1273917-21chrt3
110224799211,15cyclictest0-21swapper/33
110224799211,14cyclictest0-21swapper/33
110224799210,16cyclictest14219642sleep33
12566112201,3sleep01256621-21ssh0
110224799202,15cyclictest0-21swapper/33
110224799201,15cyclictest0-21swapper/33
110224799201,15cyclictest0-21swapper/33
110224799201,15cyclictest0-21swapper/33
110224799201,14cyclictest0-21swapper/33
110224799201,14cyclictest0-21swapper/33
110224799191,6cyclictest14007982sleep33
1102247991915,2cyclictest0-21swapper/33
110224799191,15cyclictest0-21swapper/33
110224799191,14cyclictest0-21swapper/33
110224799191,14cyclictest0-21swapper/33
110224799191,14cyclictest0-21swapper/33
15954952182,5sleep01230015-21diskmemload0
110224799188,7cyclictest1462533-21taskset3
110224799181,5cyclictest0-21swapper/33
110224799181,4cyclictest0-21swapper/33
1102247991814,3cyclictest66950irq/132-enp1s0-TxRx-33
1102247991814,3cyclictest0-21swapper/33
1102247991811,5cyclictest0-21swapper/33
110224799181,14cyclictest1198171-21taskset3
110224799181,14cyclictest0-21swapper/33
110224799181,14cyclictest0-21swapper/33
110224799181,14cyclictest0-21swapper/33
110224799181,14cyclictest0-21swapper/33
110224799181,14cyclictest0-21swapper/33
110224799181,13cyclictest0-21swapper/33
110224799180,16cyclictest0-21swapper/33
110224799180,15cyclictest0-21swapper/33
14819232171,3sleep10-21swapper/11
14362952171,2sleep10-21swapper/11
13952652171,4sleep01230015-21diskmemload0
13906372170,2sleep10-21swapper/11
13677662171,2sleep00-21swapper/00
11976212171,11sleep11197712-21/usr/sbin/munin1
1102247991714,1cyclictest0-21swapper/33
1102247991713,2cyclictest0-21swapper/33
110224799171,13cyclictest0-21swapper/33
110224799171,13cyclictest0-21swapper/33
110224799171,13cyclictest0-21swapper/33
110224799171,13cyclictest0-21swapper/33
110224799171,13cyclictest0-21swapper/33
110224799171,13cyclictest0-21swapper/33
110224799171,13cyclictest0-21swapper/33
110224799171,13cyclictest0-21swapper/33
110224799171,13cyclictest0-21swapper/33
110224799171,12cyclictest0-21swapper/33
110224799170,15cyclictest0-21swapper/33
110224799170,14cyclictest0-21swapper/33
110224799170,14cyclictest0-21swapper/33
110224799170,14cyclictest0-21swapper/33
110224799170,14cyclictest0-21swapper/33
110224799170,14cyclictest0-21swapper/33
110224799170,13cyclictest0-21swapper/33
15584862160,7sleep11230015-21diskmemload1
13393732161,10sleep21339634-21head2
13313832161,4sleep21230015-21diskmemload2
110224799161,13cyclictest0-21swapper/33
1102247991610,4cyclictest0-21swapper/33
110224799160,13cyclictest0-21swapper/33
110224799160,13cyclictest0-21swapper/33
14617982151,2sleep20-21swapper/22
14536672151,4sleep21230015-21diskmemload2
14109212151,6sleep11230015-21diskmemload1
13518732151,2sleep20-21swapper/22
12723022151,2sleep10-21swapper/11
110224799151,4cyclictest0-21swapper/33
110224799151,12cyclictest0-21swapper/33
1102247991510,3cyclictest0-21swapper/33
110224799150,13cyclictest0-21swapper/33
110224799150,12cyclictest0-21swapper/33
110224799150,12cyclictest0-21swapper/33
110224799150,12cyclictest0-21swapper/33
110224799150,12cyclictest0-21swapper/33
110224799150,12cyclictest0-21swapper/33
15937202141,3sleep11593733-21sh1
15412752140,2sleep20-21swapper/22
14984752141,2sleep20-21swapper/22
14829592141,7sleep11482983-21apt-get1
14793932141,9sleep01479407-21ssh0
14655592140,2sleep00-21swapper/00
13339642145,5sleep01333976-21sh0
13158912141,4sleep11230015-21diskmemload1
13143482142,7sleep01230015-21diskmemload0
12896432141,8sleep21230015-21diskmemload2
12386152140,2sleep1171rcu_preempt1
11669222140,2sleep00-21swapper/00
110224799140,2cyclictest0-21swapper/33
110224799140,2cyclictest0-21swapper/33
15878472131,2sleep20-21swapper/22
15662602131,8sleep11566271-21ssh1
15526852130,2sleep00-21swapper/00
14741442131,6sleep20-21swapper/22
14703292131,8sleep21470340-21ssh2
14219982131,5sleep21230015-21diskmemload2
14034362131,7sleep01403446-21ssh0
13833962131,7sleep21230015-21diskmemload2
13348912131,8sleep01334905-21ssh0
12561162131,7sleep21256127-21ssh2
12560462131,7sleep11230015-21diskmemload1
11149462131,3sleep00-21swapper/00
15764692121,5sleep10-21swapper/11
15340972121,5sleep21230015-21diskmemload2
15242682121,7sleep00-21swapper/00
15139892121,7sleep21230015-21diskmemload2
14903562120,2sleep20-21swapper/22
14864142121,7sleep01482962-21/usr/sbin/munin0
14650512121,7sleep01465063-21ssh0
14359502121,5sleep21230015-21diskmemload2
14213512122,4sleep21230015-21diskmemload2
14192602121,6sleep11230015-21diskmemload1
14017412120,2sleep10-21swapper/11
13682992120,7sleep21368314-21ssh2
13612592121,5sleep11361421-21diskstats1
12914192121,6sleep11230015-21diskmemload1
12815032121,4sleep20-21swapper/22
12813832121,7sleep10-21swapper/11
12706492120,3sleep21270662-21ssh2
12674772121,7sleep01269029-21kthreadcore0
12148392121,5sleep01215048-21hddtemp_smartct0
11820782121,7sleep21177873-21/usr/sbin/munin2
11674912120,1sleep00-21swapper/00
11554182120,1sleep00-21swapper/00
11254212121,6sleep21125440-21apt-get2
15849262111,5sleep01470354-21kworker/u16:2+rpciod0
15701372111,4sleep0221rcuc/00
15701052111,6sleep21230015-21diskmemload2
15665272111,5sleep21230015-21diskmemload2
15620412110,7sleep01563254-21grep0
15159612111,3sleep00-21swapper/00
15007752111,6sleep11501005-21/usr/sbin/munin1
14734972111,1sleep10-21swapper/11
14357642110,5sleep00-21swapper/00
14283892111,2sleep00-21swapper/00
14272272110,7sleep11427245-21ssh1
13744692111,4sleep20-21swapper/22
13253882116,2sleep00-21swapper/00
13245892111,4sleep20-21swapper/22
13165652111,6sleep21230015-21diskmemload2
12964892111,4sleep21230015-21diskmemload2
12606502111,4sleep10-21swapper/11
12365112111,3sleep00-21swapper/00
12304432111,6sleep21230477-21ssh2
12081382110,3sleep21204063-21/usr/sbin/munin2
11674052112,4sleep21167424-21apt-get2
11516062111,5sleep11151625-21apt-get1
15862192100,1sleep20-21swapper/22
15595802101,4sleep21230015-21diskmemload2
15492982101,3sleep00-21swapper/00
15440022101,3sleep21544033-21apt-get2
15412042101,3sleep10-21swapper/11
15345812101,3sleep00-21swapper/00
15147482101,2sleep10-21swapper/11
15065342100,1sleep00-21swapper/00
15004542101,3sleep20-21swapper/22
14968332101,4sleep01230015-21diskmemload0
14920342101,5sleep11492150-21perl1
14632752101,2sleep10-21swapper/11
14534942101,3sleep10-21swapper/11
14531232101,3sleep00-21swapper/00
14476912101,5sleep01447758-21sh0
14395072101,4sleep21439729-21diskstats2
14139142102,4sleep01414719-21cut0
14108382101,3sleep21230015-21diskmemload2
14108112101,4sleep01230015-21diskmemload0
13958752101,5sleep21396013-21cut2
13933052101,3sleep20-21swapper/22
13764162101,4sleep11230015-21diskmemload1
13727012101,3sleep00-21swapper/00
13605162101,5sleep11360527-21ssh1
13584622101,3sleep00-21swapper/00
13518162101,4sleep11230015-21diskmemload1
13436052101,4sleep01343632-21apt-get0
13352332101,5sleep11335280-21cut1
13312192100,1sleep10-21swapper/11
13069022101,2sleep10-21swapper/11
13001892101,3sleep00-21swapper/00
12885502100,2sleep1171rcu_preempt1
12829432101,4sleep01283080-21diskstats0
12740612101,4sleep01230015-21diskmemload0
12475162101,4sleep01247805-21ssh0
12451722101,3sleep21230015-21diskmemload2
12439172101,2sleep10-21swapper/11
12397492101,6sleep01240406-21cut0
12292342102,4sleep01229425-21/usr/sbin/munin0
12197782100,1sleep00-21swapper/00
11843402101,5sleep21185996-21kthreadcore2
11364562101,4sleep01136523-21irqstats0
11359732101,6sleep11136178-21expr1
11257112101,6sleep11125921-21/usr/sbin/munin1
11149482101,4sleep21114724-21sendmail-msp2
1549464291,2sleep10-21swapper/11
1541244291,2sleep00-21swapper/00
1531475290,2sleep10-21swapper/11
1523170291,2sleep20-21swapper/22
1522795290,3sleep10-21swapper/11
1445352291,2sleep10-21swapper/11
1383740291,4sleep11383754-21ssh1
1357870291,3sleep21230015-21diskmemload2
1317399290,2sleep10-21swapper/11
1305803290,1sleep20-21swapper/22
1292122291,4sleep01292903-21grep0
1262168291,2sleep20-21swapper/22
1219779291,3sleep10-21swapper/11
1214534290,4sleep11214259-21apt-get1
1199328291,5sleep01199399-21irqstats0
1195495290,6sleep21197239-21cut2
1193546291,3sleep01193565-21apt-get0
1187777290,2sleep10-21swapper/11
1161079290,2sleep20-21swapper/22
1127214291,4sleep01128945-21tr0
1125122290,1sleep20-21swapper/22
1115806291,4sleep11117426-21cut1
1109954290,5sleep01110079-21gltestperf0
1225586281,3sleep20-21swapper/22
1214243281,3sleep11214486-21latency_hist1
1209866281,3sleep01209889-21kthreadcore0
1204062280,3sleep01204081-21apt-get0
1203482280,2sleep10-21swapper/11
1177895280,2sleep00-21swapper/00
1176684281,3sleep21176811-21grep2
1173187281,3sleep11173241-21kthreadcore1
1162642281,3sleep21162737-21cut2
1157512281,3sleep10-21swapper/11
1156897281,3sleep01156915-21apt-get0
1135416280,1sleep00-21swapper/00
1120463281,4sleep11120491-21fschecks_count1
1110234281,3sleep21111151-21kthreadcore2
1204632271,2sleep10-21swapper/11
1200549271,3sleep21202257-21kthreadcore2
1193123270,1sleep20-21swapper/22
1192913270,1sleep00-21swapper/00
1183104270,2sleep01183123-21apt-get0
1178904270,3sleep11180533-21kthreadcore1
1173048270,4sleep00-21swapper/00
1172092270,1sleep10-21swapper/11
1151114270,1sleep00-21swapper/00
1147834271,3sleep2421rcuc/22
1142217271,2sleep00-21swapper/00
1137756272,2sleep20-21swapper/22
1130664270,2sleep10-21swapper/11
1107363270,1sleep20-21swapper/22
1102422270,2sleep10-21swapper/11
1102416270,1sleep00-21swapper/00
1215121260,2sleep20-21swapper/22
1213095260,2sleep21213268-21strings2
1165949260,2sleep11166122-21strings1
1146937261,2sleep10-21swapper/11
1146071261,2sleep21102242-21cyclictest2
1141444260,2sleep10-21swapper/11
1134701260,3sleep21134763-21/usr/sbin/munin2
1121061260,3sleep01122685-21grep0
1109667260,1sleep10-21swapper/11
1225030250,1sleep10-21swapper/11
1219770250,1sleep20-21swapper/22
1188502250,1sleep10-21swapper/11
1156460250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional