You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 15:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Sat Jul 04, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1504315212252,65sleep30-21swapper/33
191098221130,3sleep10-21swapper/11
150422528757,12sleep20-21swapper/22
150406028755,11sleep10-21swapper/11
150425727755,15sleep00-21swapper/00
18591192230,3sleep30-21swapper/33
150457199233,14cyclictest1872429-21chrt3
150457199221,3cyclictest0-21swapper/33
150457199211,16cyclictest66950irq/132-enp1s0-TxRx-33
150457199211,16cyclictest0-21swapper/33
150457199211,16cyclictest0-21swapper/33
150457199211,15cyclictest0-21swapper/33
150457199201,7cyclictest0-21swapper/33
150457199201,15cyclictest0-21swapper/33
150457199201,15cyclictest0-21swapper/33
150457199201,14cyclictest0-21swapper/33
17306192191,3sleep11632335-21diskmemload1
1504571991916,1cyclictest0-21swapper/33
1504571991914,3cyclictest66950irq/132-enp1s0-TxRx-33
150457199191,15cyclictest0-21swapper/33
150457199191,15cyclictest0-21swapper/33
150457199191,15cyclictest0-21swapper/33
150457199191,15cyclictest0-21swapper/33
1504571991911,4cyclictest18866772sleep33
150457199191,14cyclictest0-21swapper/33
150457199191,14cyclictest0-21swapper/33
150457199191,14cyclictest0-21swapper/33
150457199191,12cyclictest0-21swapper/33
150457199190,1cyclictest0-21swapper/33
150457199190,16cyclictest0-21swapper/33
16728082181,8sleep11672820-21ssh1
16402252181,2sleep10-21swapper/11
1504571991814,2cyclictest0-21swapper/33
150457199181,14cyclictest0-21swapper/33
150457199181,14cyclictest0-21swapper/33
150457199181,14cyclictest0-21swapper/33
150457199181,14cyclictest0-21swapper/33
150457199181,14cyclictest0-21swapper/33
150457199181,14cyclictest0-21swapper/33
150457199181,14cyclictest0-21swapper/33
150457199181,13cyclictest0-21swapper/33
150457199181,13cyclictest0-21swapper/33
150457199180,15cyclictest66950irq/132-enp1s0-TxRx-33
150457199180,14cyclictest0-21swapper/33
150457199180,14cyclictest0-21swapper/33
150457199180,14cyclictest0-21swapper/33
19344872170,1sleep20-21swapper/22
18575002171,12sleep21859117-21cut2
18285372171,5sleep01632335-21diskmemload0
17455922171,4sleep01632335-21diskmemload0
150457199172,10cyclictest1517321-21taskset3
150457199171,13cyclictest0-21swapper/33
150457199171,13cyclictest0-21swapper/33
150457199171,13cyclictest0-21swapper/33
150457199171,12cyclictest0-21swapper/33
150457199171,12cyclictest0-21swapper/33
150457199170,14cyclictest0-21swapper/33
150457199170,14cyclictest0-21swapper/33
150457199170,13cyclictest0-21swapper/33
19369042161,3sleep10-21swapper/11
150457199163,8cyclictest0-21swapper/33
1504571991612,2cyclictest0-21swapper/33
1504571991611,3cyclictest0-21swapper/33
150457199161,12cyclictest0-21swapper/33
150457199161,11cyclictest0-21swapper/33
150457199160,14cyclictest0-21swapper/33
150457199160,13cyclictest0-21swapper/33
150457199160,13cyclictest0-21swapper/33
150457199160,12cyclictest0-21swapper/33
19697322150,2sleep20-21swapper/22
19599982151,3sleep11632335-21diskmemload1
19457192151,2sleep20-21swapper/22
16725912150,4sleep21632335-21diskmemload2
150457199156,7cyclictest1595267-21chrt3
150457199151,11cyclictest0-21swapper/33
1504571991510,3cyclictest0-21swapper/33
150457199150,12cyclictest0-21swapper/33
150457199150,11cyclictest0-21swapper/33
19699002140,3sleep01632335-21diskmemload0
19545462140,2sleep20-21swapper/22
19455532141,3sleep01945567-21ssh0
19421362141,9sleep11942276-21sh1
19037092141,3sleep21632335-21diskmemload2
19022762141,3sleep11902284-21ssh1
18888182141,4sleep01888825-21cpu0
17950562141,5sleep01795069-21ssh0
17379492141,2sleep10-21swapper/11
16741042141,2sleep20-21swapper/22
150457199149,2cyclictest1611261-21taskset3
150457199141,3cyclictest15446672sleep33
150457199140,2cyclictest0-21swapper/33
150457199140,11cyclictest0-21swapper/33
19783502130,2sleep20-21swapper/22
19712232131,4sleep01971388-21ssh0
19535452131,8sleep11953552-21ssh1
18918792131,8sleep21892739-21/usr/sbin/munin2
18724132131,5sleep20-21swapper/22
18707162131,8sleep21870730-21ssh2
17888792131,3sleep11788893-21ssh1
17781532131,7sleep21632335-21diskmemload2
17388452131,5sleep20-21swapper/22
16974762131,8sleep21697490-21ssh2
16890772131,3sleep11689089-21ssh1
16801112131,8sleep01680121-21ssh0
15824002131,8sleep21584001-21ls2
15579902131,8sleep11558061-21cut1
15047682130,2sleep20-21swapper/22
150457199130,1cyclictest0-21swapper/33
19482842121,7sleep01949975-21cut0
19362382121,7sleep01936249-21ssh0
19051702121,4sleep21905194-21apt-get2
18445652120,3sleep21844576-21ssh2
18055122121,6sleep11632335-21diskmemload1
17729232121,7sleep01772992-21systemd-run0
17715802120,1sleep10-21swapper/11
17633622121,3sleep10-21swapper/11
17317112121,2sleep21731725-21ssh2
17049672121,3sleep10-21swapper/11
16494612121,3sleep21649569-21tr2
16488752121,2sleep20-21swapper/22
16386542121,5sleep01632335-21diskmemload0
15595012121,7sleep10-21swapper/11
15539572122,5sleep01553976-21apt-get0
15397232122,5sleep01541402-21cut0
15272192120,1sleep00-21swapper/00
19604982110,1sleep00-21swapper/00
19285912110,5sleep10-21swapper/11
19181862111,5sleep00-21swapper/00
18972032111,6sleep01897276-21fschecks_count0
18935982111,4sleep10-21swapper/11
18875732111,4sleep10-21swapper/11
18875402111,3sleep20-21swapper/22
18723202111,3sleep00-21swapper/00
18704702110,1sleep00-21swapper/00
18703962110,7sleep11870408-21rm1
18615632111,4sleep01632335-21diskmemload0
18555182111,4sleep01632335-21diskmemload0
18373492111,4sleep01632335-21diskmemload0
18325202111,5sleep11834105-21cut1
18040292111,4sleep20-21swapper/22
18036922111,4sleep01632335-21diskmemload0
17952512111,4sleep11632335-21diskmemload1
17897192112,4sleep21789732-21apt-get2
17875652111,4sleep01632335-21diskmemload0
17617002111,4sleep01632335-21diskmemload0
17488392111,4sleep01749052-21diskstats0
17465072111,3sleep20-21swapper/22
17309852110,2sleep00-21swapper/00
17215162110,2sleep10-21swapper/11
17123072111,3sleep272-21kcompactd02
17072932111,4sleep11707317-21apt-get1
16971182110,7sleep01697129-21ssh0
16824212111,3sleep20-21swapper/22
16805912111,3sleep10-21swapper/11
16546662111,4sleep01632335-21diskmemload0
15897112114,3sleep01589956-21uptime0
15841502111,5sleep01584220-21ntp_states0
15317842111,5sleep11531837-21ntp_states1
15172992111,3sleep20-21swapper/22
19628622101,5sleep11963007-21tr1
19467912101,4sleep21632335-21diskmemload2
19275212101,4sleep21927532-21ssh2
19265562101,4sleep01632335-21diskmemload0
19187632101,5sleep21632335-21diskmemload2
18869172101,3sleep00-21swapper/00
18801672101,5sleep11880236-21modprobe1
18554272101,3sleep11632335-21diskmemload1
18474952101,4sleep21632335-21diskmemload2
18446402101,3sleep10-21swapper/11
18312012101,4sleep21632335-21diskmemload2
18291622101,3sleep20-21swapper/22
18277542101,4sleep11632335-21diskmemload1
18200802101,3sleep01632335-21diskmemload0
18193542100,1sleep20-21swapper/22
18149122101,3sleep10-21swapper/11
18115572101,4sleep01632335-21diskmemload0
18112372101,4sleep11632335-21diskmemload1
17881612100,3sleep20-21swapper/22
17806802100,1sleep00-21swapper/00
17786222101,2sleep10-21swapper/11
17705922101,3sleep20-21swapper/22
17615282101,4sleep21632335-21diskmemload2
17538252100,6sleep21753836-21ssh2
17486762101,3sleep11632335-21diskmemload1
17478772101,4sleep11632335-21diskmemload1
17374082100,1sleep00-21swapper/00
17208472100,2sleep00-21swapper/00
17155452101,3sleep20-21swapper/22
17043472101,3sleep01632335-21diskmemload0
16991022100,6sleep21632335-21diskmemload2
16981162100,1sleep1171rcu_preempt1
16829872101,4sleep01683068-21irqstats0
16710332101,4sleep01632335-21diskmemload0
16629562100,1sleep20-21swapper/22
16582672101,5sleep11659353-21grep1
16560232100,1sleep10-21swapper/11
16478292101,3sleep00-21swapper/00
16383462101,2sleep20-21swapper/22
15906222101,3sleep00-21swapper/00
15894502101,5sleep21589539-21uname2
15647402101,4sleep01564950-21hddtemp_smartct0
15484182101,4sleep11548536-21wc1
15463302101,5sleep01547332-21memory0
15347772101,5sleep11536510-21kthreadcore1
1977140290,1sleep10-21swapper/11
1910062291,3sleep01632335-21diskmemload0
1862784290,3sleep10-21swapper/11
1840755291,5sleep01842414-21kthreadcore0
1806230290,2sleep20-21swapper/22
1713057291,4sleep01713069-21ssh0
1646412291,3sleep11646424-21ssh1
1627359291,3sleep11627378-21apt-get1
1626873292,3sleep1555-21dbus-daemon1
1622112290,3sleep20-21swapper/22
1605265291,4sleep01605409-21wc0
1596361291,4sleep21596433-21uname2
1570199291,4sleep01571095-21cut0
1564176291,4sleep21564338-21cat2
1553347290,3sleep20-21swapper/22
1543521291,2sleep20-21swapper/22
1519519291,4sleep01521145-21grep0
1513445291,2sleep20-21swapper/22
1512607291,4sleep11513444-21cat1
1917434281,3sleep11917609-21mailstats1
1657640280,2sleep00-21swapper/00
1627381281,3sleep21627444-21cpuspeed_turbos2
1611600280,2sleep00-21swapper/00
1597730281,3sleep01599461-21cut0
1591353280,4sleep10-21swapper/11
1580152281,3sleep10-21swapper/11
1579807280,1sleep20-21swapper/22
1575395281,3sleep01575983-21kthreadcore0
1571097281,4sleep11572785-21cut1
1564446280,2sleep10-21swapper/11
1553686281,3sleep01553821-21sed0
1529257281,3sleep21530951-21grep2
1522532280,3sleep20-21swapper/22
1512040281,2sleep01512059-21apt-get0
1509094280,4sleep10-21swapper/11
1626867270,2sleep0110338-21fwupd0
1615766271,2sleep20-21swapper/22
1611163270,1sleep10-21swapper/11
1606911271,3sleep2421rcuc/22
1606338270,1sleep00-21swapper/00
1601416270,3sleep10-21swapper/11
1601121270,2sleep20-21swapper/22
1600553270,1sleep10-21swapper/11
1594804271,2sleep21594950-21find2
1585384270,2sleep10-21swapper/11
1579697270,1sleep10-21swapper/11
1565050271,3sleep20-21swapper/22
1555762271,3sleep20-21swapper/22
1548709270,2sleep10-21swapper/11
1542663270,1sleep20-21swapper/22
1538576270,4sleep10-21swapper/11
1533575271,2sleep01533608-21kthreadcore0
1532382271,3sleep0116341-21sshd0
1525889272,2sleep10-21swapper/11
1509616270,1sleep00-21swapper/00
1617459261,2sleep00-21swapper/00
1536513261,2sleep20-21swapper/22
1517087260,2sleep10-21swapper/11
1630837250,1sleep00-21swapper/00
1620666250,1sleep20-21swapper/22
1611622250,1sleep10-21swapper/11
1569545250,1sleep20-21swapper/22
1559063250,1sleep00-21swapper/00
1617131240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional