You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 15:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sun May 10, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1241298213057,69sleep30-21swapper/33
124134728152,10sleep20-21swapper/22
124150327964,9sleep10-21swapper/11
124134027454,14sleep00-21swapper/00
1241777992218,2cyclictest0-21swapper/33
124177799221,17cyclictest1465265-21taskset3
124177799213,14cyclictest0-21swapper/33
1241777992117,2cyclictest0-21swapper/33
124177799211,16cyclictest0-21swapper/33
124177799207,10cyclictest1702481-21turbostat3
124177799207,10cyclictest1702481-21turbostat3
124177799202,14cyclictest0-21swapper/33
1241777992011,7cyclictest0-21swapper/33
124177799201,16cyclictest1659615-21taskset3
124177799201,15cyclictest1665175-21taskset3
124177799201,15cyclictest0-21swapper/33
124177799201,15cyclictest0-21swapper/33
124177799200,18cyclictest0-21swapper/33
124177799200,17cyclictest66950irq/132-enp1s0-TxRx-33
124177799191,15cyclictest0-21swapper/33
124177799191,15cyclictest0-21swapper/33
124177799191,14cyclictest0-21swapper/33
124177799191,14cyclictest0-21swapper/33
124177799191,13cyclictest1340779-21taskset3
124177799190,17cyclictest0-21swapper/33
124177799190,16cyclictest0-21swapper/33
15334622181,8sleep21533473-21ssh2
14951152180,4sleep0221rcuc/00
13152182181,6sleep21316905-21kthreadcore2
124177799182,11cyclictest1357226-21taskset3
1241777991816,1cyclictest0-21swapper/33
1241777991815,1cyclictest0-21swapper/33
1241777991814,2cyclictest0-21swapper/33
124177799181,14cyclictest0-21swapper/33
124177799181,14cyclictest0-21swapper/33
124177799181,14cyclictest0-21swapper/33
124177799181,14cyclictest0-21swapper/33
124177799181,14cyclictest0-21swapper/33
124177799181,14cyclictest0-21swapper/33
124177799181,14cyclictest0-21swapper/33
124177799181,14cyclictest0-21swapper/33
124177799181,13cyclictest0-21swapper/33
124177799181,13cyclictest0-21swapper/33
124177799181,13cyclictest0-21swapper/33
124177799181,13cyclictest0-21swapper/33
124177799181,13cyclictest0-21swapper/33
17248852171,3sleep20-21swapper/22
16909912170,1sleep20-21swapper/22
14470002177,7sleep11241772-21cyclictest1
13793762171,3sleep00-21swapper/00
1241777991713,2cyclictest0-21swapper/33
124177799171,14cyclictest66950irq/132-enp1s0-TxRx-33
124177799171,14cyclictest0-21swapper/33
124177799171,13cyclictest0-21swapper/33
124177799171,13cyclictest0-21swapper/33
124177799171,13cyclictest0-21swapper/33
124177799171,13cyclictest0-21swapper/33
124177799171,12cyclictest0-21swapper/33
124177799170,15cyclictest0-21swapper/33
124177799170,14cyclictest0-21swapper/33
17238742160,3sleep10-21swapper/11
14877242161,9sleep01487788-21ntpq0
14816832161,10sleep11372931-21diskmemload1
124177799168,4cyclictest13452892sleep33
124177799164,10cyclictest0-21swapper/33
124177799160,13cyclictest0-21swapper/33
124177799160,13cyclictest0-21swapper/33
17182642151,3sleep11372931-21diskmemload1
15487832151,2sleep00-21swapper/00
15336602150,3sleep20-21swapper/22
15308132151,10sleep11530823-21ssh1
15151182151,9sleep21372931-21diskmemload2
15081762151,3sleep01508183-21ssh0
14299912151,4sleep21372931-21diskmemload2
124177799155,8cyclictest1241662-21turbostat3
124177799151,8cyclictest1346589-21taskset3
124177799151,13cyclictest0-21swapper/33
124177799151,10cyclictest1298619-21chrt3
124177799150,13cyclictest0-21swapper/33
124177799150,13cyclictest0-21swapper/33
124177799150,13cyclictest0-21swapper/33
124177799150,12cyclictest0-21swapper/33
124177799150,12cyclictest0-21swapper/33
16735802141,5sleep01673605-21switchtime0
16317332141,2sleep20-21swapper/22
16229742141,9sleep01622985-21ssh0
15755222141,4sleep21575537-21ssh2
15549672141,2sleep01555063-21ntpq0
15223602141,2sleep10-21swapper/11
15173162141,7sleep01517349-21ssh0
14392652141,2sleep20-21swapper/22
14329052140,2sleep10-21swapper/11
14201142141,4sleep21420171-21ntpq2
13860572141,6sleep01386105-21ntpq0
13760502141,8sleep21377289-21memory2
13622722141,9sleep01362289-21sendmail0
12757042141,3sleep11275636-31find1
124177799146,1cyclictest0-21swapper/33
1241777991410,2cyclictest0-21swapper/33
124177799140,12cyclictest0-21swapper/33
124177799140,12cyclictest0-21swapper/33
124177799140,11cyclictest0-21swapper/33
124177799140,11cyclictest0-21swapper/33
17080412132,7sleep2802-21snmpd2
17080412132,7sleep2802-21snmpd2
16985892131,6sleep01698645-21ntpq0
16492602130,3sleep21649271-21ssh2
16428162130,8sleep01372931-21diskmemload0
16336982130,4sleep11372931-21diskmemload1
15971052131,8sleep01597154-21ssh0
15898822131,4sleep01589892-21ssh0
15832542131,8sleep21372931-21diskmemload2
15725032131,5sleep00-21swapper/00
15062142131,7sleep11372931-21diskmemload1
14875512131,3sleep21487659-21ld2
14805182131,2sleep00-21swapper/00
14794802131,6sleep21479539-21ntpq2
14645762131,6sleep10-21swapper/11
14140392130,3sleep01372931-21diskmemload0
12870972133,6sleep21287437-21apt-key2
17256372121,7sleep01725651-21ssh0
16947292121,7sleep21694906-21/usr/sbin/munin2
16844392120,5sleep10-21swapper/11
16664602120,2sleep00-21swapper/00
16591412120,2sleep20-21swapper/22
16158682121,7sleep01615870-21ssh0
16065002121,5sleep20-21swapper/22
16006402120,7sleep11372931-21diskmemload1
15634062121,7sleep11563458-21awk1
15599812121,7sleep21561616-21cut2
14738132121,6sleep21372931-21diskmemload2
14564642121,7sleep21372931-21diskmemload2
14220512120,3sleep01422061-21ssh0
13409592124,5sleep014-21ksoftirqd/00
13234442121,7sleep21323934-21cut2
12713392121,4sleep20-21swapper/22
12693802121,7sleep11269431-21ld1
12460632121,7sleep11246118-21ntpq1
12460202121,5sleep01246061-21ntpq0
17084882111,4sleep11372931-21diskmemload1
17084882111,4sleep11372931-21diskmemload1
16915152111,7sleep01691526-21sh0
16762442110,6sleep10-21swapper/11
16678072111,3sleep20-21swapper/22
16445622111,7sleep01646048-21ssh0
16417042111,3sleep10-21swapper/11
16243602110,3sleep20-21swapper/22
16145602111,3sleep21614571-21ssh2
16094922111,4sleep11372931-21diskmemload1
16086892110,5sleep00-21swapper/00
16064382111,2sleep10-21swapper/11
15996232111,6sleep21599634-21ssh2
15914542111,3sleep10-21swapper/11
15813012111,6sleep11581315-21ssh1
15480912111,3sleep10-21swapper/11
15225562111,3sleep20-21swapper/22
15154772110,2sleep00-21swapper/00
15063272110,1sleep20-21swapper/22
14887442111,5sleep11372931-21diskmemload1
14696362111,5sleep01470726-21memory0
14658432110,6sleep00-21swapper/00
14574792110,2sleep0171rcu_preempt0
14540582111,5sleep11454108-21ntpq1
14378262111,4sleep01372931-21diskmemload0
14300182111,6sleep01430029-21ssh0
14164952111,6sleep11417812-21kthreadcore1
14073592111,5sleep11407383-21apt-get1
14053692111,2sleep21405384-21ssh2
14053492111,6sleep01405356-21ssh0
13829922111,6sleep11384652-21kthreadcore1
13559602111,5sleep11356007-21ntpq1
13559122111,7sleep01355958-21ntpq0
13507262111,6sleep21346568-21/usr/sbin/munin2
13286172111,6sleep11325244-21/usr/sbin/munin1
13145622111,5sleep11314581-21apt-get1
12944652111,6sleep11295063-21kthreadcore1
12757132111,5sleep01275636-31find0
12654672111,5sleep21265590-21diskstats2
12587662111,5sleep01258823-21ntp_states0
12534632111,5sleep11253516-21ntp_states1
17112852101,4sleep21711313-21apt-get2
16945022101,4sleep11694728-21diskstats1
16839352101,2sleep20-21swapper/22
16775202101,3sleep00-21swapper/00
16695452101,5sleep21669626-21irqstats2
16663312101,3sleep10-21swapper/11
16517852101,4sleep11651817-21ssh1
16436882101,3sleep10-21swapper/11
16399362101,4sleep21372931-21diskmemload2
16317062101,2sleep00-21swapper/00
15841302101,2sleep00-21swapper/00
15734702101,4sleep11372931-21diskmemload1
15662862101,4sleep01372931-21diskmemload0
15508592101,2sleep10-21swapper/11
15500432101,4sleep21372931-21diskmemload2
15390222101,3sleep11372931-21diskmemload1
15381132101,4sleep00-21swapper/00
15258262101,3sleep01372931-21diskmemload0
15146832101,3sleep10-21swapper/11
14977812101,5sleep21497792-21ssh2
14729402101,4sleep11372931-21diskmemload1
14633082100,2sleep20-21swapper/22
14490212101,2sleep00-21swapper/00
14468132101,4sleep21372931-21diskmemload2
14301932101,4sleep11372931-21diskmemload1
14130712101,3sleep20-21swapper/22
14055372100,6sleep11372931-21diskmemload1
13976442101,3sleep00-21swapper/00
13945982101,3sleep10-21swapper/11
13878752101,3sleep20-21swapper/22
13786162101,3sleep10-21swapper/11
13453402101,4sleep01345394-21ntpq0
13439582101,4sleep11345148-21memory1
13346112101,4sleep11334659-21ntpq1
12819602101,4sleep01281492-21apt-get0
1717448291,4sleep01717459-21ssh0
1709663291,2sleep00-21swapper/00
1709663291,2sleep00-21swapper/00
1692291291,3sleep11372931-21diskmemload1
1652119291,5sleep01652332-21sh0
1623452291,3sleep11372931-21diskmemload1
1590655290,2sleep20-21swapper/22
1550968291,4sleep21551193-21diskstats2
1497393291,3sleep11372931-21diskmemload1
1395407291,4sleep21395417-21ssh2
1362555290,4sleep01362575-21apt-get0
1334661291,3sleep21334715-21ntpq2
1329341292,3sleep01329386-21ntpq0
1319934291,4sleep01319984-21/usr/sbin/munin0
1304392291,4sleep11304508-21/usr/sbin/munin1
1357204280,2sleep20-21swapper/22
1346868281,3sleep11347084-21idleruntime1
1309806281,3sleep21310159-21kthreadcore2
1308896280,2sleep20-21swapper/22
1303534280,1sleep00-21swapper/00
1293536280,5sleep01294464-21cut0
1289643281,3sleep21291475-21grep2
1289643281,3sleep21291475-21grep2
1287653281,3sleep11287834-21cstates1
1287653281,3sleep11287834-21cstates1
1287631281,2sleep01287650-21apt-get0
1287631281,2sleep01287650-21apt-get0
1276907281,3sleep21277080-21kthreadcore2
1264806280,1sleep10-21swapper/11
1249894281,3sleep01251385-21kthreadcore0
1372221270,3sleep10-21swapper/11
1346067270,1sleep20-21swapper/22
1336474270,3sleep21337985-21/usr/sbin/munin2
1335892270,2sleep10-21swapper/11
1314551270,1sleep00-21swapper/00
1314302270,4sleep11314303-21cron1
1304228270,4sleep00-21swapper/00
1298597270,2sleep20-21swapper/22
1287074270,1sleep10-21swapper/11
1264094270,4sleep01264151-21ntp_states0
1254683270,1sleep20-21swapper/22
1372038260,3sleep20-21swapper/22
1368486261,2sleep00-21swapper/00
1364433261,2sleep20-21swapper/22
1363129261,2sleep10-21swapper/11
1356627260,1sleep20-21swapper/22
1350625261,2sleep01350678-21modprobe0
1321626261,2sleep10-21swapper/11
1314039260,1sleep00-21swapper/00
1298199260,1sleep10-21swapper/11
1297818260,4sleep20-21swapper/22
1280982260,2sleep11281119-21modprobe1
1276632261,2sleep00-21swapper/00
1265301260,1sleep00-21swapper/00
1259971260,2sleep20-21swapper/22
1259484260,4sleep10-21swapper/11
1253812260,2sleep20-21swapper/22
1361403250,1sleep10-21swapper/11
1334471250,2sleep00-21swapper/00
1329141250,2sleep20-21swapper/22
1246349250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional