You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 06:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Thu May 07, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
389820821260,2sleep20-21swapper/22
3466334211858,56sleep30-21swapper/33
346651028652,12sleep20-21swapper/22
346643128468,10sleep10-21swapper/11
346647527753,18sleep00-21swapper/00
3466700992522,1cyclictest0-21swapper/33
3466700992521,2cyclictest0-21swapper/33
3466700992521,2cyclictest0-21swapper/33
3466700992420,2cyclictest0-21swapper/33
3466700992320,1cyclictest0-21swapper/33
346670099216,12cyclictest0-21swapper/33
346670099215,12cyclictest0-21swapper/33
3466700992118,1cyclictest0-21swapper/33
3466700992118,1cyclictest0-21swapper/33
3466700992118,1cyclictest0-21swapper/33
3466700992118,1cyclictest0-21swapper/33
3466700992112,5cyclictest0-21swapper/33
38117272201,13sleep23811743-21/usr/sbin/munin2
3466700992016,2cyclictest0-21swapper/33
3466700992016,2cyclictest0-21swapper/33
3466700992016,2cyclictest0-21swapper/33
3466700992011,6cyclictest3720145-21taskset3
346670099201,16cyclictest0-21swapper/33
35542442190,10sleep23554263-21apt-get2
34996382191,8sleep23499687-21ntpq2
346670099197,8cyclictest3908158-21taskset3
346670099192,15cyclictest66950irq/132-enp1s0-TxRx-33
3466700991917,1cyclictest0-21swapper/33
3466700991917,1cyclictest0-21swapper/33
3466700991916,1cyclictest0-21swapper/33
3466700991916,1cyclictest0-21swapper/33
3466700991914,2cyclictest0-21swapper/33
3466700991912,3cyclictest37988632chrt3
346670099191,15cyclictest0-21swapper/33
346670099191,14cyclictest0-21swapper/33
346670099191,14cyclictest0-21swapper/33
346670099190,16cyclictest66950irq/132-enp1s0-TxRx-33
39385532181,3sleep10-21swapper/11
39311982180,4sleep03596628-21diskmemload0
38895642180,3sleep23889577-21sh2
38473372181,3sleep00-21swapper/00
36228742181,12sleep13622996-21/usr/sbin/munin1
3466700991816,1cyclictest0-21swapper/33
3466700991815,1cyclictest0-21swapper/33
3466700991815,1cyclictest0-21swapper/33
3466700991815,1cyclictest0-21swapper/33
3466700991812,3cyclictest0-21swapper/33
346670099181,14cyclictest3770528-21taskset3
346670099181,14cyclictest3706052-21turbostat3
346670099181,14cyclictest0-21swapper/33
346670099181,14cyclictest0-21swapper/33
346670099181,14cyclictest0-21swapper/33
346670099181,14cyclictest0-21swapper/33
346670099181,14cyclictest0-21swapper/33
346670099181,13cyclictest0-21swapper/33
346670099181,13cyclictest0-21swapper/33
38801352171,3sleep00-21swapper/00
38544302171,4sleep23596628-21diskmemload2
3466700991714,1cyclictest0-21swapper/33
3466700991713,2cyclictest0-21swapper/33
3466700991712,2cyclictest0-21swapper/33
346670099170,15cyclictest0-21swapper/33
346670099170,14cyclictest0-21swapper/33
346670099170,13cyclictest0-21swapper/33
39295802160,2sleep13929591-21ssh1
37724932161,10sleep03596628-21diskmemload0
37704572161,2sleep10-21swapper/11
36860652161,4sleep03686318-21users0
36703652161,4sleep03596628-21diskmemload0
36547512161,4sleep23596628-21diskmemload2
36268762161,11sleep03626937-21ntpq0
36015252161,10sleep03601584-21ntpq0
346670099162,12cyclictest0-21swapper/33
3466700991613,2cyclictest0-21swapper/33
3466700991613,1cyclictest0-21swapper/33
3466700991612,2cyclictest0-21swapper/33
3466700991612,2cyclictest0-21swapper/33
3466700991611,3cyclictest3479568-21chrt3
346670099161,12cyclictest0-21swapper/33
346670099160,13cyclictest0-21swapper/33
346670099160,13cyclictest0-21swapper/33
39465112151,4sleep23946525-21ssh2
37630722151,4sleep03763083-21ssh0
37545752151,5sleep13596628-21diskmemload1
37540852151,4sleep03596628-21diskmemload0
37054092151,3sleep20-21swapper/22
36686562151,8sleep23668714-21ntpq2
346670099157,5cyclictest3516659-21turbostat3
346670099156,5cyclictest0-21swapper/33
3466700991513,1cyclictest0-21swapper/33
346670099151,2cyclictest0-21swapper/33
3466700991512,2cyclictest0-21swapper/33
346670099150,13cyclictest0-21swapper/33
346670099150,13cyclictest0-21swapper/33
346670099150,13cyclictest0-21swapper/33
346670099150,12cyclictest0-21swapper/33
38903742141,9sleep03890388-21ssh0
38659812141,8sleep072-21kcompactd00
38659812141,8sleep072-21kcompactd00
38655262141,4sleep03865540-21ssh0
38390432141,8sleep03596628-21diskmemload0
38227382141,9sleep23822741-21ssh2
36813492141,2sleep10-21swapper/11
36363692141,2sleep10-21swapper/11
3466700991411,1cyclictest0-21swapper/33
346670099140,11cyclictest0-21swapper/33
39289192131,6sleep23928983-21ntpq2
39059442131,4sleep23905955-21sh2
39048262131,7sleep03596628-21diskmemload0
38970282131,8sleep03897041-21sh0
38715972131,8sleep13871608-21ssh1
38715972131,8sleep13871608-21ssh1
38644042131,4sleep23864414-21ssh2
38641962131,8sleep13864208-21ssh1
37707732131,7sleep20-21swapper/22
37454412130,2sleep20-21swapper/22
37452852131,2sleep10-21swapper/11
37137712131,3sleep13713782-21ssh1
36770102130,2sleep20-21swapper/22
36617632131,8sleep23661777-21ssh2
35902782130,2sleep20-21swapper/22
35536322130,2sleep10-21swapper/11
35494882131,8sleep03550348-21cut0
35209722131,2sleep20-21swapper/22
39473712121,2sleep03947382-21ssh0
39371622121,4sleep20-21swapper/22
39081242121,5sleep23908148-21apt-get2
38461572120,3sleep23846171-21ssh2
38152772120,8sleep03815419-21cat0
38078232121,7sleep13809269-21kthreadcore1
37961892121,6sleep23596628-21diskmemload2
37893472121,6sleep23596628-21diskmemload2
37607572121,5sleep13760856-21ntpq1
37557742121,5sleep20-21swapper/22
37356542121,7sleep13735702-21ntpq1
37310292121,5sleep23596628-21diskmemload2
37308762121,3sleep13730890-21ssh1
37292572121,7sleep03729267-21ssh0
37210362120,2sleep10-21swapper/11
37197442120,8sleep23719766-21ssh2
36946952120,1sleep10-21swapper/11
36867682120,8sleep23686782-21ssh2
36131702121,7sleep00-21swapper/00
36117232121,6sleep23596628-21diskmemload2
36104652121,3sleep13610477-21ssh1
35966162121,6sleep03596991-21sed0
35329452121,6sleep23532964-21apt-get2
39391662111,4sleep03596628-21diskmemload0
39140252111,5sleep03596628-21diskmemload0
38989432111,6sleep13898953-21ssh1
38884302110,1sleep10-21swapper/11
38553452111,2sleep00-21swapper/00
38314802111,3sleep00-21swapper/00
38297232111,2sleep20-21swapper/22
38290022111,6sleep13596628-21diskmemload1
38043632111,5sleep23804364-21sh2
37988962111,5sleep03799164-21df_inode0
37966592111,6sleep13596628-21diskmemload1
37733532111,5sleep03596628-21diskmemload0
37647082111,5sleep20-21swapper/22
37397312111,5sleep03596628-21diskmemload0
37360132111,3sleep20-21swapper/22
37128192111,5sleep03596628-21diskmemload0
36926582111,5sleep03596628-21diskmemload0
36470452111,3sleep20-21swapper/22
36368432112,4sleep23596628-21diskmemload2
36282592111,3sleep20-21swapper/22
36195532111,5sleep23596628-21diskmemload2
36035902110,2sleep13603604-21ssh1
36034162111,4sleep20-21swapper/22
35690252111,5sleep13569079-21ntpq1
35640492111,4sleep13564266-21users1
35118422111,6sleep23511891-21grep2
35035702111,4sleep23504818-21memory2
34709252111,5sleep13470973-21ntpq1
34709252111,5sleep13470973-21ntpq1
39168042101,6sleep23596628-21diskmemload2
39162462100,6sleep13596628-21diskmemload1
39130682101,2sleep10-21swapper/11
38785912101,4sleep13878659-21ntp_states1
38662752102,4sleep23866382-21tune2fs2
38662752102,4sleep23866382-21tune2fs2
38561252101,3sleep13596628-21diskmemload1
38470652101,4sleep13596628-21diskmemload1
38378242101,2sleep10-21swapper/11
38213532101,4sleep03596628-21diskmemload0
38209102101,3sleep10-21swapper/11
38049242101,4sleep13596628-21diskmemload1
37804302101,3sleep20-21swapper/22
37740692101,5sleep13775300-21kthreadcore1
37385622102,4sleep00-21swapper/00
37151572100,6sleep03715293-21gltestperf0
37132642101,2sleep20-21swapper/22
37045292101,4sleep13596628-21diskmemload1
37042872100,1sleep00-21swapper/00
36937602101,5sleep23693808-21ntpq2
36799892101,4sleep03596628-21diskmemload0
36786582101,3sleep10-21swapper/11
36615822101,4sleep13596628-21diskmemload1
36519402101,4sleep10-21swapper/11
36452402101,5sleep1578-21rs:main1
36448712101,4sleep03596628-21diskmemload0
36195902101,4sleep10-21swapper/11
35838552101,5sleep03584794-21expr0
35755762101,4sleep03575834-21df_inode0
35476662101,4sleep13547715-21ntpq1
35422462101,5sleep23542284-21ntpq2
35422462101,5sleep23542284-21ntpq2
35276652101,5sleep23527862-21diskstats2
35239732101,6sleep13524338-21kthreadcore1
35222622101,5sleep03522312-21grep0
35219642102,4sleep11540068-21cups-browsed1
35018412100,6sleep13503568-21kthreadcore1
35009142101,4sleep03500933-21apt-get0
34783482101,4sleep23478405-21ntp_states2
34742252101,5sleep03474244-21apt-get0
3945303291,2sleep10-21swapper/11
3918656291,3sleep03596628-21diskmemload0
3907577291,4sleep13907587-21ssh1
3879264291,2sleep20-21swapper/22
3834073291,5sleep23835786-21kthreadcore2
3795319291,2sleep00-21swapper/00
3789599291,4sleep03789609-21ssh0
3786684291,3sleep13596628-21diskmemload1
3656010291,4sleep03656022-21ssh0
3652200291,3sleep00-21swapper/00
3636028291,2sleep00-21swapper/00
3620337290,3sleep00-21swapper/00
3586517291,4sleep03586727-21hddtemp_smartct0
3575294291,4sleep03575310-21dump-pmu-power0
3565487291,4sleep03566444-21grep0
3564484290,4sleep00-21swapper/00
3532517290,2sleep00-21swapper/00
3489624290,1sleep00-21swapper/00
3484942291,4sleep13485121-21expr1
3483701291,4sleep13483760-21ntpq1
3474798291,4sleep13476193-21grep1
3669946280,2sleep10-21swapper/11
3596598281,3sleep13596592-21fwupd1
3585525280,1sleep10-21swapper/11
3549209281,4sleep23549317-21uniq2
3543578280,3sleep03543597-21apt-get0
3537699281,3sleep172-21kcompactd01
3532607281,4sleep1802-21snmpd1
3511565281,2sleep00-21swapper/00
3511020280,1sleep20-21swapper/22
3492227281,3sleep03494053-21cut0
3490249281,3sleep23490268-21apt-get2
3489292281,3sleep23489466-21cat2
3479581280,3sleep03479599-21apt-get0
3471965280,1sleep20-21swapper/22
3471965280,1sleep20-21swapper/22
3580880270,2sleep20-21swapper/22
3580379270,4sleep10-21swapper/11
3580275270,1sleep20-21swapper/22
3571975271,3sleep13572318-21kthreadcore1
3569289270,1sleep20-21swapper/22
3559573270,2sleep20-21swapper/22
3559035270,2sleep1171rcu_preempt1
3542132270,2sleep13542240-21strings1
3542132270,2sleep13542240-21strings1
3509220271,2sleep13489687-21kworker/1:1+events1
3499403270,2sleep03499576-21strings0
3593641261,2sleep20-21swapper/22
3575077260,1sleep20-21swapper/22
3556219261,2sleep00-21swapper/00
3545777261,2sleep20-21swapper/22
3525787261,2sleep20-21swapper/22
3512675261,2sleep10-21swapper/11
3507468261,2sleep00-21swapper/00
3499582261,2sleep10-21swapper/11
3479861260,2sleep20-21swapper/22
3470746260,2sleep03470919-21strings0
3470746260,2sleep03470919-21strings0
3586227250,1sleep10-21swapper/11
3543108250,1sleep00-21swapper/00
3543108250,1sleep00-21swapper/00
3537860250,3sleep00-21swapper/00
3521082250,2sleep00-21swapper/00
3490539250,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional