You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-31 - 06:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Mon Aug 31, 2026 00:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
303351921360,3sleep03033520-21idleruntime-cro0
2853688213154,71sleep30-21swapper/33
2853688213154,71sleep30-21swapper/33
315642121030,2sleep00-21swapper/00
285372628880,5sleep10-21swapper/11
285372628880,5sleep10-21swapper/11
285369728163,12sleep20-21swapper/22
285369728163,12sleep20-21swapper/22
285360527656,14sleep00-21swapper/00
285360527656,14sleep00-21swapper/00
30792952370,2sleep00-21swapper/00
33320382281,14sleep00-21swapper/00
285401499211,16cyclictest0-21swapper/33
285401499211,16cyclictest0-21swapper/33
285401499211,15cyclictest0-21swapper/33
285401499201,5cyclictest0-21swapper/33
285401499201,15cyclictest0-21swapper/33
285401499201,15cyclictest0-21swapper/33
30734872198,5sleep1331ktimers/11
285401499192,14cyclictest66950irq/132-enp1s0-TxRx-33
285401499191,15cyclictest0-21swapper/33
285401499191,14cyclictest66950irq/132-enp1s0-TxRx-33
285401499191,14cyclictest0-21swapper/33
285401499191,14cyclictest0-21swapper/33
285401499191,14cyclictest0-21swapper/33
285401499191,14cyclictest0-21swapper/33
2854014991910,6cyclictest3326731-21taskset3
285401499190,16cyclictest0-21swapper/33
285401499189,6cyclictest3068151-21taskset3
2854014991814,2cyclictest0-21swapper/33
285401499181,14cyclictest0-21swapper/33
285401499181,14cyclictest0-21swapper/33
285401499181,14cyclictest0-21swapper/33
285401499181,14cyclictest0-21swapper/33
285401499181,14cyclictest0-21swapper/33
285401499181,14cyclictest0-21swapper/33
285401499181,14cyclictest0-21swapper/33
285401499181,14cyclictest0-21swapper/33
285401499181,14cyclictest0-21swapper/33
285401499181,14cyclictest0-21swapper/33
285401499181,14cyclictest0-21swapper/33
285401499181,14cyclictest0-21swapper/33
285401499181,14cyclictest0-21swapper/33
285401499181,13cyclictest2898124-21turbostat3
285401499181,13cyclictest0-21swapper/33
285401499181,13cyclictest0-21swapper/33
285401499181,13cyclictest0-21swapper/33
285401499181,13cyclictest0-21swapper/33
285401499181,13cyclictest0-21swapper/33
2854014991810,5cyclictest2913539-21taskset3
285401499180,15cyclictest0-21swapper/33
285401499180,14cyclictest0-21swapper/33
285401499180,14cyclictest0-21swapper/33
285401499180,14cyclictest0-21swapper/33
32718022171,4sleep12982116-21diskmemload1
32304992170,1sleep10-21swapper/11
285401499178,6cyclictest2866454-21turbostat3
285401499172,12cyclictest0-21swapper/33
285401499171,4cyclictest0-21swapper/33
285401499171,13cyclictest0-21swapper/33
285401499171,13cyclictest0-21swapper/33
285401499171,12cyclictest0-21swapper/33
285401499170,14cyclictest66950irq/132-enp1s0-TxRx-33
285401499170,14cyclictest0-21swapper/33
285401499170,14cyclictest0-21swapper/33
285401499170,14cyclictest0-21swapper/33
285401499170,14cyclictest0-21swapper/33
33179842161,3sleep10-21swapper/11
32976612161,3sleep10-21swapper/11
32278282161,3sleep00-21swapper/00
31797372161,5sleep13179927-21gltestperf1
31765972161,3sleep13176609-21ssh1
29891772161,2sleep00-21swapper/00
2854014991611,3cyclictest0-21swapper/33
285401499161,10cyclictest2903633-21taskset3
285401499160,13cyclictest0-21swapper/33
285401499160,13cyclictest0-21swapper/33
33440512151,8sleep13344150-21munin-run1
33164532150,1sleep20-21swapper/22
31673252151,2sleep00-21swapper/00
30603222151,3sleep02982116-21diskmemload0
30404242151,4sleep12982116-21diskmemload1
30168162151,4sleep12982116-21diskmemload1
30045452150,9sleep02982116-21diskmemload0
30045452150,9sleep02982116-21diskmemload0
28883162151,4sleep12888386-21irqstats1
2854014991512,1cyclictest0-21swapper/33
2854014991512,1cyclictest0-21swapper/33
285401499151,12cyclictest0-21swapper/33
285401499151,11cyclictest28926552sleep33
285401499150,13cyclictest0-21swapper/33
285401499150,12cyclictest0-21swapper/33
285401499150,12cyclictest0-21swapper/33
285401499150,12cyclictest0-21swapper/33
285401499150,11cyclictest0-21swapper/33
32903402141,3sleep02982116-21diskmemload0
32774762140,2sleep00-21swapper/00
32177912141,7sleep23217877-21ntp_states2
31623032141,7sleep13162334-21apt-get1
31597292141,9sleep13159743-21ssh1
31526862141,7sleep02982116-21diskmemload0
31426882140,2sleep20-21swapper/22
31236222142,6sleep13123773-21ntp_192.168.1141
29452172140,1sleep00-21swapper/00
29088682140,2sleep10-21swapper/11
28979602141,2sleep00-21swapper/00
2854014991411,2cyclictest0-21swapper/33
2854014991411,2cyclictest0-21swapper/33
285401499140,11cyclictest0-21swapper/33
33253072131,8sleep03325322-21ssh0
33149852130,2sleep03314999-21ssh0
32540432131,8sleep23254053-21ssh2
32295112130,8sleep13229523-21ssh1
32231142130,2sleep20-21swapper/22
32212332130,3sleep03221247-21ssh0
31765842131,7sleep02982116-21diskmemload0
31187952131,8sleep03118804-21ssh0
30830942131,2sleep20-21swapper/22
30772762131,3sleep13077433-21ssh1
30757452131,8sleep03075759-21ssh0
30663452132,5sleep22982116-21diskmemload2
30572812131,7sleep22982116-21diskmemload2
30150162131,6sleep00-21swapper/00
29338342131,7sleep12933949-21/usr/sbin/munin1
29209432132,3sleep02922614-21cut0
33329022121,7sleep23332913-21ssh2
33257682121,6sleep12982116-21diskmemload1
32808192125,3sleep13273430-40find1
32630892121,6sleep10-21swapper/11
32564542121,6sleep03256681-21expr0
32437832123,5sleep13243955-21wc1
32119512120,4sleep03151681-21kworker/0:2+events0
32017912121,6sleep02982116-21diskmemload0
31502752121,7sleep23150283-21ssh2
31452532121,7sleep12982116-21diskmemload1
31380862126,3sleep10-21swapper/11
31281302122,5sleep23128155-21apt-get2
30905562120,1sleep00-21swapper/00
30573622121,3sleep10-21swapper/11
30409052121,7sleep03040918-21sh0
29985772121,3sleep22998588-21ssh2
29718582121,7sleep039542-21systemd-journal0
29253752120,9sleep22926983-21kthreadcore2
28983932122,4sleep22898395-21apt-get2
28673532121,2sleep10-21swapper/11
33420202111,4sleep00-21swapper/00
33231632111,6sleep23323395-21head2
33084212110,5sleep22982116-21diskmemload2
33075542110,2sleep02982116-21diskmemload0
33006002111,4sleep22982116-21diskmemload2
32482822111,6sleep03248325-21fschecks_count0
32377632111,3sleep00-21swapper/00
32218492111,6sleep13221919-21munin-run1
32014232111,3sleep20-21swapper/22
31872932111,2sleep20-21swapper/22
31871812111,4sleep02982116-21diskmemload0
31686002110,7sleep23168612-21sh2
31614212111,2sleep20-21swapper/22
31176322111,4sleep22982116-21diskmemload2
31095562110,7sleep23109567-21ssh2
31082962111,3sleep10-21swapper/11
31015802111,6sleep22982116-21diskmemload2
30981282111,5sleep02982116-21diskmemload0
30930632110,3sleep23093071-21ssh2
30928562111,4sleep10-21swapper/11
30325042110,1sleep10-21swapper/11
30215592111,4sleep22982116-21diskmemload2
29973922110,4sleep00-21swapper/00
29457832111,4sleep22945906-21diskstats2
29379242111,5sleep12939026-21memory1
28602412111,6sleep12861297-21if_enp1s01
33422482101,3sleep20-21swapper/22
33065172101,3sleep10-21swapper/11
32996702101,3sleep00-21swapper/00
32904802101,2sleep10-21swapper/11
32895222101,3sleep20-21swapper/22
32810882101,6sleep23281100-21rm2
32724942101,3sleep22982116-21diskmemload2
32713502101,4sleep02982116-21diskmemload0
32567482101,5sleep23256972-21hddtemp_smartct2
32527482101,5sleep13252762-21ssh1
32475572101,4sleep02982116-21diskmemload0
32393112101,5sleep23239040-21sendmail-msp2
32363522101,2sleep20-21swapper/22
32099892101,5sleep13210006-21ssh1
32052792101,2sleep20-21swapper/22
32006402101,4sleep13200710-21ntp_states1
31956842101,4sleep02982116-21diskmemload0
31930302101,5sleep10-21swapper/11
31762062100,1sleep20-21swapper/22
31435522101,3sleep02982116-21diskmemload0
31340722101,3sleep00-21swapper/00
31244832101,3sleep20-21swapper/22
31152392101,4sleep13115295-21ntp_states1
31093252101,4sleep02982116-21diskmemload0
30942352101,4sleep13094459-21hddtemp_smartct1
30659882101,4sleep12982116-21diskmemload1
30574532101,4sleep02982116-21diskmemload0
30505052100,6sleep23050512-21ssh2
30342782101,5sleep23034462-21ssh2
30325712100,2sleep23032585-21ssh2
30111012101,4sleep23012257-21memory2
30083742101,4sleep13008604-21df_inode1
30050132101,3sleep10-21swapper/11
30050132101,3sleep10-21swapper/11
30045182101,4sleep22999262-21sendmail-msp2
30045182101,4sleep22999262-21sendmail-msp2
29892432101,3sleep10-21swapper/11
29445422101,6sleep10-21swapper/11
29246232100,4sleep10-21swapper/11
29188022100,1sleep10-21swapper/11
29082302101,3sleep272-21kcompactd02
29030992100,3sleep10-21swapper/11
28958902101,4sleep22897023-21memory2
28881062101,5sleep02888315-21hddtemp_smartct0
28865722101,4sleep22886625-21ntp_states2
28776072101,5sleep22877824-21hddtemp_smartct2
28761452101,5sleep12876235-21wc1
3333036291,4sleep13333047-21ssh1
3192801291,4sleep23192814-21ssh2
3136197291,4sleep13136211-21ssh1
3126941291,3sleep02982116-21diskmemload0
3068188291,2sleep20-21swapper/22
3042499291,3sleep13042527-21apt-get1
3024815291,4sleep02982116-21diskmemload0
2996452290,2sleep10-21swapper/11
2982450291,4sleep22982463-21sh2
2972142291,4sleep12972190-21fschecks_count1
2967216291,4sleep22968684-21kthreadcore2
2950560291,3sleep22950626-21sendmail-msp2
2929906291,4sleep22929656-21sendmail-msp2
2918840290,1sleep00-21swapper/00
2913759290,2sleep00-21swapper/00
2894235292,4sleep1331ktimers/11
2888387291,5sleep22889470-21cut2
2882880291,4sleep12883096-21idleruntime1
2872620291,4sleep02872663-21kthreadcore0
2861462291,2sleep20-21swapper/22
2854221291,3sleep02854378-21cstates0
2854221291,3sleep02854378-21cstates0
3047455281,3sleep03047467-21ssh0
2977724281,3sleep00-21swapper/00
2961384280,2sleep20-21swapper/22
2936269281,3sleep02937920-21kthreadcore0
2879349281,3sleep12879431-21kthreadcore1
2877338280,4sleep02877483-21cstates0
2871422280,1sleep20-21swapper/22
2978482271,3sleep12980147-21kthreadcore1
2971860270,3sleep22971881-21dpkg2
2971568271,2sleep02971608-21munin-run0
2966629270,2sleep10-21swapper/11
2965193270,2sleep12965374-21strings1
2955512271,2sleep10-21swapper/11
2945616270,2sleep00-21swapper/00
2929883271,2sleep00-21swapper/00
2924096270,1sleep10-21swapper/11
2919399270,2sleep20-21swapper/22
2914459271,2sleep22914677-21smartctl2
2913617270,1sleep20-21swapper/22
2901135271,2sleep00-21swapper/00
2887424270,1sleep00-21swapper/00
2876917270,1sleep20-21swapper/22
2871743270,4sleep00-21swapper/00
2866274270,1sleep00-21swapper/00
2858925270,1sleep20-21swapper/22
2858925270,1sleep20-21swapper/22
2963419261,2sleep00-21swapper/00
2960988260,1sleep00-21swapper/00
2960761260,4sleep10-21swapper/11
2960310260,2sleep20-21swapper/22
2950873261,2sleep00-21swapper/00
2950288260,1sleep10-21swapper/11
2945095260,1sleep20-21swapper/22
2935148260,1sleep20-21swapper/22
2924611260,4sleep00-21swapper/00
2908293260,4sleep10-21swapper/11
2905454261,2sleep00-21swapper/00
2859118260,4sleep10-21swapper/11
2859118260,4sleep10-21swapper/11
2980150250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional