You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-15 - 11:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Mon Jun 15, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3585380211453,56sleep30-21swapper/33
358537428769,12sleep20-21swapper/22
358534428467,10sleep10-21swapper/11
358513628058,16sleep00-21swapper/00
3585587992211,8cyclictest0-21swapper/33
3585587992211,8cyclictest0-21swapper/33
378142922112,4sleep13715722-21diskmemload1
3585587992111,7cyclictest3825259-21taskset3
358558799211,16cyclictest0-21swapper/33
358558799205,12cyclictest3704676-21taskset3
358558799203,14cyclictest66950irq/132-enp1s0-TxRx-33
3585587992016,2cyclictest0-21swapper/33
3585587992016,2cyclictest0-21swapper/33
3585587992012,6cyclictest66950irq/132-enp1s0-TxRx-33
358558799201,15cyclictest0-21swapper/33
358558799200,16cyclictest66950irq/132-enp1s0-TxRx-33
358558799199,6cyclictest3683733-21turbostat3
358558799191,15cyclictest0-21swapper/33
358558799191,14cyclictest4068117-21chrt3
358558799191,14cyclictest0-21swapper/33
358558799191,14cyclictest0-21swapper/33
358558799191,14cyclictest0-21swapper/33
358558799191,14cyclictest0-21swapper/33
358558799191,14cyclictest0-21swapper/33
358558799191,14cyclictest0-21swapper/33
358558799191,13cyclictest0-21swapper/33
358558799190,16cyclictest0-21swapper/33
358558799190,15cyclictest511irq_work/33
38828812181,2sleep00-21swapper/00
358558799188,6cyclictest3651779-21turbostat3
358558799187,8cyclictest66950irq/132-enp1s0-TxRx-33
3585587991816,1cyclictest0-21swapper/33
3585587991811,4cyclictest0-21swapper/33
358558799181,14cyclictest0-21swapper/33
358558799181,14cyclictest0-21swapper/33
358558799181,14cyclictest0-21swapper/33
358558799181,14cyclictest0-21swapper/33
358558799181,13cyclictest0-21swapper/33
358558799181,13cyclictest0-21swapper/33
358558799181,13cyclictest0-21swapper/33
39567352172,8sleep13956792-21ntpq1
39355752171,11sleep23935055-21apt-get2
38601332171,11sleep03860242-21grep0
38146672171,3sleep20-21swapper/22
3585587991714,1cyclictest0-21swapper/33
358558799171,3cyclictest0-21swapper/33
358558799171,13cyclictest3984178-21taskset3
358558799171,13cyclictest0-21swapper/33
358558799171,13cyclictest0-21swapper/33
358558799171,13cyclictest0-21swapper/33
358558799171,13cyclictest0-21swapper/33
358558799171,12cyclictest0-21swapper/33
358558799170,14cyclictest0-21swapper/33
358558799170,14cyclictest0-21swapper/33
38917252161,7sleep13891738-21sh1
38669592161,3sleep10-21swapper/11
37892452161,9sleep23715722-21diskmemload2
37833802161,2sleep20-21swapper/22
37552702168,3sleep072-21kcompactd00
37371322161,3sleep13737194-21sed1
36987682161,11sleep23698820-21modprobe2
36311402160,2sleep0171rcu_preempt0
358558799161,3cyclictest0-21swapper/33
3585587991611,3cyclictest0-21swapper/33
358558799161,13cyclictest0-21swapper/33
3585587991610,4cyclictest0-21swapper/33
358558799160,14cyclictest0-21swapper/33
358558799160,13cyclictest0-21swapper/33
358558799160,13cyclictest0-21swapper/33
358558799160,13cyclictest0-21swapper/33
358558799160,12cyclictest0-21swapper/33
39946152151,8sleep13994880-21df1
39696712151,8sleep13969804-21diskstats1
39415752151,4sleep03715722-21diskmemload0
38753972152,9sleep03715722-21diskmemload0
37995392151,2sleep00-21swapper/00
36138232151,6sleep03614016-21unixbench_multi0
358558799150,13cyclictest0-21swapper/33
358558799150,13cyclictest0-21swapper/33
358558799150,12cyclictest0-21swapper/33
358558799150,12cyclictest0-21swapper/33
358558799150,12cyclictest0-21swapper/33
358558799150,12cyclictest0-21swapper/33
358558799150,10cyclictest0-21swapper/33
40352852141,3sleep10-21swapper/11
39865592141,3sleep03986776-21ssh0
39327702141,2sleep20-21swapper/22
39017132141,9sleep23901727-21ssh2
38326282141,8sleep03715722-21diskmemload0
37736902141,8sleep03715722-21diskmemload0
37324012141,8sleep03715722-21diskmemload0
37311472141,3sleep13731158-21ssh1
36773642141,6sleep13677402-21ntpq1
36187852141,4sleep03618837-21ld0
358558799148,4cyclictest3662307-21chrt3
358558799148,4cyclictest3662307-21chrt3
358558799147,4cyclictest35931032sleep33
358558799147,4cyclictest35931032sleep33
358558799140,2cyclictest0-21swapper/33
358558799140,12cyclictest0-21swapper/33
358558799140,11cyclictest0-21swapper/33
40445312131,6sleep10-21swapper/11
39660802131,5sleep10-21swapper/11
39505112133,4sleep0151ktimers/00
39006002131,3sleep03900611-21ssh0
38908792131,6sleep23715722-21diskmemload2
38563842131,4sleep13856398-21ssh1
38249032131,4sleep23824917-21ssh2
38240232131,1sleep10-21swapper/11
38172652131,8sleep03817445-21cat0
37897262130,2sleep00-21swapper/00
37484172131,8sleep23748428-21ssh2
37397332131,2sleep23715722-21diskmemload2
358558799131,9cyclictest3657086-21turbostat3
358558799130,2cyclictest0-21swapper/33
40616092121,3sleep24061620-21ssh2
40519622121,7sleep04051972-21ssh0
40102452121,7sleep14010255-21ssh1
40102452121,7sleep14010255-21ssh1
39922192121,7sleep13992231-21ssh1
39325192121,5sleep00-21swapper/00
39258352120,2sleep10-21swapper/11
39007562121,7sleep13900766-21ssh1
38578172121,3sleep23857828-21ssh2
38500362121,6sleep03715722-21diskmemload0
38134362121,5sleep13813499-21ntpq1
38088382121,5sleep20-21swapper/22
37982632122,2sleep20-21swapper/22
36804662121,2sleep20-21swapper/22
36670612121,3sleep03667091-21switchtime0
36666562122,5sleep23666745-21ntpq2
36613852121,6sleep13661431-21ntpq1
36613852121,6sleep13661431-21ntpq1
36133892121,6sleep13613477-21ntpq1
40686932111,5sleep03715722-21diskmemload0
40260472111,4sleep23715722-21diskmemload2
40190002111,3sleep00-21swapper/00
40177612111,5sleep13715722-21diskmemload1
40102092111,3sleep20-21swapper/22
40102092111,3sleep20-21swapper/22
39907242111,2sleep20-21swapper/22
39855632110,5sleep10-21swapper/11
39831182111,4sleep00-21swapper/00
39616262111,6sleep03715722-21diskmemload0
39169272111,3sleep10-21swapper/11
39017622111,5sleep03902025-21df0
38929622111,3sleep00-21swapper/00
38815892111,6sleep13881599-21ssh1
38653332111,3sleep20-21swapper/22
38358752111,2sleep20-21swapper/22
38087292111,6sleep13808736-21ssh1
37979542111,5sleep10-21swapper/11
37732302110,1sleep10-21swapper/11
37645322110,7sleep23715722-21diskmemload2
37481172111,4sleep10-21swapper/11
37381362111,5sleep03715722-21diskmemload0
36778432111,5sleep03678019-21users0
36044432111,7sleep20-21swapper/22
36035252111,5sleep23603549-21munin-run2
35931262111,3sleep03593330-21cat0
35931262111,3sleep03593330-21cat0
40690572101,3sleep10-21swapper/11
40674642101,2sleep20-21swapper/22
40596292101,4sleep03715722-21diskmemload0
40592592100,2sleep10-21swapper/11
40506382100,2sleep10-21swapper/11
40378752102,4sleep00-21swapper/00
40347872101,4sleep23715722-21diskmemload2
40208652101,6sleep00-21swapper/00
40188092101,4sleep23715722-21diskmemload2
40032882101,4sleep03715722-21diskmemload0
40032882101,4sleep03715722-21diskmemload0
40025202101,3sleep20-21swapper/22
40014692101,4sleep03715722-21diskmemload0
39769472101,4sleep03715722-21diskmemload0
39762502101,2sleep20-21swapper/22
39659482100,6sleep23715722-21diskmemload2
39598862101,3sleep20-21swapper/22
39525022101,4sleep03952524-21apt-get0
39492322101,4sleep23715722-21diskmemload2
39377172101,5sleep13938480-21kthreadcore1
39339302101,2sleep10-21swapper/11
39239772101,4sleep23715722-21diskmemload2
39185832101,4sleep03918604-21apt-get0
39178822101,4sleep23715722-21diskmemload2
39162062101,4sleep03715722-21diskmemload0
39081032100,1sleep10-21swapper/11
38989712101,2sleep20-21swapper/22
38836982101,2sleep20-21swapper/22
38753182100,2sleep10-21swapper/11
38730602101,4sleep23715722-21diskmemload2
38384332101,3sleep00-21swapper/00
38244982101,4sleep03715722-21diskmemload0
38049342101,4sleep03715722-21diskmemload0
37808582101,4sleep03715722-21diskmemload0
37670112101,3sleep20-21swapper/22
37645662101,4sleep13731992-21kworker/u16:2+rpciod1
37296182101,3sleep23715722-21diskmemload2
37228302101,4sleep13715722-21diskmemload1
37210172101,3sleep20-21swapper/22
37159882101,5sleep03716002-21ssh0
37150182101,2sleep00-21swapper/00
37014142101,6sleep13703174-21tr1
36893302101,4sleep03689349-21apt-get0
36517692101,4sleep13651818-21munin-run1
36454672101,5sleep03645518-21ntpq0
36366072101,5sleep03637474-21kthreadcore0
36301812101,6sleep03630184-21sshd0
36206522101,5sleep23621715-21cat2
36033452101,3sleep172-21kcompactd01
35975522101,5sleep23597796-21/usr/sbin/munin2
35975522101,5sleep23597796-21/usr/sbin/munin2
4050785291,4sleep24050799-21ssh2
4044065291,2sleep20-21swapper/22
4020560291,3sleep14020583-21apt-get1
3982526291,5sleep23982725-21vmstat2
3947361291,4sleep13948150-21/usr/sbin/munin1
3856282290,5sleep03715722-21diskmemload0
3849095291,3sleep13715722-21diskmemload1
3848498291,2sleep20-21swapper/22
3839748291,2sleep10-21swapper/11
3832227291,3sleep23715722-21diskmemload2
3825863291,3sleep10-21swapper/11
3764734291,2sleep00-21swapper/00
3757674291,4sleep23757688-21ssh2
3755136291,3sleep13715722-21diskmemload1
3747353290,1sleep00-21swapper/00
3698712291,4sleep13698766-21ntpq1
3668466291,4sleep13668582-21irqstats1
3662977291,4sleep13663187-21/usr/sbin/munin1
3656085291,4sleep03656140-21ntpq0
3632296291,4sleep23634060-21cut2
3624441291,4sleep03624677-21grep0
3619114291,4sleep23619348-21unixbench_multi2
3614768291,4sleep13615027-21df_inode1
3587586292,3sleep13589387-21cut1
4029544281,3sleep04030398-21ssh0
3789877280,2sleep10-21swapper/11
3710644280,3sleep23710663-21apt-get2
3700548281,3sleep03701413-21cut0
3690209281,4sleep13691892-21grep1
3684298281,3sleep13684508-21hddtemp_smartct1
3668583283,2sleep23669665-21kthreadcore2
3662124280,1sleep20-21swapper/22
3662124280,1sleep20-21swapper/22
3657691281,3sleep03657885-21/usr/sbin/munin0
3657691281,3sleep03657885-21/usr/sbin/munin0
3651725280,1sleep20-21swapper/22
3634781281,3sleep13634832-21ntpq1
3625937281,4sleep23626450-21kthreadcore2
3613478281,3sleep23613525-21ntpq2
3710243270,1sleep10-21swapper/11
3709224270,3sleep20-21swapper/22
3688713270,1sleep20-21swapper/22
3688121270,3sleep03688175-21ntpq0
3683648270,1sleep10-21swapper/11
3656974270,1sleep10-21swapper/11
3646437270,1sleep20-21swapper/22
3646193270,1sleep10-21swapper/11
3637476271,3sleep10-21swapper/11
3608824270,1sleep10-21swapper/11
3600297270,3sleep0221rcuc/00
3714513260,2sleep13714658-21strings1
3704135261,2sleep20-21swapper/22
3698630261,2sleep03698711-21ldconfig0
3694310260,1sleep20-21swapper/22
3674816261,2sleep23676567-21kthreadcore2
3648056261,2sleep00-21swapper/00
3629297261,2sleep10-21swapper/11
3604030260,2sleep00-21swapper/00
3590903261,2sleep10-21swapper/11
3590903261,2sleep10-21swapper/11
3590737260,2sleep23590738-21sshd2
3586329261,2sleep00-21swapper/00
3706467250,2sleep03708168-21cut0
3671464250,3sleep00-21swapper/00
3656957251,1sleep20-21swapper/22
3636333250,1sleep20-21swapper/22
3624030250,1sleep10-21swapper/11
3678653240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional