You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 22:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Wed Jun 10, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3454876211861,53sleep30-21swapper/33
345978528163,12sleep20-21swapper/22
345958428063,12sleep10-21swapper/11
345962627753,7sleep00-21swapper/00
36227432520,2sleep23622742-21ssh2
36600762280,3sleep30-21swapper/33
36587752250,3sleep13658682-21ssh1
345997099251,16cyclictest0-21swapper/33
345997099232,16cyclictest36411752chrt3
3459970992218,2cyclictest0-21swapper/33
345997099221,18cyclictest0-21swapper/33
3459970992117,2cyclictest0-21swapper/33
345997099211,16cyclictest0-21swapper/33
345997099211,16cyclictest0-21swapper/33
345997099211,15cyclictest0-21swapper/33
345997099210,18cyclictest0-21swapper/33
38766892201,8sleep13590852-21diskmemload1
37000362201,2sleep10-21swapper/11
345997099201,15cyclictest0-21swapper/33
345997099200,16cyclictest66950irq/132-enp1s0-TxRx-33
37852222191,3sleep00-21swapper/00
36062322191,2sleep00-21swapper/00
36062322191,2sleep00-21swapper/00
3459970991915,2cyclictest3569188-21taskset3
345997099191,14cyclictest66950irq/132-enp1s0-TxRx-33
345997099191,14cyclictest0-21swapper/33
345997099191,14cyclictest0-21swapper/33
345997099190,17cyclictest0-21swapper/33
345997099190,16cyclictest0-21swapper/33
39190412181,5sleep03590852-21diskmemload0
38578742181,6sleep03857949-21grep0
3459970991814,2cyclictest0-21swapper/33
345997099181,14cyclictest0-21swapper/33
345997099181,14cyclictest0-21swapper/33
345997099181,14cyclictest0-21swapper/33
345997099181,14cyclictest0-21swapper/33
345997099181,14cyclictest0-21swapper/33
345997099181,14cyclictest0-21swapper/33
345997099181,14cyclictest0-21swapper/33
345997099181,14cyclictest0-21swapper/33
345997099181,14cyclictest0-21swapper/33
345997099181,14cyclictest0-21swapper/33
345997099181,14cyclictest0-21swapper/33
345997099181,13cyclictest0-21swapper/33
38176842171,4sleep03590852-21diskmemload0
37423242171,2sleep10-21swapper/11
37014482172,5sleep03590852-21diskmemload0
36254762171,6sleep03625612-21gltestperf0
345997099175,9cyclictest3494019-21turbostat3
3459970991713,2cyclictest0-21swapper/33
345997099171,13cyclictest0-21swapper/33
345997099171,13cyclictest0-21swapper/33
345997099171,13cyclictest0-21swapper/33
345997099171,13cyclictest0-21swapper/33
345997099171,13cyclictest0-21swapper/33
345997099171,13cyclictest0-21swapper/33
345997099171,13cyclictest0-21swapper/33
345997099171,13cyclictest0-21swapper/33
345997099171,13cyclictest0-21swapper/33
345997099171,13cyclictest0-21swapper/33
345997099171,13cyclictest0-21swapper/33
345997099170,15cyclictest0-21swapper/33
345997099170,14cyclictest0-21swapper/33
345997099170,14cyclictest0-21swapper/33
345997099170,14cyclictest0-21swapper/33
345997099170,14cyclictest0-21swapper/33
38355602160,2sleep00-21swapper/00
345997099165,8cyclictest3585524-21turbostat3
345997099161,13cyclictest0-21swapper/33
345997099161,12cyclictest0-21swapper/33
39453522151,3sleep03945366-21ssh0
39166522151,8sleep13916713-21ntpq1
39080532151,8sleep13908114-21ntpq1
38679732151,3sleep03590852-21diskmemload0
38272122151,2sleep20-21swapper/22
37995192151,9sleep03590852-21diskmemload0
36138752151,3sleep03590852-21diskmemload0
34736122151,5sleep23475283-21tr2
345997099151,2cyclictest0-21swapper/33
345997099151,11cyclictest3579670-21taskset3
345997099150,12cyclictest0-21swapper/33
345997099150,11cyclictest0-21swapper/33
39258612141,2sleep20-21swapper/22
38491482141,1sleep20-21swapper/22
38016312140,2sleep20-21swapper/22
37111802141,9sleep03712778-21tr0
37074422141,3sleep13590852-21diskmemload1
36914762141,8sleep03590852-21diskmemload0
36737052141,8sleep03590852-21diskmemload0
36419422141,4sleep2583-21gdbus2
35108182140,6sleep23511449-21cut2
34874102141,3sleep23487515-21ntpq2
345997099148,4cyclictest3585202-21chrt3
3459970991412,1cyclictest0-21swapper/33
3459970991412,1cyclictest0-21swapper/33
345997099140,2cyclictest0-21swapper/33
345997099140,2cyclictest0-21swapper/33
345997099140,12cyclictest0-21swapper/33
345997099140,12cyclictest0-21swapper/33
345997099140,12cyclictest0-21swapper/33
345997099140,11cyclictest0-21swapper/33
345997099140,11cyclictest0-21swapper/33
39285542131,3sleep13928564-21ssh1
39108862131,7sleep03590852-21diskmemload0
38332932130,4sleep23833304-21ssh2
38089312130,2sleep10-21swapper/11
37858132131,2sleep20-21swapper/22
37614682131,4sleep13761803-21ssh1
37241222130,9sleep23724133-21ssh2
36994922131,8sleep03699506-21ssh0
36898032131,6sleep20-21swapper/22
36552722131,8sleep23590852-21diskmemload2
36210242131,3sleep13621081-21ssh1
35518382131,6sleep13551927-21ntpq1
35303712131,6sleep03530420-21ntpq0
34937312131,8sleep13493718-31find1
345997099138,3cyclictest3532015-21chrt3
39372022121,3sleep13937213-21ssh1
39190682120,1sleep20-21swapper/22
38767252121,7sleep03590852-21diskmemload0
38454702121,7sleep13845498-21ssh1
38444472120,7sleep03590852-21diskmemload0
38105182121,4sleep00-21swapper/00
38082492121,6sleep23590852-21diskmemload2
37996282120,3sleep13799638-21ssh1
37593902120,2sleep10-21swapper/11
37322722121,3sleep23732275-21ssh2
36748132121,7sleep13674825-21rm1
36480312121,7sleep03648043-21ssh0
36476972121,5sleep10-21swapper/11
36329932121,7sleep13633007-21ssh1
36040292121,6sleep23604080-21ntpq2
36040292121,6sleep23604080-21ntpq2
35913802121,4sleep23590861-21apt-get2
34604332121,7sleep03460477-21tune2fs0
39376492111,3sleep20-21swapper/22
39375912111,6sleep13590852-21diskmemload1
38949942111,5sleep10-21swapper/11
38869622111,6sleep03886975-21diskmemload0
38661672111,5sleep13866227-21ntpq1
38602062111,6sleep13860217-21ssh1
38511902111,5sleep03590852-21diskmemload0
38437842110,2sleep20-21swapper/22
38180342111,5sleep13818046-21sshd1
37735132111,6sleep13773573-21collect21
37609702111,5sleep20-21swapper/22
37495652111,7sleep03749567-21ssh0
37487702111,3sleep20-21swapper/22
37420302111,4sleep03590852-21diskmemload0
37319382111,4sleep03590852-21diskmemload0
37263412111,6sleep13726352-21ssh1
37256622111,6sleep03725672-21ssh0
36803312111,5sleep13680390-21ntpq1
36581082111,6sleep03658119-21ssh0
36217592111,4sleep03590852-21diskmemload0
36140762112,3sleep23590852-21diskmemload2
35466682111,5sleep23546721-21ntp_states2
35156432111,5sleep23515899-21df2
35131902111,5sleep03514175-21memory0
34947882111,5sleep03494859-21irqstats0
39353372101,4sleep23590852-21diskmemload2
39029002101,4sleep03902914-21ssh0
39024832101,2sleep10-21swapper/11
38997882100,2sleep23899886-21ssh2
38855022101,3sleep20-21swapper/22
38827562101,4sleep13882814-21ntpq1
38761832100,5sleep20-21swapper/22
38677952101,3sleep23590852-21diskmemload2
38395782101,4sleep13840756-21memory1
38284382101,5sleep13828654-21cat1
38278712101,6sleep13590852-21diskmemload1
38254462101,4sleep03590852-21diskmemload0
37929632101,2sleep00-21swapper/00
37922142101,3sleep20-21swapper/22
37915612101,3sleep10-21swapper/11
37761162101,3sleep00-21swapper/00
37744002100,2sleep20-21swapper/22
37668212101,4sleep03590852-21diskmemload0
37576902101,4sleep03590852-21diskmemload0
37436222102,3sleep10-21swapper/11
37175552101,6sleep13590852-21diskmemload1
37157452101,3sleep20-21swapper/22
36846142101,2sleep10-21swapper/11
36761232101,4sleep03676142-21apt-get0
36665832101,4sleep23590852-21diskmemload2
36637102101,5sleep03663795-21find0
36414502100,6sleep13641460-21ssh1
36337222100,6sleep03633754-21ssh0
36293362101,2sleep2171rcu_preempt2
36136922100,1sleep10-21swapper/11
36066242101,3sleep10-21swapper/11
36066242101,3sleep10-21swapper/11
35972522101,4sleep03590852-21diskmemload0
35798722103,3sleep2421rcuc/22
35788232101,4sleep13578871-21ntpq1
35642662101,4sleep23564444-21diskstats2
35519282101,4sleep23551975-21ntpq2
35425482101,4sleep13542804-21df1
35046512100,3sleep172-21kcompactd01
35043522100,4sleep00-21swapper/00
3933460291,4sleep03933503-21ld0
3926552291,3sleep03590852-21diskmemload0
3909259291,4sleep23909270-21ssh2
3884984291,3sleep03590852-21diskmemload0
3858527291,2sleep20-21swapper/22
3817906291,4sleep23817916-21ssh2
3783137291,3sleep10-21swapper/11
3757664290,1sleep20-21swapper/22
3742245291,2sleep20-21swapper/22
3732351290,2sleep10-21swapper/11
3706337291,2sleep20-21swapper/22
3699829291,2sleep20-21swapper/22
3680682291,5sleep23680735-21switchtime2
3672500291,2sleep20-21swapper/22
3666995291,4sleep13667009-21ssh1
3647923291,2sleep20-21swapper/22
3598161291,3sleep13590852-21diskmemload1
3553711291,5sleep03553836-21kthreadcore0
3542526291,3sleep03542545-21apt-get0
3537235291,4sleep03537432-21grep0
3520466291,6sleep0151ktimers/00
3478444291,4sleep23478568-21perl2
3478161290,1sleep00-21swapper/00
3473349291,4sleep13473611-21cat1
3471583291,4sleep23471628-21ntpq2
3471531291,4sleep13471581-21ntpq1
3471412291,4sleep03471525-21ntpq0
3891069281,3sleep23887035-21/usr/sbin/munin2
3589899281,3sleep13589952-21ntp_states1
3574569281,3sleep00-21swapper/00
3569475280,3sleep13569494-21apt-get1
3568841280,1sleep00-21swapper/00
3559282281,4sleep13560946-21cut1
3558551281,2sleep03558570-21apt-get0
3555462281,3sleep23557085-21cat2
3536945280,3sleep13536964-21apt-get1
3535703281,3sleep13535764-21ntpq1
3531890280,1sleep20-21swapper/22
3531100280,2sleep10-21swapper/11
3530475281,3sleep20-21swapper/22
3509835280,1sleep20-21swapper/22
3494860281,3sleep10-21swapper/11
3493782281,3sleep03493718-31find0
3484922281,3sleep00-21swapper/00
3483779281,3sleep13483489-21/usr/sbin/munin1
3460156281,2sleep20-21swapper/22
3585794270,3sleep03586018-21cstates0
3580987271,3sleep13581702-21kthreadcore1
3580423270,1sleep20-21swapper/22
3580420271,3sleep00-21swapper/00
3568916270,1sleep10-21swapper/11
3563262270,1sleep20-21swapper/22
3553837271,3sleep10-21swapper/11
3541824270,1sleep20-21swapper/22
3525720270,1sleep00-21swapper/00
3522165271,2sleep20-21swapper/22
3521515271,2sleep10-21swapper/11
3515621270,2sleep10-21swapper/11
3514176270,1sleep10-21swapper/11
3509050270,2sleep00-21swapper/00
3499660270,4sleep20-21swapper/22
3493531270,1sleep20-21swapper/22
3479561271,3sleep10-21swapper/11
3590214260,1sleep20-21swapper/22
3578531260,2sleep03578817-21strings0
3532172261,2sleep00-21swapper/00
3509819260,1sleep10-21swapper/11
3498433260,2sleep20-21swapper/22
3476673260,2sleep03476846-21strings0
3569497250,1sleep20-21swapper/22
3551159251,1sleep00-21swapper/00
3459928240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional