You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 05:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat Jun 13, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
314421023050,2sleep03144202-21ntpq0
310189821360,2sleep072-21kcompactd00
3078854212153,63sleep30-21swapper/33
307880028755,11sleep20-21swapper/22
307864028265,11sleep10-21swapper/11
307874927663,7sleep00-21swapper/00
31334472290,6sleep10-21swapper/11
32250302271,4sleep23225038-21ssh2
35256102231,10sleep03525671-21ssh0
33665532230,2sleep10-21swapper/11
3079010992219,1cyclictest0-21swapper/33
307901099211,17cyclictest3360735-21taskset3
307901099211,14cyclictest0-21swapper/33
3079010992110,8cyclictest0-21swapper/33
32166522201,5sleep03216656-21sh0
307901099202,15cyclictest66950irq/132-enp1s0-TxRx-33
307901099202,13cyclictest3314866-21taskset3
3079010992017,1cyclictest0-21swapper/33
3079010992012,5cyclictest0-21swapper/33
307901099201,16cyclictest0-21swapper/33
307901099201,15cyclictest66950irq/132-enp1s0-TxRx-33
307901099201,14cyclictest0-21swapper/33
3079010992010,7cyclictest3526451-21taskset3
32979942191,9sleep13209423-21diskmemload1
307901099199,6cyclictest3204113-21turbostat3
3079010991916,1cyclictest0-21swapper/33
3079010991916,1cyclictest0-21swapper/33
307901099191,4cyclictest3139510-21taskset3
3079010991914,2cyclictest0-21swapper/33
307901099191,15cyclictest66950irq/132-enp1s0-TxRx-33
307901099191,15cyclictest66950irq/132-enp1s0-TxRx-33
307901099191,15cyclictest0-21swapper/33
307901099191,14cyclictest0-21swapper/33
307901099191,14cyclictest0-21swapper/33
307901099191,14cyclictest0-21swapper/33
3079010991910,6cyclictest0-21swapper/33
34765342186,7sleep03209423-21diskmemload0
307901099186,8cyclictest0-21swapper/33
3079010991814,2cyclictest0-21swapper/33
3079010991814,2cyclictest0-21swapper/33
307901099181,3cyclictest3392410-21taskset3
307901099181,14cyclictest0-21swapper/33
307901099181,14cyclictest0-21swapper/33
307901099181,14cyclictest0-21swapper/33
307901099181,14cyclictest0-21swapper/33
307901099181,14cyclictest0-21swapper/33
307901099181,13cyclictest511irq_work/33
307901099181,13cyclictest0-21swapper/33
307901099180,16cyclictest0-21swapper/33
35354432171,7sleep03209423-21diskmemload0
3079010991715,1cyclictest0-21swapper/33
3079010991712,3cyclictest0-21swapper/33
307901099171,13cyclictest0-21swapper/33
307901099171,13cyclictest0-21swapper/33
307901099171,13cyclictest0-21swapper/33
307901099171,12cyclictest0-21swapper/33
3079010991710,4cyclictest3091247-21chrt3
307901099170,14cyclictest34461282sleep33
307901099170,14cyclictest0-21swapper/33
307901099170,14cyclictest0-21swapper/33
307901099170,14cyclictest0-21swapper/33
307901099170,13cyclictest0-21swapper/33
307901099170,13cyclictest0-21swapper/33
34521042160,1sleep20-21swapper/22
34450282164,8sleep23079005-21cyclictest2
3079010991610,4cyclictest0-21swapper/33
307901099160,15cyclictest0-21swapper/33
307901099160,13cyclictest0-21swapper/33
307901099160,13cyclictest0-21swapper/33
307901099160,13cyclictest0-21swapper/33
307901099160,12cyclictest0-21swapper/33
307901099160,12cyclictest0-21swapper/33
34360112151,4sleep03209423-21diskmemload0
34106262151,2sleep20-21swapper/22
34082792151,3sleep03408287-21ssh0
33946602151,8sleep23394923-21df2
33351512151,5sleep23209423-21diskmemload2
32333992151,3sleep03209423-21diskmemload0
32333992151,3sleep03209423-21diskmemload0
31830522152,8sleep23183071-21apt-get2
307901099159,3cyclictest3102114-21chrt3
3079010991512,1cyclictest0-21swapper/33
307901099150,13cyclictest0-21swapper/33
307901099150,12cyclictest0-21swapper/33
307901099150,12cyclictest0-21swapper/33
307901099150,11cyclictest0-21swapper/33
34838252141,9sleep03483838-21ssh0
34267852141,2sleep20-21swapper/22
33929372141,7sleep10-21swapper/11
33929012140,2sleep20-21swapper/22
33244482141,4sleep03324462-21ssh0
33244482141,4sleep03324462-21ssh0
33009572141,2sleep20-21swapper/22
32684502141,9sleep13268481-21apt-get1
32389102141,3sleep23238974-21ntp_states2
32097742141,9sleep13209423-21diskmemload1
31764462141,3sleep10-21swapper/11
307901099148,3cyclictest3129462-21chrt3
3079010991412,1cyclictest0-21swapper/33
307901099140,12cyclictest0-21swapper/33
307901099140,12cyclictest0-21swapper/33
35376362131,6sleep10-21swapper/11
35092612131,2sleep13209423-21diskmemload1
35092612131,2sleep13209423-21diskmemload1
34699532131,6sleep20-21swapper/22
34693822131,3sleep13469392-21ssh1
34288502131,8sleep13428910-21/usr/sbin/munin1
34182292131,8sleep03418240-21ssh0
33528202131,3sleep03353043-21smartctl0
33173442131,6sleep20-21swapper/22
32910772130,3sleep03209423-21diskmemload0
32835512131,4sleep03283562-21ssh0
32808942131,6sleep23280945-21ntpq2
32557302131,7sleep13255788-21ntpq1
31667402131,8sleep13166743-21sshd1
3079010991310,2cyclictest0-21swapper/33
3079010991310,2cyclictest0-21swapper/33
307901099130,2cyclictest0-21swapper/33
35620722123,5sleep23553496-21kworker/u16:1+nfsiod2
35528982121,7sleep13552909-21ssh1
35262812121,6sleep13209423-21diskmemload1
34945372121,7sleep03494547-21ssh0
34866322121,7sleep13486644-21sh1
34440662120,2sleep1171rcu_preempt1
34205802121,7sleep03420269-21/usr/sbin/munin0
34114952121,4sleep20-21swapper/22
34088912121,7sleep13408905-21ssh1
34012072121,6sleep03209423-21diskmemload0
33670302121,5sleep20-21swapper/22
33519132121,5sleep20-21swapper/22
33494192121,7sleep13349433-21ssh1
33360772121,5sleep03336188-21perl0
33111372120,3sleep03311210-21irqstats0
33019292121,5sleep13301958-21ssh1
32603412121,6sleep23209423-21diskmemload2
32573582121,6sleep23209423-21diskmemload2
32092842120,3sleep13209285-21sshd1
31782822127,2sleep0251irq_work/00
31453962121,7sleep03145221-21apt-get0
31231872121,7sleep13123407-21/usr/sbin/munin1
30974802121,7sleep23097705-21cat2
30905542121,5sleep13090603-21ntpq1
35506172111,4sleep23550668-21ntpq2
35290102110,7sleep23529027-21ssh2
35011822111,6sleep03501192-21ssh0
34959392111,5sleep13496074-21diskstats1
34932332111,5sleep23209423-21diskmemload2
34844282110,5sleep20-21swapper/22
34594582110,3sleep10-21swapper/11
34430282111,5sleep03209423-21diskmemload0
34289112111,5sleep23429138-21df_inode2
33934432110,5sleep00-21swapper/00
33687262111,5sleep03368733-21ssh0
32932962111,6sleep03293303-21cron0
32852032111,3sleep10-21swapper/11
32714172111,5sleep03272490-21memory0
32669462112,4sleep13209423-21diskmemload1
32486282111,3sleep20-21swapper/22
32485772110,2sleep10-21swapper/11
32388482111,5sleep13238908-21ntpq1
32152952111,3sleep20-21swapper/22
32071462111,5sleep23208247-21memory2
32049142114,3sleep03205442-21cut0
31990582111,5sleep13199317-21df_inode1
31924742111,5sleep23192523-21ntpq2
31604382110,2sleep20-21swapper/22
31566922113,4sleep03156715-21/usr/sbin/munin0
31335082112,4sleep23133556-21ntpq2
31123262110,1sleep00-21swapper/00
31075562110,7sleep23107565-21idleruntime-cro2
35619952100,4sleep00-21swapper/00
35605962101,4sleep10-21swapper/11
35541042101,3sleep00-21swapper/00
35432402101,3sleep10-21swapper/11
35347952101,2sleep20-21swapper/22
35201712101,4sleep03209423-21diskmemload0
35189032101,2sleep10-21swapper/11
35115362100,4sleep00-21swapper/00
35115362100,4sleep00-21swapper/00
34780812101,3sleep10-21swapper/11
34592012101,3sleep20-21swapper/22
34519462101,3sleep10-21swapper/11
34256632101,3sleep10-21swapper/11
34170012101,5sleep13209423-21diskmemload1
33987732101,4sleep13398823-21ssh1
33849182100,1sleep20-21swapper/22
33833762101,3sleep10-21swapper/11
33818472101,4sleep03381902-21ntpq0
33767782100,1sleep20-21swapper/22
33748472100,1sleep00-21swapper/00
33524502101,4sleep13209423-21diskmemload1
33337592101,3sleep10-21swapper/11
33241892101,3sleep20-21swapper/22
33241892101,3sleep20-21swapper/22
33222852101,4sleep13209423-21diskmemload1
33222852101,4sleep13209423-21diskmemload1
33154762101,3sleep10-21swapper/11
33079842101,3sleep20-21swapper/22
33079192101,6sleep03307930-21ssh0
32817662101,5sleep10-21swapper/11
32567222101,4sleep03209423-21diskmemload0
32487472101,2sleep00-21swapper/00
32346392101,4sleep03234665-21apt-get0
32329442100,1sleep10-21swapper/11
32329442100,1sleep10-21swapper/11
32316112101,4sleep20-21swapper/22
32316112101,4sleep20-21swapper/22
32249242100,6sleep13224936-21ssh1
31763962101,5sleep03176444-21ntpq0
31623332101,5sleep23163810-21kthreadcore2
31126162100,2sleep20-21swapper/22
31063962101,5sleep13106535-21/usr/sbin/munin1
3545320291,4sleep03545334-21ssh0
3542988291,3sleep20-21swapper/22
3517512291,2sleep20-21swapper/22
3511653291,4sleep23209423-21diskmemload2
3511653291,4sleep23209423-21diskmemload2
3502895291,4sleep23502903-21ssh2
3492514291,4sleep13492526-21ssh1
3477481290,5sleep23477493-21ssh2
3469511290,1sleep00-21swapper/00
3453903291,4sleep03453931-21ssh0
3450796290,6sleep03450807-21ssh0
3375479291,3sleep13209423-21diskmemload1
3357376291,2sleep20-21swapper/22
3349410291,3sleep03209423-21diskmemload0
3340959291,2sleep10-21swapper/11
3335783291,3sleep23335802-21apt-get2
3332384291,4sleep03332395-21ssh0
3291445290,1sleep20-21swapper/22
3273473291,2sleep20-21swapper/22
3266134291,3sleep03209423-21diskmemload0
3223154291,3sleep03209423-21diskmemload0
3198559290,1sleep10-21swapper/11
3178008291,4sleep23178111-21perl2
3166541290,3sleep00-21swapper/00
3151064291,3sleep03151083-21apt-get0
3143496291,4sleep23144113-21/usr/sbin/munin2
3139168291,4sleep23139243-21sshd2
3117774290,1sleep20-21swapper/22
3117602291,4sleep03117659-21ntp_states0
3096921291,4sleep03096968-21systemd-run0
3090466291,3sleep03090547-21ntpq0
3199037280,2sleep00-21swapper/00
3193710281,2sleep20-21swapper/22
3188381280,2sleep10-21swapper/11
3182099281,4sleep13182104-21sensors_temp1
3171231281,4sleep13171355-21/usr/sbin/munin1
3167049281,2sleep20-21swapper/22
3153325280,1sleep20-21swapper/22
3146186280,1sleep10-21swapper/11
3139862281,3sleep03140033-21wc0
3133030281,4sleep03133442-21needreboot0
3128197281,3sleep23128251-21modprobe2
3203409271,3sleep23203572-21/usr/sbin/munin2
3193179270,1sleep00-21swapper/00
3187197270,4sleep00-21swapper/00
3171829270,1sleep00-21swapper/00
3151086271,3sleep10-21swapper/11
3134816270,3sleep13135075-21df_inode1
3123869270,1sleep20-21swapper/22
3107815270,2sleep10-21swapper/11
3106862271,3sleep00-21swapper/00
3096669270,2sleep20-21swapper/22
3091848270,1sleep10-21swapper/11
3088533272,2sleep20-21swapper/22
3084225270,1sleep00-21swapper/00
3080473271,3sleep23082202-21cut2
3079186270,2sleep10-21swapper/11
3198525260,4sleep00-21swapper/00
3187808260,1sleep10-21swapper/11
3177324260,1sleep20-21swapper/22
3146315261,2sleep20-21swapper/22
3141715261,2sleep10-21swapper/11
3128311261,2sleep00-21swapper/00
3128107260,2sleep10-21swapper/11
3120077261,2sleep00-21swapper/00
3118220260,2sleep10-21swapper/11
3102130260,4sleep10-21swapper/11
3160300250,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional