You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-23 - 23:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Sun Aug 23, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
403116123020,3sleep24031163-21unix_chkpwd2
394435822800,4sleep2421rcuc/22
3778538213158,67sleep30-21swapper/33
377839229173,12sleep10-21swapper/11
377854028663,17sleep00-21swapper/00
377361228550,12sleep20-21swapper/22
39857062620,2sleep0221rcuc/00
377885499270,18cyclictest0-21swapper/33
39851862241,18sleep13906847-21diskmemload1
377885499241,2cyclictest0-21swapper/33
377885499240,2cyclictest0-21swapper/33
40036722229,7sleep13906847-21diskmemload1
39150942221,10sleep23906847-21diskmemload2
377885499221,5cyclictest0-21swapper/33
3778854992211,8cyclictest0-21swapper/33
377885499212,13cyclictest5915-21taskset3
3778854992117,2cyclictest0-21swapper/33
3778854992113,6cyclictest66950irq/132-enp1s0-TxRx-33
3778854992113,6cyclictest66950irq/132-enp1s0-TxRx-33
377885499211,17cyclictest0-21swapper/33
377885499211,16cyclictest3806706-21taskset3
377885499211,16cyclictest0-21swapper/33
377885499211,16cyclictest0-21swapper/33
377885499211,16cyclictest0-21swapper/33
377885499211,16cyclictest0-21swapper/33
377885499210,12cyclictest0-21swapper/33
390832201,4sleep039096-21sh0
377885499202,4cyclictest4134020-21taskset3
377885499201,7cyclictest4049856-21taskset3
3778854992017,1cyclictest0-21swapper/33
3778854992014,3cyclictest66950irq/132-enp1s0-TxRx-33
377885499201,16cyclictest0-21swapper/33
377885499201,15cyclictest0-21swapper/33
377885499201,15cyclictest0-21swapper/33
377885499201,14cyclictest0-21swapper/33
377885499201,14cyclictest0-21swapper/33
41372182190,2sleep00-21swapper/00
39434232191,7sleep13944357-21grep1
377885499195,2cyclictest0-21swapper/33
377885499193,6cyclictest0-21swapper/33
377885499192,14cyclictest66950irq/132-enp1s0-TxRx-33
377885499191,7cyclictest4031177-21turbostat3
377885499191,7cyclictest3870125-21turbostat3
377885499191,7cyclictest3849042-21turbostat3
3778854991917,1cyclictest0-21swapper/33
377885499191,6cyclictest3880625-21turbostat3
3778854991916,1cyclictest0-21swapper/33
3778854991916,1cyclictest0-21swapper/33
3778854991915,2cyclictest0-21swapper/33
3778854991911,5cyclictest0-21swapper/33
377885499191,15cyclictest0-21swapper/33
377885499191,15cyclictest0-21swapper/33
377885499191,15cyclictest0-21swapper/33
377885499191,15cyclictest0-21swapper/33
377885499191,15cyclictest0-21swapper/33
377885499191,15cyclictest0-21swapper/33
377885499191,14cyclictest0-21swapper/33
377885499191,14cyclictest0-21swapper/33
377885499190,2cyclictest0-21swapper/33
39403712181,3sleep20-21swapper/22
377885499181,6cyclictest3854305-21turbostat3
377885499181,2cyclictest38119932sleep33
3778854991811,4cyclictest0-21swapper/33
377885499181,14cyclictest0-21swapper/33
377885499181,14cyclictest0-21swapper/33
377885499181,14cyclictest0-21swapper/33
377885499181,13cyclictest0-21swapper/33
377885499181,13cyclictest0-21swapper/33
649112170,2sleep00-21swapper/00
39993032171,11sleep04000189-21memory0
38287462171,5sleep23828844-21irqstats2
377885499176,8cyclictest3870125-21turbostat3
377885499171,3cyclictest0-21swapper/33
377885499171,13cyclictest0-21swapper/33
377885499171,13cyclictest0-21swapper/33
377885499170,13cyclictest0-21swapper/33
64722161,3sleep26792-21kthreadcore2
40304842161,2sleep10-21swapper/11
39945262168,4sleep03778845-21cyclictest0
377885499160,13cyclictest0-21swapper/33
38429092151,3sleep20-21swapper/22
377885499151,12cyclictest0-21swapper/33
377885499150,5cyclictest0-21swapper/33
377885499150,12cyclictest0-21swapper/33
377885499150,12cyclictest0-21swapper/33
659582141,2sleep20-21swapper/22
484472140,1sleep00-21swapper/00
41903012141,9sleep04190315-21ssh0
41870692140,1sleep20-21swapper/22
41817232141,8sleep13906847-21diskmemload1
41731672146,4sleep24173179-21sh2
41712422149,1sleep20-21swapper/22
41555982141,6sleep04155632-21ssh0
40585092141,8sleep14058726-21hddtemp_smartct1
40554862141,7sleep03906847-21diskmemload0
39871882141,8sleep13986808-21apt-get1
39253082141,7sleep23924627-21sendmail-msp2
38551682141,9sleep13855661-21grep1
38167512141,8sleep23812275-21sendmail-msp2
38020372141,9sleep13802040-21grep1
377885499140,11cyclictest0-21swapper/33
196732141,8sleep019684-21ssh0
815962131,7sleep13906847-21diskmemload1
574232131,4sleep257434-21ssh2
41889712131,7sleep13906847-21diskmemload1
41703842131,8sleep14170395-21ssh1
41533372131,8sleep14153348-21ssh1
41257482131,6sleep23906847-21diskmemload2
41194902131,8sleep24119503-21ssh2
41099312131,8sleep23906847-21diskmemload2
41003282131,8sleep04100340-21ssh0
407672131,3sleep140779-21ssh1
40460792130,2sleep00-21swapper/00
40400842131,3sleep04040143-21systemd-run0
40058672130,2sleep20-21swapper/22
39516862131,5sleep03951720-21ssh0
38774142132,7sleep239542-21systemd-journal2
38762112131,8sleep13877412-21cut1
37981492131,8sleep13799799-21cut1
377885499138,3cyclictest0-21swapper/33
377885499130,11cyclictest0-21swapper/33
369182131,3sleep237148-21ssh2
33252131,8sleep03336-21ssh0
830652121,7sleep083077-21ssh0
551742120,1sleep10-21swapper/11
41273102121,4sleep00-21swapper/00
41075362120,7sleep13906847-21diskmemload1
40637202121,5sleep20-21swapper/22
40636482121,7sleep04063662-21sh0
40240542121,7sleep04025681-21grep0
39753472121,7sleep13975358-21ssh1
39685682121,7sleep23968583-21ssh2
39575962120,3sleep23957610-21ssh2
39068312121,7sleep23906855-21dump-pmu-power2
38393812121,7sleep13840033-21grep1
38207612121,5sleep03821676-21memory0
37965482121,7sleep13796603-21systemd-run1
101872120,7sleep03906847-21diskmemload0
759432111,4sleep03906847-21diskmemload0
759432111,4sleep03906847-21diskmemload0
588972111,4sleep159170-21df_inode1
41913522111,5sleep24191571-21hddtemp_smartct2
41623182110,6sleep23906847-21diskmemload2
41447302111,5sleep00-21swapper/00
41322032111,3sleep10-21swapper/11
41065622111,6sleep04102109-21sendmail-msp0
40991722111,3sleep10-21swapper/11
40921272111,5sleep23906847-21diskmemload2
40906852111,4sleep13906847-21diskmemload1
40483872111,5sleep13906847-21diskmemload1
40221582111,6sleep24022179-21ssh2
40205872110,1sleep00-21swapper/00
39767692111,6sleep03976783-21ssh0
39666432110,5sleep13906847-21diskmemload1
39494872110,1sleep00-21swapper/00
39413592110,1sleep00-21swapper/00
38965802111,5sleep23896355-21sendmail-msp2
38493912111,5sleep03849620-21df_inode0
38020422111,5sleep23802300-21df_inode2
317162111,4sleep03906847-21diskmemload0
299942110,3sleep20-21swapper/22
241482111,6sleep124540-21grep1
22722111,4sleep13906847-21diskmemload1
216702111,4sleep23906847-21diskmemload2
808482101,4sleep281019-21ssh2
539732101,4sleep054165-21ssh0
467052101,3sleep13906847-21diskmemload1
41739242101,4sleep03906847-21diskmemload0
41712142101,3sleep00-21swapper/00
41623032101,4sleep14162317-21ssh1
41551512101,4sleep23906847-21diskmemload2
41530522101,3sleep03906847-21diskmemload0
41155182100,7sleep04115623-21ssh0
40815002101,3sleep20-21swapper/22
40728322100,6sleep24072847-21ssh2
40555732101,5sleep24055588-21ssh2
40321982101,5sleep24032757-21ssh2
40048812101,5sleep14004895-21ssh1
39933852101,3sleep23906847-21diskmemload2
39618412102,4sleep00-21swapper/00
39311392100,4sleep13906847-21diskmemload1
39250102101,4sleep03906847-21diskmemload0
39216112100,2sleep10-21swapper/11
39136392100,1sleep00-21swapper/00
38897752101,4sleep03889974-21memory0
38654352101,5sleep23865591-21grep2
38443842101,4sleep13844594-21hddtemp_smartct1
38075282101,5sleep03807598-21grep0
37925752101,5sleep03794034-21kthreadcore0
74728291,3sleep174742-21ssh1
74728291,3sleep174742-21ssh1
73736291,4sleep273750-21ssh2
73736291,4sleep273750-21ssh2
4144067291,3sleep23906847-21diskmemload2
4142951291,2sleep13906847-21diskmemload1
4129042291,3sleep24129071-21apt-get2
4127810291,3sleep13906847-21diskmemload1
4116598291,2sleep10-21swapper/11
41152291,2sleep20-21swapper/22
4093638291,3sleep24093902-21df2
4085473291,4sleep04087019-21kthreadcore0
4081629291,2sleep00-21swapper/00
4081544291,4sleep14081555-21ssh1
4075229291,2sleep10-21swapper/11
4072485291,2sleep00-21swapper/00
4056525290,1sleep10-21swapper/11
4044816290,1sleep20-21swapper/22
4021562291,3sleep13906847-21diskmemload1
4002668291,4sleep24002683-21ssh2
3983234291,2sleep20-21swapper/22
3976580290,1sleep20-21swapper/22
3958179291,2sleep10-21swapper/11
3933783291,3sleep13906847-21diskmemload1
3924247291,2sleep20-21swapper/22
3921596291,5sleep03921610-21ssh0
3912379291,4sleep13912392-21ssh1
3896602291,4sleep03896600-21apt-get0
3881616291,4sleep13883224-21cut1
3870382291,2sleep10-21swapper/11
3864858290,3sleep272-21kcompactd02
3833912291,4sleep03834079-21cat0
3833554291,4sleep23833812-21df_inode2
3828565294,2sleep1321rcuc/11
3807262291,3sleep23807260-21apt-get2
3801737291,5sleep03801820-21latency_hist0
22818291,1sleep10-21swapper/11
11127291,2sleep10-21swapper/11
4037773281,3sleep14037788-21ssh1
4004924281,2sleep03878329-21kworker/u16:3+rpciod0
3906627280,2sleep00-21swapper/00
3906463280,1sleep10-21swapper/11
3886669280,4sleep23888015-21tr2
3881163282,3sleep23881192-21uniq2
3880894281,2sleep03880906-21apt-get0
3866645281,3sleep13868335-21kthreadcore1
3859904280,2sleep10-21swapper/11
3858974280,4sleep00-21swapper/00
3855663281,3sleep23857126-21cut2
3849334280,2sleep20-21swapper/22
3849329280,1sleep10-21swapper/11
3848964280,1sleep20-21swapper/22
3826242280,4sleep10-21swapper/11
3823025280,2sleep20-21swapper/22
3805923281,4sleep03802016-21/usr/sbin/munin0
3801619280,1sleep20-21swapper/22
3781073281,3sleep13782819-21kthreadcore1
3896579271,2sleep10-21swapper/11
3896239270,1sleep20-21swapper/22
3895980270,1sleep10-21swapper/11
3886092270,2sleep10-21swapper/11
3875624271,2sleep00-21swapper/00
3875128270,1sleep00-21swapper/00
3870954271,2sleep20-21swapper/22
3864586270,1sleep00-21swapper/00
3838824271,2sleep03838843-21apt-get0
3829897271,3sleep00-21swapper/00
3827676270,1sleep00-21swapper/00
3822566270,1sleep20-21swapper/22
3817797270,2sleep10-21swapper/11
3813082270,4sleep00-21swapper/00
3812563271,2sleep10-21swapper/11
3811947270,1sleep10-21swapper/11
3796390270,1sleep20-21swapper/22
3788242271,3sleep13789999-21kthreadcore1
3784044271,3sleep00-21swapper/00
3783865270,1sleep20-21swapper/22
3895093260,2sleep03895315-21strings0
3833522260,2sleep10-21swapper/11
3790003260,2sleep23790254-21strings2
3783730260,4sleep00-21swapper/00
3865717250,1sleep00-21swapper/00
3848211250,2sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional