You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-22 - 06:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Mon Jun 22, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
377814322500,2sleep10-21swapper/11
3338105212667,55sleep30-21swapper/33
333778429577,10sleep10-21swapper/11
333787928454,12sleep20-21swapper/22
333806827359,7sleep00-21swapper/00
38009172320,2sleep10-21swapper/11
35969772261,9sleep10-21swapper/11
3338252992319,1cyclictest0-21swapper/33
3338252992217,2cyclictest0-21swapper/33
3338252992212,7cyclictest66950irq/132-enp1s0-TxRx-33
3338252992118,1cyclictest0-21swapper/33
3338252992116,2cyclictest0-21swapper/33
3338252992112,5cyclictest0-21swapper/33
333825299211,15cyclictest0-21swapper/33
38152032201,5sleep23815285-21ls2
333825299206,12cyclictest3680916-21taskset3
333825299201,16cyclictest0-21swapper/33
333825299201,15cyclictest3439778-21turbostat3
333825299200,17cyclictest3582712-21turbostat3
333825299200,16cyclictest0-21swapper/33
333825299200,16cyclictest0-21swapper/33
37429132191,14sleep03744484-21kthreadcore0
333825299193,13cyclictest0-21swapper/33
3338252991916,1cyclictest0-21swapper/33
333825299191,15cyclictest0-21swapper/33
333825299191,14cyclictest0-21swapper/33
333825299191,14cyclictest0-21swapper/33
333825299191,14cyclictest0-21swapper/33
333825299191,14cyclictest0-21swapper/33
333825299191,14cyclictest0-21swapper/33
333825299191,14cyclictest0-21swapper/33
333825299190,1cyclictest0-21swapper/33
37235492181,3sleep00-21swapper/00
36469202181,6sleep13646930-21ssh1
35577532181,13sleep13557788-21latency_hist1
35291162181,3sleep00-21swapper/00
35213982181,12sleep13465954-21diskmemload1
333825299184,12cyclictest3674557-21taskset3
333825299183,12cyclictest0-21swapper/33
3338252991815,2cyclictest0-21swapper/33
3338252991814,2cyclictest0-21swapper/33
3338252991813,2cyclictest0-21swapper/33
3338252991812,3cyclictest3352175-21taskset3
333825299181,14cyclictest0-21swapper/33
333825299181,14cyclictest0-21swapper/33
333825299181,14cyclictest0-21swapper/33
333825299181,14cyclictest0-21swapper/33
333825299181,13cyclictest0-21swapper/33
333825299181,13cyclictest0-21swapper/33
333825299181,13cyclictest0-21swapper/33
333825299181,13cyclictest0-21swapper/33
333825299181,13cyclictest0-21swapper/33
3338252991810,5cyclictest0-21swapper/33
333825299180,14cyclictest0-21swapper/33
333825299180,14cyclictest0-21swapper/33
38110722171,3sleep10-21swapper/11
37750272171,3sleep00-21swapper/00
34828962171,3sleep00-21swapper/00
34729122171,3sleep20-21swapper/22
3338252991713,2cyclictest0-21swapper/33
3338252991713,2cyclictest0-21swapper/33
333825299171,13cyclictest0-21swapper/33
333825299171,13cyclictest0-21swapper/33
333825299171,13cyclictest0-21swapper/33
333825299170,14cyclictest0-21swapper/33
333825299170,13cyclictest0-21swapper/33
37473932161,5sleep23465954-21diskmemload2
37468092161,3sleep13465954-21diskmemload1
37253542161,3sleep20-21swapper/22
37042142161,4sleep10-21swapper/11
37036792160,4sleep0221rcuc/00
36065582161,3sleep20-21swapper/22
35646092161,10sleep00-21swapper/00
333825299161,4cyclictest0-21swapper/33
333825299161,3cyclictest0-21swapper/33
333825299161,3cyclictest0-21swapper/33
3338252991613,1cyclictest0-21swapper/33
3338252991613,1cyclictest0-21swapper/33
3338252991613,1cyclictest0-21swapper/33
3338252991613,1cyclictest0-21swapper/33
333825299161,11cyclictest3398096-21taskset3
333825299160,3cyclictest3413314-21chrt3
333825299160,3cyclictest3413314-21chrt3
333825299160,13cyclictest0-21swapper/33
333825299160,13cyclictest0-21swapper/33
37921192151,3sleep20-21swapper/22
37507342151,5sleep13750215-40find1
37247622152,2sleep2171rcu_preempt2
37247492151,4sleep13465954-21diskmemload1
36893522151,2sleep00-21swapper/00
36655262150,2sleep00-21swapper/00
36405042151,3sleep10-21swapper/11
35809092150,8sleep13580921-21rm1
35384902151,2sleep10-21swapper/11
34395382150,1sleep10-21swapper/11
34353822151,3sleep03436692-21kthreadcore0
34138272150,2sleep00-21swapper/00
34138272150,2sleep00-21swapper/00
333825299158,4cyclictest3371481-21chrt3
3338252991512,2cyclictest0-21swapper/33
3338252991511,2cyclictest0-21swapper/33
333825299150,13cyclictest0-21swapper/33
333825299150,13cyclictest0-21swapper/33
333825299150,12cyclictest0-21swapper/33
333825299150,12cyclictest0-21swapper/33
333825299150,12cyclictest0-21swapper/33
37836852140,7sleep20-21swapper/22
36961532141,10sleep03696370-21cat0
36917602141,3sleep13691762-21ssh1
36458292141,9sleep23645928-21pmu-power2
36161242141,8sleep13616138-21cron1
35720432140,1sleep20-21swapper/22
35487422141,8sleep03465954-21diskmemload0
35072202141,9sleep03507234-21ssh0
34730212141,3sleep13465954-21diskmemload1
34502042141,9sleep23450276-21cat2
34033322140,2sleep20-21swapper/22
38106652131,8sleep23810731-21systemd-run2
37745862130,1sleep20-21swapper/22
37154322131,5sleep10-21swapper/11
36864032131,6sleep23687535-21memory2
36644372131,2sleep20-21swapper/22
36133112130,2sleep03465954-21diskmemload0
35545722131,8sleep03554583-21ssh0
35247352130,8sleep13465954-21diskmemload1
35038082131,8sleep23503909-21tr2
37689872121,7sleep00-21swapper/00
36726432121,6sleep13465954-21diskmemload1
36301202121,7sleep13630131-21sh1
36231172121,6sleep03623129-21ssh0
36171692121,6sleep23618544-21tr2
35830002121,5sleep10-21swapper/11
35724022121,7sleep13572416-21ssh1
35633592120,2sleep10-21swapper/11
35564332121,7sleep23556446-21ssh2
34818132121,2sleep13481825-21ssh1
34752562121,7sleep23475980-21cut2
34706712121,7sleep03470849-21sed0
34510482121,7sleep23452329-21cut2
33910282121,7sleep13391540-21sed1
38078292110,1sleep10-21swapper/11
38003462111,4sleep00-21swapper/00
37750002111,6sleep13775011-21ssh1
37530982111,6sleep03750215-40find0
37403432111,5sleep03465954-21diskmemload0
37336082111,3sleep272-21kcompactd02
37315802111,5sleep03731590-21ssh0
37076552110,7sleep23707666-21ssh2
36812372111,3sleep20-21swapper/22
36322492111,4sleep03465954-21diskmemload0
36216752110,2sleep10-21swapper/11
36045512111,3sleep10-21swapper/11
35913802111,4sleep03465954-21diskmemload0
35900412111,7sleep23590052-21diskmemload2
35897752111,4sleep03465954-21diskmemload0
35805102111,5sleep00-21swapper/00
35643512110,1sleep20-21swapper/22
35132662111,7sleep13513280-21ssh1
35093892111,6sleep03510979-21kthreadcore0
35002252111,5sleep13500302-21irqstats1
34912372111,4sleep23465954-21diskmemload2
34812642110,2sleep00-21swapper/00
34615832111,2sleep10-21swapper/11
34557532111,4sleep13455451-21apt-get1
34395242112,6sleep2106713-21snmpd2
34242992111,4sleep13424557-21df_inode1
33873142111,6sleep21-21systemd2
33538392111,5sleep03354882-21memory0
38171852101,3sleep00-21swapper/00
37913522101,2sleep10-21swapper/11
37905472100,1sleep00-21swapper/00
37827622101,4sleep03465954-21diskmemload0
37401232100,2sleep10-21swapper/11
37307612101,2sleep10-21swapper/11
37163322101,4sleep23465954-21diskmemload2
36980252101,3sleep23465954-21diskmemload2
36894602101,4sleep13465954-21diskmemload1
36827242100,1sleep00-21swapper/00
36750622101,3sleep10-21swapper/11
36638062101,2sleep10-21swapper/11
36570762100,1sleep20-21swapper/22
36551532101,4sleep03465954-21diskmemload0
36474732101,4sleep03465954-21diskmemload0
36126272101,4sleep23612869-21users2
36072712101,2sleep00-21swapper/00
35970352100,5sleep23465954-21diskmemload2
35771362101,5sleep23578714-21/usr/sbin/munin2
35714672101,3sleep03465954-21diskmemload0
35462252101,3sleep20-21swapper/22
35416862101,6sleep13541802-21grep1
35385692101,3sleep00-21swapper/00
35215752101,3sleep03465954-21diskmemload0
34992592100,5sleep03465954-21diskmemload0
34973942101,5sleep13497405-21ssh1
34440412101,4sleep13444097-21ntp_states1
34284822101,5sleep23428702-21cat2
34129602101,4sleep03413145-21users0
34129602101,4sleep03413145-21users0
34048552102,4sleep03406555-21kthreadcore0
33978052101,5sleep03397872-21unin-run0
33733542104,3sleep20-21swapper/22
33667402101,5sleep03366980-21expr0
33470062101,2sleep00-21swapper/00
3802727291,4sleep03802899-21cstates0
3794980291,4sleep23465954-21diskmemload2
3767467291,2sleep10-21swapper/11
3766359290,6sleep23766371-21rm2
3754861291,4sleep23750215-40find2
3715090291,2sleep00-21swapper/00
3674222291,4sleep23674234-21rm2
3667057291,5sleep03667192-21gltestperf0
3654885291,2sleep10-21swapper/11
3638818291,4sleep03638829-21ssh0
3638790291,2sleep20-21swapper/22
3630081291,2sleep20-21swapper/22
3537821290,2sleep20-21swapper/22
3521838291,2sleep20-21swapper/22
3512867291,2sleep20-21swapper/22
3488831291,4sleep23465954-21diskmemload2
3488291291,2sleep10-21swapper/11
3455438291,3sleep13455528-21munin-run1
3429528291,4sleep03429565-21grep0
3419353291,4sleep03419562-21hddtemp_smartct0
3406557291,4sleep13407248-21wc1
3398112291,2sleep00-21swapper/00
3363415291,4sleep03365153-21grep0
3360848290,1sleep20-21swapper/22
3355024291,4sleep23355088-21awk2
3351002291,4sleep13351021-21apt-get1
3350076290,5sleep23350320-21/usr/sbin/munin2
3338481291,2sleep00-21swapper/00
3338189290,5sleep10-21swapper/11
3530440281,3sleep23530450-21ssh2
3460729281,3sleep03460753-21latency_hist0
3443908281,3sleep03444039-21netstat0
3434479281,3sleep13434550-21https1
3432672281,3sleep23433397-21missed_timers2
3414538281,3sleep13416124-21kthreadcore1
3414538281,3sleep13416124-21kthreadcore1
3398105280,2sleep10-21swapper/11
3387659281,3sleep03387875-21diskstats0
3387032281,4sleep0116341-21sshd0
3382005280,1sleep00-21swapper/00
3361472280,3sleep23361491-21apt-get2
3356253280,2sleep00-21swapper/00
3461000270,2sleep00-21swapper/00
3460987270,1sleep20-21swapper/22
3419634271,2sleep20-21swapper/22
3418616270,1sleep20-21swapper/22
3418616270,1sleep20-21swapper/22
3408583270,2sleep10-21swapper/11
3408583270,2sleep10-21swapper/11
3397686270,1sleep10-21swapper/11
3387585270,2sleep20-21swapper/22
3387302270,1sleep10-21swapper/11
3371618270,1sleep10-21swapper/11
3366106270,1sleep10-21swapper/11
3360908271,2sleep13360913-21sshd-session1
3343852271,2sleep10-21swapper/11
3343163270,1sleep20-21swapper/22
3454077260,2sleep03454460-21strings0
3449933260,1sleep00-21swapper/00
3441124261,2sleep20-21swapper/22
3424296261,2sleep03424292-21apt-get0
3419061260,1sleep10-21swapper/11
3413469260,4sleep20-21swapper/22
3413469260,4sleep20-21swapper/22
3378718261,2sleep20-21swapper/22
3377137261,3sleep1106713-21snmpd1
3371928260,1sleep00-21swapper/00
3371924260,1sleep10-21swapper/11
3370484260,2sleep23370657-21strings2
3459497250,1sleep20-21swapper/22
3445558250,1sleep10-21swapper/11
3392629250,1sleep20-21swapper/22
3398106240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional