You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-30 - 06:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Thu Jul 30, 2026 00:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2007067212365,54sleep30-21swapper/33
200692129475,12sleep20-21swapper/22
200703928061,12sleep10-21swapper/11
200712827159,6sleep00-21swapper/00
22032142410,1sleep12203216-21ssh1
2007341993016,2cyclictest0-21swapper/33
22468542251,20sleep02135036-21diskmemload0
200734199241,18cyclictest2307732-21chrt3
200734199235,14cyclictest2169916-21turbostat3
200734199223,14cyclictest2248550-21taskset3
200734199221,17cyclictest0-21swapper/33
200734199221,17cyclictest0-21swapper/33
200734199213,14cyclictest2195959-21taskset3
200734199211,16cyclictest2334101-21chrt3
200734199211,16cyclictest0-21swapper/33
200734199211,13cyclictest0-21swapper/33
233227422010,2sleep0171rcu_preempt0
2007341992018,1cyclictest0-21swapper/33
2007341992017,1cyclictest0-21swapper/33
2007341992012,5cyclictest0-21swapper/33
2007341992011,5cyclictest0-21swapper/33
200734199201,15cyclictest0-21swapper/33
200734199201,15cyclictest0-21swapper/33
200734199201,15cyclictest0-21swapper/33
231656921910,2sleep1171rcu_preempt1
200734199195,2cyclictest0-21swapper/33
200734199192,12cyclictest2340905-21taskset3
200734199191,15cyclictest0-21swapper/33
200734199191,14cyclictest0-21swapper/33
200734199191,14cyclictest0-21swapper/33
200734199191,14cyclictest0-21swapper/33
200734199191,14cyclictest0-21swapper/33
200734199191,14cyclictest0-21swapper/33
24204792181,3sleep20-21swapper/22
2007341991811,4cyclictest0-21swapper/33
200734199181,14cyclictest0-21swapper/33
200734199181,14cyclictest0-21swapper/33
200734199181,14cyclictest0-21swapper/33
200734199181,14cyclictest0-21swapper/33
200734199181,13cyclictest0-21swapper/33
200734199181,13cyclictest0-21swapper/33
200734199181,13cyclictest0-21swapper/33
200734199181,13cyclictest0-21swapper/33
24499262170,7sleep10-21swapper/11
24487982171,2sleep20-21swapper/22
2007341991713,3cyclictest0-21swapper/33
200734199171,14cyclictest0-21swapper/33
2007341991711,3cyclictest0-21swapper/33
200734199171,13cyclictest0-21swapper/33
200734199171,13cyclictest0-21swapper/33
200734199171,13cyclictest0-21swapper/33
200734199171,13cyclictest0-21swapper/33
200734199170,14cyclictest0-21swapper/33
200734199170,14cyclictest0-21swapper/33
200734199170,14cyclictest0-21swapper/33
200734199170,14cyclictest0-21swapper/33
200734199170,14cyclictest0-21swapper/33
24227272161,5sleep12422957-21if_enp1s01
23864302162,9sleep02135036-21diskmemload0
23864302162,9sleep02135036-21diskmemload0
23247282160,2sleep10-21swapper/11
23230892161,4sleep02323102-21ssh0
21758102160,2sleep00-21swapper/00
21683302161,2sleep10-21swapper/11
200734199162,9cyclictest2144054-21taskset3
200734199161,9cyclictest2056708-21taskset3
200734199161,3cyclictest0-21swapper/33
200734199161,13cyclictest0-21swapper/33
200734199160,14cyclictest0-21swapper/33
200734199160,14cyclictest0-21swapper/33
200734199160,13cyclictest0-21swapper/33
200734199160,13cyclictest0-21swapper/33
200734199160,13cyclictest0-21swapper/33
200734199160,13cyclictest0-21swapper/33
200734199160,13cyclictest0-21swapper/33
200734199160,13cyclictest0-21swapper/33
24750362151,2sleep10-21swapper/11
24577612151,2sleep10-21swapper/11
22996202150,1sleep20-21swapper/22
22625482150,2sleep10-21swapper/11
22456402151,2sleep10-21swapper/11
21500392151,4sleep12135036-21diskmemload1
20669062150,2sleep10-21swapper/11
200734199158,4cyclictest2129791-21sleep3
200734199151,3cyclictest0-21swapper/33
200734199151,3cyclictest0-21swapper/33
2007341991512,2cyclictest0-21swapper/33
200734199150,12cyclictest0-21swapper/33
200734199150,12cyclictest0-21swapper/33
24926322141,3sleep02492644-21ssh0
24856002141,2sleep190-21kswapd01
24836922140,8sleep22135036-21diskmemload2
24469372140,2sleep00-21swapper/00
24249112141,8sleep00-21swapper/00
23675912141,4sleep22367604-21ssh2
23664332142,7sleep02135036-21diskmemload0
23590662141,8sleep22135036-21diskmemload2
23395742141,7sleep02339635-21ntp_states0
23383912141,7sleep22339419-21memory2
23075632140,3sleep22307574-21ssh2
22050382141,8sleep02135036-21diskmemload0
2007341991412,1cyclictest0-21swapper/33
200734199140,2cyclictest0-21swapper/33
200734199140,2cyclictest0-21swapper/33
200734199140,12cyclictest0-21swapper/33
24649092131,6sleep12135036-21diskmemload1
24636422131,8sleep02463719-21grep0
24109602131,2sleep10-21swapper/11
23517822131,2sleep20-21swapper/22
23267582132,5sleep22326377-21sendmail-msp2
23233082130,3sleep22135036-21diskmemload2
23002682131,8sleep12300360-21ls1
22977142131,6sleep00-21swapper/00
22798932131,3sleep02279896-21ssh0
22572312136,3sleep04192556-21in:imuxsock0
21515542131,7sleep22135036-21diskmemload2
20936582131,8sleep12093758-21tune2fs1
200734199135,4cyclictest2114894-21taskset3
200734199131,2cyclictest0-21swapper/33
24999952120,7sleep02135036-21diskmemload0
24014442120,8sleep02401457-21ssh0
23664992121,7sleep12366513-21ssh1
22533772121,3sleep12253392-21ssh1
22485172121,2sleep20-21swapper/22
22307932121,7sleep00-21swapper/00
22100542121,4sleep10-21swapper/11
21868132121,7sleep02186826-21ssh0
21858562121,7sleep12185870-21ssh1
21603972121,3sleep10-21swapper/11
21383772121,6sleep20-21swapper/22
21295922120,1sleep00-21swapper/00
20770352120,6sleep272-21kcompactd02
20673462121,5sleep22067469-21diskstats2
20200462128,1sleep20-21swapper/22
20200462128,1sleep20-21swapper/22
20117862121,7sleep22012033-21awk2
25001722111,4sleep22135036-21diskmemload2
24575182111,5sleep22135036-21diskmemload2
24572302111,5sleep02135036-21diskmemload0
24412572111,6sleep00-21swapper/00
24393422111,6sleep22135036-21diskmemload2
24217292110,1sleep00-21swapper/00
24126862111,6sleep02412700-21ssh0
24025542111,6sleep22402567-21ssh2
23847632111,5sleep22135036-21diskmemload2
23847632111,5sleep22135036-21diskmemload2
23773182111,4sleep12135036-21diskmemload1
23771012111,2sleep00-21swapper/00
23701422111,3sleep20-21swapper/22
23533292111,5sleep02353398-21irqstats0
23527202111,4sleep12352370-21apt-get1
23503342110,7sleep12350348-21ssh1
23155032111,4sleep22135036-21diskmemload2
22901032111,6sleep02135036-21diskmemload0
22833462111,5sleep12283610-21df_inode1
22732612110,6sleep22135036-21diskmemload2
22486422111,5sleep02248845-21diskstats0
22379212110,7sleep12237934-21ssh1
22269682111,6sleep12222482-21/usr/sbin/munin1
22198472111,4sleep22135036-21diskmemload2
21975552114,4sleep02199108-21kthreadcore0
21959462110,4sleep22135036-21diskmemload2
21775712112,4sleep22135036-21diskmemload2
21601042111,6sleep22160117-21ssh2
21174482111,5sleep12118185-21memory1
21066582111,5sleep12107737-21memory1
20991822111,6sleep02100165-21cut0
20816702111,5sleep22081746-21ntp_states2
20619422112,4sleep02061961-21apt-get0
20415642111,7sleep20-21swapper/22
20414612111,7sleep12041557-21kthreadcore1
20400892111,5sleep22040276-21users2
20305072111,6sleep02030745-21expr0
20076572111,5sleep12007780-21diskstats1
24990472100,1sleep10-21swapper/11
24768912101,5sleep02477159-21df0
24740362101,4sleep22135036-21diskmemload2
24656442100,1sleep20-21swapper/22
24401362100,1sleep10-21swapper/11
24223852101,2sleep20-21swapper/22
24195892101,2sleep10-21swapper/11
24097992101,2sleep20-21swapper/22
23954132101,4sleep12135036-21diskmemload1
23937502100,1sleep20-21swapper/22
23915272101,4sleep02391680-21ntp_192.168.1140
23788132101,3sleep10-21swapper/11
23788132101,3sleep10-21swapper/11
23502672101,3sleep00-21swapper/00
23328082100,6sleep12332819-21ssh1
23094492101,3sleep00-21swapper/00
23012642101,5sleep02301564-21kthreadcore0
23006592101,4sleep12300287-21apt-get1
22861562101,4sleep22287292-21memory2
22798972101,2sleep10-21swapper/11
22798132101,2sleep20-21swapper/22
22703832101,4sleep02270637-21users0
22458002101,3sleep20-21swapper/22
22361502101,2sleep20-21swapper/22
22224442101,4sleep22135036-21diskmemload2
22218352101,3sleep10-21swapper/11
22193682101,3sleep00-21swapper/00
22119152100,2sleep20-21swapper/22
22042082101,2sleep20-21swapper/22
21944122101,4sleep12135036-21diskmemload1
21928172101,4sleep02135036-21diskmemload0
21852522100,1sleep20-21swapper/22
21752522101,5sleep12135036-21diskmemload1
21677822101,2sleep20-21swapper/22
21528362101,4sleep02152860-21apt-get0
21524072101,5sleep02152422-21cron0
21355242101,4sleep12135785-21df_inode1
20974622101,5sleep02097593-21mailstats0
20723962101,3sleep02072116-21apt-get0
20568572101,4sleep02056980-21diskstats0
20558382101,5sleep02056039-21users0
20346402101,5sleep12034790-21ls1
20129072101,5sleep12013940-21kthreadcore1
20129072101,5sleep12013940-21kthreadcore1
2491070291,3sleep22135036-21diskmemload2
2484191291,3sleep12135036-21diskmemload1
2474730291,3sleep02135036-21diskmemload0
2401608291,3sleep12135036-21diskmemload1
2335360291,4sleep12335374-21ssh1
2262253291,3sleep22135036-21diskmemload2
2237805291,3sleep02135036-21diskmemload0
2166790290,1sleep00-21swapper/00
2142233291,2sleep00-21swapper/00
2134658290,1sleep10-21swapper/11
2129757291,4sleep02129760-21cron0
2124749291,3sleep22124567-21sendmail-msp2
2123572291,5sleep12123637-21pmu-power1
2103848291,3sleep22103625-21sendmail-msp2
2098901291,4sleep22099048-21grep2
2088192291,4sleep12088452-21df1
2086754291,4sleep02086929-21grep0
2082958291,3sleep12082955-21apt-get1
2048182291,4sleep12049927-21cut1
2046535290,1sleep20-21swapper/22
2024676290,4sleep10-21swapper/11
2024676290,4sleep10-21swapper/11
2019538290,1sleep00-21swapper/00
2019538290,1sleep00-21swapper/00
2011563291,4sleep02011637-21grep0
2265905281,4sleep12265968-21grep1
2121488281,3sleep20-21swapper/22
2109695281,3sleep12111191-21kthreadcore1
2109088280,2sleep00-21swapper/00
2100166281,3sleep12101865-21kthreadcore1
2093099281,3sleep00-21swapper/00
2082933280,3sleep22082709-21sendmail-msp2
2082465280,1sleep00-21swapper/00
2076567281,3sleep12076717-21ls1
2067176280,2sleep00-21swapper/00
2056686280,2sleep20-21swapper/22
2052033281,3sleep12052602-21grep1
2051060280,2sleep00-21swapper/00
2030064280,1sleep00-21swapper/00
2030064280,1sleep00-21swapper/00
2025257280,3sleep12024994-21apt-get1
2025257280,3sleep12024994-21apt-get1
2119536270,2sleep00-21swapper/00
2114326270,2sleep20-21swapper/22
2108764270,1sleep00-21swapper/00
2081551270,2sleep12081664-21strings1
2063548271,3sleep20-21swapper/22
2045900270,1sleep00-21swapper/00
2035088270,4sleep20-21swapper/22
2131704260,2sleep20-21swapper/22
2125369261,2sleep10-21swapper/11
2118945260,1sleep00-21swapper/00
2113942260,1sleep20-21swapper/22
2097979260,3sleep20-21swapper/22
2067172260,1sleep10-21swapper/11
2052603261,2sleep20-21swapper/22
2039891261,1sleep10-21swapper/11
2025253260,1sleep20-21swapper/22
2025253260,1sleep20-21swapper/22
2020013260,3sleep00-21swapper/00
2020013260,3sleep00-21swapper/00
2016220261,1sleep20-21swapper/22
2016220261,1sleep20-21swapper/22
2090909250,1sleep20-21swapper/22
2059907250,1sleep10-21swapper/11
2039768250,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional