You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 20:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Tue Apr 14, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2660125212060,55sleep30-21swapper/33
266027228856,12sleep20-21swapper/22
266024728755,12sleep10-21swapper/11
266024128360,17sleep00-21swapper/00
29543992750,2sleep20-21swapper/22
2660530992421,1cyclictest0-21swapper/33
2660530992319,2cyclictest0-21swapper/33
2660530992313,6cyclictest3045739-21sleep3
266053099229,1cyclictest0-21swapper/33
266053099227,12cyclictest0-21swapper/33
2660530992219,1cyclictest0-21swapper/33
266053099218,10cyclictest0-21swapper/33
266053099211,6cyclictest2727139-21taskset3
2660530992112,6cyclictest66950irq/132-enp1s0-TxRx-33
266053099211,15cyclictest0-21swapper/33
266053099202,5cyclictest30628862chrt3
2660530992017,1cyclictest0-21swapper/33
2660530992016,2cyclictest0-21swapper/33
266053099201,3cyclictest0-21swapper/33
266053099201,16cyclictest0-21swapper/33
266053099201,14cyclictest0-21swapper/33
2660530992010,7cyclictest0-21swapper/33
266053099200,17cyclictest66950irq/132-enp1s0-TxRx-33
266053099191,5cyclictest2858004-21taskset3
266053099191,5cyclictest0-21swapper/33
266053099191,14cyclictest0-21swapper/33
266053099191,14cyclictest0-21swapper/33
266053099191,14cyclictest0-21swapper/33
266053099191,14cyclictest0-21swapper/33
266053099191,14cyclictest0-21swapper/33
266053099191,14cyclictest0-21swapper/33
266053099191,14cyclictest0-21swapper/33
31421702181,5sleep2431ktimers/22
29760942181,5sleep22976128-21ssh2
2660530991816,1cyclictest0-21swapper/33
2660530991816,1cyclictest0-21swapper/33
2660530991816,1cyclictest0-21swapper/33
2660530991814,2cyclictest0-21swapper/33
2660530991813,2cyclictest0-21swapper/33
2660530991812,3cyclictest2688973-21taskset3
2660530991812,3cyclictest0-21swapper/33
266053099181,14cyclictest0-21swapper/33
266053099181,14cyclictest0-21swapper/33
266053099181,14cyclictest0-21swapper/33
266053099181,14cyclictest0-21swapper/33
266053099181,14cyclictest0-21swapper/33
266053099181,14cyclictest0-21swapper/33
266053099181,14cyclictest0-21swapper/33
266053099181,13cyclictest0-21swapper/33
266053099180,15cyclictest0-21swapper/33
266053099180,15cyclictest0-21swapper/33
31306772171,2sleep20-21swapper/22
30882302171,4sleep12790817-21diskmemload1
29892892171,12sleep02989421-21ssh0
29385162170,1sleep20-21swapper/22
28920582172,9sleep12892117-21ntpq1
2660530991715,1cyclictest0-21swapper/33
266053099171,4cyclictest0-21swapper/33
2660530991714,2cyclictest0-21swapper/33
2660530991714,1cyclictest0-21swapper/33
2660530991713,2cyclictest0-21swapper/33
2660530991713,2cyclictest0-21swapper/33
2660530991713,2cyclictest0-21swapper/33
2660530991713,2cyclictest0-21swapper/33
2660530991713,2cyclictest0-21swapper/33
2660530991713,1cyclictest0-21swapper/33
266053099171,13cyclictest0-21swapper/33
266053099171,13cyclictest0-21swapper/33
266053099171,13cyclictest0-21swapper/33
266053099170,14cyclictest0-21swapper/33
30615572161,4sleep12790817-21diskmemload1
30427642161,2sleep10-21swapper/11
29789402161,4sleep02980108-21memory0
26647612160,1sleep00-21swapper/00
2660530991614,1cyclictest0-21swapper/33
2660530991613,1cyclictest0-21swapper/33
2660530991613,1cyclictest0-21swapper/33
266053099160,13cyclictest0-21swapper/33
31312802151,9sleep12790817-21diskmemload1
29829652156,5sleep1331ktimers/11
28170452151,10sleep02817059-21ssh0
266053099150,13cyclictest0-21swapper/33
266053099150,13cyclictest0-21swapper/33
266053099150,11cyclictest27857592sleep33
31215132141,8sleep03121527-21ssh0
31045122141,2sleep20-21swapper/22
30523542140,11sleep02948795-21kworker/u16:1+rpciod0
29586032141,4sleep12958849-21cstates1
29184392143,7sleep2431ktimers/22
28979862141,9sleep12899635-21kthreadcore1
28704492141,9sleep22870671-21/usr/sbin/munin2
28704492141,9sleep22870671-21/usr/sbin/munin2
28695022141,9sleep22869516-21ssh2
28595672141,4sleep22859581-21ssh2
28400772141,9sleep02840087-21ssh0
28174702141,8sleep22817493-21apt-get2
28042242142,6sleep22804277-21ntpq2
27999582141,2sleep00-21swapper/00
26840742141,8sleep22684290-21diskstats2
266053099141,2cyclictest0-21swapper/33
266053099140,12cyclictest0-21swapper/33
31492952131,8sleep12790817-21diskmemload1
31399272131,6sleep00-21swapper/00
31223732131,7sleep12790817-21diskmemload1
31076222131,7sleep03107646-21apt-get0
30968752131,7sleep12790817-21diskmemload1
30955202131,8sleep23095535-21ssh2
30702222131,6sleep20-21swapper/22
30695432131,9sleep00-21swapper/00
30003542131,3sleep13000365-21ssh1
29214542131,7sleep12790817-21diskmemload1
28861232131,8sleep12790817-21diskmemload1
28057152131,6sleep12790817-21diskmemload1
27952972131,1sleep00-21swapper/00
27199182131,8sleep12720497-21tail1
26907192130,5sleep20-21swapper/22
26827382131,8sleep22682792-21ld2
31218362121,7sleep22790817-21diskmemload2
30990782121,5sleep13099212-21diskstats1
30614912121,7sleep03061502-21ssh0
30503542120,2sleep10-21swapper/11
30440132120,8sleep03044027-21ssh0
30257002121,7sleep23025707-21ssh2
30253842122,4sleep12790817-21diskmemload1
30192832121,3sleep03019285-21ssh0
30153192121,7sleep23015371-21ssh2
30081602121,6sleep12790817-21diskmemload1
30078422121,3sleep03007856-21ssh0
29541512121,8sleep12954398-21sed1
29476942121,6sleep22790817-21diskmemload2
29317582121,5sleep02931787-21ssh0
28762362121,6sleep12790817-21diskmemload1
28762362121,6sleep12790817-21diskmemload1
28678932121,5sleep00-21swapper/00
28521952125,4sleep02660524-21cyclictest0
28515022120,6sleep20-21swapper/22
28258272121,6sleep02790817-21diskmemload0
27962212121,6sleep12790817-21diskmemload1
27330502121,7sleep12733598-21cut1
26736532121,7sleep12673749-21fschecks_time1
31586432111,6sleep12790817-21diskmemload1
31412972110,3sleep13141308-21ssh1
31043352111,4sleep02790817-21diskmemload0
30872742111,3sleep20-21swapper/22
30852392111,5sleep072-21kcompactd00
30775332111,2sleep20-21swapper/22
30713112111,5sleep10-21swapper/11
30628342110,7sleep23062849-21ssh2
30007932110,3sleep00-21swapper/00
29752642111,6sleep02975278-21ssh0
29460632110,2sleep00-21swapper/00
29323752111,6sleep12933452-21cut1
29304002110,1sleep10-21swapper/11
29289352111,2sleep20-21swapper/22
29273142111,6sleep02927361-21ssh0
29030562111,3sleep22903067-21ssh2
28921192111,5sleep22892187-21ntpq2
28859012113,4sleep02874235-21kworker/u16:0+xprtiod0
28603392111,6sleep02860351-21ssh0
28591462111,3sleep10-21swapper/11
28426412111,4sleep12790817-21diskmemload1
28331302111,5sleep12790817-21diskmemload1
28308942111,4sleep22831150-21users2
28253332111,3sleep10-21swapper/11
28130332112,4sleep12813092-21ntpq1
27804112112,4sleep22780430-21apt-get2
27790892111,5sleep12779140-21ntpq1
27644542116,2sleep00-21swapper/00
27041232111,5sleep02704264-21ntpq0
26949082111,5sleep02695111-21diskstats0
26944132111,5sleep12694341-31find1
26821502111,6sleep02678675-21/usr/sbin/munin0
26774522111,5sleep02677502-21ntpq0
26722202111,5sleep072-21kcompactd00
26721132111,5sleep22672167-21ntpq2
31581162101,5sleep03158130-21ssh0
31567282101,3sleep20-21swapper/22
31496652100,6sleep22790817-21diskmemload2
31472292101,4sleep03147291-21sshd0
31260532101,6sleep03126959-21cut0
31145372101,4sleep12790817-21diskmemload1
30961932101,5sleep03096206-21rm0
30781402100,1sleep10-21swapper/11
30776612100,3sleep00-21swapper/00
30518232100,4sleep22790817-21diskmemload2
30349572101,3sleep20-21swapper/22
30349312100,1sleep00-21swapper/00
30338812101,3sleep12790817-21diskmemload1
30262332101,2sleep0171rcu_preempt0
30067352101,5sleep23006857-21/usr/sbin/munin2
29866302101,5sleep22988388-21tr2
29855202101,5sleep12986628-21cut1
29731612101,4sleep22790817-21diskmemload2
29657242100,2sleep00-21swapper/00
29608652100,2sleep20-21swapper/22
29558292101,3sleep00-21swapper/00
29070222101,6sleep00-21swapper/00
29045132101,6sleep00-21swapper/00
28697322101,3sleep02790817-21diskmemload0
28697322101,3sleep02790817-21diskmemload0
28667442101,4sleep12790817-21diskmemload1
28446542101,5sleep12846219-21ssh1
28412192101,4sleep22790817-21diskmemload2
28341232101,4sleep02790817-21diskmemload0
28155542101,4sleep22790817-21diskmemload2
27930832101,2sleep20-21swapper/22
27748032101,4sleep02774824-21munin-run0
27396942101,5sleep12741516-21kthreadcore1
27325232101,4sleep22732778-21df2
27160042100,5sleep02716459-21packagekitd0
3112935291,3sleep22790817-21diskmemload2
3037996291,4sleep23039178-21cat2
3018065291,3sleep10-21swapper/11
2999352290,5sleep22999362-21ssh2
2972378290,5sleep1802-21snmpd1
2945822291,2sleep10-21swapper/11
2919917290,4sleep00-21swapper/00
2911119290,2sleep10-21swapper/11
2910531291,2sleep20-21swapper/22
2893900290,2sleep00-21swapper/00
2884155291,2sleep20-21swapper/22
2785737291,3sleep22785756-21apt-get2
2779142290,1sleep20-21swapper/22
2743132291,3sleep00-21swapper/00
2736362291,4sleep02736503-21ntpq0
2727442291,4sleep02727655-21hddtemp_smartct0
2721822291,3sleep12721841-21apt-get1
2714936291,4sleep02714982-21ntpq0
2709579291,4sleep02709625-21/usr/sbin/munin0
2684573291,4sleep12685785-21cut1
2679126291,4sleep12679242-21irqstats1
2789879281,3sleep02789927-21/usr/sbin/munin0
2773815282,3sleep20-21swapper/22
2764973281,3sleep12765097-21kthreadcore1
2753790281,2sleep00-21swapper/00
2753258280,1sleep10-21swapper/11
2748465280,3sleep22748484-21apt-get2
2731200280,4sleep12731257-21ld1
2721844280,4sleep22722042-21ls2
2716471280,1sleep20-21swapper/22
2708117281,3sleep22709437-21memory2
2699957282,3sleep2431ktimers/22
2668016280,2sleep10-21swapper/11
2660972281,3sleep22661170-21grep2
2785214270,1sleep10-21swapper/11
2780050270,2sleep00-21swapper/00
2765099271,3sleep22766782-21kthreadcore2
2761129271,3sleep02762969-21kthreadcore0
2759140270,2sleep20-21swapper/22
2758657270,1sleep20-21swapper/22
2753488270,1sleep00-21swapper/00
2747512271,2sleep22747757-21unixbench_multi2
2742611270,1sleep20-21swapper/22
2738380271,3sleep02738413-21kthreadcore0
2727743271,3sleep22729273-21kthreadcore2
2726868270,1sleep00-21swapper/00
2714990271,2sleep12715041-21open_files1
2709626271,3sleep10-21swapper/11
2700216270,2sleep10-21swapper/11
2694160270,1sleep00-21swapper/00
2678159270,4sleep20-21swapper/22
2789928261,2sleep12790056-21sendmail_mailst1
2780409260,1sleep00-21swapper/00
2769748260,1sleep10-21swapper/11
2753812261,2sleep10-21swapper/11
2744449261,2sleep10-21swapper/11
2715720260,1sleep20-21swapper/22
2701318261,2sleep20-21swapper/22
2698405261,2sleep10-21swapper/11
2759430250,1sleep10-21swapper/11
2688022250,1sleep00-21swapper/00
2662460250,2sleep12662774-21kthreadcore1
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional