You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 20:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Fri Jun 12, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3984020212060,56sleep30-21swapper/33
398409128559,12sleep10-21swapper/11
398406128258,8sleep00-21swapper/00
398343827760,10sleep20-21swapper/22
41296702230,2sleep30-21swapper/33
41296702230,2sleep30-21swapper/33
398428199231,17cyclictest66950irq/132-enp1s0-TxRx-33
398428199231,16cyclictest0-21swapper/33
398428199211,16cyclictest37815-21taskset3
2049032211,8sleep04114587-21diskmemload0
398428199201,15cyclictest205864-21taskset3
398428199201,15cyclictest0-21swapper/33
40181022191,9sleep14018023-31find1
398428199191,5cyclictest4077194-21taskset3
398428199191,15cyclictest0-21swapper/33
398428199191,14cyclictest188553-21taskset3
398428199191,14cyclictest0-21swapper/33
398428199191,14cyclictest0-21swapper/33
398428199191,14cyclictest0-21swapper/33
398428199191,14cyclictest0-21swapper/33
398428199191,14cyclictest0-21swapper/33
398428199191,14cyclictest0-21swapper/33
398428199190,15cyclictest66950irq/132-enp1s0-TxRx-33
398428199190,15cyclictest66950irq/132-enp1s0-TxRx-33
398428199186,9cyclictest191092-21turbostat3
3984281991814,2cyclictest0-21swapper/33
398428199181,14cyclictest0-21swapper/33
398428199181,14cyclictest0-21swapper/33
398428199181,14cyclictest0-21swapper/33
398428199181,14cyclictest0-21swapper/33
398428199181,14cyclictest0-21swapper/33
398428199181,14cyclictest0-21swapper/33
398428199181,13cyclictest0-21swapper/33
398428199181,13cyclictest0-21swapper/33
398428199181,13cyclictest0-21swapper/33
398428199180,15cyclictest0-21swapper/33
398428199180,14cyclictest0-21swapper/33
398428199180,14cyclictest0-21swapper/33
41536252172,8sleep24153820-21users2
398428199178,6cyclictest3996532-21taskset3
398428199171,6cyclictest0-21swapper/33
3984281991711,3cyclictest122508-21taskset3
3984281991711,3cyclictest0-21swapper/33
398428199171,13cyclictest0-21swapper/33
398428199171,13cyclictest0-21swapper/33
398428199171,13cyclictest0-21swapper/33
398428199171,13cyclictest0-21swapper/33
398428199171,13cyclictest0-21swapper/33
398428199171,13cyclictest0-21swapper/33
398428199171,13cyclictest0-21swapper/33
398428199170,14cyclictest0-21swapper/33
398428199170,14cyclictest0-21swapper/33
398428199170,14cyclictest0-21swapper/33
26982172,3sleep02709-21sh0
2328612171,3sleep20-21swapper/22
2169492171,3sleep00-21swapper/00
209012171,3sleep00-21swapper/00
565472161,2sleep20-21swapper/22
41319862161,2sleep10-21swapper/11
398428199161,12cyclictest0-21swapper/33
398428199160,13cyclictest0-21swapper/33
398428199160,13cyclictest0-21swapper/33
398428199160,13cyclictest0-21swapper/33
398428199160,13cyclictest0-21swapper/33
398428199160,13cyclictest0-21swapper/33
398428199160,13cyclictest0-21swapper/33
398428199160,13cyclictest0-21swapper/33
398428199160,13cyclictest0-21swapper/33
398428199160,13cyclictest0-21swapper/33
398428199160,13cyclictest0-21swapper/33
398428199160,13cyclictest0-21swapper/33
2424362161,4sleep1242458-21apt-get1
40881252152,8sleep04088144-21apt-get0
398428199152,8cyclictest4092197-21taskset3
398428199150,13cyclictest0-21swapper/33
398428199150,13cyclictest0-21swapper/33
398428199150,13cyclictest0-21swapper/33
398428199150,13cyclictest0-21swapper/33
398428199150,12cyclictest0-21swapper/33
398428199150,12cyclictest0-21swapper/33
2674772151,4sleep04114587-21diskmemload0
2652942151,5sleep1265305-21sh1
2557572151,4sleep14114587-21diskmemload1
2481532151,4sleep04114587-21diskmemload0
1975322151,4sleep14114587-21diskmemload1
1967232151,4sleep04114587-21diskmemload0
1216282151,2sleep00-21swapper/00
1126022151,2sleep00-21swapper/00
714082141,9sleep171418-21ssh1
41634582141,9sleep24163470-21ssh2
41389652141,3sleep04114587-21diskmemload0
41298952141,2sleep20-21swapper/22
41298952141,2sleep20-21swapper/22
40497312141,9sleep14049861-21systemctl1
398428199140,2cyclictest0-21swapper/33
388502140,3sleep038864-21ssh0
360752141,8sleep14114587-21diskmemload1
2507312140,1sleep20-21swapper/22
2313882141,5sleep1231402-21ssh1
1454862140,2sleep00-21swapper/00
1091062140,2sleep20-21swapper/22
803962131,8sleep24114587-21diskmemload2
56622131,7sleep14114587-21diskmemload1
557702131,1sleep20-21swapper/22
41699542131,6sleep24169997-21ntpq2
41613372131,6sleep04161436-21ntpq0
41561242131,7sleep04114587-21diskmemload0
40420572131,8sleep24043866-21cut2
39886652131,8sleep13988778-21rt-features1
39886112131,8sleep03988664-21/usr/sbin/munin0
3984281991310,2cyclictest0-21swapper/33
398428199130,2cyclictest0-21swapper/33
2398532131,8sleep2239864-21ssh2
223792131,9sleep122531-21tr1
2216822131,6sleep10-21swapper/11
2004662131,8sleep2201983-21/usr/sbin/munin2
191702131,7sleep14114587-21diskmemload1
191312131,8sleep219144-21sh2
1891142131,7sleep04114587-21diskmemload0
1368062131,6sleep2136862-21ntpq2
41869732121,7sleep14187032-21ssh1
41630632121,6sleep14163074-21ssh1
41288942121,7sleep14128906-21ssh1
41288942121,7sleep14128906-21ssh1
41145692121,7sleep04114741-21date0
41138232121,3sleep24109451-21/usr/sbin/munin2
40118022123,4sleep14011832-21ntpq1
39968842121,7sleep23997002-21grep2
303202121,5sleep00-21swapper/00
26712121,7sleep22685-21ssh2
2229112121,7sleep2222925-21ssh2
2164032121,5sleep20-21swapper/22
2048732121,7sleep1204884-21ssh1
1708132122,6sleep1171040-21unixbench-2d1
1468872121,3sleep1146897-21ssh1
125222121,6sleep00-21swapper/00
981442111,5sleep098180-21munin-run0
981182111,7sleep298131-21ssh2
951482110,7sleep195158-21ssh1
531342111,4sleep04114587-21diskmemload0
455082110,1sleep00-21swapper/00
41708262111,6sleep14170838-21ssh1
41406882111,5sleep24140820-21diskstats2
41362052111,5sleep24136254-21ntpq2
41217152111,5sleep24114587-21diskmemload2
41158742111,6sleep04117471-21kthreadcore0
41081512111,5sleep24108193-21ntpq2
41028302111,5sleep24102876-21ntpq2
40827992111,5sleep24082818-21apt-get2
39977342110,7sleep23998642-21cut2
39885032111,5sleep23988557-21ld2
2689642112,2sleep1171rcu_preempt1
2663692111,3sleep20-21swapper/22
2397912110,1sleep00-21swapper/00
225342111,5sleep222668-21diskstats2
2085172110,2sleep0208529-21ssh0
1900222111,6sleep14114587-21diskmemload1
17292111,6sleep11749-21systemctl1
1620782111,7sleep0162138-21gcc0
1569102111,3sleep10-21swapper/11
1563952112,4sleep04114587-21diskmemload0
1557832111,5sleep24114587-21diskmemload2
1318232111,3sleep20-21swapper/22
1027962111,5sleep1102854-21ntpq1
1026962111,3sleep00-21swapper/00
893352101,2sleep10-21swapper/11
789452101,4sleep04114587-21diskmemload0
784342101,3sleep10-21swapper/11
698712101,2sleep20-21swapper/22
697592101,3sleep00-21swapper/00
612952101,3sleep10-21swapper/11
453842101,4sleep14114587-21diskmemload1
41870332101,4sleep24187099-21ntpq2
41795182101,3sleep20-21swapper/22
41794072101,3sleep00-21swapper/00
41657012101,4sleep04114587-21diskmemload0
41459482101,4sleep04114587-21diskmemload0
41308302101,4sleep04114587-21diskmemload0
41308302101,4sleep04114587-21diskmemload0
41221922101,3sleep10-21swapper/11
41094672101,5sleep14109517-21cpu1
41027162101,5sleep14102829-21ntpq1
40825152101,5sleep24082537-21grep2
40668492101,4sleep04066867-21apt-get0
40668442100,1sleep10-21swapper/11
40561642101,4sleep14056183-21apt-get1
40561642101,4sleep14056183-21apt-get1
40508632101,4sleep14050882-21apt-get1
40440472101,4sleep04044113-21memory0
40348632101,4sleep04034882-21apt-get0
40290152100,1sleep00-21swapper/00
40183072101,5sleep24018339-21perf2
40131272102,4sleep04013182-21ls0
382132101,6sleep24114587-21diskmemload2
2678252101,4sleep2267959-21perl2
2566872101,4sleep04114587-21diskmemload0
2403522101,4sleep14114587-21diskmemload1
2317522101,3sleep04114587-21diskmemload0
1916372101,4sleep2191783-21diskstats2
1803712100,1sleep20-21swapper/22
1802012100,1sleep10-21swapper/11
1775572101,4sleep0178706-21memory0
1715252101,3sleep24114587-21diskmemload2
1643172101,3sleep10-21swapper/11
1577792101,4sleep24114587-21diskmemload2
1408842101,5sleep290-21kswapd02
1403392100,3sleep10-21swapper/11
1241542101,4sleep0124169-21ssh0
1215672101,3sleep20-21swapper/22
1128462100,2sleep10-21swapper/11
107942101,4sleep24114587-21diskmemload2
86673290,2sleep00-21swapper/00
82254291,4sleep283066-21tr2
62185291,4sleep04114587-21diskmemload0
48362291,4sleep148654-21tr1
43618291,4sleep290-21kswapd02
4189493290,1sleep00-21swapper/00
4179368291,3sleep14114587-21diskmemload1
4155942291,3sleep14114587-21diskmemload1
4145437291,3sleep14114587-21diskmemload1
4102414291,4sleep04102715-21sed0
4097534291,4sleep14097580-21ntpq1
4088698291,5sleep24089957-21kthreadcore2
4085821291,4sleep04086707-21memory0
4081577291,4sleep14077460-21/usr/sbin/munin1
4072751290,5sleep00-21swapper/00
4060191291,3sleep24060242-21ntpq2
4060191291,3sleep24060242-21ntpq2
4050885291,4sleep24051093-21cat2
4045555291,5sleep24045618-21cpuspeed_turbos2
4044114291,4sleep14044249-21netstat1
4028236291,4sleep14028287-21ntpq1
4011839290,4sleep24011888-21ntpq2
266018291,3sleep04114587-21diskmemload0
248766291,2sleep20-21swapper/22
213816290,1sleep10-21swapper/11
182684290,1sleep20-21swapper/22
168344291,4sleep0168366-21kthreadcore0
129628291,2sleep10-21swapper/11
122111290,3sleep10-21swapper/11
104257291,2sleep20-21swapper/22
4066638280,1sleep20-21swapper/22
4035445281,3sleep14036958-21ps1
4034248280,1sleep10-21swapper/11
4001345280,4sleep10-21swapper/11
138524280,2sleep00-21swapper/00
4098197270,1sleep00-21swapper/00
4088147271,3sleep10-21swapper/11
4076895270,1sleep20-21swapper/22
4058490270,4sleep00-21swapper/00
4058490270,4sleep00-21swapper/00
4055606270,1sleep00-21swapper/00
4049912271,3sleep00-21swapper/00
4039571270,1sleep20-21swapper/22
4031932270,1sleep20-21swapper/22
4029539270,2sleep00-21swapper/00
4029116270,1sleep20-21swapper/22
4008168270,3sleep04008305-21cat0
4007233272,3sleep2431ktimers/22
4109127260,1sleep10-21swapper/11
4108250260,2sleep00-21swapper/00
4098277260,4sleep20-21swapper/22
4079543261,2sleep00-21swapper/00
4076995260,4sleep10-21swapper/11
4066556260,1sleep10-21swapper/11
4066282260,4sleep00-21swapper/00
4065566260,2sleep20-21swapper/22
4023717260,1sleep10-21swapper/11
4019451260,3sleep0221rcuc/00
4007282260,1sleep10-21swapper/11
4007171260,4sleep00-21swapper/00
4001840260,4sleep00-21swapper/00
3991178260,2sleep13991775-21cat1
3989737261,2sleep00-21swapper/00
4087829250,3sleep10-21swapper/11
4022724250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional