You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-07 - 02:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Fri Aug 07, 2026 00:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3971633212843,80sleep30-21swapper/33
397179029071,11sleep20-21swapper/22
397158128669,11sleep10-21swapper/11
397175328455,7sleep00-21swapper/00
2278642251,7sleep1227959-21irqstats1
397209999241,17cyclictest0-21swapper/33
397209999231,16cyclictest66950irq/132-enp1s0-TxRx-33
3972099992219,1cyclictest0-21swapper/33
397209999214,14cyclictest66950irq/132-enp1s0-TxRx-33
3972099992111,6cyclictest66950irq/132-enp1s0-TxRx-33
397209999211,16cyclictest0-21swapper/33
397209999211,15cyclictest0-21swapper/33
397209999210,18cyclictest0-21swapper/33
3972099992014,4cyclictest66950irq/132-enp1s0-TxRx-33
397209999201,16cyclictest136030-21turbostat3
397209999201,15cyclictest0-21swapper/33
397209999201,15cyclictest0-21swapper/33
397209999201,15cyclictest0-21swapper/33
397209999201,15cyclictest0-21swapper/33
397209999198,8cyclictest162636-21turbostat3
397209999192,12cyclictest21469-21taskset3
3972099991915,2cyclictest4176920-21taskset3
3972099991912,5cyclictest0-21swapper/33
3972099991912,4cyclictest0-21swapper/33
397209999191,15cyclictest0-21swapper/33
397209999191,15cyclictest0-21swapper/33
397209999191,15cyclictest0-21swapper/33
397209999191,15cyclictest0-21swapper/33
397209999191,15cyclictest0-21swapper/33
397209999191,14cyclictest0-21swapper/33
397209999191,14cyclictest0-21swapper/33
397209999191,14cyclictest0-21swapper/33
397209999191,14cyclictest0-21swapper/33
397209999190,17cyclictest0-21swapper/33
41333322181,2sleep00-21swapper/00
397209999183,12cyclictest0-21swapper/33
397209999183,11cyclictest4057794-21taskset3
3972099991815,1cyclictest0-21swapper/33
397209999181,15cyclictest66950irq/132-enp1s0-TxRx-33
397209999181,14cyclictest0-21swapper/33
397209999181,14cyclictest0-21swapper/33
397209999181,14cyclictest0-21swapper/33
397209999181,14cyclictest0-21swapper/33
397209999181,14cyclictest0-21swapper/33
397209999181,14cyclictest0-21swapper/33
397209999181,14cyclictest0-21swapper/33
397209999181,14cyclictest0-21swapper/33
397209999181,14cyclictest0-21swapper/33
397209999181,14cyclictest0-21swapper/33
397209999181,13cyclictest0-21swapper/33
397209999181,13cyclictest0-21swapper/33
397209999180,16cyclictest0-21swapper/33
397209999180,15cyclictest0-21swapper/33
397209999180,14cyclictest0-21swapper/33
2422262181,2sleep20-21swapper/22
2149732180,2sleep00-21swapper/00
614032171,11sleep061658-21awk0
41262952170,1sleep20-21swapper/22
41140352171,7sleep24114046-21ssh2
41063242171,2sleep00-21swapper/00
40313122171,4sleep24031316-21modprobe2
3972099991714,1cyclictest0-21swapper/33
3972099991711,4cyclictest0-21swapper/33
397209999171,14cyclictest0-21swapper/33
397209999171,13cyclictest0-21swapper/33
397209999171,13cyclictest0-21swapper/33
397209999171,13cyclictest0-21swapper/33
397209999171,13cyclictest0-21swapper/33
3972099991710,4cyclictest0-21swapper/33
397209999170,14cyclictest0-21swapper/33
2766202176,3sleep0276632-21ssh0
1873772171,2sleep00-21swapper/00
41338342161,4sleep24099891-21diskmemload2
3972099991613,1cyclictest0-21swapper/33
3972099991612,2cyclictest0-21swapper/33
397209999161,12cyclictest3984362-21taskset3
397209999160,13cyclictest0-21swapper/33
397209999160,12cyclictest0-21swapper/33
1697932161,3sleep0169808-21ssh0
1543492161,10sleep1154146-21/usr/sbin/munin1
444852151,10sleep244499-21ssh2
3972099991512,2cyclictest0-21swapper/33
397209999151,12cyclictest0-21swapper/33
3972099991510,3cyclictest0-21swapper/33
397209999150,13cyclictest0-21swapper/33
397209999150,12cyclictest0-21swapper/33
397209999150,12cyclictest0-21swapper/33
2097312151,3sleep1209947-21/usr/sbin/munin1
2034592151,4sleep14099891-21diskmemload1
1172382151,2sleep00-21swapper/00
1172382151,2sleep00-21swapper/00
41495442141,3sleep04099891-21diskmemload0
41420442141,2sleep20-21swapper/22
397209999140,12cyclictest0-21swapper/33
386322141,3sleep038643-21ssh0
377512141,8sleep237766-21ssh2
285832141,3sleep14099891-21diskmemload1
2346372141,3sleep0234648-21ssh0
214602141,6sleep24099891-21diskmemload2
1453312143,6sleep1145334-21apt-get1
1370102141,9sleep0136074-21sendmail-msp0
1247482141,2sleep20-21swapper/22
523932138,2sleep1301irq_work/11
479802131,8sleep247995-21ssh2
41674652131,6sleep10-21swapper/11
41618262130,2sleep10-21swapper/11
41576012131,6sleep04157684-21ntp_states0
41439212131,8sleep04143938-21ssh0
41053362131,8sleep14105351-21ssh1
40371182130,2sleep10-21swapper/11
40365172130,1sleep00-21swapper/00
2772932131,7sleep24099891-21diskmemload2
2450072133,2sleep1171rcu_preempt1
2052362131,7sleep2205248-21ssh2
1965822131,5sleep00-21swapper/00
1711742131,2sleep1171188-21ssh1
1602182137,3sleep0160229-21ssh0
1447452130,2sleep10-21swapper/11
1230112131,8sleep1123100-21awk1
981792121,5sleep00-21swapper/00
981792121,5sleep00-21swapper/00
82862121,6sleep08513-21users0
738852121,6sleep273900-21ssh2
474372120,1sleep00-21swapper/00
41888442121,6sleep14189011-21cat1
41760362121,7sleep14176047-21sh1
41715112121,7sleep04171723-21if_enp1s00
41417082121,7sleep14099891-21diskmemload1
40691282120,8sleep24069199-21grep2
40212022121,5sleep24021258-21munin-run2
2716062120,2sleep10-21swapper/11
2542312121,7sleep2254328-21grep2
2456292121,6sleep2246511-21cut2
2348282120,1sleep20-21swapper/22
2267032121,7sleep2226721-21sh2
2237692121,6sleep1223783-21ssh1
1896402122,5sleep1189635-21apt-get1
1767782121,8sleep10-21swapper/11
174942121,7sleep117507-21rm1
1711892121,4sleep20-21swapper/22
1519292121,7sleep0151942-21ssh0
1292262121,3sleep00-21swapper/00
889692111,5sleep14099891-21diskmemload1
848312111,6sleep086405-21kthreadcore0
569402111,5sleep257207-21df_inode2
481332111,5sleep048364-21df0
454282111,5sleep10-21swapper/11
41696072111,6sleep24169621-21ssh2
41672892111,6sleep04099891-21diskmemload0
41533642111,6sleep20-21swapper/22
41336222111,3sleep10-21swapper/11
41149212111,4sleep04099891-21diskmemload0
41050792110,7sleep24105092-21sh2
40885212111,6sleep14088650-21cat1
40010622111,6sleep24000458-21/usr/sbin/munin2
39722432111,4sleep23972262-21apt-get2
198772111,3sleep00-21swapper/00
1859552111,6sleep1185969-21ssh1
1719952111,5sleep0172221-21df_inode0
1598152111,3sleep20-21swapper/22
1513782111,3sleep20-21swapper/22
1333762111,4sleep24099891-21diskmemload2
1188622111,4sleep0118897-21ssh0
1099762111,4sleep24099891-21diskmemload2
1099762111,4sleep24099891-21diskmemload2
982062101,4sleep24099891-21diskmemload2
982062101,4sleep24099891-21diskmemload2
975012101,3sleep10-21swapper/11
975012101,3sleep10-21swapper/11
92762101,2sleep10-21swapper/11
819952101,3sleep20-21swapper/22
711052100,2sleep00-21swapper/00
706322101,2sleep10-21swapper/11
59072101,5sleep24099891-21diskmemload2
41855242100,1sleep20-21swapper/22
41843052101,4sleep14099891-21diskmemload1
41523822101,6sleep14099891-21diskmemload1
41480012100,6sleep24148623-21cat2
41093812101,5sleep14109491-21perl1
40899202101,5sleep24090022-21perl2
40788362101,5sleep24079050-21cat2
40636632100,6sleep14063730-21tune2fs1
40493122100,2sleep10-21swapper/11
40481902101,5sleep04049310-21grep0
40322202101,5sleep24032414-21head2
40214922101,4sleep24021491-21apt-get2
39955362101,4sleep13995745-21hddtemp_smartct1
39900552101,4sleep13990311-21df1
39836952101,5sleep03979491-21/usr/sbin/munin0
2709782101,2sleep10-21swapper/11
2689602101,3sleep20-21swapper/22
2610322101,4sleep14099891-21diskmemload1
2539452101,4sleep0253939-21apt-get0
2501482101,5sleep0250163-21ssh0
2426742101,2sleep00-21swapper/00
2416262101,4sleep14099891-21diskmemload1
2145862100,1sleep20-21swapper/22
2049372101,3sleep04099891-21diskmemload0
1946512100,3sleep20-21swapper/22
1859702101,5sleep2185981-21ssh2
1796172101,5sleep2179624-21ssh2
1352362101,3sleep14099891-21diskmemload1
1153842101,2sleep10-21swapper/11
1153842101,2sleep10-21swapper/11
1077832101,3sleep00-21swapper/00
1077832101,3sleep00-21swapper/00
1077052102,3sleep20-21swapper/22
1077052102,3sleep20-21swapper/22
1060922100,2sleep10-21swapper/11
1060922100,2sleep10-21swapper/11
88561290,1sleep20-21swapper/22
80782291,2sleep00-21swapper/00
79943290,1sleep10-21swapper/11
62610291,2sleep10-21swapper/11
4194073291,3sleep00-21swapper/00
4181084291,4sleep04182646-21tr0
4171032291,4sleep24171047-21ssh2
4124258291,2sleep00-21swapper/00
4123088291,5sleep14123101-21ssh1
4099469290,1sleep20-21swapper/22
4090172291,4sleep04089409-21sendmail-msp0
4079129291,3sleep24078851-21apt-get2
4056654291,4sleep04056785-21/usr/sbin/munin0
4042923291,4sleep14044290-21cat1
4041161290,1sleep20-21swapper/22
4026708291,3sleep10-21swapper/11
4006217291,4sleep04006287-21irqstats0
3999162291,4sleep23999254-21ntp_kernel_pll_2
3979490291,3sleep13979509-21apt-get1
35505290,1sleep10-21swapper/11
26920291,3sleep00-21swapper/00
263592291,4sleep0265109-21cut0
219073291,4sleep04099891-21diskmemload0
1728290,1sleep20-21swapper/22
141688291,4sleep2141699-21ssh2
12579291,3sleep212608-21apt-get2
4079163280,2sleep10-21swapper/11
4079162280,2sleep00-21swapper/00
4064153281,3sleep04065760-21kthreadcore0
4063733281,4sleep24063933-21cat2
4063005280,1sleep00-21swapper/00
4062027281,3sleep14062167-21ntp_192.168.1141
4058168280,2sleep20-21swapper/22
4057793281,2sleep20-21swapper/22
4042350281,2sleep04042369-21apt-get0
4027003281,3sleep04027211-21hddtemp_smartct0
4012646281,3sleep04014350-21kthreadcore0
4010513280,1sleep20-21swapper/22
4005423280,4sleep1205-21jbd2/sda2-81
3999312280,1sleep00-21swapper/00
3994831280,1sleep20-21swapper/22
3990050281,2sleep00-21swapper/00
3979511280,2sleep20-21swapper/22
4099594270,1sleep00-21swapper/00
4099565270,1sleep10-21swapper/11
4090474271,3sleep14091926-21kthreadcore1
4088189271,3sleep20-21swapper/22
4076034271,3sleep10-21swapper/11
4068622271,2sleep00-21swapper/00
4052909270,2sleep10-21swapper/11
4041950270,1sleep00-21swapper/00
4033503271,2sleep10-21swapper/11
4021462270,1sleep10-21swapper/11
4021151270,1sleep10-21swapper/11
4011005270,1sleep20-21swapper/22
4010647270,1sleep10-21swapper/11
4005382270,1sleep00-21swapper/00
3985351270,4sleep23986205-21kthreadcore2
3984784271,2sleep13984803-21apt-get1
3984773271,2sleep00-21swapper/00
3976899270,1sleep00-21swapper/00
4084960261,2sleep04086461-21kthreadcore0
4073920261,2sleep00-21swapper/00
4068503260,2sleep10-21swapper/11
4052609260,4sleep20-21swapper/22
4044291261,2sleep20-21swapper/22
4017821260,2sleep04018339-21kthreadcore0
4015877260,1sleep10-21swapper/11
3976547260,2sleep10-21swapper/11
4021753250,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional