You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 21:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Fri Apr 24, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1285915213055,70sleep30-21swapper/33
128583028655,12sleep20-21swapper/22
128095628254,16sleep00-21swapper/00
128564027963,10sleep10-21swapper/11
1286047992824,2cyclictest0-21swapper/33
1286047992522,1cyclictest0-21swapper/33
1286047992420,2cyclictest0-21swapper/33
1286047992410,13cyclictest0-21swapper/33
1286047992321,1cyclictest0-21swapper/33
128604799227,12cyclictest0-21swapper/33
1286047992219,1cyclictest0-21swapper/33
128604799221,18cyclictest1286222-21chrt3
1286047992119,1cyclictest0-21swapper/33
1286047992119,1cyclictest0-21swapper/33
1286047992118,1cyclictest0-21swapper/33
1286047992117,2cyclictest0-21swapper/33
1286047992116,2cyclictest0-21swapper/33
14106402201,7sleep11410681-21ntpq1
128604799204,13cyclictest0-21swapper/33
1286047992018,1cyclictest0-21swapper/33
1286047992018,1cyclictest0-21swapper/33
1286047992017,2cyclictest0-21swapper/33
1286047992017,1cyclictest0-21swapper/33
1286047992017,1cyclictest0-21swapper/33
1286047992017,1cyclictest0-21swapper/33
1286047992016,2cyclictest0-21swapper/33
1286047992016,2cyclictest0-21swapper/33
1286047992013,3cyclictest1683293-21taskset3
1286047992013,3cyclictest1683293-21taskset3
1286047992012,5cyclictest0-21swapper/33
128604799201,15cyclictest66950irq/132-enp1s0-TxRx-33
128604799201,15cyclictest66950irq/132-enp1s0-TxRx-33
128604799200,18cyclictest0-21swapper/33
15465042190,7sleep01417003-21diskmemload0
15055722192,12sleep11507196-21grep1
128604799198,1cyclictest0-21swapper/33
128604799193,13cyclictest0-21swapper/33
128604799192,11cyclictest1298931-21taskset3
1286047991917,1cyclictest0-21swapper/33
1286047991915,3cyclictest0-21swapper/33
1286047991915,2cyclictest0-21swapper/33
1286047991915,2cyclictest0-21swapper/33
1286047991914,3cyclictest0-21swapper/33
128604799191,14cyclictest1389969-21chrt3
128604799191,14cyclictest0-21swapper/33
128604799191,14cyclictest0-21swapper/33
128604799191,14cyclictest0-21swapper/33
16764762181,8sleep11676490-21ssh1
15729892181,4sleep01417003-21diskmemload0
15468872181,6sleep21417003-21diskmemload2
128604799184,12cyclictest0-21swapper/33
1286047991816,1cyclictest0-21swapper/33
1286047991815,1cyclictest0-21swapper/33
1286047991814,3cyclictest0-21swapper/33
1286047991814,2cyclictest0-21swapper/33
1286047991814,1cyclictest0-21swapper/33
1286047991813,2cyclictest0-21swapper/33
128604799181,14cyclictest66950irq/132-enp1s0-TxRx-33
128604799181,13cyclictest0-21swapper/33
128604799181,13cyclictest0-21swapper/33
128604799180,14cyclictest0-21swapper/33
17097432170,7sleep00-21swapper/00
15697602179,5sleep10-21swapper/11
1286047991715,1cyclictest0-21swapper/33
1286047991714,1cyclictest0-21swapper/33
1286047991714,1cyclictest0-21swapper/33
128604799171,3cyclictest0-21swapper/33
1286047991713,2cyclictest0-21swapper/33
1286047991713,2cyclictest0-21swapper/33
1286047991713,1cyclictest0-21swapper/33
1286047991711,3cyclictest0-21swapper/33
128604799171,13cyclictest0-21swapper/33
128604799170,14cyclictest0-21swapper/33
128604799170,14cyclictest0-21swapper/33
128604799170,13cyclictest0-21swapper/33
17609592161,7sleep01760970-21ssh0
17351402161,10sleep01417003-21diskmemload0
17195552161,3sleep00-21swapper/00
16754482161,4sleep21417003-21diskmemload2
16690932161,4sleep01417003-21diskmemload0
16579332161,3sleep00-21swapper/00
15212632161,3sleep20-21swapper/22
14844932161,4sleep01417003-21diskmemload0
128604799162,12cyclictest0-21swapper/33
1286047991613,1cyclictest0-21swapper/33
1286047991613,1cyclictest0-21swapper/33
1286047991613,1cyclictest0-21swapper/33
1286047991612,2cyclictest0-21swapper/33
17809872152,6sleep01417003-21diskmemload0
15918782151,9sleep11591997-21irqstats1
15868452151,8sleep21586911-21ntpq2
14476932150,4sleep11447741-21ntpq1
14313162151,9sleep11417003-21diskmemload1
17813132141,2sleep20-21swapper/22
17268802141,8sleep01417003-21diskmemload0
17028402141,3sleep01417003-21diskmemload0
16667872141,3sleep01417003-21diskmemload0
16223672141,8sleep21417003-21diskmemload2
15531032141,6sleep00-21swapper/00
14846072141,3sleep11417003-21diskmemload1
13699712140,2sleep1321rcuc/11
13316782141,9sleep11331897-21sort1
13201002141,8sleep11320035-31find1
17642352132,7sleep11764400-21sed1
17256132131,8sleep21725657-21ssh2
17251802131,6sleep11725279-21ntpq1
17166602130,3sleep20-21swapper/22
16951202131,2sleep2171rcu_preempt2
16844822131,4sleep01684496-21ssh0
16844822131,4sleep01684496-21ssh0
16672522131,8sleep11667262-21ssh1
16388102134,5sleep0151ktimers/00
15623612131,7sleep01417003-21diskmemload0
15436852130,2sleep10-21swapper/11
15034482131,6sleep11417003-21diskmemload1
14925942131,3sleep11492607-21rm1
14758842131,8sleep21475898-21ssh2
14600942130,8sleep21417003-21diskmemload2
13685362130,1sleep20-21swapper/22
17362792121,5sleep11417003-21diskmemload1
17027542121,6sleep11417003-21diskmemload1
16906162121,7sleep21690748-21modprobe2
16404742122,6sleep21640486-21sh2
16326502121,5sleep11417003-21diskmemload1
16319492121,6sleep01631962-21ssh0
16235512121,7sleep11623566-21ssh1
16095252121,7sleep01611140-21tr0
16095252121,7sleep01611140-21tr0
16086362121,7sleep21608649-21ssh2
16086362121,7sleep21608649-21ssh2
16061812121,8sleep11606187-21sh1
15991472120,2sleep01599158-21ssh0
15981282121,7sleep21417003-21diskmemload2
15877752121,3sleep11587789-21ssh1
15806962125,3sleep21417003-21diskmemload2
15110422121,3sleep21511056-21ssh2
14835842121,3sleep20-21swapper/22
14414812121,6sleep20-21swapper/22
14407522122,7sleep01417003-21diskmemload0
13794052121,7sleep01379603-21date0
13541972121,7sleep01355944-21grep0
13487132121,3sleep21350437-21kthreadcore2
12977502125,3sleep21297876-21run-parts2
17720922111,3sleep00-21swapper/00
17627552111,4sleep21417003-21diskmemload2
17546802111,1sleep20-21swapper/22
17446712111,5sleep10-21swapper/11
16936102111,5sleep00-21swapper/00
16569082111,7sleep11417003-21diskmemload1
16484232111,4sleep21417003-21diskmemload2
16323642111,4sleep21417003-21diskmemload2
16147022111,1sleep10-21swapper/11
16147022111,1sleep10-21swapper/11
16052412110,6sleep01417003-21diskmemload0
15740592111,6sleep11574073-21ssh1
15530222110,8sleep21553046-21ssh2
15375842110,2sleep20-21swapper/22
15307662111,4sleep01417003-21diskmemload0
15275482111,5sleep01417003-21diskmemload0
15002982111,6sleep21500492-21sed2
14917962110,7sleep01417003-21diskmemload0
14575472110,1sleep00-21swapper/00
14525762111,4sleep11417003-21diskmemload1
14215942111,5sleep11417003-21diskmemload1
14119242111,5sleep11411943-21apt-get1
13953362111,6sleep11390616-21/usr/sbin/munin1
13890572111,5sleep21389098-21ntpq2
13802222111,6sleep21380265-21kthreadcore2
13690042111,5sleep01369023-21apt-get0
13677352111,5sleep11367782-21ntpq1
13354222110,1sleep20-21swapper/22
13098552110,7sleep01310102-21cat0
17786882101,3sleep11417003-21diskmemload1
17645412100,6sleep21764555-21ssh2
17551672101,2sleep10-21swapper/11
17539792101,4sleep01417003-21diskmemload0
17356022101,3sleep20-21swapper/22
17186192101,6sleep11417003-21diskmemload1
17107862101,3sleep10-21swapper/11
17100112100,1sleep20-21swapper/22
16941672101,3sleep10-21swapper/11
16825812101,4sleep21682790-21users2
16825812101,4sleep21682790-21users2
16668132101,4sleep21417003-21diskmemload2
16575132100,1sleep20-21swapper/22
16504862101,3sleep10-21swapper/11
16388702101,4sleep11638929-21ntpq1
16223922101,2sleep00-21swapper/00
15881052102,4sleep01581079-21kworker/u16:2+xprtiod0
15806212101,3sleep01417003-21diskmemload0
15626282100,2sleep20-21swapper/22
15549392101,4sleep11417003-21diskmemload1
15374202101,4sleep11417003-21diskmemload1
15289652101,3sleep10-21swapper/11
15274812100,7sleep21527495-21ssh2
15186542101,3sleep00-21swapper/00
15099282100,1sleep00-21swapper/00
14963122100,6sleep01496837-21cut0
14908922101,4sleep21490993-21ntpq2
14768812101,4sleep11476895-21ssh1
14694992101,4sleep01469526-21apt-get0
14680152101,4sleep20-21swapper/22
14671482100,1sleep00-21swapper/00
14514412101,4sleep01417003-21diskmemload0
14330602100,2sleep00-21swapper/00
14263932101,4sleep21426617-21hddtemp_smartct2
14160212101,5sleep21416075-21ntpq2
14012912101,5sleep21401383-21tr2
13959532101,4sleep11395972-21apt-get1
13582692101,4sleep21358288-21apt-get2
13476592102,3sleep11347677-21apt-get1
13406402102,3sleep21340753-21ntpq2
13308562101,4sleep21330875-21apt-get2
1764529291,2sleep10-21swapper/11
1744509291,2sleep00-21swapper/00
1743838291,4sleep21743849-21ssh2
1685191290,1sleep10-21swapper/11
1685191290,1sleep10-21swapper/11
1649532290,5sleep01649544-21ssh0
1606485291,4sleep21606499-21ssh2
1573055290,1sleep20-21swapper/22
1561780291,3sleep10-21swapper/11
1519414291,2sleep10-21swapper/11
1465787291,3sleep11417003-21diskmemload1
1450596291,2sleep20-21swapper/22
1438961291,4sleep11439021-21ntpq1
1422528291,4sleep21422538-21ssh2
1406642291,4sleep21406875-21cstates2
1401559291,4sleep01401768-21hddtemp_smartct0
1378238291,4sleep11378376-21/usr/sbin/munin1
1352695291,4sleep01352702-21cron0
1326552291,4sleep01327119-21cut0
1320363290,4sleep20-21swapper/22
1293833291,4sleep11293881-21fschecks_count1
1417403280,1sleep00-21swapper/00
1400725280,2sleep20-21swapper/22
1391346281,3sleep21393028-21kthreadcore2
1389209282,3sleep11389344-21mailstats1
1374333281,3sleep21374352-21apt-get2
1355946281,3sleep10-21swapper/11
1327121281,3sleep10-21swapper/11
1325744281,3sleep21325930-21latency_hist2
1325736280,1sleep10-21swapper/11
1320099280,4sleep01320035-31find0
1305078281,3sleep01306172-21grep0
1298910280,2sleep20-21swapper/22
1294610281,3sleep01296339-21kthreadcore0
1291130280,1sleep10-21swapper/11
1286231280,3sleep21286250-21apt-get2
1368408270,1sleep00-21swapper/00
1363189270,1sleep10-21swapper/11
1362647270,3sleep01362679-21modprobe0
1345896270,2sleep01346069-21strings0
1342056270,2sleep10-21swapper/11
1341567270,1sleep10-21swapper/11
1336405270,1sleep00-21swapper/00
1314655270,1sleep10-21swapper/11
1309497270,1sleep10-21swapper/11
1301956271,3sleep00-21swapper/00
1290963270,1sleep00-21swapper/00
1406221260,4sleep10-21swapper/11
1400791260,1sleep00-21swapper/00
1389991260,1sleep00-21swapper/00
1373376261,2sleep20-21swapper/22
1356873260,2sleep20-21swapper/22
1342637261,2sleep20-21swapper/22
1320932260,3sleep01320979-21fschecks_count0
1310130261,2sleep20-21swapper/22
1309357260,1sleep20-21swapper/22
1303671260,1sleep10-21swapper/11
1412273250,1sleep00-21swapper/00
1411073250,1sleep00-21swapper/00
1390585250,2sleep00-21swapper/00
1383861250,1sleep10-21swapper/11
1340812250,1sleep00-21swapper/00
1379944240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional