You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 06:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Wed May 06, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1116832212061,54sleep30-21swapper/33
11214192112104,5sleep10-21swapper/11
112154627658,12sleep20-21swapper/22
112135127454,14sleep00-21swapper/00
14941452360,1sleep072-21kcompactd00
112180799243,15cyclictest1346330-21taskset3
112180799231,18cyclictest1275639-21taskset3
1121807992118,1cyclictest0-21swapper/33
112180799211,18cyclictest0-21swapper/33
112180799201,7cyclictest1360689-21taskset3
112180799201,7cyclictest1127049-21turbostat3
1121807992017,1cyclictest0-21swapper/33
1121807992014,3cyclictest1344751-21taskset3
1121807992011,6cyclictest1557145-21taskset3
1121807992011,6cyclictest0-21swapper/33
112180799201,15cyclictest66950irq/132-enp1s0-TxRx-33
112180799201,14cyclictest0-21swapper/33
112180799200,18cyclictest0-21swapper/33
12603192192,13sleep21252430-21diskmemload2
112180799192,14cyclictest66950irq/132-enp1s0-TxRx-33
1121807991915,3cyclictest66950irq/132-enp1s0-TxRx-33
112180799191,4cyclictest1144790-21taskset3
1121807991912,5cyclictest66950irq/132-enp1s0-TxRx-33
1121807991912,3cyclictest1327257-21taskset3
112180799191,15cyclictest0-21swapper/33
112180799191,15cyclictest0-21swapper/33
112180799191,15cyclictest0-21swapper/33
112180799191,14cyclictest1177118-21chrt3
112180799191,14cyclictest0-21swapper/33
112180799191,14cyclictest0-21swapper/33
112180799191,14cyclictest0-21swapper/33
112180799190,7cyclictest1335900-21chrt3
112180799190,16cyclictest66950irq/132-enp1s0-TxRx-33
14052172181,3sleep10-21swapper/11
13359322181,3sleep21335942-21ssh2
13187752181,3sleep20-21swapper/22
13019072181,3sleep11252430-21diskmemload1
112180799189,5cyclictest1430258-21turbostat3
112180799183,12cyclictest66950irq/132-enp1s0-TxRx-33
1121807991812,3cyclictest0-21swapper/33
112180799181,14cyclictest66950irq/132-enp1s0-TxRx-33
112180799181,14cyclictest0-21swapper/33
112180799181,14cyclictest0-21swapper/33
112180799181,14cyclictest0-21swapper/33
112180799181,14cyclictest0-21swapper/33
112180799181,13cyclictest0-21swapper/33
112180799181,13cyclictest0-21swapper/33
112180799181,13cyclictest0-21swapper/33
112180799181,13cyclictest0-21swapper/33
112180799181,13cyclictest0-21swapper/33
112180799180,14cyclictest0-21swapper/33
14874932171,11sleep21252430-21diskmemload2
14772292170,2sleep10-21swapper/11
143563821711,2sleep30-21swapper/33
116212921711,3sleep0151ktimers/00
112180799171,13cyclictest0-21swapper/33
112180799171,13cyclictest0-21swapper/33
112180799171,12cyclictest0-21swapper/33
112180799170,14cyclictest0-21swapper/33
112180799170,13cyclictest0-21swapper/33
112180799170,12cyclictest0-21swapper/33
16066262161,3sleep20-21swapper/22
14468592160,1sleep00-21swapper/00
13706362161,3sleep21252430-21diskmemload2
12319712160,2sleep0221rcuc/00
11836932161,3sleep11183788-21kthreadcore1
11334442161,4sleep01133498-21ntpq0
1121807991613,1cyclictest0-21swapper/33
1121807991612,3cyclictest0-21swapper/33
112180799161,13cyclictest0-21swapper/33
112180799161,13cyclictest0-21swapper/33
112180799160,13cyclictest0-21swapper/33
112180799160,13cyclictest0-21swapper/33
15223392151,2sleep00-21swapper/00
14047402151,2sleep10-21swapper/11
13933202151,2sleep20-21swapper/22
13599842150,4sleep00-21swapper/00
11455992151,11sleep11145660-21/usr/sbin/munin1
1121807991512,2cyclictest0-21swapper/33
1121807991512,1cyclictest0-21swapper/33
112180799151,11cyclictest1126964-21taskset3
112180799151,11cyclictest0-21swapper/33
112180799150,13cyclictest0-21swapper/33
112180799150,13cyclictest0-21swapper/33
112180799150,12cyclictest0-21swapper/33
15039332141,4sleep11503936-21ssh1
14795642141,9sleep01252430-21diskmemload0
14725772141,8sleep11252430-21diskmemload1
13934622140,2sleep10-21swapper/11
13615722141,4sleep11252430-21diskmemload1
13462962142,6sleep21252430-21diskmemload2
13280992141,2sleep20-21swapper/22
12824172141,8sleep01282473-21ntpq0
1121807991411,2cyclictest0-21swapper/33
1121807991411,2cyclictest0-21swapper/33
112180799140,12cyclictest0-21swapper/33
112180799140,12cyclictest0-21swapper/33
15800032131,7sleep21252430-21diskmemload2
15726572131,8sleep11572669-21sh1
15720592131,4sleep21572073-21ssh2
15638462131,8sleep11563856-21ssh1
15302772131,4sleep21530288-21ssh2
14203972131,4sleep21420411-21ssh2
13337462131,7sleep00-21swapper/00
13013382131,3sleep21301349-21ssh2
12663192131,4sleep21266330-21ssh2
12315792130,2sleep10-21swapper/11
12139162130,2sleep20-21swapper/22
11995482131,7sleep01199757-21hddtemp_smartct0
11978702131,5sleep01197959-21ntpq0
11719532130,1sleep00-21swapper/00
11219892131,8sleep11122248-21sh1
112180799135,5cyclictest11563082sleep33
112180799131,2cyclictest0-21swapper/33
15544512120,3sleep01554465-21ssh0
15542672125,2sleep10-21swapper/11
15484932121,5sleep11548503-21ssh1
15404262121,7sleep00-21swapper/00
15307292121,7sleep01530743-21ssh0
15297882121,3sleep11529798-21ssh1
15211272121,6sleep11252430-21diskmemload1
15143322121,6sleep01252430-21diskmemload0
14621422121,7sleep01462156-21ssh0
14536652121,7sleep1802-21snmpd1
14228302121,7sleep21423930-21tr2
14190622122,4sleep01252430-21diskmemload0
13876132121,7sleep01387616-21ssh0
13588682123,4sleep21358919-21ntpq2
13429002121,7sleep0802-21snmpd0
13099692121,6sleep01252430-21diskmemload0
13028992121,7sleep01302913-21ssh0
12758662121,7sleep01275878-21ssh0
12473562121,7sleep21247536-21ls2
12459752121,6sleep01246064-21ntpq0
12300302121,7sleep01230083-21ldconfig0
12193422121,5sleep21219385-21ntpq2
12140662121,3sleep01214109-21ntp_offset0
12051682122,6sleep01205963-21kthreadcore0
15898852111,6sleep01589896-21ssh0
15823542111,5sleep11582389-21ssh1
15801462111,4sleep11252430-21diskmemload1
15732152111,5sleep01252430-21diskmemload0
15625152110,3sleep01562525-21ssh0
15359562111,5sleep21536049-21ntpq2
15201282111,4sleep21252430-21diskmemload2
14719042112,4sleep21252430-21diskmemload2
14463972111,5sleep11252430-21diskmemload1
14355972111,4sleep01252430-21diskmemload0
14108492111,5sleep01252430-21diskmemload0
14048432111,6sleep01404883-21grep0
13933572111,7sleep01393367-21ssh0
13878262111,3sleep20-21swapper/22
13767842110,1sleep11252430-21diskmemload1
13718192111,5sleep21372039-21hddtemp_smartct2
13517142111,6sleep11351724-21ssh1
13453852110,2sleep20-21swapper/22
13449982111,3sleep10-21swapper/11
13352112110,3sleep10-21swapper/11
13247872111,5sleep01324845-21ntpq0
13087792111,4sleep20-21swapper/22
12928802111,5sleep01252430-21diskmemload0
12909692111,7sleep11291097-21ssh1
12739662111,5sleep21274026-21ntpq2
12696952111,3sleep10-21swapper/11
12593492111,3sleep10-21swapper/11
12517322111,5sleep01251942-21grep0
12033422111,6sleep21199259-21/usr/sbin/munin2
11939332111,5sleep21194191-21df_inode2
11885722110,7sleep01188656-21grep0
11554622111,5sleep11155653-21users1
11554622111,5sleep11155653-21users1
11332532111,5sleep21133394-21ntpq2
11225272111,6sleep01123385-21kthreadcore0
16049122101,3sleep01252430-21diskmemload0
16041952101,2sleep10-21swapper/11
15957922101,4sleep11252430-21diskmemload1
15952552100,1sleep00-21swapper/00
15865352101,2sleep20-21swapper/22
15622662101,3sleep21252430-21diskmemload2
15556392101,2sleep20-21swapper/22
15361762101,5sleep11536231-21/usr/sbin/munin1
15361152101,4sleep01536174-21ntpq0
15136342101,4sleep11252430-21diskmemload1
15109422101,4sleep21511003-21ntpq2
15026352101,3sleep20-21swapper/22
14982792101,2sleep00-21swapper/00
14898782101,5sleep11489892-21ssh1
14896332101,4sleep21252430-21diskmemload2
14850182101,4sleep01252430-21diskmemload0
14531832101,3sleep00-21swapper/00
14435992101,4sleep21443665-21ntp_states2
14366602101,3sleep10-21swapper/11
14279742100,1sleep10-21swapper/11
14220882101,4sleep01421585-21apt-get0
14205712101,3sleep11252430-21diskmemload1
14117412101,4sleep21252430-21diskmemload2
13816372101,5sleep11252430-21diskmemload1
13690982101,4sleep01252430-21diskmemload0
13632652101,4sleep11363295-21apt-get1
13204142100,1sleep10-21swapper/11
13172952101,3sleep00-21swapper/00
13141172105,2sleep10-21swapper/11
13085312101,3sleep10-21swapper/11
12785262101,6sleep21278708-21sed2
12420482101,4sleep21242298-21df_inode2
12077122101,5sleep21208529-21expr2
11819032101,5sleep11181952-21ntpq1
11818082101,4sleep01181896-21ntpq0
11509682101,4sleep21150987-21apt-get2
11509682101,4sleep21150987-21apt-get2
11386162101,4sleep01138757-21ntpq0
11347192101,4sleep21134980-21df_inode2
11344142101,5sleep11134441-21munin-run1
1595675291,2sleep20-21swapper/22
1579043291,4sleep01579054-21ssh0
1544730290,5sleep20-21swapper/22
1487573291,3sleep11252430-21diskmemload1
1479633291,4sleep21479644-21ssh2
1470982291,3sleep01252430-21diskmemload0
1462743291,2sleep20-21swapper/22
1461395291,3sleep11252430-21diskmemload1
1453350291,2sleep20-21swapper/22
1396899291,3sleep20-21swapper/22
1376863291,3sleep00-21swapper/00
1352320291,3sleep01252430-21diskmemload0
1292973291,3sleep21252430-21diskmemload2
1283685291,2sleep10-21swapper/11
1267394291,3sleep01252430-21diskmemload0
1259629291,3sleep00-21swapper/00
1241733291,4sleep21241762-21munin-run2
1228214291,5sleep20-21swapper/22
1205966291,5sleep11206696-21kthreadcore1
1192969290,1sleep20-21swapper/22
1181954291,4sleep21182013-21ld2
1140606291,4sleep01141976-21cut0
1139050291,4sleep11139057-21/usr/sbin/munin1
1430868280,2sleep20-21swapper/22
1266678281,3sleep11266688-21ssh1
1247334280,3sleep11247353-21apt-get1
1220326280,1sleep10-21swapper/11
1161200280,1sleep10-21swapper/11
1150302280,1sleep20-21swapper/22
1242582270,3sleep11243532-21cut1
1241543270,4sleep00-21swapper/00
1230786270,1sleep10-21swapper/11
1225468270,1sleep10-21swapper/11
1222760270,4sleep00-21swapper/00
1220651270,2sleep20-21swapper/22
1199258271,1sleep10-21swapper/11
1193912270,2sleep10-21swapper/11
1193348271,3sleep11193349-21sshd1
1188238270,1sleep00-21swapper/00
1177203270,1sleep10-21swapper/11
1172547271,3sleep00-21swapper/00
1172266270,2sleep20-21swapper/22
1171812270,1sleep10-21swapper/11
1166469270,1sleep20-21swapper/22
1161354271,3sleep1576-21in:imuxsock1
1161014270,1sleep20-21swapper/22
1155704270,1sleep00-21swapper/00
1155704270,1sleep00-21swapper/00
1146025271,3sleep00-21swapper/00
1144985270,4sleep10-21swapper/11
1236644261,2sleep10-21swapper/11
1235188260,1sleep20-21swapper/22
1213203261,2sleep10-21swapper/11
1183840260,2sleep21185293-21kthreadcore2
1161027260,1sleep00-21swapper/00
1143793260,2sleep21144046-21strings2
1126763260,4sleep20-21swapper/22
1220157250,1sleep00-21swapper/00
1171696250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional