You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 23:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Thu Jun 18, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1286304212263,55sleep30-21swapper/33
128650629983,9sleep20-21swapper/22
128639528253,17sleep00-21swapper/00
128640128165,10sleep10-21swapper/11
1286789992814,4cyclictest0-21swapper/33
1286789992814,4cyclictest0-21swapper/33
128678999278,7cyclictest0-21swapper/33
1286789992622,2cyclictest0-21swapper/33
128678999261,23cyclictest0-21swapper/33
128678999241,13cyclictest1708137-21taskset3
128678999240,2cyclictest0-21swapper/33
128678999240,2cyclictest0-21swapper/33
128678999231,2cyclictest0-21swapper/33
128678999231,18cyclictest1525884-21chrt3
128678999231,10cyclictest1417032-21turbostat3
128678999230,20cyclictest0-21swapper/33
128678999227,11cyclictest1342456-21turbostat3
128678999221,4cyclictest0-21swapper/33
128678999221,17cyclictest1732476-21taskset3
128678999221,17cyclictest1640896-21taskset3
128678999216,7cyclictest0-21swapper/33
128678999214,2cyclictest0-21swapper/33
128678999211,18cyclictest0-21swapper/33
128678999211,17cyclictest1623819-21taskset3
128678999210,12cyclictest0-21swapper/33
17327732201,14sleep01417020-21diskmemload0
15425242201,4sleep01417020-21diskmemload0
13254842200,11sleep01325525-21ntpq0
13254842200,11sleep01325525-21ntpq0
128678999202,13cyclictest1677006-21taskset3
128678999198,8cyclictest66950irq/132-enp1s0-TxRx-33
128678999195,4cyclictest0-21swapper/33
128678999195,11cyclictest0-21swapper/33
128678999192,15cyclictest66950irq/132-enp1s0-TxRx-33
128678999192,13cyclictest0-21swapper/33
128678999192,12cyclictest1765908-21taskset3
128678999191,8cyclictest1651353-21turbostat3
1286789991914,3cyclictest0-21swapper/33
1286789991913,4cyclictest0-21swapper/33
1286789991913,3cyclictest14246072sleep33
1286789991913,3cyclictest0-21swapper/33
1286789991913,3cyclictest0-21swapper/33
128678999191,15cyclictest0-21swapper/33
128678999191,15cyclictest0-21swapper/33
128678999191,14cyclictest1374065-21chrt3
128678999191,14cyclictest0-21swapper/33
128678999191,14cyclictest0-21swapper/33
128678999191,14cyclictest0-21swapper/33
128678999191,14cyclictest0-21swapper/33
17357522181,4sleep10-21swapper/11
128678999189,6cyclictest1353120-21turbostat3
128678999182,12cyclictest0-21swapper/33
128678999181,7cyclictest1315672-21turbostat3
128678999181,6cyclictest1304746-21turbostat3
128678999181,4cyclictest0-21swapper/33
128678999181,4cyclictest0-21swapper/33
128678999181,4cyclictest0-21swapper/33
128678999181,4cyclictest0-21swapper/33
128678999181,3cyclictest0-21swapper/33
128678999181,3cyclictest0-21swapper/33
128678999181,3cyclictest0-21swapper/33
1286789991811,4cyclictest1310179-21chrt3
128678999181,14cyclictest0-21swapper/33
128678999180,15cyclictest0-21swapper/33
128678999180,14cyclictest0-21swapper/33
128678999180,14cyclictest0-21swapper/33
17520622171,8sleep11752076-21ssh1
16504672171,6sleep21650478-21ssh2
16500292171,11sleep11417020-21diskmemload1
15491652171,3sleep20-21swapper/22
15491652171,3sleep20-21swapper/22
15341012171,2sleep10-21swapper/11
14989162171,2sleep20-21swapper/22
14824282171,12sleep11417020-21diskmemload1
14563872171,12sleep21456394-21ssh2
14411942171,1sleep10-21swapper/11
14238892171,4sleep10-21swapper/11
14053842171,12sleep11405445-21modprobe1
128678999176,2cyclictest0-21swapper/33
17256972161,3sleep20-21swapper/22
16907452161,5sleep21417020-21diskmemload2
16827162161,2sleep00-21swapper/00
14895862161,4sleep01417020-21diskmemload0
14748772160,7sleep20-21swapper/22
128678999168,6cyclictest0-21swapper/33
128678999168,5cyclictest1336153-21chrt3
128678999163,3cyclictest66950irq/132-enp1s0-TxRx-33
128678999163,3cyclictest66950irq/132-enp1s0-TxRx-33
128678999161,12cyclictest0-21swapper/33
128678999161,12cyclictest0-21swapper/33
128678999160,5cyclictest1379735-21turbostat3
128678999160,13cyclictest0-21swapper/33
128678999160,13cyclictest0-21swapper/33
17332982151,3sleep10-21swapper/11
16686712151,7sleep11668899-21diskstats1
15976642151,10sleep01597766-21cat0
15675572151,8sleep21567593-21munin-run2
15584042151,6sleep21558418-21ssh2
15429652151,4sleep11542995-21apt-get1
15429652151,4sleep11542995-21apt-get1
14565642150,6sleep10-21swapper/11
14251852151,6sleep01425199-21ssh0
13693532150,2sleep20-21swapper/22
128678999152,3cyclictest13840122sleep33
16856822141,8sleep01685583-21/usr/sbin/munin0
16841782141,8sleep10-21swapper/11
16090562141,3sleep21417020-21diskmemload2
16006582141,4sleep10-21swapper/11
15725552140,4sleep00-21swapper/00
13519812144,2sleep1171rcu_preempt1
128678999140,11cyclictest0-21swapper/33
17663052131,7sleep01417020-21diskmemload0
17181092131,8sleep01417020-21diskmemload0
17181092131,8sleep01417020-21diskmemload0
16643682131,6sleep21417020-21diskmemload2
16578792131,8sleep11657893-21ssh1
16577302131,2sleep00-21swapper/00
16414642131,3sleep11641472-21ssh1
16175242131,2sleep1171rcu_preempt1
15972652131,7sleep21597316-21ntpq2
15500722131,6sleep00-21swapper/00
15500722131,6sleep00-21swapper/00
15242892131,3sleep01524300-21ssh0
15103422131,8sleep21417020-21diskmemload2
15074142131,7sleep21417020-21diskmemload2
14928572131,6sleep00-21swapper/00
1286789991310,2cyclictest0-21swapper/33
17580002121,7sleep21417020-21diskmemload2
17512142121,6sleep21417020-21diskmemload2
17095262121,5sleep10-21swapper/11
17007062121,6sleep11417020-21diskmemload1
16262822121,6sleep21626341-21munin-run2
16239772120,4sleep10-21swapper/11
16061102120,9sleep11601582-21/usr/sbin/munin1
15914442121,6sleep01417020-21diskmemload0
15838452121,7sleep01417020-21diskmemload0
15836792121,7sleep21583690-21sh2
15742712121,7sleep21574281-21ssh2
15246362121,3sleep21524647-21ssh2
15088072120,3sleep00-21swapper/00
14981472121,7sleep11417020-21diskmemload1
14887412121,6sleep11488800-21ntpq1
14751992121,8sleep11475212-21sh1
14418722121,7sleep21441883-21ssh2
14405542121,7sleep01440564-21ssh0
13209762121,5sleep11320915-31find1
17491062111,4sleep01417020-21diskmemload0
17421612111,5sleep01417020-21diskmemload0
17185502110,3sleep20-21swapper/22
17185502110,3sleep20-21swapper/22
17162422111,6sleep11716252-21ssh1
17162422111,6sleep11716252-21ssh1
17024542111,7sleep21701909-21apt-get2
16995912111,6sleep01417020-21diskmemload0
16906912111,5sleep11417020-21diskmemload1
16836312110,2sleep21683644-21ssh2
16669262111,5sleep01417020-21diskmemload0
16648892111,5sleep11665115-21users1
16346282111,6sleep01417020-21diskmemload0
16330602111,3sleep10-21swapper/11
16245762111,5sleep01417020-21diskmemload0
15921232111,3sleep10-21swapper/11
15816672110,2sleep10-21swapper/11
15333912111,5sleep01417020-21diskmemload0
14899422111,5sleep21489948-21ssh2
14823972111,3sleep20-21swapper/22
14659062111,5sleep01417020-21diskmemload0
14659062111,5sleep01417020-21diskmemload0
14473002110,2sleep20-21swapper/22
13844542110,2sleep20-21swapper/22
13644802111,5sleep21364596-21irqstats2
13574072111,5sleep11357454-21ntpq1
13160442111,4sleep21316210-21diskstats2
12920572111,5sleep21292325-21diskstats2
17681552101,4sleep21417020-21diskmemload2
17597492101,6sleep01417020-21diskmemload0
17587202100,2sleep10-21swapper/11
17357852101,4sleep21736047-21df2
17336002101,4sleep21417020-21diskmemload2
17247822101,4sleep01417020-21diskmemload0
17024792101,2sleep00-21swapper/00
16762322101,3sleep00-21swapper/00
16502112101,4sleep01417020-21diskmemload0
16331662101,4sleep21417020-21diskmemload2
16091722101,4sleep01417020-21diskmemload0
15920862101,4sleep21417020-21diskmemload2
15733562101,4sleep11417020-21diskmemload1
15664522101,3sleep00-21swapper/00
15589992100,2sleep10-21swapper/11
15562702101,2sleep00-21swapper/00
15347352101,4sleep21534953-21df_inode2
15225372101,6sleep11417020-21diskmemload1
15161532101,4sleep11417020-21diskmemload1
15148702101,4sleep01417020-21diskmemload0
15073602101,3sleep10-21swapper/11
14495692101,4sleep01417020-21diskmemload0
14423552101,4sleep11442374-21apt-get1
14310252101,4sleep01417020-21diskmemload0
14265272101,5sleep11428132-21kthreadcore1
14228572101,5sleep21422870-21ssh2
13962132101,5sleep21396245-21sort2
13770422100,3sleep10-21swapper/11
13467682101,4sleep21346814-21ntpq2
13035832100,5sleep11303721-21ntpq1
12943292101,4sleep01294348-21apt-get0
1724550291,2sleep10-21swapper/11
1672063291,4sleep21672660-21ssh2
1651696291,3sleep20-21swapper/22
1641333290,1sleep20-21swapper/22
1640988290,1sleep00-21swapper/00
1616499291,2sleep00-21swapper/00
1610325291,4sleep21610543-21hddtemp_smartct2
1560114291,4sleep11560267-21interrupts1
1542349291,4sleep11542360-21ssh1
1531968291,4sleep21531982-21ssh2
1482786291,2sleep00-21swapper/00
1473125291,3sleep01417020-21diskmemload0
1459347290,3sleep20-21swapper/22
1459347290,3sleep20-21swapper/22
1432007290,5sleep21432019-21rm2
1374417290,3sleep00-21swapper/00
1348054291,3sleep21348073-21apt-get2
1337401291,3sleep01337420-21apt-get0
1311974291,4sleep21313724-21kthreadcore2
1311155292,3sleep11311973-21kthreadcore1
1300237291,5sleep21300907-21kthreadcore2
1760786281,2sleep11417020-21diskmemload1
1700912281,2sleep20-21swapper/22
1465197280,2sleep10-21swapper/11
1465197280,2sleep10-21swapper/11
1457140281,2sleep00-21swapper/00
1415852280,1sleep10-21swapper/11
1410797281,3sleep01410885-21processes0
1407221281,3sleep21408740-21kthreadcore2
1395939281,2sleep00-21swapper/00
1374700281,4sleep01374914-21cstates0
1337142281,3sleep11337167-21munin-run1
1336453281,3sleep01336533-21cat0
1332612280,4sleep21332973-21grep2
1327334281,3sleep21328623-21cat2
1320970281,3sleep01320915-31find0
1299961281,3sleep01300058-21fschecks_time0
1291996280,1sleep20-21swapper/22
1291095281,3sleep11291143-21ntpq1
1286947280,4sleep00-21swapper/00
1412515271,3sleep21413686-21kthreadcore2
1411686270,4sleep00-21swapper/00
1406615270,3sleep11406634-21apt-get1
1390612270,2sleep10-21swapper/11
1390102270,1sleep10-21swapper/11
1386823271,2sleep00-21swapper/00
1384673270,1sleep00-21swapper/00
1363443270,1sleep00-21swapper/00
1352767270,1sleep00-21swapper/00
1310116270,1sleep20-21swapper/22
1305879271,2sleep00-21swapper/00
1295438270,4sleep11297131-21kthreadcore1
1401837261,2sleep00-21swapper/00
1396881261,2sleep10-21swapper/11
1391219261,2sleep20-21swapper/22
1384336261,2sleep11384451-21timerandwakeup1
1374146260,1sleep10-21swapper/11
1363626260,1sleep10-21swapper/11
1363594260,1sleep20-21swapper/22
1358363260,4sleep00-21swapper/00
1342391260,1sleep20-21swapper/22
1341446260,2sleep10-21swapper/11
1326750260,4sleep10-21swapper/11
1326380260,1sleep20-21swapper/22
1326380260,1sleep20-21swapper/22
1326228260,1sleep10-21swapper/11
1326228260,1sleep10-21swapper/11
1315618260,1sleep00-21swapper/00
1310102260,1sleep10-21swapper/11
1404591250,1sleep20-21swapper/22
1395510250,3sleep00-21swapper/00
1385810250,1sleep20-21swapper/22
1378854250,2sleep20-21swapper/22
1367541250,2sleep10-21swapper/11
1365748250,2sleep00-21swapper/00
1354714250,2sleep20-21swapper/22
1342719250,3sleep00-21swapper/00
1330933250,2sleep00-21swapper/00
1342446240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional