You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 20:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Tue Jun 02, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
181497221260,3sleep21814975-21grep2
1341610212558,62sleep30-21swapper/33
134625528754,7sleep00-21swapper/00
134645628554,12sleep20-21swapper/22
134640928151,11sleep10-21swapper/11
134672799232,16cyclictest1651998-21taskset3
134672799232,16cyclictest1651998-21taskset3
134672799232,15cyclictest1477723-21chrt3
134672799222,14cyclictest1687661-21taskset3
1346727992219,1cyclictest0-21swapper/33
134672799214,14cyclictest66950irq/132-enp1s0-TxRx-33
134672799212,13cyclictest1683181-21taskset3
1346727992111,6cyclictest66950irq/132-enp1s0-TxRx-33
134672799201,16cyclictest0-21swapper/33
16764892191,3sleep11477304-21diskmemload1
16426122191,9sleep11477304-21diskmemload1
14854902190,2sleep20-21swapper/22
13756482190,3sleep10-21swapper/11
134672799199,7cyclictest0-21swapper/33
1346727991917,1cyclictest0-21swapper/33
1346727991916,1cyclictest0-21swapper/33
134672799191,15cyclictest66950irq/132-enp1s0-TxRx-33
134672799191,15cyclictest0-21swapper/33
134672799191,14cyclictest1720246-21taskset3
134672799191,14cyclictest0-21swapper/33
134672799191,14cyclictest0-21swapper/33
134672799191,14cyclictest0-21swapper/33
134672799190,16cyclictest0-21swapper/33
134672799190,15cyclictest1615116-21taskset3
15822552181,2sleep00-21swapper/00
14226862181,5sleep01422734-21ntpq0
134672799181,4cyclictest1449269-21taskset3
134672799181,14cyclictest66950irq/132-enp1s0-TxRx-33
134672799181,14cyclictest0-21swapper/33
134672799181,14cyclictest0-21swapper/33
134672799181,14cyclictest0-21swapper/33
134672799181,14cyclictest0-21swapper/33
134672799181,14cyclictest0-21swapper/33
134672799181,14cyclictest0-21swapper/33
134672799181,14cyclictest0-21swapper/33
134672799181,14cyclictest0-21swapper/33
134672799181,14cyclictest0-21swapper/33
134672799181,13cyclictest0-21swapper/33
134672799181,13cyclictest0-21swapper/33
134672799181,13cyclictest0-21swapper/33
134672799181,13cyclictest0-21swapper/33
134672799181,13cyclictest0-21swapper/33
134672799181,13cyclictest0-21swapper/33
134672799181,13cyclictest0-21swapper/33
134672799181,13cyclictest0-21swapper/33
134672799180,15cyclictest0-21swapper/33
15628042171,3sleep10-21swapper/11
134672799171,14cyclictest0-21swapper/33
134672799171,13cyclictest0-21swapper/33
134672799171,13cyclictest0-21swapper/33
134672799171,13cyclictest0-21swapper/33
134672799171,13cyclictest0-21swapper/33
134672799170,13cyclictest0-21swapper/33
16831172162,8sleep21683171-21ntpq2
16569722160,1sleep20-21swapper/22
16517232161,2sleep20-21swapper/22
16517232161,2sleep20-21swapper/22
15892082161,2sleep20-21swapper/22
134672799161,3cyclictest14447542chrt3
134672799161,13cyclictest0-21swapper/33
134672799161,11cyclictest0-21swapper/33
134672799160,13cyclictest0-21swapper/33
134672799160,13cyclictest0-21swapper/33
134672799160,13cyclictest0-21swapper/33
134672799160,13cyclictest0-21swapper/33
134672799160,13cyclictest0-21swapper/33
134672799160,12cyclictest0-21swapper/33
18338212151,4sleep01477304-21diskmemload0
18280422150,3sleep21828040-21ssh2
18044312151,8sleep11805432-21memory1
17830372151,10sleep11783048-21ssh1
15198732151,4sleep11477304-21diskmemload1
15189752151,4sleep21477304-21diskmemload2
15101872150,1sleep10-21swapper/11
15001242151,3sleep01477304-21diskmemload0
14600112151,9sleep21460058-21ntpq2
13806422150,9sleep01380571-31find0
1346727991512,1cyclictest0-21swapper/33
1346727991512,1cyclictest0-21swapper/33
134672799150,13cyclictest0-21swapper/33
134672799150,13cyclictest0-21swapper/33
134672799150,12cyclictest0-21swapper/33
18409572141,9sleep21841096-21sed2
17926032141,3sleep01792614-21ssh0
17445552141,9sleep11477304-21diskmemload1
17202622141,9sleep01720273-21ssh0
17191682140,1sleep20-21swapper/22
16581932141,8sleep01477304-21diskmemload0
16043272141,8sleep21604371-21ntpq2
15909922141,8sleep01591179-21ls0
13756702141,8sleep21375925-21df2
134672799145,6cyclictest1396851-21taskset3
1346727991411,2cyclictest0-21swapper/33
134672799140,12cyclictest0-21swapper/33
134672799140,12cyclictest0-21swapper/33
18418702130,2sleep00-21swapper/00
18259182131,7sleep01477304-21diskmemload0
18252782131,8sleep11825290-21ssh1
17911262131,8sleep21791140-21ssh2
17824902131,8sleep21782504-21ssh2
17720582131,8sleep21772070-21ssh2
17557482131,8sleep01755758-21ssh0
17355712131,3sleep01643210-21kworker/u16:2+rpciod0
16876342133,5sleep21687649-21apt-get2
16846292131,3sleep01477304-21diskmemload0
15805122131,7sleep11477304-21diskmemload1
15704442132,7sleep1802-21snmpd1
15279712131,8sleep11527982-21ssh1
15021852131,8sleep11477304-21diskmemload1
14844102130,1sleep00-21swapper/00
134672799138,3cyclictest1370311-21chrt3
134672799130,1cyclictest0-21swapper/33
17922052121,7sleep01477304-21diskmemload0
17720992121,6sleep11477304-21diskmemload1
17661482120,4sleep0171rcu_preempt0
17116342120,3sleep11711646-21ssh1
17013252122,6sleep11701336-21sh1
16783742120,3sleep21678385-21ssh2
16679072121,7sleep01477304-21diskmemload0
16344362121,8sleep11634447-21ssh1
16256042121,7sleep01477304-21diskmemload0
15536042121,5sleep20-21swapper/22
15448492121,3sleep01544852-21ssh0
15378712121,7sleep11537883-21ssh1
15107092121,7sleep21510722-21ssh2
14386902121,6sleep11438731-21ntpq1
14169502121,5sleep21417091-21ntpq2
13915302121,7sleep21391657-21date2
13744052121,5sleep21374452-21ntpq2
134672799125,4cyclictest1385842-21taskset3
18364642111,5sleep11836688-21df1
18076372111,7sleep21477304-21diskmemload2
18014592111,5sleep01801729-21df_inode0
17751232111,5sleep01775262-21diskstats0
17633832111,3sleep00-21swapper/00
17487322112,4sleep21748757-21apt-get2
17406092111,5sleep01741123-21cut0
17373582111,6sleep21477304-21diskmemload2
17158652111,6sleep11717649-21tr1
17116882111,4sleep20-21swapper/22
17045152111,6sleep21704525-21ssh2
16952962110,5sleep10-21swapper/11
16670022111,2sleep10-21swapper/11
16606822111,4sleep172-21kcompactd01
16495892111,5sleep01477304-21diskmemload0
16495892111,5sleep01477304-21diskmemload0
16414382111,3sleep00-21swapper/00
16408562112,4sleep21477304-21diskmemload2
16345522114,4sleep21634564-21sh2
15715502111,5sleep00-21swapper/00
15477522111,6sleep11547810-21fschecks_count1
15474812111,5sleep01547751-21df_inode0
15278362110,2sleep20-21swapper/22
14915062111,5sleep01477304-21diskmemload0
14722682111,4sleep21472520-21df2
14240122111,5sleep21424267-21df2
14239902111,5sleep10-21swapper/11
14127862111,5sleep21412806-21munin-run2
13869762111,6sleep11387261-21kthreadcore1
13676302111,5sleep01368895-21memory0
13519952112,5sleep11352004-21turbostat.cron1
18161422101,4sleep11477304-21diskmemload1
17989422100,2sleep20-21swapper/22
17631902100,1sleep10-21swapper/11
17567752101,6sleep10-21swapper/11
17403322101,5sleep21740464-21perl2
17296122101,5sleep01729627-21ssh0
17225552101,3sleep20-21swapper/22
17017052101,3sleep00-21swapper/00
16958802101,3sleep01477304-21diskmemload0
16785112101,4sleep11477304-21diskmemload1
16762692101,4sleep01477304-21diskmemload0
16684352101,3sleep20-21swapper/22
16505132101,2sleep10-21swapper/11
16505132101,2sleep10-21swapper/11
16314482100,1sleep00-21swapper/00
16259352101,3sleep20-21swapper/22
16161512101,3sleep11477304-21diskmemload1
16092122101,4sleep01609433-21hddtemp_smartct0
16070772101,2sleep00-21swapper/00
16069362100,5sleep11477304-21diskmemload1
15985082101,3sleep10-21swapper/11
15981192101,2sleep20-21swapper/22
15903062102,3sleep11477304-21diskmemload1
15793562101,4sleep21477304-21diskmemload2
15652192101,4sleep21565251-21ssh2
15627752101,3sleep20-21swapper/22
15615852101,4sleep01477304-21diskmemload0
15464652100,1sleep10-21swapper/11
15349722101,4sleep01477304-21diskmemload0
15265502101,4sleep01477304-21diskmemload0
15208732100,1sleep00-21swapper/00
15077672100,1sleep00-21swapper/00
14934212101,4sleep21477304-21diskmemload2
14668952100,7sleep20-21swapper/22
14618522101,5sleep21463118-21kthreadcore2
14610202101,5sleep11461088-21date1
14333782100,6sleep01433425-21ntpq0
14082242101,4sleep11408308-21irqstats1
14080292101,5sleep01408219-21grep0
13586672101,5sleep21358915-21unixbench_multi2
13519872101,6sleep01346638-21perf0
1832983291,2sleep10-21swapper/11
1816480291,4sleep01816491-21ssh0
1792615291,4sleep11477304-21diskmemload1
1789557291,4sleep11789571-21ssh1
1758108293,3sleep2431ktimers/22
1731187291,2sleep10-21swapper/11
1722885291,4sleep11723111-21ssh1
1710513291,2sleep00-21swapper/00
1623748291,3sleep11477304-21diskmemload1
1608796291,2sleep20-21swapper/22
1596673291,3sleep01477304-21diskmemload0
1543693291,2sleep20-21swapper/22
1530575291,4sleep21530651-21irqstats2
1495624291,4sleep21495802-21cut2
1494072291,4sleep11494086-21ssh1
1483871291,2sleep10-21swapper/11
1466909291,3sleep00-21swapper/00
1455694291,4sleep21455815-21cat2
1449364291,4sleep01449414-21ntpq0
1418669291,4sleep11418921-21df1
1397136291,4sleep21397300-21expr2
1397114291,3sleep11397133-21apt-get1
1385187291,4sleep11385237-21ntpq1
1369867290,1sleep20-21swapper/22
1363504291,5sleep21363685-21cut2
1823437280,1sleep20-21swapper/22
1440543281,3sleep11441686-21kthreadcore1
1438733281,3sleep20-21swapper/22
1433427281,2sleep10-21swapper/11
1418112281,3sleep11418137-21munin-run1
1417141280,4sleep00-21swapper/00
1406560281,4sleep11406611-21open_inodes1
1402462280,4sleep00-21swapper/00
1396598280,2sleep00-21swapper/00
1363797281,3sleep11363845-21/usr/sbin/munin1
1472246270,2sleep10-21swapper/11
1466348270,3sleep01466464-21base640
1461281270,2sleep10-21swapper/11
1453443270,3sleep10-21swapper/11
1451727271,3sleep00-21swapper/00
1450177270,1sleep10-21swapper/11
1450109270,1sleep20-21swapper/22
1439691270,1sleep00-21swapper/00
1391791270,2sleep20-21swapper/22
1381137270,1sleep20-21swapper/22
1375295270,1sleep00-21swapper/00
1370319270,2sleep10-21swapper/11
1370015270,1sleep10-21swapper/11
1363743270,4sleep01363796-21modprobe0
1350984270,2sleep20-21swapper/22
1467776261,2sleep11469455-21cut1
1456236261,2sleep00-21swapper/00
1441689261,2sleep20-21swapper/22
1440426260,2sleep00-21swapper/00
1434162260,1sleep20-21swapper/22
1421349260,2sleep20-21swapper/22
1407328260,1sleep20-21swapper/22
1397407260,2sleep01397621-21smartctl0
1395749260,2sleep10-21swapper/11
1385109260,2sleep00-21swapper/00
1359025260,4sleep00-21swapper/00
1477011250,3sleep00-21swapper/00
1428188250,1sleep00-21swapper/00
1390365250,2sleep00-21swapper/00
1354430250,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional