You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 16:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Sat Sep 05, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
164419322650,1sleep11644190-21sendmail-msp1
1319306214256,71sleep30-21swapper/33
131942428354,10sleep20-21swapper/22
131931928252,11sleep10-21swapper/11
131927828162,13sleep00-21swapper/00
16626262680,2sleep00-21swapper/00
1319640992511,10cyclictest1563837-21turbostat3
1319640992320,1cyclictest0-21swapper/33
131964099231,18cyclictest0-21swapper/33
1319640992117,2cyclictest0-21swapper/33
1319640992117,2cyclictest0-21swapper/33
1319640992112,5cyclictest0-21swapper/33
131964099211,16cyclictest0-21swapper/33
131964099211,16cyclictest0-21swapper/33
131964099209,7cyclictest1667638-21taskset3
1319640992012,5cyclictest0-21swapper/33
131964099201,15cyclictest0-21swapper/33
131964099201,15cyclictest0-21swapper/33
131964099201,15cyclictest0-21swapper/33
131964099201,15cyclictest0-21swapper/33
131964099201,14cyclictest0-21swapper/33
131964099200,16cyclictest0-21swapper/33
131964099192,12cyclictest1510802-21taskset3
1319640991914,3cyclictest66950irq/132-enp1s0-TxRx-33
1319640991911,5cyclictest0-21swapper/33
1319640991911,5cyclictest0-21swapper/33
131964099191,14cyclictest0-21swapper/33
131964099191,14cyclictest0-21swapper/33
131964099191,14cyclictest0-21swapper/33
131964099191,14cyclictest0-21swapper/33
131964099191,14cyclictest0-21swapper/33
131964099191,14cyclictest0-21swapper/33
131964099191,14cyclictest0-21swapper/33
131964099191,14cyclictest0-21swapper/33
131964099191,14cyclictest0-21swapper/33
131964099190,2cyclictest0-21swapper/33
131964099190,12cyclictest0-21swapper/33
15442232181,4sleep10-21swapper/11
14733962181,3sleep01447795-21diskmemload0
13203112181,6sleep01320382-21irqstats0
1319640991816,1cyclictest0-21swapper/33
1319640991814,2cyclictest0-21swapper/33
1319640991812,4cyclictest0-21swapper/33
1319640991812,3cyclictest0-21swapper/33
131964099181,14cyclictest0-21swapper/33
131964099181,14cyclictest0-21swapper/33
131964099181,14cyclictest0-21swapper/33
131964099181,14cyclictest0-21swapper/33
131964099181,13cyclictest0-21swapper/33
131964099181,13cyclictest0-21swapper/33
131964099181,13cyclictest0-21swapper/33
131964099181,13cyclictest0-21swapper/33
131964099181,13cyclictest0-21swapper/33
131964099181,13cyclictest0-21swapper/33
131964099180,14cyclictest0-21swapper/33
17498192171,3sleep10-21swapper/11
16763992171,3sleep10-21swapper/11
16400272171,3sleep00-21swapper/00
15259422171,2sleep00-21swapper/00
13680512171,5sleep21368142-21/usr/sbin/munin2
1319640991714,1cyclictest0-21swapper/33
131964099171,13cyclictest0-21swapper/33
131964099171,13cyclictest0-21swapper/33
131964099171,13cyclictest0-21swapper/33
131964099171,13cyclictest0-21swapper/33
131964099171,12cyclictest0-21swapper/33
131964099170,14cyclictest0-21swapper/33
131964099170,14cyclictest0-21swapper/33
131964099170,13cyclictest0-21swapper/33
131964099170,13cyclictest0-21swapper/33
17253752161,8sleep01725512-21perl0
16346022160,1sleep10-21swapper/11
16319822160,6sleep00-21swapper/00
15914632161,5sleep11591680-21/usr/sbin/munin1
15914632161,5sleep11591680-21/usr/sbin/munin1
15878362161,11sleep21587850-21ssh2
1319640991614,1cyclictest0-21swapper/33
131964099161,3cyclictest0-21swapper/33
131964099161,3cyclictest0-21swapper/33
131964099160,13cyclictest0-21swapper/33
131964099160,13cyclictest0-21swapper/33
17303262150,10sleep21730341-21ssh2
16685892151,2sleep10-21swapper/11
16612842150,1sleep00-21swapper/00
16500392150,7sleep11650052-21ssh1
16242052151,3sleep11447795-21diskmemload1
14722192151,8sleep11447795-21diskmemload1
13330632153,4sleep10-21swapper/11
1319640991512,1cyclictest0-21swapper/33
131964099150,12cyclictest0-21swapper/33
17957832144,6sleep21795798-21sh2
17683482141,3sleep01447795-21diskmemload0
17588642141,9sleep01758879-21ssh0
17426682141,8sleep21447795-21diskmemload2
17411712141,3sleep21447795-21diskmemload2
16619102141,8sleep21447795-21diskmemload2
16093882141,8sleep01609507-21irqstats0
16065042141,4sleep21606518-21ssh2
15553832141,4sleep11447795-21diskmemload1
14811262141,8sleep01481141-21ssh0
13365842141,9sleep21336711-21wc2
131964099141,2cyclictest0-21swapper/33
1319640991411,1cyclictest0-21swapper/33
131964099140,12cyclictest0-21swapper/33
131964099140,11cyclictest0-21swapper/33
17665172131,1sleep10-21swapper/11
17590402131,8sleep11759051-21ssh1
17339242131,7sleep01447795-21diskmemload0
17155922131,2sleep20-21swapper/22
16773912131,8sleep21677403-21sh2
16624612131,7sleep21447795-21diskmemload2
16088012131,7sleep21608523-21sendmail-msp2
15808432131,7sleep21447795-21diskmemload2
15791452131,4sleep11579160-21ssh1
15700942131,7sleep01447795-21diskmemload0
15197862131,5sleep11447795-21diskmemload1
15166652131,8sleep01516679-21ssh0
14639822131,8sleep11463995-21sh1
14626762131,7sleep01447795-21diskmemload0
14537992131,3sleep01453814-21ssh0
13741372130,1sleep20-21swapper/22
13639622132,6sleep11363984-21apt-get1
131964099136,4cyclictest0-21swapper/33
131964099131,1cyclictest0-21swapper/33
17946352121,7sleep01794648-21rm0
17696452121,5sleep11769673-21apt-get1
17211722120,7sleep01447795-21diskmemload0
16881832120,3sleep21688198-21ssh2
16521512121,7sleep21652166-21ssh2
16362442121,7sleep21637391-21cut2
16344452121,7sleep21634458-21ssh2
16089102121,7sleep11609057-21cpuspeed_turbos1
15795122120,1sleep00-21swapper/00
15628792121,6sleep01447795-21diskmemload0
15520632121,7sleep01552075-21ssh0
15352792121,2sleep20-21swapper/22
14903352121,7sleep21490346-21ssh2
14900892121,2sleep01490103-21ssh0
14547032121,7sleep21454716-21rm2
13477532120,1sleep00-21swapper/00
13271562121,5sleep01327412-21df0
18219012111,3sleep20-21swapper/22
17326882111,5sleep11447795-21diskmemload1
17160402111,6sleep21715742-21sendmail-msp2
17061392110,1sleep00-21swapper/00
17034632111,3sleep20-21swapper/22
17031722111,5sleep11447795-21diskmemload1
16969722111,5sleep01447795-21diskmemload0
16942202111,6sleep21694233-21sh2
16853422111,6sleep01685357-21ssh0
16791482111,5sleep01447795-21diskmemload0
16084512111,7sleep190-21kswapd01
15686732111,6sleep21568926-21unixbench_multi2
15465582112,4sleep11546556-21apt-get1
15376282111,5sleep01537898-21df0
15320922111,6sleep01532728-21cat0
15292022111,4sleep11529281-21irqstats1
15169202110,1sleep20-21swapper/22
15147432110,1sleep10-21swapper/11
15088042110,2sleep01508819-21ssh0
15006022111,6sleep11500620-21sshd-session1
14810822110,7sleep11481097-21ssh1
14806722111,3sleep20-21swapper/22
14567582111,5sleep11456801-21munin-run1
14322932111,4sleep11432295-21apt-get1
14152132111,5sleep21415283-21ntp_states2
14106282110,1sleep20-21swapper/22
14106282110,1sleep20-21swapper/22
13429462111,5sleep11343199-21df1
13376872111,4sleep11337706-21apt-get1
13310122111,5sleep21331152-21ntp_192.168.1142
18201602101,3sleep10-21swapper/11
18136672101,4sleep11447795-21diskmemload1
18136672101,4sleep11447795-21diskmemload1
18046612101,3sleep20-21swapper/22
18042532101,4sleep01447795-21diskmemload0
18040462101,5sleep11804064-21ssh1
17945892100,1sleep10-21swapper/11
17869862101,3sleep11787075-21munin-run1
17852542101,2sleep00-21swapper/00
17696812100,1sleep20-21swapper/22
17597582101,3sleep21447795-21diskmemload2
17351632101,6sleep11736760-21cut1
17221442101,4sleep11447795-21diskmemload1
17121672101,4sleep01447795-21diskmemload0
16824552101,4sleep11680027-21sendmail-msp1
16619542101,3sleep11447795-21diskmemload1
16511592102,3sleep01447795-21diskmemload0
16253502101,2sleep20-21swapper/22
16054042100,5sleep01447795-21diskmemload0
15977482100,1sleep00-21swapper/00
15977482100,1sleep00-21swapper/00
15916812101,5sleep21591815-21kthreadcore2
15916812101,5sleep21591815-21kthreadcore2
15897042101,2sleep00-21swapper/00
15642272100,2sleep10-21swapper/11
15623462101,3sleep20-21swapper/22
15375782101,3sleep20-21swapper/22
15261792101,3sleep20-21swapper/22
15017542100,1sleep10-21swapper/11
15007822100,1sleep20-21swapper/22
14984852101,4sleep00-21swapper/00
14897192101,4sleep11447795-21diskmemload1
14741292101,5sleep21447795-21diskmemload2
14415902101,4sleep21437296-21sendmail-msp2
14375182100,2sleep10-21swapper/11
13999092101,1sleep20-21swapper/22
13905052100,1sleep20-21swapper/22
1821388291,3sleep01447795-21diskmemload0
1811397291,4sleep01811408-21ssh0
1811397291,4sleep01811408-21ssh0
1810725291,3sleep21447795-21diskmemload2
1810725291,3sleep21447795-21diskmemload2
1773148291,4sleep01773710-21ssh0
1748019290,5sleep01447795-21diskmemload0
1707792291,4sleep11709024-21ssh1
1694713291,3sleep11447795-21diskmemload1
1623005290,2sleep00-21swapper/00
1582457291,4sleep11582545-21grep1
1552632291,3sleep20-21swapper/22
1507262291,3sleep21447795-21diskmemload2
1437517292,4sleep0205-21jbd2/sda2-80
1432298291,4sleep21432551-21df2
1422198291,4sleep21422353-21/usr/sbin/munin2
1416490291,3sleep11416492-21apt-get1
1405507290,2sleep00-21swapper/00
1401751291,4sleep21403377-21grep2
1400796291,2sleep10-21swapper/11
1384578290,3sleep00-21swapper/00
1374152291,4sleep01374153-21sshd-session0
1350716291,4sleep01348161-21/usr/sbin/munin0
1332378291,4sleep01332162-21sendmail-msp0
1783090281,3sleep21783288-21ssh2
1767190281,3sleep21767204-21ssh2
1457035281,3sleep21457040-21ssh2
1447712280,2sleep00-21swapper/00
1446912280,2sleep10-21swapper/11
1431929280,2sleep00-21swapper/00
1423280281,3sleep01424982-21grep0
1421193281,3sleep21421197-21modprobe2
1405992280,3sleep00-21swapper/00
1405992280,3sleep00-21swapper/00
1395484281,3sleep11395503-21apt-get1
1385283281,3sleep11385493-21hddtemp_smartct1
1380345281,3sleep10-21swapper/11
1358698280,2sleep00-21swapper/00
1343200281,4sleep21343226-21grep2
1327122280,3sleep11324825-21apt-get1
1319833281,4sleep11319972-21grep1
1447570270,1sleep20-21swapper/22
1436899270,1sleep00-21swapper/00
1429083270,3sleep11430856-21grep1
1416799271,2sleep00-21swapper/00
1405994270,3sleep11406250-21df1
1405994270,3sleep11406250-21df1
1395478271,2sleep00-21swapper/00
1395180271,3sleep10-21swapper/11
1390242270,2sleep00-21swapper/00
1384989270,2sleep20-21swapper/22
1381664271,2sleep20-21swapper/22
1379452270,1sleep00-21swapper/00
1374446271,2sleep20-21swapper/22
1363961270,2sleep00-21swapper/00
1358388270,1sleep10-21swapper/11
1358058271,2sleep21353172-21sendmail-msp2
1352522270,3sleep11352711-21users1
1348168270,2sleep20-21swapper/22
1342524270,1sleep00-21swapper/00
1338254271,2sleep20-21swapper/22
1431892260,1sleep20-21swapper/22
1426517260,4sleep10-21swapper/11
1411212260,1sleep10-21swapper/11
1374445260,2sleep10-21swapper/11
1373798260,1sleep10-21swapper/11
1363319260,1sleep20-21swapper/22
1353397261,2sleep00-21swapper/00
1411207250,1sleep00-21swapper/00
1387124250,2sleep01388817-21cat0
1358720240,1sleep10-21swapper/11
1319976240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional