You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-18 - 13:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Tue Aug 18, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
134679522850,2sleep00-21swapper/00
10868762130112,13sleep30-21swapper/33
109152429173,12sleep20-21swapper/22
109163228857,12sleep10-21swapper/11
108686827651,7sleep00-21swapper/00
109191799231,18cyclictest15617442sleep33
109191799231,17cyclictest1281351-21taskset3
1091917992218,2cyclictest0-21swapper/33
1091917992218,2cyclictest0-21swapper/33
109191799220,18cyclictest0-21swapper/33
109191799211,16cyclictest0-21swapper/33
109191799210,1cyclictest0-21swapper/33
13079932201,6sleep11308455-21cut1
109191799209,7cyclictest66950irq/132-enp1s0-TxRx-33
1091917992012,7cyclictest0-21swapper/33
109191799201,15cyclictest0-21swapper/33
109191799201,15cyclictest0-21swapper/33
109191799201,15cyclictest0-21swapper/33
109191799200,16cyclictest0-21swapper/33
13690522190,2sleep30-21swapper/33
109191799192,14cyclictest66950irq/132-enp1s0-TxRx-33
109191799192,12cyclictest1490272-21taskset3
1091917991915,2cyclictest0-21swapper/33
109191799191,15cyclictest66950irq/132-enp1s0-TxRx-33
109191799191,14cyclictest1533562-21taskset3
109191799191,14cyclictest0-21swapper/33
109191799191,14cyclictest0-21swapper/33
109191799191,14cyclictest0-21swapper/33
109191799191,14cyclictest0-21swapper/33
14365982181,5sleep21436611-21ssh2
14080562181,3sleep00-21swapper/00
13223142185,8sleep01219943-21diskmemload0
11048642186,8sleep139542-21systemd-journal1
1091917991815,1cyclictest0-21swapper/33
1091917991812,4cyclictest1384053-21taskset3
109191799181,15cyclictest0-21swapper/33
109191799181,14cyclictest0-21swapper/33
109191799181,14cyclictest0-21swapper/33
109191799181,14cyclictest0-21swapper/33
109191799181,14cyclictest0-21swapper/33
109191799181,14cyclictest0-21swapper/33
109191799181,13cyclictest1403216-21taskset3
109191799181,13cyclictest0-21swapper/33
109191799181,13cyclictest0-21swapper/33
109191799181,13cyclictest0-21swapper/33
109191799181,13cyclictest0-21swapper/33
109191799181,13cyclictest0-21swapper/33
109191799181,13cyclictest0-21swapper/33
109191799180,15cyclictest0-21swapper/33
109191799180,14cyclictest0-21swapper/33
15779862171,4sleep01219943-21diskmemload0
14789762171,3sleep00-21swapper/00
14431072171,7sleep01443115-21ssh0
109191799171,4cyclictest0-21swapper/33
1091917991711,3cyclictest0-21swapper/33
1091917991711,3cyclictest0-21swapper/33
109191799171,13cyclictest0-21swapper/33
109191799171,13cyclictest0-21swapper/33
109191799171,13cyclictest0-21swapper/33
109191799171,11cyclictest0-21swapper/33
109191799170,14cyclictest0-21swapper/33
109191799170,14cyclictest0-21swapper/33
109191799170,13cyclictest0-21swapper/33
15608572161,5sleep11219943-21diskmemload1
15184132161,9sleep21518439-21ssh2
15057372161,4sleep01219943-21diskmemload0
13827792161,2sleep00-21swapper/00
12270182161,3sleep00-21swapper/00
109191799161,12cyclictest0-21swapper/33
109191799160,13cyclictest0-21swapper/33
109191799160,13cyclictest0-21swapper/33
109191799160,13cyclictest0-21swapper/33
109191799160,12cyclictest1188232-21chrt3
15864042151,2sleep20-21swapper/22
14292642151,3sleep11219943-21diskmemload1
14287562151,4sleep11219943-21diskmemload1
14181762151,5sleep11219943-21diskmemload1
14179792151,3sleep21219943-21diskmemload2
14027392151,3sleep20-21swapper/22
13673782151,9sleep01219943-21diskmemload0
11691902151,10sleep11170721-21tr1
1091917991513,1cyclictest0-21swapper/33
109191799150,13cyclictest0-21swapper/33
109191799150,13cyclictest0-21swapper/33
109191799150,13cyclictest0-21swapper/33
109191799150,13cyclictest0-21swapper/33
109191799150,12cyclictest0-21swapper/33
109191799150,12cyclictest0-21swapper/33
15700902141,4sleep11570093-21ssh1
14190832140,2sleep00-21swapper/00
14011952141,8sleep11219943-21diskmemload1
13821132141,2sleep10-21swapper/11
13598182141,6sleep11359843-21ssh1
13412002141,9sleep01341214-21ssh0
12894792141,8sleep20-21swapper/22
12855322141,5sleep11285629-21grep1
12721682141,7sleep11272323-21sed1
12524142141,3sleep20-21swapper/22
12326472141,9sleep21233124-21head2
11568962141,8sleep11156971-21sed1
1091917991411,1cyclictest0-21swapper/33
1091917991410,2cyclictest0-21swapper/33
109191799140,2cyclictest0-21swapper/33
15853872131,8sleep01585399-21ssh0
15612282131,3sleep21561238-21ssh2
15263632131,8sleep11526375-21ssh1
14973812131,5sleep01497393-21pool-udisksd0
14815222131,7sleep21481196-21sendmail-msp2
14636772132,5sleep01219943-21diskmemload0
14546452130,2sleep20-21swapper/22
14519772131,9sleep11451988-21ssh1
13494322132,6sleep11219943-21diskmemload1
13488342130,3sleep21219943-21diskmemload2
13395692136,3sleep11339581-21ssh1
13319132130,2sleep21219943-21diskmemload2
13240782131,8sleep21324093-21ssh2
12440262131,8sleep01244041-21ssh0
11896772131,8sleep01191155-21kthreadcore0
1091917991310,1cyclictest0-21swapper/33
15758082121,3sleep20-21swapper/22
15534902121,5sleep01553100-21sendmail-msp0
15360562121,7sleep11536223-21cat1
15360232121,5sleep01536047-21apt-get0
15129032121,6sleep11219943-21diskmemload1
14881952121,4sleep10-21swapper/11
14728782121,5sleep21473144-21df2
14524702124,4sleep01452484-21sh0
14032672122,4sleep21403279-21apt-get2
13928122121,6sleep21219943-21diskmemload2
13864692121,7sleep11386743-21cut1
13727012121,7sleep01372766-21/usr/sbin/munin0
12793802121,6sleep11219943-21diskmemload1
12496322121,7sleep01250519-21ssh0
12424092121,6sleep21219943-21diskmemload2
12417012124,5sleep11203784-21kworker/u16:0+ext4-rsv-conversion1
12296382121,7sleep01230977-21grep0
11530842121,3sleep21154735-21kthreadcore2
11419532121,6sleep11143415-21kthreadcore1
11409522121,7sleep21140956-21modprobe2
11045712122,2sleep0171rcu_preempt0
11035772122,5sleep21103789-21sed2
11035772122,5sleep21103789-21sed2
109191799128,2cyclictest11039332sleep33
109191799128,2cyclictest11039332sleep33
15670062115,2sleep00-21swapper/00
15526922110,2sleep10-21swapper/11
15349262110,7sleep21534939-21ssh2
15278232111,6sleep01527978-21ssh0
15183342111,6sleep01518339-21rm0
15082172111,5sleep21509363-21cut2
15043252110,2sleep21504339-21ssh2
14647062111,5sleep21464790-21irqstats2
14624192111,6sleep21462433-21ssh2
14463232111,7sleep11446422-21ssh1
13945682111,4sleep00-21swapper/00
13854092111,4sleep21219943-21diskmemload2
13761552111,6sleep11219943-21diskmemload1
13559662111,5sleep11355980-21ssh1
13128412110,1sleep21219943-21diskmemload2
13063092111,5sleep11219943-21diskmemload1
12997772111,6sleep01301182-21ssh0
12940452111,3sleep10-21swapper/11
12813662112,4sleep01281390-21apt-get0
12799102111,4sleep21219943-21diskmemload2
12729382111,5sleep01219943-21diskmemload0
12630822111,5sleep00-21swapper/00
12602242111,3sleep10-21swapper/11
12547692111,3sleep10-21swapper/11
12260222111,3sleep10-21swapper/11
12033702111,6sleep01203517-21xargs0
11679662111,6sleep21167672-21/usr/sbin/munin2
11465992111,2sleep10-21swapper/11
11361522111,5sleep01136406-21df0
15796952101,4sleep11579831-21diskstats1
15664912101,5sleep21566642-21sed2
15507572101,3sleep21219943-21diskmemload2
15338352100,2sleep10-21swapper/11
15141332100,1sleep00-21swapper/00
15042092101,3sleep10-21swapper/11
14959042101,2sleep10-21swapper/11
14901852101,3sleep21219943-21diskmemload2
14878852101,3sleep00-21swapper/00
14780712101,4sleep11219943-21diskmemload1
14685982101,3sleep10-21swapper/11
14659632101,5sleep01467577-21kthreadcore0
14555222101,5sleep11455748-21expr1
14448192100,1sleep20-21swapper/22
14370282100,1sleep00-21swapper/00
14263712101,3sleep20-21swapper/22
14032442101,5sleep11403264-21acpi1
13913572100,1sleep00-21swapper/00
13671992101,3sleep20-21swapper/22
13565792101,4sleep01219943-21diskmemload0
13305972101,3sleep10-21swapper/11
13295652101,6sleep01329638-21sh0
13164862101,2sleep10-21swapper/11
12953572101,5sleep01295368-21ssh0
12691422101,3sleep00-21swapper/00
12634612101,5sleep21263527-21munin-run2
12343582101,2sleep10-21swapper/11
12149642101,3sleep11214983-21apt-get1
11939612101,4sleep11193963-21apt-get1
11872722101,6sleep20-21swapper/22
11781952101,4sleep11178198-21apt-get1
11624052101,4sleep01162407-21apt-get0
11577342101,5sleep21158451-21kthreadcore2
11256202101,4sleep039542-21systemd-journal0
11197552101,4sleep20-21swapper/22
11150862101,4sleep01115105-21apt-get0
10994022100,4sleep11099605-21diskstats1
10994022100,4sleep11099605-21diskstats1
10970602101,5sleep01097112-21systemd-run0
1575797291,4sleep11575807-21ssh1
1549800290,1sleep00-21swapper/00
1537858291,4sleep21539504-21cut2
1426344291,2sleep00-21swapper/00
1368528291,2sleep20-21swapper/22
1358636291,2sleep20-21swapper/22
1339527291,2sleep20-21swapper/22
1312665290,1sleep00-21swapper/00
1304645291,3sleep21219943-21diskmemload2
1295634290,3sleep20-21swapper/22
1263812291,1sleep20-21swapper/22
1225715291,2sleep20-21swapper/22
1205193291,4sleep11206759-21cut1
1204414291,2sleep00-21swapper/00
1203520291,4sleep11203764-21users1
1188637291,3sleep21188420-21sendmail-msp2
1184272291,4sleep01185892-21kthreadcore0
1173451291,4sleep21173524-21kernelversion2
1131490291,5sleep11132321-21kthreadcore1
1124427291,4sleep11124581-21systemctl1
1113899290,2sleep01113991-21proc_pri0
1113899290,2sleep01113991-21proc_pri0
1108495291,4sleep287-1kworker/2:1H+kblockd2
1209693280,3sleep00-21swapper/00
1199756281,3sleep21200177-21kthreadcore2
1179136281,3sleep21180269-21kthreadcore2
1177645280,2sleep00-21swapper/00
1167694281,3sleep01167803-21cpuspeed_turbos0
1167369280,1sleep20-21swapper/22
1146622281,3sleep01146326-21apt-get0
1111805281,3sleep11113530-21kthreadcore1
1111805281,3sleep11113530-21kthreadcore1
1092113280,2sleep20-21swapper/22
1214672270,1sleep10-21swapper/11
1209664271,2sleep20-21swapper/22
1194837271,2sleep21196454-21kthreadcore2
1188935271,2sleep10-21swapper/11
1183045270,1sleep00-21swapper/00
1177695270,1sleep10-21swapper/11
1167257270,1sleep10-21swapper/11
1161983270,1sleep00-21swapper/00
1157167270,1sleep10-21swapper/11
1146614271,2sleep20-21swapper/22
1141366271,2sleep00-21swapper/00
1141069270,1sleep10-21swapper/11
1130917270,1sleep00-21swapper/00
1125951272,1sleep20-21swapper/22
1125904271,3sleep11125948-21tune2fs1
1125214270,2sleep00-21swapper/00
1123963270,3sleep21124266-21sed2
1115673271,2sleep10-21swapper/11
1104014270,1sleep00-21swapper/00
1104014270,1sleep00-21swapper/00
1096828270,1sleep10-21swapper/11
1219782260,1sleep00-21swapper/00
1215538261,2sleep20-21swapper/22
1197847261,2sleep00-21swapper/00
1156780260,1sleep00-21swapper/00
1132323261,2sleep20-21swapper/22
1114123260,2sleep20-21swapper/22
1114123260,2sleep20-21swapper/22
1206760250,1sleep20-21swapper/22
1183283250,1sleep10-21swapper/11
1146086250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional