You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 12:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Mon Apr 27, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
964893213662,70sleep30-21swapper/33
96503928656,12sleep20-21swapper/22
96484028454,10sleep10-21swapper/11
96483928360,6sleep00-21swapper/00
12183312420,4sleep01218388-21ntpq0
96523699231,18cyclictest1255022-21taskset3
14334462232,10sleep01095647-21diskmemload0
965236992117,2cyclictest0-21swapper/33
11545332211,16sleep01154543-21ssh0
9887372201,6sleep2988756-21apt-get2
96523699205,12cyclictest66950irq/132-enp1s0-TxRx-33
96523699201,15cyclictest1143109-21taskset3
96523699197,9cyclictest1408210-21turbostat3
96523699193,14cyclictest66950irq/132-enp1s0-TxRx-33
965236991914,3cyclictest0-21swapper/33
96523699191,15cyclictest0-21swapper/33
96523699191,15cyclictest0-21swapper/33
96523699191,15cyclictest0-21swapper/33
96523699191,15cyclictest0-21swapper/33
96523699191,14cyclictest0-21swapper/33
96523699191,14cyclictest0-21swapper/33
96523699191,14cyclictest0-21swapper/33
96523699191,14cyclictest0-21swapper/33
96523699190,16cyclictest0-21swapper/33
14305392191,7sleep21430553-21ssh2
13369912191,4sleep21337114-21ntpq2
12450422191,8sleep11095647-21diskmemload1
9981552181,5sleep1998204-21ntpq1
96523699189,6cyclictest1119022-21taskset3
96523699187,8cyclictest1052745-21turbostat3
96523699181,5cyclictest66950irq/132-enp1s0-TxRx-33
965236991814,2cyclictest0-21swapper/33
965236991811,5cyclictest66950irq/132-enp1s0-TxRx-33
96523699181,14cyclictest0-21swapper/33
96523699181,14cyclictest0-21swapper/33
96523699181,14cyclictest0-21swapper/33
96523699181,14cyclictest0-21swapper/33
96523699181,14cyclictest0-21swapper/33
96523699181,14cyclictest0-21swapper/33
96523699181,14cyclictest0-21swapper/33
96523699181,14cyclictest0-21swapper/33
96523699181,13cyclictest1405292-21taskset3
96523699181,13cyclictest0-21swapper/33
96523699181,13cyclictest0-21swapper/33
96523699181,13cyclictest0-21swapper/33
96523699181,13cyclictest0-21swapper/33
96523699180,1cyclictest0-21swapper/33
96523699180,15cyclictest66950irq/132-enp1s0-TxRx-33
13748372181,3sleep20-21swapper/22
12726262180,14sleep11095647-21diskmemload1
96523699177,1cyclictest0-21swapper/33
96523699177,1cyclictest0-21swapper/33
96523699176,8cyclictest1015110-21turbostat3
96523699174,8cyclictest0-21swapper/33
965236991713,2cyclictest0-21swapper/33
965236991711,3cyclictest983157-21turbostat3
96523699171,13cyclictest0-21swapper/33
96523699171,12cyclictest0-21swapper/33
96523699170,15cyclictest66950irq/132-enp1s0-TxRx-33
96523699170,14cyclictest0-21swapper/33
96523699170,14cyclictest0-21swapper/33
96523699170,13cyclictest0-21swapper/33
96523699170,13cyclictest0-21swapper/33
14237002171,3sleep10-21swapper/11
13646532170,3sleep2421rcuc/22
13472712171,3sleep00-21swapper/00
13296072171,3sleep00-21swapper/00
11199452171,3sleep00-21swapper/00
96523699166,8cyclictest1090024-21turbostat3
96523699161,3cyclictest0-21swapper/33
96523699161,13cyclictest0-21swapper/33
96523699160,13cyclictest0-21swapper/33
96523699160,13cyclictest0-21swapper/33
96523699160,13cyclictest0-21swapper/33
96523699160,13cyclictest0-21swapper/33
96523699160,12cyclictest0-21swapper/33
14411932161,2sleep10-21swapper/11
12958162161,3sleep00-21swapper/00
12801632161,9sleep11095647-21diskmemload1
11971432161,4sleep11197193-21ssh1
11933432161,9sleep01193406-21ntp_states0
96523699158,4cyclictest1041719-21chrt3
96523699150,12cyclictest0-21swapper/33
96523699150,12cyclictest0-21swapper/33
96523699150,12cyclictest0-21swapper/33
96523699150,12cyclictest0-21swapper/33
13407072151,2sleep10-21swapper/11
13135222150,3sleep20-21swapper/22
11805182151,4sleep11095647-21diskmemload1
96523699142,8cyclictest0-21swapper/33
965236991410,2cyclictest0-21swapper/33
96523699140,2cyclictest0-21swapper/33
96523699140,12cyclictest0-21swapper/33
96523699140,11cyclictest1021003-21chrt3
14423942141,2sleep10-21swapper/11
14217532141,3sleep00-21swapper/00
13975892141,9sleep01397603-21ssh0
13567032141,4sleep21356714-21ssh2
13287522141,8sleep21328808-21ntpq2
12707392140,2sleep20-21swapper/22
11784972141,9sleep01178511-21ssh0
11712392141,9sleep11171253-21ssh1
11627112141,4sleep11162722-21ssh1
11516512141,8sleep21095647-21diskmemload2
11445882141,4sleep11095647-21diskmemload1
11370352141,4sleep11095647-21diskmemload1
9991322131,8sleep0999179-21sendmail0
965236991311,1cyclictest0-21swapper/33
13892762131,3sleep11389286-21ssh1
13813722131,6sleep00-21swapper/00
13572762132,2sleep1171rcu_preempt1
13493502131,7sleep21349422-21ssh2
12716352131,9sleep01271646-21sh0
12635682131,8sleep01095647-21diskmemload0
12457542130,9sleep01095647-21diskmemload0
11037222131,8sleep11103734-21rm1
10535612131,3sleep21054931-21kthreadcore2
10357112131,6sleep21035758-21ntpq2
13980712121,5sleep10-21swapper/11
13968272121,6sleep21095647-21diskmemload2
13132392121,3sleep11313252-21diskmemload1
13058362124,5sleep20-21swapper/22
13058212120,3sleep01305832-21ssh0
12980542121,6sleep21095647-21diskmemload2
12551972121,6sleep21095647-21diskmemload2
12352372121,5sleep11235293-21ntpq1
12132972125,3sleep21213310-21ssh2
12030452121,5sleep20-21swapper/22
12030452121,5sleep20-21swapper/22
11970072121,6sleep21095647-21diskmemload2
11430012121,7sleep21095647-21diskmemload2
11375012120,3sleep21137504-21ssh2
11279652121,3sleep01127976-21ssh0
11256932121,7sleep11125797-21ssh1
11198672121,8sleep21095647-21diskmemload2
10050872121,7sleep01005264-21/usr/sbin/munin0
10034352121,5sleep01003476-21ntpq0
9653982111,5sleep0965417-21apt-get0
14139612111,4sleep21095647-21diskmemload2
14084892111,4sleep00-21swapper/00
13669462115,3sleep20-21swapper/22
13588052111,6sleep01360272-21cut0
13215352111,6sleep11321545-21ssh1
12821632111,4sleep11282196-21ssh1
12306842111,4sleep21095647-21diskmemload2
12290182111,5sleep01095647-21diskmemload0
12272582111,5sleep11227463-21users1
11862542111,4sleep21095647-21diskmemload2
11674152111,5sleep21167541-21ntpq2
11629452110,2sleep00-21swapper/00
11134022111,6sleep11114683-21cat1
11104852111,6sleep21110499-21ssh2
11045832111,5sleep01104807-21hddtemp_smartct0
10946642111,5sleep01094718-21ntpq0
10854842111,6sleep01085849-21grep0
10783732111,5sleep01078409-21ntpq0
10585782111,5sleep21058716-21grep2
10424202111,5sleep21042623-21diskstats2
10424202111,5sleep21042623-21diskstats2
10044042111,3sleep172-21kcompactd01
9780832101,4sleep0978102-21apt-get0
14484532100,2sleep00-21swapper/00
14409382101,4sleep01095647-21diskmemload0
14398192101,3sleep20-21swapper/22
14305782101,2sleep10-21swapper/11
14074532101,3sleep01095647-21diskmemload0
13833442101,4sleep21383368-21apt-get2
13833182101,2sleep00-21swapper/00
13721892101,6sleep01095647-21diskmemload0
13665292101,5sleep11366540-21ssh1
13546772101,4sleep01095647-21diskmemload0
13413042101,3sleep10-21swapper/11
13384742101,4sleep01095647-21diskmemload0
13251302101,4sleep11095647-21diskmemload1
13236762101,5sleep01323678-21ssh0
13221192101,3sleep20-21swapper/22
13078512101,5sleep01308064-21diskstats0
12949772101,4sleep11095647-21diskmemload1
12886732101,3sleep00-21swapper/00
12801242101,2sleep20-21swapper/22
12635292101,2sleep10-21swapper/11
12607112101,4sleep21095647-21diskmemload2
12559002101,3sleep10-21swapper/11
12371772101,4sleep01095647-21diskmemload0
12287442101,4sleep21095647-21diskmemload2
12140892101,2sleep20-21swapper/22
12132862101,5sleep11095647-21diskmemload1
12034322101,2sleep10-21swapper/11
12034322101,2sleep10-21swapper/11
11974672101,2sleep00-21swapper/00
11974672101,2sleep00-21swapper/00
11687462100,1sleep00-21swapper/00
11615282101,3sleep20-21swapper/22
11434892100,1sleep00-21swapper/00
11348832101,4sleep01095647-21diskmemload0
11025272100,2sleep00-21swapper/00
10949392101,5sleep11095158-21grep1
10945842100,1sleep20-21swapper/22
10837602101,5sleep01083821-21pmu-power0
10796002101,4sleep11079619-21apt-get1
10689452101,4sleep21068964-21apt-get2
10532792101,5sleep01053488-21hddtemp_smartct0
10410922101,5sleep21041149-21ntpq2
10263482101,4sleep21026367-21apt-get2
10226552101,5sleep01024447-21kthreadcore0
990481291,4sleep0992257-21grep0
977800293,3sleep00-21swapper/00
965979291,4sleep1967488-21ps1
1446576293,2sleep21095647-21diskmemload2
1417056290,2sleep20-21swapper/22
1413652291,4sleep11413666-21ssh1
1407012291,2sleep20-21swapper/22
1404326291,4sleep11404478-21/usr/sbin/munin1
1374876291,3sleep11374905-21apt-get1
1360273291,4sleep11361835-21ssh1
1305730291,3sleep11305742-21ssh1
1286343290,4sleep21286396-21ntpq2
1279276291,4sleep01279287-21sh0
1252541291,4sleep01252560-21sensors_temp0
1247136291,4sleep21247147-21ssh2
1218673291,3sleep11218746-21find1
1205704291,2sleep00-21swapper/00
1186519291,2sleep00-21swapper/00
1179297291,2sleep10-21swapper/11
1178289291,2sleep20-21swapper/22
1146904290,4sleep11147122-21hddtemp_smartct1
1125478291,3sleep21095647-21diskmemload2
1104170292,4sleep1965227-21cyclictest1
1096065291,4sleep21096317-21df_inode2
1073937290,1sleep10-21swapper/11
1064215291,4sleep01065458-21cut0
1059873291,4sleep11061658-21grep1
1052071291,4sleep21052344-21grep2
1047664291,3sleep01047682-21apt-get0
1042905291,4sleep11044004-21kthreadcore1
1042905291,4sleep11044004-21kthreadcore1
1030255291,4sleep11030395-21ntp_192.168.1141
1019352291,4sleep01019440-21ntpq0
983051280,1sleep20-21swapper/22
979195281,3sleep1980921-21kthreadcore1
1089816281,4sleep2802-21snmpd2
1080172281,3sleep21081616-21kthreadcore2
1079341281,3sleep21079533-21cat2
1047291281,2sleep00-21swapper/00
1047291281,2sleep00-21swapper/00
1037546281,4sleep11038471-21kthreadcore1
1015929281,3sleep11016998-21kthreadcore1
1009714281,3sleep1802-21snmpd1
993586270,1sleep10-21swapper/11
987780271,3sleep1983408-21/usr/sbin/munin1
977466270,2sleep10-21swapper/11
1089703270,1sleep10-21swapper/11
1079039270,1sleep10-21swapper/11
1068653270,1sleep20-21swapper/22
1065459271,3sleep11067266-21kthreadcore1
1052989270,2sleep10-21swapper/11
1049109270,3sleep11050884-21grep1
1041907270,1sleep00-21swapper/00
1036552270,1sleep10-21swapper/11
1036414270,1sleep00-21swapper/00
1016999271,2sleep20-21swapper/22
1010067270,2sleep21010086-21apt-get2
1009617270,1sleep20-21swapper/22
1003764271,3sleep21003926-21sed2
983399260,1sleep00-21swapper/00
977642260,1sleep20-21swapper/22
970143260,1sleep20-21swapper/22
1031344260,1sleep00-21swapper/00
1025730260,1sleep20-21swapper/22
1015023260,3sleep00-21swapper/00
993848250,1sleep20-21swapper/22
987314251,1sleep20-21swapper/22
1058861251,1sleep00-21swapper/00
1020916250,1sleep10-21swapper/11
1010360250,2sleep10-21swapper/11
1068688240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional