You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-21 - 10:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat Mar 21, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
895858213253,74sleep30-21swapper/33
89572028555,11sleep20-21swapper/22
89555128455,11sleep10-21swapper/11
89421528053,15sleep00-21swapper/00
10984602350,2sleep0221rcuc/00
896025992826,1cyclictest0-21swapper/33
896025992725,1cyclictest0-21swapper/33
896025992523,1cyclictest0-21swapper/33
896025992523,1cyclictest0-21swapper/33
896025992513,1cyclictest0-21swapper/33
896025992422,1cyclictest0-21swapper/33
896025992422,1cyclictest0-21swapper/33
896025992420,2cyclictest0-21swapper/33
12320272240,3sleep10-21swapper/11
10782972241,9sleep11026589-21diskmemload1
896025992321,1cyclictest0-21swapper/33
896025992320,1cyclictest0-21swapper/33
896025992319,2cyclictest0-21swapper/33
896025992319,1cyclictest0-21swapper/33
896025992220,1cyclictest0-21swapper/33
896025992220,1cyclictest0-21swapper/33
896025992220,1cyclictest0-21swapper/33
896025992219,1cyclictest0-21swapper/33
896025992219,1cyclictest0-21swapper/33
896025992218,2cyclictest0-21swapper/33
896025992218,2cyclictest0-21swapper/33
896025992218,2cyclictest0-21swapper/33
896025992218,2cyclictest0-21swapper/33
896025992218,2cyclictest0-21swapper/33
89602599221,17cyclictest1015723-21taskset3
12436412220,15sleep20-21swapper/22
896025992119,1cyclictest0-21swapper/33
896025992119,1cyclictest0-21swapper/33
896025992118,1cyclictest0-21swapper/33
896025992118,1cyclictest0-21swapper/33
89602599211,16cyclictest0-21swapper/33
89602599211,16cyclictest0-21swapper/33
12273212211,6sleep00-21swapper/00
89602599207,2cyclictest0-21swapper/33
89602599205,12cyclictest0-21swapper/33
896025992018,1cyclictest0-21swapper/33
896025992018,1cyclictest0-21swapper/33
896025992018,1cyclictest0-21swapper/33
896025992018,1cyclictest0-21swapper/33
896025992018,1cyclictest0-21swapper/33
896025992017,1cyclictest0-21swapper/33
896025992017,1cyclictest0-21swapper/33
896025992017,1cyclictest0-21swapper/33
896025992017,1cyclictest0-21swapper/33
896025992016,2cyclictest0-21swapper/33
89602599201,12cyclictest0-21swapper/33
13321102201,8sleep11026589-21diskmemload1
896025991917,1cyclictest0-21swapper/33
896025991917,1cyclictest0-21swapper/33
896025991917,1cyclictest0-21swapper/33
896025991916,1cyclictest0-21swapper/33
896025991916,1cyclictest0-21swapper/33
896025991914,2cyclictest0-21swapper/33
896025991912,4cyclictest940653-21chrt3
13162722191,3sleep10-21swapper/11
89602599182,13cyclictest0-21swapper/33
896025991816,1cyclictest0-21swapper/33
896025991815,2cyclictest0-21swapper/33
896025991815,1cyclictest0-21swapper/33
896025991815,1cyclictest0-21swapper/33
896025991815,1cyclictest0-21swapper/33
89602599181,13cyclictest0-21swapper/33
11761312181,13sleep01-21systemd0
11761312181,13sleep01-21systemd0
10453772189,4sleep01046927-21tr0
896025991715,1cyclictest0-21swapper/33
896025991715,1cyclictest0-21swapper/33
896025991715,1cyclictest0-21swapper/33
896025991713,2cyclictest0-21swapper/33
896025991713,2cyclictest0-21swapper/33
896025991713,2cyclictest0-21swapper/33
896025991713,2cyclictest0-21swapper/33
896025991713,2cyclictest0-21swapper/33
896025991713,2cyclictest0-21swapper/33
89602599170,6cyclictest951901-21taskset3
13838442171,3sleep00-21swapper/00
11907292170,1sleep00-21swapper/00
11564742171,3sleep10-21swapper/11
10508102171,3sleep20-21swapper/22
896025991614,1cyclictest0-21swapper/33
896025991613,1cyclictest0-21swapper/33
13935442160,1sleep00-21swapper/00
13769712161,4sleep21026589-21diskmemload2
13494612161,2sleep20-21swapper/22
10582992161,3sleep10-21swapper/11
10510982161,10sleep11026589-21diskmemload1
10401962162,8sleep21040260-21ntpq2
9834942151,11sleep1802-21snmpd1
13743832150,3sleep10-21swapper/11
12884762150,2sleep00-21swapper/00
12011632151,3sleep11026589-21diskmemload1
11018722151,4sleep11101933-21ld1
10534832151,3sleep21053505-21apt-get2
13678232141,8sleep11026589-21diskmemload1
12130892141,7sleep01214668-21cut0
11947932141,9sleep01194924-21irqstats0
11829692141,8sleep11026589-21diskmemload1
11367352141,8sleep11136793-21ntpq1
9506482131,6sleep2950695-21ntpq2
13861912131,8sleep11026589-21diskmemload1
12730062130,1sleep00-21swapper/00
12714962132,7sleep21026589-21diskmemload2
12638272131,3sleep01263838-21ssh0
12631952131,8sleep21263206-21ssh2
12268122131,4sleep10-21swapper/11
12097642131,8sleep21209778-21ssh2
12077622131,4sleep00-21swapper/00
11499292131,8sleep01149931-21ssh0
11367972131,8sleep21136862-21ntpq2
11019342132,3sleep2896019-21cyclictest2
10876792130,2sleep20-21swapper/22
10788162131,8sleep21078831-21ssh2
10416232130,2sleep01026589-21diskmemload0
10347542131,7sleep11026589-21diskmemload1
10258812131,8sleep01025889-21sensors0
9882692121,6sleep2988316-21ntpq2
9572892126,2sleep1321rcuc/11
13696982122,5sleep01369742-21idleruntime-cro0
13406842121,5sleep00-21swapper/00
13339172121,7sleep21026589-21diskmemload2
13044592120,5sleep10-21swapper/11
12811972121,6sleep11026589-21diskmemload1
11841812121,2sleep01184195-21ssh0
11768412121,7sleep21177078-21basename2
11677302121,6sleep11026589-21diskmemload1
11677302121,6sleep11026589-21diskmemload1
11415562121,2sleep11141567-21ssh1
11217292121,7sleep01121742-21ssh0
11169252121,7sleep10-21swapper/11
10954232121,6sleep11026589-21diskmemload1
10940742121,3sleep21094085-21ssh2
10352842121,7sleep21035345-21gpgv2
9949702111,4sleep2995186-21diskstats2
9939962111,5sleep0994240-21users0
9773762111,5sleep2977429-21ntp_states2
9772882112,4sleep0977317-21ntpq0
9732722111,5sleep1973527-21df1
9559482111,5sleep0956002-21ntpq0
9415242111,5sleep0941733-21hddtemp_smartct0
9406412111,3sleep10-21swapper/11
9385512111,5sleep0939810-21memory0
9293902111,5sleep2929428-21ntp_states2
13926432111,6sleep11026589-21diskmemload1
13835142111,6sleep21383762-21unixbench_singl2
13606482111,5sleep11360690-21ssh1
13586712111,4sleep20-21swapper/22
13516662111,4sleep11026589-21diskmemload1
13423312111,4sleep20-21swapper/22
13141522111,6sleep01314160-21ssh0
12967552111,3sleep00-21swapper/00
12911992111,4sleep11026589-21diskmemload1
12905742111,5sleep11026589-21diskmemload1
12282502111,6sleep21228264-21ssh2
12146692111,6sleep11216378-21cat1
12127432111,5sleep21212962-21hddtemp_smartct2
11649312110,4sleep10-21swapper/11
11141612111,5sleep00-21swapper/00
11139212112,4sleep11026589-21diskmemload1
10105742111,2sleep21010700-21latency_hist2
10045512111,7sleep01004654-21timerandwakeup0
9679182101,4sleep0967937-21apt-get0
9520772101,4sleep1952199-21diskstats1
9506002101,4sleep1950646-21ntpq1
9452532101,4sleep1945301-21ntpq1
9040802101,5sleep0904365-21cut0
9012932101,5sleep2901480-21latency_hist2
13668302101,3sleep20-21swapper/22
13604262101,2sleep00-21swapper/00
13488742101,5sleep00-21swapper/00
13413542101,4sleep11026589-21diskmemload1
13313552100,6sleep01331366-21ssh0
13231512100,1sleep20-21swapper/22
13177272101,5sleep11317951-21/usr/sbin/munin1
13148822101,3sleep20-21swapper/22
13082792101,2sleep20-21swapper/22
13071372101,3sleep00-21swapper/00
12924462103,3sleep21294097-21kthreadcore2
12882992101,3sleep20-21swapper/22
12715892101,3sleep11026589-21diskmemload1
12474922101,4sleep01247720-21df_inode0
12462632100,4sleep00-21swapper/00
12446922101,4sleep11026589-21diskmemload1
11995422101,4sleep21026589-21diskmemload2
11905952101,4sleep11026589-21diskmemload1
11905082100,6sleep21190515-21ssh2
11559712101,4sleep21026589-21diskmemload2
11498472101,2sleep20-21swapper/22
11317212103,3sleep21131730-21sh2
11237402101,4sleep11026589-21diskmemload1
11153472101,4sleep21115567-21hddtemp_smartct2
11106122101,6sleep21110704-21awk2
10866022101,4sleep11026589-21diskmemload1
10851522101,4sleep01026589-21diskmemload0
10768652100,1sleep00-21swapper/00
10590352101,2sleep00-21swapper/00
10425002101,2sleep10-21swapper/11
10166822101,4sleep01016753-21irqstats0
10043592101,5sleep11000200-21/usr/sbin/munin1
987004290,4sleep0988127-21memory0
945303291,4sleep2945358-21ntpq2
919919291,2sleep10-21swapper/11
914289291,2sleep20-21swapper/22
900351290,6sleep10-21swapper/11
1393313290,5sleep21393323-21ssh2
1374317291,3sleep01374379-21ntpq0
1319905291,2sleep00-21swapper/00
1279837291,4sleep21279851-21ssh2
1278981291,3sleep00-21swapper/00
1261399291,2sleep10-21swapper/11
1247722291,4sleep11247857-21/usr/sbin/munin1
1247345291,2sleep20-21swapper/22
1234565291,4sleep21234821-21users2
1229897291,3sleep00-21swapper/00
1203368291,3sleep11203389-21apt-get1
1173021290,2sleep20-21swapper/22
1173021290,2sleep20-21swapper/22
1166966291,2sleep00-21swapper/00
1163981291,3sleep20-21swapper/22
1150293291,4sleep01150305-21ssh0
1136582291,4sleep01136734-21ntpq0
1129268291,2sleep00-21swapper/00
1096885291,2sleep00-21swapper/00
1069436290,5sleep01026589-21diskmemload0
1069436290,5sleep01026589-21diskmemload0
1069016291,4sleep21069029-21ssh2
1069016291,4sleep21069029-21ssh2
1067476291,3sleep11026589-21diskmemload1
1067476291,3sleep11026589-21diskmemload1
1032265291,3sleep00-21swapper/00
972605280,2sleep10-21swapper/11
951454280,1sleep00-21swapper/00
909448281,3sleep20-21swapper/22
903586281,3sleep1903741-21cstates1
1026520280,1sleep10-21swapper/11
1010832281,2sleep01010851-21apt-get0
1010512280,1sleep00-21swapper/00
999634270,1sleep10-21swapper/11
994266270,4sleep10-21swapper/11
983475270,1sleep20-21swapper/22
983448270,1sleep00-21swapper/00
972703270,1sleep20-21swapper/22
967402270,1sleep00-21swapper/00
962593271,2sleep1962612-21apt-get1
957267270,2sleep00-21swapper/00
956673270,1sleep20-21swapper/22
935905270,2sleep20-21swapper/22
935426270,1sleep00-21swapper/00
930106270,1sleep10-21swapper/11
925260270,2sleep00-21swapper/00
924027270,1sleep20-21swapper/22
914282270,1sleep00-21swapper/00
913918270,1sleep10-21swapper/11
908431270,1sleep20-21swapper/22
1016201271,3sleep11016262-21sort1
1015698270,1sleep10-21swapper/11
1005505270,2sleep10-21swapper/11
1000201270,2sleep20-21swapper/22
999799260,1sleep00-21swapper/00
989570260,2sleep20-21swapper/22
963616261,2sleep20-21swapper/22
918558261,1sleep10-21swapper/11
1021508261,2sleep20-21swapper/22
1018034261,2sleep20-21swapper/22
988128250,1sleep10-21swapper/11
961421250,1sleep20-21swapper/22
930318250,1sleep10-21swapper/11
919889250,1sleep00-21swapper/00
911250250,1sleep00-21swapper/00
896767251,1sleep00-21swapper/00
1010997250,1sleep20-21swapper/22
930892240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional