You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-18 - 10:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Mon May 18, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
98762211960,55sleep30-21swapper/33
9887028566,12sleep10-21swapper/11
9879927959,12sleep20-21swapper/22
9879727657,14sleep00-21swapper/00
9917699221,17cyclictest521471-21taskset3
9917699221,17cyclictest230079-21turbostat3
3080402220,3sleep30-21swapper/33
99176992116,2cyclictest0-21swapper/33
9917699211,16cyclictest288128-21taskset3
9917699211,15cyclictest0-21swapper/33
9917699202,13cyclictest238815-21taskset3
9917699201,3cyclictest0-21swapper/33
99176992011,6cyclictest0-21swapper/33
9917699201,15cyclictest0-21swapper/33
9917699201,15cyclictest0-21swapper/33
4133012201,8sleep2230065-21diskmemload2
3097932202,11sleep1309854-21ntpq1
9917699195,9cyclictest0-21swapper/33
9917699193,11cyclictest104363-21taskset3
9917699192,12cyclictest186737-21taskset3
9917699191,7cyclictest0-21swapper/33
99176991916,1cyclictest0-21swapper/33
99176991912,4cyclictest0-21swapper/33
9917699191,14cyclictest0-21swapper/33
9917699191,14cyclictest0-21swapper/33
9917699191,14cyclictest0-21swapper/33
99176991910,5cyclictest0-21swapper/33
3544812190,3sleep00-21swapper/00
2979552191,14sleep0299242-21grep0
9917699189,6cyclictest395419-21taskset3
99176991816,1cyclictest0-21swapper/33
9917699181,14cyclictest0-21swapper/33
9917699181,14cyclictest0-21swapper/33
9917699181,14cyclictest0-21swapper/33
9917699181,14cyclictest0-21swapper/33
9917699181,14cyclictest0-21swapper/33
9917699181,14cyclictest0-21swapper/33
9917699181,14cyclictest0-21swapper/33
9917699181,14cyclictest0-21swapper/33
9917699181,14cyclictest0-21swapper/33
9917699181,14cyclictest0-21swapper/33
9917699181,14cyclictest0-21swapper/33
9917699181,14cyclictest0-21swapper/33
9917699181,13cyclictest0-21swapper/33
9917699181,13cyclictest0-21swapper/33
9917699180,16cyclictest530874-21taskset3
9917699180,14cyclictest0-21swapper/33
9917699180,14cyclictest0-21swapper/33
4724672180,3sleep1472478-21ssh1
4195782181,9sleep1419589-21ssh1
99176991713,2cyclictest0-21swapper/33
99176991711,3cyclictest0-21swapper/33
9917699171,13cyclictest0-21swapper/33
9917699171,13cyclictest0-21swapper/33
9917699171,13cyclictest0-21swapper/33
9917699170,14cyclictest0-21swapper/33
3764672171,4sleep2230065-21diskmemload2
3632922171,3sleep20-21swapper/22
9917699161,3cyclictest0-21swapper/33
9917699161,12cyclictest0-21swapper/33
9917699160,14cyclictest0-21swapper/33
9917699160,13cyclictest0-21swapper/33
3538712161,3sleep20-21swapper/22
3046152161,2sleep20-21swapper/22
2944652161,3sleep10-21swapper/11
9917699159,4cyclictest0-21swapper/33
99176991512,2cyclictest0-21swapper/33
99176991511,2cyclictest0-21swapper/33
9917699151,10cyclictest149479-21chrt3
9917699151,10cyclictest0-21swapper/33
9917699150,13cyclictest0-21swapper/33
9917699150,13cyclictest0-21swapper/33
9917699150,12cyclictest0-21swapper/33
9917699150,11cyclictest0-21swapper/33
5687142151,7sleep1568839-21ntpq1
5215742151,9sleep0230065-21diskmemload0
4793012151,1sleep20-21swapper/22
4699492151,3sleep10-21swapper/11
3850052151,9sleep1385063-21ntpq1
3718532151,3sleep20-21swapper/22
3183592151,4sleep2318402-21ntpq2
2805062151,4sleep11-21systemd1
2799362151,3sleep0230065-21diskmemload0
2447052151,2sleep10-21swapper/11
1750592151,4sleep1175095-21ntp_states1
99176991412,1cyclictest0-21swapper/33
99176991412,1cyclictest0-21swapper/33
99176991410,3cyclictest0-21swapper/33
9917699140,12cyclictest0-21swapper/33
9917699140,11cyclictest160182-21chrt3
5781152141,9sleep0578128-21ssh0
5184982141,9sleep20-21swapper/22
5133692141,9sleep1513380-21ssh1
4600822141,9sleep2460130-21ntpq2
4527552141,2sleep10-21swapper/11
4008232141,2sleep00-21swapper/00
3971392141,7sleep20-21swapper/22
3056862141,7sleep2305951-21df2
2440822141,9sleep2244094-21sh2
2358902141,9sleep1235904-21ssh1
9917699130,11cyclictest0-21swapper/33
5810742131,8sleep2581085-21cron2
5652742131,8sleep2566593-21cut2
5631032131,8sleep2563109-21ssh2
5288942131,8sleep2528908-21ssh2
5114792132,3sleep0511489-21ssh0
4467942131,8sleep1446804-21ssh1
4447372131,7sleep2230065-21diskmemload2
3462062131,8sleep0346208-21ssh0
2472842137,2sleep1247294-21ssh1
2459652131,8sleep0245975-21ssh0
996162121,8sleep10-21swapper/11
9917699120,1cyclictest0-21swapper/33
5487692121,7sleep2549476-21tr2
5400822121,7sleep2540149-21fschecks_count2
5043392121,7sleep1504349-21ssh1
5036842121,6sleep0230065-21diskmemload0
4530422121,7sleep2453052-21ssh2
4096992121,5sleep1409757-21ntpq1
3857192121,7sleep2385730-21ssh2
3640192121,6sleep00-21swapper/00
3534772121,7sleep10-21swapper/11
3353912121,8sleep2335657-21unixbench_singl2
2553812121,5sleep00-21swapper/00
2083002121,7sleep0208506-21latency_hist0
1983992121,7sleep1197920-21/usr/sbin/munin1
1885452121,7sleep1190294-21tr1
1444032121,8sleep2144559-21grep2
5797592111,7sleep1230065-21diskmemload1
5615452111,3sleep00-21swapper/00
5390932112,4sleep2230065-21diskmemload2
5315352111,7sleep1531613-21ls1
4784202110,2sleep00-21swapper/00
4664002111,5sleep2468139-21cut2
4599792110,7sleep1460079-21ntpq1
4441722111,3sleep00-21swapper/00
4036292111,3sleep10-21swapper/11
3766052110,7sleep0376667-21ntpq0
3444502111,3sleep10-21swapper/11
3308962111,5sleep0331113-21diskstats0
3294942110,2sleep10-21swapper/11
3276552111,3sleep00-21swapper/00
3015732111,5sleep1301641-21ntpq1
2880882111,5sleep20-21swapper/22
2858192110,5sleep10-21swapper/11
2724562111,6sleep2272472-21/usr/sbin/munin2
2682752111,4sleep10-21swapper/11
2345702111,5sleep0234618-21ntpq0
2323772111,7sleep20-21swapper/22
2290372111,5sleep2229083-21ntpq2
1975282110,1sleep20-21swapper/22
1902952111,6sleep2191158-21missed_timers2
1548242111,6sleep0154834-21find0
1393792111,6sleep2140995-21cut2
1232632111,5sleep2123334-21irqstats2
1161582111,5sleep2116176-21ntpq2
1108012111,6sleep0110848-21ld0
1005222111,6sleep0102243-21grep0
5712262101,4sleep0230065-21diskmemload0
5640442101,5sleep1564055-21ssh1
5553942101,4sleep1230065-21diskmemload1
5511412101,4sleep0552199-21memory0
5470262100,1sleep00-21swapper/00
5374072101,2sleep00-21swapper/00
5290172101,4sleep0230065-21diskmemload0
5283372100,6sleep1528350-21sshd1
5122202101,4sleep20-21swapper/22
5018642101,4sleep2501904-21ntpq2
4953932103,2sleep2230065-21diskmemload2
4899382101,5sleep0491221-21grep0
4707032101,3sleep00-21swapper/00
4638582101,3sleep00-21swapper/00
4517272101,5sleep0451778-21ntpq0
4376042100,7sleep0437618-21ssh0
4365592101,4sleep1230065-21diskmemload1
4300732101,2sleep00-21swapper/00
4216892101,3sleep00-21swapper/00
4181602101,5sleep2418224-21ntpq2
4055142101,4sleep0405535-21apt-get0
3966532100,1sleep20-21swapper/22
3930752101,4sleep0393126-21ntpq0
3808042101,4sleep0380823-21apt-get0
3801702101,5sleep1230065-21diskmemload1
3702182101,5sleep1370228-21ssh1
3598602101,5sleep1359924-21ssh1
3361402101,4sleep1230065-21diskmemload1
3299812101,2sleep20-21swapper/22
3217842100,6sleep1230065-21diskmemload1
3212612101,3sleep00-21swapper/00
2958502101,4sleep0230065-21diskmemload0
2932752101,6sleep2293316-21sh2
2874002101,3sleep00-21swapper/00
2691242101,6sleep0230065-21diskmemload0
2621622100,2sleep20-21swapper/22
2575092101,5sleep1259246-21kthreadcore1
2548732101,3sleep20-21swapper/22
2515732101,4sleep0230065-21diskmemload0
2289112101,4sleep1229036-21ntpq1
2144462100,1sleep10-21swapper/11
1859152100,5sleep0185962-21ntpq0
1769602101,6sleep0178639-21kthreadcore0
1672892101,5sleep0169096-21kthreadcore0
1606902101,4sleep1160762-21irqstats1
1185382101,5sleep1120260-21tr1
1160162101,4sleep1116157-21ntpq1
1108492101,5sleep1110899-21ntpq1
544885291,4sleep1230065-21diskmemload1
521927290,1sleep10-21swapper/11
489285291,2sleep10-21swapper/11
486681291,3sleep10-21swapper/11
486602291,3sleep2230065-21diskmemload2
486344291,4sleep0486354-21ssh0
430812291,3sleep2430839-21apt-get2
429682291,2sleep10-21swapper/11
422514290,1sleep20-21swapper/22
388816291,4sleep1388821-21ssh1
359800291,3sleep00-21swapper/00
344320290,1sleep20-21swapper/22
311989291,4sleep0312003-21ssh0
264328291,4sleep2264555-21idleruntime2
224358290,1sleep20-21swapper/22
198209291,4sleep0198397-21expr0
181314291,4sleep1255-21systemd-journal1
155391291,4sleep1156295-21cut1
144686291,4sleep0145669-21grep0
128091291,3sleep2128110-21apt-get2
126886291,4sleep0126943-21ntp_states0
213543280,1sleep20-21swapper/22
187750281,2sleep00-21swapper/00
181245280,1sleep20-21swapper/22
170899280,1sleep00-21swapper/00
153587281,2sleep00-21swapper/00
149457281,2sleep20-21swapper/22
142816281,2sleep10-21swapper/11
138269280,1sleep10-21swapper/11
104319280,2sleep20-21swapper/22
224623270,2sleep10-21swapper/11
214516271,2sleep20-21swapper/22
209134271,2sleep00-21swapper/00
203217270,2sleep10-21swapper/11
197379270,1sleep10-21swapper/11
193403271,3sleep0195093-21kthreadcore0
186783270,1sleep10-21swapper/11
175816270,3sleep2175817-21sshd2
165525270,1sleep10-21swapper/11
156296271,2sleep20-21swapper/22
148995270,2sleep10-21swapper/11
138250270,2sleep20-21swapper/22
132980270,1sleep10-21swapper/11
117714271,2sleep20-21swapper/22
117435270,2sleep00-21swapper/00
112106270,1sleep00-21swapper/00
219612260,1sleep00-21swapper/00
218777260,3sleep00-21swapper/00
210469261,2sleep10-21swapper/11
204013260,3sleep2421rcuc/22
198490261,2sleep20-21swapper/22
170599260,4sleep20-21swapper/22
165184260,3sleep00-21swapper/00
160763261,2sleep20-21swapper/22
143748260,1sleep00-21swapper/00
122757260,1sleep10-21swapper/11
107048261,2sleep20-21swapper/22
228111250,2sleep00-21swapper/00
136888250,2sleep00-21swapper/00
181329240,1sleep20-21swapper/22
149758240,1sleep10-21swapper/11
128338240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional