You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 21:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Mon Apr 06, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
280801216657,104sleep30-21swapper/33
28084928759,10sleep10-21swapper/11
28084528367,10sleep20-21swapper/22
27594928059,14sleep00-21swapper/00
281124992823,2cyclictest0-21swapper/33
281124992522,1cyclictest0-21swapper/33
3613182240,3sleep10-21swapper/11
281124992422,1cyclictest0-21swapper/33
281124992320,1cyclictest0-21swapper/33
7782242221,5sleep1411994-21diskmemload1
7103532221,7sleep0411994-21diskmemload0
4633682221,9sleep2463379-21ssh2
28112499226,13cyclictest0-21swapper/33
281124992219,1cyclictest0-21swapper/33
281124992218,2cyclictest0-21swapper/33
281124992217,2cyclictest0-21swapper/33
281124992215,4cyclictest66950irq/132-enp1s0-TxRx-33
6580392211,4sleep2411994-21diskmemload2
5258862211,3sleep20-21swapper/22
281124992119,1cyclictest0-21swapper/33
281124992118,2cyclictest0-21swapper/33
281124992118,2cyclictest0-21swapper/33
281124992117,2cyclictest0-21swapper/33
28112499211,16cyclictest0-21swapper/33
28112499203,6cyclictest533332-21chrt3
281124992018,1cyclictest0-21swapper/33
281124992017,1cyclictest0-21swapper/33
281124992017,1cyclictest0-21swapper/33
281124992017,1cyclictest0-21swapper/33
281124992017,1cyclictest0-21swapper/33
281124992016,2cyclictest0-21swapper/33
28112499201,2cyclictest0-21swapper/33
28112499201,16cyclictest0-21swapper/33
28112499201,16cyclictest0-21swapper/33
28112499201,15cyclictest0-21swapper/33
28112499201,14cyclictest0-21swapper/33
7360742191,13sleep1411994-21diskmemload1
6830702191,3sleep10-21swapper/11
281124991917,1cyclictest0-21swapper/33
281124991917,1cyclictest0-21swapper/33
281124991917,1cyclictest0-21swapper/33
281124991917,1cyclictest0-21swapper/33
281124991917,1cyclictest0-21swapper/33
281124991916,2cyclictest0-21swapper/33
281124991916,1cyclictest0-21swapper/33
281124991916,1cyclictest0-21swapper/33
281124991916,1cyclictest0-21swapper/33
281124991916,1cyclictest0-21swapper/33
281124991916,1cyclictest0-21swapper/33
281124991914,2cyclictest0-21swapper/33
281124991913,3cyclictest66950irq/132-enp1s0-TxRx-33
28112499190,15cyclictest4204812sleep33
7427632181,5sleep20-21swapper/22
6388222181,3sleep20-21swapper/22
6235512181,13sleep1623661-21cpuspeed_turbos1
3843192181,2sleep1384328-21/usr/sbin/munin1
281124991816,1cyclictest0-21swapper/33
281124991814,2cyclictest0-21swapper/33
281124991813,2cyclictest0-21swapper/33
28112499181,14cyclictest0-21swapper/33
28112499181,14cyclictest0-21swapper/33
28112499181,14cyclictest0-21swapper/33
28112499181,14cyclictest0-21swapper/33
28112499181,13cyclictest0-21swapper/33
281124991810,5cyclictest0-21swapper/33
28112499180,14cyclictest0-21swapper/33
7596232170,2sleep00-21swapper/00
7504122172,8sleep0750565-21ntp_192.168.1140
6630432171,11sleep0663098-21ssh0
5090282171,3sleep20-21swapper/22
4259552170,3sleep10-21swapper/11
28112499177,7cyclictest379360-21taskset3
281124991715,1cyclictest0-21swapper/33
281124991715,1cyclictest0-21swapper/33
281124991715,1cyclictest0-21swapper/33
281124991715,1cyclictest0-21swapper/33
28112499171,12cyclictest0-21swapper/33
281124991710,4cyclictest286379-21sleep3
28112499170,14cyclictest0-21swapper/33
28112499170,14cyclictest0-21swapper/33
7197142161,6sleep20-21swapper/22
6817822161,2sleep00-21swapper/00
6744212161,3sleep1411994-21diskmemload1
5946432160,1sleep00-21swapper/00
5574162162,7sleep1557475-21ntpq1
5007122161,3sleep20-21swapper/22
4822492161,2sleep20-21swapper/22
4451452161,2sleep20-21swapper/22
2863942161,4sleep20-21swapper/22
281124991614,1cyclictest0-21swapper/33
281124991613,1cyclictest0-21swapper/33
281124991613,1cyclictest0-21swapper/33
281124991613,1cyclictest0-21swapper/33
281124991613,1cyclictest0-21swapper/33
28112499160,13cyclictest0-21swapper/33
6205322151,11sleep0620546-21ssh0
6130532151,8sleep00-21swapper/00
4349372151,2sleep10-21swapper/11
3733772155,6sleep244-21ksoftirqd/22
3642502151,9sleep1364460-21hddtemp_smartct1
28112499151,3cyclictest0-21swapper/33
281124991513,1cyclictest0-21swapper/33
28112499150,12cyclictest0-21swapper/33
7691682143,2sleep2171rcu_preempt2
6638132141,2sleep10-21swapper/11
5871292141,9sleep2587139-21ssh2
5593952141,2sleep20-21swapper/22
5325762141,5sleep00-21swapper/00
5178432141,2sleep0517874-21apt-get0
5003662141,4sleep1500377-21ssh1
4988662141,9sleep0498876-21ssh0
4974602141,8sleep1411994-21diskmemload1
3573232141,8sleep0357380-21ntpq0
3062712141,10sleep2308067-21kthreadcore2
7028882131,8sleep1702923-21ssh1
6750442131,3sleep2675058-21ssh2
6477052130,9sleep0647720-21ssh0
6203532131,7sleep2411994-21diskmemload2
6116112131,8sleep2611624-21ssh2
5705982131,8sleep2570612-21ssh2
5705982131,8sleep2570612-21ssh2
5680062130,6sleep20-21swapper/22
5680062130,6sleep20-21swapper/22
5253252131,7sleep1411994-21diskmemload1
5148252131,7sleep1411994-21diskmemload1
5080442132,7sleep00-21swapper/00
4473212131,6sleep1447354-21ssh1
4279572131,4sleep2427968-21ssh2
3527522131,5sleep2353239-21date2
3149512131,7sleep0314871-31find0
7726232121,7sleep2772682-21/usr/sbin/munin2
7419672121,3sleep1742069-21ps1
7179102121,7sleep0717920-21ssh0
6919422120,1sleep20-21swapper/22
6280502121,7sleep2628064-21ssh2
5863842120,4sleep00-21swapper/00
5515922121,7sleep1411994-21diskmemload1
5444452121,7sleep0544666-21hddtemp_smartct0
5426102120,4sleep20-21swapper/22
5410922121,7sleep1541103-21ssh1
5161302121,7sleep0516140-21ssh0
4381752121,7sleep0438342-21date0
3331752121,7sleep1334998-21cut1
7705592111,3sleep00-21swapper/00
7600992111,3sleep20-21swapper/22
7593392111,6sleep1759399-21ntpq1
7000872111,4sleep0411994-21diskmemload0
6980002111,5sleep2698058-21ntpq2
6933202111,7sleep0693332-21ssh0
6641882110,5sleep20-21swapper/22
6207482111,5sleep1411994-21diskmemload1
6041532111,4sleep2431ktimers/22
5935202111,4sleep1411994-21diskmemload1
5801782112,2sleep1171rcu_preempt1
5773072111,5sleep0411994-21diskmemload0
5773072111,5sleep0411994-21diskmemload0
5331582111,3sleep10-21swapper/11
4904902111,5sleep1411994-21diskmemload1
4797962111,4sleep0411994-21diskmemload0
4708472110,7sleep2470860-21sh2
4569752111,3sleep0456374-21/usr/sbin/munin0
4344462111,5sleep2434693-21users2
4192702111,3sleep00-21swapper/00
4174822111,5sleep1411994-21diskmemload1
4057132111,5sleep0405766-21ntp_states0
4056052111,5sleep2405653-21ntpq2
4001892110,1sleep10-21swapper/11
3908632110,1sleep00-21swapper/00
3679282111,5sleep2368018-21ntpq2
3464472111,5sleep0346494-21ntpq0
3354792111,5sleep0335528-21ntpq0
3266392115,3sleep2327983-21kthreadcore2
2818262111,6sleep1282933-21kthreadcore1
7793232101,4sleep0411994-21diskmemload0
7536192100,1sleep20-21swapper/22
7288832102,4sleep2421rcuc/22
7277602101,4sleep1411994-21diskmemload1
7275192101,3sleep20-21swapper/22
7200382100,1sleep0720052-21ssh0
7178262101,3sleep1411994-21diskmemload1
6992982101,3sleep1411994-21diskmemload1
6913712100,7sleep1691384-21sh1
6842992101,3sleep20-21swapper/22
6575072101,5sleep0657518-21ssh0
6462692101,3sleep20-21swapper/22
6413152101,4sleep1641340-21apt-get1
6385982100,6sleep0638613-21ssh0
6287632101,3sleep00-21swapper/00
6109432101,5sleep1610949-21modprobe1
5978572101,6sleep0599337-21kthreadcore0
5937372101,3sleep20-21swapper/22
5768172101,4sleep1411994-21diskmemload1
5768172101,4sleep1411994-21diskmemload1
5683462100,1sleep10-21swapper/11
5683462100,1sleep10-21swapper/11
5519122101,4sleep2411994-21diskmemload2
5396492101,4sleep0539714-21ntp_states0
5274122101,5sleep2527735-21cut2
4958882101,4sleep2495957-21ntp_states2
4871542101,5sleep2487212-21ntpq2
4801072101,3sleep10-21swapper/11
4712312101,4sleep00-21swapper/00
4702732101,4sleep1411994-21diskmemload1
4564112101,4sleep1456680-21df_inode1
4543412101,4sleep2411994-21diskmemload2
4520062101,4sleep0452232-21users0
4468132101,4sleep1411994-21diskmemload1
4467552101,3sleep00-21swapper/00
4264942101,3sleep00-21swapper/00
4191442101,2sleep20-21swapper/22
3949662101,4sleep1395016-21ntpq1
3909152101,4sleep2391173-21df_inode2
3149472101,5sleep1314871-31find1
2942502100,3sleep10-21swapper/11
2886112101,4sleep0288630-21apt-get0
769416291,3sleep1411994-21diskmemload1
753139291,3sleep1411994-21diskmemload1
741896291,4sleep0741961-21ntpq0
734339291,4sleep0734352-21ssh0
702924291,4sleep2411994-21diskmemload2
673097291,3sleep00-21swapper/00
656054291,3sleep1411994-21diskmemload1
632409291,3sleep1411994-21diskmemload1
597416291,4sleep1597542-21/usr/sbin/munin1
568240291,3sleep0411994-21diskmemload0
568240291,3sleep0411994-21diskmemload0
558759291,2sleep00-21swapper/00
488896290,2sleep00-21swapper/00
408228291,4sleep1409968-21cut1
385291291,4sleep0385484-21cstates0
369825290,2sleep10-21swapper/11
358374291,3sleep1358389-21latency_hist1
349215291,4sleep2350996-21tr2
335000291,4sleep2335404-21cut2
324917290,1sleep10-21swapper/11
320737291,3sleep2320756-21apt-get2
314814294,2sleep2421rcuc/22
289790291,4sleep1291530-21cut1
282936291,4sleep2284728-21tr2
406914281,2sleep00-21swapper/00
379658281,3sleep0555-21dbus-daemon0
358982281,3sleep2359190-21/usr/sbin/munin2
358680281,4sleep0358658-21/usr/sbin/munin0
342668281,4sleep2342887-21idleruntime2
341551280,1sleep20-21swapper/22
341139280,1sleep10-21swapper/11
320373280,2sleep172-21kcompactd01
316049281,4sleep0317729-21kthreadcore0
299515281,3sleep0299586-21/usr/sbin/munin0
407194271,2sleep2407297-21perl2
406500270,1sleep10-21swapper/11
396804271,2sleep2397771-21kthreadcore2
384005271,2sleep00-21swapper/00
379311270,1sleep20-21swapper/22
376588271,3sleep1376698-21kthreadcore1
369616272,2sleep00-21swapper/00
368697270,1sleep00-21swapper/00
352684270,1sleep00-21swapper/00
352647270,1sleep10-21swapper/11
337347271,3sleep00-21swapper/00
331070270,1sleep00-21swapper/00
331028270,1sleep10-21swapper/11
320354270,1sleep20-21swapper/22
308679270,2sleep10-21swapper/11
308589270,2sleep00-21swapper/00
299285270,1sleep10-21swapper/11
298923270,4sleep20-21swapper/22
285995270,4sleep00-21swapper/00
399557261,2sleep00-21swapper/00
383506261,2sleep20-21swapper/22
347273260,1sleep10-21swapper/11
299291261,1sleep20-21swapper/22
295652261,2sleep00-21swapper/00
390010250,1sleep10-21swapper/11
389830250,1sleep20-21swapper/22
320897250,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional