You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 04:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Tue Apr 07, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3579797213658,73sleep30-21swapper/33
358010628467,8sleep20-21swapper/22
357988727959,12sleep10-21swapper/11
357988127653,17sleep00-21swapper/00
38076762320,2sleep20-21swapper/22
40018762241,8sleep04002104-21df_inode0
358027499241,18cyclictest3770898-21chrt3
358027499222,15cyclictest3747092-21chrt3
3580274992112,6cyclictest0-21swapper/33
358027499211,16cyclictest0-21swapper/33
358027499210,17cyclictest3936858-21taskset3
358027499204,13cyclictest3824112-21taskset3
358027499204,13cyclictest3824112-21taskset3
358027499201,8cyclictest0-21swapper/33
358027499201,16cyclictest0-21swapper/33
358027499201,16cyclictest0-21swapper/33
358027499201,15cyclictest0-21swapper/33
358027499201,15cyclictest0-21swapper/33
358027499201,14cyclictest0-21swapper/33
358027499201,14cyclictest0-21swapper/33
36991032198,5sleep23699150-21ntpq2
358027499199,6cyclictest3956888-21turbostat3
3580274991915,2cyclictest0-21swapper/33
3580274991915,2cyclictest0-21swapper/33
3580274991912,5cyclictest0-21swapper/33
358027499191,15cyclictest0-21swapper/33
358027499191,14cyclictest3734564-21taskset3
358027499191,14cyclictest0-21swapper/33
358027499191,14cyclictest0-21swapper/33
40698222181,3sleep00-21swapper/00
40354812180,1sleep20-21swapper/22
36831062181,5sleep13683160-21ntpq1
358027499189,6cyclictest3866508-21taskset3
358027499186,8cyclictest3694734-21taskset3
358027499181,7cyclictest4037731-21taskset3
3580274991816,1cyclictest0-21swapper/33
3580274991811,5cyclictest0-21swapper/33
358027499181,14cyclictest0-21swapper/33
358027499181,14cyclictest0-21swapper/33
358027499181,14cyclictest0-21swapper/33
358027499181,14cyclictest0-21swapper/33
358027499181,14cyclictest0-21swapper/33
358027499181,14cyclictest0-21swapper/33
358027499181,14cyclictest0-21swapper/33
358027499181,14cyclictest0-21swapper/33
358027499181,13cyclictest3831155-21taskset3
358027499181,13cyclictest0-21swapper/33
358027499181,13cyclictest0-21swapper/33
358027499181,13cyclictest0-21swapper/33
358027499180,15cyclictest0-21swapper/33
40609192171,3sleep00-21swapper/00
39309042171,4sleep03711333-21diskmemload0
38572482171,3sleep10-21swapper/11
37631042171,3sleep20-21swapper/22
3580274991713,2cyclictest0-21swapper/33
3580274991711,3cyclictest0-21swapper/33
358027499171,13cyclictest0-21swapper/33
358027499171,13cyclictest0-21swapper/33
358027499171,13cyclictest0-21swapper/33
358027499171,13cyclictest0-21swapper/33
358027499171,13cyclictest0-21swapper/33
358027499171,13cyclictest0-21swapper/33
358027499171,13cyclictest0-21swapper/33
358027499171,11cyclictest0-21swapper/33
358027499170,14cyclictest0-21swapper/33
358027499170,14cyclictest0-21swapper/33
358027499170,14cyclictest0-21swapper/33
358027499170,14cyclictest0-21swapper/33
40262862161,4sleep13711333-21diskmemload1
39129122161,2sleep20-21swapper/22
38162142160,1sleep20-21swapper/22
37989492161,4sleep13798960-21ssh1
358027499167,6cyclictest3662675-21turbostat3
358027499161,3cyclictest0-21swapper/33
358027499160,13cyclictest0-21swapper/33
358027499160,13cyclictest0-21swapper/33
358027499160,13cyclictest0-21swapper/33
358027499160,13cyclictest0-21swapper/33
40455892151,10sleep24045844-21expr2
39933542150,1sleep20-21swapper/22
39475332151,2sleep00-21swapper/00
39187952151,2sleep20-21swapper/22
39187952151,2sleep20-21swapper/22
39113642150,1sleep00-21swapper/00
389158621510,2sleep10-21swapper/11
38419912151,4sleep03711333-21diskmemload0
38067552151,4sleep13711333-21diskmemload1
37362462151,4sleep03736257-21ssh0
36415722151,9sleep13641827-21df1
35973312151,9sleep13597381-21ntpq1
358027499151,12cyclictest0-21swapper/33
358027499151,12cyclictest0-21swapper/33
358027499150,13cyclictest0-21swapper/33
358027499150,12cyclictest0-21swapper/33
40537332141,3sleep04053744-21ssh0
40281022141,8sleep13711333-21diskmemload1
39997392141,8sleep03711333-21diskmemload0
39916982141,3sleep13711333-21diskmemload1
39547022140,2sleep20-21swapper/22
39476152140,2sleep23929387-21kworker/u16:1+rpciod2
39180852141,9sleep13918345-21grep1
39180852141,9sleep13918345-21grep1
39114312141,3sleep13711333-21diskmemload1
37881012146,4sleep23788113-21rm2
37552752141,3sleep03755277-21ssh0
37157982141,7sleep23715897-21ntpq2
3580274991412,1cyclictest0-21swapper/33
3580274991411,2cyclictest0-21swapper/33
358027499140,2cyclictest0-21swapper/33
358027499140,11cyclictest0-21swapper/33
40286312131,8sleep04028910-21cut0
40167362131,9sleep10-21swapper/11
40167362131,9sleep10-21swapper/11
39946372131,8sleep13996325-21cut1
39653992131,8sleep23965409-21ssh2
39447642131,8sleep13944776-21sh1
39294322131,8sleep23929444-21ssh2
38834112131,8sleep03883425-21ssh0
38759032131,8sleep23875917-21ssh2
38754262131,2sleep00-21swapper/00
38610642131,4sleep13861296-21cstates1
38147712131,7sleep13711333-21diskmemload1
37975162131,3sleep03797530-21ssh0
37695452131,3sleep13769556-21ssh1
36464162130,1sleep20-21swapper/22
36415502130,2sleep00-21swapper/00
3580274991310,1cyclictest0-21swapper/33
40610302121,6sleep13711333-21diskmemload1
40441102121,7sleep04044122-21ssh0
40438662121,8sleep14043877-21sh1
40022452121,6sleep20-21swapper/22
39746792120,1sleep00-21swapper/00
39273712121,6sleep03711333-21diskmemload0
38935862121,3sleep03893602-21ssh0
38514642120,5sleep00-21swapper/00
38368672121,7sleep23838602-21sh2
38333682121,6sleep13711333-21diskmemload1
38155162121,3sleep03815529-21ssh0
37459392121,3sleep13745950-21ssh1
37339272121,7sleep23734054-21ssh2
37287882121,5sleep13711333-21diskmemload1
37200102121,2sleep10-21swapper/11
37011892121,7sleep23701770-21grep2
36924432121,6sleep03693577-21memory0
36776712121,5sleep13677704-21ntpq1
36670332120,1sleep00-21swapper/00
36617722121,7sleep03661855-21/usr/sbin/munin0
36190152121,7sleep23619265-21unixbench_singl2
36079372121,5sleep23607983-21ntpq2
35994302121,3sleep03601120-21kthreadcore0
40777512111,3sleep20-21swapper/22
40720432111,4sleep14072074-21ssh1
40506212111,4sleep13711333-21diskmemload1
40367812112,4sleep24036805-21apt-get2
40254392110,1sleep20-21swapper/22
40240472111,5sleep04024242-21users0
40175822111,3sleep00-21swapper/00
40175822111,3sleep00-21swapper/00
39920082111,3sleep20-21swapper/22
39813812110,3sleep10-21swapper/11
39807852111,5sleep23711333-21diskmemload2
39758512110,7sleep03711333-21diskmemload0
39715962110,7sleep23971611-21ssh2
39544852111,6sleep1802-21snmpd1
39377742111,5sleep23711333-21diskmemload2
39309912111,7sleep13711333-21diskmemload1
39304732111,7sleep1331ktimers/11
39032292111,3sleep20-21swapper/22
39013772110,1sleep00-21swapper/00
38785342111,4sleep20-21swapper/22
38601972111,6sleep20-21swapper/22
38438442111,3sleep10-21swapper/11
38052632114,2sleep03711333-21diskmemload0
37808352111,7sleep00-21swapper/00
37796922112,4sleep13711333-21diskmemload1
37637512110,7sleep03763762-21ssh0
37551282111,6sleep13755141-21rm1
37434142111,3sleep20-21swapper/22
37205042111,3sleep00-21swapper/00
37047682110,1sleep00-21swapper/00
36998852110,1sleep00-21swapper/00
36687672111,5sleep13668837-21irqstats1
36685572111,5sleep03668766-21hddtemp_smartct0
36133062112,4sleep23613354-21ntpq2
40766612101,3sleep00-21swapper/00
40689322101,3sleep20-21swapper/22
40638332101,5sleep14063915-21kernelversion1
40181672101,3sleep20-21swapper/22
40181672101,3sleep20-21swapper/22
40097022101,4sleep13711333-21diskmemload1
39902342101,3sleep00-21swapper/00
39735672101,2sleep10-21swapper/11
39641352101,5sleep13711333-21diskmemload1
39555322101,3sleep03711333-21diskmemload0
39002082101,5sleep13900272-21ntpq1
38859002101,2sleep10-21swapper/11
38697922101,4sleep13711333-21diskmemload1
38684772100,3sleep20-21swapper/22
38505802101,2sleep20-21swapper/22
38420472101,6sleep13711333-21diskmemload1
38225812101,3sleep20-21swapper/22
38225812101,3sleep20-21swapper/22
38223632101,5sleep13822374-21ssh1
38223632101,5sleep13822374-21ssh1
37949492101,5sleep23795005-21ntpq2
37865852101,5sleep03786801-21sed0
37807042101,3sleep20-21swapper/22
37622352101,5sleep13762245-21ssh1
37360532101,4sleep13711333-21diskmemload1
37254452101,3sleep20-21swapper/22
37173062101,3sleep00-21swapper/00
37000802101,5sleep13700084-21cron1
36896572101,4sleep23689676-21apt-get2
36374852101,5sleep23639265-21kthreadcore2
36359412101,4sleep13635959-21/usr/sbin/munin1
36238582101,3sleep23623971-21ntpq2
35932202101,4sleep03593239-21apt-get0
4061394290,1sleep20-21swapper/22
3963149291,3sleep00-21swapper/00
3921002290,1sleep00-21swapper/00
3921002290,1sleep00-21swapper/00
3893768291,2sleep20-21swapper/22
3866208291,2sleep00-21swapper/00
3857438290,2sleep00-21swapper/00
3832750291,2sleep00-21swapper/00
3825927291,4sleep23825940-21ssh2
3823356290,1sleep00-21swapper/00
3823356290,1sleep00-21swapper/00
3769680290,1sleep00-21swapper/00
3769049291,4sleep23769093-21ssh2
3747059290,3sleep23747083-21apt-get2
3738305290,3sleep03738336-21ssh0
3706244291,2sleep10-21swapper/11
3706216291,3sleep272-21kcompactd02
3684316291,3sleep03684335-21apt-get0
3678693291,4sleep23678816-21cat2
3632009291,4sleep23633771-21cut2
3619671291,4sleep13619871-21latency_hist1
3603622290,1sleep00-21swapper/00
3591928291,4sleep13591966-21ntpq1
3584688290,1sleep00-21swapper/00
3667084280,4sleep10-21swapper/11
3657288280,1sleep20-21swapper/22
3652760280,5sleep13653286-21kthreadcore1
3651269281,4sleep03651529-21sed0
3624713280,1sleep00-21swapper/00
3615158281,3sleep03616111-21kthreadcore0
3598862281,3sleep23599092-21idleruntime2
3595775281,3sleep23597142-21/usr/sbin/munin2
3592471280,1sleep00-21swapper/00
3589323281,3sleep23591087-21cut2
3585490281,3sleep23585493-21sshd2
3580442280,2sleep10-21swapper/11
3787073271,2sleep13787086-21ssh1
3705414270,1sleep10-21swapper/11
3694543270,1sleep10-21swapper/11
3684959271,3sleep13686648-21kthreadcore1
3683940270,1sleep00-21swapper/00
3678674270,1sleep00-21swapper/00
3662314270,1sleep20-21swapper/22
3647432271,3sleep23648314-21grep2
3646865270,1sleep10-21swapper/11
3641014271,2sleep03641059-21http0
3631153271,2sleep13631196-21kthreadcore1
3630087270,2sleep20-21swapper/22
3629383270,3sleep03629437-21ntpq0
3624777270,1sleep10-21swapper/11
3613969270,1sleep10-21swapper/11
3613684270,4sleep00-21swapper/00
3688474261,2sleep20-21swapper/22
3679258260,3sleep20-21swapper/22
3668289261,2sleep20-21swapper/22
3666842260,2sleep20-21swapper/22
3652200260,1sleep00-21swapper/00
3634520260,2sleep00-21swapper/00
3608467260,2sleep10-21swapper/11
3711231250,3sleep00-21swapper/00
3661568250,2sleep13661661-21ld1
3630101250,3sleep10-21swapper/11
3598302240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional