You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 03:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  Congatec
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Fri Jul 26, 2024 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
349056799756749,5cyclictest3684930-21kworker/1:2+events1
349057599753748,4cyclictest3621643-21kworker/3:0+events3
349057599753748,4cyclictest3504690-21kworker/3:1+events3
349056599753746,6cyclictest3640418-21turbostat0
349057599752748,3cyclictest3762795-21kworker/3:2+events3
349057599752748,3cyclictest3621643-21kworker/3:0+events3
349057599751747,3cyclictest3621643-21kworker/3:0+events3
349057599750742,3cyclictest3504690-21kworker/3:1+events3
349057599750742,3cyclictest3504690-21kworker/3:1+events3
349057599749745,3cyclictest3504690-21kworker/3:1+events3
349057599748744,3cyclictest3762795-21kworker/3:2+events3
349057599748743,4cyclictest3621643-21kworker/3:0+events3
349057599748740,4cyclictest3762795-21kworker/3:2+events3
349057599747739,3cyclictest3621643-21kworker/3:0+events3
349057099747739,3cyclictest1381504-21kworker/2:2+events2
349057599746742,3cyclictest3762795-21kworker/3:2+events3
349057599745741,3cyclictest3504690-21kworker/3:1+events3
349057599744740,3cyclictest3504690-21kworker/3:1+events3
349057599744738,5cyclictest3762795-21kworker/3:2+events3
349057599743739,3cyclictest3621643-21kworker/3:0+events3
349056799743736,5cyclictest316369-21kworker/1:0+events1
349057599742738,3cyclictest3700228-21kworker/3:2+events3
349057599742738,3cyclictest3700228-21kworker/3:2+events3
349057599742738,3cyclictest3621643-21kworker/3:0+events3
349057599742738,3cyclictest3504690-21kworker/3:1+events3
349057599742737,4cyclictest3621643-21kworker/3:0+events3
349057599742734,5cyclictest3621643-21kworker/3:0+events3
349057599741737,3cyclictest3762795-21kworker/3:2+events3
349057599741737,3cyclictest3762795-21kworker/3:2+events3
349057599741737,3cyclictest3621643-21kworker/3:0+events3
349057599741737,3cyclictest3504690-21kworker/3:1+events3
349057599741736,4cyclictest3762795-21kworker/3:2+events3
349057099741737,3cyclictest3566430-21kworker/2:0+events2
349057599740736,3cyclictest3762795-21kworker/3:2+events3
349057599740732,3cyclictest3504690-21kworker/3:1+events3
349057099740735,4cyclictest1381504-21kworker/2:2+events2
349057599739735,3cyclictest3762795-21kworker/3:2+events3
349057599739735,3cyclictest3762795-21kworker/3:2+events3
349057599739735,3cyclictest357009-21kworker/3:0+events3
349057599739734,4cyclictest357009-21kworker/3:0+events3
349057599738734,3cyclictest3762795-21kworker/3:2+events3
349057599738734,3cyclictest3504690-21kworker/3:1+events3
349057599738733,4cyclictest3621643-21kworker/3:0+events3
349057599738733,3cyclictest3762795-21kworker/3:2+events3
349057599737733,3cyclictest3621643-21kworker/3:0+events3
349057599737733,3cyclictest357009-21kworker/3:0+events3
349057099737733,3cyclictest1381504-21kworker/2:2+events2
349057099736732,3cyclictest3545540-21kworker/2:3+events2
349057599735731,3cyclictest3762795-21kworker/3:2+events3
349057599735731,3cyclictest3762795-21kworker/3:2+events3
349057599735731,3cyclictest3504690-21kworker/3:1+events3
349057099735731,3cyclictest3566430-21kworker/2:0+events2
349057599734730,3cyclictest3762795-21kworker/3:2+events3
349057599734730,3cyclictest3504690-21kworker/3:1+events3
349057599734728,3cyclictest3504690-21kworker/3:1+events3
349057099734730,3cyclictest3726706-21kworker/2:1+events2
349056799734729,4cyclictest316369-21kworker/1:0+events1
349057599733729,3cyclictest3621643-21kworker/3:0+events3
349057599731727,3cyclictest3504690-21kworker/3:1+events3
349056599731724,6cyclictest3647796-21kworker/0:1+events0
349056799726723,2cyclictest316369-21kworker/1:0+events1
349056799725721,3cyclictest3684930-21kworker/1:2+events1
349056799725721,3cyclictest3684930-21kworker/1:2+events1
349056599722717,4cyclictest3647796-21kworker/0:1+events0
349056799720716,3cyclictest3684930-21kworker/1:2+events1
349057599718713,4cyclictest3572897-21turbostat3
349056799718713,4cyclictest3684930-21kworker/1:2+events1
349056799718713,4cyclictest3684930-21kworker/1:2+events1
349056799717714,2cyclictest3816743-21turbostat1
349056599716711,4cyclictest3824410-21turbostat0
349056599714711,2cyclictest3830688-21kworker/0:0+events0
349057099709704,4cyclictest3542128-21turbostat2
349056599707703,3cyclictest3566545-21turbostat0
349056799701698,2cyclictest3684930-21kworker/1:2+events1
349056599693690,2cyclictest3396314-21kworker/0:2+events0
3490565996630,660cyclictest3771155-21runrttasks0
349057599662656,5cyclictest3937416-21turbostat3
349056799649645,3cyclictest3870554-21turbostat1
349057599636633,2cyclictest3678734-21turbostat3
349057099627623,3cyclictest3918965-21turbostat2
349057599622619,2cyclictest3832033-21turbostat3
349057599620617,2cyclictest3906681-21turbostat3
349056799612609,2cyclictest3655788-21turbostat1
3490570992724,2cyclictest0-21swapper/22
3490570992419,3cyclictest3893491-21sh2
3490567992421,2cyclictest0-21swapper/11
3490570992219,2cyclictest0-21swapper/22
3490565992219,2cyclictest3801495-21cut0
3490570992117,2cyclictest0-21swapper/22
3490570992116,4cyclictest3855228-21cron2
3490565992118,2cyclictest3804824-21kthreadcore0
3490570992017,2cyclictest3628133-21idleruntime-cro2
3490570992017,2cyclictest0-21swapper/22
3490575991916,2cyclictest3664792-21irqrtprio3
3490570991914,3cyclictest3496640-21turbostat.cron2
3490567991916,2cyclictest0-21swapper/11
3490565991916,2cyclictest3770586-21systemd-run0
3490565991916,2cyclictest3496642-21latency_hist0
349056599190,18cyclictest211rcuc/00
3490570991815,2cyclictest3616447-21irqcore2
3490570991815,2cyclictest3615717-21munin-plugin-st2
3490570991814,3cyclictest3686904-21grep2
3490567991815,2cyclictest3835382-21kthreadcore1
3490567991815,2cyclictest3530375-21irqcore1
3490567991815,2cyclictest3530375-21irqcore1
349056799181,16cyclictest3610196-21gltestperf1
3490570991710,5cyclictest0-21swapper/22
3490567991714,2cyclictest0-21swapper/11
3490567991714,1cyclictest3925652-21fschecks_time1
3490567991713,3cyclictest3799210-21ntp_kernel_pll_1
3490565991714,2cyclictest3621933-21latency_hist0
3490565991713,3cyclictest3853440-21unixbench_multi0
3490575991613,2cyclictest3832038-21sh3
3490575991613,2cyclictest0-21swapper/33
3490570991614,1cyclictest0-21swapper/22
3490570991613,2cyclictest3663905-21cpuspeed_turbos2
3490570991613,2cyclictest0-21swapper/22
3490570991612,3cyclictest3825030-21gltestperf2
3490567991613,2cyclictest491-21dbus-daemon1
3490567991613,2cyclictest3699957-21unixbench_singl1
3490567991613,2cyclictest3699957-21unixbench_singl1
3490567991612,3cyclictest3949241-21unixbench_singl1
3490567991612,2cyclictest3523184-21apt-key1
3490565991612,2cyclictest3693446-21kworker/u8:1-xprtiod0
3490565991611,3cyclictest3709395-21cron0
3490575991510,3cyclictest3937008-21unixbench_singl3
3490570991513,1cyclictest0-21swapper/22
3490570991512,2cyclictest0-21swapper/22
3490570991512,2cyclictest0-21swapper/22
3490570991512,2cyclictest0-21swapper/22
3490570991510,3cyclictest3913370-21grep2
3490570991510,3cyclictest0-21swapper/22
3490567991512,2cyclictest3726064-21irqrtprio1
3490567991512,2cyclictest3686788-21cpuspeed_turbos1
3490567991512,2cyclictest3554289-21sendmail1
349056599159,4cyclictest365-21systemd-journal0
349056599158,6cyclictest3740422-21cpuspeed_turbos0
3490575991412,1cyclictest0-21swapper/33
3490575991412,1cyclictest0-21swapper/33
3490575991411,2cyclictest3656416-21gltestperf3
3490575991411,2cyclictest3648492-21cpuspeed_turbos3
3490575991411,2cyclictest0-21swapper/33
349057099149,3cyclictest0-21swapper/22
349057099149,3cyclictest0-21swapper/22
3490570991412,1cyclictest500-21systemd-logind2
3490570991411,2cyclictest3912347-21unixbench_multi2
3490570991411,2cyclictest3743243-21kthreadcore2
3490570991410,3cyclictest3585493-21cpuspeed_turbos2
3490570991410,3cyclictest1-21systemd2
349056799149,4cyclictest0-21swapper/11
349056799148,4cyclictest365-21systemd-journal1
3490567991411,2cyclictest3931603-21cpuspeed_turbos1
3490567991411,2cyclictest3640408-21diskmemload1
3490567991411,2cyclictest3491197-21irqcore1
3490567991411,2cyclictest0-21swapper/11
3490567991410,3cyclictest3943537-21cron1
3490567991410,3cyclictest3809558-21cpuspeed_turbos1
3490567991410,3cyclictest3617463-21kthreadcore1
3490567991410,2cyclictest0-21swapper/11
349056599148,4cyclictest491-21dbus-daemon0
3490565991412,1cyclictest3684679-21kworker/0:2+kacpid0
3490565991411,2cyclictest490-21avahi-daemon0
3490565991411,2cyclictest3672969-21kthreadcore0
3490565991411,2cyclictest3522638-21grep0
3490565991411,2cyclictest3510447-21unixbench_singl0
3490565991411,2cyclictest0-21swapper/00
3490565991411,2cyclictest0-21swapper/00
3490565991411,2cyclictest0-21swapper/00
3490565991410,2cyclictest3523924-21gltestperf0
349057599139,3cyclictest491ktimers/33
3490575991310,2cyclictest3555045-21irqcore3
349057099139,2cyclictest3579428-21cpuspeed_turbos2
3490570991311,1cyclictest0-21swapper/22
3490570991310,2cyclictest3794646-21irqcore2
3490570991310,2cyclictest3531399-21tr2
3490570991310,2cyclictest3531399-21tr2
3490570991310,2cyclictest3522617-21unixbench_multi2
3490570991310,2cyclictest0-21swapper/22
349057099130,4cyclictest724-21snmpd2
349057099130,4cyclictest724-21snmpd2
349056799139,3cyclictest3863705-21irqcore1
349056799139,3cyclictest3560040-21unixbench_singl1
349056799139,3cyclictest3510400-21unixbench_multi1
3490567991311,1cyclictest3529613-21cron1
3490567991311,1cyclictest0-21swapper/11
3490567991310,2cyclictest3541708-21unixbench_singl1
3490567991310,2cyclictest0-21swapper/11
3490567991310,2cyclictest0-21swapper/11
349056799130,1cyclictest0-21swapper/11
349056799130,12cyclictest0-21swapper/11
349056599139,3cyclictest3647796-21kworker/0:1+kacpi_notify0
349056599138,4cyclictest3822167-21ntpq0
349056599138,4cyclictest3783886-21ntpq0
349056599135,2cyclictest191rcu_preempt0
3490565991312,1cyclictest3396314-21kworker/0:2+kacpid0
3490565991311,1cyclictest3830688-21kworker/0:0+kacpid0
3490565991311,1cyclictest3830688-21kworker/0:0+kacpid0
3490565991311,1cyclictest3396314-21kworker/0:2+kacpid0
3490565991311,1cyclictest3396314-21kworker/0:2+kacpid0
3490565991311,1cyclictest3396314-21kworker/0:2+kacpid0
3490565991310,2cyclictest3830688-21kworker/0:0+kacpid0
3490565991310,2cyclictest3830688-21kworker/0:0+kacpid0
3490565991310,2cyclictest3717454-21cpuspeed_turbos0
3490565991310,2cyclictest3687036-21gltestperf0
3490565991310,2cyclictest3663845-21cpuspeed_turbos0
3490565991310,2cyclictest3530023-21cpuspeed_turbos0
3490565991310,2cyclictest3530023-21cpuspeed_turbos0
349056599130,12cyclictest62350irq/127-eno1:rx-00
38939802120,2sleep33894139-21sh3
38939802120,2sleep33894139-21sh3
349057599129,2cyclictest3930288-21needreboot3
349057599120,4cyclictest0-21swapper/33
349057099129,2cyclictest0-21swapper/22
349057099129,2cyclictest0-21swapper/22
349057099127,4cyclictest729-21lldpd2
349057099127,4cyclictest3855573-21awk2
349057099127,3cyclictest0-21swapper/22
349057099126,4cyclictest3874444-21tr2
349057099122,2cyclictest174098rtkit-daemon2
349057099121,3cyclictest1739-21rtkit-daemon2
349057099120,3cyclictest0-21swapper/22
349056799129,2cyclictest3645984-21python31
349056799129,2cyclictest3542470-21cpuspeed_turbos1
349056799129,2cyclictest0-21swapper/11
349056799129,2cyclictest0-21swapper/11
349056799128,2cyclictest0-21swapper/11
3490567991210,1cyclictest500-21systemd-logind1
3490567991210,1cyclictest0-21swapper/11
349056799120,1cyclictest3806917-21ssh1
349056599129,2cyclictest3840590-21gltestperf0
349056599129,2cyclictest3580097-21irqcore0
349056599129,2cyclictest3396314-21kworker/0:2+kacpid0
349056599129,2cyclictest0-21swapper/00
349056599128,3cyclictest3901103-21gltestperf0
349056599128,3cyclictest365-21systemd-journal0
349056599128,1cyclictest0-21swapper/00
349056599124,7cyclictest3622519-21uniq0
3490565991211,1cyclictest3830688-21kworker/0:0+kacpid0
3490565991211,1cyclictest3830688-21kworker/0:0+kacpid0
3490565991211,1cyclictest3830688-21kworker/0:0+kacpid0
3490565991211,1cyclictest3396314-21kworker/0:2+kacpid0
3490565991211,1cyclictest3396314-21kworker/0:2+kacpid0
3490565991210,1cyclictest3396314-21kworker/0:2+kacpid0
3490565991210,1cyclictest3396314-21kworker/0:2+kacpid0
349057599110,1cyclictest0-21swapper/33
349057099118,2cyclictest0-21swapper/22
349057099118,2cyclictest0-21swapper/22
349057099118,2cyclictest0-21swapper/22
349057099118,2cyclictest0-21swapper/22
349057099116,4cyclictest3499620-21sed2
349057099114,6cyclictest3603847-21cut2
3490570991110,1cyclictest0-21swapper/22
349057099110,2cyclictest3883012-21grep2
349057099110,1cyclictest0-21swapper/22
349057099110,10cyclictest0-21swapper/22
349056799118,2cyclictest3918009-21needreboot1
349056799118,2cyclictest0-21swapper/11
349056799116,4cyclictest513-21gdbus1
349056799113,1cyclictest174098rtkit-daemon1
349056799110,1cyclictest0-21swapper/11
349056799110,1cyclictest0-21swapper/11
349056799110,1cyclictest0-21swapper/11
349056799110,11cyclictest0-21swapper/11
349056799110,11cyclictest0-21swapper/11
349056799110,10cyclictest0-21swapper/11
349056599118,2cyclictest3858178-21kthreadcore0
349056599118,2cyclictest0-21swapper/00
349056599118,2cyclictest0-21swapper/00
349056599116,4cyclictest3749349-21sed0
349056599111,3cyclictest3716077-21ssh0
349056599110,4cyclictest3870546-21latency_hist0
34902302117,2sleep20-21swapper/22
349057099108,1cyclictest0-21swapper/22
349057099107,2cyclictest3779050-21gltestperf2
349057099107,2cyclictest3505093-21cpuspeed_turbos2
349056799106,3cyclictest6950irq/9-acpi1
34905659990,8cyclictest3908423-21kthreadcore0
3490279295,2sleep30-21swapper/33
3490375285,2sleep10-21swapper/11
3490155285,2sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional