You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 02:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot8s.osadl.org (updated Sun Dec 07, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
36786959912280,1224cyclictest3848639-21turbostat3
36786959911220,1118cyclictest40427822sleep33
36823082430,1sleep00-21swapper/00
3678695992118,1cyclictest0-21swapper/33
190898210,7rtkit-daemon3730452-21ntp_states2
3678695991815,1cyclictest0-21swapper/33
3678695991814,1cyclictest0-21swapper/33
3678695991714,1cyclictest0-21swapper/33
3678695991714,1cyclictest0-21swapper/33
3678695991714,1cyclictest0-21swapper/33
367869599169,4cyclictest4042545-21sleep3
367869599161,7cyclictest0-21swapper/33
3678695991613,1cyclictest0-21swapper/33
367869599161,12cyclictest4066692-21turbostat3
367869599161,12cyclictest3826492-21taskset3
367869599161,11cyclictest3684916-21turbostat3
3678695991610,3cyclictest3897044-21turbostat3
367869599159,3cyclictest3872818-21sleep3
367869599159,3cyclictest3725050-21sleep3
367869599159,2cyclictest531rcuc/33
367869599157,5cyclictest4112947-21chrt3
367869599156,6cyclictest41461382sleep33
367869599156,6cyclictest4123369-21sleep3
367869599156,6cyclictest39173532sleep33
3678695991513,1cyclictest0-21swapper/33
3678695991512,1cyclictest0-21swapper/33
3678695991512,1cyclictest0-21swapper/33
3678695991512,1cyclictest0-21swapper/33
3678695991512,1cyclictest0-21swapper/33
36876772140,2sleep20-21swapper/22
367869599145,6cyclictest40974522sleep33
367869599145,6cyclictest40105332sleep33
367869599145,6cyclictest40009082sleep33
367869599144,7cyclictest3714412-21taskset3
367869599142,9cyclictest4131763-21taskset3
367869599141,9cyclictest37822492sleep33
3678695991413,0cyclictest0-21swapper/33
3678695991413,0cyclictest0-21swapper/33
3678695991412,1cyclictest0-21swapper/33
3678695991412,1cyclictest0-21swapper/33
3678695991412,1cyclictest0-21swapper/33
3678695991411,1cyclictest0-21swapper/33
3678695991411,1cyclictest0-21swapper/33
3678695991411,1cyclictest0-21swapper/33
3678695991411,1cyclictest0-21swapper/33
3678695991411,1cyclictest0-21swapper/33
367869599141,10cyclictest4154429-21taskset3
367869599141,10cyclictest4007963-21taskset3
367869599141,10cyclictest3887315-21taskset3
367869599141,10cyclictest3732537-21taskset3
3678695991410,1cyclictest0-21swapper/33
367869599140,11cyclictest3947453-21taskset3
367869599139,2cyclictest0-21swapper/33
367869599138,3cyclictest3986827-21chrt3
367869599135,5cyclictest3954206-21taskset3
367869599133,7cyclictest3905413-21taskset3
367869599131,9cyclictest4032768-21taskset3
367869599131,9cyclictest3807428-21taskset3
367869599131,9cyclictest3706335-21taskset3
3678695991313,0cyclictest0-21swapper/33
367869599131,10cyclictest4089309-21chrt3
367869599131,10cyclictest3936866-21taskset3
367869599131,10cyclictest3750640-21chrt3
3678695991310,1cyclictest0-21swapper/33
3678695991310,1cyclictest0-21swapper/33
367869599130,10cyclictest4067835-21taskset3
367869599130,10cyclictest3856960-21chrt3
37885972121,4sleep13788749-21df_inode1
367869599129,1cyclictest0-21swapper/33
367869599129,1cyclictest0-21swapper/33
3678695991210,1cyclictest0-21swapper/33
190898120,8rtkit-daemon4138108-21ssh2
41659922111,7sleep14167992-21grep1
41555642111,8sleep10-21swapper/11
39622222111,6sleep13962255-21apt-get1
38712142110,1sleep13871222-21ssh1
190898110,7rtkit-daemon1223-21cron0
190898110,6rtkit-daemon3978774-21sed1
190898110,5rtkit-daemon4121382-21ssh0
190898110,5rtkit-daemon4023974-21ntp_states0
190898110,4rtkit-daemon4001377-21ssh2
190898110,4rtkit-daemon3985946-21ssh2
190898110,4rtkit-daemon3887236-21ssh0
190898110,3rtkit-daemon473-21gmain2
190898110,1rtkit-daemon0-21swapper/22
41540632104,4sleep20-21swapper/22
41317712102,4sleep04131808-21apt-get0
40750542102,4sleep14075089-21apt-get1
40585722101,7sleep10-21swapper/11
40170012100,1sleep00-21swapper/00
39144732103,4sleep13915369-21kthreadcore1
38630772100,1sleep10-21swapper/11
38202492101,4sleep03820251-21apt-get0
190898100,9rtkit-daemon1907-21rtkit-daemon2
190898100,6rtkit-daemon4026295-21ssh2
190898100,6rtkit-daemon3895428-21ssh0
190898100,6rtkit-daemon3693922-21hddtemp_smartct2
190898100,5rtkit-daemon4113625-21ssh0
190898100,5rtkit-daemon4053916-21kthreadcore2
190898100,4rtkit-daemon3846845-21ssh2
4146744290,1sleep10-21swapper/11
4121591291,6sleep14121599-21ssh1
4097392291,1sleep00-21swapper/00
4082582290,1sleep20-21swapper/22
3967552290,6sleep03967668-21/usr/sbin/munin0
3873131291,5sleep10-21swapper/11
3873131291,5sleep10-21swapper/11
3794621290,6sleep23794786-21latency_hist2
3794394290,1sleep00-21swapper/00
3770467290,7sleep23771330-21grep2
3751105290,6sleep03752022-21sed0
3744390291,4sleep13744423-21apt-get1
3700098291,4sleep03700253-21diskstats0
36786959997,1cyclictest0-21swapper/33
19089890,6rtkit-daemon473-21gmain1
19089890,5rtkit-daemon473-21gmain2
19089890,5rtkit-daemon438-21wpa_supplicant1
19089890,5rtkit-daemon438-21wpa_supplicant0
19089890,5rtkit-daemon3993665-21ssh2
19089890,5rtkit-daemon3744223-21latency_hist2
19089890,5rtkit-daemon3675023-21grep2
19089890,4rtkit-daemon3678690-21cyclictest2
19089890,4rtkit-daemon299-21systemd-journal1
19089890,3rtkit-daemon4089642-21ssh0
19089890,3rtkit-daemon3976989-21ssh1
19089890,3rtkit-daemon3960091-21ssh2
19089890,1rtkit-daemon0-21swapper/00
4139876281,4sleep04139983-21df_inode0
4114061280,3sleep20-21swapper/22
4066185281,4sleep14066192-21sh1
4003048281,4sleep04004045-21irqstats0
4002605281,4sleep14002760-21ssh1
3993609280,4sleep03993613-21ssh0
3970391281,4sleep03970549-21df_inode0
3948654280,5sleep03950741-21grep0
3918639280,6sleep00-21swapper/00
3905129281,4sleep13905175-21unin-run1
3886716280,5sleep13886987-21grep1
3847146280,3sleep00-21swapper/00
3832559281,4sleep13832607-21/usr/sbin/munin1
3807431281,3sleep13807464-21apt-get1
3807172281,4sleep03807204-21idleruntime-cro0
3800003281,4sleep03800062-21ntp_states0
3769444281,4sleep23769505-21systemd-run2
3757147281,4sleep03757180-21apt-get0
3718292280,3sleep00-21swapper/00
3717729281,4sleep23717788-21ntp_states2
3712591280,6sleep13712624-21apt-get1
3674350280,5sleep03676384-21grep0
19089880,4rtkit-daemon81364-21packagekitd1
19089880,4rtkit-daemon667-21snmpd1
19089880,4rtkit-daemon667-21snmpd0
19089880,4rtkit-daemon667-21snmpd0
19089880,4rtkit-daemon667-21snmpd0
19089880,4rtkit-daemon667-21snmpd0
19089880,4rtkit-daemon438-21wpa_supplicant1
19089880,4rtkit-daemon438-21wpa_supplicant1
19089880,4rtkit-daemon421-21avahi-daemon1
19089880,4rtkit-daemon4075258-21df_inode0
19089880,4rtkit-daemon3838686-21ssh1
19089880,4rtkit-daemon3685048-21munin-node2
19089880,4rtkit-daemon3685048-21munin-node1
19089880,4rtkit-daemon299-21systemd-journal1
19089880,4rtkit-daemon0-21swapper/22
19089880,3rtkit-daemon671-21ntpd2
19089880,1rtkit-daemon0-21swapper/22
19089880,1rtkit-daemon0-21swapper/22
19089880,1rtkit-daemon0-21swapper/22
19089880,1rtkit-daemon0-21swapper/22
19089880,1rtkit-daemon0-21swapper/11
19089880,1rtkit-daemon0-21swapper/11
19089880,1rtkit-daemon0-21swapper/11
19089880,1rtkit-daemon0-21swapper/00
19089880,1rtkit-daemon0-21swapper/00
4163688271,3sleep04163733-21munin-run0
4163405270,2sleep10-21swapper/11
4099415271,3sleep24099454-21apt-get2
4097871271,4sleep24097879-21ssh2
4083101271,3sleep14083133-21apt-get1
4072372271,3sleep14072480-21ssh1
4002544271,3sleep24002552-21ssh2
3996577271,4sleep13998580-21cut1
3995548273,2sleep03996576-21grep0
3976775270,4sleep23976783-21ssh2
3960240270,4sleep13960247-21sh1
3937449274,1sleep20-21swapper/22
3936824271,3sleep23936832-21ssh2
3909816270,4sleep13910555-21ls1
3891333271,3sleep23893317-21kthreadcore2
3888276270,4sleep23888284-21ssh2
3862218270,4sleep03862282-21ntp_states0
3847116271,3sleep13847124-21ssh1
3840573270,6sleep00-21swapper/00
3832277270,1sleep00-21swapper/00
3775979271,3sleep03776012-21apt-get0
3775688270,1sleep00-21swapper/00
3759356271,4sleep23761438-21tr2
3733604270,4sleep03735670-21tr0
3725314271,4sleep03725469-21diskstats0
3679245270,4sleep13679375-21sed1
19089870,4rtkit-daemon473-21gmain2
19089870,4rtkit-daemon473-21gmain1
19089870,4rtkit-daemon3685048-21munin-node2
19089870,4rtkit-daemon1928-21sendmail-mta2
19089870,3rtkit-daemon674-21lldpd0
19089870,3rtkit-daemon671-21ntpd2
19089870,3rtkit-daemon671-21ntpd1
19089870,3rtkit-daemon667-21snmpd1
19089870,3rtkit-daemon4016024-21ssh1
19089870,3rtkit-daemon3685048-21munin-node2
19089870,3rtkit-daemon3685048-21munin-node1
19089870,3rtkit-daemon0-21swapper/22
19089870,1rtkit-daemon0-21swapper/22
19089870,1rtkit-daemon0-21swapper/22
4170316261,3sleep04170324-21ssh0
4109000261,2sleep14110142-21kthreadcore1
4105618260,1sleep10-21swapper/11
4066966261,2sleep20-21swapper/22
4048252261,2sleep14048362-21sed1
4036670260,3sleep14038660-21ssh1
4025485260,1sleep10-21swapper/11
4017373260,1sleep20-21swapper/22
3994038260,1sleep10-21swapper/11
3960772260,5sleep00-21swapper/00
3946103260,2sleep23946139-21apt-get2
3827010261,3sleep23827997-21irqstats2
3819457260,2sleep20-21swapper/22
3812578261,3sleep20-21swapper/22
3781231260,4sleep20-21swapper/22
3769414260,1sleep00-21swapper/00
3753210260,4sleep23755317-21kthreadcore2
3724805260,3sleep13724806-21sshd1
3711650260,4sleep13711865-21sed1
3693246261,3sleep03693378-21cat0
3676385260,3sleep13677508-21memory1
19089860,2rtkit-daemon0-21swapper/22
4150976251,2sleep00-21swapper/00
4133261251,2sleep10-21swapper/11
4122693250,2sleep24122701-21ssh2
4097244250,3sleep14097252-21ssh1
4089137250,3sleep24089147-21ssh2
4060462250,3sleep24062175-21cut2
4026753250,2sleep00-21swapper/00
3978792250,3sleep03979360-21irqcore0
3935051250,2sleep00-21swapper/00
3929056251,2sleep20-21swapper/22
3911895250,3sleep00-21swapper/00
3903559250,1sleep00-21swapper/00
3874650250,3sleep23876494-21cut2
3874650250,3sleep23876494-21cut2
3856482250,4sleep00-21swapper/00
3825254250,2sleep20-21swapper/22
3811088250,3sleep03812441-21memory0
3802608250,2sleep20-21swapper/22
3795098250,3sleep23795221-21gltestperf2
3705843250,1sleep10-21swapper/11
3693956250,2sleep10-21swapper/11
3693755250,2sleep00-21swapper/00
3691608250,2sleep13692259-21sed1
3943121240,2sleep03943274-21/usr/sbin/munin0
3818830240,2sleep00-21swapper/00
3788185240,3sleep00-21swapper/00
3782236240,3sleep20-21swapper/22
3738016240,2sleep00-21swapper/00
3737220240,3sleep10-21swapper/11
4027268230,1sleep10-21swapper/11
3921553230,1sleep00-21swapper/00
3744698230,1sleep00-21swapper/00
3738036230,1sleep10-21swapper/11
3728616230,1sleep10-21swapper/11
3719005230,1sleep00-21swapper/00
3709134230,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional