You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 05:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Fri Dec 12, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
37459969911694,1157cyclictest40054872sleep33
37459969911512,1146cyclictest40707782sleep33
3745996992118,1cyclictest0-21swapper/33
3745996992118,1cyclictest0-21swapper/33
3745996992017,1cyclictest0-21swapper/33
3745996991916,1cyclictest0-21swapper/33
374599699189,5cyclictest4054095-21turbostat3
3745996991815,1cyclictest0-21swapper/33
3745996991714,1cyclictest0-21swapper/33
374599699171,10cyclictest37987852sleep33
40124882160,4sleep04012496-21ssh0
3745996991613,1cyclictest0-21swapper/33
3745996991513,1cyclictest0-21swapper/33
3745996991513,1cyclictest0-21swapper/33
3745996991513,0cyclictest0-21swapper/33
3745996991513,0cyclictest0-21swapper/33
3745996991512,1cyclictest0-21swapper/33
3745996991512,1cyclictest0-21swapper/33
3745996991512,1cyclictest0-21swapper/33
3745996991512,1cyclictest0-21swapper/33
374599699151,11cyclictest4111454-21taskset3
40467522145,3sleep14047598-21irqrtprio1
38969442140,4sleep1874094-21kworker/1:1+events1
38178182141,3sleep03817851-21apt-get0
374599699145,6cyclictest40941382sleep33
374599699141,9cyclictest41357822sleep33
374599699141,9cyclictest38808012sleep33
3745996991412,1cyclictest0-21swapper/33
3745996991412,1cyclictest0-21swapper/33
3745996991412,1cyclictest0-21swapper/33
3745996991412,1cyclictest0-21swapper/33
3745996991412,1cyclictest0-21swapper/33
3745996991412,0cyclictest0-21swapper/33
3745996991412,0cyclictest0-21swapper/33
3745996991411,1cyclictest0-21swapper/33
3745996991411,1cyclictest0-21swapper/33
3745996991411,1cyclictest0-21swapper/33
3745996991411,1cyclictest0-21swapper/33
3745996991411,1cyclictest0-21swapper/33
3745996991411,1cyclictest0-21swapper/33
374599699141,10cyclictest8846-21taskset3
374599699141,10cyclictest4133948-21taskset3
374599699141,10cyclictest3997403-21chrt3
374599699141,10cyclictest3956422-21taskset3
374599699141,10cyclictest3932542-21taskset3
374599699141,10cyclictest3785740-21turbostat3
374599699141,10cyclictest25851-21taskset3
3745996991410,1cyclictest0-21swapper/33
374599699140,11cyclictest4181672-21chrt3
190898140,3rtkit-daemon1928-21sendmail-mta0
190898140,10rtkit-daemon3747482-21irqrtprio1
40444402130,1sleep23940362-21kworker/2:0+mm_percpu_wq2
374599699134,7cyclictest3861506-21taskset3
374599699131,9cyclictest4165889-21taskset3
374599699131,9cyclictest4013949-21taskset3
374599699131,9cyclictest3930318-21taskset3
374599699131,9cyclictest3907962-21taskset3
374599699131,9cyclictest3873939-21taskset3
374599699131,9cyclictest3810684-21taskset3
374599699131,8cyclictest38431952sleep33
3745996991312,0cyclictest0-21swapper/33
3745996991312,0cyclictest0-21swapper/33
3745996991312,0cyclictest0-21swapper/33
3745996991311,1cyclictest0-21swapper/33
374599699131,10cyclictest3971113-21taskset3
3745996991310,1cyclictest0-21swapper/33
374599699130,11cyclictest3973163-21chrt3
228392131,10sleep022993-21grep0
39714582125,1sleep0171rcu_preempt0
38822952120,2sleep13884257-21grep1
374599699127,3cyclictest38622172sleep33
374599699124,6cyclictest40627092sleep33
374599699121,9cyclictest4037341-21chrt3
374599699121,9cyclictest3855299-21taskset3
374599699120,9cyclictest4192933-21taskset3
374599699120,9cyclictest4147228-21taskset3
374599699120,10cyclictest3823876-21taskset3
190898120,7rtkit-daemon3880768-21sed1
40521422110,8sleep04052150-21ssh0
38871432111,8sleep23887296-21/usr/sbin/munin2
38179232110,4sleep23817819-21/usr/sbin/munin2
37733712111,6sleep13773404-21apt-get1
190898110,3rtkit-daemon667-21snmpd2
190898110,2rtkit-daemon3830686-21apt-get1
38431642100,1sleep23843194-21awk2
255002102,4sleep025516-21apt-get0
190898100,6rtkit-daemon4003838-21ssh0
190898100,6rtkit-daemon3867004-21memory1
190898100,6rtkit-daemon3767320-21/usr/sbin/munin1
190898100,5rtkit-daemon4117807-21ssh0
190898100,5rtkit-daemon4085431-21ssh0
190898100,5rtkit-daemon4062100-21ssh0
190898100,5rtkit-daemon4043458-21ntp_states0
190898100,4rtkit-daemon4127525-21cat0
190898100,4rtkit-daemon4127525-21cat0
190898100,3rtkit-daemon81364-21packagekitd1
8122291,4sleep08130-21ssh0
4192344291,5sleep04192423-21ntp_states0
4181368291,5sleep24181671-21sed2
4176830291,5sleep24178939-21kthreadcore2
4152387291,5sleep04152954-21ssh0
4142754291,6sleep04142762-21ssh0
4072297291,2sleep00-21swapper/00
4070522291,5sleep1299-21systemd-journal1
3932624291,5sleep13932657-21apt-get1
38872291,4sleep138922-21ntp_states1
19089890,6rtkit-daemon473-21gmain1
19089890,5rtkit-daemon4092726-21users0
19089890,5rtkit-daemon3994687-21ntpq0
19089890,5rtkit-daemon3744999-21ntp_states1
19089890,5rtkit-daemon1928-21sendmail-mta0
19089890,4rtkit-daemon667-21snmpd0
19089890,4rtkit-daemon3893145-21cron1
19089890,4rtkit-daemon16026-21ssh0
19089890,3rtkit-daemon3946670-21ssh0
19089890,3rtkit-daemon3752363-21munin-node0
19089890,3rtkit-daemon34-21ksoftirqd/11
4160499280,6sleep04161443-21cut0
4138557280,6sleep14140648-21cut1
4135140281,4sleep04135148-21ssh0
4110388281,4sleep14110396-21ssh1
4075772280,5sleep24075933-21/usr/sbin/munin2
4005230281,4sleep14005253-21munin-run1
3949188280,2sleep1321rcuc/11
3948393280,6sleep23948399-21ssh2
3939128280,6sleep23939136-21ssh2
3932834281,4sleep03933024-21hddtemp_smartct0
3899806280,5sleep23899970-21diskstats2
3894924281,4sleep03896943-21cut0
3873399281,4sleep03873455-21ntp_states0
3850878284,2sleep10-21swapper/11
3848265281,4sleep03848324-21ntp_states0
3786079280,5sleep23786193-21/usr/sbin/munin2
3780133281,4sleep03781126-21irqstats0
3773407281,4sleep23773553-21df2
3752201282,4sleep0439-21gdbus0
3741318281,4sleep30-21swapper/33
3739863281,2sleep20-21swapper/22
19089880,5rtkit-daemon674-21lldpd1
19089880,5rtkit-daemon667-21snmpd0
19089880,5rtkit-daemon1928-21sendmail-mta1
19089880,4rtkit-daemon81364-21packagekitd2
19089880,4rtkit-daemon674-21lldpd1
19089880,4rtkit-daemon671-21ntpd0
19089880,4rtkit-daemon667-21snmpd0
19089880,4rtkit-daemon438-21wpa_supplicant2
19089880,4rtkit-daemon438-21wpa_supplicant1
19089880,4rtkit-daemon407-21rpcbind2
19089880,4rtkit-daemon3988956-21ssh0
19089880,4rtkit-daemon3926819-21grep0
19089880,4rtkit-daemon3752363-21munin-node2
19089880,4rtkit-daemon3752363-21munin-node2
19089880,4rtkit-daemon3752363-21munin-node0
19089880,4rtkit-daemon31970-21ssh1
19089880,3rtkit-daemon3754732-21diskstats1
19089880,1rtkit-daemon0-21swapper/11
4175652270,4sleep14176829-21grep1
4174357271,3sleep24174412-40updatedb.mlocat2
4168645270,4sleep14169233-21ps1
4166749270,4sleep20-21swapper/22
4135773270,4sleep24135780-21sh2
4108299271,4sleep24108382-21grep2
4106137270,5sleep04108115-21ssh0
4101525270,5sleep04101532-21sh0
4093343270,4sleep24093347-21ssh2
4071024270,4sleep14071134-21perl1
4044611270,1sleep10-21swapper/11
4037645270,4sleep14038033-21cat1
4035720270,1sleep20-21swapper/22
4028490270,1sleep00-21swapper/00
4007122270,4sleep14009026-21tr1
4004892271,1sleep20-21swapper/22
3930775270,5sleep13930782-21sh1
3849441271,3sleep03849453-21apt-get0
3831635270,4sleep23832625-21cat2
3785994270,3sleep03786027-21apt-get0
25127270,1sleep10-21swapper/11
19089870,4rtkit-daemon667-21snmpd1
19089870,4rtkit-daemon3752363-21munin-node1
19089870,3rtkit-daemon667-21snmpd1
19089870,3rtkit-daemon667-21snmpd1
19089870,3rtkit-daemon421-21avahi-daemon2
19089870,3rtkit-daemon3752363-21munin-node1
19089870,1rtkit-daemon0-21swapper/11
16061270,1sleep20-21swapper/22
4193472260,1sleep10-21swapper/11
4161444261,2sleep10-21swapper/11
4159009260,1sleep10-21swapper/11
4153455261,2sleep20-21swapper/22
4119991260,3sleep14120269-21sed1
4119991260,3sleep14120269-21sed1
4118505260,1sleep10-21swapper/11
4101850260,1sleep10-21swapper/11
4087025261,1sleep10-21swapper/11
4079122260,4sleep24079153-21sort2
4068737260,1sleep00-21swapper/00
4062276260,3sleep14062277-21sh1
4061283260,1sleep20-21swapper/22
4029283260,1sleep20-21swapper/22
4020465260,1sleep10-21swapper/11
4005835260,1sleep20-21swapper/22
3992510260,3sleep13993921-21kthreadcore1
3988057260,1sleep10-21swapper/11
3954908260,1sleep20-21swapper/22
3922554260,1sleep00-21swapper/00
3893407261,3sleep20-21swapper/22
3862418260,3sleep03862571-21sed0
3817296260,3sleep03817451-21apt-config0
3805264261,2sleep00-21swapper/00
3767286260,4sleep03767450-21expr0
3759770261,2sleep20-21swapper/22
3755008260,4sleep03755995-21irqstats0
25680260,4sleep225848-21gltestperf2
14543260,4sleep114580-21proc_pri1
1076261,2sleep20-21swapper/22
4186173251,2sleep10-21swapper/11
4150196250,1sleep20-21swapper/22
4135114250,3sleep10-21swapper/11
4126151250,3sleep24126159-21ssh2
4126151250,3sleep24126159-21ssh2
4118999250,2sleep24119007-21ssh2
4100919250,2sleep24100927-21ssh2
4052910250,3sleep24052918-21ssh2
4027434250,2sleep14027575-21ssh1
4021094250,3sleep24021100-21ssh2
3989373250,2sleep20-21swapper/22
3973268250,2sleep03973307-21apt-get0
3963913250,3sleep20-21swapper/22
3948034250,2sleep13948042-21ssh1
3929704251,2sleep20-21swapper/22
3922588251,2sleep13922596-21ssh1
3914579250,2sleep00-21swapper/00
3899755250,2sleep00-21swapper/00
3887106250,2sleep00-21swapper/00
3886692250,1sleep00-21swapper/00
3877276251,2sleep00-21swapper/00
3874550250,2sleep20-21swapper/22
3873539250,3sleep20-21swapper/22
3863476251,2sleep20-21swapper/22
3861674250,1sleep20-21swapper/22
3836349250,1sleep00-21swapper/00
3824085250,1sleep00-21swapper/00
3817117250,3sleep20-21swapper/22
3804727250,1sleep20-21swapper/22
3804703250,1sleep00-21swapper/00
3785542250,1sleep20-21swapper/22
3767103250,2sleep20-21swapper/22
3762277251,2sleep20-21swapper/22
23961250,1sleep20-21swapper/22
19089850,1rtkit-daemon0-21swapper/11
7309240,3sleep10-21swapper/11
4193960240,2sleep20-21swapper/22
4143855240,3sleep10-21swapper/11
4085471240,2sleep10-21swapper/11
3974278240,2sleep13975235-21kthreadcore1
3965254240,2sleep13745990-21cyclictest1
3959450240,2sleep10-21swapper/11
3855437240,2sleep20-21swapper/22
3842823240,2sleep20-21swapper/22
3842572240,3sleep00-21swapper/00
3830109240,3sleep20-21swapper/22
3806125240,2sleep23806528-21kthreadcore2
3797941240,3sleep00-21swapper/00
3779226240,3sleep00-21swapper/00
3760808240,3sleep00-21swapper/00
3747587240,2sleep20-21swapper/22
34103240,2sleep00-21swapper/00
4127645230,1sleep20-21swapper/22
3880798230,1sleep23745990-21cyclictest2
3858181230,1sleep00-21swapper/00
3792266230,1sleep20-21swapper/22
3740050230,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional