You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 14:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot8s.osadl.org (updated Wed Jan 07, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35564099912340,1231cyclictest35713452sleep33
35564099911100,1105cyclictest3744888-21sleep3
3556409992491,245cyclictest3880922-21turbostat3
3556409992390,236cyclictest3635502-21turbostat3
38353142270,1sleep00-21swapper/00
3556409991916,1cyclictest0-21swapper/33
3556409991815,1cyclictest0-21swapper/33
3556409991815,1cyclictest0-21swapper/33
3556409991815,1cyclictest0-21swapper/33
3556409991714,1cyclictest0-21swapper/33
3556409991714,1cyclictest0-21swapper/33
36614292161,3sleep23661593-21latency_hist2
3556409991613,1cyclictest0-21swapper/33
355640999161,11cyclictest3802679-21turbostat3
37199272151,11sleep23720916-21irqstats2
355640999155,7cyclictest35848052sleep33
3556409991513,1cyclictest0-21swapper/33
3556409991513,0cyclictest0-21swapper/33
3556409991512,1cyclictest0-21swapper/33
3556409991512,1cyclictest0-21swapper/33
355640999151,11cyclictest3777011-21taskset3
355640999145,7cyclictest3687174-21turbostat3
355640999145,7cyclictest3667866-21turbostat3
355640999141,9cyclictest39585732sleep33
3556409991413,0cyclictest0-21swapper/33
3556409991412,1cyclictest0-21swapper/33
3556409991412,1cyclictest0-21swapper/33
3556409991412,1cyclictest0-21swapper/33
3556409991412,1cyclictest0-21swapper/33
3556409991411,1cyclictest0-21swapper/33
3556409991411,1cyclictest0-21swapper/33
355640999141,10cyclictest3984024-21turbostat3
355640999141,10cyclictest3921687-21taskset3
355640999141,10cyclictest3900494-21taskset3
355640999141,10cyclictest3830172-21taskset3
355640999141,10cyclictest3757933-21taskset3
355640999141,10cyclictest3686969-21chrt3
355640999141,10cyclictest3623415-21taskset3
355640999137,3cyclictest3777583-21taskset3
355640999131,9cyclictest3970847-21taskset3
355640999131,9cyclictest3887581-21chrt3
355640999131,9cyclictest3815431-21chrt3
355640999131,9cyclictest3661100-21taskset3
355640999131,9cyclictest3576867-21taskset3
355640999131,8cyclictest38940212sleep33
3556409991312,1cyclictest0-21swapper/33
3556409991312,0cyclictest0-21swapper/33
3556409991312,0cyclictest0-21swapper/33
3556409991312,0cyclictest0-21swapper/33
3556409991312,0cyclictest0-21swapper/33
3556409991312,0cyclictest0-21swapper/33
3556409991312,0cyclictest0-21swapper/33
3556409991311,1cyclictest0-21swapper/33
3556409991311,1cyclictest0-21swapper/33
355640999131,10cyclictest3861372-21chrt3
3556409991310,1cyclictest0-21swapper/33
3556409991310,1cyclictest0-21swapper/33
355640999130,10cyclictest3783632-21taskset3
355640999130,10cyclictest3732276-21taskset3
355640999130,10cyclictest3720917-21chrt3
355640999130,10cyclictest3718857-21taskset3
301798130,8rtkit-daemon3892862-21awk1
355640999129,1cyclictest0-21swapper/33
355640999121,9cyclictest3795946-21taskset3
355640999121,8cyclictest3850018-21taskset3
355640999121,8cyclictest3675008-21taskset3
355640999120,9cyclictest3629314-21taskset3
355640999120,9cyclictest3578018-21taskset3
355640999120,10cyclictest3706066-21taskset3
301798120,7rtkit-daemon3673570-21python32
39777472110,2sleep10-21swapper/11
39327742110,3sleep23932820-21cut2
37772382111,2sleep00-21swapper/00
355640999111,8cyclictest3867558-21taskset3
35561212110,3sleep30-21swapper/33
301798110,7rtkit-daemon3900237-21systemd-run1
301798110,7rtkit-daemon3582831-21grep2
301798110,4rtkit-daemon636-21snmpd1
301798110,4rtkit-daemon492-21gmain1
38090972101,7sleep23809153-21apt-config2
37772732101,5sleep13777428-21diskstats1
36037132101,5sleep13603746-21apt-get1
35859032101,6sleep13587892-21grep1
301798100,7rtkit-daemon3562922-21munin-node1
301798100,5rtkit-daemon3571302-21taskset2
301798100,4rtkit-daemon492-21gmain1
301798100,4rtkit-daemon3562922-21munin-node2
301798100,4rtkit-daemon3200908-21packagekitd1
301798100,3rtkit-daemon3562922-21munin-node2
301798100,3rtkit-daemon3562922-21munin-node2
301798100,3rtkit-daemon3205-21sendmail-mta1
3970247290,6sleep13970318-21ntp_states1
3937736291,5sleep13937816-21grep1
3811838291,6sleep00-21swapper/00
3790061291,5sleep03790092-21/usr/sbin/munin0
3648907290,5sleep03649050-21df0
30179890,6rtkit-daemon636-21snmpd1
30179890,5rtkit-daemon317-21systemd-udevd2
30179890,5rtkit-daemon317-21systemd-udevd2
30179890,4rtkit-daemon3824536-21tr1
30179890,4rtkit-daemon3705954-21/usr/sbin/munin2
30179890,1rtkit-daemon0-21swapper/22
30179890,1rtkit-daemon0-21swapper/22
3948352280,2sleep20-21swapper/22
3945720280,4sleep03945753-21apt-get0
3932594281,3sleep03932627-21apt-get0
3919897281,4sleep03920096-21hddtemp_smartct0
3913028280,4sleep13913072-21munin-run1
3848600281,4sleep23848633-21apt-get2
3810021281,4sleep23810670-21sed2
3764128281,4sleep03764336-21latency_hist0
3737524281,4sleep03737601-21ntp_states0
3733745280,6sleep13735173-21grep1
3694019281,4sleep03694219-21hddtemp_smartct0
3677401281,5sleep13679553-21grep1
3636133281,5sleep10-21swapper/11
3610150281,4sleep03610182-21apt-get0
3571342283,3sleep13562754-21cron1
30179880,5rtkit-daemon492-21gmain1
30179880,5rtkit-daemon317-21systemd-udevd1
30179880,5rtkit-daemon317-21systemd-udevd1
30179880,4rtkit-daemon667-21lldpd2
30179880,4rtkit-daemon667-21lldpd2
30179880,4rtkit-daemon667-21lldpd1
30179880,4rtkit-daemon636-21snmpd2
30179880,4rtkit-daemon636-21snmpd1
30179880,4rtkit-daemon636-21snmpd1
30179880,4rtkit-daemon492-21gmain1
30179880,4rtkit-daemon492-21gmain1
30179880,4rtkit-daemon492-21gmain1
30179880,4rtkit-daemon448-21wpa_supplicant2
30179880,4rtkit-daemon430-21avahi-daemon1
30179880,4rtkit-daemon3842296-21grep1
30179880,4rtkit-daemon3562922-21munin-node2
30179880,4rtkit-daemon3562922-21munin-node1
30179880,4rtkit-daemon3562922-21munin-node1
30179880,4rtkit-daemon3205-21sendmail-mta1
30179880,1rtkit-daemon0-21swapper/22
30179880,1rtkit-daemon0-21swapper/22
30179880,1rtkit-daemon0-21swapper/11
30179880,1rtkit-daemon0-21swapper/11
3940149270,4sleep23941345-21cut2
3919443274,1sleep00-21swapper/00
3894058270,4sleep03894207-21df_inode0
3867183270,4sleep23867427-21users2
3847530271,3sleep03847655-21python30
3784904270,4sleep23786042-21grep2
3770392271,4sleep23770393-21sshd2
3745119270,1sleep20-21swapper/22
3732032270,5sleep13732161-21latency_hist1
3714017270,4sleep03715146-21grep0
3706630271,3sleep03706662-21apt-get0
3644645270,5sleep23646757-21cut2
3617884270,4sleep03619053-21kthreadcore0
3596318271,3sleep13596438-21timerandwakeup1
3584604270,4sleep23584804-21hddtemp_smartct2
3573567270,4sleep03575621-21kthreadcore0
3556257270,4sleep03556377-21calmdown-rtkit0
30179870,4rtkit-daemon492-21gmain1
30179870,4rtkit-daemon3562922-21munin-node2
30179870,4rtkit-daemon3562922-21munin-node1
30179870,3rtkit-daemon638-21ntpd2
30179870,3rtkit-daemon638-21ntpd1
30179870,3rtkit-daemon638-21ntpd1
30179870,3rtkit-daemon636-21snmpd1
30179870,3rtkit-daemon3562922-21munin-node2
30179870,3rtkit-daemon3562922-21munin-node2
30179870,3rtkit-daemon3205-21sendmail-mta1
30179870,3rtkit-daemon3200908-21packagekitd2
30179870,3rtkit-daemon3200908-21packagekitd2
30179870,1rtkit-daemon3016-21rtkit-daemon2
3977564261,2sleep00-21swapper/00
3977492261,3sleep23977493-21sshd2
3964413260,1sleep00-21swapper/00
3926995260,3sleep03927876-21cut0
3910807261,3sleep03911996-21/usr/sbin/munin0
3900458261,2sleep20-21swapper/22
3888242260,4sleep03889194-21kthreadcore0
3868523260,1sleep20-21swapper/22
3860589260,4sleep23860665-21awk2
3835548260,4sleep03835704-21diskstats0
3828856261,2sleep20-21swapper/22
3822420261,2sleep20-21swapper/22
3791773260,4sleep23793799-21kthreadcore2
3769511260,3sleep03769654-21ntpq0
3741463260,3sleep13743609-21grep1
3738743260,3sleep03738892-21df_inode0
3728233260,3sleep03730320-21kthreadcore0
3694220260,3sleep13694544-21cut1
3666197261,3sleep13666868-21missed_timers1
3661876260,3sleep03661918-21fschecks_count0
3655309261,2sleep13655331-21apt-get1
3642610260,3sleep03643485-21irqrtprio0
3624395260,3sleep03626214-21cut0
3597481260,3sleep03597587-21grep0
3585118260,4sleep03585902-21kthreadcore0
3580703260,4sleep13582862-21cut1
3579474260,4sleep03580699-21kthreadcore0
3567721260,4sleep03568323-21kthreadcore0
30179860,3rtkit-daemon638-21ntpd2
3978219250,2sleep00-21swapper/00
3970512251,2sleep00-21swapper/00
3957982250,1sleep00-21swapper/00
3945081250,1sleep00-21swapper/00
3924972251,2sleep20-21swapper/22
3918625250,3sleep23918751-21/usr/sbin/munin2
3903298251,2sleep03905440-21kthreadcore0
3882203251,2sleep20-21swapper/22
3843061251,2sleep23843893-21kthreadcore2
3835510251,2sleep20-21swapper/22
3821298251,2sleep20-21swapper/22
3804287251,2sleep00-21swapper/00
3801916251,2sleep20-21swapper/22
3789766250,1sleep00-21swapper/00
3777234250,1sleep20-21swapper/22
3770997250,2sleep20-21swapper/22
3763820250,1sleep20-21swapper/22
3757494250,1sleep20-21swapper/22
3751720250,3sleep00-21swapper/00
3724851250,2sleep00-21swapper/00
3706371250,2sleep01-21systemd0
3704096250,3sleep10-21swapper/11
3693529250,1sleep00-21swapper/00
3686834250,1sleep10-21swapper/11
3675995251,2sleep00-21swapper/00
3668502250,2sleep00-21swapper/00
3651210250,3sleep13652028-21kthreadcore1
3643488251,2sleep10-21swapper/11
3641683250,3sleep00-21swapper/00
3631883251,2sleep10-21swapper/11
3630755250,2sleep03631879-21kthreadcore0
3628960250,1sleep10-21swapper/11
3592920251,2sleep00-21swapper/00
3552798250,2sleep10-21swapper/11
3966441240,2sleep20-21swapper/22
3964427240,3sleep20-21swapper/22
3954595241,1sleep20-21swapper/22
3907876240,2sleep20-21swapper/22
3894323240,2sleep20-21swapper/22
3893718240,3sleep20-21swapper/22
3887168240,3sleep00-21swapper/00
3880824240,3sleep20-21swapper/22
3864478240,2sleep00-21swapper/00
3861151240,3sleep00-21swapper/00
3824214240,2sleep00-21swapper/00
3797476240,2sleep03798655-21kthreadcore0
3747504240,2sleep00-21swapper/00
3719765240,2sleep10-21swapper/11
3719134240,2sleep10-21swapper/11
3708086241,1sleep10-21swapper/11
3687422240,1sleep10-21swapper/11
3683850240,2sleep03685990-21kthreadcore0
3669014240,2sleep13669919-21kthreadcore1
3622481240,1sleep10-21swapper/11
3611606240,2sleep10-21swapper/11
3609736241,1sleep00-21swapper/00
3603360240,3sleep10-21swapper/11
3562405240,3sleep00-21swapper/00
3558021240,2sleep10-21swapper/11
3977890230,1sleep20-21swapper/22
3932253230,1sleep20-21swapper/22
3874958230,1sleep00-21swapper/00
3870976230,1sleep00-21swapper/00
3851156230,1sleep00-21swapper/00
3816311230,1sleep00-21swapper/00
3770834230,1sleep00-21swapper/00
3655297230,1sleep00-21swapper/00
3571831230,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional