You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 19:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Sat Dec 06, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4481489912930,1288cyclictest5580462sleep33
4481489911801,1176cyclictest926563-21turbostat3
4481489911770,1173cyclictest7235572sleep33
4481489911710,1166cyclictest488068-21sleep3
82488222220,1sleep10-21swapper/11
73166421860,1sleep1731663-21ssh1
190898270,5rtkit-daemon763994-21ssh0
8831212210,8sleep2431ktimers/22
4908352201,8sleep1492953-21cut1
448148992017,1cyclictest0-21swapper/33
44814899191,14cyclictest902332-21taskset3
44814899188,6cyclictest780796-21turbostat3
190898180,6rtkit-daemon821344-21ssh1
44814899171,12cyclictest878810-21taskset3
7784772161,5sleep0778720-21/usr/sbin/munin0
44814899166,8cyclictest583220-21turbostat3
44814899162,10cyclictest756278-21turbostat3
44814899162,10cyclictest756278-21turbostat3
44814899161,11cyclictest891615-21taskset3
44814899161,11cyclictest863159-21taskset3
44814899155,7cyclictest828419-21taskset3
44814899155,7cyclictest7308912sleep33
44814899151,9cyclictest9350292sleep33
448148991513,0cyclictest0-21swapper/33
448148991513,0cyclictest0-21swapper/33
448148991513,0cyclictest0-21swapper/33
448148991513,0cyclictest0-21swapper/33
448148991512,1cyclictest0-21swapper/33
448148991512,1cyclictest0-21swapper/33
448148991512,1cyclictest0-21swapper/33
448148991512,1cyclictest0-21swapper/33
448148991512,1cyclictest0-21swapper/33
448148991512,1cyclictest0-21swapper/33
44814899151,10cyclictest902817-21taskset3
44814899150,11cyclictest6349922sleep33
44814899145,6cyclictest8302972sleep33
44814899145,6cyclictest7461242sleep33
448148991412,1cyclictest0-21swapper/33
448148991412,1cyclictest0-21swapper/33
448148991412,1cyclictest0-21swapper/33
448148991412,0cyclictest0-21swapper/33
448148991412,0cyclictest0-21swapper/33
448148991411,1cyclictest0-21swapper/33
448148991411,1cyclictest0-21swapper/33
448148991411,1cyclictest0-21swapper/33
44814899141,10cyclictest876053-21taskset3
44814899141,10cyclictest819886-21taskset3
44814899141,10cyclictest812413-21taskset3
44814899141,10cyclictest771420-21chrt3
44814899141,10cyclictest738501-21taskset3
44814899141,10cyclictest550390-21taskset3
44814899141,10cyclictest520449-21taskset3
44814899141,10cyclictest506494-21chrt3
44814899141,10cyclictest468966-21taskset3
44814899140,11cyclictest934600-21taskset3
44814899134,7cyclictest601986-21taskset3
44814899133,8cyclictest683087-21taskset3
44814899131,9cyclictest610648-21taskset3
44814899131,9cyclictest499755-21taskset3
448148991312,0cyclictest0-21swapper/33
448148991312,0cyclictest0-21swapper/33
448148991311,1cyclictest0-21swapper/33
44814899131,10cyclictest715194-21taskset3
44814899131,10cyclictest576572-21taskset3
448148991310,1cyclictest0-21swapper/33
448148991310,1cyclictest0-21swapper/33
448148991310,1cyclictest0-21swapper/33
448148991310,1cyclictest0-21swapper/33
448148991310,1cyclictest0-21swapper/33
44814899130,10cyclictest789849-21taskset3
44814899130,10cyclictest666068-21taskset3
44814899130,10cyclictest448313-21taskset3
44814899120,10cyclictest762614-21taskset3
44814899120,10cyclictest469260-21taskset3
4480182121,6sleep1448038-21/usr/sbin/munin1
190898120,8rtkit-daemon705715-21ssh0
190898120,8rtkit-daemon666084-21ssh0
190898120,4rtkit-daemon81364-21packagekitd0
9420692110,8sleep0942077-21ssh0
7067662111,2sleep20-21swapper/22
6348932112,5sleep1634934-21apt-get1
4420342111,6sleep30-21swapper/33
190898110,6rtkit-daemon673923-21ssh0
190898110,6rtkit-daemon515155-21irqstats0
190898110,5rtkit-daemon1928-21sendmail-mta1
9027842102,4sleep2902808-21apt-get2
8055752101,5sleep1805612-21apt-get1
7962892103,4sleep1796297-21sh1
7719742100,7sleep0771982-21ssh0
7413572101,6sleep20-21swapper/22
7235832101,5sleep2723602-21idleruntime-cro2
6195392101,7sleep2620379-21ssh2
5950012100,1sleep20-21swapper/22
5822892101,5sleep0582360-21ntp_states0
190898100,5rtkit-daemon891612-21ntp_states1
190898100,5rtkit-daemon596278-21apt-get0
190898100,4rtkit-daemon844146-21ssh1
190898100,3rtkit-daemon454515-21munin-node0
738234290,1sleep00-21swapper/00
698572290,6sleep1698580-21ssh1
664642291,5sleep1664768-21wc1
659203291,4sleep2659238-21apt-get2
650748290,6sleep2650775-21munin-run2
545162291,5sleep2545318-21diskstats2
521441290,7sleep0523257-21cut0
469761290,7sleep2469274-21/usr/sbin/munin2
19089890,5rtkit-daemon724099-21kworker/u16:4+nfsiod2
19089890,5rtkit-daemon620103-21irqrtprio0
19089890,5rtkit-daemon602299-21diskmemload2
19089890,5rtkit-daemon602299-21diskmemload2
19089890,5rtkit-daemon460324-21kthreadcore0
19089890,5rtkit-daemon438-21wpa_supplicant0
19089890,5rtkit-daemon436-21systemd-logind0
19089890,5rtkit-daemon1928-21sendmail-mta0
19089890,5rtkit-daemon1928-21sendmail-mta0
19089890,4rtkit-daemon832894-21cut1
19089890,4rtkit-daemon787019-21ssh0
19089890,4rtkit-daemon707918-21df_inode0
19089890,4rtkit-daemon681870-21ssh0
19089890,4rtkit-daemon535734-21cut0
19089890,4rtkit-daemon442220-21df_inode0
19089890,3rtkit-daemon602299-21diskmemload0
19089890,3rtkit-daemon544179-21python30
19089890,2rtkit-daemon358110-21kworker/0:0+kacpid0
941181280,4sleep1941189-21ssh1
925667280,5sleep2925674-21sh2
924750280,2sleep0910132-21kworker/0:0+kacpid0
908071280,2sleep0908189-21smartctl0
851019281,5sleep1851139-21ssh1
842691280,5sleep2842984-21grep2
781132281,3sleep2781166-21apt-get2
779285280,1sleep20-21swapper/22
770261280,6sleep1770348-21mailstats1
738518280,1sleep10-21swapper/11
729409281,4sleep0729465-21ntp_states0
699606281,3sleep1699643-21apt-get1
689402280,1sleep10-21swapper/11
649445280,5sleep1649453-21ssh1
625345280,6sleep1625351-21ssh1
601283281,5sleep2601411-21ntpq2
513738281,4sleep2513894-21diskstats2
513319281,4sleep1513180-21apt-get1
513162281,4sleep0513252-21munin-run0
458211281,4sleep1460032-21tr1
19089880,7rtkit-daemon1907-21rtkit-daemon1
19089880,5rtkit-daemon893885-21ssh2
19089880,5rtkit-daemon1928-21sendmail-mta0
19089880,4rtkit-daemon674-21lldpd0
19089880,4rtkit-daemon667-21snmpd0
19089880,4rtkit-daemon642256-21ssh0
19089880,4rtkit-daemon633011-21ssh0
19089880,4rtkit-daemon570939-21apt-get0
19089880,4rtkit-daemon550766-21sed0
19089880,4rtkit-daemon473-21gmain1
19089880,4rtkit-daemon454515-21munin-node0
19089880,4rtkit-daemon1223-21cron0
19089880,3rtkit-daemon930865-21kthreadcore0
19089880,1rtkit-daemon1907-21rtkit-daemon0
19089880,1rtkit-daemon0-21swapper/00
19089880,1rtkit-daemon0-21swapper/00
19089880,1rtkit-daemon0-21swapper/00
19089880,1rtkit-daemon0-21swapper/00
19089880,1rtkit-daemon0-21swapper/00
926902270,3sleep2926936-21apt-get2
911794271,4sleep1912805-21tr1
910437271,3sleep1910508-21munin-run1
893201270,1sleep00-21swapper/00
872831270,5sleep0874886-21tr0
835208271,3sleep2835405-21cat2
813687270,4sleep0813723-21awk0
793365271,4sleep20-21swapper/22
757221271,3sleep20-21swapper/22
748870271,3sleep1748988-21ps1
748870271,3sleep1748988-21ps1
732564271,3sleep2732779-21ssh2
673245273,2sleep1539221-21kworker/u16:2+rpciod1
643211270,4sleep0643414-21hddtemp_smartct0
640145270,4sleep2640226-21ntp_states2
626760270,5sleep1626768-21ssh1
617386271,4sleep2617394-21ssh2
601594270,4sleep1601734-21/usr/sbin/munin1
564606270,4sleep1564639-21apt-get1
538826271,3sleep1538859-21apt-get1
507359270,5sleep1507559-21hddtemp_smartct1
501265270,4sleep2501684-21cut2
481872271,4sleep1667-21snmpd1
468989270,1sleep10-21swapper/11
19089870,4rtkit-daemon667-21snmpd0
19089870,4rtkit-daemon1928-21sendmail-mta1
19089870,3rtkit-daemon876914-21ssh1
19089870,3rtkit-daemon671-21ntpd0
19089870,3rtkit-daemon671-21ntpd0
19089870,3rtkit-daemon671-21ntpd0
19089870,3rtkit-daemon667-21snmpd0
19089870,3rtkit-daemon667-21snmpd0
19089870,3rtkit-daemon584949-21kthreadcore0
19089870,3rtkit-daemon468125-21ntp_kernel_err0
917849260,1sleep20-21swapper/22
900310260,1sleep10-21swapper/11
878373260,4sleep0878529-21ssh0
876623260,1sleep20-21swapper/22
862571260,1sleep20-21swapper/22
861499260,1sleep00-21swapper/00
860366260,1sleep20-21swapper/22
853132260,1sleep00-21swapper/00
835552260,4sleep0829819-21/usr/sbin/munin0
827819260,3sleep2827827-21ssh2
823336260,4sleep0824880-21grep0
815243260,3sleep2817242-21grep2
803737260,1sleep20-21swapper/22
755178260,1sleep00-21swapper/00
755178260,1sleep00-21swapper/00
746166260,1sleep10-21swapper/11
682452260,1sleep20-21swapper/22
673192260,3sleep2673200-21ssh2
657946260,1sleep20-21swapper/22
653451260,4sleep10-21swapper/11
617103260,4sleep1617111-21ssh1
602606260,1sleep20-21swapper/22
589179260,1sleep10-21swapper/11
538369260,1sleep10-21swapper/11
525684260,1sleep20-21swapper/22
499684261,3sleep2499753-21ntpq2
19089860,3rtkit-daemon671-21ntpd0
934329250,3sleep10-21swapper/11
894422251,2sleep20-21swapper/22
779718250,1sleep10-21swapper/11
763757250,3sleep1602299-21diskmemload1
717338251,2sleep10-21swapper/11
714867250,3sleep20-21swapper/22
709202250,2sleep1710394-21cut1
697791251,2sleep20-21swapper/22
683403250,3sleep20-21swapper/22
626864250,3sleep20-21swapper/22
589452251,2sleep20-21swapper/22
578644250,2sleep10-21swapper/11
576586250,1sleep20-21swapper/22
564602250,1sleep20-21swapper/22
564055250,1sleep10-21swapper/11
558306250,2sleep20-21swapper/22
552836250,3sleep1553720-21cat1
551968250,2sleep20-21swapper/22
538862250,3sleep2538827-21/usr/sbin/munin2
525875250,1sleep10-21swapper/11
506834250,1sleep10-21swapper/11
475102250,1sleep10-21swapper/11
468738250,1sleep20-21swapper/22
454115250,1sleep10-21swapper/11
449779251,1sleep20-21swapper/22
924633240,2sleep10-21swapper/11
851922240,2sleep2851930-21ssh2
805555240,2sleep20-21swapper/22
802515240,2sleep1802667-21strings1
772159240,2sleep2772167-21ssh2
730760240,2sleep2730768-21ssh2
677357240,2sleep1679374-21cut1
602631240,2sleep10-21swapper/11
591235240,2sleep10-21swapper/11
575027240,2sleep1575910-21missed_timers1
526229240,1sleep20-21swapper/22
507560240,2sleep20-21swapper/22
494331240,3sleep20-21swapper/22
481889240,1sleep20-21swapper/22
481528240,3sleep20-21swapper/22
462632240,1sleep20-21swapper/22
577379230,1sleep20-21swapper/22
551017230,1sleep10-21swapper/11
532831230,1sleep20-21swapper/22
526575230,1sleep10-21swapper/11
494866230,1sleep10-21swapper/11
475755230,1sleep10-21swapper/11
442340230,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional