You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 05:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Thu Dec 11, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
488874994030,400cyclictest974174-21turbostat3
9800542830,3sleep1980058-21sendmail_mailqu1
190898210,7rtkit-daemon473-21gmain0
48887499187,8cyclictest917522-21turbostat3
48887499187,8cyclictest917522-21turbostat3
48887499181,13cyclictest617596-21taskset3
48887499178,7cyclictest650369-21turbostat3
48887499178,6cyclictest535378-21turbostat3
48887499175,9cyclictest706978-21turbostat3
48887499175,8cyclictest494703-21taskset3
488874991714,1cyclictest0-21swapper/33
7229422160,5sleep1722949-21sh1
488874991613,1cyclictest0-21swapper/33
488874991613,1cyclictest0-21swapper/33
48887499161,11cyclictest503420-21turbostat3
190898160,4rtkit-daemon846152-21ps1
48887499151,6cyclictest0-21swapper/33
488874991513,1cyclictest0-21swapper/33
488874991512,1cyclictest0-21swapper/33
488874991512,1cyclictest0-21swapper/33
488874991512,1cyclictest0-21swapper/33
48887499151,11cyclictest852483-21taskset3
48887499151,11cyclictest787922-21taskset3
48887499151,10cyclictest939298-21taskset3
48887499151,10cyclictest820183-21turbostat3
190898150,11rtkit-daemon747737-21diskstats0
9343952141,4sleep1934553-21sed1
48887499145,6cyclictest8590402sleep33
48887499143,8cyclictest788143-21taskset3
48887499143,8cyclictest723347-21taskset3
488874991413,0cyclictest0-21swapper/33
488874991412,1cyclictest0-21swapper/33
488874991412,1cyclictest0-21swapper/33
488874991412,0cyclictest0-21swapper/33
48887499141,10cyclictest901636-21taskset3
48887499141,10cyclictest860976-21taskset3
48887499141,10cyclictest822541-21taskset3
48887499141,10cyclictest810670-21taskset3
48887499141,10cyclictest763938-21taskset3
48887499141,10cyclictest753498-21taskset3
48887499141,10cyclictest715069-21turbostat3
48887499141,10cyclictest691373-21taskset3
48887499141,10cyclictest657461-21taskset3
48887499141,10cyclictest638180-21taskset3
48887499141,10cyclictest604747-21turbostat3
48887499141,10cyclictest585115-21chrt3
48887499141,10cyclictest522524-21chrt3
48887499140,11cyclictest672453-21taskset3
48887499140,11cyclictest510499-21taskset3
48887499140,11cyclictest510499-21taskset3
190898140,2rtkit-daemon0-21swapper/22
48887499131,9cyclictest972191-21taskset3
48887499131,9cyclictest731410-21taskset3
48887499131,9cyclictest635787-21taskset3
48887499131,9cyclictest592603-21taskset3
488874991312,0cyclictest0-21swapper/33
488874991312,0cyclictest0-21swapper/33
488874991311,1cyclictest0-21swapper/33
488874991311,1cyclictest0-21swapper/33
48887499131,10cyclictest874928-21taskset3
48887499131,10cyclictest802619-21taskset3
48887499131,10cyclictest761094-21chrt3
48887499131,10cyclictest586117-21taskset3
488874991311,0cyclictest0-21swapper/33
488874991310,1cyclictest0-21swapper/33
48887499130,10cyclictest923655-21taskset3
48887499130,10cyclictest715374-21taskset3
48887499130,10cyclictest665071-21taskset3
48887499130,10cyclictest623871-21chrt3
48887499130,10cyclictest610987-21taskset3
48887499130,10cyclictest572967-21chrt3
48887499130,10cyclictest509624-21taskset3
8246352121,4sleep0825582-21memory0
48887499121,8cyclictest836530-21taskset3
48887499121,8cyclictest560277-21taskset3
48887499120,9cyclictest579262-21taskset3
48887499120,9cyclictest560991-21chrt3
48887499120,9cyclictest542347-21taskset3
190898120,4rtkit-daemon495196-21munin-node0
190898120,4rtkit-daemon495196-21munin-node0
190898120,2rtkit-daemon0-21swapper/00
9417032111,5sleep2941709-21ssh2
4878232111,5sleep2487881-21ntp_states2
190898110,7rtkit-daemon745863-21ssh0
190898110,6rtkit-daemon559914-21ntp_states2
190898110,4rtkit-daemon981290-21ssh0
190898110,4rtkit-daemon899974-21ssh0
190898110,4rtkit-daemon770810-21ssh1
7062792100,1sleep20-21swapper/22
6908022101,6sleep0690863-21sendmail-msp0
4892242100,7sleep0489424-21hddtemp_smartct0
190898100,6rtkit-daemon787580-21ssh0
190898100,6rtkit-daemon697220-21ssh2
190898100,6rtkit-daemon667-21snmpd2
190898100,6rtkit-daemon667-21snmpd2
190898100,6rtkit-daemon619890-21tr2
190898100,5rtkit-daemon958514-21df0
190898100,5rtkit-daemon890516-21ntp_states0
190898100,5rtkit-daemon630329-21/usr/sbin/munin0
190898100,3rtkit-daemon495196-21munin-node2
966368291,4sleep2966405-21apt-get2
891692290,6sleep1891698-21ssh1
884494290,6sleep0884502-21ssh0
869083291,4sleep0869118-21apt-get0
825741291,2sleep20-21swapper/22
787803290,6sleep2787921-21wc2
681653291,5sleep0681661-21ssh0
529345291,4sleep2529378-21apt-get2
19089890,5rtkit-daemon891841-21kworker/u16:1+rpciod1
19089890,5rtkit-daemon535377-21apt-get2
19089890,4rtkit-daemon864137-21tr0
19089890,4rtkit-daemon737274-21ssh0
19089890,4rtkit-daemon726966-21kthreadcore0
19089890,4rtkit-daemon707331-21apt-get0
19089890,3rtkit-daemon667-21snmpd2
19089890,3rtkit-daemon473-21gmain2
19089890,3rtkit-daemon473-21gmain1
19089890,3rtkit-daemon473-21gmain1
960506280,6sleep1962589-21tr1
958542281,3sleep2958748-21smartctl2
951864281,5sleep2953832-21kthreadcore2
948107281,4sleep0948115-21ssh0
948107281,4sleep0948115-21ssh0
906941281,5sleep0906999-21/usr/sbin/munin0
895089280,5sleep2895127-21kthreadcore2
851344280,2sleep2851352-21ssh2
804341280,2sleep10-21swapper/11
756288280,1sleep1757214-21kthreadcore1
738755280,2sleep1738763-21ssh1
715334281,3sleep2715369-21apt-get2
697060280,1sleep00-21swapper/00
669032280,5sleep1671071-21grep1
648963280,2sleep1648969-21ssh1
647954281,4sleep2648004-21grep2
616379281,4sleep2616456-21ntp_states2
592804281,5sleep0593043-21irqcore0
579854281,3sleep1579887-21apt-get1
19089880,5rtkit-daemon1928-21sendmail-mta2
19089880,5rtkit-daemon0-21swapper/22
19089880,4rtkit-daemon81364-21packagekitd0
19089880,4rtkit-daemon721807-21ssh0
19089880,4rtkit-daemon667-21snmpd2
19089880,4rtkit-daemon667-21snmpd1
19089880,4rtkit-daemon495196-21munin-node2
19089880,4rtkit-daemon495196-21munin-node2
19089880,4rtkit-daemon495196-21munin-node1
19089880,4rtkit-daemon495196-21munin-node0
19089880,4rtkit-daemon495196-21munin-node0
19089880,4rtkit-daemon438-21wpa_supplicant2
19089880,4rtkit-daemon407-21rpcbind2
19089880,1rtkit-daemon0-21swapper/00
909069270,1sleep10-21swapper/11
893013271,3sleep2893274-21store2
883665270,5sleep1883673-21ssh1
859159271,1sleep2171rcu_preempt2
836642270,4sleep1836764-21grep1
828982270,5sleep2829572-21irqrtprio2
818972270,1sleep10-21swapper/11
804385271,3sleep2804544-21sh2
765258270,4sleep2767194-21kthreadcore2
756102270,4sleep0756287-21sed0
745708270,1sleep10-21swapper/11
704712271,2sleep00-21swapper/00
691197271,3sleep10-21swapper/11
674446270,4sleep2674454-21ssh2
623578271,3sleep1623580-21cron1
587058270,5sleep0587625-21kthreadcore0
566411270,4sleep0566655-21users0
555875271,3sleep0557115-21kthreadcore0
510412270,4sleep2510498-21fschecks_time2
510412270,4sleep2510498-21fschecks_time2
487994270,3sleep00-21swapper/00
484253270,4sleep30-21swapper/33
483110271,3sleep10-21swapper/11
19089870,4rtkit-daemon671-21ntpd0
19089870,4rtkit-daemon667-21snmpd2
19089870,4rtkit-daemon667-21snmpd0
19089870,4rtkit-daemon495196-21munin-node2
19089870,4rtkit-daemon473-21gmain1
19089870,4rtkit-daemon421-21avahi-daemon2
19089870,3rtkit-daemon942162-21ssh2
19089870,3rtkit-daemon942162-21ssh2
19089870,3rtkit-daemon667-21snmpd2
19089870,3rtkit-daemon667-21snmpd0
19089870,3rtkit-daemon666527-21ssh1
19089870,3rtkit-daemon495196-21munin-node2
19089870,3rtkit-daemon495196-21munin-node0
19089870,3rtkit-daemon495196-21munin-node0
19089870,3rtkit-daemon450942-21munin-node2
19089870,3rtkit-daemon421-21avahi-daemon2
19089870,3rtkit-daemon1928-21sendmail-mta2
19089870,3rtkit-daemon1928-21sendmail-mta2
974190261,2sleep2974166-21apt-get2
966324260,1sleep10-21swapper/11
955443261,3sleep1955505-21ntp_states1
942126261,2sleep1942165-21apt-get1
942126261,2sleep1942165-21apt-get1
940215260,3sleep0940224-21sshd0
933264260,4sleep2933270-21ssh2
929301260,4sleep0930981-21ssh0
918159260,3sleep2918332-21/usr/sbin/munin2
898840260,1sleep10-21swapper/11
883571262,2sleep2883579-21ssh2
874853260,3sleep2874861-21ssh2
869125260,3sleep1869282-21ssh1
867077260,3sleep1867085-21ssh1
844628261,2sleep00-21swapper/00
842815260,1sleep20-21swapper/22
830672261,2sleep00-21swapper/00
819999260,1sleep20-21swapper/22
802698260,4sleep1802704-21ssh1
795990260,3sleep2796195-21ssh2
794070260,1sleep20-21swapper/22
789634260,3sleep1790768-21kthreadcore1
778037260,1sleep20-21swapper/22
764145261,3sleep0764303-21irqcore0
761531260,1sleep20-21swapper/22
754638260,1sleep20-21swapper/22
753697260,4sleep1753703-21ssh1
733170260,3sleep2735196-21tr2
729572260,1sleep20-21swapper/22
705625260,1sleep10-21swapper/11
689237261,2sleep1689245-21ssh1
682776260,4sleep1682823-21munin-run1
667052261,2sleep0221rcuc/00
658991260,4sleep0658998-21sh0
655927260,4sleep0656103-21strings0
611435261,2sleep00-21swapper/00
598687261,2sleep0598720-21apt-get0
598137261,3sleep1299-21systemd-journal1
587991260,3sleep1321rcuc/11
578753260,4sleep1578868-21mailstats1
575009260,4sleep0576306-21cut0
568048261,3sleep0569001-21kthreadcore0
535362260,3sleep0535528-21apt-config0
528865260,1sleep00-21swapper/00
528865260,1sleep00-21swapper/00
516986261,2sleep10-21swapper/11
509051260,3sleep1509130-21ntp_states1
503390260,3sleep0503598-21apt-config0
494711260,1sleep10-21swapper/11
19089860,2rtkit-daemon827787-21ssh1
19089860,2rtkit-daemon683036-21ssh2
917873250,3sleep0918037-21diskstats0
866993250,1sleep20-21swapper/22
859712250,3sleep10-21swapper/11
836600250,2sleep0836637-21apt-get0
786756250,1sleep10-21swapper/11
741402250,2sleep20-21swapper/22
723794250,3sleep10-21swapper/11
713554251,2sleep20-21swapper/22
713146250,3sleep1713152-21ssh1
658336250,3sleep10-21swapper/11
637234251,2sleep20-21swapper/22
635863250,1sleep20-21swapper/22
623260250,1sleep00-21swapper/00
610725250,1sleep10-21swapper/11
600169250,3sleep1602026-21cut1
573233250,1sleep10-21swapper/11
566736250,1sleep10-21swapper/11
548441250,1sleep00-21swapper/00
547863250,1sleep00-21swapper/00
542766251,1sleep10-21swapper/11
537376250,2sleep00-21swapper/00
518251251,2sleep00-21swapper/00
509661250,1sleep00-21swapper/00
495034250,3sleep1495301-21munin-node1
901539240,3sleep20-21swapper/22
642131240,1sleep10-21swapper/11
631588240,2sleep1631624-21kthreadcore1
622929240,1sleep10-21swapper/11
557118240,2sleep10-21swapper/11
535192240,3sleep10-21swapper/11
524453240,2sleep10-21swapper/11
524453240,2sleep10-21swapper/11
611539230,1sleep10-21swapper/11
605199230,1sleep00-21swapper/00
554154230,1sleep10-21swapper/11
535535230,1sleep10-21swapper/11
510265230,1sleep10-21swapper/11
510265230,1sleep10-21swapper/11
510016230,1sleep00-21swapper/00
510016230,1sleep00-21swapper/00
579843220,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional