You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 09:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Mon Dec 08, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31899099912050,1201cyclictest33180352sleep33
31899099911530,1150cyclictest33594682sleep33
33395442250,1sleep10-21swapper/11
3189909992219,1cyclictest0-21swapper/33
3189909992118,1cyclictest0-21swapper/33
3189909991916,1cyclictest0-21swapper/33
318990999186,9cyclictest3454446-21taskset3
3189909991815,1cyclictest0-21swapper/33
3189909991714,1cyclictest0-21swapper/33
3189909991714,1cyclictest0-21swapper/33
318990999171,10cyclictest34165582sleep33
318990999161,11cyclictest3400258-21taskset3
3189909991610,3cyclictest0-21swapper/33
318990999160,12cyclictest3611553-21taskset3
36330462150,4sleep23633207-21sed2
3189909991513,1cyclictest0-21swapper/33
3189909991513,1cyclictest0-21swapper/33
3189909991513,0cyclictest0-21swapper/33
3189909991512,1cyclictest0-21swapper/33
3189909991512,1cyclictest0-21swapper/33
3189909991512,1cyclictest0-21swapper/33
3189909991512,1cyclictest0-21swapper/33
318990999151,11cyclictest3635116-21taskset3
318990999151,11cyclictest3530409-21taskset3
318990999151,11cyclictest3343201-21turbostat3
318990999151,10cyclictest3624755-21taskset3
318990999150,12cyclictest3229606-21turbostat3
35803452140,11sleep23581462-21cut2
318990999144,8cyclictest3496953-21taskset3
318990999144,8cyclictest3204472-21turbostat3
318990999144,7cyclictest34085262sleep33
318990999141,9cyclictest35062372sleep33
318990999141,9cyclictest32553132sleep33
3189909991413,0cyclictest0-21swapper/33
3189909991413,0cyclictest0-21swapper/33
3189909991412,1cyclictest0-21swapper/33
3189909991412,1cyclictest0-21swapper/33
3189909991412,1cyclictest0-21swapper/33
3189909991411,1cyclictest0-21swapper/33
3189909991411,1cyclictest0-21swapper/33
3189909991411,1cyclictest0-21swapper/33
3189909991411,1cyclictest0-21swapper/33
3189909991411,1cyclictest0-21swapper/33
318990999141,10cyclictest3651365-21taskset3
318990999141,10cyclictest3586216-21taskset3
318990999141,10cyclictest3563002-21chrt3
318990999141,10cyclictest3563002-21chrt3
318990999141,10cyclictest3488438-21taskset3
318990999141,10cyclictest3465351-21taskset3
318990999141,10cyclictest3447394-21taskset3
318990999141,10cyclictest3351536-21taskset3
318990999141,10cyclictest3351536-21taskset3
318990999141,10cyclictest3273535-21taskset3
318990999141,10cyclictest3248598-21taskset3
318990999141,10cyclictest3195754-21taskset3
33308832131,4sleep13330916-21apt-get1
318990999134,7cyclictest3229870-21taskset3
318990999131,9cyclictest32992532sleep33
318990999131,8cyclictest3292986-21taskset3
3189909991311,1cyclictest0-21swapper/33
3189909991311,1cyclictest0-21swapper/33
318990999131,10cyclictest3521876-21taskset3
318990999131,10cyclictest3324313-21taskset3
3189909991310,1cyclictest0-21swapper/33
3189909991310,1cyclictest0-21swapper/33
318990999130,10cyclictest3560007-21taskset3
318990999130,10cyclictest3286691-21taskset3
318990999130,10cyclictest3279891-21taskset3
318990999130,10cyclictest3204207-21chrt3
35465242121,9sleep03546576-21munin-run0
34490452122,5sleep03449077-21apt-get0
32161002120,4sleep13216177-21ntp_states1
318990999121,9cyclictest3280410-21taskset3
318990999121,7cyclictest36034362sleep33
318990999120,10cyclictest3530664-21chrt3
36756482110,8sleep23675718-21date2
36408652111,7sleep13640946-21ntp_states1
35858512111,7sleep03585859-21ssh0
33576032115,1sleep1171rcu_preempt1
33576032115,1sleep1171rcu_preempt1
31895372110,2sleep30-21swapper/33
190898110,3rtkit-daemon667-21snmpd1
35791232102,5sleep13579160-21apt-get1
35632342101,6sleep20-21swapper/22
35632342101,6sleep20-21swapper/22
35142732100,8sleep13514280-21dpkg1
34707072101,5sleep03470840-21python30
34213072100,7sleep23421716-21grep2
33596082100,3sleep03359770-21diskstats0
190898100,6rtkit-daemon3496745-21ssh0
190898100,6rtkit-daemon3196247-21munin-node1
190898100,6rtkit-daemon3183896-21taskset1
190898100,5rtkit-daemon3681233-21ntp_states1
190898100,3rtkit-daemon473-21gmain1
190898100,1rtkit-daemon0-21swapper/11
3679855291,5sleep03681035-21memory0
3660323291,5sleep23661035-21irqrtprio2
3616838291,5sleep03616957-21python30
3608473294,3sleep23608618-21needreboot2
3601446290,1sleep23601454-21ssh2
3489584296,1sleep20-21swapper/22
3441432291,6sleep03442426-21/usr/sbin/munin0
3351579291,5sleep03351740-21df_inode0
3351579291,5sleep03351740-21df_inode0
3260544291,5sleep13260669-21python31
3248735291,4sleep03248753-21turbostat0
3235896290,6sleep23236153-21cat2
3216178291,6sleep23210997-21/usr/sbin/munin2
19089890,6rtkit-daemon3674617-21sh1
19089890,5rtkit-daemon438-21wpa_supplicant0
19089890,5rtkit-daemon438-21wpa_supplicant0
19089890,5rtkit-daemon3561080-21ssh0
19089890,5rtkit-daemon3460248-21grep0
19089890,5rtkit-daemon3376199-21if_err_eno11
19089890,4rtkit-daemon3512643-21ssh0
19089890,4rtkit-daemon3414818-21ssh0
19089890,4rtkit-daemon3350361-21ssh1
19089890,4rtkit-daemon3248370-21users1
19089890,1rtkit-daemon0-21swapper/00
3650169281,4sleep23650173-21ssh2
3611509280,4sleep23611546-21apt-get2
3611234280,5sleep13611278-21munin-run1
3503811281,4sleep03503816-21sh0
3481855284,2sleep0151ktimers/00
3480492280,2sleep23480500-21ssh2
3465104281,4sleep13465298-21date1
3392917280,5sleep23393872-21cut2
3389651280,6sleep03389652-21sshd0
3349039281,4sleep03349285-21users0
3301589280,5sleep13303669-21grep1
3273056281,5sleep23273149-21mailstats2
3253100281,4sleep03254002-21memory0
19089880,5rtkit-daemon319-21systemd-udevd1
19089880,5rtkit-daemon1928-21sendmail-mta1
19089880,5rtkit-daemon1928-21sendmail-mta1
19089880,5rtkit-daemon1928-21sendmail-mta0
19089880,4rtkit-daemon671-21ntpd1
19089880,4rtkit-daemon667-21snmpd1
19089880,4rtkit-daemon436-21systemd-logind1
19089880,4rtkit-daemon3660519-21cut1
19089880,4rtkit-daemon3602219-21ssh0
19089880,4rtkit-daemon3513789-21apt-get0
19089880,4rtkit-daemon3416000-21apt-get0
19089880,4rtkit-daemon3196247-21munin-node1
19089880,4rtkit-daemon3196247-21munin-node0
19089880,4rtkit-daemon1928-21sendmail-mta0
19089880,3rtkit-daemon3603630-21df0
19089880,1rtkit-daemon0-21swapper/22
19089880,1rtkit-daemon0-21swapper/11
19089880,1rtkit-daemon0-21swapper/00
3651871270,4sleep03651950-21grep0
3637191271,3sleep20-21swapper/22
3618321270,2sleep13618329-21ssh1
3587254271,2sleep13587291-21apt-get1
3549356270,5sleep23551399-21cut2
3465393270,3sleep23465436-21ssh2
3410593271,4sleep23412626-21cut2
3392425270,4sleep03392625-21/usr/sbin/munin0
3390695270,1sleep20-21swapper/22
3368090270,4sleep13369092-21cut1
3367974270,4sleep03368089-21irqcore0
3348817270,1sleep20-21swapper/22
3331865270,4sleep23332830-21cut2
3326236271,4sleep20-21swapper/22
3305579270,3sleep03305612-21apt-get0
3299250270,1sleep00-21swapper/00
3275639270,5sleep03277520-21kthreadcore0
3261649270,4sleep03261796-21df0
3256756270,5sleep03257892-21grep0
3201024270,5sleep23203094-21cut2
3195877270,4sleep23195878-21sshd2
3195766270,2sleep00-21swapper/00
19089870,4rtkit-daemon473-21gmain1
19089870,4rtkit-daemon421-21avahi-daemon0
19089870,4rtkit-daemon421-21avahi-daemon0
19089870,4rtkit-daemon3196247-21munin-node1
19089870,4rtkit-daemon3196247-21munin-node1
19089870,3rtkit-daemon674-21lldpd0
19089870,3rtkit-daemon671-21ntpd1
19089870,3rtkit-daemon671-21ntpd1
19089870,3rtkit-daemon667-21snmpd2
19089870,3rtkit-daemon667-21snmpd1
19089870,3rtkit-daemon667-21snmpd0
19089870,3rtkit-daemon436-21systemd-logind1
19089870,3rtkit-daemon436-21systemd-logind1
19089870,3rtkit-daemon3522384-21ssh2
19089870,3rtkit-daemon3239227-21grep1
19089870,3rtkit-daemon3196441-21sh1
19089870,3rtkit-daemon1223-21cron0
19089870,2rtkit-daemon3205764-21sed1
19089870,1rtkit-daemon0-21swapper/11
19089870,1rtkit-daemon0-21swapper/11
3675038260,1sleep00-21swapper/00
3665152260,1sleep00-21swapper/00
3658096260,1sleep20-21swapper/22
3626139260,1sleep10-21swapper/11
3587195260,1sleep20-21swapper/22
3548192260,3sleep13549354-21cut1
3532261261,2sleep10-21swapper/11
3515506261,2sleep20-21swapper/22
3511610260,4sleep13511803-21users1
3498202260,3sleep13498407-21smartctl1
3496817260,1sleep20-21swapper/22
3483652261,3sleep13481819-21/usr/sbin/munin1
3472728260,4sleep13343198-21diskmemload1
3456239260,1sleep20-21swapper/22
3455201260,4sleep13455209-21ssh1
3436602260,4sleep13437711-21memory1
3427478261,3sleep13429587-21kthreadcore1
3423528260,1sleep10-21swapper/11
3400214261,2sleep20-21swapper/22
3367677261,3sleep23367778-21diskstats2
3365466260,1sleep20-21swapper/22
3313581260,3sleep23315480-21cut2
3282264261,2sleep00-21swapper/00
3274143260,4sleep23274163-21awk2
3273885261,2sleep00-21swapper/00
3249982261,2sleep20-21swapper/22
3237413261,3sleep23238589-21kthreadcore2
3235654260,1sleep00-21swapper/00
3226261260,3sleep23228398-21grep2
3216341261,2sleep00-21swapper/00
3185792260,4sleep23187876-21grep2
19089860,3rtkit-daemon671-21ntpd1
19089860,3rtkit-daemon667-21snmpd1
3682743251,2sleep20-21swapper/22
3642880250,2sleep00-21swapper/00
3632857250,3sleep03632915-21open_inodes0
3629934250,2sleep13631923-21kthreadcore1
3595557251,2sleep10-21swapper/11
3578387251,2sleep23343198-21diskmemload2
3556492250,3sleep13558404-21cut1
3539778250,3sleep13540271-21kthreadcore1
3533666251,2sleep20-21swapper/22
3504197250,1sleep20-21swapper/22
3495921250,1sleep10-21swapper/11
3479248250,3sleep10-21swapper/11
3464473251,2sleep20-21swapper/22
3447000250,1sleep10-21swapper/11
3439671250,3sleep20-21swapper/22
3430556250,3sleep23430564-21ssh2
3415170251,2sleep10-21swapper/11
3343075250,1sleep20-21swapper/22
3336620250,1sleep00-21swapper/00
3318286250,1sleep20-21swapper/22
3308050250,3sleep23310147-21kthreadcore2
3298534250,3sleep20-21swapper/22
3296027250,1sleep00-21swapper/00
3243072251,2sleep23243535-21irqcore2
3242380250,1sleep00-21swapper/00
3223106250,1sleep00-21swapper/00
3222962250,1sleep20-21swapper/22
3649702240,1sleep00-21swapper/00
3544561240,1sleep20-21swapper/22
3522446240,2sleep13522608-21diskstats1
3507070240,2sleep20-21swapper/22
3382449240,1sleep00-21swapper/00
3351527240,2sleep23196247-21munin-node2
3351527240,2sleep23196247-21munin-node2
3338442240,2sleep00-21swapper/00
3324976240,2sleep00-21swapper/00
3318310240,1sleep00-21swapper/00
3312455240,2sleep03312594-21irqcore0
3291797240,1sleep00-21swapper/00
3223554240,1sleep03223587-21apt-get0
3210465240,3sleep00-21swapper/00
3204721240,1sleep20-21swapper/22
3196330240,2sleep03197054-21kthreadcore0
3183796240,1sleep00-21swapper/00
3555119230,1sleep20-21swapper/22
3440854230,1sleep20-21swapper/22
3304609230,1sleep20-21swapper/22
3292633230,1sleep20-21swapper/22
3280827230,1sleep20-21swapper/22
3261601230,1sleep20-21swapper/22
3255593230,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional