You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 17:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Mon Dec 08, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27033299913160,1312cyclictest31971052sleep33
27033299912780,1275cyclictest29297982sleep33
27033299912040,1200cyclictest28254342sleep33
2703329993631,359cyclictest2856616-21turbostat3
2703329992974,289cyclictest2994360-21turbostat3
2703329992320,1cyclictest0-21swapper/33
270332999197,9cyclictest2819006-21taskset3
2703329991917,1cyclictest0-21swapper/33
270332999187,8cyclictest2913469-21turbostat3
2703329991714,1cyclictest0-21swapper/33
270332999166,7cyclictest2837804-21turbostat3
190898160,4rtkit-daemon3058714-21ssh0
27313342151,4sleep02731534-21hddtemp_smartct0
27095742151,4sleep11-21systemd1
270332999154,9cyclictest2787531-21turbostat3
270332999152,10cyclictest3099979-21taskset3
2703329991512,1cyclictest0-21swapper/33
270332999151,11cyclictest2938150-21taskset3
270332999151,11cyclictest2900423-21taskset3
270332999145,7cyclictest2954058-21turbostat3
270332999141,9cyclictest3027028-21taskset3
270332999141,9cyclictest29543812sleep33
270332999141,9cyclictest2819253-21taskset3
270332999141,9cyclictest2794129-21chrt3
2703329991412,1cyclictest0-21swapper/33
2703329991412,1cyclictest0-21swapper/33
2703329991412,1cyclictest0-21swapper/33
2703329991412,1cyclictest0-21swapper/33
2703329991412,0cyclictest0-21swapper/33
2703329991411,1cyclictest0-21swapper/33
2703329991411,1cyclictest0-21swapper/33
2703329991411,1cyclictest0-21swapper/33
2703329991411,1cyclictest0-21swapper/33
2703329991411,1cyclictest0-21swapper/33
270332999141,10cyclictest3187378-21taskset3
270332999141,10cyclictest3121712-21chrt3
270332999141,10cyclictest3115966-21taskset3
270332999141,10cyclictest3090227-21taskset3
270332999141,10cyclictest3082015-21taskset3
270332999141,10cyclictest3026222-21taskset3
270332999141,10cyclictest2895971-21taskset3
270332999141,10cyclictest2850238-21taskset3
270332999141,10cyclictest2773482-21taskset3
270332999141,10cyclictest2724256-21taskset3
270332999140,11cyclictest3067609-21taskset3
270332999140,11cyclictest2703453-21taskset3
190898140,4rtkit-daemon3186608-21ntp_states0
190898140,2rtkit-daemon0-21swapper/00
29931332131,9sleep02993141-21ssh0
270332999131,9cyclictest3167679-21taskset3
270332999131,9cyclictest3107919-21turbostat3
270332999131,9cyclictest3065549-21taskset3
270332999131,9cyclictest2842506-21taskset3
270332999131,9cyclictest2842506-21taskset3
270332999131,9cyclictest2744178-21taskset3
270332999131,8cyclictest28813992sleep33
270332999131,8cyclictest27248392sleep33
2703329991312,0cyclictest0-21swapper/33
2703329991312,0cyclictest0-21swapper/33
2703329991312,0cyclictest0-21swapper/33
2703329991311,1cyclictest0-21swapper/33
270332999131,10cyclictest2921014-21taskset3
2703329991310,1cyclictest0-21swapper/33
270332999130,10cyclictest3057854-21taskset3
270332999130,10cyclictest3002649-21taskset3
270332999130,10cyclictest2962382-21taskset3
270332999130,10cyclictest2865841-21chrt3
270332999130,10cyclictest2777947-21taskset3
270332999130,10cyclictest2737117-21taskset3
190898130,8rtkit-daemon3172135-21ssh0
270332999121,9cyclictest2762168-21taskset3
270332999121,8cyclictest3035016-21taskset3
270332999120,9cyclictest2923314-21taskset3
270332999120,9cyclictest2856250-21chrt3
270332999120,9cyclictest2781705-21chrt3
190898120,8rtkit-daemon2929546-21ssh0
31813232111,5sleep13181366-21ssh1
29112632111,7sleep02911476-21users0
28509212111,7sleep12851066-21grep1
27182412110,4sleep02718301-21systemd-run0
190898110,7rtkit-daemon3163536-21ssh1
190898110,7rtkit-daemon3155288-21ssh1
190898110,7rtkit-daemon3073786-21ssh0
190898110,6rtkit-daemon2960104-21unixbench_singl0
31479202100,3sleep23147928-21ssh2
30676882101,5sleep13067727-21apt-get1
29313702101,2sleep20-21swapper/22
28960612100,2sleep20-21swapper/22
28269072101,6sleep02828650-21tr0
27515902100,7sleep02752764-21grep0
26972112100,4sleep20-21swapper/22
190898100,6rtkit-daemon2870770-21ssh2
190898100,5rtkit-daemon3090278-21ssh0
190898100,3rtkit-daemon674-21lldpd0
190898100,3rtkit-daemon2953147-21ssh0
3163021290,6sleep03163027-21ssh0
3034326295,2sleep20-21swapper/22
2959118290,6sleep22959510-21needreboot2
2946833291,5sleep12947830-21irqstats1
2897299291,4sleep12897542-21sed1
2880278290,3sleep22880286-21ssh2
2863931290,6sleep22863937-21ssh2
2849634290,6sleep02849854-21unixbench_multi0
2799212290,5sleep22799289-21ntp_states2
2775264291,4sleep12775297-21apt-get1
2750320290,6sleep12750401-21grep1
2737392291,4sleep12737425-21apt-get1
19089890,6rtkit-daemon667-21snmpd0
19089890,5rtkit-daemon674-21lldpd0
19089890,5rtkit-daemon473-21gmain0
19089890,5rtkit-daemon2990448-21ssh2
19089890,5rtkit-daemon2881554-21expr0
19089890,5rtkit-daemon1928-21sendmail-mta1
19089890,4rtkit-daemon3147274-21lsb_release1
19089890,4rtkit-daemon3139492-21ssh1
19089890,4rtkit-daemon3098823-21ssh0
19089890,4rtkit-daemon3049916-21ssh0
19089890,4rtkit-daemon3016106-21ntp_states0
19089890,4rtkit-daemon2920947-21ssh0
19089890,1rtkit-daemon0-21swapper/00
3165260280,4sleep23165405-21df2
3145695282,3sleep014-21ksoftirqd/00
3139946280,5sleep23139950-21ssh2
3107703281,5sleep13107709-21ssh1
3042528280,1sleep20-21swapper/22
3035557281,4sleep03036554-21sed0
3010838281,3sleep23010873-21apt-get2
2971992280,5sleep12973442-21cut1
2929878281,4sleep12929912-21apt-get1
2929547281,4sleep12929571-21munin-run1
2916070282,3sleep12918102-21kthreadcore1
2880646281,4sleep12880654-21ssh1
2781514281,3sleep12781546-21apt-get1
2756451280,1sleep00-21swapper/00
2756157280,5sleep22756187-21basename2
19089880,5rtkit-daemon667-21snmpd1
19089880,5rtkit-daemon2709811-21munin-node1
19089880,5rtkit-daemon1928-21sendmail-mta1
19089880,5rtkit-daemon1928-21sendmail-mta1
19089880,4rtkit-daemon667-21snmpd1
19089880,4rtkit-daemon667-21snmpd0
19089880,4rtkit-daemon667-21snmpd0
19089880,4rtkit-daemon667-21snmpd0
19089880,4rtkit-daemon473-21gmain1
19089880,4rtkit-daemon438-21wpa_supplicant1
19089880,4rtkit-daemon438-21wpa_supplicant0
19089880,4rtkit-daemon421-21avahi-daemon0
19089880,4rtkit-daemon3122780-21ssh1
19089880,4rtkit-daemon3114836-21ssh1
19089880,4rtkit-daemon3001563-21ssh0
19089880,4rtkit-daemon2944383-21taskset0
19089880,4rtkit-daemon2877884-21cut0
19089880,4rtkit-daemon2808476-21grep1
19089880,4rtkit-daemon2709811-21munin-node1
19089880,4rtkit-daemon2709811-21munin-node0
19089880,4rtkit-daemon2709811-21munin-node0
19089880,1rtkit-daemon0-21swapper/22
19089880,1rtkit-daemon0-21swapper/00
19089880,1rtkit-daemon0-21swapper/00
19089880,1rtkit-daemon0-21swapper/00
3195370270,1sleep20-21swapper/22
3179806270,1sleep20-21swapper/22
3161273271,3sleep23091255-21kworker/u16:1+nfsiod2
3132038270,1sleep00-21swapper/00
3113719270,4sleep03113965-21users0
3092158270,4sleep13092281-21perl1
3090096270,4sleep23090104-21ssh2
3075829271,3sleep13075864-21apt-get1
3074128270,5sleep23074136-21ssh2
3050626270,1sleep20-21swapper/22
3007923270,4sleep23008004-21uname2
2983755270,4sleep12983838-21ntp_states1
2943442270,5sleep12943524-21ntpq1
2907798270,5sleep22909784-21tr2
2838044271,3sleep02838077-21apt-get0
2838044271,3sleep02838077-21apt-get0
2818938271,3sleep20-21swapper/22
2800790270,5sleep22801386-21irqrtprio2
2775300271,4sleep22775449-21df_inode2
2770366270,4sleep12771386-21grep1
19089870,4rtkit-daemon674-21lldpd0
19089870,4rtkit-daemon473-21gmain0
19089870,4rtkit-daemon2709811-21munin-node2
19089870,3rtkit-daemon671-21ntpd2
19089870,3rtkit-daemon671-21ntpd0
19089870,3rtkit-daemon667-21snmpd1
19089870,3rtkit-daemon667-21snmpd0
19089870,3rtkit-daemon421-21avahi-daemon1
19089870,3rtkit-daemon3124347-21/usr/sbin/munin1
19089870,3rtkit-daemon3024744-21ssh1
19089870,3rtkit-daemon299-21systemd-journal0
19089870,3rtkit-daemon2985980-21ssh2
3187540260,1sleep20-21swapper/22
3179892260,4sleep10-21swapper/11
3155339260,3sleep03155347-21ssh0
3154388260,3sleep23154505-21find2
3139409261,3sleep03139419-21ssh0
3122567260,1sleep20-21swapper/22
3060068260,3sleep13060524-21sed1
3059682260,1sleep20-21swapper/22
3031736261,3sleep12856605-21diskmemload1
3000605260,1sleep20-21swapper/22
2994330260,3sleep12994354-21munin-run1
2984013260,1sleep00-21swapper/00
2970710260,4sleep22970511-21/usr/sbin/munin2
2957026263,1sleep10-21swapper/11
2927732260,1sleep20-21swapper/22
2906728260,3sleep12907797-21grep1
2903542262,2sleep12703323-21cyclictest1
2883992260,3sleep12886030-21tr1
2837595260,1sleep00-21swapper/00
2822596260,3sleep02824138-21cat0
2819218261,2sleep20-21swapper/22
2806863260,4sleep02807060-21tail0
2793538260,1sleep00-21swapper/00
2787261260,1sleep20-21swapper/22
2765030260,4sleep20-21swapper/22
2726851260,4sleep12728898-21cut1
2724259260,1sleep10-21swapper/11
2723509260,1sleep20-21swapper/22
2709720260,3sleep22709595-21apt-get2
19089860,3rtkit-daemon473-21gmain0
19089860,3rtkit-daemon2709811-21munin-node1
19089860,2rtkit-daemon2781916-21smartctl0
3106640250,2sleep03106648-21ssh0
3085218250,3sleep13086362-21cat1
3051929251,2sleep20-21swapper/22
3051440250,1sleep10-21swapper/11
3044698250,3sleep13046155-21cat1
3040923250,3sleep12888106-21kworker/u16:4+nfsiod1
3009321250,3sleep10-21swapper/11
3000015250,3sleep10-21swapper/11
2946255250,3sleep20-21swapper/22
2914031251,2sleep20-21swapper/22
2881696251,2sleep20-21swapper/22
2870312250,2sleep10-21swapper/11
2863451250,3sleep00-21swapper/00
2855827250,3sleep02855928-21sed0
2850585250,2sleep20-21swapper/22
2845798250,3sleep22845836-21kthreadcore2
2843246250,3sleep22843369-21/usr/sbin/munin2
2843246250,3sleep22843369-21/usr/sbin/munin2
2831759250,2sleep20-21swapper/22
2825448251,2sleep20-21swapper/22
2818763250,1sleep00-21swapper/00
2812378250,1sleep20-21swapper/22
2802594250,3sleep02804686-21kthreadcore0
2800100250,1sleep00-21swapper/00
2787769250,2sleep20-21swapper/22
2771387251,2sleep20-21swapper/22
2762400250,3sleep20-21swapper/22
2745330250,2sleep12746947-21ps1
2731535251,2sleep10-21swapper/11
2730854250,1sleep20-21swapper/22
2714656250,2sleep10-21swapper/11
2703518250,2sleep20-21swapper/22
19089850,1rtkit-daemon0-21swapper/11
3116311240,1sleep00-21swapper/00
3109777240,2sleep20-21swapper/22
3107832240,2sleep23107700-21kworker/u16:3+xprtiod2
3099745240,2sleep23099762-21latency_hist2
3077316240,2sleep23078434-21ssh2
3010732240,2sleep13010740-21ssh1
2969258240,2sleep22969264-21ssh2
2964004240,2sleep10-21swapper/11
2899127240,2sleep20-21swapper/22
2758498240,2sleep10-21swapper/11
2749563240,3sleep20-21swapper/22
2731170240,2sleep22731190-21grep2
2701810240,1sleep10-21swapper/11
2763865230,1sleep10-21swapper/11
2738818230,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional