You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-30 - 18:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot8s.osadl.org (updated Tue Dec 30, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26372109913360,1333cyclictest28327302sleep33
26372109913204,1312cyclictest26910942sleep33
2637210993220,319cyclictest2722971-21turbostat3
2637210992219,1cyclictest0-21swapper/33
2637210992118,1cyclictest0-21swapper/33
2637210992118,1cyclictest0-21swapper/33
2637210991815,1cyclictest0-21swapper/33
2637210991815,1cyclictest0-21swapper/33
30525122172,5sleep13052545-21apt-get1
301798170,4rtkit-daemon2974041-21cat0
263721099177,8cyclictest3045592-21turbostat3
263721099177,7cyclictest2819901-21turbostat3
263721099177,7cyclictest2819901-21turbostat3
2637210991714,1cyclictest0-21swapper/33
301798160,6rtkit-daemon2717049-21fschecks_time0
263721099165,8cyclictest2800632-21turbostat3
263721099162,10cyclictest3039185-21turbostat3
263721099157,5cyclictest2994215-21taskset3
263721099157,5cyclictest2994215-21taskset3
263721099156,7cyclictest2667229-21taskset3
263721099155,7cyclictest2857619-21taskset3
2637210991513,1cyclictest0-21swapper/33
2637210991512,1cyclictest0-21swapper/33
2637210991512,1cyclictest0-21swapper/33
263721099151,11cyclictest2935953-21turbostat3
263721099151,11cyclictest2839640-21taskset3
263721099151,10cyclictest2987829-21taskset3
263721099144,8cyclictest2955705-21taskset3
263721099142,8cyclictest2684706-21taskset3
2637210991413,0cyclictest0-21swapper/33
2637210991413,0cyclictest0-21swapper/33
2637210991413,0cyclictest0-21swapper/33
2637210991412,1cyclictest0-21swapper/33
2637210991412,1cyclictest0-21swapper/33
2637210991412,0cyclictest0-21swapper/33
263721099141,11cyclictest2684428-21turbostat3
2637210991411,1cyclictest0-21swapper/33
2637210991411,1cyclictest0-21swapper/33
2637210991411,1cyclictest0-21swapper/33
263721099141,10cyclictest3044890-21chrt3
263721099141,10cyclictest2974699-21turbostat3
263721099141,10cyclictest2923021-21taskset3
263721099141,10cyclictest2897444-21taskset3
263721099141,10cyclictest2802002-21taskset3
263721099141,10cyclictest2791642-21taskset3
263721099141,10cyclictest2736615-21taskset3
30321202130,2sleep10-21swapper/11
301798130,8rtkit-daemon2917364-21hddtemp_smartct0
28846222131,4sleep02884765-21df0
263721099133,8cyclictest2910305-21turbostat3
263721099131,9cyclictest3020152-21chrt3
263721099131,9cyclictest2883977-21taskset3
263721099131,9cyclictest2877564-21taskset3
263721099131,9cyclictest2642947-21chrt3
2637210991312,0cyclictest0-21swapper/33
2637210991312,0cyclictest0-21swapper/33
2637210991311,1cyclictest0-21swapper/33
2637210991311,1cyclictest0-21swapper/33
263721099131,10cyclictest2807275-21taskset3
2637210991311,0cyclictest0-21swapper/33
2637210991310,1cyclictest0-21swapper/33
2637210991310,1cyclictest0-21swapper/33
263721099130,10cyclictest3052498-21taskset3
263721099130,10cyclictest3028355-21taskset3
263721099130,10cyclictest2910541-21taskset3
263721099130,10cyclictest2847841-21taskset3
301798120,8rtkit-daemon2774533-21vmstat0
301798120,8rtkit-daemon2643706-21munin-node0
301798120,7rtkit-daemon2901592-21grep0
29235732124,5sleep10-21swapper/11
263721099121,9cyclictest2838813-21taskset3
263721099121,9cyclictest2710115-21taskset3
263721099121,9cyclictest2658836-21taskset3
263721099121,9cyclictest2651869-21taskset3
263721099121,8cyclictest2897651-21taskset3
263721099121,8cyclictest2749467-21taskset3
263721099120,9cyclictest2755910-21taskset3
263721099120,10cyclictest2871170-21taskset3
2637210991110,1cyclictest0-21swapper/33
301798100,5rtkit-daemon3020361-21/usr/sbin/munin0
301798100,5rtkit-daemon2943069-21df_inode0
301798100,5rtkit-daemon2820176-21apt-get0
301798100,5rtkit-daemon2790698-21kthreadcore0
301798100,5rtkit-daemon2776596-21irqstats0
301798100,3rtkit-daemon636-21snmpd0
29362052102,4sleep12936238-21apt-get1
30179890,6rtkit-daemon3205-21sendmail-mta0
30179890,5rtkit-daemon636-21snmpd0
30179890,5rtkit-daemon3205-21sendmail-mta0
30179890,4rtkit-daemon3008070-21cut0
30179890,4rtkit-daemon2722960-21apt-get0
30179890,1rtkit-daemon0-21swapper/00
30179890,1rtkit-daemon0-21swapper/00
3013492290,6sleep23013506-21find2
2932081290,1sleep02934181-21kthreadcore0
2865086291,5sleep22865104-21munin-run2
2832734291,5sleep22832736-21cron2
2761201296,1sleep20-21swapper/22
2742131290,6sleep22742380-21unixbench_singl2
2728704291,4sleep22728760-21ntp_states2
2728563290,1sleep10-21swapper/11
2715554291,5sleep22715669-21/usr/sbin/munin2
2630963290,4sleep10-21swapper/11
3039434281,3sleep03039467-21apt-get0
30179880,5rtkit-daemon636-21snmpd0
30179880,5rtkit-daemon2643706-21munin-node0
30179880,5rtkit-daemon2643706-21munin-node0
30179880,4rtkit-daemon667-21lldpd0
30179880,4rtkit-daemon667-21lldpd0
30179880,4rtkit-daemon667-21lldpd0
30179880,4rtkit-daemon667-21lldpd0
30179880,4rtkit-daemon636-21snmpd0
30179880,4rtkit-daemon636-21snmpd0
30179880,4rtkit-daemon448-21wpa_supplicant0
30179880,4rtkit-daemon448-21wpa_supplicant0
30179880,4rtkit-daemon441-21rsyslogd0
30179880,4rtkit-daemon3205-21sendmail-mta0
30179880,4rtkit-daemon3205-21sendmail-mta0
30179880,4rtkit-daemon3205-21sendmail-mta0
30179880,4rtkit-daemon2643706-21munin-node0
30179880,4rtkit-daemon2643706-21munin-node0
30179880,4rtkit-daemon2643706-21munin-node0
30179880,1rtkit-daemon0-21swapper/00
30179880,1rtkit-daemon0-21swapper/00
30179880,1rtkit-daemon0-21swapper/00
30179880,0rtkit-daemon3016-21rtkit-daemon0
2955722281,3sleep02955755-21apt-get0
2909378281,4sleep12909435-21ntp_states1
2877561281,5sleep02643706-21munin-node0
2852694281,4sleep22852894-21smartctl2
2846085281,3sleep12846118-21apt-get1
2840648280,5sleep12841635-21kthreadcore1
2717189281,4sleep12717671-21cut1
2638350281,4sleep02639318-21cut0
3046528271,3sleep23047270-21cut2
3038246270,4sleep03038304-21ntp_states0
30179870,4rtkit-daemon636-21snmpd0
30179870,4rtkit-daemon636-21snmpd0
30179870,4rtkit-daemon636-21snmpd0
30179870,3rtkit-daemon667-21lldpd0
30179870,3rtkit-daemon667-21lldpd0
30179870,3rtkit-daemon638-21ntpd0
30179870,3rtkit-daemon638-21ntpd0
30179870,3rtkit-daemon636-21snmpd0
30179870,3rtkit-daemon636-21snmpd0
30179870,3rtkit-daemon3205-21sendmail-mta0
30179870,3rtkit-daemon3205-21sendmail-mta0
30179870,3rtkit-daemon3200908-21packagekitd0
30179870,3rtkit-daemon3200908-21packagekitd0
30179870,3rtkit-daemon2995471-21irqrtprio0
30179870,3rtkit-daemon2995471-21irqrtprio0
30179870,3rtkit-daemon2921281-21kworker/0:0+kacpid0
30179870,3rtkit-daemon2643706-21munin-node0
30179870,3rtkit-daemon2643706-21munin-node0
30179870,3rtkit-daemon2643706-21munin-node0
30179870,2rtkit-daemon3049823-21cut0
2974979270,4sleep12975131-21df_inode1
2910554271,3sleep12910587-21apt-get1
2893171270,4sleep22895219-21tr2
2887052270,4sleep12889168-21tr1
2809847271,3sleep12811981-21kthreadcore1
2793301270,4sleep12793357-21ntp_states1
2749041270,1sleep20-21swapper/22
2692714271,3sleep22694722-21grep2
2684670271,2sleep20-21swapper/22
2652442270,4sleep12652550-21grep1
3050558260,3sleep13051251-21wc1
3027417260,4sleep23028352-21kthreadcore2
3026349260,4sleep13026576-21latency_hist1
30179860,3rtkit-daemon492-21gmain0
3007243260,4sleep13007316-21fschecks_time1
2993973261,3sleep12994128-21cat1
2988234260,3sleep22989122-21cut2
2982240260,3sleep22983143-21cut2
2971296260,3sleep22973468-21cut2
2962136260,3sleep12962169-21apt-get1
2955901260,1sleep20-21swapper/22
2949623260,4sleep12949791-21awk1
2949317261,2sleep20-21swapper/22
2919046260,4sleep12921118-21tr1
2897655261,2sleep20-21swapper/22
2866800261,3sleep10-21swapper/11
2821473261,2sleep20-21swapper/22
2820143261,2sleep10-21swapper/11
2815154261,2sleep20-21swapper/22
2815154261,2sleep20-21swapper/22
2813701260,3sleep12813734-21apt-get1
2813701260,3sleep12813734-21apt-get1
2801284260,3sleep22802001-21sed2
2786939260,1sleep20-21swapper/22
2776600260,4sleep12778275-21kthreadcore1
2755918261,2sleep12755951-21apt-get1
2749224261,2sleep10-21swapper/11
2714832261,2sleep10-21swapper/11
2691762260,4sleep12692713-21kthreadcore1
2641386260,3sleep22642499-21memory2
3064920250,1sleep20-21swapper/22
3060394250,2sleep10-21swapper/11
3040890250,3sleep13042443-21kthreadcore1
3033003250,1sleep20-21swapper/22
3025050250,3sleep23025420-21strings2
3002874251,2sleep20-21swapper/22
3000315250,1sleep10-21swapper/11
3000315250,1sleep10-21swapper/11
3000076250,1sleep20-21swapper/22
3000076250,1sleep20-21swapper/22
2981753250,3sleep12982238-21cut1
2980750250,1sleep20-21swapper/22
2974665250,1sleep10-21swapper/11
2961804250,1sleep10-21swapper/11
2948863250,1sleep20-21swapper/22
2944337251,2sleep10-21swapper/11
2942251250,1sleep20-21swapper/22
2930200251,2sleep20-21swapper/22
2929236250,1sleep20-21swapper/22
2917168251,2sleep20-21swapper/22
2916680250,1sleep20-21swapper/22
2903589250,1sleep10-21swapper/11
2897150250,1sleep10-21swapper/11
2890449250,1sleep20-21swapper/22
2884010250,1sleep10-21swapper/11
2878563250,3sleep22878703-21cut2
2871760250,2sleep20-21swapper/22
2871259250,1sleep20-21swapper/22
2854428250,3sleep12856486-21cut1
2846933251,2sleep20-21swapper/22
2839147250,2sleep22839639-21store2
2838423250,3sleep12838532-21find1
2829993250,2sleep10-21swapper/11
2807011250,1sleep20-21swapper/22
2787440250,1sleep10-21swapper/11
2774616250,1sleep20-21swapper/22
2768407250,1sleep20-21swapper/22
2763288251,1sleep10-21swapper/11
2751963251,2sleep10-21swapper/11
2736181250,1sleep10-21swapper/11
2709865250,1sleep20-21swapper/22
2703449250,1sleep20-21swapper/22
2677707250,1sleep20-21swapper/22
2671275250,1sleep20-21swapper/22
2664700250,3sleep20-21swapper/22
2654093251,2sleep20-21swapper/22
2644016251,2sleep10-21swapper/11
2636875250,1sleep20-21swapper/22
3053965240,2sleep20-21swapper/22
3034473240,2sleep10-21swapper/11
3012902240,3sleep20-21swapper/22
2963557240,2sleep20-21swapper/22
2935675240,3sleep10-21swapper/11
2905599240,2sleep2421rcuc/22
2871953240,3sleep10-21swapper/11
2833410240,2sleep22833502-21irqcore2
2805278240,1sleep10-21swapper/11
2789627240,2sleep2421rcuc/22
2775334240,2sleep20-21swapper/22
2770129240,2sleep10-21swapper/11
2733753240,1sleep20-21swapper/22
2705460240,2sleep12707100-21kthreadcore1
2700020240,1sleep10-21swapper/11
2678278240,2sleep20-21swapper/22
2665261240,1sleep10-21swapper/11
2664923240,1sleep10-21swapper/11
2651894240,3sleep20-21swapper/22
2637536240,3sleep10-21swapper/11
3042446230,1sleep20-21swapper/22
3018844230,1sleep10-21swapper/11
3000679230,1sleep10-21swapper/11
2858922230,1sleep10-21swapper/11
2799516230,1sleep22799688-21strings2
2794648230,1sleep10-21swapper/11
2749734230,1sleep20-21swapper/22
2736774230,1sleep10-21swapper/11
2717673230,1sleep20-21swapper/22
2690851230,1sleep10-21swapper/11
2678483230,1sleep10-21swapper/11
2674112230,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional