You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 23:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Wed Jan 07, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30592469911950,1191cyclictest33522712sleep33
30592469911680,1165cyclictest31390662sleep33
30592469911331,1126cyclictest3280568-21sleep3
30592469911011,1095cyclictest3461729-21sleep3
344805221110,2sleep03448051-21sendmail_mailqu0
3059246992320,1cyclictest0-21swapper/33
3059246992118,1cyclictest0-21swapper/33
3059246992017,1cyclictest0-21swapper/33
305924699187,7cyclictest3132679-21turbostat3
3059246991815,1cyclictest0-21swapper/33
3059246991714,1cyclictest0-21swapper/33
3059246991614,1cyclictest0-21swapper/33
3059246991613,1cyclictest0-21swapper/33
305924699161,11cyclictest3455270-21turbostat3
305924699161,11cyclictest3326246-21taskset3
305924699155,7cyclictest3423405-21taskset3
3059246991512,1cyclictest0-21swapper/33
3059246991512,1cyclictest0-21swapper/33
3059246991512,1cyclictest0-21swapper/33
305924699151,10cyclictest3384927-21taskset3
305924699151,10cyclictest3205978-21taskset3
305924699151,10cyclictest3184300-21taskset3
305924699145,6cyclictest33591392sleep33
3059246991412,1cyclictest0-21swapper/33
3059246991412,1cyclictest0-21swapper/33
3059246991412,1cyclictest0-21swapper/33
3059246991412,1cyclictest0-21swapper/33
3059246991412,0cyclictest0-21swapper/33
3059246991412,0cyclictest0-21swapper/33
3059246991411,1cyclictest0-21swapper/33
3059246991411,1cyclictest0-21swapper/33
3059246991411,1cyclictest0-21swapper/33
3059246991411,1cyclictest0-21swapper/33
305924699141,10cyclictest3484567-21taskset3
305924699141,10cyclictest3344316-21taskset3
305924699141,10cyclictest3065300-21chrt3
305924699134,7cyclictest3397337-21taskset3
305924699133,8cyclictest3320026-21taskset3
305924699133,8cyclictest3320026-21taskset3
305924699133,7cyclictest3216510-21taskset3
305924699131,9cyclictest3480652-21taskset3
305924699131,9cyclictest3444553-21taskset3
305924699131,9cyclictest3306061-21chrt3
305924699131,9cyclictest3145745-21taskset3
305924699131,9cyclictest3145745-21taskset3
305924699131,9cyclictest3139325-21taskset3
305924699131,9cyclictest3093913-21taskset3
3059246991312,0cyclictest0-21swapper/33
3059246991311,1cyclictest0-21swapper/33
3059246991311,1cyclictest0-21swapper/33
3059246991311,1cyclictest0-21swapper/33
3059246991310,1cyclictest0-21swapper/33
3059246991310,1cyclictest0-21swapper/33
3059246991310,1cyclictest0-21swapper/33
3059246991310,1cyclictest0-21swapper/33
305924699130,10cyclictest3261317-21taskset3
33641842121,4sleep134-21ksoftirqd/11
32163292121,6sleep13216351-21apt-get1
32134792120,1sleep30-21swapper/33
305924699129,1cyclictest0-21swapper/33
305924699124,6cyclictest3377246-21taskset3
305924699124,6cyclictest3074191-21taskset3
305924699121,9cyclictest3429820-21taskset3
305924699121,9cyclictest3365329-21taskset3
305924699121,8cyclictest3403529-21taskset3
3059246991210,1cyclictest0-21swapper/33
3059246991210,1cyclictest0-21swapper/33
3059246991210,1cyclictest0-21swapper/33
3059246991210,0cyclictest0-21swapper/33
305924699120,9cyclictest3177242-21taskset3
31393292111,6sleep23139362-21apt-get2
305924699111,8cyclictest3306770-21taskset3
305924699110,9cyclictest3255690-21taskset3
30772582101,6sleep03079391-21kthreadcore0
30531792101,5sleep23053374-21hddtemp_smartct2
301798100,5rtkit-daemon3379640-21irqstats1
301798100,5rtkit-daemon3222945-21df_inode1
301798100,4rtkit-daemon3391360-21apt-get1
301798100,4rtkit-daemon3065766-21munin-node1
301798100,3rtkit-daemon492-21gmain1
301798100,3rtkit-daemon430-21avahi-daemon1
301798100,3rtkit-daemon3065766-21munin-node1
301798100,1rtkit-daemon0-21swapper/11
3482708291,6sleep23484566-21grep2
3417379290,6sleep13417770-21cut1
3365374291,4sleep13365520-21df1
3262017290,6sleep03262981-21grep0
3242047291,4sleep03242079-21apt-get0
3105953291,4sleep23106078-21python32
30179890,5rtkit-daemon638-21ntpd1
30179890,5rtkit-daemon636-21snmpd1
30179890,5rtkit-daemon636-21snmpd1
30179890,5rtkit-daemon636-21snmpd1
30179890,5rtkit-daemon3442683-21/usr/sbin/munin1
30179890,5rtkit-daemon3205-21sendmail-mta1
30179890,5rtkit-daemon317-21systemd-udevd1
30179890,5rtkit-daemon317-21systemd-udevd1
30179890,4rtkit-daemon3449263-21df_inode1
30179890,4rtkit-daemon3352608-21grep1
30179890,4rtkit-daemon3273229-21switchtime1
30179890,3rtkit-daemon3200908-21packagekitd1
30179890,1rtkit-daemon0-21swapper/11
30179890,1rtkit-daemon0-21swapper/11
30179890,1rtkit-daemon0-21swapper/11
30179890,1rtkit-daemon0-21swapper/11
3447934284,1sleep2431ktimers/22
3428927280,5sleep03429181-21head0
3360633281,5sleep23362668-21grep2
3347568280,4sleep03349403-21cut0
3326566280,1sleep00-21swapper/00
3301503280,5sleep10-21swapper/11
3282851280,5sleep03284927-21cut0
3273879281,4sleep01-21systemd0
3172407280,5sleep23172894-21kthreadcore2
3157421280,5sleep13157477-21ntp_states1
3145782281,4sleep03145934-21df_inode0
3145782281,4sleep03145934-21df_inode0
3132912281,3sleep13132945-21apt-get1
3112231281,4sleep03112308-21ntp_states0
3100994281,4sleep03101801-21sed0
3087314281,3sleep23087347-21apt-get2
30179880,5rtkit-daemon492-21gmain1
30179880,5rtkit-daemon3205-21sendmail-mta1
30179880,4rtkit-daemon638-21ntpd1
30179880,4rtkit-daemon492-21gmain1
30179880,4rtkit-daemon492-21gmain1
30179880,4rtkit-daemon492-21gmain1
30179880,4rtkit-daemon448-21wpa_supplicant1
30179880,4rtkit-daemon448-21wpa_supplicant1
30179880,4rtkit-daemon448-21wpa_supplicant1
30179880,4rtkit-daemon3473509-21memory1
30179880,4rtkit-daemon3205-21sendmail-mta1
30179880,4rtkit-daemon3205-21sendmail-mta1
30179880,4rtkit-daemon3065766-21munin-node1
30179880,4rtkit-daemon3065766-21munin-node1
30179880,4rtkit-daemon3065766-21munin-node1
30179880,4rtkit-daemon3065766-21munin-node1
30179880,4rtkit-daemon3065766-21munin-node1
30179880,4rtkit-daemon3065766-21munin-node1
30179880,4rtkit-daemon3065766-21munin-node1
30179880,4rtkit-daemon0-21swapper/11
30179880,3rtkit-daemon3474834-21apt-get1
30179880,3rtkit-daemon3375745-21kthreadcore1
30179880,3rtkit-daemon3324459-21kthreadcore1
30179880,3rtkit-daemon3324459-21kthreadcore1
30179880,1rtkit-daemon0-21swapper/11
3437729270,4sleep03439413-21cut0
3417771271,3sleep23418716-21cut2
3403034270,4sleep13403159-21sensors_temp1
3399176271,3sleep03399926-21kthreadcore0
3351217271,3sleep23351376-21awk2
3339141270,4sleep03339373-21readlink0
3333170270,5sleep23333250-21fschecks_time2
3308715270,4sleep23310755-21grep2
3293640271,3sleep13293673-21apt-get1
3273940270,3sleep13273899-21apt-get1
3256639270,4sleep03258677-21grep0
3209560270,1sleep20-21swapper/22
3126246271,3sleep00-21swapper/00
3093728271,2sleep10-21swapper/11
30179870,4rtkit-daemon3065766-21munin-node1
30179870,4rtkit-daemon0-21swapper/11
30179870,3rtkit-daemon638-21ntpd1
30179870,3rtkit-daemon638-21ntpd1
30179870,3rtkit-daemon636-21snmpd1
30179870,3rtkit-daemon636-21snmpd1
30179870,3rtkit-daemon3065766-21munin-node1
30179870,3rtkit-daemon3065766-21munin-node1
3487205260,1sleep00-21swapper/00
3474800260,3sleep03474830-21awk0
3461455260,3sleep03461457-21sh0
3423162260,3sleep014-21ksoftirqd/00
3415828260,3sleep03415884-21ntp_states0
3409583260,3sleep03409823-21unixbench_multi0
3392781260,3sleep23394074-21cat2
3387724261,3sleep03389903-21tr0
3384891260,3sleep20-21swapper/22
3382913260,4sleep03383320-21missed_timers0
3379624260,3sleep23380756-21cut2
3345503260,1sleep20-21swapper/22
3339660261,2sleep00-21swapper/00
3325744260,3sleep23325761-21apt-get2
3317003260,3sleep23318268-21memory2
3312709260,1sleep00-21swapper/00
3306237261,2sleep03306384-21gpgv0
3302675260,4sleep23304800-21tr2
3292545260,3sleep23292632-21mailstats2
3274794260,3sleep03275139-21cut0
3238250260,3sleep03240333-21tr0
3236095260,4sleep23237081-21irqrtprio2
3235396261,3sleep2431-21dbus-daemon2
3235287260,1sleep00-21swapper/00
3228799260,1sleep00-21swapper/00
3225404261,2sleep20-21swapper/22
3210290260,3sleep03210476-21irqcore0
3202952260,1sleep00-21swapper/00
3184264261,2sleep20-21swapper/22
3183256260,4sleep03183361-21switchtime0
3175602260,3sleep03176560-21memory0
3164996261,2sleep20-21swapper/22
3163949261,3sleep23164070-21cat2
3139071261,2sleep20-21swapper/22
3114353261,2sleep20-21swapper/22
3109871260,3sleep23112048-21kthreadcore2
3086171260,1sleep20-21swapper/22
3068021261,2sleep00-21swapper/00
3060866261,2sleep20-21swapper/22
3053815261,2sleep00-21swapper/00
3468802251,1sleep20-21swapper/22
3462008250,3sleep03462154-21df0
3461559250,1sleep20-21swapper/22
3449084250,2sleep00-21swapper/00
3435882250,1sleep00-21swapper/00
3425672251,2sleep20-21swapper/22
3416417250,1sleep20-21swapper/22
3405574251,2sleep20-21swapper/22
3397717250,2sleep20-21swapper/22
3371496250,3sleep00-21swapper/00
3368022250,2sleep23370158-21kthreadcore2
3359341250,3sleep03359662-21cut0
3358445250,1sleep20-21swapper/22
3353516250,2sleep00-21swapper/00
3324900250,2sleep03324975-21ps0
3324900250,2sleep03324975-21ps0
3299554250,1sleep20-21swapper/22
3276077251,2sleep20-21swapper/22
3260896250,1sleep20-21swapper/22
3254306250,1sleep20-21swapper/22
3248469251,2sleep00-21swapper/00
3209397250,1sleep00-21swapper/00
3192158251,2sleep00-21swapper/00
3191052250,2sleep20-21swapper/22
3185723251,2sleep00-21swapper/00
3178549250,3sleep23179494-21kthreadcore2
3170902250,1sleep00-21swapper/00
3159300251,2sleep00-21swapper/00
3142154250,3sleep03144314-21cut0
3099224250,1sleep00-21swapper/00
3095181251,2sleep20-21swapper/22
3086958250,1sleep00-21swapper/00
3065367250,1sleep00-21swapper/00
3054767250,2sleep10-21swapper/11
3476324241,1sleep20-21swapper/22
3470758240,2sleep00-21swapper/00
3448915240,3sleep20-21swapper/22
3436666240,1sleep20-21swapper/22
3374650240,2sleep23376821-21kthreadcore2
3365338240,1sleep00-21swapper/00
3287623240,2sleep03288004-21irqcore0
3280811240,1sleep20-21swapper/22
3269761240,2sleep20-21swapper/22
3261524240,2sleep20-21swapper/22
3247930240,3sleep20-21swapper/22
3211458240,1sleep20-21swapper/22
3203073240,3sleep20-21swapper/22
3153817240,2sleep23155851-21kthreadcore2
3152581240,2sleep00-21swapper/00
3133112240,1sleep00-21swapper/00
3126525240,1sleep00-21swapper/00
3121744240,2sleep20-21swapper/22
3113872240,2sleep00-21swapper/00
3093468240,1sleep00-21swapper/00
3073386240,1sleep20-21swapper/22
3462232230,1sleep20-21swapper/22
3435909230,1sleep20-21swapper/22
3396227230,1sleep00-21swapper/00
3324644230,1sleep20-21swapper/22
3324644230,1sleep20-21swapper/22
3313201230,1sleep00-21swapper/00
3293943230,1sleep00-21swapper/00
3216354230,1sleep20-21swapper/22
3216317230,1sleep00-21swapper/00
3146049230,1sleep20-21swapper/22
3146049230,1sleep20-21swapper/22
3126515230,1sleep20-21swapper/22
3074482230,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional