You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 06:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Tue Apr 14, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3569725212667,54sleep30-21swapper/33
356977928566,10sleep10-21swapper/11
356980627858,14sleep00-21swapper/00
356973427860,12sleep20-21swapper/22
3570110993027,1cyclictest0-21swapper/33
3570110992725,1cyclictest0-21swapper/33
3570110992725,1cyclictest0-21swapper/33
3570110992624,1cyclictest0-21swapper/33
3570110992622,2cyclictest0-21swapper/33
3570110992622,2cyclictest0-21swapper/33
3570110992422,1cyclictest0-21swapper/33
3570110992421,1cyclictest0-21swapper/33
3570110992321,1cyclictest0-21swapper/33
3570110992321,1cyclictest0-21swapper/33
3570110992321,1cyclictest0-21swapper/33
3570110992320,1cyclictest0-21swapper/33
3570110992319,2cyclictest0-21swapper/33
3570110992314,7cyclictest0-21swapper/33
357011099226,13cyclictest0-21swapper/33
3570110992220,1cyclictest0-21swapper/33
3570110992219,1cyclictest0-21swapper/33
3570110992219,1cyclictest0-21swapper/33
3570110992218,2cyclictest0-21swapper/33
3570110992218,2cyclictest0-21swapper/33
357011099221,18cyclictest0-21swapper/33
357011099217,2cyclictest0-21swapper/33
357011099212,15cyclictest0-21swapper/33
3570110992119,1cyclictest0-21swapper/33
3570110992119,1cyclictest0-21swapper/33
3570110992119,1cyclictest0-21swapper/33
3570110992118,2cyclictest0-21swapper/33
3570110992118,1cyclictest0-21swapper/33
3570110992118,1cyclictest0-21swapper/33
3570110992117,2cyclictest0-21swapper/33
3570110992117,2cyclictest0-21swapper/33
3570110992117,2cyclictest0-21swapper/33
3570110992117,2cyclictest0-21swapper/33
357011099211,17cyclictest3786093-21taskset3
357011099210,18cyclictest0-21swapper/33
40231822201,6sleep20-21swapper/22
3570110992018,1cyclictest0-21swapper/33
3570110992018,1cyclictest0-21swapper/33
3570110992018,1cyclictest0-21swapper/33
3570110992017,1cyclictest0-21swapper/33
3570110992017,1cyclictest0-21swapper/33
3570110992016,2cyclictest0-21swapper/33
357011099201,5cyclictest3598750-21taskset3
3570110992013,3cyclictest36632172sleep33
357011099201,15cyclictest0-21swapper/33
39813732191,8sleep13701318-21diskmemload1
39193092191,2sleep00-21swapper/00
357011099195,2cyclictest0-21swapper/33
3570110991917,1cyclictest0-21swapper/33
3570110991916,1cyclictest0-21swapper/33
3570110991816,1cyclictest0-21swapper/33
3570110991816,1cyclictest0-21swapper/33
3570110991816,1cyclictest0-21swapper/33
3570110991816,1cyclictest0-21swapper/33
3570110991815,2cyclictest0-21swapper/33
3570110991815,1cyclictest0-21swapper/33
3570110991815,1cyclictest0-21swapper/33
3570110991815,1cyclictest0-21swapper/33
3570110991814,2cyclictest0-21swapper/33
3570110991814,2cyclictest0-21swapper/33
3570110991814,2cyclictest0-21swapper/33
357011099181,15cyclictest0-21swapper/33
357011099181,14cyclictest0-21swapper/33
357011099181,14cyclictest0-21swapper/33
357011099181,13cyclictest0-21swapper/33
40495452171,3sleep20-21swapper/22
40077702170,1sleep20-21swapper/22
39207832179,5sleep13920844-21/usr/sbin/munin1
38559932171,6sleep13701318-21diskmemload1
357011099174,11cyclictest0-21swapper/33
3570110991714,1cyclictest0-21swapper/33
3570110991713,2cyclictest0-21swapper/33
3570110991713,2cyclictest0-21swapper/33
357011099170,14cyclictest0-21swapper/33
39642982161,4sleep03964772-21packagekitd0
39542872161,2sleep00-21swapper/00
39542872161,2sleep00-21swapper/00
38941952161,3sleep00-21swapper/00
38582042161,2sleep00-21swapper/00
38464242161,10sleep23846467-21ntpq2
38391012161,10sleep13701318-21diskmemload1
38056032161,3sleep10-21swapper/11
37070462161,4sleep13701318-21diskmemload1
3570110991614,1cyclictest0-21swapper/33
3570110991612,3cyclictest0-21swapper/33
39904642150,2sleep20-21swapper/22
39640912152,7sleep13701318-21diskmemload1
39450732151,3sleep03701318-21diskmemload0
38738622151,9sleep13701318-21diskmemload1
38505862151,9sleep13850633-21awk1
38418452152,7sleep23841890-21munin-run2
37969572150,1sleep10-21swapper/11
37278342151,2sleep00-21swapper/00
35874902151,9sleep03587541-21ntpq0
39707172141,2sleep20-21swapper/22
39444962140,2sleep20-21swapper/22
39027562140,2sleep10-21swapper/11
38922512140,1sleep10-21swapper/11
38329402141,4sleep13832954-21ssh1
37536182140,3sleep03701318-21diskmemload0
37182282141,2sleep20-21swapper/22
40695072131,7sleep24069545-21munin-run2
40323122131,8sleep04032322-21ssh0
40323122131,8sleep04032322-21ssh0
39898902131,3sleep13989902-21ssh1
39808732131,8sleep23980885-21ssh2
39348512131,7sleep23701318-21diskmemload2
38904412131,8sleep23890689-21grep2
38845202131,3sleep13884531-21ssh1
37812952131,8sleep23782895-21cut2
37793372131,3sleep23779351-21ssh2
37705922131,3sleep00-21swapper/00
37683342131,7sleep13701318-21diskmemload1
37421242131,7sleep03701318-21diskmemload0
37003282131,6sleep13700365-21ntpq1
36912062131,9sleep03691345-21tail0
36201862131,6sleep03620240-21ntpq0
40691832121,7sleep04069193-21ssh0
40151532121,7sleep14015156-21ssh1
39384482121,6sleep13938482-21ssh1
39362192121,7sleep03701318-21diskmemload0
39161892121,6sleep13916242-21ntpq1
39128082121,7sleep23914377-21cut2
38765182121,3sleep00-21swapper/00
38596752121,7sleep03859686-21ssh0
38163342121,7sleep23817248-21cut2
37865062120,2sleep03701318-21diskmemload0
37497622121,6sleep13749806-21ssh1
37281812120,2sleep00-21swapper/00
36752092121,4sleep0171rcu_preempt0
35990272121,6sleep13599031-21apt-listchanges1
35989262120,1sleep00-21swapper/00
40689982111,6sleep13701318-21diskmemload1
40600292111,3sleep20-21swapper/22
40329472111,4sleep13701318-21diskmemload1
40329472111,4sleep13701318-21diskmemload1
40244822110,1sleep00-21swapper/00
40235172111,4sleep13701318-21diskmemload1
40149392111,3sleep00-21swapper/00
40142552111,4sleep23701318-21diskmemload2
40065922111,3sleep00-21swapper/00
39911112111,5sleep23991144-21ssh2
39471962111,5sleep13947212-21apt-get1
39471962111,5sleep13947212-21apt-get1
39032512111,7sleep13701318-21diskmemload1
38724802111,2sleep20-21swapper/22
38679282111,5sleep13701318-21diskmemload1
38675412111,3sleep20-21swapper/22
38253732111,6sleep03826844-21cut0
38230052111,4sleep13701318-21diskmemload1
38123092111,2sleep23812320-21ssh2
38049132111,4sleep23701318-21diskmemload2
37954432111,4sleep03701318-21diskmemload0
37610342111,7sleep03761047-21rm0
37354762111,3sleep13735483-21ssh1
36988502110,2sleep20-21swapper/22
36749172111,6sleep23675169-21df2
36628922111,5sleep13662941-21ntpq1
36575912111,5sleep23657644-21ntp_states2
36575402111,5sleep13657589-21ntpq1
36481102111,5sleep23648128-21apt-get2
36478232111,6sleep23647883-21sleep2
36320792111,5sleep13632337-21df_inode1
36317892110,1sleep10-21swapper/11
36002902111,5sleep13600495-21hddtemp_smartct1
35887482111,5sleep03589005-21df0
35819982111,5sleep23582089-21ntpq2
40602052101,2sleep00-21swapper/00
40566652103,3sleep1321rcuc/11
40410802101,4sleep23701318-21diskmemload2
40378132101,3sleep00-21swapper/00
40350312101,4sleep13701318-21diskmemload1
40327822101,6sleep24032796-21ssh2
40327822101,6sleep24032796-21ssh2
40064982101,4sleep13701318-21diskmemload1
39964992101,4sleep13701318-21diskmemload1
39896722101,4sleep03701318-21diskmemload0
39793882101,3sleep00-21swapper/00
39699572101,4sleep13701318-21diskmemload1
39472212101,4sleep23947493-21df_inode2
39472212101,4sleep23947493-21df_inode2
39360852101,4sleep13701318-21diskmemload1
39278092101,5sleep03927820-21sh0
39274832101,4sleep23701318-21diskmemload2
39091532101,4sleep23701318-21diskmemload2
39048842101,5sleep03906558-21grep0
39022222101,2sleep20-21swapper/22
38563632101,2sleep20-21swapper/22
38478952101,6sleep03847909-21diskmemload0
38397932100,1sleep00-21swapper/00
38250632101,4sleep23825284-21hddtemp_smartct2
38217732101,3sleep00-21swapper/00
38132592100,2sleep10-21swapper/11
38088452101,5sleep03810581-21cut0
37937442101,5sleep23793804-21ntpq2
37883282101,2sleep10-21swapper/11
37798122100,1sleep00-21swapper/00
37794792101,3sleep13701318-21diskmemload1
37596402101,3sleep20-21swapper/22
37543572101,4sleep13701318-21diskmemload1
37455802101,4sleep23701318-21diskmemload2
37434022101,4sleep13701318-21diskmemload1
37384422101,5sleep23740122-21kthreadcore2
37244702101,3sleep13701318-21diskmemload1
37165982100,6sleep13701318-21diskmemload1
37059052101,5sleep23706137-21strings2
36695532101,3sleep10-21swapper/11
36588412101,5sleep23659082-21/usr/sbin/munin2
36107602101,5sleep13610959-21cstates1
4050763291,2sleep00-21swapper/00
4043712290,3sleep13701318-21diskmemload1
3996841291,4sleep03996851-21ssh0
3960149291,4sleep23960215-21ntp_states2
3894616291,3sleep03894639-21apt-get0
3885058291,2sleep00-21swapper/00
3881659291,3sleep23701318-21diskmemload2
3805741291,2sleep00-21swapper/00
3767674291,4sleep23767943-21ssh2
3728281291,4sleep23728535-21ssh2
3724686291,3sleep23701318-21diskmemload2
3716902291,3sleep03701318-21diskmemload0
3701927291,4sleep03701940-21sh0
3696782291,4sleep03697145-21cut0
3685554291,2sleep20-21swapper/22
3662772291,3sleep03662885-21ntpq0
3653450291,4sleep03653469-21apt-get0
3626476290,5sleep23626502-21latency_hist2
3620038290,6sleep23620131-21ld2
3599992290,3sleep20-21swapper/22
3961752280,2sleep00-21swapper/00
3684297281,3sleep03684341-21ntpq0
3674568280,1sleep00-21swapper/00
3642726280,1sleep10-21swapper/11
3638264281,3sleep23639493-21kthreadcore2
3632617281,3sleep03633488-21kthreadcore0
3632338281,3sleep23632461-21fschecks_time2
3631786280,1sleep00-21swapper/00
3591670281,4sleep13592626-21missed_timers1
3576963281,3sleep13577591-21dpkg1
3695986271,3sleep13696027-21systemd-run1
3691488271,2sleep20-21swapper/22
3685263270,1sleep10-21swapper/11
3675428271,2sleep10-21swapper/11
3669047270,2sleep20-21swapper/22
3668339271,3sleep13664212-21/usr/sbin/munin1
3653131270,1sleep10-21swapper/11
3647513270,1sleep00-21swapper/00
3642144270,1sleep00-21swapper/00
3637397270,2sleep10-21swapper/11
3627736271,2sleep20-21swapper/22
3621678271,3sleep00-21swapper/00
3616363270,3sleep10-21swapper/11
3615597270,1sleep00-21swapper/00
3610155271,2sleep10-21swapper/11
3610155271,2sleep10-21swapper/11
3606563271,3sleep23608297-21kthreadcore2
3606563271,3sleep23608297-21kthreadcore2
3597025271,3sleep23597965-21sed2
3588374270,1sleep10-21swapper/11
3575585271,3sleep00-21swapper/00
3575166270,2sleep10-21swapper/11
3575022270,1sleep20-21swapper/22
3680229260,1sleep20-21swapper/22
3664816261,2sleep00-21swapper/00
3625319260,2sleep10-21swapper/11
3610181260,1sleep00-21swapper/00
3610181260,1sleep00-21swapper/00
3601744261,2sleep00-21swapper/00
3588724260,1sleep20-21swapper/22
3571238261,2sleep00-21swapper/00
3685829250,2sleep00-21swapper/00
3685540250,1sleep10-21swapper/11
3673661250,2sleep20-21swapper/22
3648393250,1sleep00-21swapper/00
3588252250,3sleep20-21swapper/22
3610960240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional