You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 13:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Tue Jun 02, 2026 00:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2245793213563,67sleep30-21swapper/33
224555728353,10sleep20-21swapper/22
224357128353,7sleep00-21swapper/00
224107727557,10sleep10-21swapper/11
26522832340,2sleep30-21swapper/33
224589499231,19cyclictest2246113-21chrt3
2245894992211,8cyclictest0-21swapper/33
224589499221,18cyclictest0-21swapper/33
224589499221,17cyclictest2296474-21taskset3
224589499211,17cyclictest0-21swapper/33
224589499211,16cyclictest2499301-21taskset3
224589499211,16cyclictest0-21swapper/33
2245894992012,5cyclictest0-21swapper/33
224589499201,16cyclictest0-21swapper/33
224589499201,15cyclictest0-21swapper/33
26412512191,4sleep02642521-21tr0
224589499192,12cyclictest2605076-21taskset3
224589499192,12cyclictest2407958-21taskset3
2245894991916,1cyclictest0-21swapper/33
2245894991916,1cyclictest0-21swapper/33
2245894991916,1cyclictest0-21swapper/33
224589499191,15cyclictest0-21swapper/33
224589499191,15cyclictest0-21swapper/33
224589499191,14cyclictest0-21swapper/33
224589499191,14cyclictest0-21swapper/33
224589499191,14cyclictest0-21swapper/33
224589499191,14cyclictest0-21swapper/33
224589499191,14cyclictest0-21swapper/33
224589499191,14cyclictest0-21swapper/33
224589499191,14cyclictest0-21swapper/33
224589499191,14cyclictest0-21swapper/33
224589499190,17cyclictest0-21swapper/33
26724992181,4sleep02376996-21diskmemload0
25854502181,4sleep02376996-21diskmemload0
25072282181,5sleep10-21swapper/11
23167782181,5sleep12316829-21ntpq1
224589499189,6cyclictest2333828-21turbostat3
224589499183,13cyclictest66950irq/132-enp1s0-TxRx-33
2245894991814,3cyclictest66950irq/132-enp1s0-TxRx-33
2245894991814,3cyclictest66950irq/132-enp1s0-TxRx-33
2245894991814,3cyclictest66950irq/132-enp1s0-TxRx-33
2245894991814,3cyclictest0-21swapper/33
2245894991812,3cyclictest0-21swapper/33
224589499181,1cyclictest0-21swapper/33
224589499181,14cyclictest0-21swapper/33
224589499181,14cyclictest0-21swapper/33
224589499181,14cyclictest0-21swapper/33
224589499181,14cyclictest0-21swapper/33
224589499181,14cyclictest0-21swapper/33
224589499181,13cyclictest0-21swapper/33
224589499181,13cyclictest0-21swapper/33
224589499181,13cyclictest0-21swapper/33
224589499180,15cyclictest66950irq/132-enp1s0-TxRx-33
224589499180,15cyclictest0-21swapper/33
27091962170,1sleep00-21swapper/00
24326292171,11sleep12434285-21cat1
24033632171,4sleep10-21swapper/11
224589499176,9cyclictest2728662-21turbostat3
224589499171,14cyclictest0-21swapper/33
224589499171,14cyclictest0-21swapper/33
224589499171,13cyclictest0-21swapper/33
224589499171,13cyclictest0-21swapper/33
224589499171,13cyclictest0-21swapper/33
224589499171,13cyclictest0-21swapper/33
224589499171,12cyclictest0-21swapper/33
224589499170,14cyclictest0-21swapper/33
224589499170,14cyclictest0-21swapper/33
27453202161,7sleep22376996-21diskmemload2
27186842161,2sleep20-21swapper/22
26402342162,10sleep12640332-21latency_hist1
26402342162,10sleep12640332-21latency_hist1
26173492161,8sleep22618418-21memory2
26033622161,3sleep10-21swapper/11
25759532161,10sleep02376996-21diskmemload0
25586262161,3sleep00-21swapper/00
25586262161,3sleep00-21swapper/00
25529472162,9sleep12553211-21df1
25529472162,9sleep12553211-21df1
25421732162,3sleep12376996-21diskmemload1
224589499162,3cyclictest0-21swapper/33
224589499161,6cyclictest2366381-21turbostat3
224589499161,12cyclictest2361040-21turbostat3
224589499161,12cyclictest0-21swapper/33
224589499160,13cyclictest0-21swapper/33
224589499160,13cyclictest0-21swapper/33
224589499160,13cyclictest0-21swapper/33
26941582150,1sleep20-21swapper/22
25703922151,9sleep12570656-21df1
25493812151,2sleep00-21swapper/00
25240892151,4sleep12376996-21diskmemload1
24991392151,4sleep22376996-21diskmemload2
24982652151,2sleep00-21swapper/00
24528892151,2sleep20-21swapper/22
24463302151,8sleep22376996-21diskmemload2
24281382151,8sleep12376996-21diskmemload1
23114032151,4sleep12311492-21ntpq1
22689632151,5sleep02269198-21/usr/sbin/munin0
224589499151,12cyclictest0-21swapper/33
224589499150,13cyclictest0-21swapper/33
224589499150,12cyclictest0-21swapper/33
224589499150,12cyclictest0-21swapper/33
224589499150,12cyclictest0-21swapper/33
224589499150,12cyclictest0-21swapper/33
224589499150,12cyclictest0-21swapper/33
26906442141,2sleep20-21swapper/22
26841922141,3sleep12376996-21diskmemload1
25332992141,7sleep12376996-21diskmemload1
24825762141,9sleep02482587-21ssh0
24694632141,9sleep02469524-21ntpq0
24078272141,6sleep22407951-21ntpq2
24040912141,2sleep10-21swapper/11
24012862141,4sleep22401297-21ssh2
23654012141,4sleep12365457-21ntpq1
224589499140,11cyclictest0-21swapper/33
27346302131,4sleep02734644-21ssh0
27116272131,7sleep12711847-21df1
26575652131,7sleep12657579-21ssh1
26224962131,7sleep12376996-21diskmemload1
26133242131,7sleep02376996-21diskmemload0
26057012131,6sleep12605916-21diskstats1
26049432131,6sleep22605038-21munin-run2
25864732131,4sleep12586484-21ssh1
25051442131,7sleep02376996-21diskmemload0
24822872131,3sleep02482301-21ssh0
24739512131,5sleep12473986-21ssh1
23827362131,8sleep12382748-21ssh1
23381222131,6sleep22338159-21ntpq2
27427112121,5sleep00-21swapper/00
27274112121,7sleep02376996-21diskmemload0
27098772120,1sleep20-21swapper/22
26626682121,6sleep02662734-21ntpq0
25862852121,7sleep22586299-21ssh2
25433592120,2sleep22543370-21ssh2
25160022121,6sleep22376996-21diskmemload2
25139332121,7sleep12513944-21ssh1
25088432121,5sleep02376996-21diskmemload0
24905962125,3sleep244-21ksoftirqd/22
24655642121,6sleep12465783-21hddtemp_smartct1
24643642121,7sleep22464375-21ssh2
24643642121,7sleep22464375-21ssh2
24310452121,7sleep02432628-21grep0
24302642121,5sleep20-21swapper/22
23992202122,4sleep02399273-21ntpq0
23925172121,8sleep12392531-21ssh1
23547472121,6sleep12354796-21ntpq1
27353092111,7sleep22735320-21ssh2
27338852110,1sleep10-21swapper/11
27165402111,4sleep02376996-21diskmemload0
26896262111,6sleep12685014-21/usr/sbin/munin1
26536602111,5sleep22653720-21ntpq2
26388042110,1sleep00-21swapper/00
26388042110,1sleep00-21swapper/00
26297012110,1sleep00-21swapper/00
26296232111,6sleep22629633-21ssh2
26083912111,5sleep22609638-21memory2
25516342111,5sleep22376996-21diskmemload2
25309662111,3sleep22531209-21unixbench_multi2
24731162110,6sleep20-21swapper/22
24630002110,5sleep10-21swapper/11
24630002110,5sleep10-21swapper/11
24450522111,2sleep12445063-21ssh1
23759342111,5sleep02375982-21ntpq0
23453132112,4sleep12345332-21apt-get1
23221522111,4sleep12322199-21ntpq1
22955972111,5sleep02295634-21ntpq0
22848752111,5sleep02284922-21ntpq0
22805662110,7sleep02280656-21date0
22749482111,6sleep22275216-21apt-key2
22693502110,1sleep10-21swapper/11
22686102111,5sleep22268664-21ntpq2
27279692101,3sleep10-21swapper/11
27265252100,2sleep20-21swapper/22
26908672101,4sleep02376996-21diskmemload0
26804572101,4sleep02680508-21ntpq0
26558962101,2sleep00-21swapper/00
26460452101,4sleep12376996-21diskmemload1
26380302101,3sleep20-21swapper/22
26380302101,3sleep20-21swapper/22
26142762101,3sleep02376996-21diskmemload0
25945582101,3sleep20-21swapper/22
25729052101,6sleep22574386-21/usr/sbin/munin2
25687632101,3sleep20-21swapper/22
25675902101,3sleep12376996-21diskmemload1
25351222101,3sleep02376996-21diskmemload0
25338492100,1sleep00-21swapper/00
25236692101,4sleep02376996-21diskmemload0
25176752101,4sleep22517943-21df_inode2
25064332101,4sleep20-21swapper/22
24901302101,3sleep10-21swapper/11
24797892100,2sleep20-21swapper/22
24560062101,3sleep12376996-21diskmemload1
24551872101,4sleep02376996-21diskmemload0
24212292101,3sleep00-21swapper/00
24211472100,6sleep22376996-21diskmemload2
24173972101,4sleep02376996-21diskmemload0
24100682100,2sleep00-21swapper/00
23915292100,6sleep02376996-21diskmemload0
23826952101,3sleep20-21swapper/22
23818942101,4sleep02376996-21diskmemload0
23653462101,5sleep02365393-21ntpq0
23600822101,4sleep22360135-21ntp_states2
23547022100,7sleep02354739-21ntpq0
23396792101,4sleep12339698-21apt-get1
23234552101,4sleep02323474-21apt-get0
23050292101,5sleep22306016-21memory2
23021572101,4sleep12302412-21df1
22795192101,4sleep12279567-21ntpq1
22614692101,6sleep10-21swapper/11
2743429291,3sleep12376996-21diskmemload1
2708156291,2sleep10-21swapper/11
2699164291,3sleep00-21swapper/00
2680854291,3sleep22376996-21diskmemload2
2674057290,1sleep10-21swapper/11
2671667291,3sleep22671696-21ntpq2
2663374291,2sleep10-21swapper/11
2658356291,4sleep22658368-21rm2
2646005291,4sleep22646017-21sh2
2631330291,3sleep12376996-21diskmemload1
2603301291,3sleep00-21swapper/00
2587873291,2sleep00-21swapper/00
2568784291,2sleep00-21swapper/00
2561128291,2sleep20-21swapper/22
2561128291,2sleep20-21swapper/22
2549598291,3sleep12376996-21diskmemload1
2497520291,3sleep12376996-21diskmemload1
2461679291,3sleep02376996-21diskmemload0
2461679291,3sleep02376996-21diskmemload0
2444333291,2sleep00-21swapper/00
2418920291,3sleep12376996-21diskmemload1
2418429290,1sleep20-21swapper/22
2391556290,1sleep20-21swapper/22
2373909291,4sleep22375745-21cut2
2368527290,6sleep12370356-21cut1
2368527290,6sleep12370356-21cut1
2361025291,4sleep12361055-21perf1
2355979291,3sleep02355998-21apt-get0
2344917291,3sleep22344767-21apt-get2
2329345291,4sleep12330965-21cut1
2328742291,3sleep02328761-21apt-get0
2316836291,4sleep22316886-21ntpq2
2307437291,3sleep22307455-21apt-get2
2302684290,6sleep02303300-21kthreadcore0
2290232291,4sleep12290278-21ntpq1
2281967291,4sleep12283673-21grep1
2253518291,4sleep02253756-21expr0
2250534291,4sleep02250718-21cat0
2699527281,3sleep12699542-21ssh1
2587830281,2sleep10-21swapper/11
2376693280,1sleep10-21swapper/11
2344631280,1sleep20-21swapper/22
2338448281,4sleep02338614-21timerwakeupswit0
2319119281,3sleep22320840-21tr2
2285884280,2sleep20-21swapper/22
2270427281,4sleep12270912-21kthreadcore1
2259828281,3sleep02261467-21kthreadcore0
2258087280,1sleep20-21swapper/22
2257928281,3sleep12258084-21timerwakeupswit1
2370815270,3sleep22370927-21ps2
2370815270,3sleep22370927-21ps2
2338795270,1sleep10-21swapper/11
2312215270,1sleep00-21swapper/00
2290926270,1sleep00-21swapper/00
2279841270,4sleep20-21swapper/22
2251208270,2sleep20-21swapper/22
2250353271,2sleep12246091-21/usr/sbin/munin1
2366167260,1sleep20-21swapper/22
2349057260,2sleep02349341-21strings0
2344735260,1sleep00-21swapper/00
2330966261,2sleep20-21swapper/22
2301722260,1sleep00-21swapper/00
2296802260,1sleep10-21swapper/11
2296378260,4sleep10-21swapper/11
2371446250,1sleep00-21swapper/00
2371446250,1sleep00-21swapper/00
2353476250,1sleep20-21swapper/22
2327514251,1sleep10-21swapper/11
2313054250,1sleep00-21swapper/00
2296587250,1sleep20-21swapper/22
2291981250,1sleep20-21swapper/22
2291109250,3sleep20-21swapper/22
2259155250,1sleep20-21swapper/22
2323736240,1sleep20-21swapper/22
2318406240,1sleep00-21swapper/00
2270207240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional