You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-22 - 20:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Mon Jun 22, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
284221222950,5sleep12842182-21ssh1
284221222950,5sleep12842182-21ssh1
2425950212153,63sleep30-21swapper/33
279600721140,2sleep10-21swapper/11
242605428468,10sleep20-21swapper/22
242622328352,10sleep10-21swapper/11
242608627856,14sleep00-21swapper/00
26946792350,2sleep00-21swapper/00
25386512320,1sleep30-21swapper/33
2426419992211,8cyclictest2554158-21taskset3
277763222113,2sleep20-21swapper/22
2426419992111,6cyclictest2702214-21taskset3
2426419992016,2cyclictest0-21swapper/33
242641999201,16cyclictest0-21swapper/33
242641999201,15cyclictest0-21swapper/33
242641999201,15cyclictest0-21swapper/33
242641999192,12cyclictest2788047-21taskset3
2426419991916,2cyclictest0-21swapper/33
2426419991916,1cyclictest0-21swapper/33
2426419991916,1cyclictest0-21swapper/33
2426419991914,2cyclictest0-21swapper/33
2426419991913,3cyclictest66950irq/132-enp1s0-TxRx-33
242641999191,14cyclictest0-21swapper/33
242641999191,14cyclictest0-21swapper/33
242641999191,14cyclictest0-21swapper/33
242641999191,12cyclictest0-21swapper/33
2426419991910,5cyclictest2648549-21taskset3
2426419991910,5cyclictest2648549-21taskset3
27760382182,4sleep02554178-21diskmemload0
27110312181,3sleep20-21swapper/22
26785322181,3sleep20-21swapper/22
242641999186,1cyclictest0-21swapper/33
242641999182,10cyclictest2771625-21taskset3
2426419991814,2cyclictest0-21swapper/33
2426419991814,2cyclictest0-21swapper/33
2426419991814,2cyclictest0-21swapper/33
2426419991813,2cyclictest0-21swapper/33
2426419991812,4cyclictest0-21swapper/33
242641999181,14cyclictest66950irq/132-enp1s0-TxRx-33
242641999181,14cyclictest66950irq/132-enp1s0-TxRx-33
242641999181,14cyclictest66950irq/132-enp1s0-TxRx-33
242641999181,14cyclictest0-21swapper/33
242641999181,14cyclictest0-21swapper/33
242641999181,14cyclictest0-21swapper/33
242641999181,14cyclictest0-21swapper/33
242641999181,13cyclictest0-21swapper/33
242641999181,13cyclictest0-21swapper/33
242641999180,15cyclictest0-21swapper/33
242641999180,14cyclictest0-21swapper/33
242641999180,14cyclictest0-21swapper/33
28204682170,11sleep20-21swapper/22
27966102170,8sleep02554178-21diskmemload0
27361792171,2sleep20-21swapper/22
27194722171,2sleep00-21swapper/00
26794812171,11sleep02679516-21ssh0
242641999177,6cyclictest2543691-21turbostat3
242641999176,8cyclictest2517484-21turbostat3
242641999173,11cyclictest0-21swapper/33
242641999171,4cyclictest0-21swapper/33
242641999171,3cyclictest2454200-21taskset3
2426419991713,2cyclictest0-21swapper/33
2426419991713,2cyclictest0-21swapper/33
242641999171,13cyclictest0-21swapper/33
242641999171,13cyclictest0-21swapper/33
242641999171,13cyclictest0-21swapper/33
242641999171,13cyclictest0-21swapper/33
242641999171,13cyclictest0-21swapper/33
242641999171,13cyclictest0-21swapper/33
242641999171,13cyclictest0-21swapper/33
242641999171,13cyclictest0-21swapper/33
242641999171,13cyclictest0-21swapper/33
242641999170,14cyclictest0-21swapper/33
28348742168,4sleep12834885-21sh1
28348742168,4sleep12834885-21sh1
28348372161,2sleep22554178-21diskmemload2
28348372161,2sleep22554178-21diskmemload2
28102892161,10sleep22554178-21diskmemload2
27846142161,10sleep12554178-21diskmemload1
27838512161,11sleep22783930-21grep2
27463682162,9sleep22746371-21apt-get2
27441362161,2sleep10-21swapper/11
26784412161,3sleep10-21swapper/11
26699582161,3sleep10-21swapper/11
26526162161,2sleep00-21swapper/00
26526162161,2sleep00-21swapper/00
25866242161,2sleep20-21swapper/22
2426419991613,1cyclictest0-21swapper/33
242641999161,12cyclictest0-21swapper/33
242641999161,12cyclictest0-21swapper/33
2426419991610,3cyclictest2457557-21taskset3
242641999160,12cyclictest0-21swapper/33
28787702151,3sleep02554178-21diskmemload0
28209992150,3sleep10-21swapper/11
27028062151,3sleep10-21swapper/11
24763182151,8sleep22476389-21irqstats2
242641999158,5cyclictest2496533-21turbostat3
242641999158,5cyclictest2496533-21turbostat3
242641999158,4cyclictest2470338-21turbostat3
242641999157,5cyclictest24432592sleep33
242641999151,2cyclictest0-21swapper/33
2426419991512,1cyclictest0-21swapper/33
242641999150,12cyclictest0-21swapper/33
242641999150,12cyclictest0-21swapper/33
28963202141,8sleep02896394-21ls0
28955622140,2sleep0221rcuc/00
28919102141,3sleep22892060-21ntp_192.168.1142
28855462142,8sleep12885544-21apt-get1
28670272141,8sleep02867177-21switchtime0
28364802141,2sleep00-21swapper/00
28364802141,2sleep00-21swapper/00
28123002140,1sleep00-21swapper/00
27946042140,3sleep22554178-21diskmemload2
27685972141,9sleep12768611-21ssh1
27413152142,2sleep2171rcu_preempt2
26462442142,6sleep12554178-21diskmemload1
26462442142,6sleep12554178-21diskmemload1
26361462141,3sleep02554178-21diskmemload0
25599152141,3sleep02554178-21diskmemload0
242641999143,7cyclictest0-21swapper/33
242641999140,11cyclictest0-21swapper/33
28771992130,2sleep12554178-21diskmemload1
28513402131,8sleep12851351-21ssh1
27034152131,7sleep02554178-21diskmemload0
26770652131,1sleep00-21swapper/00
26695462131,8sleep02554178-21diskmemload0
26437672131,4sleep12643781-21ssh1
26366612131,3sleep12636671-21ssh1
26058822131,3sleep02554178-21diskmemload0
26046492130,2sleep20-21swapper/22
25376812131,8sleep02537832-21ls0
24316382131,7sleep02432008-21users0
28823802121,5sleep22883406-21memory2
28675092120,2sleep10-21swapper/11
27275102121,7sleep22554178-21diskmemload2
27239922121,6sleep02725185-21memory0
27207312121,7sleep2106713-21snmpd2
27189632120,3sleep12718977-21ssh1
26940962121,6sleep22554178-21diskmemload2
26846322121,7sleep22684642-21ssh2
26609272121,6sleep12554178-21diskmemload1
26456152121,6sleep02554178-21diskmemload0
26096812121,7sleep12609692-21ssh1
26024502121,3sleep02602461-21ssh0
25708572121,7sleep12571147-21ssh1
25282752121,7sleep02528403-21grep0
24754092121,4sleep00-21swapper/00
24495772121,5sleep22449596-21apt-get2
24320092121,7sleep12433169-21grep1
24267562121,5sleep12426879-21diskstats1
28963952110,2sleep10-21swapper/11
28940632112,6sleep10-21swapper/11
28862012111,6sleep02886204-21ssh0
28627442112,4sleep22862746-21apt-get2
28615722111,3sleep20-21swapper/22
28448732111,5sleep00-21swapper/00
28448732111,5sleep00-21swapper/00
28190802111,4sleep02554178-21diskmemload0
28182782111,4sleep12554178-21diskmemload1
27688312110,5sleep00-21swapper/00
27611102111,5sleep22554178-21diskmemload2
27102902110,6sleep02710302-21ssh0
26700022111,4sleep22554178-21diskmemload2
26345542112,4sleep22554178-21diskmemload2
25863272110,1sleep10-21swapper/11
25768102110,6sleep02554178-21diskmemload0
25381162112,6sleep2106713-21snmpd2
24800612112,5sleep12480302-21grep1
24759042110,2sleep00-21swapper/00
24699882111,3sleep272-21kcompactd02
24650912111,5sleep02465147-21munin-run0
24496042111,5sleep00-21swapper/00
24492742111,4sleep02449344-21munin-run0
29027502101,3sleep22554178-21diskmemload2
28711532102,4sleep20-21swapper/22
28544402101,4sleep02854708-21df_inode0
28510922101,4sleep02554178-21diskmemload0
28475782101,5sleep22849047-21ssh2
28272352100,1sleep00-21swapper/00
28210112101,3sleep22554178-21diskmemload2
28097142101,4sleep12554178-21diskmemload1
28010992100,2sleep20-21swapper/22
27935292101,4sleep02554178-21diskmemload0
27847492101,4sleep02554178-21diskmemload0
27632372102,4sleep20-21swapper/22
27608092101,5sleep12760820-21ssh1
27540632100,2sleep10-21swapper/11
27436102101,4sleep02554178-21diskmemload0
27357522101,3sleep10-21swapper/11
27268372100,1sleep10-21swapper/11
27098752101,2sleep10-21swapper/11
27022512101,4sleep22554178-21diskmemload2
26950792101,1sleep10-21swapper/11
26530562100,1sleep20-21swapper/22
26530562100,1sleep20-21swapper/22
26290962101,3sleep10-21swapper/11
26191312101,4sleep12554178-21diskmemload1
26182812100,1sleep00-21swapper/00
26037032101,5sleep22603713-21ssh2
26024622101,4sleep12554178-21diskmemload1
25939842100,1sleep00-21swapper/00
25712392101,3sleep22571265-21apt-get2
25700972101,3sleep12554178-21diskmemload1
25686692101,3sleep20-21swapper/22
25629122101,4sleep02562939-21apt-get0
25612492101,3sleep22554178-21diskmemload2
25596442101,4sleep12554178-21diskmemload1
25324082101,5sleep12532549-21switchtime1
24443252101,4sleep22444580-21df2
24397752101,5sleep22441387-21kthreadcore2
2854328290,1sleep10-21swapper/11
2842720291,2sleep20-21swapper/22
2842720291,2sleep20-21swapper/22
2796007290,1sleep10-21swapper/11
2776344291,2sleep10-21swapper/11
2759549291,2sleep00-21swapper/00
2750637291,4sleep02750722-21cat0
2735740290,1sleep00-21swapper/00
2684277291,2sleep10-21swapper/11
2660102290,4sleep02554178-21diskmemload0
2659399291,4sleep22554178-21diskmemload2
2642660291,2sleep20-21swapper/22
2626454290,3sleep00-21swapper/00
2626292290,1sleep20-21swapper/22
2619733290,1sleep20-21swapper/22
2594151291,3sleep22554178-21diskmemload2
2592868291,2sleep10-21swapper/11
2584746291,4sleep02584756-21ssh0
2548930291,4sleep02549176-21cut0
2539231291,5sleep10-21swapper/11
2528544291,4sleep22528754-21smartctl2
2517467292,3sleep22517492-21latency_hist2
2507300291,2sleep00-21swapper/00
2485684290,3sleep272-21kcompactd02
2475545291,4sleep22475610-21wc2
2472967290,1sleep10-21swapper/11
2455387291,4sleep12455891-21grep1
2454860290,1sleep20-21swapper/22
2438795290,5sleep20-21swapper/22
2524740281,3sleep10-21swapper/11
2523590281,3sleep00-21swapper/00
2522564280,1sleep00-21swapper/00
2497358281,3sleep12498404-21kthreadcore1
2496286280,2sleep10-21swapper/11
2496286280,2sleep10-21swapper/11
2491578281,2sleep00-21swapper/00
2491578281,2sleep00-21swapper/00
2487477281,3sleep12489144-21cut1
2486016281,3sleep01-21systemd0
2481053280,2sleep10-21swapper/11
2465384280,3sleep12465381-21apt-get1
2459607280,1sleep00-21swapper/00
2444849281,3sleep12445370-21kthreadcore1
2439089280,2sleep10-21swapper/11
2553012270,2sleep22553185-21strings2
2549222271,3sleep02549455-21cstates0
2539417271,2sleep20-21swapper/22
2523308271,3sleep20-21swapper/22
2518309271,3sleep20-21swapper/22
2517737270,2sleep10-21swapper/11
2512219270,4sleep20-21swapper/22
2512004270,1sleep10-21swapper/11
2506805270,1sleep20-21swapper/22
2503402271,2sleep10-21swapper/11
2501672271,4sleep2431ktimers/22
2491839270,3sleep20-21swapper/22
2491839270,3sleep20-21swapper/22
2486338270,2sleep00-21swapper/00
2465362270,2sleep00-21swapper/00
2462612270,1sleep10-21swapper/11
2454501270,1sleep10-21swapper/11
2443843270,1sleep00-21swapper/00
2427163271,3sleep02428503-21kthreadcore0
2545379261,2sleep20-21swapper/22
2544534261,2sleep12545376-21kthreadcore1
2543382260,1sleep00-21swapper/00
2538336260,1sleep10-21swapper/11
2514395260,3sleep00-21swapper/00
2507013261,1sleep00-21swapper/00
2496787260,2sleep00-21swapper/00
2490928260,1sleep20-21swapper/22
2460124261,2sleep20-21swapper/22
2430255260,2sleep22430604-21strings2
2549456250,1sleep10-21swapper/11
2517194250,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional