You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 12:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat Jun 20, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
299104123720,1sleep172-21kcompactd01
2796920212952,69sleep30-21swapper/33
279700928451,11sleep20-21swapper/22
279719728156,17sleep00-21swapper/00
279718328163,12sleep10-21swapper/11
32532282480,2sleep30-21swapper/33
2797407992111,7cyclictest0-21swapper/33
279740799201,7cyclictest2948813-21taskset3
2797407992017,1cyclictest0-21swapper/33
279740799201,16cyclictest0-21swapper/33
279740799201,14cyclictest3212368-21chrt3
279740799201,13cyclictest3262910-21chrt3
279740799200,17cyclictest0-21swapper/33
279740799192,13cyclictest3010011-21chrt3
2797407991915,2cyclictest0-21swapper/33
279740799191,15cyclictest0-21swapper/33
279740799191,15cyclictest0-21swapper/33
279740799191,14cyclictest0-21swapper/33
279740799191,14cyclictest0-21swapper/33
279740799191,14cyclictest0-21swapper/33
279740799191,14cyclictest0-21swapper/33
279740799191,14cyclictest0-21swapper/33
279740799191,14cyclictest0-21swapper/33
279740799191,13cyclictest0-21swapper/33
32439512181,4sleep13243962-21ssh1
32006342181,5sleep00-21swapper/00
31991062181,2sleep20-21swapper/22
29652612181,2sleep10-21swapper/11
29258442182,5sleep22925840-21apt-get2
279740799189,6cyclictest3134767-21turbostat3
279740799187,8cyclictest2888634-21turbostat3
2797407991814,2cyclictest0-21swapper/33
2797407991812,3cyclictest0-21swapper/33
279740799181,14cyclictest0-21swapper/33
279740799181,14cyclictest0-21swapper/33
279740799181,14cyclictest0-21swapper/33
279740799181,14cyclictest0-21swapper/33
279740799181,14cyclictest0-21swapper/33
279740799181,14cyclictest0-21swapper/33
279740799181,14cyclictest0-21swapper/33
279740799181,13cyclictest0-21swapper/33
279740799181,13cyclictest0-21swapper/33
279740799181,13cyclictest0-21swapper/33
279740799180,14cyclictest2841410-21turbostat3
279740799180,14cyclictest0-21swapper/33
31165882171,11sleep12925445-21diskmemload1
30647862171,3sleep10-21swapper/11
30077212171,2sleep10-21swapper/11
279740799174,10cyclictest0-21swapper/33
2797407991711,3cyclictest0-21swapper/33
279740799171,13cyclictest0-21swapper/33
279740799171,13cyclictest0-21swapper/33
279740799171,13cyclictest0-21swapper/33
279740799171,13cyclictest0-21swapper/33
279740799171,13cyclictest0-21swapper/33
279740799171,13cyclictest0-21swapper/33
279740799171,12cyclictest0-21swapper/33
279740799171,12cyclictest0-21swapper/33
279740799170,14cyclictest0-21swapper/33
279740799170,14cyclictest0-21swapper/33
279740799170,13cyclictest0-21swapper/33
32357382161,3sleep00-21swapper/00
32175392160,2sleep20-21swapper/22
31798662160,10sleep13180949-21/usr/sbin/munin1
31572752160,1sleep00-21swapper/00
30438372161,11sleep23044611-21kthreadcore2
28154672161,5sleep12815464-21apt-get1
279740799167,6cyclictest2825663-21turbostat3
279740799161,3cyclictest0-21swapper/33
2797407991613,2cyclictest0-21swapper/33
279740799161,12cyclictest0-21swapper/33
279740799160,13cyclictest0-21swapper/33
279740799160,13cyclictest0-21swapper/33
279740799160,13cyclictest0-21swapper/33
31487362151,9sleep02925445-21diskmemload0
30984212151,3sleep02925445-21diskmemload0
30645962151,3sleep02925445-21diskmemload0
30329702150,1sleep20-21swapper/22
29511672151,10sleep12951181-21ssh1
29491722151,9sleep10-21swapper/11
279740799151,5cyclictest29093992sleep33
2797407991512,2cyclictest0-21swapper/33
279740799151,1cyclictest0-21swapper/33
279740799151,12cyclictest0-21swapper/33
279740799151,11cyclictest28942122sleep33
279740799150,13cyclictest0-21swapper/33
279740799150,13cyclictest0-21swapper/33
279740799150,12cyclictest0-21swapper/33
279740799150,12cyclictest0-21swapper/33
31762382141,9sleep02925445-21diskmemload0
30927642141,4sleep23092778-21ssh2
30171912141,2sleep10-21swapper/11
29651132141,8sleep22925445-21diskmemload2
279740799148,3cyclictest2814973-21chrt3
32630672132,6sleep03263193-21diskstats0
32496192131,8sleep03250019-21sed0
32434572131,2sleep20-21swapper/22
32358012130,3sleep12925445-21diskmemload1
31900732131,8sleep13190084-21ssh1
31832392131,8sleep03183249-21ssh0
31824402131,3sleep23182451-21ssh2
31586102131,7sleep22925445-21diskmemload2
30902812131,4sleep13090295-21ssh1
30743262131,8sleep03074338-21ssh0
30652872130,3sleep23065298-21ssh2
30424412131,3sleep23042453-21ssh2
30244392131,6sleep02925445-21diskmemload0
29997702131,7sleep02925445-21diskmemload0
29978372131,3sleep12925445-21diskmemload1
29752062131,7sleep10-21swapper/11
29738342130,2sleep20-21swapper/22
29481982131,8sleep02925445-21diskmemload0
28077192131,7sleep02808814-21memory0
279740799131,8cyclictest2818372-21taskset3
32679322121,7sleep22925445-21diskmemload2
32615822121,7sleep03261592-21ssh0
32526382121,6sleep23252650-21ssh2
32451342121,2sleep00-21swapper/00
32279602120,8sleep13227971-21ssh1
31925172121,5sleep00-21swapper/00
31906982120,2sleep20-21swapper/22
31601012121,6sleep03160125-21apt-get0
31318162121,6sleep22925445-21diskmemload2
31189362121,7sleep23119081-21cat2
31096372121,7sleep13109789-21cat1
30687942121,6sleep13069365-21grep1
30498912120,3sleep00-21swapper/00
30170352121,7sleep03017045-21ssh0
30015492121,7sleep03001553-21apt-get0
29587042121,6sleep22958711-21modprobe2
29420872121,6sleep22925445-21diskmemload2
29413032121,7sleep12941313-21ssh1
29309412121,7sleep02930951-21ssh0
29052292121,7sleep12905545-21grep1
28991922121,5sleep02899248-21munin-run0
28831562120,1sleep00-21swapper/00
28731692120,5sleep12873188-21apt-get1
28561492121,6sleep12856219-21ntp_states1
28518622121,7sleep22851937-21systemd-run2
28360922120,1sleep10-21swapper/11
28245332120,4sleep20-21swapper/22
32699062112,4sleep12925445-21diskmemload1
32232962111,6sleep03224877-21wc0
32173772111,5sleep02925445-21diskmemload0
32172982111,2sleep10-21swapper/11
32085632111,5sleep02925445-21diskmemload0
32073292111,3sleep20-21swapper/22
31649222111,6sleep12925445-21diskmemload1
31579602111,3sleep10-21swapper/11
31488532111,4sleep22925445-21diskmemload2
30837562111,4sleep12925445-21diskmemload1
30594512111,5sleep03059710-21ssh0
30581772111,6sleep13058190-21ssh1
30432202111,5sleep13043246-21apt-get1
30245602111,6sleep13024574-21ssh1
30153782111,4sleep22925445-21diskmemload2
30004812111,6sleep22925445-21diskmemload2
29812112110,1sleep20-21swapper/22
29686732115,3sleep0151ktimers/00
29560102111,6sleep02925445-21diskmemload0
29493602111,4sleep22925445-21diskmemload2
29326802110,2sleep10-21swapper/11
29055472111,6sleep22907158-21kthreadcore2
28630952111,5sleep22863200-21irqstats2
28359232110,1sleep00-21swapper/00
28198552111,5sleep02820040-21users0
32760762101,3sleep02925445-21diskmemload0
32600502101,3sleep22925445-21diskmemload2
32516932101,4sleep12925445-21diskmemload1
32343152100,2sleep20-21swapper/22
32214992101,5sleep23221760-21cut2
32090482101,2sleep10-21swapper/11
31936692101,4sleep13193890-21df_inode1
31754882100,1sleep20-21swapper/22
31658432100,1sleep20-21swapper/22
31434532101,4sleep13143465-21ssh1
31431222101,5sleep03143173-21perf0
31424262101,3sleep10-21swapper/11
31328892101,4sleep12925445-21diskmemload1
31253252100,6sleep13125336-21ssh1
31240642100,1sleep00-21swapper/00
31160522101,4sleep03116066-21ssh0
31083312101,2sleep20-21swapper/22
31016012100,6sleep00-21swapper/00
30994482101,3sleep20-21swapper/22
30933452101,3sleep10-21swapper/11
30529022102,4sleep23054497-21cut2
30393152101,5sleep13039521-21grep1
30339612101,4sleep12925445-21diskmemload1
30093792101,3sleep22925445-21diskmemload2
29814892102,3sleep12925445-21diskmemload1
29673002101,3sleep00-21swapper/00
29244702101,4sleep02924540-21ntp_states0
28943192101,4sleep22894503-21diskstats2
28627172101,4sleep02862920-21diskstats0
28573862101,3sleep00-21swapper/00
28533702101,3sleep20-21swapper/22
28151712101,4sleep12815213-21basename1
28104892101,4sleep02810698-21hddtemp_smartct0
28029432101,5sleep10-21swapper/11
27976002102,3sleep22797619-21apt-get2
3276819291,2sleep20-21swapper/22
3271256291,3sleep10-21swapper/11
3258590291,4sleep13258665-21/usr/sbin/munin1
3135053290,1sleep20-21swapper/22
3131879291,2sleep00-21swapper/00
3114601291,3sleep22925445-21diskmemload2
3085006291,3sleep00-21swapper/00
3082521290,2sleep00-21swapper/00
3079372291,3sleep22925445-21diskmemload2
3073581290,1sleep20-21swapper/22
3034809291,2sleep00-21swapper/00
3027164291,3sleep00-21swapper/00
3023252290,1sleep20-21swapper/22
2992468290,1sleep00-21swapper/00
2990951291,2sleep20-21swapper/22
2915803291,4sleep12916865-21grep1
2914935290,1sleep10-21swapper/11
2914689290,1sleep00-21swapper/00
2904103291,4sleep22904107-21sshd-auth2
2866869290,2sleep10-21swapper/11
2836702291,4sleep22836826-21perl2
2825942291,4sleep22826198-21df2
2825389291,4sleep139542-21systemd-journal1
2805482291,4sleep22806280-21cat2
3173715280,2sleep12925445-21diskmemload1
2982714281,3sleep02982726-21ssh0
2940405281,2sleep00-21swapper/00
2916866281,3sleep22918582-21cut2
2900040281,3sleep1321rcuc/11
2894236281,3sleep10-21swapper/11
2889462281,3sleep22890681-21cut2
2888886280,3sleep12888905-21apt-get1
2883312280,2sleep20-21swapper/22
2878140282,2sleep02878196-21unin-run0
2867903280,3sleep22867922-21apt-get2
2867898280,2sleep00-21swapper/00
2856770280,1sleep00-21swapper/00
2851551280,1sleep00-21swapper/00
2846336280,1sleep10-21swapper/11
2821351281,4sleep02822938-21cut0
2810771281,3sleep22812130-21cat2
2801806281,3sleep02801955-21grep0
2801494281,4sleep12801619-21netstat1
2925099270,1sleep20-21swapper/22
2915224270,1sleep00-21swapper/00
2909959270,2sleep20-21swapper/22
2909615270,1sleep00-21swapper/00
2883232270,1sleep10-21swapper/11
2872501270,1sleep10-21swapper/11
2858206271,3sleep12859805-21kthreadcore1
2841680270,2sleep20-21swapper/22
2841226271,3sleep02841227-21pool-udisksd0
2825937271,2sleep12825939-21apt-get1
2815437270,1sleep20-21swapper/22
2921394261,2sleep10-21swapper/11
2899463260,1sleep00-21swapper/00
2893661260,1sleep00-21swapper/00
2888605260,1sleep20-21swapper/22
2884535261,2sleep00-21swapper/00
2883916261,2sleep10-21swapper/11
2873742261,2sleep22792095-21kworker/2:1-events2
2841112260,1sleep10-21swapper/11
2831767260,2sleep20-21swapper/22
2861559250,1sleep20-21swapper/22
2846910250,1sleep10-21swapper/11
2825693250,1sleep00-21swapper/00
2841653240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional