You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 02:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Fri Jun 19, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
358401213154,72sleep30-21swapper/33
35858029170,11sleep20-21swapper/22
35790228054,14sleep00-21swapper/00
35845227959,12sleep10-21swapper/11
7671092360,1sleep20-21swapper/22
358754992410,11cyclictest700586-21turbostat3
8314942221,17sleep0831594-21ps0
35875499229,7cyclictest616338-21turbostat3
35875499223,13cyclictest790440-21taskset3
35875499221,17cyclictest832095-21taskset3
358754992111,7cyclictest0-21swapper/33
5539842201,10sleep0489383-21diskmemload0
35875499201,6cyclictest800733-21taskset3
358754992011,5cyclictest6406942sleep33
35875499201,15cyclictest0-21swapper/33
358754992010,6cyclictest440734-21turbostat3
7060962191,9sleep2706110-21ssh2
358754991912,4cyclictest0-21swapper/33
35875499191,15cyclictest0-21swapper/33
35875499191,15cyclictest0-21swapper/33
35875499191,15cyclictest0-21swapper/33
35875499191,14cyclictest0-21swapper/33
35875499191,14cyclictest0-21swapper/33
35875499191,14cyclictest0-21swapper/33
35875499191,14cyclictest0-21swapper/33
35875499191,14cyclictest0-21swapper/33
35875499191,14cyclictest0-21swapper/33
35875499190,16cyclictest66950irq/132-enp1s0-TxRx-33
7850402181,5sleep2785174-21diskstats2
6834372181,8sleep2683447-21ssh2
35875499182,11cyclictest557935-21taskset3
358754991812,5cyclictest0-21swapper/33
35875499181,15cyclictest0-21swapper/33
35875499181,14cyclictest0-21swapper/33
35875499181,14cyclictest0-21swapper/33
35875499181,14cyclictest0-21swapper/33
35875499181,14cyclictest0-21swapper/33
35875499181,14cyclictest0-21swapper/33
35875499181,14cyclictest0-21swapper/33
35875499181,14cyclictest0-21swapper/33
35875499181,14cyclictest0-21swapper/33
35875499181,14cyclictest0-21swapper/33
35875499181,13cyclictest0-21swapper/33
35875499181,13cyclictest0-21swapper/33
35875499181,13cyclictest0-21swapper/33
35875499181,13cyclictest0-21swapper/33
35875499181,12cyclictest489408-21sleep3
35875499180,14cyclictest0-21swapper/33
35875499180,14cyclictest0-21swapper/33
35875499171,14cyclictest0-21swapper/33
35875499171,13cyclictest0-21swapper/33
35875499171,13cyclictest0-21swapper/33
35875499171,13cyclictest0-21swapper/33
35875499170,13cyclictest0-21swapper/33
35875499170,13cyclictest0-21swapper/33
7386662162,7sleep0738723-21ntpq0
7074082161,3sleep10-21swapper/11
6839642160,1sleep10-21swapper/11
5896002161,4sleep0489383-21diskmemload0
5787202161,3sleep00-21swapper/00
3970132161,10sleep1397062-21ntpq1
3970132161,10sleep1397062-21ntpq1
35875499161,2cyclictest0-21swapper/33
358754991612,2cyclictest0-21swapper/33
358754991611,3cyclictest398263-21chrt3
35875499160,14cyclictest0-21swapper/33
35875499160,13cyclictest0-21swapper/33
35875499160,12cyclictest0-21swapper/33
8356142151,4sleep1835638-21apt-get1
7331132150,1sleep20-21swapper/22
6739682151,2sleep00-21swapper/00
6642712151,2sleep00-21swapper/00
5803832150,1sleep10-21swapper/11
5730562151,9sleep2489383-21diskmemload2
5532002151,2sleep10-21swapper/11
35875499152,1cyclictest0-21swapper/33
35875499152,1cyclictest0-21swapper/33
358754991513,1cyclictest0-21swapper/33
358754991512,2cyclictest0-21swapper/33
358754991511,2cyclictest0-21swapper/33
35875499150,13cyclictest0-21swapper/33
35875499150,12cyclictest0-21swapper/33
35875499150,12cyclictest0-21swapper/33
35875499150,12cyclictest0-21swapper/33
7738272141,3sleep2773838-21ssh2
7400692141,2sleep20-21swapper/22
6488982140,10sleep2648912-21ssh2
6256492141,10sleep1625837-21kthreadcore1
6043422141,9sleep0604404-21ssh0
5887932141,4sleep1588811-21ssh1
5797252141,8sleep2579739-21ssh2
4350072140,2sleep00-21swapper/00
358754991412,1cyclictest0-21swapper/33
358754991412,1cyclictest0-21swapper/33
358754991412,1cyclictest0-21swapper/33
35875499140,12cyclictest0-21swapper/33
35875499140,11cyclictest0-21swapper/33
8177072130,3sleep10-21swapper/11
8103472131,7sleep2489383-21diskmemload2
7763762132,4sleep1776400-21apt-get1
7746022131,4sleep0774613-21ssh0
7244442131,6sleep10-21swapper/11
7079282131,3sleep0171rcu_preempt0
6686262132,6sleep1670250-21cut1
6502562131,8sleep0650283-21ssh0
6473062130,8sleep0489383-21diskmemload0
6342312131,7sleep2635793-21cut2
6233322130,2sleep20-21swapper/22
6142802131,7sleep0489383-21diskmemload0
6082282131,5sleep20-21swapper/22
6062992131,8sleep1606313-21ssh1
5475252131,5sleep10-21swapper/11
5295612130,2sleep20-21swapper/22
5228112131,8sleep00-21swapper/00
4297522130,1sleep00-21swapper/00
4193532130,1sleep10-21swapper/11
358754991311,1cyclictest0-21swapper/33
35875499130,2cyclictest3589132sleep33
8240272121,7sleep1824040-21ssh1
8079812121,6sleep1489383-21diskmemload1
7913952121,7sleep1791408-21sh1
7512692122,4sleep0751299-21apt-get0
6757532121,4sleep10-21swapper/11
6583602121,7sleep290-21kswapd02
6508802121,7sleep1651809-21cat1
5580192121,8sleep0559380-21cut0
5375952121,3sleep2537610-21ssh2
4952222121,7sleep1495232-21ssh1
4830622121,5sleep2483111-21ntpq2
4572892121,5sleep0457544-21df0
4506872121,5sleep00-21swapper/00
4397532121,5sleep0439802-21ntpq0
3979832121,6sleep0398008-21munin-run0
3979832121,6sleep0398008-21munin-run0
8352402111,6sleep2835346-21latency_hist2
8176022110,1sleep00-21swapper/00
8078172111,6sleep2807823-21ssh2
7938042111,6sleep0793855-21fschecks_count0
7836392111,5sleep0489383-21diskmemload0
7664992111,3sleep00-21swapper/00
7316532110,2sleep10-21swapper/11
7135462111,5sleep2713594-21ntpq2
6996902111,5sleep2489383-21diskmemload2
6990792111,7sleep1699090-21ssh1
6554072111,4sleep20-21swapper/22
6340112111,6sleep1634228-21kthreadcore1
5383062110,7sleep0489383-21diskmemload0
5252292111,6sleep0526922-21kthreadcore0
5123102111,3sleep20-21swapper/22
5066912111,5sleep1506958-21df1
4981942111,6sleep2498327-21cpuspeed_turbos2
4897882111,5sleep0490054-21df0
4785972110,1sleep00-21swapper/00
4359172111,6sleep1435947-21fschecks_count1
3628372111,5sleep1362978-21ntpq1
8426622101,4sleep2489383-21diskmemload2
8414282101,4sleep0489383-21diskmemload0
8266542101,4sleep0489383-21diskmemload0
8240412101,3sleep20-21swapper/22
8077312100,2sleep00-21swapper/00
7988312101,4sleep1489383-21diskmemload1
7935022100,4sleep20-21swapper/22
7925872101,4sleep0489383-21diskmemload0
7830982101,4sleep2489383-21diskmemload2
7595712101,4sleep1489383-21diskmemload1
7512422101,4sleep2489383-21diskmemload2
7481812101,4sleep2489383-21diskmemload2
7478732101,4sleep0489383-21diskmemload0
7406852101,2sleep10-21swapper/11
7220622101,4sleep2722122-21ntp_states2
7163222101,4sleep0489383-21diskmemload0
7147772101,5sleep1714787-21ssh1
6914262101,4sleep0489383-21diskmemload0
6896112101,3sleep20-21swapper/22
6807922102,3sleep0489383-21diskmemload0
6473702100,1sleep10-21swapper/11
6377842101,5sleep0637909-21/usr/sbin/munin0
6321892101,3sleep20-21swapper/22
6170042101,5sleep0617222-21hddtemp_smartct0
6128592101,5sleep1612879-21switchtime1
6062592101,4sleep2489383-21diskmemload2
5987952100,4sleep00-21swapper/00
5830402101,5sleep2583121-21cpuspeed_turbos2
5740222100,2sleep10-21swapper/11
5664792100,5sleep0489383-21diskmemload0
5642612101,4sleep2489383-21diskmemload2
5556652101,4sleep2489383-21diskmemload2
5464102101,4sleep2489383-21diskmemload2
5384442101,3sleep10-21swapper/11
5219552101,3sleep10-21swapper/11
5066582101,4sleep0506682-21apt-get0
4789582101,3sleep10-21swapper/11
4704292101,4sleep1472123-21cat1
4576242100,6sleep2457266-21/usr/sbin/munin2
4465882100,2sleep10-21swapper/11
4201972101,5sleep0421228-21kthreadcore0
4129632101,4sleep0413013-21ntpq0
3796562101,4sleep1380820-21memory1
3667532101,5sleep0366824-21irqstats0
3629792101,4sleep2363025-21ntpq2
832484291,2sleep10-21swapper/11
768344291,4sleep1768478-21perl1
747219291,4sleep1747318-21ps1
717806290,4sleep0717828-21apt-get0
699787291,4sleep0699798-21ssh0
670253290,4sleep20-21swapper/22
632815291,4sleep0489383-21diskmemload0
616675290,3sleep10-21swapper/11
597747291,2sleep10-21swapper/11
596731291,2sleep20-21swapper/22
565165291,2sleep10-21swapper/11
547459291,3sleep0489383-21diskmemload0
505307291,3sleep10-21swapper/11
503807291,4sleep0503819-21ssh0
489694291,3sleep2489383-21diskmemload2
477540291,4sleep1477661-21ntpq1
468848291,4sleep0470427-21cut0
445642291,4sleep1445729-21cat1
441282291,4sleep0441534-21df0
440572290,3sleep272-21kcompactd02
425448291,5sleep1425532-21kernelversion1
407608291,4sleep1407656-21ntpq1
403539290,1sleep00-21swapper/00
392635291,4sleep1392699-21systemd-run1
381921290,1sleep00-21swapper/00
359198291,4sleep0359301-21perl0
751191280,4sleep1489383-21diskmemload1
726716281,3sleep0728275-21cut0
664790280,2sleep10-21swapper/11
527916281,3sleep1527989-21ssh1
515240281,2sleep20-21swapper/22
474147281,3sleep2474972-21cut2
467856280,2sleep10-21swapper/11
462888280,3sleep0462907-21apt-get0
447097280,1sleep20-21swapper/22
446216280,1sleep20-21swapper/22
422996280,5sleep20-21swapper/22
403056280,2sleep072-21kcompactd00
388822281,3sleep2390554-21kthreadcore2
376188280,1sleep20-21swapper/22
371862281,3sleep1371928-21fschecks_count1
370299281,2sleep10-21swapper/11
484293270,2sleep00-21swapper/00
467813270,1sleep20-21swapper/22
457545271,3sleep1457623-21grep1
432276272,2sleep2434087-21tr2
430298271,3sleep1430422-21expr1
413939270,1sleep20-21swapper/22
408918271,2sleep10-21swapper/11
408563270,1sleep20-21swapper/22
403224270,1sleep10-21swapper/11
398241270,2sleep20-21swapper/22
393196271,3sleep20-21swapper/22
393196271,3sleep20-21swapper/22
392428270,1sleep00-21swapper/00
386366270,3sleep00-21swapper/00
485408261,2sleep10-21swapper/11
484280260,1sleep20-21swapper/22
473010260,1sleep20-21swapper/22
456986260,3sleep10-21swapper/11
456870260,1sleep00-21swapper/00
455984260,2sleep20-21swapper/22
421231261,2sleep10-21swapper/11
415635261,2sleep00-21swapper/00
414669261,2sleep20-21swapper/22
382261261,2sleep20-21swapper/22
382239260,2sleep10-21swapper/11
372727261,2sleep00-21swapper/00
368102261,2sleep20-21swapper/22
483972250,2sleep00-21swapper/00
429030250,1sleep20-21swapper/22
381699250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional