You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 23:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Mon Mar 16, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
542862211854,57sleep30-21swapper/33
54321428153,17sleep00-21swapper/00
54303127960,11sleep20-21swapper/22
9558592760,1sleep072-21kcompactd00
54289427658,12sleep10-21swapper/11
8138652730,3sleep20-21swapper/22
54336599211,17cyclictest0-21swapper/33
54336599211,15cyclictest0-21swapper/33
8901102201,4sleep2890153-21sh2
6962312200,8sleep014-21ksoftirqd/00
543365992013,4cyclictest820913-21taskset3
54336599201,2cyclictest0-21swapper/33
54336599201,16cyclictest987032-21chrt3
54336599201,16cyclictest0-21swapper/33
54336599201,15cyclictest66950irq/132-enp1s0-TxRx-33
54336599200,17cyclictest0-21swapper/33
54336599200,17cyclictest0-21swapper/33
6905872191,8sleep1674268-21diskmemload1
5509892191,5sleep2551159-21diskstats2
54336599193,13cyclictest0-21swapper/33
54336599191,15cyclictest66950irq/132-enp1s0-TxRx-33
54336599191,15cyclictest0-21swapper/33
54336599191,15cyclictest0-21swapper/33
54336599191,14cyclictest0-21swapper/33
54336599191,14cyclictest0-21swapper/33
54336599191,14cyclictest0-21swapper/33
54336599191,14cyclictest0-21swapper/33
54336599191,14cyclictest0-21swapper/33
54336599191,14cyclictest0-21swapper/33
54336599191,14cyclictest0-21swapper/33
54336599190,16cyclictest0-21swapper/33
543365991815,1cyclictest0-21swapper/33
543365991813,3cyclictest0-21swapper/33
54336599181,14cyclictest66950irq/132-enp1s0-TxRx-33
54336599181,14cyclictest66950irq/132-enp1s0-TxRx-33
54336599181,14cyclictest0-21swapper/33
54336599181,14cyclictest0-21swapper/33
54336599181,14cyclictest0-21swapper/33
54336599181,14cyclictest0-21swapper/33
54336599181,14cyclictest0-21swapper/33
54336599181,14cyclictest0-21swapper/33
54336599181,14cyclictest0-21swapper/33
54336599181,14cyclictest0-21swapper/33
54336599181,13cyclictest0-21swapper/33
54336599181,13cyclictest0-21swapper/33
9891762171,3sleep20-21swapper/22
9290212171,2sleep00-21swapper/00
9069572171,11sleep0903408-21/usr/sbin/munin0
8814872170,8sleep0674268-21diskmemload0
8561822171,3sleep20-21swapper/22
8319692171,4sleep1674268-21diskmemload1
7807452177,6sleep2781086-21cat2
543365991713,3cyclictest0-21swapper/33
543365991713,3cyclictest0-21swapper/33
54336599171,14cyclictest0-21swapper/33
54336599171,14cyclictest0-21swapper/33
54336599171,13cyclictest0-21swapper/33
54336599171,13cyclictest0-21swapper/33
54336599171,13cyclictest0-21swapper/33
54336599171,13cyclictest0-21swapper/33
54336599171,12cyclictest700895-21taskset3
54336599170,14cyclictest0-21swapper/33
10127142171,5sleep21012771-21ntpq2
9006322161,2sleep20-21swapper/22
7779762161,4sleep1674268-21diskmemload1
7773112161,3sleep00-21swapper/00
6254452161,4sleep0625647-21users0
54336599161,3cyclictest0-21swapper/33
543365991613,1cyclictest0-21swapper/33
54336599160,14cyclictest0-21swapper/33
54336599160,14cyclictest0-21swapper/33
54336599160,13cyclictest0-21swapper/33
54336599160,13cyclictest0-21swapper/33
54336599160,13cyclictest0-21swapper/33
9724072151,8sleep0674268-21diskmemload0
9375382151,4sleep1674268-21diskmemload1
9366562151,3sleep0936670-21ssh0
8849252151,3sleep1674268-21diskmemload1
8379862150,1sleep10-21swapper/11
8027802151,9sleep1674268-21diskmemload1
7796702151,2sleep20-21swapper/22
7496162151,3sleep20-21swapper/22
7087562151,3sleep20-21swapper/22
5603392150,10sleep1560388-21ntpq1
54336599151,3cyclictest0-21swapper/33
543365991512,1cyclictest0-21swapper/33
543365991511,2cyclictest0-21swapper/33
543365991511,2cyclictest0-21swapper/33
543365991511,2cyclictest0-21swapper/33
54336599150,13cyclictest0-21swapper/33
54336599150,13cyclictest0-21swapper/33
54336599150,13cyclictest0-21swapper/33
54336599150,13cyclictest0-21swapper/33
54336599150,13cyclictest0-21swapper/33
54336599150,12cyclictest0-21swapper/33
54336599150,12cyclictest0-21swapper/33
54336599150,12cyclictest0-21swapper/33
54336599150,12cyclictest0-21swapper/33
9210872141,9sleep2921238-21gltestperf2
8219222141,9sleep2821936-21ssh2
7355282141,2sleep20-21swapper/22
7317122141,9sleep0731781-21ntpq0
6732482141,4sleep0673295-21ntpq0
6209782142,7sleep1620996-21apt-get1
5774342141,3sleep0577313-31sort0
5440652147,4sleep2431ktimers/22
543365991411,2cyclictest0-21swapper/33
10418962141,9sleep1674268-21diskmemload1
10171682140,1sleep20-21swapper/22
10140182141,3sleep11014026-21ssh1
9952352131,6sleep2995337-21ps2
9808032131,8sleep2980816-21rm2
9532982131,3sleep0953308-21ssh0
9386162131,6sleep2938837-21hddtemp_smartct2
8648802131,3sleep0864894-21ssh0
8620962131,7sleep1863352-21memory1
8494972130,3sleep1849508-21ssh1
8478812131,8sleep2847894-21ssh2
8231742131,7sleep1674268-21diskmemload1
8111012131,7sleep1811359-21users1
8041072131,4sleep2804121-21ssh2
7682042131,7sleep1674268-21diskmemload1
7439182130,1sleep00-21swapper/00
6828062131,7sleep0674268-21diskmemload0
54336599138,3cyclictest653760-21chrt3
10253222130,2sleep1674268-21diskmemload1
9975282121,5sleep1674268-21diskmemload1
9295002120,2sleep20-21swapper/22
9162152123,5sleep2916268-21sh2
8734712121,6sleep1674268-21diskmemload1
8641102121,7sleep2864247-21sh2
8568182121,6sleep00-21swapper/00
7260712120,5sleep20-21swapper/22
7176212121,7sleep1674268-21diskmemload1
7051712121,6sleep0705236-21ntpq0
6897822121,7sleep2689795-21sh2
6268142121,7sleep0627199-21grep0
5833662121,5sleep0583384-21apt-get0
5774002120,7sleep1577349-31find1
5665882120,1sleep20-21swapper/22
10053652121,5sleep10-21swapper/11
9951042111,5sleep0995163-21ntpq0
9697372111,2sleep20-21swapper/22
9469522111,5sleep1674268-21diskmemload1
9033032111,3sleep20-21swapper/22
8846232111,4sleep2674268-21diskmemload2
8734312111,3sleep20-21swapper/22
8577402111,4sleep1674268-21diskmemload1
7953652111,6sleep1795378-21ssh1
7951472111,6sleep0795161-21ssh0
7857432111,4sleep00-21swapper/00
7612992111,3sleep00-21swapper/00
7545012111,6sleep1755968-21cut1
7501152110,5sleep00-21swapper/00
7438742111,5sleep1674268-21diskmemload1
7416902111,2sleep2741703-21ssh2
7341892111,4sleep1674268-21diskmemload1
7265632110,7sleep1674268-21diskmemload1
7142782111,7sleep0714415-21cat0
6922972111,5sleep2692491-21diskstats2
6922012111,6sleep1692293-21grep1
6825142111,3sleep10-21swapper/11
6787532111,5sleep2678808-21ntpq2
6303672111,5sleep1630414-21ntpq1
6103202111,5sleep1610575-21df1
6090552111,5sleep0609104-21ntpq0
5984742111,5sleep0598687-21users0
5984742111,5sleep0598687-21users0
5940162111,4sleep2594268-21df2
5940162111,4sleep2594268-21df2
5927312111,5sleep2592772-21ntpq2
5833872111,5sleep1583646-21df_inode1
10329252110,6sleep0674268-21diskmemload0
9885402101,3sleep00-21swapper/00
9814422101,3sleep00-21swapper/00
9703412101,4sleep1674268-21diskmemload1
9620042101,4sleep10-21swapper/11
9525642101,2sleep20-21swapper/22
9381492100,2sleep0171rcu_preempt0
9272612101,4sleep1674268-21diskmemload1
9180732100,1sleep00-21swapper/00
9172702101,3sleep1674268-21diskmemload1
9107012101,4sleep1674268-21diskmemload1
9019272101,3sleep00-21swapper/00
9010302101,4sleep1674268-21diskmemload1
8855682101,3sleep10-21swapper/11
8497442100,6sleep0849755-21ssh0
8361352101,5sleep2836834-21sed2
8327362101,3sleep00-21swapper/00
8310102101,4sleep2674268-21diskmemload2
8296032100,2sleep00-21swapper/00
8157032101,4sleep0815833-21irqstats0
8026562101,4sleep0674268-21diskmemload0
7850932101,5sleep1674268-21diskmemload1
7668362101,4sleep0766890-21ntpq0
7596872101,3sleep20-21swapper/22
6896102101,2sleep00-21swapper/00
6735992101,6sleep2673844-21awk2
6641872101,4sleep2664290-21perl2
6586452101,4sleep2658863-21df_inode2
6586452101,4sleep2658863-21df_inode2
6420022101,6sleep10-21swapper/11
6316052101,4sleep1631624-21apt-get1
6200722100,1sleep00-21swapper/00
6034442101,4sleep2603498-21ntpq2
5980372101,4sleep1598078-21ntpq1
5980372101,4sleep1598078-21ntpq1
5820602101,5sleep1582108-21ntpq1
5730772100,6sleep2574210-21cut2
5679812101,6sleep2569704-21cut2
5615962101,5sleep0561774-21cstates0
5500412101,4sleep0550786-21irqstats0
10339202101,3sleep20-21swapper/22
10258532101,3sleep1674268-21diskmemload1
10232692101,3sleep0674268-21diskmemload0
10061202101,3sleep00-21swapper/00
10002212101,4sleep21000306-21irqstats2
987683291,5sleep1987696-21ssh1
973346291,3sleep1973374-21apt-get1
961401291,3sleep2674268-21diskmemload2
943601291,4sleep1943612-21ssh1
885607291,3sleep0885640-21apt-get0
872387291,4sleep0872442-21ssh0
796996291,4sleep2797008-21ssh2
762988291,4sleep2763208-21hddtemp_smartct2
750332291,3sleep1674268-21diskmemload1
718367291,4sleep0718381-21ssh0
715533290,3sleep20-21swapper/22
707717291,3sleep1674268-21diskmemload1
658319291,4sleep2658364-21systemd-run2
649394291,4sleep1651169-21tr1
644551291,4sleep2646393-21grep2
619665291,4sleep1619698-21ntpq1
617475290,5sleep2619304-21tr2
599346291,3sleep0599365-21apt-get0
556254291,4sleep0556266-21apt-get0
1039964290,2sleep00-21swapper/00
1034680291,2sleep20-21swapper/22
1008378291,2sleep00-21swapper/00
810730281,3sleep0810796-21ssh0
665169281,3sleep10-21swapper/11
651930281,3sleep00-21swapper/00
637452280,4sleep0637694-21kthreadcore0
609341281,4sleep1609542-21unixbench-2d1
671298271,3sleep10-21swapper/11
663907270,2sleep00-21swapper/00
642560270,2sleep00-21swapper/00
641837272,2sleep2543359-21cyclictest2
631601270,1sleep20-21swapper/22
615360271,3sleep2615394-21basename2
610288270,1sleep00-21swapper/00
599368271,2sleep10-21swapper/11
593576270,1sleep00-21swapper/00
582801270,1sleep00-21swapper/00
578667271,3sleep2580351-21kthreadcore2
566903270,2sleep10-21swapper/11
551443271,2sleep10-21swapper/11
548404270,1sleep10-21swapper/11
663624261,2sleep1663656-21perf1
663624261,2sleep1663656-21perf1
654144261,2sleep00-21swapper/00
651170260,3sleep20-21swapper/22
647265260,1sleep10-21swapper/11
635511260,2sleep0635621-21strings0
625295260,3sleep20-21swapper/22
604946261,2sleep20-21swapper/22
593602261,3sleep10-21swapper/11
586522261,2sleep20-21swapper/22
560965260,4sleep20-21swapper/22
653487250,1sleep10-21swapper/11
626275250,3sleep20-21swapper/22
571674250,3sleep00-21swapper/00
566284250,3sleep10-21swapper/11
547662250,1sleep00-21swapper/00
658579240,1sleep00-21swapper/00
658579240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional