You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 03:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Mon May 04, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
77273921510,3sleep2771796-21kthreadcore2
621402213058,67sleep30-21swapper/33
6212742121105,10sleep10-21swapper/11
62132829160,12sleep20-21swapper/22
62110427856,17sleep00-21swapper/00
10943402241,3sleep10-21swapper/11
62155199221,17cyclictest1027379-21taskset3
7765142211,2sleep10-21swapper/11
621551992118,1cyclictest0-21swapper/33
621551992111,6cyclictest881944-21taskset3
62155199211,16cyclictest0-21swapper/33
10013022211,8sleep134-21ksoftirqd/11
6803082201,14sleep2681255-21memory2
62155199208,9cyclictest1003333-21turbostat3
621551992017,1cyclictest0-21swapper/33
621551992012,5cyclictest0-21swapper/33
62155199201,15cyclictest0-21swapper/33
62155199201,15cyclictest0-21swapper/33
9601002191,2sleep00-21swapper/00
8923382191,8sleep1892350-21ssh1
7461462191,14sleep2746286-21/usr/sbin/munin2
62155199192,14cyclictest792542-21taskset3
621551991916,1cyclictest0-21swapper/33
621551991916,1cyclictest0-21swapper/33
621551991915,2cyclictest0-21swapper/33
621551991915,2cyclictest0-21swapper/33
621551991914,3cyclictest0-21swapper/33
621551991913,3cyclictest66950irq/132-enp1s0-TxRx-33
62155199191,15cyclictest0-21swapper/33
62155199191,15cyclictest0-21swapper/33
62155199191,14cyclictest0-21swapper/33
62155199191,14cyclictest0-21swapper/33
62155199191,14cyclictest0-21swapper/33
62155199191,13cyclictest0-21swapper/33
62155199190,17cyclictest0-21swapper/33
62155199190,16cyclictest66950irq/132-enp1s0-TxRx-33
8945632181,4sleep0894575-21rm0
7820662181,5sleep1782218-21ntpq1
62155199189,6cyclictest1068416-21taskset3
62155199185,11cyclictest0-21swapper/33
621551991815,1cyclictest0-21swapper/33
62155199181,15cyclictest0-21swapper/33
62155199181,14cyclictest0-21swapper/33
62155199181,14cyclictest0-21swapper/33
62155199181,14cyclictest0-21swapper/33
62155199181,14cyclictest0-21swapper/33
62155199181,14cyclictest0-21swapper/33
62155199181,13cyclictest0-21swapper/33
62155199181,12cyclictest0-21swapper/33
62155199180,15cyclictest0-21swapper/33
10515732180,1sleep10-21swapper/11
103379721810,2sleep10-21swapper/11
9850882170,1sleep20-21swapper/22
9514842171,3sleep00-21swapper/00
7915242171,2sleep10-21swapper/11
621551991713,2cyclictest0-21swapper/33
621551991712,3cyclictest0-21swapper/33
621551991711,4cyclictest0-21swapper/33
621551991711,3cyclictest0-21swapper/33
62155199171,13cyclictest0-21swapper/33
62155199171,12cyclictest7139872sleep33
62155199171,12cyclictest0-21swapper/33
62155199170,14cyclictest0-21swapper/33
62155199170,14cyclictest0-21swapper/33
62155199170,14cyclictest0-21swapper/33
62155199170,13cyclictest0-21swapper/33
62155199170,13cyclictest0-21swapper/33
10627952171,4sleep01063011-21hddtemp_smartct0
9421692161,2sleep10-21swapper/11
9111612161,4sleep1752660-21diskmemload1
8933632161,3sleep20-21swapper/22
62155199162,9cyclictest704600-21taskset3
62155199161,3cyclictest0-21swapper/33
62155199160,13cyclictest0-21swapper/33
62155199160,13cyclictest0-21swapper/33
62155199160,13cyclictest0-21swapper/33
10436872161,2sleep00-21swapper/00
8846592151,2sleep20-21swapper/22
62155199151,3cyclictest0-21swapper/33
621551991513,1cyclictest0-21swapper/33
621551991511,2cyclictest0-21swapper/33
621551991510,2cyclictest0-21swapper/33
62155199150,13cyclictest0-21swapper/33
62155199150,12cyclictest0-21swapper/33
62155199150,11cyclictest682352-21taskset3
10844272151,3sleep10-21swapper/11
10109692151,2sleep10-21swapper/11
9933122141,2sleep20-21swapper/22
9362252140,2sleep20-21swapper/22
9204182141,6sleep0221rcuc/00
9172742141,3sleep1917285-21ssh1
9116892140,3sleep00-21swapper/00
8670872141,8sleep1752660-21diskmemload1
621551991412,1cyclictest0-21swapper/33
621551991411,1cyclictest0-21swapper/33
62155199140,12cyclictest0-21swapper/33
62155199140,12cyclictest0-21swapper/33
11001212141,8sleep2752660-21diskmemload2
10840902141,8sleep2752660-21diskmemload2
10584422141,3sleep10-21swapper/11
10428182141,6sleep20-21swapper/22
10025032141,2sleep20-21swapper/22
9872222131,6sleep0987435-21diskstats0
9445712134,5sleep2944582-21sh2
9437052131,7sleep0752660-21diskmemload0
9338132131,2sleep1752660-21diskmemload1
9003032131,7sleep0752660-21diskmemload0
8356542131,7sleep2752660-21diskmemload2
8003032136,3sleep0800312-21sh0
7846752131,4sleep2784686-21ssh2
7253592131,8sleep2255-21systemd-journal2
62155199137,3cyclictest645278-21chrt3
621551991310,2cyclictest0-21swapper/33
10758282130,2sleep00-21swapper/00
10703872131,8sleep21070556-21latency_hist2
9867892121,7sleep1986972-21latency_hist1
9766402121,6sleep0752660-21diskmemload0
9686392121,4sleep2968651-21rm2
9530102121,5sleep20-21swapper/22
9518142121,2sleep10-21swapper/11
9124062121,7sleep2912891-21cut2
9033432120,8sleep2903359-21ssh2
8701032121,6sleep20-21swapper/22
8693752122,4sleep0752660-21diskmemload0
8672862121,5sleep2752660-21diskmemload2
8577052122,5sleep2752660-21diskmemload2
7988682121,5sleep20-21swapper/22
7738252121,5sleep0773879-21ntpq0
7675102121,7sleep2767524-21ssh2
7673382121,7sleep0767352-21ssh0
7303012121,7sleep0730350-21ntpq0
7199772120,1sleep20-21swapper/22
6493412121,5sleep2649390-21ntpq2
62155199120,2cyclictest0-21swapper/33
10961472121,7sleep01096267-21ssh0
10868022121,5sleep0752660-21diskmemload0
10680592121,6sleep10-21swapper/11
10435162121,5sleep10-21swapper/11
10287542121,6sleep21028786-21ssh2
10280862121,5sleep20-21swapper/22
10031702121,5sleep00-21swapper/00
9857972116,2sleep00-21swapper/00
9628372111,6sleep0963352-21cat0
9581322111,7sleep1958201-21ntp_states1
9271002111,6sleep1752660-21diskmemload1
9249652111,2sleep20-21swapper/22
9179472111,4sleep0752660-21diskmemload0
9027792111,6sleep1902790-21ssh1
8861642110,2sleep00-21swapper/00
8420082111,4sleep2752660-21diskmemload2
8370742111,7sleep1837184-21fschecks_time1
8272062111,5sleep0752660-21diskmemload0
8249552110,6sleep2752660-21diskmemload2
8182912111,3sleep10-21swapper/11
7918152111,4sleep2752660-21diskmemload2
7342962111,5sleep0735439-21memory0
6296332115,4sleep0629731-21ps0
6217592111,6sleep1621989-21cstates1
10749012112,5sleep11074948-21ntpq1
10500792111,5sleep21050143-21ntpq2
10184542111,4sleep2752660-21diskmemload2
10126452111,6sleep11014035-21cut1
10077842110,7sleep21007843-21gcc2
9946132101,3sleep10-21swapper/11
9770162100,4sleep1752660-21diskmemload1
9704972101,2sleep20-21swapper/22
9675892101,3sleep10-21swapper/11
9590902101,4sleep2752660-21diskmemload2
9346432102,3sleep0752660-21diskmemload0
8764712100,5sleep1752660-21diskmemload1
8762212101,3sleep00-21swapper/00
8588302102,3sleep0752660-21diskmemload0
8530562101,3sleep10-21swapper/11
8530562101,3sleep10-21swapper/11
8450342101,4sleep0752660-21diskmemload0
8450342101,4sleep0752660-21diskmemload0
8340342101,3sleep00-21swapper/00
8263592101,3sleep10-21swapper/11
8179222101,3sleep20-21swapper/22
8105382101,4sleep0752660-21diskmemload0
8100572101,5sleep2810068-21ssh2
7846992101,2sleep00-21swapper/00
7581862100,2sleep00-21swapper/00
7529282101,3sleep20-21swapper/22
7422472101,4sleep0742508-21df_inode0
7373672101,5sleep0737462-21kthreadcore0
7354402101,4sleep1735580-21/usr/sbin/munin1
7234612101,4sleep1724508-21memory1
7206092100,1sleep00-21swapper/00
7104492101,5sleep2710506-21kthreadcore2
7086202101,4sleep2708666-21ntpq2
7084782101,4sleep1708619-21ntpq1
6992232101,5sleep00-21swapper/00
6666422101,4sleep1666664-21apt-get1
6600902101,4sleep1660146-21ntpq1
6508882101,4sleep0651098-21hddtemp_smartct0
6335442101,5sleep2633723-21timerwakeupswit2
10962722101,4sleep1752660-21diskmemload1
10932912100,1sleep00-21swapper/00
10928712101,4sleep2752660-21diskmemload2
10722342101,5sleep21073894-21kthreadcore2
10613002100,1sleep00-21swapper/00
10505152101,4sleep01050743-21users0
10258342101,3sleep10-21swapper/11
10189552101,5sleep01018969-21ssh0
10079072101,4sleep01007966-21ntpq0
895017291,3sleep2752660-21diskmemload2
884551290,1sleep10-21swapper/11
845157291,3sleep2845186-21apt-get2
845157291,3sleep2845186-21apt-get2
838184293,3sleep00-21swapper/00
833915291,2sleep10-21swapper/11
816923291,3sleep0752660-21diskmemload0
808245291,3sleep10-21swapper/11
795140291,4sleep1795278-21perl1
761841291,4sleep1763334-21ssh1
758002291,3sleep10-21swapper/11
736879291,4sleep1737044-21cstates1
732108291,4sleep2732569-21cat2
704089291,4sleep2704090-21sshd2
681442291,4sleep1681491-21ntpq1
677334291,3sleep0677353-21apt-get0
677042290,2sleep00-21swapper/00
666667291,4sleep2666846-21expr2
661302291,2sleep20-21swapper/22
659145291,4sleep2659943-21cat2
640233291,4sleep1640443-21hddtemp_smartct1
639936291,3sleep2639955-21apt-get2
621737291,3sleep0621756-21apt-get0
1058791291,2sleep20-21swapper/22
1028371291,3sleep01028125-21apt-get0
1026136291,4sleep01026149-21ssh0
858936281,3sleep1858948-21ssh1
786376281,3sleep0786390-21ssh0
727870281,3sleep10-21swapper/11
698434280,1sleep10-21swapper/11
694669281,3sleep2696409-21cut2
692964280,1sleep00-21swapper/00
683253280,1sleep10-21swapper/11
650137280,2sleep00-21swapper/00
639534280,2sleep1639526-21fwupd1
629737281,3sleep10-21swapper/11
748115271,2sleep1748529-21kthreadcore1
747895271,3sleep00-21swapper/00
747004270,1sleep10-21swapper/11
730983270,1sleep20-21swapper/22
714779270,1sleep10-21swapper/11
710182270,4sleep00-21swapper/00
708950271,3sleep00-21swapper/00
700234271,2sleep1331ktimers/11
682668270,2sleep00-21swapper/00
676353271,2sleep20-21swapper/22
676059270,3sleep10-21swapper/11
655962271,1sleep0655981-21apt-get0
655635270,1sleep20-21swapper/22
654576271,2sleep10-21swapper/11
748531260,2sleep2750232-21cut2
736852260,1sleep20-21swapper/22
720013260,1sleep00-21swapper/00
691829260,2sleep10-21swapper/11
687995260,2sleep20-21swapper/22
687571260,1sleep20-21swapper/22
671474260,3sleep00-21swapper/00
665854260,3sleep10-21swapper/11
645281260,1sleep10-21swapper/11
640118261,2sleep00-21swapper/00
635940261,2sleep00-21swapper/00
634570260,1sleep20-21swapper/22
626516260,1sleep20-21swapper/22
698428250,3sleep00-21swapper/00
666289250,3sleep00-21swapper/00
715221240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional