You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 19:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Sun Mar 29, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2205387212952,72sleep30-21swapper/33
220551029059,12sleep20-21swapper/22
220548928556,12sleep10-21swapper/11
220563428153,14sleep00-21swapper/00
26368052251,8sleep02636870-21ntp_states0
26804962230,2sleep2421rcuc/22
25083232230,2sleep0221rcuc/00
22624632221,5sleep02263951-21kthreadcore0
220584199221,17cyclictest2630698-21taskset3
220584199221,17cyclictest0-21swapper/33
2205841992118,1cyclictest0-21swapper/33
25367762201,4sleep22537045-21ssh2
220584199202,13cyclictest2493416-21taskset3
2205841992011,5cyclictest26386532sleep33
220584199201,15cyclictest2614608-21turbostat3
25275832191,3sleep20-21swapper/22
23976792191,13sleep12397710-21ssh1
220584199199,7cyclictest2657645-21chrt3
220584199198,8cyclictest2272304-21turbostat3
220584199191,6cyclictest2379398-21taskset3
220584199191,15cyclictest0-21swapper/33
220584199191,15cyclictest0-21swapper/33
220584199191,15cyclictest0-21swapper/33
220584199191,15cyclictest0-21swapper/33
220584199191,15cyclictest0-21swapper/33
220584199191,14cyclictest0-21swapper/33
220584199191,14cyclictest0-21swapper/33
220584199191,14cyclictest0-21swapper/33
220584199191,14cyclictest0-21swapper/33
220584199190,15cyclictest26748072chrt3
24994932181,2sleep00-21swapper/00
24236682181,5sleep12423699-21ssh1
220584199187,8cyclictest2282939-21turbostat3
2205841991814,2cyclictest0-21swapper/33
220584199181,3cyclictest2213375-21taskset3
220584199181,15cyclictest0-21swapper/33
220584199181,14cyclictest2421929-21chrt3
220584199181,14cyclictest0-21swapper/33
220584199181,14cyclictest0-21swapper/33
220584199181,14cyclictest0-21swapper/33
220584199181,14cyclictest0-21swapper/33
220584199181,14cyclictest0-21swapper/33
220584199181,14cyclictest0-21swapper/33
220584199181,14cyclictest0-21swapper/33
220584199181,14cyclictest0-21swapper/33
220584199181,14cyclictest0-21swapper/33
220584199181,13cyclictest0-21swapper/33
220584199181,13cyclictest0-21swapper/33
220584199181,13cyclictest0-21swapper/33
220584199181,13cyclictest0-21swapper/33
220584199181,13cyclictest0-21swapper/33
220584199181,13cyclictest0-21swapper/33
220584199181,13cyclictest0-21swapper/33
220584199180,15cyclictest0-21swapper/33
220584199180,14cyclictest0-21swapper/33
220584199180,14cyclictest0-21swapper/33
26201212171,4sleep134-21ksoftirqd/11
26201212171,4sleep134-21ksoftirqd/11
24809472176,2sleep0171rcu_preempt0
220584199172,13cyclictest0-21swapper/33
2205841991711,4cyclictest0-21swapper/33
220584199171,14cyclictest0-21swapper/33
2205841991711,3cyclictest0-21swapper/33
220584199171,13cyclictest0-21swapper/33
220584199171,13cyclictest0-21swapper/33
220584199171,13cyclictest0-21swapper/33
220584199171,12cyclictest2240041-21taskset3
220584199171,12cyclictest0-21swapper/33
220584199170,15cyclictest0-21swapper/33
25521382161,3sleep12552148-21ssh1
25265102161,2sleep00-21swapper/00
25174032161,4sleep12336545-21diskmemload1
23871972160,1sleep20-21swapper/22
22979132161,5sleep22297969-21sed2
220584199168,5cyclictest2309380-21chrt3
220584199161,3cyclictest0-21swapper/33
220584199161,11cyclictest0-21swapper/33
220584199160,13cyclictest0-21swapper/33
220584199160,13cyclictest0-21swapper/33
220584199160,13cyclictest0-21swapper/33
26995962151,2sleep00-21swapper/00
26572112151,2sleep00-21swapper/00
25817302151,10sleep12583490-21sh1
25755682151,9sleep12571345-21/usr/sbin/munin1
25427792150,1sleep10-21swapper/11
25181362151,4sleep02518150-21ssh0
25099372156,5sleep2431ktimers/22
24569912151,10sleep12457004-21rm1
24379432151,3sleep20-21swapper/22
23972952151,3sleep20-21swapper/22
23466012151,11sleep00-21swapper/00
2205841991512,2cyclictest0-21swapper/33
2205841991512,1cyclictest0-21swapper/33
220584199150,13cyclictest0-21swapper/33
220584199150,12cyclictest0-21swapper/33
220584199150,12cyclictest0-21swapper/33
26931602141,4sleep22336545-21diskmemload2
26123072141,9sleep22336545-21diskmemload2
25581772141,8sleep12558236-21ntpq1
25073432140,3sleep12336545-21diskmemload1
24974952141,6sleep22497595-21ntpq2
24396102141,9sleep02439625-21ssh0
24204142140,3sleep10-21swapper/11
23446122141,8sleep12336545-21diskmemload1
23094852140,1sleep00-21swapper/00
22514932141,8sleep12251617-21perl1
22284352141,8sleep12228442-21sensors_temp1
220584199140,12cyclictest0-21swapper/33
26738412131,7sleep22336545-21diskmemload2
26499072131,2sleep20-21swapper/22
26028672131,7sleep12336545-21diskmemload1
25865802130,4sleep22586595-21ssh2
25539722131,7sleep02553999-21apt-get0
25183022131,8sleep22518313-21ssh2
24903092131,6sleep00-21swapper/00
24901752136,4sleep12490176-21sh1
22228002131,6sleep22222841-21ntpq2
22228002131,6sleep22222841-21ntpq2
2205841991311,1cyclictest0-21swapper/33
220584199130,2cyclictest0-21swapper/33
220584199130,1cyclictest0-21swapper/33
26848452121,7sleep02685069-21hddtemp_smartct0
26639622121,7sleep12336545-21diskmemload1
26443052121,5sleep12645241-21memory1
26031182121,7sleep22603130-21rm2
25962402121,7sleep12596252-21sh1
25854222121,7sleep02585436-21ssh0
25701742121,3sleep22570185-21ssh2
25684882121,2sleep10-21swapper/11
25582392121,5sleep22558303-21ntpq2
25334372121,7sleep12533451-21sh1
24816162121,6sleep10-21swapper/11
24742912121,7sleep12474302-21ssh1
24497302121,5sleep22449749-21apt-get2
24291482121,7sleep22336545-21diskmemload2
24139442121,5sleep00-21swapper/00
24063202121,3sleep12406331-21ssh1
23871732121,7sleep02387187-21ssh0
23538202121,3sleep22353827-21ssh2
23207942121,7sleep02320896-21cpuspeed_turbos0
22768942121,7sleep22276966-21xargs2
22446012121,5sleep12244639-21ntpq1
22401822123,5sleep02240064-31frcode0
22349992122,5sleep12235018-21apt-get1
26982122111,4sleep12336545-21diskmemload1
26897412111,3sleep10-21swapper/11
26591082111,6sleep02659314-21cut0
26287392111,4sleep22336545-21diskmemload2
26131832111,6sleep12336545-21diskmemload1
25513972110,2sleep00-21swapper/00
25457172111,7sleep20-21swapper/22
24818202111,4sleep22336545-21diskmemload2
24661542110,5sleep00-21swapper/00
24475812111,4sleep12336545-21diskmemload1
24329582111,3sleep12433416-21kthreadcore1
24084072111,6sleep22408520-21kthreadcore2
24049892110,4sleep20-21swapper/22
23946162110,2sleep10-21swapper/11
23759082111,5sleep12375967-21ntpq1
23711562111,5sleep02371170-21ssh0
23707812111,4sleep22336545-21diskmemload2
23635702111,6sleep12363773-21cut1
23617962110,3sleep02361808-21ssh0
23372462111,6sleep02337426-21sed0
23194152111,5sleep02319504-21ntpq0
23031922110,3sleep12303249-21ntp_kernel_err1
22978632111,5sleep12297911-21ntpq1
22725662111,7sleep12272638-21cpuspeed_turbos1
22487612111,5sleep12249790-21memory1
22390852111,5sleep22239131-21ntpq2
22134032111,5sleep02213656-21df0
26757772101,4sleep12336545-21diskmemload1
26740302101,4sleep12336545-21diskmemload1
26640212101,4sleep22336545-21diskmemload2
26555392101,4sleep12336545-21diskmemload1
26470672100,3sleep20-21swapper/22
26374412100,1sleep20-21swapper/22
26311212101,3sleep10-21swapper/11
26216432101,3sleep00-21swapper/00
26216432101,3sleep00-21swapper/00
26198802101,4sleep22336545-21diskmemload2
26198802101,4sleep22336545-21diskmemload2
26141932101,3sleep00-21swapper/00
26056262101,6sleep02605640-21ssh0
25947172100,1sleep20-21swapper/22
25779762101,5sleep22577986-21ssh2
25701982100,6sleep02570212-21ssh0
25430112100,2sleep00-21swapper/00
25331262101,3sleep00-21swapper/00
25276862100,3sleep272-21kcompactd02
24984482101,2sleep10-21swapper/11
24885362101,5sleep22488588-21ntpq2
24748112101,3sleep00-21swapper/00
24648752101,4sleep22336545-21diskmemload2
24634782101,2sleep10-21swapper/11
24473902101,2sleep20-21swapper/22
24416012101,3sleep00-21swapper/00
24296702101,3sleep00-21swapper/00
24221082101,2sleep20-21swapper/22
24204022101,4sleep02336545-21diskmemload0
24039712101,3sleep02336545-21diskmemload0
23908102101,4sleep02392511-21ssh0
23788612101,3sleep00-21swapper/00
23768062101,2sleep20-21swapper/22
23601182101,4sleep12336545-21diskmemload1
23543132101,4sleep22336545-21diskmemload2
23533992101,3sleep12336545-21diskmemload1
23359432100,6sleep12331488-21/usr/sbin/munin1
23210622101,4sleep22321271-21hddtemp_smartct2
22885522101,3sleep22288571-21apt-get2
22828582101,3sleep172-21kcompactd01
22341862100,1sleep00-21swapper/00
22124672101,4sleep22213185-21df_inode2
2690149290,2sleep20-21swapper/22
2680776291,2sleep00-21swapper/00
2672872291,4sleep02672886-21ssh0
2641187291,2sleep00-21swapper/00
2638332291,3sleep12336545-21diskmemload1
2577313291,4sleep02577326-21ssh0
2525134291,3sleep12336545-21diskmemload1
2473174290,3sleep22336545-21diskmemload2
2455948291,3sleep00-21swapper/00
2385639291,3sleep12385650-21ssh1
2342663291,2sleep20-21swapper/22
2315455290,1sleep20-21swapper/22
2304241291,4sleep02304351-21cat0
2291212291,4sleep02292420-21/usr/sbin/munin0
2288879291,5sleep10-21swapper/11
2278921291,5sleep02280650-21kthreadcore0
2269901290,1sleep10-21swapper/11
2252677291,5sleep02254444-21kthreadcore0
2250711290,3sleep00-21swapper/00
2230934291,5sleep22232722-21kthreadcore2
2227264290,1sleep20-21swapper/22
2224624291,4sleep02225483-21kthreadcore0
2210416291,3sleep12210487-21find1
2206712291,4sleep02208388-21cut0
2629612280,5sleep00-21swapper/00
2595388280,1sleep00-21swapper/00
2331487280,2sleep20-21swapper/22
2311483281,3sleep22313262-21cut2
2310277281,3sleep02310393-21irqstats0
2294137281,3sleep02294351-21smartctl0
2287253281,3sleep22287304-21ntpq2
2272544281,2sleep00-21swapper/00
2272206280,1sleep20-21swapper/22
2255997280,1sleep20-21swapper/22
2229961281,3sleep12230933-21cut1
2211160281,3sleep12211409-21kthreadcore1
2335594270,3sleep00-21swapper/00
2326122270,1sleep20-21swapper/22
2320346270,1sleep10-21swapper/11
2310394270,4sleep12310429-21kthreadcore1
2309530270,1sleep10-21swapper/11
2304511270,1sleep20-21swapper/22
2304001270,1sleep20-21swapper/22
2283383271,3sleep0221rcuc/00
2272066270,1sleep00-21swapper/00
2266807270,4sleep10-21swapper/11
2261582270,1sleep20-21swapper/22
2261371270,1sleep10-21swapper/11
2257676271,2sleep00-21swapper/00
2250072271,3sleep22250193-21sendmail_mailqu2
2241688271,2sleep20-21swapper/22
2223680270,1sleep10-21swapper/11
2223680270,1sleep10-21swapper/11
2223679270,3sleep072-21kcompactd00
2223679270,3sleep072-21kcompactd00
2211086270,1sleep20-21swapper/22
2330867260,1sleep10-21swapper/11
2266928260,1sleep20-21swapper/22
2330974250,3sleep00-21swapper/00
2320901250,1sleep10-21swapper/11
2283498250,1sleep10-21swapper/11
2281755250,1sleep20-21swapper/22
2240844250,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional