You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-15 - 22:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Fri May 15, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
95992721380,3sleep1331ktimers/11
490889212959,65sleep30-21swapper/33
491013210892,10sleep10-21swapper/11
49101928555,12sleep20-21swapper/22
49113727858,14sleep00-21swapper/00
491325992523,1cyclictest0-21swapper/33
491325992422,1cyclictest0-21swapper/33
491325992422,1cyclictest0-21swapper/33
491325992417,4cyclictest66950irq/132-enp1s0-TxRx-33
491325992411,10cyclictest0-21swapper/33
9322862231,3sleep10-21swapper/11
49132599238,12cyclictest0-21swapper/33
491325992319,2cyclictest0-21swapper/33
49132599231,18cyclictest939691-21chrt3
491325992214,4cyclictest916748-21taskset3
9597582211,9sleep0959924-21apt-config0
49132599215,13cyclictest0-21swapper/33
491325992119,1cyclictest0-21swapper/33
491325992112,7cyclictest0-21swapper/33
49132599211,17cyclictest0-21swapper/33
49132599211,16cyclictest66950irq/132-enp1s0-TxRx-33
491325992018,1cyclictest0-21swapper/33
491325992018,1cyclictest0-21swapper/33
491325992018,1cyclictest0-21swapper/33
491325992018,1cyclictest0-21swapper/33
491325992017,1cyclictest0-21swapper/33
491325992017,1cyclictest0-21swapper/33
491325992017,1cyclictest0-21swapper/33
49132599201,6cyclictest8044042sleep33
491325992014,3cyclictest694907-21taskset3
49132599200,16cyclictest678032-21taskset3
8831612190,7sleep1321rcuc/11
7200422190,2sleep10-21swapper/11
7120392191,9sleep2712052-21ssh2
6897122192,5sleep1689741-21apt-get1
491325991917,1cyclictest0-21swapper/33
491325991917,1cyclictest0-21swapper/33
491325991916,2cyclictest0-21swapper/33
491325991916,1cyclictest0-21swapper/33
491325991916,1cyclictest0-21swapper/33
491325991916,1cyclictest0-21swapper/33
491325991914,2cyclictest0-21swapper/33
49132599191,15cyclictest66950irq/132-enp1s0-TxRx-33
49132599191,14cyclictest737109-21taskset3
49132599191,14cyclictest66950irq/132-enp1s0-TxRx-33
491325991911,4cyclictest0-21swapper/33
49132599191,14cyclictest0-21swapper/33
9745952181,3sleep20-21swapper/22
5993132181,11sleep0599361-21ntpq0
49132599189,5cyclictest66950irq/132-enp1s0-TxRx-33
49132599182,14cyclictest66950irq/132-enp1s0-TxRx-33
491325991816,1cyclictest0-21swapper/33
491325991816,1cyclictest0-21swapper/33
491325991816,1cyclictest0-21swapper/33
491325991814,2cyclictest0-21swapper/33
491325991813,2cyclictest0-21swapper/33
49132599181,14cyclictest0-21swapper/33
49132599181,13cyclictest0-21swapper/33
49132599180,15cyclictest0-21swapper/33
8728312171,10sleep0621658-21diskmemload0
8649472171,4sleep0621658-21diskmemload0
8326382171,3sleep10-21swapper/11
7792312171,5sleep2431ktimers/22
6949492171,3sleep20-21swapper/22
5153802176,7sleep0516453-21tr0
49132599174,1cyclictest0-21swapper/33
491325991715,1cyclictest0-21swapper/33
491325991714,1cyclictest0-21swapper/33
491325991714,1cyclictest0-21swapper/33
491325991713,2cyclictest0-21swapper/33
49132599171,13cyclictest0-21swapper/33
49132599170,13cyclictest0-21swapper/33
8974122161,3sleep10-21swapper/11
8458992161,5sleep2845957-21ntp_kernel_pll_2
8241882160,6sleep00-21swapper/00
7825342160,7sleep10-21swapper/11
7115782161,2sleep00-21swapper/00
6900272161,4sleep0690242-21hddtemp_smartct0
6273922161,3sleep00-21swapper/00
60539321610,4sleep2520726-21kworker/2:0+events_freezable2
491325991614,1cyclictest0-21swapper/33
491325991614,1cyclictest0-21swapper/33
491325991614,1cyclictest0-21swapper/33
49132599161,3cyclictest0-21swapper/33
491325991613,1cyclictest0-21swapper/33
491325991613,1cyclictest0-21swapper/33
49132599161,13cyclictest0-21swapper/33
49132599161,12cyclictest0-21swapper/33
9499952150,1sleep10-21swapper/11
9420242150,1sleep20-21swapper/22
9230122150,3sleep10-21swapper/11
8882612152,7sleep0888312-21ntpq0
8230632151,11sleep1823073-21rm1
7732702152,2sleep1171rcu_preempt1
7316692151,7sleep1731897-21df_inode1
6616032151,10sleep0661617-21ssh0
6483882151,7sleep00-21swapper/00
5727282151,5sleep2572783-21ntpq2
491325991512,1cyclictest0-21swapper/33
49132599151,12cyclictest0-21swapper/33
491325991510,3cyclictest0-21swapper/33
49132599150,13cyclictest0-21swapper/33
49132599150,13cyclictest0-21swapper/33
9762942141,8sleep1621658-21diskmemload1
9431742141,8sleep0621658-21diskmemload0
8902462146,4sleep1890257-21sh1
8582252141,8sleep2858306-21cat2
6376302141,2sleep20-21swapper/22
9503472131,7sleep2621658-21diskmemload2
9155962131,8sleep0621658-21diskmemload0
9051742131,7sleep0905237-21ntpq0
8814582131,7sleep2621658-21diskmemload2
8301572130,9sleep2830167-21ssh2
8124982132,4sleep0171rcu_preempt0
7888362131,8sleep2788850-21ssh2
7748552131,8sleep1776440-21cut1
7625592131,3sleep1762571-21ssh1
6220172132,6sleep2622045-21apt-get2
9693542121,7sleep0969780-21cut0
9249732121,7sleep0621658-21diskmemload0
9174582121,2sleep1917472-21ssh1
8924602122,5sleep0892482-21apt-get0
8830992121,7sleep0883110-21ssh0
8012432121,7sleep1802925-21cut1
7909392120,8sleep2790953-21ssh2
7535942120,3sleep1753597-21ssh1
7401592121,6sleep0740424-21df0
7373582121,6sleep2621658-21diskmemload2
6779212120,3sleep1677931-21ssh1
6716722120,3sleep1671682-21ssh1
6629232120,8sleep1662930-21ssh1
6369002121,7sleep1636912-21sh1
6355642120,3sleep0635576-21ssh0
5510552121,5sleep0551088-21ntpq0
5413992121,6sleep2541434-21awk2
5315472121,7sleep0532447-21cut0
4917772121,6sleep0491880-21perl0
9573082111,3sleep20-21swapper/22
9408582110,6sleep1621658-21diskmemload1
9335272111,2sleep2933541-21ssh2
9144152111,2sleep2621658-21diskmemload2
8740322110,6sleep134-21ksoftirqd/11
8711452111,5sleep2871244-21ntpq2
8469442111,3sleep00-21swapper/00
8403722111,6sleep1621658-21diskmemload1
8298562111,4sleep0621658-21diskmemload0
8051302111,3sleep00-21swapper/00
7980792111,6sleep0798089-21ssh0
7665242111,6sleep2767606-21kthreadcore2
7650382111,6sleep0765050-21ssh0
7478262111,7sleep1747838-21rm1
7286272110,1sleep00-21swapper/00
7150732111,5sleep0715204-21diskstats0
7122222111,6sleep1621658-21diskmemload1
6862842111,5sleep10-21swapper/11
6851692111,5sleep0685229-21ntpq0
6557012111,4sleep2621658-21diskmemload2
6547282110,3sleep1654742-21ssh1
6463662111,4sleep10-21swapper/11
6050322111,6sleep1605287-21sed1
5993632111,6sleep1595294-21/usr/sbin/munin1
5897182114,4sleep20-21swapper/22
5886182111,5sleep1588706-21ntpq1
5794742111,5sleep0579585-21diskstats0
5728372110,8sleep0572960-21mailstats0
9666032101,3sleep072-21kcompactd00
9412182101,3sleep00-21swapper/00
9262322101,4sleep0621658-21diskmemload0
9220802101,4sleep2922139-21ntpq2
9060322101,3sleep10-21swapper/11
8979962101,4sleep2621658-21diskmemload2
8892552101,4sleep2621658-21diskmemload2
8627952101,3sleep10-21swapper/11
8552302101,4sleep0621658-21diskmemload0
8457502100,1sleep10-21swapper/11
8170422101,4sleep2818434-21cat2
8123482101,3sleep2621658-21diskmemload2
7967702100,2sleep1171rcu_preempt1
7729282101,4sleep0621658-21diskmemload0
7627632101,2sleep20-21swapper/22
7549302101,3sleep20-21swapper/22
7400672101,3sleep20-21swapper/22
7383442101,3sleep0621658-21diskmemload0
7302822101,4sleep1621658-21diskmemload1
7205812100,3sleep20-21swapper/22
7030232101,4sleep2621658-21diskmemload2
6873942101,4sleep2621658-21diskmemload2
6798812101,3sleep20-21swapper/22
6766562101,5sleep0676696-21ssh0
6715832101,3sleep20-21swapper/22
6524052101,2sleep20-21swapper/22
6453602101,4sleep0621658-21diskmemload0
6445032101,3sleep2621658-21diskmemload2
6286672101,4sleep10-21swapper/11
6065172101,5sleep1607691-21kthreadcore1
5940302101,4sleep1594079-21ntpq1
5790362101,4sleep0579086-21munin-run0
5686182101,4sleep1568637-21apt-get1
5581492101,4sleep0558233-21irqstats0
5297122101,4sleep0529759-21ntpq0
5241642100,1sleep10-21swapper/11
5182542101,6sleep2518802-21/usr/sbin/munin2
5029212101,5sleep0502978-21ntp_states0
4955582101,5sleep2495599-21ntpq2
965727290,1sleep20-21swapper/22
959927291,3sleep1959777-21apt-get1
906138291,2sleep20-21swapper/22
864921291,4sleep2864933-21ssh2
856575291,2sleep10-21swapper/11
838725291,3sleep0621658-21diskmemload0
838473290,2sleep20-21swapper/22
813033291,3sleep1813043-21ssh1
807158290,4sleep20-21swapper/22
784276291,4sleep00-21swapper/00
774184291,4sleep0774212-21apt-get0
756053290,2sleep00-21swapper/00
728506290,1sleep20-21swapper/22
702358291,4sleep0702482-21ssh0
698043291,3sleep1621658-21diskmemload1
671801291,2sleep00-21swapper/00
611279292,3sleep1611298-21apt-get1
578943290,7sleep13599524-21sshd1
547667291,4sleep1549318-21cut1
535085291,4sleep1535133-21ntpq1
531269291,3sleep2531389-21perl2
529767290,5sleep1529823-21ntpq1
524913290,1sleep00-21swapper/00
520176291,5sleep2520183-21cpu2
508258293,3sleep2508307-21gcc2
602160281,3sleep0603947-21cut0
593934281,2sleep00-21swapper/00
591404281,4sleep2593175-21kthreadcore2
558234283,2sleep1559372-21kthreadcore1
541660281,2sleep20-21swapper/22
509499281,3sleep0509717-21cstates0
495435281,3sleep1495552-21ntpq1
621449270,1sleep20-21swapper/22
606107270,3sleep20-21swapper/22
605947270,2sleep00-21swapper/00
588821271,2sleep0588909-21ps0
579295271,2sleep20-21swapper/22
568185270,1sleep10-21swapper/11
563148270,3sleep0562744-21apt-get0
552080270,1sleep10-21swapper/11
546730270,4sleep20-21swapper/22
529825271,3sleep20-21swapper/22
519775270,1sleep10-21swapper/11
514341270,1sleep20-21swapper/22
621329260,4sleep00-21swapper/00
616605260,2sleep10-21swapper/11
611301260,3sleep2611404-21cpuspeed_turbos2
568335261,2sleep20-21swapper/22
562498260,1sleep20-21swapper/22
557374260,4sleep20-21swapper/22
552360261,2sleep00-21swapper/00
541332260,1sleep00-21swapper/00
504151260,2sleep10-21swapper/11
503511260,1sleep10-21swapper/11
611570250,2sleep00-21swapper/00
595378250,1sleep20-21swapper/22
579586250,1sleep10-21swapper/11
574146250,2sleep20-21swapper/22
546728250,3sleep00-21swapper/00
540240250,1sleep10-21swapper/11
509219250,1sleep10-21swapper/11
508792250,1sleep00-21swapper/00
498820250,1sleep20-21swapper/22
542011240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional