You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 04:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat Apr 04, 2026 00:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
568507212364,55sleep30-21swapper/33
56876628466,12sleep10-21swapper/11
56869428062,12sleep20-21swapper/22
56865127351,17sleep00-21swapper/00
56895999231,18cyclictest0-21swapper/33
568959992211,7cyclictest875029-21chrt3
56895999211,16cyclictest961015-21taskset3
56895999211,16cyclictest961015-21taskset3
56895999211,15cyclictest0-21swapper/33
56895999210,18cyclictest0-21swapper/33
56895999210,18cyclictest0-21swapper/33
56895999210,17cyclictest0-21swapper/33
568959992018,1cyclictest0-21swapper/33
568959992017,1cyclictest0-21swapper/33
568959992015,3cyclictest0-21swapper/33
568959992012,5cyclictest0-21swapper/33
56895999201,15cyclictest0-21swapper/33
56895999201,15cyclictest0-21swapper/33
56895999200,16cyclictest66950irq/132-enp1s0-TxRx-33
56895999199,3cyclictest0-21swapper/33
568959991915,2cyclictest0-21swapper/33
56895999191,15cyclictest0-21swapper/33
56895999191,15cyclictest0-21swapper/33
56895999191,15cyclictest0-21swapper/33
56895999191,15cyclictest0-21swapper/33
56895999191,14cyclictest0-21swapper/33
56895999191,14cyclictest0-21swapper/33
56895999191,14cyclictest0-21swapper/33
56895999187,8cyclictest640467-21turbostat3
56895999182,12cyclictest699179-21sleep3
56895999181,15cyclictest0-21swapper/33
56895999181,14cyclictest66950irq/132-enp1s0-TxRx-33
56895999181,14cyclictest0-21swapper/33
56895999181,14cyclictest0-21swapper/33
56895999181,14cyclictest0-21swapper/33
56895999181,14cyclictest0-21swapper/33
56895999181,14cyclictest0-21swapper/33
56895999181,14cyclictest0-21swapper/33
56895999181,14cyclictest0-21swapper/33
56895999181,14cyclictest0-21swapper/33
56895999181,14cyclictest0-21swapper/33
56895999181,13cyclictest0-21swapper/33
56895999181,13cyclictest0-21swapper/33
56895999180,15cyclictest66950irq/132-enp1s0-TxRx-33
56895999180,14cyclictest0-21swapper/33
10214132181,2sleep00-21swapper/00
10124162181,3sleep00-21swapper/00
8898632171,2sleep00-21swapper/00
8398922171,7sleep1699158-21diskmemload1
7537602171,12sleep2755414-21kthreadcore2
7037572172,8sleep0703819-21ntpq0
56895999171,4cyclictest0-21swapper/33
56895999171,4cyclictest0-21swapper/33
568959991713,2cyclictest0-21swapper/33
56895999171,13cyclictest0-21swapper/33
56895999171,12cyclictest0-21swapper/33
56895999170,14cyclictest0-21swapper/33
56895999170,14cyclictest0-21swapper/33
56895999170,13cyclictest0-21swapper/33
56895999170,13cyclictest0-21swapper/33
56895999170,13cyclictest0-21swapper/33
10327192171,3sleep00-21swapper/00
9853042161,8sleep2985363-21ntpq2
8976282161,8sleep2897781-21sh2
8130692161,4sleep2699158-21diskmemload2
7423872161,4sleep1699158-21diskmemload1
7419512161,5sleep2741964-21sh2
7252142161,2sleep00-21swapper/00
7134312161,3sleep00-21swapper/00
7044562161,2sleep20-21swapper/22
6253652160,2sleep1321rcuc/11
56895999161,3cyclictest0-21swapper/33
568959991611,3cyclictest0-21swapper/33
56895999161,13cyclictest0-21swapper/33
56895999161,12cyclictest0-21swapper/33
56895999161,11cyclictest6776952sleep33
56895999161,11cyclictest6776952sleep33
568959991610,4cyclictest0-21swapper/33
56895999160,13cyclictest0-21swapper/33
56895999160,13cyclictest0-21swapper/33
56895999160,13cyclictest0-21swapper/33
10678732161,4sleep1699158-21diskmemload1
8982112151,6sleep1898222-21ssh1
8669792151,2sleep00-21swapper/00
8563452151,3sleep20-21swapper/22
8563452151,3sleep20-21swapper/22
8317222151,3sleep20-21swapper/22
8201922151,4sleep1699158-21diskmemload1
8200422151,9sleep2699158-21diskmemload2
7950082151,9sleep1699158-21diskmemload1
7574502151,2sleep00-21swapper/00
7221292151,10sleep2722140-21ssh2
56895999151,3cyclictest0-21swapper/33
568959991511,2cyclictest0-21swapper/33
56895999150,13cyclictest0-21swapper/33
56895999150,13cyclictest0-21swapper/33
56895999150,12cyclictest0-21swapper/33
10578172151,3sleep1699158-21diskmemload1
10578172151,3sleep1699158-21diskmemload1
10422622152,10sleep11042397-21cut1
9609472142,2sleep1699158-21diskmemload1
9609472142,2sleep1699158-21diskmemload1
9522572141,9sleep1952268-21ssh1
8495072141,8sleep1849725-21expr1
8495072141,8sleep1849725-21expr1
8017822141,2sleep20-21swapper/22
7949652141,2sleep20-21swapper/22
7746372141,9sleep2774692-21ntpq2
7307672140,8sleep2699158-21diskmemload2
56895999149,3cyclictest0-21swapper/33
56895999140,2cyclictest0-21swapper/33
10413672143,7sleep2699158-21diskmemload2
10319252141,3sleep21031933-21ssh2
9677252131,6sleep2967782-21ntpq2
9286062130,3sleep2699158-21diskmemload2
9010952131,8sleep0901110-21ssh0
8583522131,7sleep1858619-21df1
8035932131,3sleep1803604-21ssh1
7663872131,5sleep20-21swapper/22
7330982131,6sleep1699158-21diskmemload1
7132912131,7sleep1699158-21diskmemload1
6927692131,8sleep0692807-21ntpq0
6714412131,6sleep0671482-21ntpq0
6291322131,7sleep2629316-21cat2
6120002131,8sleep1612738-21sed1
56895999130,2cyclictest0-21swapper/33
56895999130,10cyclictest5839572sleep33
10659062131,3sleep21065918-21ssh2
10381762131,8sleep01038240-21collect20
10090192131,8sleep21010652-21cut2
9781902121,7sleep1699158-21diskmemload1
9551022121,6sleep0955211-21fschecks_time0
9551022121,6sleep0955211-21fschecks_time0
9501462121,5sleep0950252-21modprobe0
9429382120,8sleep10-21swapper/11
9109942121,5sleep2699158-21diskmemload2
9093722121,5sleep20-21swapper/22
8898242121,7sleep1699158-21diskmemload1
8887322121,6sleep2888792-21ntpq2
8756532121,3sleep1875664-21ssh1
8126482121,6sleep1699158-21diskmemload1
7684422121,6sleep0699158-21diskmemload0
7519332120,2sleep10-21swapper/11
7048032121,6sleep1699158-21diskmemload1
6984872121,7sleep2698763-21unixbench_singl2
6884022120,1sleep10-21swapper/11
6466182121,7sleep1647037-21grep1
6341812121,5sleep2634230-21ntpq2
10526812121,7sleep01054324-21cut0
10526812121,7sleep01054324-21cut0
9964822111,3sleep00-21swapper/00
9948862111,4sleep1699158-21diskmemload1
9852362111,6sleep1985303-21ld1
9346672111,5sleep1699158-21diskmemload1
9177322111,5sleep1699158-21diskmemload1
8822812111,4sleep00-21swapper/00
8756652111,4sleep2699158-21diskmemload2
8583162111,5sleep0858340-21apt-get0
8199762111,4sleep0699158-21diskmemload0
7792272111,5sleep1779262-21ssh1
7703812111,5sleep1699158-21diskmemload1
7576112111,4sleep1699158-21diskmemload1
7516752111,5sleep00-21swapper/00
7508372111,3sleep20-21swapper/22
7399932110,1sleep00-21swapper/00
6727932111,4sleep0673054-21df_inode0
6727932111,4sleep0673054-21df_inode0
6664202111,6sleep0666565-21ls0
6447942111,5sleep2644843-21ntpq2
6412492111,6sleep1641629-21kthreadcore1
5978542111,5sleep2597880-21munin-run2
5869282111,5sleep0586976-21munin-run0
5748602110,2sleep10-21swapper/11
10650222111,2sleep00-21swapper/00
10482282111,3sleep10-21swapper/11
10148992112,1sleep1171rcu_preempt1
9961602101,5sleep2996174-21ssh2
9772582101,3sleep00-21swapper/00
9713782101,3sleep1699158-21diskmemload1
9710092101,3sleep00-21swapper/00
9547952101,4sleep2954819-21apt-get2
9547952101,4sleep2954819-21apt-get2
9460352101,3sleep20-21swapper/22
9428992100,3sleep20-21swapper/22
9425122101,3sleep00-21swapper/00
9336902101,5sleep0933700-21ssh0
9239902101,4sleep2924040-21ssh2
9191292101,3sleep00-21swapper/00
9103682100,2sleep00-21swapper/00
9026272101,6sleep1902771-21gltestperf1
8722952101,4sleep2699158-21diskmemload2
8670452101,5sleep1867067-21/usr/sbin/munin1
8452932101,2sleep10-21swapper/11
8411052101,3sleep20-21swapper/22
8407712101,6sleep0840997-21sh0
8288572101,3sleep2699158-21diskmemload2
8271632101,4sleep1699158-21diskmemload1
8235012101,5sleep0823737-21kthreadcore0
8056082101,4sleep0805744-21diskstats0
7943302101,3sleep00-21swapper/00
7844202101,4sleep2699158-21diskmemload2
6781722101,5sleep0678388-21diskstats0
6625932101,5sleep2663161-21kthreadcore2
6514832101,5sleep1651685-21diskstats1
6244212101,3sleep00-21swapper/00
6039462101,4sleep0604017-21irqstats0
6021882101,4sleep2602236-21ntpq2
10513172101,3sleep2699158-21diskmemload2
10513172101,3sleep2699158-21diskmemload2
10477862100,1sleep20-21swapper/22
10306092101,5sleep1699158-21diskmemload1
10243772101,3sleep2699158-21diskmemload2
10211722101,3sleep1699158-21diskmemload1
10063752101,4sleep2699158-21diskmemload2
10052192101,5sleep01005233-21ssh0
987790291,4sleep0987801-21ssh0
972317291,4sleep2972519-21expr2
925119291,2sleep00-21swapper/00
865292291,2sleep20-21swapper/22
849474291,4sleep0849506-21ssh0
849474291,4sleep0849506-21ssh0
836692291,4sleep0836706-21ssh0
803885291,2sleep00-21swapper/00
784960291,3sleep0699158-21diskmemload0
770761291,4sleep0770941-21sed0
767034291,3sleep1699158-21diskmemload1
731108291,4sleep0731110-21ssh0
724307290,1sleep10-21swapper/11
714326291,3sleep2699158-21diskmemload2
698136291,4sleep0698183-21ntpq0
689348291,5sleep1690869-21kthreadcore1
683447291,4sleep2683703-21df2
640236290,4sleep00-21swapper/00
630384291,4sleep0630086-21/usr/sbin/munin0
619426291,4sleep1619445-21apt-get1
614126291,5sleep0614371-21cstates0
612739291,4sleep2612830-21ntpq2
603048290,1sleep00-21swapper/00
592749291,3sleep1592241-21apt-get1
573664291,4sleep2573877-21users2
1048118291,2sleep00-21swapper/00
1005333290,3sleep10-21swapper/11
927312281,2sleep1699158-21diskmemload1
688416280,1sleep00-21swapper/00
682513281,3sleep1682784-21awk1
658826280,4sleep00-21swapper/00
657027281,3sleep1657246-21idleruntime1
656726280,2sleep20-21swapper/22
656292280,2sleep00-21swapper/00
639359281,3sleep1639453-21modprobe1
634132280,3sleep1634173-21ntpq1
598113280,2sleep10-21swapper/11
591361281,4sleep1591484-21mailstats1
582447281,3sleep2583956-21kthreadcore2
577671281,3sleep2579403-21grep2
570290281,3sleep00-21swapper/00
699057270,1sleep10-21swapper/11
677698270,1sleep10-21swapper/11
677698270,1sleep10-21swapper/11
668157271,3sleep1669830-21cut1
645778270,1sleep00-21swapper/00
618915270,1sleep20-21swapper/22
603464271,2sleep10-21swapper/11
587185270,2sleep20-21swapper/22
574440271,3sleep00-21swapper/00
693122260,3sleep20-21swapper/22
677535260,2sleep20-21swapper/22
677535260,2sleep20-21swapper/22
666907260,1sleep10-21swapper/11
656432260,4sleep20-21swapper/22
635978260,3sleep2636014-21kthreadcore2
624756260,2sleep00-21swapper/00
620485261,2sleep20-21swapper/22
610242261,2sleep00-21swapper/00
605311260,2sleep2607118-21kthreadcore2
573557261,2sleep10-21swapper/11
649981250,1sleep00-21swapper/00
646093250,1sleep20-21swapper/22
592302250,2sleep00-21swapper/00
581865250,1sleep10-21swapper/11
678094240,1sleep20-21swapper/22
667113240,1sleep20-21swapper/22
614372240,1sleep10-21swapper/11
587388240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional