You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-03 - 02:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Wed Jun 03, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
436849211962,53sleep30-21swapper/33
43704028353,11sleep10-21swapper/11
43692128264,12sleep20-21swapper/22
43703927855,6sleep00-21swapper/00
8175032740,2sleep0221rcuc/00
437299992421,1cyclictest0-21swapper/33
43729999222,16cyclictest0-21swapper/33
43729999221,17cyclictest0-21swapper/33
437299992117,2cyclictest0-21swapper/33
437299992111,7cyclictest867601-21taskset3
43729999211,16cyclictest814313-21taskset3
43729999211,16cyclictest66950irq/132-enp1s0-TxRx-33
43729999211,16cyclictest0-21swapper/33
43729999207,11cyclictest0-21swapper/33
43729999201,2cyclictest0-21swapper/33
43729999201,15cyclictest0-21swapper/33
43729999201,15cyclictest0-21swapper/33
437299992010,7cyclictest683080-21taskset3
437299992010,7cyclictest683080-21taskset3
437299991917,1cyclictest0-21swapper/33
437299991915,2cyclictest0-21swapper/33
437299991915,2cyclictest0-21swapper/33
437299991911,5cyclictest0-21swapper/33
43729999191,14cyclictest0-21swapper/33
43729999191,14cyclictest0-21swapper/33
43729999191,14cyclictest0-21swapper/33
43729999191,14cyclictest0-21swapper/33
43729999191,14cyclictest0-21swapper/33
43729999190,16cyclictest0-21swapper/33
43729999190,15cyclictest0-21swapper/33
73043021811,2sleep30-21swapper/33
43729999189,5cyclictest527070-21turbostat3
43729999182,13cyclictest0-21swapper/33
43729999181,15cyclictest0-21swapper/33
43729999181,14cyclictest0-21swapper/33
43729999181,14cyclictest0-21swapper/33
43729999181,14cyclictest0-21swapper/33
43729999181,14cyclictest0-21swapper/33
43729999181,14cyclictest0-21swapper/33
43729999181,14cyclictest0-21swapper/33
43729999181,14cyclictest0-21swapper/33
43729999181,13cyclictest0-21swapper/33
43729999181,13cyclictest0-21swapper/33
43729999181,13cyclictest0-21swapper/33
43729999180,14cyclictest0-21swapper/33
7396782171,11sleep1740104-21grep1
7030572171,8sleep0703069-21ssh0
5849872171,4sleep0585122-21sendmail_mailst0
43729999177,7cyclictest549115-21chrt3
43729999177,7cyclictest531432-21chrt3
437299991712,3cyclictest450816-21taskset3
437299991711,3cyclictest0-21swapper/33
43729999171,13cyclictest0-21swapper/33
43729999171,13cyclictest0-21swapper/33
43729999170,14cyclictest0-21swapper/33
43729999170,14cyclictest0-21swapper/33
43729999170,14cyclictest0-21swapper/33
9120452161,5sleep0554013-21diskmemload0
8177852161,3sleep10-21swapper/11
7991152161,5sleep0554013-21diskmemload0
7712822160,6sleep00-21swapper/00
7205342161,3sleep20-21swapper/22
6999612161,4sleep1554013-21diskmemload1
6563252161,2sleep10-21swapper/11
5954372161,3sleep0554013-21diskmemload0
5790862160,1sleep20-21swapper/22
5790862160,1sleep20-21swapper/22
43729999161,14cyclictest0-21swapper/33
43729999161,13cyclictest0-21swapper/33
43729999160,14cyclictest0-21swapper/33
43729999160,13cyclictest4679072sleep33
43729999160,13cyclictest0-21swapper/33
8316752150,2sleep00-21swapper/00
8221102155,6sleep0822168-21/usr/sbin/munin0
7107522152,8sleep0554013-21diskmemload0
6847172151,8sleep0554013-21diskmemload0
6847172151,8sleep0554013-21diskmemload0
5702822150,1sleep00-21swapper/00
5700482151,2sleep20-21swapper/22
43729999152,8cyclictest479092-21taskset3
437299991512,1cyclictest0-21swapper/33
43729999151,11cyclictest0-21swapper/33
43729999151,11cyclictest0-21swapper/33
43729999150,13cyclictest0-21swapper/33
43729999150,13cyclictest0-21swapper/33
43729999150,12cyclictest0-21swapper/33
43729999150,12cyclictest0-21swapper/33
9136262141,8sleep0913512-21apt-get0
8789242141,4sleep1554013-21diskmemload1
8686262141,9sleep0554013-21diskmemload0
8434422141,3sleep0843456-21ssh0
6860802140,2sleep20-21swapper/22
6762512142,7sleep1554013-21diskmemload1
6323142141,2sleep10-21swapper/11
6312222141,3sleep2554013-21diskmemload2
6119092141,8sleep0554013-21diskmemload0
5893822140,2sleep10-21swapper/11
43729999143,7cyclictest0-21swapper/33
437299991411,2cyclictest0-21swapper/33
43729999140,12cyclictest0-21swapper/33
43729999140,12cyclictest0-21swapper/33
9032182130,2sleep20-21swapper/22
8505362130,7sleep10-21swapper/11
8158602131,8sleep1815872-21ssh1
7834762131,8sleep0784639-21cut0
7820282131,6sleep00-21swapper/00
7561972131,8sleep2554013-21diskmemload2
7444892130,2sleep20-21swapper/22
6583322131,3sleep0658343-21ssh0
6201172131,6sleep0620173-21/usr/sbin/munin0
6050372131,3sleep1605048-21ssh1
5885322131,8sleep1554013-21diskmemload1
5883822130,2sleep20-21swapper/22
43729999137,3cyclictest494413-21chrt3
43729999130,1cyclictest0-21swapper/33
9069222121,7sleep2908613-21grep2
9033562121,6sleep1554013-21diskmemload1
8348232121,7sleep2554013-21diskmemload2
8184312121,7sleep2818806-21ssh2
8086872121,7sleep0808703-21cron0
7972062121,6sleep1554013-21diskmemload1
7957782121,6sleep2795827-21ntpq2
7814992121,8sleep2554013-21diskmemload2
7793482121,7sleep1554013-21diskmemload1
7637072121,3sleep2763718-21ssh2
7626782121,2sleep10-21swapper/11
7542422121,2sleep00-21swapper/00
7307982121,2sleep10-21swapper/11
6683232121,7sleep2668526-21sed2
6483752121,2sleep00-21swapper/00
6401602121,5sleep2554013-21diskmemload2
6339862121,7sleep1634217-21tr1
6304362122,4sleep0554013-21diskmemload0
6074702121,7sleep1607665-21ssh1
6035992121,7sleep0554013-21diskmemload0
5981192121,7sleep2598221-21expr2
5676462121,5sleep10-21swapper/11
5611912121,3sleep1561202-21ssh1
5529962121,5sleep2553043-21ntpq2
5011442121,6sleep1501214-21irqstats1
4568762121,7sleep1456877-21sshd1
4494002121,2sleep0445475-21/usr/sbin/munin0
9219332111,4sleep2554013-21diskmemload2
8857222111,6sleep2885736-21ssh2
8478352110,2sleep2848133-21strings2
8066262110,1sleep10-21swapper/11
8062862111,4sleep20-21swapper/22
7827702111,4sleep1554013-21diskmemload1
7270352111,7sleep1727049-21ssh1
6484972111,7sleep2648510-21ssh2
6140642111,4sleep2554013-21diskmemload2
5738572114,4sleep0151ktimers/00
5738572114,4sleep0151ktimers/00
5174182111,6sleep0519093-21kthreadcore0
5100772110,2sleep10-21swapper/11
4671072111,5sleep0467155-21ntpq0
4579992111,6sleep0458093-21fschecks_time0
4415022111,5sleep2441553-21ntpq2
9191822101,3sleep10-21swapper/11
9106442101,4sleep1554013-21diskmemload1
9017782101,3sleep00-21swapper/00
8927052101,4sleep2554013-21diskmemload2
8918942101,4sleep0554013-21diskmemload0
8862062100,2sleep00-21swapper/00
8761762101,3sleep10-21swapper/11
8758372101,3sleep20-21swapper/22
8670402101,3sleep2554013-21diskmemload2
8532772101,5sleep2853379-21ps2
8527362101,2sleep10-21swapper/11
8152602101,4sleep2554013-21diskmemload2
7724182101,3sleep2554013-21diskmemload2
7266302101,5sleep0726641-21ssh0
7260742101,5sleep2726254-21awk2
7090742100,1sleep20-21swapper/22
6949242101,4sleep2694948-21apt-get2
6844302101,3sleep20-21swapper/22
6844302101,3sleep20-21swapper/22
6839152100,1sleep10-21swapper/11
6839152100,1sleep10-21swapper/11
6687452100,5sleep2669012-21df2
6658622101,6sleep0665873-21ssh0
6649662101,3sleep10-21swapper/11
6403382100,5sleep00-21swapper/00
6215472101,4sleep1554013-21diskmemload1
5974042101,3sleep20-21swapper/22
5584562101,4sleep0558579-21ntpq0
5542682100,2sleep20-21swapper/22
5326452101,4sleep0532664-21apt-get0
5313792101,5sleep2531425-21ntpq2
5219942101,4sleep2522012-21apt-get2
5208372101,5sleep20-21swapper/22
4844212100,1sleep10-21swapper/11
4630872101,4sleep1463342-21df1
4555052101,3sleep0455552-21ntpq0
892745291,4sleep1554013-21diskmemload1
875814291,2sleep00-21swapper/00
868640290,1sleep10-21swapper/11
856949291,4sleep0857040-21ntpq0
849573290,3sleep00-21swapper/00
840835291,3sleep20-21swapper/22
835306291,3sleep1835332-21apt-get1
831071291,3sleep1554013-21diskmemload1
789941291,4sleep2554013-21diskmemload2
765940291,4sleep1766498-21cut1
761703290,6sleep0761715-21rm0
756139291,2sleep10-21swapper/11
739080291,3sleep0554013-21diskmemload0
716570291,3sleep1716627-21ssh1
716509291,4sleep0716563-21grep0
711729290,2sleep10-21swapper/11
692273291,4sleep0692283-21ssh0
669096290,2sleep00-21swapper/00
653393291,4sleep2655120-21cut2
646652291,4sleep1646711-21ntpq1
616243291,4sleep2616437-21expr2
577965290,2sleep10-21swapper/11
577965290,2sleep10-21swapper/11
548678291,4sleep1548742-21sed1
535681290,1sleep20-21swapper/22
505043291,4sleep0505284-21grep0
452866291,4sleep1454592-21grep1
445982290,5sleep1446176-21cat1
736200281,2sleep2554013-21diskmemload2
730202281,3sleep0729704-21apt-get0
686119281,2sleep10-21swapper/11
553801280,1sleep00-21swapper/00
547631281,3sleep2547677-21/usr/sbin/munin2
539722281,3sleep20-21swapper/22
538251282,3sleep1331ktimers/11
531730281,4sleep0531980-21unixbench_singl0
516058280,2sleep10-21swapper/11
505985280,3sleep0506004-21apt-get0
504717280,3sleep20-21swapper/22
494736280,2sleep20-21swapper/22
489429281,3sleep0489494-21cut0
479070280,2sleep20-21swapper/22
457720280,3sleep2457739-21apt-get2
441600280,1sleep00-21swapper/00
553988270,1sleep10-21swapper/11
495867271,3sleep00-21swapper/00
494437270,1sleep10-21swapper/11
489344270,1sleep20-21swapper/22
483815270,1sleep10-21swapper/11
473166270,1sleep10-21swapper/11
472415271,2sleep20-21swapper/22
468411270,1sleep00-21swapper/00
462521270,1sleep10-21swapper/11
451214270,1sleep00-21swapper/00
451014270,1sleep10-21swapper/11
450543270,1sleep20-21swapper/22
442384270,1sleep10-21swapper/11
548387260,1sleep00-21swapper/00
537017261,2sleep10-21swapper/11
521982260,1sleep10-21swapper/11
521626260,1sleep10-21swapper/11
512652261,2sleep20-21swapper/22
510708260,4sleep20-21swapper/22
499847260,1sleep20-21swapper/22
489679260,1sleep00-21swapper/00
483927260,1sleep00-21swapper/00
478505260,1sleep10-21swapper/11
477913261,2sleep20-21swapper/22
473741261,2sleep0455788-21kworker/0:0+events0
457022260,1sleep00-21swapper/00
451751260,2sleep20-21swapper/22
451109260,4sleep20-21swapper/22
444846260,1sleep20-21swapper/22
443177261,2sleep10-21swapper/11
542226250,1sleep00-21swapper/00
515516250,1sleep00-21swapper/00
467916250,3sleep20-21swapper/22
442604250,1sleep00-21swapper/00
527320240,1sleep10-21swapper/11
522277240,1sleep00-21swapper/00
495290240,1sleep10-21swapper/11
456798240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional