You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 15:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat Apr 18, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
400270922510,1sleep04002710-21ssh0
3837237213360,69sleep30-21swapper/33
383728428657,9sleep10-21swapper/11
383723627862,10sleep20-21swapper/22
383704727556,14sleep00-21swapper/00
383747399231,18cyclictest3983422-21taskset3
3837473992218,2cyclictest0-21swapper/33
383747399221,16cyclictest40112862chrt3
383747399211,16cyclictest0-21swapper/33
3837473992017,1cyclictest0-21swapper/33
3837473992012,4cyclictest4169583-21taskset3
383747399201,15cyclictest4107925-21chrt3
383747399201,15cyclictest0-21swapper/33
383747399201,15cyclictest0-21swapper/33
383747399201,14cyclictest0-21swapper/33
41161702191,2sleep30-21swapper/33
383747399195,12cyclictest0-21swapper/33
383747399192,12cyclictest73571-21taskset3
383747399191,15cyclictest0-21swapper/33
383747399191,15cyclictest0-21swapper/33
383747399191,14cyclictest0-21swapper/33
383747399191,14cyclictest0-21swapper/33
383747399191,14cyclictest0-21swapper/33
383747399191,14cyclictest0-21swapper/33
993192181,2sleep20-21swapper/22
40111672181,3sleep20-21swapper/22
383747399184,11cyclictest0-21swapper/33
3837473991816,1cyclictest0-21swapper/33
3837473991814,2cyclictest0-21swapper/33
383747399181,14cyclictest0-21swapper/33
383747399181,14cyclictest0-21swapper/33
383747399181,14cyclictest0-21swapper/33
383747399181,14cyclictest0-21swapper/33
383747399181,14cyclictest0-21swapper/33
383747399181,14cyclictest0-21swapper/33
383747399181,14cyclictest0-21swapper/33
383747399181,14cyclictest0-21swapper/33
383747399181,14cyclictest0-21swapper/33
383747399181,13cyclictest0-21swapper/33
383747399181,13cyclictest0-21swapper/33
383747399181,13cyclictest0-21swapper/33
3837473991810,5cyclictest0-21swapper/33
383747399180,16cyclictest0-21swapper/33
383747399180,14cyclictest0-21swapper/33
383747399180,14cyclictest0-21swapper/33
383747399180,14cyclictest0-21swapper/33
41263622171,12sleep13968657-21diskmemload1
41088642171,3sleep10-21swapper/11
383747399178,5cyclictest3968668-21turbostat3
383747399172,9cyclictest4047945-21taskset3
3837473991712,3cyclictest0-21swapper/33
3837473991712,3cyclictest0-21swapper/33
383747399171,14cyclictest0-21swapper/33
383747399171,14cyclictest0-21swapper/33
383747399171,13cyclictest0-21swapper/33
383747399170,14cyclictest0-21swapper/33
312521712,2sleep00-21swapper/00
965382161,4sleep13968657-21diskmemload1
41618342161,4sleep04161912-21munin-run0
41347652161,3sleep20-21swapper/22
40964282161,4sleep14096483-21ntpq1
40700472162,10sleep14070180-21sendmail_mailqu1
383747399161,4cyclictest0-21swapper/33
383747399161,13cyclictest0-21swapper/33
383747399161,12cyclictest3952288-21taskset3
383747399161,12cyclictest0-21swapper/33
383747399160,14cyclictest0-21swapper/33
383747399160,13cyclictest0-21swapper/33
383747399160,13cyclictest0-21swapper/33
383747399160,13cyclictest0-21swapper/33
253692161,5sleep125466-21ssh1
1412072161,4sleep13968657-21diskmemload1
1346912161,2sleep20-21swapper/22
874542151,2sleep20-21swapper/22
41887272151,7sleep24189000-21df_inode2
41853072151,2sleep20-21swapper/22
41693512151,11sleep14169362-21ssh1
41581932151,8sleep14158420-21users1
41439212151,4sleep04143934-21ssh0
41061932151,4sleep23968657-21diskmemload2
40991752151,4sleep04099189-21ssh0
39758822151,4sleep13968657-21diskmemload1
39570302151,9sleep13957086-21ntp_states1
38718402150,9sleep13871765-31find1
3837473991512,2cyclictest0-21swapper/33
3837473991512,2cyclictest0-21swapper/33
383747399151,11cyclictest3877136-21chrt3
383747399151,11cyclictest3842526-21taskset3
383747399150,12cyclictest0-21swapper/33
383747399150,12cyclictest0-21swapper/33
383747399150,12cyclictest0-21swapper/33
175262151,5sleep117538-21sh1
1403362151,3sleep03968657-21diskmemload0
819322141,8sleep281990-21munin-run2
616382141,3sleep20-21swapper/22
41771942141,9sleep14177204-21ssh1
41143802141,7sleep14114611-21users1
41051592141,7sleep04105217-21ntpq0
40621192142,7sleep23968657-21diskmemload2
40315742141,9sleep24033149-21ssh2
39832842141,8sleep03968657-21diskmemload0
3837473991412,1cyclictest0-21swapper/33
3837473991411,1cyclictest0-21swapper/33
383747399140,2cyclictest0-21swapper/33
383747399140,12cyclictest0-21swapper/33
383747399140,12cyclictest0-21swapper/33
100762140,9sleep03968657-21diskmemload0
902722131,7sleep13968657-21diskmemload1
703502131,8sleep270362-21ssh2
41699492131,3sleep04169963-21ssh0
41618142131,8sleep24161828-21ssh2
41531072131,6sleep14153157-21munin-run1
40917962131,7sleep14091877-21munin-run1
40917962131,7sleep14091877-21munin-run1
40434122131,7sleep13968657-21diskmemload1
39833932130,5sleep10-21swapper/11
39750472131,4sleep23975059-21rm2
38539992134,5sleep03854598-21missed_timers0
38491362131,6sleep03849190-21ntpq0
299782131,7sleep130111-21diskstats1
1318572131,6sleep23968657-21diskmemload2
882892120,2sleep0171rcu_preempt0
698692121,3sleep069883-21ssh0
41767892121,7sleep04176799-21ssh0
41752902124,4sleep20-21swapper/22
41161302120,8sleep04116144-21ssh0
40840462121,7sleep24084678-21tr2
40840462121,7sleep24084678-21tr2
40281732122,7sleep03968657-21diskmemload0
40202142121,7sleep24020228-21ssh2
39855682121,7sleep23985575-21ssh2
39635802120,2sleep10-21swapper/11
39481492121,7sleep03949495-21cut0
39244592121,6sleep13924506-21ntpq1
38780482121,7sleep03878232-21sed0
38721222121,6sleep23872161-21perf2
38621522121,7sleep13862916-21cat1
38600102121,5sleep13860067-21ntpq1
348722121,1sleep0171rcu_preempt0
26862121,6sleep13968657-21diskmemload1
1179192121,7sleep1118770-21tr1
809972111,3sleep10-21swapper/11
69622111,4sleep13968657-21diskmemload1
611672111,4sleep13968657-21diskmemload1
610072111,4sleep03968657-21diskmemload0
435402111,4sleep13968657-21diskmemload1
41626022111,6sleep24162823-21if_enp1s02
41439352111,6sleep14143946-21sh1
41428302111,4sleep20-21swapper/22
41177132111,3sleep20-21swapper/22
40877362111,6sleep04083460-21/usr/sbin/munin0
40877362111,6sleep04083460-21/usr/sbin/munin0
40827802111,5sleep24082851-21munin-run2
40649022111,7sleep04064916-21ssh0
40644742111,4sleep13968657-21diskmemload1
40306272112,4sleep14030646-21apt-get1
40268232111,5sleep13968657-21diskmemload1
400762115,3sleep00-21swapper/00
39867082111,3sleep20-21swapper/22
39631072110,1sleep00-21swapper/00
38831092111,6sleep13883367-21df_inode1
353062111,4sleep20-21swapper/22
185792111,6sleep018593-21ssh0
1267052111,6sleep1128261-21grep1
1173032111,5sleep03968657-21diskmemload0
1156142112,3sleep20-21swapper/22
1067112110,1sleep20-21swapper/22
1040032111,5sleep0104062-21ntpq0
76602101,4sleep27753-21ntpq2
554692101,3sleep03968657-21diskmemload0
526082101,3sleep13968657-21diskmemload1
472742101,2sleep20-21swapper/22
445032101,2sleep20-21swapper/22
41846312101,4sleep13968657-21diskmemload1
41523572101,3sleep20-21swapper/22
41450682101,4sleep04145285-21hddtemp_smartct0
41238172101,5sleep24123831-21ssh2
40990972101,3sleep20-21swapper/22
40805422101,3sleep13968657-21diskmemload1
40803232101,2sleep00-21swapper/00
40698672101,4sleep24069918-21ntpq2
40536882101,3sleep20-21swapper/22
40358992101,3sleep00-21swapper/00
40230302101,6sleep24024695-21cut2
40197962101,3sleep00-21swapper/00
40192442100,1sleep10-21swapper/11
40085362101,3sleep13968657-21diskmemload1
40084662101,2sleep00-21swapper/00
40015082101,4sleep13968657-21diskmemload1
39868022101,4sleep13968657-21diskmemload1
39753672101,2sleep00-21swapper/00
39369702101,4sleep13937228-21df_inode1
39369492101,3sleep00-21swapper/00
39357002103,3sleep13935894-21cat1
39260102101,4sleep13926029-21apt-get1
39243372101,4sleep03924458-21ntpq0
39181822100,6sleep23919030-21sed2
39138032101,4sleep03913850-21ntpq0
39044602101,6sleep00-21swapper/00
38494462101,5sleep13849690-21sed1
38376802101,4sleep03837938-21df_inode0
277912101,4sleep00-21swapper/00
251702100,1sleep20-21swapper/22
1317332100,1sleep00-21swapper/00
1137212101,3sleep13968657-21diskmemload1
96169291,2sleep00-21swapper/00
76059291,4sleep077572-21ssh0
69829291,3sleep13968657-21diskmemload1
4186430290,1sleep00-21swapper/00
4134498291,2sleep00-21swapper/00
4127518291,4sleep13968657-21diskmemload1
4072007291,2sleep00-21swapper/00
4053728291,3sleep13968657-21diskmemload1
4051871291,4sleep04052093-21sh0
4045405290,1sleep20-21swapper/22
4039625291,2sleep00-21swapper/00
4002332291,2sleep20-21swapper/22
3991890291,2sleep00-21swapper/00
3968648291,4sleep0555-21dbus-daemon0
3947318290,1sleep10-21swapper/11
3942841291,4sleep23944274-21cut2
3935419291,4sleep03935469-21ntpq0
3899632291,4sleep23899842-21grep2
3892567291,4sleep03892700-21apt-get0
3872409291,3sleep20-21swapper/22
3871818290,4sleep03871765-31find0
3860069291,4sleep23860120-21ld2
12326291,3sleep212350-21apt-get2
118771291,4sleep2120448-21kthreadcore2
113967291,2sleep00-21swapper/00
105791290,1sleep10-21swapper/11
4125641281,2sleep00-21swapper/00
3958254280,2sleep20-21swapper/22
3957768280,2sleep20-21swapper/22
3942268281,2sleep13942287-21apt-get1
3941843280,2sleep20-21swapper/22
3929956281,3sleep03930075-21gcc0
3927360281,3sleep23928106-21kthreadcore2
3920161281,3sleep11-21systemd1
3914812281,3sleep23914883-21unin-run2
3906225281,3sleep13908021-21kthreadcore1
3904179281,3sleep00-21swapper/00
3893239280,2sleep10-21swapper/11
3883643281,3sleep03883690-21kthreadcore0
3878328281,3sleep23878363-21kthreadcore2
3872684280,5sleep00-21swapper/00
3856281280,1sleep00-21swapper/00
3964184271,2sleep20-21swapper/22
3956977270,4sleep03957029-21ntp_kernel_pll_0
3947307270,1sleep00-21swapper/00
3936221270,1sleep20-21swapper/22
3921746271,3sleep20-21swapper/22
3915097270,2sleep00-21swapper/00
3911519271,2sleep13913315-21kthreadcore1
3904730271,3sleep23904916-21tail2
3894357271,3sleep23895408-21kthreadcore2
3888978271,3sleep23889014-21kthreadcore2
3887459271,3sleep23887528-21threads2
3877271270,1sleep10-21swapper/11
3866600270,1sleep20-21swapper/22
3865525271,2sleep00-21swapper/00
3855608270,1sleep10-21swapper/11
3850090271,3sleep20-21swapper/22
3842608270,1sleep20-21swapper/22
3842423270,1sleep10-21swapper/11
3963060260,4sleep10-21swapper/11
3951324260,2sleep23951593-21strings2
3903936260,1sleep10-21swapper/11
3898586260,1sleep10-21swapper/11
3851218261,2sleep20-21swapper/22
3898623250,3sleep00-21swapper/00
3878236250,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional