You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 18:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat Apr 04, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
38604822120103,10sleep10-21swapper/11
3860386211963,52sleep30-21swapper/33
386056228264,10sleep20-21swapper/22
385557927555,14sleep00-21swapper/00
41443572224,9sleep04146046-21grep0
386073299222,14cyclictest18739-21taskset3
3860732992113,5cyclictest4071843-21turbostat3
386073299211,16cyclictest0-21swapper/33
386073299205,3cyclictest0-21swapper/33
386073299203,13cyclictest0-21swapper/33
3860732992017,1cyclictest0-21swapper/33
3860732992017,1cyclictest0-21swapper/33
3860732992011,6cyclictest4148672-21taskset3
386073299201,15cyclictest66950irq/132-enp1s0-TxRx-33
386073299201,15cyclictest4121593-21taskset3
386073299201,15cyclictest4034830-21taskset3
386073299201,15cyclictest0-21swapper/33
386073299201,15cyclictest0-21swapper/33
386073299200,12cyclictest0-21swapper/33
3860732991915,2cyclictest4025165-21taskset3
3860732991915,2cyclictest0-21swapper/33
3860732991912,4cyclictest0-21swapper/33
386073299191,15cyclictest0-21swapper/33
386073299191,15cyclictest0-21swapper/33
386073299191,14cyclictest0-21swapper/33
386073299191,14cyclictest0-21swapper/33
386073299191,14cyclictest0-21swapper/33
386073299191,14cyclictest0-21swapper/33
386073299191,13cyclictest0-21swapper/33
40981702181,13sleep24098178-21ssh2
39996722181,3sleep10-21swapper/11
38950232181,6sleep03895014-40gst-plugin-scan0
3860732991814,2cyclictest0-21swapper/33
3860732991812,3cyclictest0-21swapper/33
386073299181,15cyclictest0-21swapper/33
386073299181,14cyclictest0-21swapper/33
386073299181,14cyclictest0-21swapper/33
386073299181,14cyclictest0-21swapper/33
386073299181,14cyclictest0-21swapper/33
386073299181,14cyclictest0-21swapper/33
386073299181,14cyclictest0-21swapper/33
386073299181,14cyclictest0-21swapper/33
386073299181,14cyclictest0-21swapper/33
386073299181,14cyclictest0-21swapper/33
386073299181,14cyclictest0-21swapper/33
386073299181,13cyclictest66950irq/132-enp1s0-TxRx-33
386073299181,13cyclictest0-21swapper/33
386073299181,13cyclictest0-21swapper/33
386073299181,13cyclictest0-21swapper/33
386073299180,15cyclictest0-21swapper/33
386073299180,15cyclictest0-21swapper/33
386073299180,14cyclictest0-21swapper/33
1675502180,7sleep00-21swapper/00
797552171,3sleep00-21swapper/00
41483642171,2sleep2171rcu_preempt2
386073299173,12cyclictest0-21swapper/33
386073299171,13cyclictest0-21swapper/33
386073299171,13cyclictest0-21swapper/33
386073299171,13cyclictest0-21swapper/33
386073299170,14cyclictest0-21swapper/33
386073299170,14cyclictest0-21swapper/33
386073299170,13cyclictest3889321-21taskset3
41679712161,9sleep13992564-21diskmemload1
41211582161,4sleep13992564-21diskmemload1
41067102161,4sleep20-21swapper/22
40425252160,1sleep00-21swapper/00
40262562161,4sleep13992564-21diskmemload1
39979962160,1sleep00-21swapper/00
38999982160,6sleep13894998-31find1
3860732991613,1cyclictest0-21swapper/33
386073299161,11cyclictest0-21swapper/33
386073299160,13cyclictest0-21swapper/33
386073299160,13cyclictest0-21swapper/33
386073299160,13cyclictest0-21swapper/33
1388462161,2sleep20-21swapper/22
690962150,1sleep20-21swapper/22
41826652151,3sleep13992564-21diskmemload1
41084822155,6sleep04110136-21cut0
40362702151,4sleep03992564-21diskmemload0
39604852150,8sleep172-21kcompactd01
386073299159,3cyclictest39483292sleep33
3860732991512,1cyclictest0-21swapper/33
386073299150,13cyclictest0-21swapper/33
386073299150,13cyclictest0-21swapper/33
386073299150,11cyclictest0-21swapper/33
271062151,10sleep227198-21apt-config2
1213832150,9sleep20-21swapper/22
1211092151,2sleep00-21swapper/00
854962141,8sleep03992564-21diskmemload0
444332140,1sleep00-21swapper/00
40964722141,3sleep13992564-21diskmemload1
40690822141,4sleep14069097-21ssh1
40524142141,9sleep24052429-21ssh2
40435532140,2sleep10-21swapper/11
38797222141,9sleep23879804-21sed2
386073299148,3cyclictest3987187-21chrt3
3860732991411,1cyclictest0-21swapper/33
386073299140,11cyclictest3879238-21chrt3
169342140,2sleep20-21swapper/22
11512141,3sleep13992564-21diskmemload1
614072131,5sleep10-21swapper/11
41746392131,8sleep13992564-21diskmemload1
41730622131,8sleep04173114-21ssh0
41582842131,3sleep14158295-21ssh1
41334122131,3sleep24133622-21ssh2
41306842131,7sleep20-21swapper/22
40869832131,8sleep04086997-21ssh0
39808252131,3sleep03980847-21ntp_kernel_err0
39210232131,6sleep03921071-21ntpq0
386073299138,3cyclictest3922596-21chrt3
386073299130,10cyclictest0-21swapper/33
372302131,8sleep238790-21cut2
1498472131,8sleep1149858-21sh1
1337442131,3sleep0135016-21kthreadcore0
1069192131,6sleep0107085-21cstates0
786532121,7sleep178665-21rm1
706542121,3sleep00-21swapper/00
41923052121,7sleep04192316-21ssh0
41491652121,4sleep14149176-21sh1
41409302121,7sleep14140941-21ssh1
41294442121,5sleep13992564-21diskmemload1
41203022121,5sleep24120352-21ntpq2
40343572121,7sleep13992564-21diskmemload1
39698612121,5sleep23969912-21ntpq2
39429682121,6sleep03943014-21ntpq0
39157122121,5sleep13915758-21ntpq1
39135652123,5sleep23915347-21kthreadcore2
250712121,2sleep10-21swapper/11
1645942120,2sleep20-21swapper/22
1373912121,5sleep1137459-21ntpq1
1040872120,2sleep10-21swapper/11
878972111,6sleep187908-21ssh1
860402111,5sleep23992564-21diskmemload2
8492111,2sleep1171rcu_preempt1
502322111,6sleep250247-21ssh2
41906092111,4sleep24190668-21ssh2
41325912110,6sleep03992564-21diskmemload0
40599952111,4sleep13992564-21diskmemload1
40593702111,5sleep04059569-21users0
40487102111,5sleep14049891-21memory1
40234522111,5sleep04023504-21ntpq0
39915262112,4sleep13991572-21ntpq1
39754762111,5sleep23975524-21ntpq2
39604892111,5sleep03960508-21apt-get0
39482812110,2sleep20-21swapper/22
39341202111,7sleep13934925-21grep1
39121622111,6sleep03911662-21/usr/sbin/munin0
38901512111,6sleep23890184-21grep2
38886402111,6sleep23888693-21collect22
38729882111,5sleep03873232-21users0
156942111,3sleep00-21swapper/00
1562892112,3sleep13992564-21diskmemload1
155602111,5sleep13992564-21diskmemload1
1318582111,5sleep13992564-21diskmemload1
1303992110,2sleep20-21swapper/22
1214232111,4sleep13992564-21diskmemload1
1151802111,4sleep10-21swapper/11
952742101,2sleep20-21swapper/22
950122101,4sleep13992564-21diskmemload1
890942102,4sleep00-21swapper/00
775532101,3sleep20-21swapper/22
678242100,1sleep10-21swapper/11
618562101,3sleep03992564-21diskmemload0
616772101,3sleep20-21swapper/22
525602101,4sleep03992564-21diskmemload0
41743922101,3sleep20-21swapper/22
41684442101,4sleep23992564-21diskmemload2
41600182101,3sleep00-21swapper/00
41576282101,4sleep20-21swapper/22
41556702101,2sleep00-21swapper/00
41158052101,3sleep03992564-21diskmemload0
40951822100,1sleep00-21swapper/00
40874072101,3sleep13992564-21diskmemload1
40814512101,2sleep20-21swapper/22
40791182100,3sleep00-21swapper/00
40790792101,4sleep13992564-21diskmemload1
40771562101,5sleep24077171-21ssh2
40714612101,2sleep00-21swapper/00
40601602100,6sleep20-21swapper/22
40470752101,5sleep04048709-21tr0
40420802101,4sleep23992564-21diskmemload2
40167002101,3sleep13992564-21diskmemload1
40076052101,3sleep13992564-21diskmemload1
40016682101,4sleep03992564-21diskmemload0
39988222101,3sleep20-21swapper/22
39861522101,4sleep23986209-21ntpq2
39590152101,5sleep23959055-21/usr/sbin/munin2
39548592101,4sleep03954878-21apt-get0
39495782101,4sleep23949832-21df2
39322722101,5sleep13932318-21ntpq1
39063352101,4sleep23906354-21apt-get2
39049422101,4sleep23905063-21ntpq2
38953422100,1sleep00-21swapper/00
38845472101,4sleep13884566-21apt-get1
365552101,4sleep136582-21apt-get1
336842101,2sleep20-21swapper/22
232962101,5sleep023433-21sed0
1674152101,4sleep13992564-21diskmemload1
1575132101,2sleep20-21swapper/22
1567382101,4sleep03992564-21diskmemload0
1420162101,4sleep2142191-21diskstats2
1418772101,4sleep0141898-21apt-get0
13452101,4sleep21559-21diskstats2
1289462101,4sleep03992564-21diskmemload0
1127592100,2sleep20-21swapper/22
1040032101,3sleep20-21swapper/22
7054291,5sleep03992564-21diskmemload0
49412291,5sleep10-21swapper/11
4182979291,2sleep20-21swapper/22
4139993291,2sleep00-21swapper/00
4112446291,3sleep13992564-21diskmemload1
4111697291,3sleep20-21swapper/22
4104902291,3sleep03992564-21diskmemload0
4103266291,4sleep13992564-21diskmemload1
4067971291,4sleep24067988-21cut2
4034969291,3sleep23992564-21diskmemload2
4023856291,4sleep24024028-21sed2
4016002290,2sleep20-21swapper/22
4014761291,3sleep03992564-21diskmemload0
4001715291,4sleep24001913-21cat2
3982420291,4sleep13982633-21hddtemp_smartct1
3975580291,4sleep03975636-21ntp_states0
3960457291,4sleep23959945-21apt-get2
3922355291,3sleep03922070-21apt-get0
3917295291,4sleep23917398-21perl2
3889898290,1sleep10-21swapper/11
3879507291,4sleep13879721-21hddtemp_smartct1
3878265291,4sleep23878461-21/usr/sbin/munin2
3866270291,4sleep23865979-21apt-get2
3865970292,3sleep10-21swapper/11
3864833291,4sleep03864951-21ntpq0
32790290,1sleep00-21swapper/00
29659292,3sleep131423-21cut1
103829291,2sleep00-21swapper/00
4183271280,1sleep00-21swapper/00
3976361280,1sleep10-21swapper/11
3949556280,4sleep13949575-21apt-get1
3938937280,1sleep10-21swapper/11
3938903280,1sleep20-21swapper/22
3938627281,3sleep0555-21dbus-daemon0
3902465281,3sleep03904230-21kthreadcore0
3874795281,3sleep13876492-21kthreadcore1
3873891281,2sleep00-21swapper/00
3986957270,3sleep03986949-21fwupd0
3981675270,1sleep20-21swapper/22
3977638271,3sleep13979312-21kthreadcore1
3970637270,1sleep10-21swapper/11
3948949270,1sleep10-21swapper/11
3934926271,2sleep20-21swapper/22
3932424271,3sleep03932549-21sendmail_mailst0
3928237271,2sleep20-21swapper/22
3927681271,3sleep20-21swapper/22
3926794271,3sleep13926882-21ps1
3910709270,3sleep03910867-21sed0
3906629271,3sleep13906843-21smartctl1
3895334270,1sleep20-21swapper/22
3884023270,1sleep00-21swapper/00
3868535270,2sleep10-21swapper/11
3987490261,2sleep20-21swapper/22
3970740260,4sleep00-21swapper/00
3955953261,2sleep10-21swapper/11
3905907260,4sleep10-21swapper/11
3884846260,3sleep00-21swapper/00
3865274260,2sleep20-21swapper/22
3918278250,1sleep10-21swapper/11
3987260240,1sleep00-21swapper/00
3949552240,1sleep00-21swapper/00
3944015240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional