You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 15:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Sat Apr 25, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
386532121210,2sleep00-21swapper/00
3652140211660,52sleep30-21swapper/33
365701628656,12sleep10-21swapper/11
365684328053,10sleep20-21swapper/22
365684127858,14sleep00-21swapper/00
365730999241,18cyclictest4020786-21taskset3
365730999210,18cyclictest0-21swapper/33
365730999202,4cyclictest38102692sleep33
365730999202,15cyclictest0-21swapper/33
3657309992017,1cyclictest0-21swapper/33
365730999201,15cyclictest0-21swapper/33
365730999201,15cyclictest0-21swapper/33
365730999199,5cyclictest40037902sleep33
365730999194,13cyclictest4057907-21taskset3
3657309991916,1cyclictest0-21swapper/33
365730999191,14cyclictest3917974-21taskset3
365730999191,14cyclictest3761531-21taskset3
365730999191,14cyclictest0-21swapper/33
365730999191,14cyclictest0-21swapper/33
365730999191,14cyclictest0-21swapper/33
365730999191,14cyclictest0-21swapper/33
365730999191,13cyclictest0-21swapper/33
365730999190,7cyclictest3831831-21taskset3
365730999190,17cyclictest0-21swapper/33
365730999190,16cyclictest0-21swapper/33
41205972181,5sleep24120971-21gpgv2
41189022181,7sleep03787920-21diskmemload0
39774862180,3sleep10-21swapper/11
365730999189,5cyclictest38190842sleep33
365730999185,11cyclictest3723742-21taskset3
365730999181,14cyclictest0-21swapper/33
365730999181,14cyclictest0-21swapper/33
365730999181,14cyclictest0-21swapper/33
365730999181,14cyclictest0-21swapper/33
365730999181,14cyclictest0-21swapper/33
365730999181,14cyclictest0-21swapper/33
365730999181,14cyclictest0-21swapper/33
365730999181,14cyclictest0-21swapper/33
365730999181,13cyclictest0-21swapper/33
365730999181,13cyclictest0-21swapper/33
365730999181,13cyclictest0-21swapper/33
365730999181,13cyclictest0-21swapper/33
365730999181,13cyclictest0-21swapper/33
365730999181,13cyclictest0-21swapper/33
3657309991810,5cyclictest3771714-21taskset3
365730999180,16cyclictest0-21swapper/33
365730999180,15cyclictest0-21swapper/33
38378102171,2sleep20-21swapper/22
365730999179,3cyclictest39269112sleep33
365730999178,6cyclictest3734613-21turbostat3
3657309991713,2cyclictest0-21swapper/33
365730999171,13cyclictest0-21swapper/33
365730999171,13cyclictest0-21swapper/33
365730999171,13cyclictest0-21swapper/33
365730999171,13cyclictest0-21swapper/33
365730999171,13cyclictest0-21swapper/33
365730999171,13cyclictest0-21swapper/33
365730999171,12cyclictest3685994-21taskset3
365730999170,14cyclictest0-21swapper/33
365730999170,14cyclictest0-21swapper/33
40999372161,2sleep00-21swapper/00
39539372161,3sleep10-21swapper/11
38925652160,3sleep00-21swapper/00
38819662161,2sleep20-21swapper/22
38737512161,4sleep03787920-21diskmemload0
365730999169,5cyclictest37721972sleep33
365730999161,2cyclictest0-21swapper/33
365730999161,13cyclictest0-21swapper/33
365730999160,4cyclictest3702435-21taskset3
365730999160,13cyclictest0-21swapper/33
365730999160,12cyclictest0-21swapper/33
41429352151,3sleep24142986-21ntpq2
41026842151,4sleep13787920-21diskmemload1
40748382151,9sleep04074850-21sh0
40666822151,11sleep20-21swapper/22
40056062151,8sleep20-21swapper/22
38102072151,9sleep23810267-21ntpq2
37549152151,4sleep23754961-21ntpq2
365730999154,8cyclictest3750616-21turbostat3
365730999151,12cyclictest3782828-21chrt3
3657309991511,2cyclictest0-21swapper/33
365730999150,13cyclictest0-21swapper/33
365730999150,12cyclictest0-21swapper/33
41367502140,3sleep23787920-21diskmemload2
40852922140,2sleep10-21swapper/11
40074752141,8sleep24007738-21ssh2
39527792145,4sleep2431ktimers/22
38468482140,2sleep10-21swapper/11
38035932141,8sleep23787920-21diskmemload2
37943552141,2sleep10-21swapper/11
37628612141,9sleep23764567-21grep2
365730999141,9cyclictest3665131-21chrt3
3657309991411,2cyclictest0-21swapper/33
3657309991411,2cyclictest0-21swapper/33
365730999140,13cyclictest0-21swapper/33
41543972131,8sleep24154411-21ssh2
41531772131,6sleep00-21swapper/00
41347952131,7sleep03787920-21diskmemload0
41136972131,4sleep14115349-21cut1
41105362131,8sleep04110547-21ssh0
41029032131,2sleep20-21swapper/22
40554492131,3sleep14055579-21ssh1
40416872131,2sleep20-21swapper/22
40232502131,3sleep14023260-21ssh1
39268382131,3sleep13926849-21ssh1
39057462131,3sleep03787920-21diskmemload0
38991252131,8sleep23787920-21diskmemload2
38927922131,7sleep23787920-21diskmemload2
38205812134,2sleep0171rcu_preempt0
37121222131,7sleep23712262-21ntp_192.168.1142
365730999130,1cyclictest0-21swapper/33
41539282121,3sleep14153942-21ssh1
41300332122,5sleep14130059-21apt-get1
41218352121,7sleep14121945-21grep1
40863462121,7sleep04086572-21/usr/sbin/munin0
40604122121,7sleep14060816-21cut1
40394572121,7sleep03787920-21diskmemload0
39969502121,7sleep13996961-21sh1
39810902121,3sleep13981226-21ssh1
39771972121,3sleep20-21swapper/22
39621232121,2sleep00-21swapper/00
39156582121,7sleep03787920-21diskmemload0
39114592121,7sleep23911674-21ssh2
38985912120,7sleep03787920-21diskmemload0
38676742121,7sleep23787920-21diskmemload2
38654422121,7sleep13787920-21diskmemload1
38475942121,7sleep03847605-21ssh0
38302492121,2sleep10-21swapper/11
38284722121,3sleep03828483-21ssh0
37079512121,6sleep23707979-21munin-run2
41292712111,5sleep03787920-21diskmemload0
41255042111,5sleep24125562-21ntpq2
41112132111,4sleep10-21swapper/11
40932132111,5sleep23787920-21diskmemload2
40860102112,4sleep14086035-21apt-get1
40801732111,5sleep24081326-21memory2
40671662111,6sleep03787920-21diskmemload0
40553862111,7sleep04051101-21/usr/sbin/munin0
40437012111,5sleep14045334-21cut1
40423622111,5sleep04042382-21apt-get0
40116142111,5sleep14011663-21ntpq1
39950212111,6sleep03995032-21ssh0
39795392111,2sleep00-21swapper/00
39466692111,2sleep00-21swapper/00
39337472111,3sleep10-21swapper/11
39328532111,5sleep03932918-21ntpq0
39286122110,2sleep23928641-21apt-get2
39179482111,3sleep10-21swapper/11
38832522111,3sleep10-21swapper/11
38803842111,7sleep03880428-21ntp_kernel_err0
38649972111,3sleep20-21swapper/22
38562612110,1sleep10-21swapper/11
38391982112,4sleep03787920-21diskmemload0
38288622111,4sleep20-21swapper/22
38218502111,3sleep10-21swapper/11
38203572111,6sleep23820371-21ssh2
38120732110,1sleep00-21swapper/00
38046352110,5sleep10-21swapper/11
37709332111,5sleep03770984-21ntpq0
37654512111,5sleep03765592-21ntpq0
37602802111,5sleep13760329-21ntpq1
37295212112,3sleep20-21swapper/22
37189612111,5sleep23719174-21df_inode2
37070102111,5sleep13707067-21ntp_states1
36963372111,5sleep13696383-21ntpq1
36915482110,2sleep00-21swapper/00
36759702111,5sleep23676092-21diskstats2
36585492111,6sleep23660266-21cut2
41390462101,6sleep04139088-21fschecks_count0
41080872101,5sleep24108338-21/usr/sbin/munin2
40511002101,4sleep24051124-21apt-get2
40378592101,4sleep14037920-21ntpq1
40302512101,4sleep23787920-21diskmemload2
40053262101,6sleep04005331-21rm0
40037642101,3sleep10-21swapper/11
39886462101,3sleep20-21swapper/22
39862062101,5sleep00-21swapper/00
39710012101,3sleep10-21swapper/11
39700052101,2sleep20-21swapper/22
39673792101,4sleep03967533-21strings0
39615922101,4sleep23787920-21diskmemload2
39454122100,1sleep10-21swapper/11
39414682101,4sleep03941531-21ntpq0
39274282101,3sleep00-21swapper/00
39253022101,3sleep20-21swapper/22
39085212101,4sleep23787920-21diskmemload2
38852402101,5sleep13885462-21hddtemp_smartct1
38724602101,3sleep10-21swapper/11
38559262101,2sleep20-21swapper/22
38129362102,2sleep10-21swapper/11
37835042100,6sleep23785145-21cut2
37816202100,1sleep20-21swapper/22
37780682101,5sleep13778762-21kthreadcore1
37709862101,5sleep13771040-21ntpq1
37603312101,3sleep20-21swapper/22
37036112100,6sleep03705269-21cut0
37016552101,4sleep23701704-21ntpq2
36963852101,4sleep23696438-21ntp_states2
36651092101,4sleep23665128-21apt-get2
4143350291,4sleep14143474-21sort1
4082473291,3sleep03787920-21diskmemload0
4074371291,2sleep20-21swapper/22
4068517291,4sleep14068531-21ssh1
4048771291,3sleep23787920-21diskmemload2
4030430291,3sleep03787920-21diskmemload0
4024806291,3sleep13787920-21diskmemload1
4022044290,1sleep00-21swapper/00
4016117291,4sleep24016124-21ssh2
4012560291,3sleep03787920-21diskmemload0
3995999291,3sleep23787920-21diskmemload2
3960083290,5sleep13787920-21diskmemload1
3942271291,2sleep20-21swapper/22
3907499291,4sleep13907510-21ssh1
3899874290,6sleep13899885-21ssh1
3855549291,4sleep03787920-21diskmemload0
3840898291,3sleep23787920-21diskmemload2
3838755291,4sleep13838762-21ssh1
3802662291,2sleep00-21swapper/00
3793846291,3sleep03787920-21diskmemload0
3793041290,1sleep20-21swapper/22
3771042291,4sleep23771133-21ps2
3761544291,3sleep13761563-21apt-get1
3749642291,4sleep03749692-21ntpq0
3740209291,4sleep13740315-21expr1
3733690291,4sleep03733769-21/usr/sbin/munin0
3719462291,4sleep13720548-21grep1
3713853291,4sleep03714022-21tr0
3713853291,4sleep03714022-21tr0
3676376291,4sleep13677631-21tr1
3675792290,3sleep072-21kcompactd00
3787908281,3sleep00-21swapper/00
3781441281,3sleep03781562-21ntpq0
3760185281,2sleep00-21swapper/00
3744954280,1sleep20-21swapper/22
3739725280,1sleep10-21swapper/11
3739676280,2sleep20-21swapper/22
3725059280,1sleep00-21swapper/00
3691558281,2sleep23686489-31sort2
3686467281,3sleep1555-21dbus-daemon1
3682762281,3sleep03684548-21grep0
3670500281,3sleep20-21swapper/22
3661567281,3sleep13661615-21ntpq1
3782842270,2sleep13782861-21apt-get1
3772779271,3sleep03774280-21ps0
3744206270,2sleep00-21swapper/00
3734258270,1sleep10-21swapper/11
3714136271,2sleep20-21swapper/22
3714136271,2sleep20-21swapper/22
3697886271,2sleep00-21swapper/00
3692210270,2sleep00-21swapper/00
3686080270,1sleep10-21swapper/11
3685978270,1sleep20-21swapper/22
3674318271,3sleep00-21swapper/00
3670478270,2sleep10-21swapper/11
3657495271,2sleep03657747-21df0
3776969260,1sleep10-21swapper/11
3755651260,1sleep10-21swapper/11
3750278260,1sleep20-21swapper/22
3728957260,1sleep20-21swapper/22
3728945260,1sleep10-21swapper/11
3713174260,1sleep10-21swapper/11
3709227261,2sleep00-21swapper/00
3697582260,2sleep10-21swapper/11
3669938260,1sleep10-21swapper/11
3663191261,2sleep03651526-21kworker/0:1+events0
3776639250,1sleep20-21swapper/22
3751144250,2sleep00-21swapper/00
3745347250,1sleep10-21swapper/11
3734959250,1sleep00-21swapper/00
3719342250,1sleep00-21swapper/00
3713564250,2sleep10-21swapper/11
3713564250,2sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional