You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-29 - 06:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Mon Jun 29, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3163236211859,53sleep30-21swapper/33
316328328667,12sleep20-21swapper/22
316355928153,7sleep00-21swapper/00
316329228153,9sleep10-21swapper/11
3163785992511,10cyclictest3606498-21turbostat3
316378599229,9cyclictest3422715-21turbostat3
316378599212,14cyclictest33323852sleep33
3163785992110,7cyclictest3530106-21turbostat3
316378599201,15cyclictest0-21swapper/33
316378599201,15cyclictest0-21swapper/33
316378599201,15cyclictest0-21swapper/33
316378599192,14cyclictest66950irq/132-enp1s0-TxRx-33
316378599191,7cyclictest3356439-21taskset3
3163785991916,2cyclictest0-21swapper/33
3163785991916,1cyclictest0-21swapper/33
316378599191,14cyclictest66950irq/132-enp1s0-TxRx-33
316378599191,14cyclictest3259389-21taskset3
3163785991911,4cyclictest0-21swapper/33
316378599191,14cyclictest0-21swapper/33
3163785991910,2cyclictest0-21swapper/33
35712572181,5sleep13571618-21grep1
34962932180,8sleep20-21swapper/22
34068232181,5sleep23407043-21hddtemp_smartct2
316378599189,6cyclictest3538426-21turbostat3
316378599182,13cyclictest3623094-21turbostat3
3163785991811,4cyclictest0-21swapper/33
316378599181,14cyclictest0-21swapper/33
316378599181,14cyclictest0-21swapper/33
316378599181,14cyclictest0-21swapper/33
316378599181,14cyclictest0-21swapper/33
316378599181,14cyclictest0-21swapper/33
316378599181,14cyclictest0-21swapper/33
316378599181,13cyclictest3228258-21turbostat3
316378599181,13cyclictest3228258-21turbostat3
316378599180,16cyclictest0-21swapper/33
35299712171,3sleep10-21swapper/11
34561492172,8sleep13456413-21df1
34425592170,5sleep13442560-21kthreadcore1
34303622171,2sleep00-21swapper/00
33892062171,5sleep03290777-21diskmemload0
33163942171,10sleep23317067-21cut2
316378599178,6cyclictest3480373-21turbostat3
316378599175,9cyclictest3421976-21taskset3
316378599171,5cyclictest0-21swapper/33
316378599171,5cyclictest0-21swapper/33
316378599171,13cyclictest0-21swapper/33
316378599171,13cyclictest0-21swapper/33
316378599171,13cyclictest0-21swapper/33
316378599171,13cyclictest0-21swapper/33
316378599171,13cyclictest0-21swapper/33
316378599171,13cyclictest0-21swapper/33
316378599171,13cyclictest0-21swapper/33
316378599171,13cyclictest0-21swapper/33
316378599171,13cyclictest0-21swapper/33
316378599171,13cyclictest0-21swapper/33
316378599171,13cyclictest0-21swapper/33
316378599171,13cyclictest0-21swapper/33
316378599171,13cyclictest0-21swapper/33
316378599170,14cyclictest0-21swapper/33
36212932162,2sleep20-21swapper/22
35201622161,2sleep00-21swapper/00
34958032161,10sleep03290777-21diskmemload0
33376272161,3sleep20-21swapper/22
32997032161,4sleep23299919-21hddtemp_smartct2
31721592167,4sleep13173800-21cut1
3163785991614,1cyclictest0-21swapper/33
316378599161,3cyclictest0-21swapper/33
316378599161,12cyclictest0-21swapper/33
316378599161,12cyclictest0-21swapper/33
316378599161,12cyclictest0-21swapper/33
316378599161,12cyclictest0-21swapper/33
316378599160,13cyclictest0-21swapper/33
316378599160,12cyclictest0-21swapper/33
36056272151,10sleep03290777-21diskmemload0
35682692150,2sleep10-21swapper/11
34395872151,2sleep20-21swapper/22
316378599151,2cyclictest0-21swapper/33
316378599151,11cyclictest3290794-21sleep3
316378599151,10cyclictest3202517-21chrt3
316378599150,13cyclictest0-21swapper/33
316378599150,13cyclictest0-21swapper/33
35696022147,3sleep23569613-21ssh2
35270122143,6sleep03163780-21cyclictest0
34877052141,7sleep20-21swapper/22
33464812141,8sleep13346491-21ssh1
33070212141,2sleep10-21swapper/11
32911772141,6sleep03291212-21ssh0
316378599147,3cyclictest0-21swapper/33
316378599141,2cyclictest0-21swapper/33
3163785991411,2cyclictest0-21swapper/33
316378599140,12cyclictest0-21swapper/33
316378599140,11cyclictest0-21swapper/33
35978902131,8sleep23597900-21ssh2
35716192131,8sleep23571433-40find2
35454592131,7sleep03290777-21diskmemload0
35055892131,7sleep23290777-21diskmemload2
34854752131,8sleep13485485-21ssh1
34203272131,8sleep23420341-21ssh2
34050512131,3sleep03405063-21ssh0
33813402131,4sleep13381352-21ssh1
33799382131,5sleep20-21swapper/22
33312202131,6sleep10-21swapper/11
31966952130,1sleep20-21swapper/22
316378599138,3cyclictest31923562sleep33
316378599135,4cyclictest3259759-21taskset3
3163785991310,1cyclictest0-21swapper/33
36288892122,4sleep23290777-21diskmemload2
36045662121,6sleep23290777-21diskmemload2
35985852121,4sleep10-21swapper/11
35879942121,6sleep13290777-21diskmemload1
35817532120,2sleep00-21swapper/00
35711712121,5sleep03571218-21munin-run0
35554532121,3sleep20-21swapper/22
35535512121,7sleep13553563-21ssh1
35388562121,3sleep10-21swapper/11
35305282121,5sleep13530792-21df1
35300872121,5sleep23530147-21munin-run2
35037512121,7sleep13503753-21sh1
34961022121,5sleep13290777-21diskmemload1
34712662121,5sleep10-21swapper/11
34699192121,7sleep23469934-21sshd-auth2
34612212121,5sleep00-21swapper/00
34379532121,7sleep23437964-21ssh2
34211062121,3sleep13421115-21sh1
34115462121,6sleep03290777-21diskmemload0
33884652121,6sleep13290777-21diskmemload1
33653282121,2sleep13365357-21apt-get1
33560842121,7sleep13356095-21ssh1
32959912121,7sleep23296005-21ssh2
32603732121,7sleep23261855-21cut2
31821562121,7sleep23182237-21uname2
31647992121,7sleep23166414-21cut2
36383142110,1sleep20-21swapper/22
36380612111,4sleep03290777-21diskmemload0
36374772111,5sleep13637487-21ssh1
36230662111,4sleep10-21swapper/11
36215092111,5sleep03290777-21diskmemload0
36131602111,6sleep23290777-21diskmemload2
35967302111,4sleep13290777-21diskmemload1
35862602111,4sleep23290777-21diskmemload2
35202722111,5sleep23290777-21diskmemload2
35045412111,2sleep00-21swapper/00
34881532111,4sleep03290777-21diskmemload0
34768062114,3sleep13476943-21mailstats1
34454422111,4sleep03290777-21diskmemload0
34391002110,2sleep10-21swapper/11
33955682111,6sleep13395582-21ssh1
33571112111,4sleep23357123-21apt-get2
33559032111,4sleep23290777-21diskmemload2
33484092111,4sleep03290777-21diskmemload0
33148072110,7sleep00-21swapper/00
33146732111,4sleep13290777-21diskmemload1
33054322110,1sleep00-21swapper/00
32858442112,4sleep23285862-21apt-get2
32806612111,5sleep03280919-21df_inode0
32754222111,5sleep13275676-21df1
32587472111,6sleep23258965-21sed2
32285302111,4sleep23228533-21apt-get2
32179462111,6sleep039542-21systemd-journal0
32082732111,2sleep20-21swapper/22
31972842110,1sleep20-21swapper/22
31819452111,5sleep13182155-21hddtemp_smartct1
31711902111,5sleep03171187-21apt-get0
36299432101,4sleep03290777-21diskmemload0
36240422101,5sleep13624387-21cut1
36129892100,1sleep00-21swapper/00
36126902101,4sleep13290777-21diskmemload1
35967172101,3sleep03290777-21diskmemload0
35886232101,3sleep00-21swapper/00
35555512101,4sleep03555772-21df_inode0
35523592100,3sleep00-21swapper/00
35445172101,3sleep20-21swapper/22
35361522101,4sleep03290777-21diskmemload0
35197072101,4sleep13290777-21diskmemload1
35056162101,3sleep03505638-21apt-get0
35037232101,3sleep20-21swapper/22
34790532101,4sleep03290777-21diskmemload0
34776772100,1sleep20-21swapper/22
34539862101,4sleep03290777-21diskmemload0
34529382101,3sleep10-21swapper/11
34526602101,4sleep23290777-21diskmemload2
34362592100,3sleep00-21swapper/00
34296682101,4sleep13290777-21diskmemload1
34197452101,4sleep03290777-21diskmemload0
34122212101,3sleep10-21swapper/11
34037882100,1sleep10-21swapper/11
33941272101,4sleep23290777-21diskmemload2
33899932101,2sleep00-21swapper/00
33887542101,3sleep20-21swapper/22
33784722101,3sleep00-21swapper/00
33716432101,3sleep03290777-21diskmemload0
33632592101,2sleep10-21swapper/11
33626862101,4sleep03290777-21diskmemload0
33406272101,3sleep23290777-21diskmemload2
33378962101,5sleep13337910-21ssh1
33374252101,4sleep03290777-21diskmemload0
33241282102,3sleep03324124-21apt-get0
33211252101,3sleep10-21swapper/11
33210742101,3sleep00-21swapper/00
33140232101,3sleep20-21swapper/22
32981662101,3sleep10-21swapper/11
32759352101,6sleep03276283-21kthreadcore0
32702122101,4sleep23270471-21df_inode2
32664962101,5sleep23268197-21kthreadcore2
32600602101,4sleep03260273-21hddtemp_smartct0
32493172100,4sleep03249331-21apt-get0
32480932101,4sleep23248146-21ntp_states2
32261662101,4sleep03227156-21memory0
32261662101,4sleep03227156-21memory0
32073242100,1sleep10-21swapper/11
31764172101,4sleep03176429-21apt-get0
3560765291,2sleep10-21swapper/11
3553241291,2sleep20-21swapper/22
3530431291,2sleep20-21swapper/22
3510890291,4sleep10-21swapper/11
3470455291,4sleep03470466-21sh0
3462686290,1sleep20-21swapper/22
3423044291,3sleep23290777-21diskmemload2
3402929290,2sleep20-21swapper/22
3365364291,5sleep20-21swapper/22
3348806291,3sleep03290777-21diskmemload0
3329096291,2sleep20-21swapper/22
3275677291,4sleep23275703-21grep2
3270751291,4sleep13271532-21cut1
3265525291,4sleep13266495-21cut1
3264955290,4sleep00-21swapper/00
3244099291,3sleep13244118-21apt-get1
3243827291,4sleep23243879-21systemd-run2
3227887291,4sleep13227888-21sshd-session1
3227887291,4sleep13227888-21sshd-session1
3227297290,1sleep20-21swapper/22
3227297290,1sleep20-21swapper/22
3202495290,3sleep20-21swapper/22
3201398291,4sleep03201529-21sensors0
3190874290,5sleep20-21swapper/22
3187154291,4sleep03187310-21head0
3176432291,4sleep13176686-21df1
3163931291,3sleep13163949-21apt-get1
3280920281,4sleep13281052-21grep1
3259768280,2sleep10-21swapper/11
3258599281,3sleep13258744-21grep1
3253376281,3sleep13253464-21ps1
3249588280,1sleep20-21swapper/22
3238282280,1sleep10-21swapper/11
3233743281,2sleep00-21swapper/00
3232368280,1sleep10-21swapper/11
3217793280,2sleep00-21swapper/00
3212712280,1sleep10-21swapper/11
3191609280,1sleep10-21swapper/11
3290593270,1sleep10-21swapper/11
3280632270,2sleep20-21swapper/22
3248818270,1sleep00-21swapper/00
3243607270,1sleep10-21swapper/11
3233370270,1sleep00-21swapper/00
3212538270,1sleep10-21swapper/11
3212413270,1sleep00-21swapper/00
3207337270,1sleep00-21swapper/00
3196295271,2sleep00-21swapper/00
3192093270,2sleep13192095-21apt-get1
3183725270,4sleep00-21swapper/00
3181048270,1sleep20-21swapper/22
3164233270,4sleep03164458-21basename0
3270188260,1sleep00-21swapper/00
3254581261,2sleep00-21swapper/00
3240112261,2sleep00-21swapper/00
3238574260,1sleep20-21swapper/22
3222477260,2sleep20-21swapper/22
3220883261,1sleep1331ktimers/11
3217715260,4sleep20-21swapper/22
3201974260,4sleep10-21swapper/11
3168899261,2sleep23169198-21kthreadcore2
3290727250,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional