You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 23:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Mon Mar 30, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
397251212353,64sleep30-21swapper/33
40163028568,11sleep20-21swapper/22
40172328362,12sleep10-21swapper/11
40186027855,6sleep00-21swapper/00
7255722251,13sleep2725586-21sh2
40203599250,16cyclictest0-21swapper/33
40203599231,20cyclictest0-21swapper/33
40203599231,18cyclictest0-21swapper/33
40203599221,3cyclictest0-21swapper/33
40203599220,5cyclictest0-21swapper/33
40203599220,1cyclictest0-21swapper/33
40203599212,14cyclictest612432-21chrt3
40203599212,14cyclictest612432-21chrt3
402035992116,3cyclictest0-21swapper/33
402035992115,3cyclictest0-21swapper/33
40203599211,16cyclictest0-21swapper/33
40203599211,16cyclictest0-21swapper/33
40203599211,13cyclictest0-21swapper/33
402035992110,8cyclictest0-21swapper/33
40203599210,1cyclictest0-21swapper/33
40203599210,1cyclictest0-21swapper/33
40203599210,15cyclictest0-21swapper/33
40203599210,13cyclictest0-21swapper/33
8070462201,3sleep10-21swapper/11
40203599201,16cyclictest0-21swapper/33
40203599201,16cyclictest0-21swapper/33
40203599201,16cyclictest0-21swapper/33
40203599201,16cyclictest0-21swapper/33
40203599201,16cyclictest0-21swapper/33
40203599201,15cyclictest522268-21turbostat3
40203599201,15cyclictest0-21swapper/33
40203599201,15cyclictest0-21swapper/33
40203599201,15cyclictest0-21swapper/33
40203599201,15cyclictest0-21swapper/33
40203599201,15cyclictest0-21swapper/33
40203599200,17cyclictest743941-21chrt3
8278602191,4sleep0827874-21ssh0
8023442191,4sleep1532953-21diskmemload1
5574522191,3sleep20-21swapper/22
40203599191,16cyclictest0-21swapper/33
402035991911,5cyclictest479649-21turbostat3
40203599191,15cyclictest0-21swapper/33
40203599191,15cyclictest0-21swapper/33
40203599191,15cyclictest0-21swapper/33
40203599191,15cyclictest0-21swapper/33
40203599191,15cyclictest0-21swapper/33
40203599191,15cyclictest0-21swapper/33
40203599191,15cyclictest0-21swapper/33
40203599191,15cyclictest0-21swapper/33
40203599191,14cyclictest653533-21taskset3
40203599191,14cyclictest532952-21turbostat3
40203599191,14cyclictest527599-21turbostat3
40203599191,14cyclictest506288-21turbostat3
40203599191,14cyclictest447052-21turbostat3
40203599191,14cyclictest0-21swapper/33
40203599191,14cyclictest0-21swapper/33
40203599191,14cyclictest0-21swapper/33
40203599191,12cyclictest441369-21chrt3
40203599190,2cyclictest0-21swapper/33
40203599190,16cyclictest0-21swapper/33
8841042181,4sleep1532953-21diskmemload1
8731392181,3sleep20-21swapper/22
7436852181,3sleep20-21swapper/22
6603542181,5sleep2660413-21ntpq2
6288482181,2sleep20-21swapper/22
50624321810,4sleep00-21swapper/00
4529942181,5sleep0453210-21diskstats0
40203599181,5cyclictest0-21swapper/33
40203599181,14cyclictest0-21swapper/33
40203599181,14cyclictest0-21swapper/33
40203599181,13cyclictest0-21swapper/33
40203599181,11cyclictest66950irq/132-enp1s0-TxRx-33
8926522171,4sleep1532953-21diskmemload1
8096502171,3sleep2809739-21proc_pri2
7335622171,3sleep10-21swapper/11
6903302171,4sleep2690341-21ssh2
6439042170,3sleep10-21swapper/11
402035991711,4cyclictest0-21swapper/33
40203599170,9cyclictest0-21swapper/33
40203599170,14cyclictest0-21swapper/33
8896292161,3sleep20-21swapper/22
8630832160,1sleep20-21swapper/22
5747412160,1sleep10-21swapper/11
40203599161,4cyclictest0-21swapper/33
40203599161,12cyclictest469009-21turbostat3
40203599160,13cyclictest0-21swapper/33
8473802151,1sleep00-21swapper/00
8470752151,9sleep1532953-21diskmemload1
8296462150,1sleep20-21swapper/22
8215182151,2sleep20-21swapper/22
8207802151,10sleep0820793-21ssh0
7172692151,10sleep0717283-21ssh0
6825362151,3sleep1532953-21diskmemload1
6450822150,1sleep20-21swapper/22
5486662151,3sleep1532953-21diskmemload1
4745662151,2sleep10-21swapper/11
40203599150,8cyclictest0-21swapper/33
40203599150,8cyclictest0-21swapper/33
40203599150,7cyclictest0-21swapper/33
40203599150,6cyclictest0-21swapper/33
40203599150,13cyclictest0-21swapper/33
8798552141,8sleep2532953-21diskmemload2
8796722141,6sleep0879765-21ps0
8742212141,2sleep00-21swapper/00
8403012142,7sleep2840323-21apt-get2
8370472141,3sleep00-21swapper/00
7952132141,9sleep0795225-21ssh0
7780392141,2sleep00-21swapper/00
7219852142,6sleep1722047-21ntpq1
6707782140,3sleep20-21swapper/22
6163502141,3sleep1616540-21ssh1
6163502141,3sleep1616540-21ssh1
6099382140,2sleep20-21swapper/22
5462532140,4sleep2546312-21ssh2
4023362141,8sleep2402491-21diskstats2
8973442131,8sleep0897429-21find0
8373122130,1sleep10-21swapper/11
8369132131,6sleep20-21swapper/22
7872732131,8sleep1532953-21diskmemload1
7140942131,7sleep1532953-21diskmemload1
6700562131,6sleep10-21swapper/11
6625492131,5sleep10-21swapper/11
6551862131,8sleep10-21swapper/11
5854492130,3sleep2532953-21diskmemload2
5583902130,1sleep00-21swapper/00
5376802131,8sleep2537806-21/usr/sbin/munin2
5047762131,7sleep2505224-21grep2
8512792121,7sleep2853005-21ssh2
8293372121,3sleep1829350-21ssh1
8143722121,5sleep1814489-21perl1
8103572121,8sleep0810362-21rm0
7791592121,5sleep0706396-21kworker/u16:2+ext4-rsv-conversion0
7615522121,8sleep2761758-21expr2
7589812121,6sleep2532953-21diskmemload2
7337262121,5sleep2532953-21diskmemload2
6954102121,6sleep2695470-21ntpq2
6728212121,5sleep00-21swapper/00
6365162121,7sleep2636531-21ssh2
6360952121,7sleep1532953-21diskmemload1
6007982121,4sleep00-21swapper/00
5928612121,8sleep0592870-21sh0
5833412120,2sleep00-21swapper/00
5827922120,1sleep10-21swapper/11
4857242121,7sleep1485800-21uname1
4813802121,7sleep2483159-21cut2
4749522121,7sleep0475103-21if_enp1s00
4733372121,1sleep00-21swapper/00
4627022121,5sleep1462758-21ntpq1
4425482121,7sleep0443925-21cut0
4360012120,7sleep1435930-31find1
8817752110,1sleep10-21swapper/11
8048902111,6sleep2805133-21latency_hist2
7933252110,7sleep2793338-21ssh2
7853132111,3sleep20-21swapper/22
7693072111,6sleep1769318-21ssh1
7689922111,3sleep00-21swapper/00
7530922111,5sleep0753314-21hddtemp_smartct0
7526672111,5sleep1532953-21diskmemload1
7491532110,1sleep10-21swapper/11
7320792111,6sleep0732094-21ssh0
7147642111,6sleep2532953-21diskmemload2
6975862111,5sleep1532953-21diskmemload1
6803542110,1sleep20-21swapper/22
6795172110,2sleep00-21swapper/00
6633552111,6sleep0802-21snmpd0
6524012111,4sleep2532953-21diskmemload2
6271962111,5sleep0627210-21ssh0
6127032111,3sleep00-21swapper/00
6127032111,3sleep00-21swapper/00
6124002111,3sleep20-21swapper/22
6124002111,3sleep20-21swapper/22
6109522110,1sleep00-21swapper/00
6086542110,2sleep1532953-21diskmemload1
5685662111,5sleep2568833-21df2
5648292111,4sleep0532953-21diskmemload0
5389932111,4sleep1532953-21diskmemload1
5253182111,5sleep2526426-21memory2
5114712111,4sleep172-21kcompactd01
4958562111,4sleep1495875-21apt-get1
4680262111,5sleep1468082-21ntpq1
4422652111,5sleep2442474-21hddtemp_smartct2
4355972111,5sleep0435841-21users0
4245132111,5sleep1424564-21ntpq1
9002802101,4sleep2532953-21diskmemload2
8906712100,1sleep00-21swapper/00
8567242101,2sleep00-21swapper/00
8549572101,4sleep1532953-21diskmemload1
7964612101,2sleep00-21swapper/00
7935702101,4sleep1532953-21diskmemload1
7702862101,4sleep1770554-21df1
7501562101,3sleep00-21swapper/00
7428462101,5sleep1742854-21ssh1
7407152100,1sleep20-21swapper/22
7177772101,5sleep0717800-21ssh0
7068002101,3sleep00-21swapper/00
7001992101,4sleep1532953-21diskmemload1
6883892101,3sleep00-21swapper/00
6800342101,4sleep1532953-21diskmemload1
6453582101,4sleep0532953-21diskmemload0
6351762101,2sleep00-21swapper/00
6031542101,4sleep2532953-21diskmemload2
6017592101,2sleep10-21swapper/11
5918102101,3sleep20-21swapper/22
5673952101,2sleep20-21swapper/22
5589922101,4sleep1532953-21diskmemload1
5420612100,1sleep00-21swapper/00
5399912100,1sleep00-21swapper/00
5070942101,6sleep0507817-21kthreadcore0
4838662101,4sleep0483947-21ntpq0
4636522101,4sleep0463674-21munin-run0
4627602101,6sleep2462849-21grep2
4151572101,4sleep1415176-21apt-get1
4144112100,2sleep20-21swapper/22
4062542100,5sleep10-21swapper/11
871652291,4sleep1871664-21sh1
862906291,3sleep00-21swapper/00
857690291,3sleep1532953-21diskmemload1
775183291,5sleep2532953-21diskmemload2
735215291,2sleep00-21swapper/00
706977291,4sleep2706991-21ssh2
690867291,4sleep0691107-21ssh0
652674291,2sleep00-21swapper/00
628427291,3sleep1532953-21diskmemload1
592415291,4sleep1592426-21ssh1
573615291,2sleep00-21swapper/00
559891291,2sleep10-21swapper/11
528417291,4sleep0529396-21grep0
527589290,1sleep10-21swapper/11
513224291,5sleep0514984-21kthreadcore0
490553290,2sleep00-21swapper/00
485242291,4sleep2485369-21grep2
464528291,4sleep0466187-21tr0
425825291,3sleep2425844-21apt-get2
421065291,4sleep2422299-21cut2
420783291,4sleep0420980-21grep0
407828291,4sleep0409007-21grep0
402201291,4sleep0402220-21apt-get0
527373280,1sleep10-21swapper/11
522521280,2sleep00-21swapper/00
522083280,1sleep00-21swapper/00
510915283,2sleep20-21swapper/22
479922281,3sleep1479943-21http1
468972281,3sleep2255-21systemd-journal2
457988281,3sleep1458081-21apt-config1
431702281,3sleep2432994-21cat2
415145280,1sleep00-21swapper/00
413438280,1sleep10-21swapper/11
532042271,3sleep2532121-21proc_pri2
521373270,4sleep20-21swapper/22
516793270,1sleep10-21swapper/11
500854270,5sleep00-21swapper/00
495878270,3sleep2496034-21cstates2
494907271,3sleep1494991-21timerandwakeup1
489038270,2sleep0489211-21strings0
475547271,3sleep20-21swapper/22
447579270,1sleep20-21swapper/22
436626270,2sleep00-21swapper/00
430532270,1sleep00-21swapper/00
430528270,1sleep10-21swapper/11
419267271,2sleep20-21swapper/22
516578260,1sleep20-21swapper/22
505323260,2sleep10-21swapper/11
495394260,3sleep2802-21snmpd2
474150260,1sleep20-21swapper/22
474109260,1sleep10-21swapper/11
447246260,1sleep00-21swapper/00
443927261,2sleep10-21swapper/11
437230261,2sleep10-21swapper/11
436618260,1sleep20-21swapper/22
520063250,1sleep10-21swapper/11
453421250,1sleep20-21swapper/22
447860250,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional