You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 00:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Tue Jul 21, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
393920211958,56sleep30-21swapper/33
39394928669,10sleep20-21swapper/22
38936728356,11sleep10-21swapper/11
39400127353,14sleep00-21swapper/00
8872642430,2sleep10-21swapper/11
6783542270,2sleep30-21swapper/33
39438999268,14cyclictest0-21swapper/33
394389992421,1cyclictest0-21swapper/33
394389992420,2cyclictest0-21swapper/33
394389992420,2cyclictest0-21swapper/33
394389992318,2cyclictest0-21swapper/33
394389992317,3cyclictest66950irq/132-enp1s0-TxRx-33
8095242223,6sleep0522195-21diskmemload0
394389992217,3cyclictest0-21swapper/33
394389992214,4cyclictest0-21swapper/33
39438999212,16cyclictest66950irq/132-enp1s0-TxRx-33
394389992118,1cyclictest0-21swapper/33
394389992118,1cyclictest0-21swapper/33
394389992117,2cyclictest0-21swapper/33
394389992117,2cyclictest0-21swapper/33
394389992116,2cyclictest0-21swapper/33
394389992116,2cyclictest0-21swapper/33
39438999211,17cyclictest66950irq/132-enp1s0-TxRx-33
39438999211,16cyclictest624691-21taskset3
39438999207,11cyclictest0-21swapper/33
39438999207,11cyclictest0-21swapper/33
39438999205,13cyclictest0-21swapper/33
39438999205,13cyclictest0-21swapper/33
39438999204,14cyclictest0-21swapper/33
394389992018,1cyclictest0-21swapper/33
394389992018,1cyclictest0-21swapper/33
394389992017,1cyclictest0-21swapper/33
394389992017,1cyclictest0-21swapper/33
394389992017,1cyclictest0-21swapper/33
394389992017,1cyclictest0-21swapper/33
394389992017,1cyclictest0-21swapper/33
394389992017,1cyclictest0-21swapper/33
394389992016,2cyclictest0-21swapper/33
394389992016,2cyclictest0-21swapper/33
394389992016,2cyclictest0-21swapper/33
394389992015,3cyclictest0-21swapper/33
394389992012,5cyclictest0-21swapper/33
8318372191,9sleep2522195-21diskmemload2
7718992191,4sleep2522195-21diskmemload2
7718992191,4sleep2522195-21diskmemload2
5298572191,2sleep20-21swapper/22
394389991916,1cyclictest0-21swapper/33
394389991916,1cyclictest0-21swapper/33
394389991916,1cyclictest0-21swapper/33
394389991916,1cyclictest0-21swapper/33
394389991915,2cyclictest0-21swapper/33
394389991915,2cyclictest0-21swapper/33
39438999191,15cyclictest0-21swapper/33
39438999191,13cyclictest0-21swapper/33
394389991911,2cyclictest0-21swapper/33
39438999190,17cyclictest0-21swapper/33
8571352181,13sleep1857230-21pmu-power1
8226612181,13sleep10-21swapper/11
7806892181,4sleep1522195-21diskmemload1
7405882181,3sleep20-21swapper/22
6429612181,2sleep10-21swapper/11
394389991815,1cyclictest0-21swapper/33
394389991814,2cyclictest0-21swapper/33
394389991814,2cyclictest0-21swapper/33
394389991813,2cyclictest0-21swapper/33
394389991813,2cyclictest0-21swapper/33
394389991811,4cyclictest66950irq/132-enp1s0-TxRx-33
7399682171,11sleep10-21swapper/11
6874512171,3sleep0687517-21ssh0
6580762171,3sleep10-21swapper/11
5660062171,4sleep0522195-21diskmemload0
39438999176,7cyclictest480242-21sleep3
394389991714,1cyclictest0-21swapper/33
394389991713,2cyclictest0-21swapper/33
39438999171,14cyclictest0-21swapper/33
39438999171,13cyclictest0-21swapper/33
39438999170,14cyclictest0-21swapper/33
39438999170,14cyclictest0-21swapper/33
39438999170,14cyclictest0-21swapper/33
7909862160,1sleep20-21swapper/22
6790832160,1sleep10-21swapper/11
6757612160,2sleep00-21swapper/00
5486482161,4sleep1522195-21diskmemload1
4595472161,4sleep2459566-21apt-get2
39438999167,6cyclictest522201-21turbostat3
394389991613,1cyclictest0-21swapper/33
394389991612,2cyclictest0-21swapper/33
39438999161,13cyclictest0-21swapper/33
8764162151,8sleep00-21swapper/00
8746252151,8sleep2874790-21sensors_temp2
6755392151,2sleep20-21swapper/22
6261452151,10sleep1626158-21ssh1
394389991513,1cyclictest0-21swapper/33
394389991511,2cyclictest0-21swapper/33
39438999150,12cyclictest0-21swapper/33
39438999150,12cyclictest0-21swapper/33
8666032141,8sleep2522195-21diskmemload2
8611872141,8sleep2861198-21ssh2
8453472141,9sleep0846912-21cut0
7821572141,8sleep0522195-21diskmemload0
7648322140,2sleep00-21swapper/00
7133122141,8sleep1522195-21diskmemload1
6858962141,8sleep2685910-21ssh2
5462352141,3sleep1546249-21ssh1
5373042141,2sleep20-21swapper/22
5014682142,6sleep2501487-21apt-get2
39438999149,2cyclictest0-21swapper/33
8851732131,2sleep00-21swapper/00
8513692131,8sleep1851383-21ssh1
8343102130,1sleep10-21swapper/11
8259952130,1sleep20-21swapper/22
8237722131,8sleep0823784-21ssh0
8149692131,6sleep10-21swapper/11
7542872131,7sleep0522195-21diskmemload0
7277192131,8sleep0727733-21ssh0
7139382133,5sleep0713960-21apt-get0
6668922131,8sleep2522195-21diskmemload2
6589382130,1sleep00-21swapper/00
5984202131,8sleep0598435-21ssh0
5895632131,7sleep1522195-21diskmemload1
4678062130,1sleep00-21swapper/00
4065142130,1sleep00-21swapper/00
39438999139,3cyclictest0-21swapper/33
8517842120,1sleep20-21swapper/22
8425932121,7sleep1842607-21ssh1
8419492124,3sleep2522195-21diskmemload2
8097172121,5sleep2809842-21diskstats2
7727582121,7sleep1522195-21diskmemload1
7727582121,7sleep1522195-21diskmemload1
7716132121,7sleep0771627-21ssh0
7716132121,7sleep0771627-21ssh0
7245312121,6sleep1726189-21kthreadcore1
7203512121,7sleep2720364-21rm2
7096322121,6sleep2709864-21/usr/sbin/munin2
7041312120,1sleep20-21swapper/22
7019712120,3sleep10-21swapper/11
6588122121,7sleep2106713-21snmpd2
6258502120,2sleep20-21swapper/22
6046592121,3sleep0605023-21needreboot0
5976492123,2sleep1171rcu_preempt1
5970002121,5sleep2522195-21diskmemload2
5660502121,5sleep2566053-21apt-get2
5556162121,7sleep2522195-21diskmemload2
5392412120,1sleep072-21kcompactd00
4857242122,4sleep2485736-21apt-get2
4798552121,3sleep20-21swapper/22
4700212121,7sleep2470022-21http2
4402042121,7sleep2441923-21tr2
4333932121,5sleep1433110-21apt-get1
8617522111,5sleep1861964-21df_inode1
8314642111,5sleep0831660-21users0
7980432110,7sleep2798056-21ssh2
7978322111,2sleep10-21swapper/11
7917312111,5sleep1791761-21munin-run1
7638332110,2sleep2763840-21ssh2
7559282111,4sleep1522195-21diskmemload1
7451942111,5sleep0522195-21diskmemload0
7372252110,3sleep20-21swapper/22
7364612110,7sleep1736475-21ssh1
7121272111,3sleep00-21swapper/00
7019562110,7sleep0701970-21ssh0
6955512111,2sleep1695565-21ssh1
6495092110,1sleep00-21swapper/00
6067912111,4sleep2522195-21diskmemload2
5913332111,3sleep00-21swapper/00
5891642110,7sleep2589177-21rm2
5468822110,2sleep0522195-21diskmemload0
5120262111,5sleep1512283-21df1
4909752111,4sleep0490995-21apt-get0
4231242111,5sleep1423333-21hddtemp_smartct1
4230002111,5sleep0423123-21diskstats0
4073992111,5sleep0407608-21hddtemp_smartct0
4073992111,5sleep0407608-21hddtemp_smartct0
8710122103,3sleep1871016-21kthreadcore1
8675522101,4sleep0522195-21diskmemload0
8361312101,4sleep0836211-21irqstats0
8073802101,3sleep10-21swapper/11
8058772101,3sleep2522195-21diskmemload2
7903462101,4sleep0522195-21diskmemload0
7746562101,3sleep20-21swapper/22
7636202100,2sleep10-21swapper/11
7139712101,5sleep1714141-21cstates1
6953622101,3sleep20-21swapper/22
6779632101,5sleep1677977-21ssh1
6693222101,4sleep0522195-21diskmemload0
6688232101,3sleep10-21swapper/11
6426842101,2sleep00-21swapper/00
6405692101,4sleep2522195-21diskmemload2
6327082101,2sleep20-21swapper/22
6319682101,4sleep0522195-21diskmemload0
6269192100,1sleep10-21swapper/11
6165292101,2sleep00-21swapper/00
6151742101,3sleep20-21swapper/22
6146002101,3sleep10-21swapper/11
5826222101,4sleep2522195-21diskmemload2
5814932101,2sleep10-21swapper/11
5749592101,4sleep0575096-21diskstats0
5722262101,4sleep1522195-21diskmemload1
5627352101,2sleep20-21swapper/22
5627352101,2sleep20-21swapper/22
5375522101,2sleep10-21swapper/11
5299292101,3sleep00-21swapper/00
5283672101,3sleep10-21swapper/11
5120242101,3sleep00-21swapper/00
5067272101,4sleep2506730-21apt-get2
4910512101,4sleep2491265-21diskstats2
4805202101,5sleep1480758-21df_inode1
4792302104,3sleep0479291-21ntp_offset0
4381192100,2sleep00-21swapper/00
4324992101,5sleep1432716-21users1
4123822101,4sleep2412385-21apt-get2
4123822101,4sleep2412385-21apt-get2
4076812103,3sleep20-21swapper/22
4076812103,3sleep20-21swapper/22
884845291,4sleep20-21swapper/22
852959290,5sleep0205-21jbd2/sda2-80
807837291,2sleep00-21swapper/00
799864291,2sleep00-21swapper/00
754001291,4sleep2754015-21ssh2
738883291,3sleep0522195-21diskmemload0
729705290,1sleep20-21swapper/22
693295291,3sleep0522195-21diskmemload0
645257291,4sleep1646809-21cut1
644706291,4sleep2644820-21perl2
625773291,2sleep00-21swapper/00
606059291,2sleep10-21swapper/11
563123291,3sleep0522195-21diskmemload0
563123291,3sleep0522195-21diskmemload0
562823291,4sleep1522195-21diskmemload1
562823291,4sleep1522195-21diskmemload1
554228291,3sleep0522195-21diskmemload0
540005291,2sleep20-21swapper/22
506288290,1sleep00-21swapper/00
490682291,4sleep139542-21systemd-journal1
481029291,4sleep0481665-21grep0
469704291,4sleep1469783-21munin-run1
456592291,4sleep0458187-21cat0
407107291,3sleep10-21swapper/11
407107291,3sleep10-21swapper/11
521245281,3sleep2521306-21ls2
517233280,3sleep1517252-21apt-get1
514263281,3sleep2515861-21latency2
496255281,2sleep00-21swapper/00
485446282,3sleep21-21systemd2
475809281,3sleep1477230-21cut1
469999280,3sleep1470018-21apt-get1
461514281,3sleep0463279-21cut0
454337280,1sleep20-21swapper/22
444562281,3sleep0446159-21kthreadcore0
428097281,3sleep0205-21jbd2/sda2-80
427279281,3sleep20-21swapper/22
422561281,3sleep2422617-2192
418217281,3sleep10-21swapper/11
416639280,1sleep10-21swapper/11
416639280,1sleep10-21swapper/11
401814281,3sleep2401833-21apt-get2
394586281,3sleep0394731-21/usr/sbin/munin0
521459270,3sleep0521676-21unixbench-2d0
506145270,1sleep10-21swapper/11
491547271,3sleep1492692-21cut1
453977270,1sleep00-21swapper/00
453973270,1sleep10-21swapper/11
449096270,2sleep20-21swapper/22
448784271,2sleep10-21swapper/11
438630270,2sleep00-21swapper/00
434993271,3sleep2436698-21kthreadcore2
428126270,2sleep20-21swapper/22
417620270,2sleep00-21swapper/00
406812271,3sleep10-21swapper/11
511673261,2sleep00-21swapper/00
500323261,2sleep10-21swapper/11
499016260,1sleep20-21swapper/22
489878261,2sleep00-21swapper/00
474198260,2sleep00-21swapper/00
465321261,2sleep20-21swapper/22
463281260,2sleep1463514-21strings1
454315260,2sleep10-21swapper/11
439201261,2sleep10-21swapper/11
398322260,2sleep2398561-21strings2
396561261,1sleep10-21swapper/11
506710250,1sleep10-21swapper/11
443839251,1sleep20-21swapper/22
416548250,1sleep00-21swapper/00
416548250,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional