You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 15:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Tue Jun 30, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
69423622760,3sleep2421rcuc/22
436893214856,88sleep30-21swapper/33
45942121380,2sleep00-21swapper/00
43712929072,12sleep10-21swapper/11
43667728756,11sleep20-21swapper/22
43226927057,6sleep00-21swapper/00
7196532570,3sleep0701806-21kworker/u16:0+kvfree_rcu_reclaim0
437327992212,6cyclictest662481-21taskset3
43732799216,12cyclictest0-21swapper/33
43732799211,16cyclictest0-21swapper/33
43732799211,16cyclictest0-21swapper/33
43732799211,15cyclictest0-21swapper/33
43732799211,15cyclictest0-21swapper/33
43732799206,2cyclictest0-21swapper/33
43732799202,4cyclictest631000-21taskset3
43732799201,14cyclictest0-21swapper/33
43732799192,11cyclictest513052-21taskset3
437327991916,1cyclictest0-21swapper/33
43732799191,5cyclictest0-21swapper/33
43732799191,15cyclictest0-21swapper/33
43732799191,14cyclictest0-21swapper/33
43732799191,14cyclictest0-21swapper/33
43732799190,1cyclictest0-21swapper/33
9093042181,4sleep0909318-21ssh0
7375682181,3sleep20-21swapper/22
7048952181,7sleep0704906-21ssh0
43732799181,14cyclictest844667-21chrt3
43732799181,14cyclictest66950irq/132-enp1s0-TxRx-33
43732799181,14cyclictest0-21swapper/33
43732799181,14cyclictest0-21swapper/33
43732799181,14cyclictest0-21swapper/33
43732799181,14cyclictest0-21swapper/33
43732799181,14cyclictest0-21swapper/33
43732799181,14cyclictest0-21swapper/33
43732799181,14cyclictest0-21swapper/33
43732799181,14cyclictest0-21swapper/33
43732799181,14cyclictest0-21swapper/33
43732799181,14cyclictest0-21swapper/33
43732799181,14cyclictest0-21swapper/33
43732799181,14cyclictest0-21swapper/33
43732799181,14cyclictest0-21swapper/33
43732799181,14cyclictest0-21swapper/33
43732799181,14cyclictest0-21swapper/33
43732799181,13cyclictest0-21swapper/33
43732799181,13cyclictest0-21swapper/33
43732799181,13cyclictest0-21swapper/33
43732799181,13cyclictest0-21swapper/33
43732799180,15cyclictest0-21swapper/33
43732799180,14cyclictest784351-21chrt3
43732799180,13cyclictest0-21swapper/33
7534372171,3sleep10-21swapper/11
6789932172,4sleep0565179-21diskmemload0
6627942170,3sleep20-21swapper/22
43732799171,4cyclictest0-21swapper/33
437327991711,4cyclictest0-21swapper/33
437327991711,3cyclictest0-21swapper/33
437327991711,3cyclictest0-21swapper/33
43732799171,13cyclictest0-21swapper/33
43732799171,13cyclictest0-21swapper/33
43732799171,13cyclictest0-21swapper/33
43732799171,13cyclictest0-21swapper/33
43732799171,12cyclictest0-21swapper/33
43732799171,11cyclictest0-21swapper/33
43732799170,14cyclictest0-21swapper/33
8934092161,2sleep20-21swapper/22
8357362161,6sleep1835746-21ssh1
8112792161,2sleep20-21swapper/22
6542782162,3sleep2437323-21cyclictest2
43732799161,12cyclictest0-21swapper/33
43732799160,14cyclictest0-21swapper/33
43732799160,13cyclictest0-21swapper/33
43732799160,12cyclictest0-21swapper/33
7690622150,2sleep00-21swapper/00
7304362151,3sleep0730603-21cstates0
7043272150,4sleep1565179-21diskmemload1
6392652151,3sleep0565179-21diskmemload0
6050122151,3sleep10-21swapper/11
5717322151,3sleep0565179-21diskmemload0
5717322151,3sleep0565179-21diskmemload0
5710692151,4sleep2565179-21diskmemload2
5710692151,4sleep2565179-21diskmemload2
4871282151,3sleep1487252-21perl1
4753992151,10sleep2475673-21grep2
43732799158,4cyclictest512458-21chrt3
43732799151,11cyclictest455030-21turbostat3
43732799150,12cyclictest0-21swapper/33
43732799150,12cyclictest0-21swapper/33
9101242141,1sleep10-21swapper/11
8677902141,2sleep20-21swapper/22
8443202141,8sleep1565179-21diskmemload1
7801012141,7sleep2780329-21df_inode2
6477712141,9sleep1647805-21latency_hist1
6364432140,2sleep20-21swapper/22
6046492144,6sleep2604662-21sh2
5793592141,2sleep20-21swapper/22
5178452140,1sleep20-21swapper/22
437327991410,3cyclictest0-21swapper/33
43732799140,12cyclictest0-21swapper/33
43732799140,12cyclictest0-21swapper/33
8939132131,3sleep1893927-21ssh1
8872522130,3sleep0887328-21ssh0
8845802131,3sleep1884595-21ssh1
8608942131,4sleep2860896-21ssh2
7964242131,6sleep10-21swapper/11
7593792131,2sleep20-21swapper/22
7466292131,7sleep2746657-21latency_hist2
7382042131,8sleep1565179-21diskmemload1
6614242131,8sleep0565179-21diskmemload0
6287252130,2sleep1565179-21diskmemload1
5725622131,4sleep10-21swapper/11
5725622131,4sleep10-21swapper/11
5502172131,8sleep0550314-21ps0
5102592131,8sleep2511644-21/usr/sbin/munin2
4763442132,5sleep2476356-21apt-get2
4447692132,6sleep0444788-21apt-get0
43732799139,2cyclictest0-21swapper/33
437327991310,1cyclictest0-21swapper/33
43732799130,2cyclictest0-21swapper/33
43732799130,2cyclictest0-21swapper/33
8775182121,7sleep1565179-21diskmemload1
8674552121,2sleep10-21swapper/11
8449752121,6sleep00-21swapper/00
8254932121,7sleep2825691-21wc2
8129942122,5sleep0813022-21apt-get0
7952082121,6sleep0565179-21diskmemload0
7175622121,7sleep1718063-21head1
7114312121,7sleep2711444-21ssh2
6958062121,7sleep0695813-21ssh0
6827012121,7sleep0684026-21ssh0
6801542121,6sleep2565179-21diskmemload2
6692502121,7sleep1565179-21diskmemload1
6474292121,7sleep2647442-21sh2
6228332120,1sleep10-21swapper/11
5951872121,5sleep2565179-21diskmemload2
4617632121,7sleep2463441-21cut2
43732799121,7cyclictest486832-21taskset3
9102262110,4sleep20-21swapper/22
9004572111,4sleep00-21swapper/00
8853442111,6sleep2885356-21ssh2
8687372110,7sleep0565179-21diskmemload0
8601592111,4sleep10-21swapper/11
8507032111,3sleep20-21swapper/22
8284712110,6sleep0565179-21diskmemload0
8194392111,4sleep1565179-21diskmemload1
8100282111,6sleep0810039-21sh0
7944982111,6sleep1794508-21ssh1
7799162115,3sleep0701806-21kworker/u16:0-ext4-rsv-conversion0
7721472111,4sleep1772275-21irqstats1
7706912110,3sleep20-21swapper/22
7619712110,2sleep10-21swapper/11
7519562112,4sleep2565179-21diskmemload2
7454102111,4sleep0565179-21diskmemload0
7139732111,4sleep272-21kcompactd02
7070752111,5sleep0708670-21cut0
7050552111,4sleep20-21swapper/22
6718842111,4sleep0565179-21diskmemload0
6532572111,3sleep10-21swapper/11
6452362112,4sleep0565179-21diskmemload0
6240462111,7sleep0625557-21kthreadcore0
6206232111,5sleep2565179-21diskmemload2
6135292111,4sleep1565179-21diskmemload1
6087722111,5sleep0610519-21cut0
5976542111,6sleep1597668-21ssh1
5890052111,5sleep2565179-21diskmemload2
5874212111,6sleep0565179-21diskmemload0
5817452112,4sleep1581766-21apt-get1
5812152110,2sleep00-21swapper/00
5602002111,3sleep20-21swapper/22
5444722112,4sleep0544491-21apt-get0
5384032111,5sleep1538598-21users1
5340352111,4sleep2534037-21apt-get2
5078142111,5sleep1508071-21df1
5065722111,5sleep2506625-21/usr/sbin/munin2
4973442112,4sleep2497342-21apt-get2
4962962111,6sleep0496501-21timerwakeupswit0
4698942111,5sleep1470036-21systemctl1
4610932111,6sleep1461761-21cat1
4552832111,4sleep2455282-21apt-get2
9020102100,1sleep10-21swapper/11
8953072101,5sleep2895533-21cstates2
8842922100,1sleep00-21swapper/00
8769402101,2sleep00-21swapper/00
8592212100,1sleep00-21swapper/00
8458712101,4sleep0846133-21df0
8260442101,4sleep1565179-21diskmemload1
8031392101,2sleep00-21swapper/00
7958952100,6sleep2795906-21ssh2
7776022101,3sleep0565179-21diskmemload0
7722762101,5sleep2773337-21kthreadcore2
7695372101,3sleep10-21swapper/11
7551672101,3sleep00-21swapper/00
7546652101,5sleep0754676-21ssh0
7442862100,1sleep10-21swapper/11
7221462100,3sleep00-21swapper/00
7055582100,6sleep10-21swapper/11
6964192101,2sleep10-21swapper/11
6884272100,2sleep20-21swapper/22
6726222101,5sleep1672636-21ssh1
6643862101,5sleep2664419-21ssh2
6612562101,3sleep10-21swapper/11
6547742101,4sleep0565179-21diskmemload0
6298402101,3sleep20-21swapper/22
6226762100,6sleep0622690-21ssh0
6066162101,4sleep2606620-21apt-get2
5948572101,4sleep0565179-21diskmemload0
5739122101,4sleep1574026-21perl1
5554652101,4sleep1555535-21irqstats1
5549852101,5sleep2555094-21cpuspeed_turbos2
5445842101,4sleep2544762-21diskstats2
5340052101,4sleep0533785-21sendmail-msp0
5236112101,4sleep1523791-21diskstats1
5188262101,5sleep1519630-21cut1
4926682101,5sleep2493480-21kthreadcore2
4883152101,4sleep0490007-21cut0
4711032101,4sleep0471357-21df0
875353290,1sleep20-21swapper/22
850692290,3sleep10-21swapper/11
843751291,2sleep20-21swapper/22
835056291,2sleep00-21swapper/00
829967291,4sleep2831141-21cut2
817912291,2sleep20-21swapper/22
809627291,2sleep10-21swapper/11
796485290,3sleep2565179-21diskmemload2
722255291,3sleep2722277-21apt-get2
722153291,4sleep1722167-21ssh1
686005291,2sleep10-21swapper/11
634789291,2sleep10-21swapper/11
603207291,2sleep00-21swapper/00
565079290,1sleep00-21swapper/00
549729290,4sleep1549936-21expr1
545046291,4sleep1546352-21tr1
523523291,5sleep0523608-21cpuspeed_turbos0
513327291,4sleep1513535-21hddtemp_smartct1
485678291,4sleep2485791-21ps2
470037291,4sleep2470262-21cat2
466364291,4sleep0467395-21kthreadcore0
454989291,4sleep2455016-21munin-run2
437496291,2sleep00-21swapper/00
779928281,2sleep10-21swapper/11
539250280,2sleep00-21swapper/00
507813281,2sleep00-21swapper/00
497607281,3sleep0497710-21perl0
496783280,1sleep10-21swapper/11
486841281,2sleep2486860-21apt-get2
486569281,3sleep0563-21systemd-logind0
481614280,2sleep10-21swapper/11
481305281,3sleep1555-21dbus-daemon1
478258281,3sleep0480017-21grep0
460533281,3sleep0460555-21apt-get0
449674280,1sleep10-21swapper/11
439057281,3sleep2440741-21kthreadcore2
565020270,1sleep10-21swapper/11
554433270,1sleep20-21swapper/22
532572270,3sleep20-21swapper/22
528781271,2sleep00-21swapper/00
528171270,1sleep20-21swapper/22
519632270,2sleep20-21swapper/22
518263270,2sleep00-21swapper/00
514988271,3sleep0515130-21kthreadcore0
502283271,2sleep10-21swapper/11
442841271,2sleep20-21swapper/22
438066271,3sleep1439056-21cut1
559587260,1sleep00-21swapper/00
543829260,4sleep10-21swapper/11
539242260,1sleep20-21swapper/22
502552260,4sleep00-21swapper/00
471358261,2sleep10-21swapper/11
459076260,2sleep1459250-21strings1
454762260,1sleep10-21swapper/11
450054261,1sleep00-21swapper/00
528965250,1sleep10-21swapper/11
502553240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional