You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-25 - 03:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat Apr 25, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
373369211658,54sleep30-21swapper/33
37337728466,12sleep10-21swapper/11
37354228152,11sleep20-21swapper/22
37355627254,13sleep00-21swapper/00
37385399239,10cyclictest592954-21turbostat3
37385399232,14cyclictest715666-21chrt3
37385399232,14cyclictest715666-21chrt3
8257442220,1sleep00-21swapper/00
6945412222,17sleep0504807-21diskmemload0
37385399221,17cyclictest872449-21taskset3
37385399220,18cyclictest8003462sleep33
37385399211,16cyclictest0-21swapper/33
37385399201,6cyclictest661019-21taskset3
37385399201,15cyclictest0-21swapper/33
37385399201,15cyclictest0-21swapper/33
37385399200,18cyclictest0-21swapper/33
5311782190,7sleep10-21swapper/11
37385399192,12cyclictest685130-21taskset3
373853991915,2cyclictest0-21swapper/33
37385399191,15cyclictest0-21swapper/33
37385399191,15cyclictest0-21swapper/33
37385399191,14cyclictest66950irq/132-enp1s0-TxRx-33
37385399191,14cyclictest66950irq/132-enp1s0-TxRx-33
37385399191,14cyclictest0-21swapper/33
37385399191,14cyclictest0-21swapper/33
37385399191,14cyclictest0-21swapper/33
37385399191,14cyclictest0-21swapper/33
37385399191,14cyclictest0-21swapper/33
37385399191,14cyclictest0-21swapper/33
373853991910,6cyclictest505140-21taskset3
37385399190,16cyclictest66950irq/132-enp1s0-TxRx-33
4487292180,2sleep00-21swapper/00
373853991816,1cyclictest0-21swapper/33
37385399181,4cyclictest399893-21taskset3
37385399181,14cyclictest66950irq/132-enp1s0-TxRx-33
37385399181,14cyclictest0-21swapper/33
37385399181,14cyclictest0-21swapper/33
37385399181,14cyclictest0-21swapper/33
37385399181,14cyclictest0-21swapper/33
37385399181,14cyclictest0-21swapper/33
37385399181,14cyclictest0-21swapper/33
37385399181,14cyclictest0-21swapper/33
37385399181,14cyclictest0-21swapper/33
37385399181,13cyclictest0-21swapper/33
37385399181,13cyclictest0-21swapper/33
37385399180,16cyclictest0-21swapper/33
37385399180,14cyclictest0-21swapper/33
37385399180,13cyclictest0-21swapper/33
7897032171,4sleep0789759-21ntpq0
6330442170,2sleep20-21swapper/22
5828932171,4sleep0582906-21sh0
5662952171,3sleep00-21swapper/00
5481422171,3sleep00-21swapper/00
373853991714,1cyclictest0-21swapper/33
37385399171,3cyclictest478069-21taskset3
37385399171,3cyclictest0-21swapper/33
373853991711,4cyclictest66950irq/132-enp1s0-TxRx-33
37385399171,13cyclictest0-21swapper/33
37385399171,13cyclictest0-21swapper/33
37385399171,13cyclictest0-21swapper/33
37385399171,13cyclictest0-21swapper/33
37385399171,13cyclictest0-21swapper/33
37385399170,14cyclictest0-21swapper/33
37385399170,14cyclictest0-21swapper/33
37385399170,13cyclictest0-21swapper/33
8707252161,7sleep1504807-21diskmemload1
8544562161,4sleep2504807-21diskmemload2
7495472161,3sleep20-21swapper/22
7295682161,3sleep20-21swapper/22
6793332161,7sleep1504807-21diskmemload1
37385399161,13cyclictest0-21swapper/33
37385399161,13cyclictest0-21swapper/33
37385399161,12cyclictest0-21swapper/33
37385399160,13cyclictest0-21swapper/33
37385399160,13cyclictest0-21swapper/33
8693192151,9sleep0504807-21diskmemload0
8172752150,2sleep00-21swapper/00
7555502152,3sleep2504807-21diskmemload2
7407682152,2sleep2171rcu_preempt2
7398872151,2sleep00-21swapper/00
5574072151,2sleep00-21swapper/00
4463142151,3sleep2446982-21cat2
37385399159,3cyclictest418489-21chrt3
373853991512,1cyclictest0-21swapper/33
37385399150,13cyclictest0-21swapper/33
37385399150,12cyclictest0-21swapper/33
37385399150,12cyclictest0-21swapper/33
37385399150,12cyclictest0-21swapper/33
8087652140,2sleep20-21swapper/22
8014842145,5sleep1331ktimers/11
37385399148,3cyclictest4133732sleep33
37385399142,7cyclictest440463-21taskset3
373853991412,1cyclictest0-21swapper/33
37385399140,12cyclictest0-21swapper/33
37385399140,12cyclictest0-21swapper/33
37385399140,11cyclictest0-21swapper/33
8725422131,8sleep2872749-21cat2
8627242131,7sleep0504807-21diskmemload0
8087932131,2sleep0504807-21diskmemload0
7985732130,4sleep2798700-21ssh2
7914242131,4sleep1791432-21ssh1
7325652131,8sleep0504807-21diskmemload0
7304052131,6sleep10-21swapper/11
7217562130,4sleep0721758-21ssh0
7217562130,4sleep0721758-21ssh0
6604522130,2sleep20-21swapper/22
5924762131,6sleep00-21swapper/00
5888522131,6sleep2588907-21ntpq2
5831202131,7sleep2504807-21diskmemload2
4988262131,8sleep2499075-21head2
4071692131,6sleep1407221-21ntpq1
8547552121,5sleep10-21swapper/11
8181042121,5sleep20-21swapper/22
8013202121,7sleep0801331-21ssh0
7623312121,7sleep1763386-21ssh1
7484862121,5sleep10-21swapper/11
7230772120,3sleep1723091-21ssh1
7230772120,3sleep1723091-21ssh1
7198112121,7sleep2715633-21/usr/sbin/munin2
7198112121,7sleep2715633-21/usr/sbin/munin2
7110472121,5sleep0711138-21ntpq0
6803632121,7sleep0680373-21ssh0
6679622121,2sleep1171rcu_preempt1
6539602120,1sleep00-21swapper/00
6514592120,2sleep10-21swapper/11
6331982121,7sleep0633208-21ssh0
6170972122,4sleep2504807-21diskmemload2
6148742121,4sleep0614964-21ntpq0
6015332121,2sleep1171rcu_preempt1
5723752121,7sleep1504807-21diskmemload1
5477592121,6sleep2504807-21diskmemload2
5125182121,5sleep00-21swapper/00
4780822121,5sleep1478101-21apt-get1
4448092127,2sleep0221rcuc/00
3960612121,5sleep2396149-21ntpq2
8439152111,3sleep20-21swapper/22
8350082111,7sleep0835022-21ssh0
8280152111,3sleep20-21swapper/22
8263482111,5sleep1504807-21diskmemload1
7929532111,3sleep20-21swapper/22
7671002111,6sleep0504807-21diskmemload0
7644712111,4sleep2504807-21diskmemload2
7563302110,1sleep00-21swapper/00
7400502111,7sleep1740064-21ssh1
7125922111,3sleep20-21swapper/22
6814662111,6sleep1682969-21kthreadcore1
6785412111,6sleep2678552-21ssh2
6694362111,6sleep0669449-21sh0
6552642111,7sleep0656050-21grep0
6510662111,6sleep2651076-21ssh2
6103952111,6sleep2610522-21latency_hist2
5984612111,3sleep00-21swapper/00
5983782110,5sleep20-21swapper/22
5815892111,4sleep10-21swapper/11
5741092111,3sleep20-21swapper/22
5623662111,5sleep2562432-21ntp_states2
5549792111,6sleep2554995-21diskmemload2
4961022114,3sleep1497881-21cut1
4605342111,5sleep1460589-21ntpq1
4515122111,6sleep2451684-21cat2
4515122111,6sleep2451684-21cat2
4096422111,6sleep1410518-21kthreadcore1
4016102111,6sleep0401752-21/usr/sbin/munin0
8560112101,6sleep2855524-21/usr/sbin/munin2
8529532101,2sleep00-21swapper/00
8424752101,4sleep0504807-21diskmemload0
8422842101,4sleep1842342-21ntpq1
8361972101,3sleep20-21swapper/22
8339882101,3sleep10-21swapper/11
8194972100,1sleep10-21swapper/11
8112232101,4sleep1504807-21diskmemload1
7840282101,2sleep20-21swapper/22
7819992101,4sleep1504807-21diskmemload1
7560392100,1sleep10-21swapper/11
7458622100,5sleep0504807-21diskmemload0
7111392101,3sleep10-21swapper/11
7050812101,3sleep00-21swapper/00
6985702101,3sleep10-21swapper/11
6954652101,2sleep20-21swapper/22
6946062101,4sleep1504807-21diskmemload1
6878142101,3sleep20-21swapper/22
6698662101,4sleep2504807-21diskmemload2
6612912101,4sleep1504807-21diskmemload1
6437902101,6sleep0643802-21ssh0
6262042101,3sleep2504807-21diskmemload2
6252222101,4sleep1504807-21diskmemload1
6179342101,2sleep10-21swapper/11
6084622100,2sleep1608475-21ssh1
6063042100,6sleep0606360-21ssh0
5725672100,1sleep00-21swapper/00
5561202101,3sleep1504807-21diskmemload1
5464072101,4sleep1504807-21diskmemload1
5383472101,2sleep20-21swapper/22
5372032101,2sleep00-21swapper/00
5308752101,3sleep00-21swapper/00
5279692101,4sleep2504807-21diskmemload2
5204492100,3sleep00-21swapper/00
5204492100,3sleep00-21swapper/00
5182762101,5sleep1518346-21rm1
5182762101,5sleep1518346-21rm1
5118382101,3sleep20-21swapper/22
5051142101,3sleep10-21swapper/11
5037702101,4sleep2503811-21ntpq2
4828892101,3sleep20-21swapper/22
4514082101,5sleep1451511-21/usr/sbin/munin1
4514082101,5sleep1451511-21/usr/sbin/munin1
4496822100,5sleep1449823-21ntpq1
4404412100,5sleep20-21swapper/22
4341532101,5sleep2434415-21sed2
4298692101,4sleep1430084-21df_inode1
4231762101,4sleep2423226-21ntpq2
4231322101,5sleep1423170-21ntpq1
4018052101,5sleep2401851-21ntpq2
861009291,3sleep1504807-21diskmemload1
782498291,4sleep0782512-21ssh0
774572291,3sleep2504807-21diskmemload2
773502290,2sleep10-21swapper/11
773144290,2sleep00-21swapper/00
702321291,4sleep2702420-21ntpq2
680705291,3sleep00-21swapper/00
642647291,4sleep1642662-21ssh1
637134291,4sleep2637147-21ssh2
632841291,4sleep1633041-21unixbench-2d1
627534291,2sleep00-21swapper/00
564395291,2sleep10-21swapper/11
539094291,2sleep10-21swapper/11
514177291,4sleep2514372-21expr2
514177291,4sleep2514372-21expr2
483988291,3sleep0484198-21hddtemp_smartct0
473553291,4sleep0475242-21cut0
467399291,4sleep1467417-21apt-get1
435703291,5sleep0437196-21kthreadcore0
428557291,4sleep2428605-21ntpq2
425007291,4sleep1426182-21kthreadcore1
408702291,4sleep2408805-21perl2
403604291,5sleep0404214-21kthreadcore0
375374290,5sleep2377122-21kthreadcore2
590936281,2sleep10-21swapper/11
476659280,1sleep20-21swapper/22
468829281,3sleep2469482-21kthreadcore2
467139281,3sleep21-21systemd2
457017281,3sleep0457619-21kthreadcore0
456208281,4sleep0456267-21latency_hist0
456208281,4sleep0456267-21latency_hist0
434632280,1sleep00-21swapper/00
419388281,3sleep0419597-21hddtemp_smartct0
412777281,4sleep0412790-21systemctl0
397697281,2sleep1397716-21apt-get1
391506280,2sleep20-21swapper/22
386739281,2sleep00-21swapper/00
381930281,3sleep10-21swapper/11
379105280,4sleep20-21swapper/22
374016281,2sleep10-21swapper/11
504461270,1sleep00-21swapper/00
498479271,2sleep00-21swapper/00
493899270,1sleep00-21swapper/00
489032270,1sleep20-21swapper/22
477644270,1sleep10-21swapper/11
461337270,1sleep20-21swapper/22
439490271,2sleep10-21swapper/11
429509270,1sleep00-21swapper/00
418802270,1sleep20-21swapper/22
393606271,2sleep00-21swapper/00
391520270,1sleep10-21swapper/11
385320270,2sleep0385433-21ntpq0
378988270,1sleep00-21swapper/00
504776260,1sleep10-21swapper/11
493889260,2sleep10-21swapper/11
488720260,4sleep10-21swapper/11
483718260,3sleep20-21swapper/22
471357260,2sleep00-21swapper/00
462012260,2sleep1461511-21apt-get1
445350260,4sleep10-21swapper/11
417859261,2sleep00-21swapper/00
416016260,3sleep10-21swapper/11
397004260,4sleep10-21swapper/11
482032250,1sleep00-21swapper/00
463219250,1sleep00-21swapper/00
403338251,1sleep20-21swapper/22
435392240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional