You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-09 - 10:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sun Aug 09, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
85942822970,1sleep1522176-21diskmemload1
393788212553,67sleep30-21swapper/33
39392428567,12sleep10-21swapper/11
39390128567,12sleep20-21swapper/22
7649692810,1sleep0764972-21cut0
39368627756,15sleep00-21swapper/00
4329952420,4sleep2421rcuc/22
39420999221,17cyclictest0-21swapper/33
39420999211,6cyclictest778697-21taskset3
39420999211,16cyclictest0-21swapper/33
39420999211,15cyclictest682020-21chrt3
39420999211,15cyclictest0-21swapper/33
39420999208,9cyclictest485386-21turbostat3
394209992017,2cyclictest0-21swapper/33
39420999201,16cyclictest0-21swapper/33
39420999201,15cyclictest0-21swapper/33
39420999200,17cyclictest0-21swapper/33
8132352191,2sleep00-21swapper/00
394209991915,2cyclictest516906-21taskset3
394209991915,2cyclictest0-21swapper/33
39420999191,15cyclictest0-21swapper/33
39420999191,15cyclictest0-21swapper/33
39420999191,15cyclictest0-21swapper/33
39420999191,15cyclictest0-21swapper/33
39420999191,15cyclictest0-21swapper/33
39420999191,14cyclictest0-21swapper/33
39420999191,14cyclictest0-21swapper/33
39420999191,14cyclictest0-21swapper/33
39420999191,14cyclictest0-21swapper/33
39420999191,14cyclictest0-21swapper/33
39420999191,14cyclictest0-21swapper/33
39420999191,14cyclictest0-21swapper/33
39420999191,14cyclictest0-21swapper/33
5468812181,4sleep00-21swapper/00
5212612180,10sleep0521370-21processes0
39420999181,5cyclictest0-21swapper/33
39420999181,5cyclictest0-21swapper/33
39420999181,5cyclictest0-21swapper/33
394209991812,4cyclictest0-21swapper/33
39420999181,14cyclictest0-21swapper/33
39420999181,14cyclictest0-21swapper/33
39420999181,14cyclictest0-21swapper/33
39420999181,14cyclictest0-21swapper/33
39420999181,14cyclictest0-21swapper/33
39420999181,13cyclictest0-21swapper/33
39420999181,13cyclictest0-21swapper/33
39420999181,13cyclictest0-21swapper/33
394209991810,5cyclictest0-21swapper/33
39420999180,15cyclictest0-21swapper/33
39420999180,15cyclictest0-21swapper/33
39420999180,15cyclictest0-21swapper/33
8299452171,2sleep10-21swapper/11
7605772171,2sleep00-21swapper/00
7478602171,9sleep0748010-21ntp_192.168.1140
39420999171,4cyclictest0-21swapper/33
394209991714,1cyclictest0-21swapper/33
39420999171,3cyclictest0-21swapper/33
394209991713,2cyclictest0-21swapper/33
39420999171,13cyclictest0-21swapper/33
39420999171,12cyclictest0-21swapper/33
39420999170,14cyclictest0-21swapper/33
39420999170,14cyclictest0-21swapper/33
39420999170,14cyclictest0-21swapper/33
39420999170,13cyclictest0-21swapper/33
8215622161,5sleep2522176-21diskmemload2
8139512161,4sleep2522176-21diskmemload2
7406042161,3sleep10-21swapper/11
6694162161,2sleep00-21swapper/00
6557202161,6sleep1655942-21hddtemp_smartct1
6531542161,2sleep00-21swapper/00
6102442160,1sleep10-21swapper/11
5823572161,4sleep1522176-21diskmemload1
4909312161,4sleep0490950-21apt-get0
4535762160,1sleep10-21swapper/11
39420999164,7cyclictest444263-21taskset3
39420999161,3cyclictest0-21swapper/33
394209991611,3cyclictest0-21swapper/33
39420999161,12cyclictest0-21swapper/33
394209991610,4cyclictest0-21swapper/33
394209991610,3cyclictest0-21swapper/33
39420999160,14cyclictest0-21swapper/33
39420999160,13cyclictest0-21swapper/33
39420999160,13cyclictest0-21swapper/33
39420999160,13cyclictest0-21swapper/33
39420999160,13cyclictest0-21swapper/33
7072972151,9sleep2522176-21diskmemload2
6971112151,9sleep1697125-21ssh1
6971112151,9sleep1697125-21ssh1
6901582151,4sleep1690170-21ssh1
5811872151,2sleep20-21swapper/22
39420999150,12cyclictest0-21swapper/33
8870332140,2sleep20-21swapper/22
7168212141,3sleep00-21swapper/00
6380292141,9sleep2638234-21tail2
6376052141,7sleep0522176-21diskmemload0
6288932141,2sleep20-21swapper/22
6249022142,4sleep1624917-21sshd-session1
6096712141,4sleep2609684-21ssh2
5898872141,3sleep2589902-21ssh2
5851192141,6sleep1585199-21irqstats1
5363712141,3sleep0522176-21diskmemload0
39420999148,3cyclictest5219352sleep33
39420999141,9cyclictest427957-21chrt3
39420999140,12cyclictest0-21swapper/33
39420999140,10cyclictest0-21swapper/33
8956782130,2sleep00-21swapper/00
8410202131,3sleep20-21swapper/22
8219002131,8sleep0821911-21ssh0
7616242131,8sleep2761724-21cpuspeed_turbos2
7416802133,2sleep2171rcu_preempt2
7050832131,5sleep00-21swapper/00
6868642131,7sleep2522176-21diskmemload2
6614572131,8sleep0661472-21ssh0
5975152131,6sleep2597589-21ntp_offset2
5603932130,4sleep0151ktimers/00
5234302131,8sleep0524970-21tr0
4763672134,5sleep2478022-21kthreadcore2
4327162130,1sleep00-21swapper/00
4174392130,2sleep10-21swapper/11
394209991310,1cyclictest0-21swapper/33
8877842122,4sleep2887798-21apt-get2
8041892121,7sleep0804203-21ssh0
7963782121,6sleep2522176-21diskmemload2
7957852121,6sleep1795798-21ssh1
7774502121,7sleep1777465-21ssh1
7704542121,7sleep2770484-21apt-get2
7520442124,4sleep2653626-21kworker/u16:0+xprtiod2
6538082121,7sleep2653827-21ssh2
6529072121,7sleep1652921-21ssh1
6133022121,6sleep1610775-21sendmail-msp1
5834072120,8sleep0522176-21diskmemload0
5398582126,3sleep10-21swapper/11
5279852121,7sleep1527999-21ssh1
5119122122,5sleep1511931-21apt-get1
4914932121,7sleep1492165-21cut1
4752252122,5sleep1475227-21apt-get1
4690502121,3sleep0469236-21who0
4643642120,1sleep10-21swapper/11
4069552121,5sleep2406707-21sendmail-msp2
8799562112,5sleep0881471-21grep0
8700332111,6sleep1870045-21sh1
8673172110,7sleep0867332-21ssh0
8667212111,5sleep2866728-21ssh2
8509172110,2sleep10-21swapper/11
8231372111,6sleep0823693-21tr0
8148372111,5sleep1814974-21diskstats1
7793342111,5sleep2779598-21df2
7520312110,3sleep1752043-21ssh1
7421822110,1sleep00-21swapper/00
7335562113,4sleep0394204-21cyclictest0
7323042110,1sleep20-21swapper/22
7322342110,1sleep10-21swapper/11
7222212111,6sleep0722235-21ssh0
7221932111,6sleep2722207-21ssh2
7137522111,6sleep1713763-21ssh1
7090752112,5sleep2710309-21cut2
6958242111,3sleep00-21swapper/00
6958242111,3sleep00-21swapper/00
6795222110,1sleep10-21swapper/11
6786232112,4sleep2522176-21diskmemload2
6700342111,4sleep2522176-21diskmemload2
6252662111,6sleep0625280-21ssh0
6201932111,5sleep2620330-21diskstats2
6168992111,4sleep2522176-21diskmemload2
6009162111,5sleep1522176-21diskmemload1
5645462111,6sleep1522176-21diskmemload1
4646782111,5sleep2464934-21df2
4486642111,5sleep2448697-21munin-run2
8961622101,4sleep1896233-21sendmail-msp1
8858002101,4sleep1522176-21diskmemload1
8761522100,1sleep20-21swapper/22
8521222101,3sleep00-21swapper/00
8460962100,1sleep20-21swapper/22
8440312101,5sleep0844502-21cat0
8399882101,2sleep00-21swapper/00
8315102101,3sleep2522176-21diskmemload2
8053722101,2sleep10-21swapper/11
8045382101,3sleep2522176-21diskmemload2
7882122101,5sleep0788423-21df_inode0
7855552100,1sleep00-21swapper/00
7615942100,3sleep10-21swapper/11
7585622101,3sleep10-21swapper/11
7222362101,4sleep1522176-21diskmemload1
6979152101,3sleep20-21swapper/22
6979152101,3sleep20-21swapper/22
6867742101,4sleep0686788-21ssh0
6784962100,4sleep00-21swapper/00
6710872101,4sleep1522176-21diskmemload1
6603142100,3sleep20-21swapper/22
6351252101,3sleep00-21swapper/00
5919852101,2sleep00-21swapper/00
5726422101,5sleep2572649-21ssh2
5668642101,3sleep1566899-21ssh1
5627852101,3sleep2522176-21diskmemload2
5558442101,3sleep20-21swapper/22
5548682101,2sleep00-21swapper/00
5466332101,4sleep1522176-21diskmemload1
5383292102,3sleep2421rcuc/22
5310262101,6sleep2531210-21latency_hist2
5116172101,5sleep1511697-21munin-run1
4962432100,5sleep10-21swapper/11
4962432100,5sleep10-21swapper/11
4646732101,4sleep1464675-21apt-get1
4494792101,5sleep0449566-21kthreadcore0
874469291,4sleep0874628-21sed0
866071290,1sleep10-21swapper/11
857523290,1sleep20-21swapper/22
841753291,3sleep1522176-21diskmemload1
812777291,3sleep1522176-21diskmemload1
779879291,4sleep1780122-21ssh1
775685290,3sleep00-21swapper/00
760650291,2sleep20-21swapper/22
707922291,2sleep10-21swapper/11
644630291,3sleep1522176-21diskmemload1
631446291,4sleep1632860-21ssh1
616816291,2sleep00-21swapper/00
607096290,1sleep00-21swapper/00
593306291,3sleep0593317-21ssh0
567193290,6sleep0567378-21gltestperf0
549061293,3sleep1331ktimers/11
541624292,3sleep2543053-21kthreadcore2
516935291,4sleep0516991-21/usr/sbin/munin0
512494291,5sleep2513780-21kthreadcore2
501736291,4sleep2501947-21sh2
482202291,4sleep1483954-21tr1
480992291,4sleep0482201-21grep0
474936291,4sleep01-21systemd0
469909291,3sleep2469685-21sendmail-msp2
448958291,4sleep2448730-21sendmail-msp2
447022291,4sleep1447608-21wc1
440210291,4sleep2441940-21cut2
438202291,4sleep0438235-21munin-run0
433251291,4sleep2433394-21expr2
422750291,4sleep1422966-21/usr/sbin/munin1
417440291,2sleep20-21swapper/22
409560290,4sleep0221rcuc/00
399630291,5sleep1401182-21netstat1
394363291,3sleep1394382-21apt-get1
490294280,1sleep00-21swapper/00
485640281,2sleep1485659-21apt-get1
469908281,3sleep14192556-21in:imuxsock1
459975281,3sleep0460024-21kthreadcore0
459407281,3sleep2106713-21snmpd2
439044281,3sleep1440209-21kthreadcore1
433229280,2sleep10-21swapper/11
422967281,4sleep2423130-21/usr/sbin/munin2
412490281,3sleep1412558-21fschecks_time1
519331271,3sleep10-21swapper/11
511394270,1sleep00-21swapper/00
502019270,3sleep0503424-21cut0
501007270,2sleep00-21swapper/00
501007270,2sleep00-21swapper/00
497214270,3sleep2498854-21kthreadcore2
497214270,3sleep2498854-21kthreadcore2
492167271,3sleep2493678-21kthreadcore2
486207271,3sleep20-21swapper/22
454744271,2sleep10-21swapper/11
454185270,1sleep00-21swapper/00
448420270,2sleep00-21swapper/00
438473270,2sleep00-21swapper/00
428229271,2sleep1205-21jbd2/sda2-81
416988270,1sleep00-21swapper/00
412207270,2sleep20-21swapper/22
410844270,2sleep1410957-21strings1
399359271,3sleep0399627-21munin-node0
503426261,2sleep10-21swapper/11
483955260,2sleep2484393-21strings2
479917260,1sleep00-21swapper/00
454172261,2sleep20-21swapper/22
423249261,2sleep00-21swapper/00
406485260,4sleep20-21swapper/22
398164260,2sleep0398378-21strings0
394385261,2sleep20-21swapper/22
510676250,1sleep20-21swapper/22
419338250,2sleep0421098-21kthreadcore0
517498240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional