You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-12 - 11:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sun Jul 12, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
531622212159,57sleep30-21swapper/33
53154629073,11sleep10-21swapper/11
53141628151,12sleep20-21swapper/22
53135028161,14sleep00-21swapper/00
531831992723,2cyclictest0-21swapper/33
8490352241,17sleep0849070-21ssh0
53183199211,16cyclictest659583-21turbostat3
53183199211,16cyclictest0-21swapper/33
53183199201,4cyclictest537395-21taskset3
53183199201,16cyclictest0-21swapper/33
53183199201,16cyclictest0-21swapper/33
53183199201,16cyclictest0-21swapper/33
53183199201,16cyclictest0-21swapper/33
53183199201,15cyclictest66950irq/132-enp1s0-TxRx-33
53183199201,15cyclictest0-21swapper/33
9313792191,8sleep0931393-21ssh0
8665242191,5sleep2866742-21hddtemp_smartct2
8665242191,5sleep2866742-21hddtemp_smartct2
53183199192,13cyclictest643866-21turbostat3
531831991913,4cyclictest0-21swapper/33
531831991912,4cyclictest0-21swapper/33
53183199191,14cyclictest0-21swapper/33
53183199191,14cyclictest0-21swapper/33
53183199191,14cyclictest0-21swapper/33
53183199190,16cyclictest66950irq/132-enp1s0-TxRx-33
6916082180,2sleep20-21swapper/22
53183199188,6cyclictest628071-21turbostat3
53183199182,11cyclictest575989-21taskset3
531831991813,2cyclictest7427412sleep33
531831991812,4cyclictest0-21swapper/33
53183199181,14cyclictest66950irq/132-enp1s0-TxRx-33
531831991811,4cyclictest0-21swapper/33
53183199181,14cyclictest0-21swapper/33
53183199181,14cyclictest0-21swapper/33
53183199181,14cyclictest0-21swapper/33
53183199181,14cyclictest0-21swapper/33
53183199181,14cyclictest0-21swapper/33
53183199181,14cyclictest0-21swapper/33
53183199181,14cyclictest0-21swapper/33
53183199181,13cyclictest0-21swapper/33
53183199181,13cyclictest0-21swapper/33
53183199181,13cyclictest0-21swapper/33
53183199180,14cyclictest66950irq/132-enp1s0-TxRx-33
53183199180,14cyclictest0-21swapper/33
53183199180,14cyclictest0-21swapper/33
53183199180,13cyclictest0-21swapper/33
9487792171,4sleep0659577-21diskmemload0
9041982170,3sleep10-21swapper/11
8309442171,3sleep10-21swapper/11
8049282171,2sleep10-21swapper/11
7782532171,2sleep10-21swapper/11
7181242171,5sleep1659577-21diskmemload1
53183199171,8cyclictest800134-21taskset3
53183199171,3cyclictest0-21swapper/33
53183199171,3cyclictest0-21swapper/33
53183199171,3cyclictest0-21swapper/33
531831991712,3cyclictest0-21swapper/33
531831991711,4cyclictest0-21swapper/33
53183199171,14cyclictest0-21swapper/33
53183199171,13cyclictest0-21swapper/33
53183199171,13cyclictest0-21swapper/33
53183199171,13cyclictest0-21swapper/33
53183199170,3cyclictest0-21swapper/33
53183199170,14cyclictest0-21swapper/33
53183199170,14cyclictest0-21swapper/33
53183199170,13cyclictest0-21swapper/33
9953322161,4sleep1659577-21diskmemload1
9785522161,4sleep2659577-21diskmemload2
7767302161,5sleep0776744-21ssh0
531831991614,1cyclictest0-21swapper/33
53183199161,2cyclictest0-21swapper/33
53183199160,13cyclictest0-21swapper/33
53183199160,13cyclictest0-21swapper/33
53183199160,13cyclictest0-21swapper/33
53183199160,12cyclictest0-21swapper/33
8015832151,4sleep2801711-21ssh2
7515622151,9sleep2659577-21diskmemload2
6946872151,4sleep2659577-21diskmemload2
5756942151,8sleep2575750-21munin-run2
5392702150,2sleep10-21swapper/11
53183199158,4cyclictest633025-21chrt3
531831991512,1cyclictest0-21swapper/33
53183199150,2cyclictest0-21swapper/33
53183199150,12cyclictest0-21swapper/33
53183199150,12cyclictest0-21swapper/33
53183199150,12cyclictest0-21swapper/33
8799652141,2sleep0879976-21ssh0
8402752141,3sleep1840287-21ssh1
7870842140,2sleep1321rcuc/11
7802632141,3sleep0659577-21diskmemload0
7685282141,8sleep1659577-21diskmemload1
7164662141,1sleep20-21swapper/22
6341872141,8sleep2634832-21cut2
6184802141,2sleep20-21swapper/22
53183199141,8cyclictest649384-21taskset3
53183199141,1cyclictest0-21swapper/33
53183199141,1cyclictest0-21swapper/33
53183199140,12cyclictest0-21swapper/33
10143112141,7sleep072-21kcompactd00
10138862141,3sleep1659577-21diskmemload1
9936722131,5sleep00-21swapper/00
9798532131,8sleep0979896-21grep0
9489972131,2sleep20-21swapper/22
9400272131,8sleep1940041-21ssh1
8982772131,8sleep2659577-21diskmemload2
8140092131,4sleep1814023-21ssh1
7712372131,7sleep2771397-21ls2
7684622131,7sleep0659577-21diskmemload0
7611452131,3sleep2761159-21ssh2
7442072131,2sleep1171rcu_preempt1
7352962131,8sleep10-21swapper/11
7249922131,8sleep1725006-21ssh1
7194172131,3sleep0719429-21ssh0
7074232131,8sleep1659577-21diskmemload1
6764552131,7sleep2659577-21diskmemload2
6678422131,7sleep1659577-21diskmemload1
6595612131,8sleep1659800-21cat1
6271752130,6sleep20-21swapper/22
53183199130,1cyclictest0-21swapper/33
9866522121,5sleep10-21swapper/11
9336022121,1sleep20-21swapper/22
9327182121,7sleep1932729-21ssh1
9155942121,7sleep1915608-21ssh1
9155002121,5sleep2659577-21diskmemload2
9065112124,3sleep2659577-21diskmemload2
9004082121,2sleep00-21swapper/00
8918072120,2sleep10-21swapper/11
8821262121,7sleep2659577-21diskmemload2
8290602121,5sleep20-21swapper/22
8114922121,5sleep00-21swapper/00
7871502121,7sleep2787164-21ssh2
7615402120,1sleep10-21swapper/11
7341272120,1sleep00-21swapper/00
6745822121,5sleep10-21swapper/11
6231092121,4sleep00-21swapper/00
6132052121,7sleep0614623-21kthreadcore0
6115292121,7sleep1607404-21/usr/sbin/munin1
5550502120,1sleep00-21swapper/00
9970322111,6sleep0997043-21ssh0
9688612111,4sleep0659577-21diskmemload0
9603812111,4sleep2659577-21diskmemload2
9596422111,4sleep00-21swapper/00
9537662111,4sleep1953830-40gzip1
8964412111,5sleep0896636-21users0
8875412111,6sleep2887638-21/usr/sbin/munin2
8682762111,7sleep1869965-21tr1
8682762111,7sleep1869965-21tr1
8658062111,6sleep01-21systemd0
8639642111,5sleep1659577-21diskmemload1
8633252111,4sleep20-21swapper/22
8558932110,1sleep10-21swapper/11
8404562111,4sleep2840724-21df_inode2
8396012111,3sleep00-21swapper/00
8217952111,6sleep1821806-21ssh1
7960642110,2sleep10-21swapper/11
7509562111,3sleep10-21swapper/11
7459302111,6sleep0745941-21ssh0
7110182111,2sleep00-21swapper/00
6844452111,3sleep10-21swapper/11
6840622111,6sleep2659577-21diskmemload2
6679332111,6sleep0667943-21ssh0
6647292111,4sleep2659577-21diskmemload2
6441412111,5sleep2644400-21df_inode2
6286722111,5sleep1628881-21hddtemp_smartct1
10206552112,4sleep1659577-21diskmemload1
9973702101,5sleep1659577-21diskmemload1
9861322101,3sleep20-21swapper/22
9692612101,3sleep10-21swapper/11
9506842101,3sleep10-21swapper/11
9229502101,4sleep2659577-21diskmemload2
9180622101,5sleep0918146-21kernelversion0
9175412101,5sleep1917806-21df1
9147792101,2sleep00-21swapper/00
8890342100,1sleep10-21swapper/11
8886882101,6sleep0888700-21ssh0
8748142100,6sleep1874904-21tr1
8733902101,2sleep00-21swapper/00
8733902101,2sleep00-21swapper/00
8539232101,2sleep20-21swapper/22
8407792101,6sleep0840984-21idleruntime0
8317372101,2sleep20-21swapper/22
8230832101,3sleep072-21kcompactd00
8203662100,1sleep00-21swapper/00
8126262101,2sleep20-21swapper/22
8055582101,3sleep00-21swapper/00
7937092101,5sleep2793720-21ssh2
7779152101,4sleep2659577-21diskmemload2
7618732101,5sleep00-21swapper/00
7424282101,3sleep20-21swapper/22
7256972101,3sleep20-21swapper/22
6998342101,3sleep10-21swapper/11
6914802101,4sleep1659577-21diskmemload1
6908202101,2sleep00-21swapper/00
6820232100,1sleep00-21swapper/00
6441392101,2sleep10-21swapper/11
6438462101,5sleep0644041-21date0
6364902101,4sleep0637493-21memory0
6297952101,5sleep0631472-21kthreadcore0
6228182101,5sleep1622936-21cat1
6039892101,5sleep1605720-21kthreadcore1
5996622101,4sleep1600784-21memory1
5861392101,4sleep0586218-21munin-run0
5817472101,5sleep1582170-21kthreadcore1
5809282101,4sleep1580984-21munin-run1
5710082105,2sleep00-21swapper/00
5654962101,3sleep2565515-21apt-get2
5492662101,4sleep2431ktimers/22
5445552101,4sleep0544574-21apt-get0
10209942101,3sleep20-21swapper/22
10123792101,3sleep00-21swapper/00
10027862101,2sleep20-21swapper/22
994640290,1sleep20-21swapper/22
977508291,4sleep0977516-21ssh0
976257291,3sleep1659577-21diskmemload1
967118291,4sleep2967349-21grep2
939448291,3sleep2939450-21ssh2
938852291,3sleep0659577-21diskmemload0
831773291,4sleep1831422-21apt-get1
820743291,3sleep2659577-21diskmemload2
794782291,2sleep00-21swapper/00
742256291,2sleep00-21swapper/00
728752291,3sleep2728771-21apt-get2
725780293,3sleep0151ktimers/00
707069291,4sleep2707132-21ntp_states2
700026291,2sleep00-21swapper/00
676124290,1sleep00-21swapper/00
628380291,3sleep2628399-21apt-get2
623111291,4sleep1623370-21df_inode1
596882291,3sleep2596901-21apt-get2
595365290,2sleep10-21swapper/11
591651291,4sleep2591670-21apt-get2
557257290,1sleep10-21swapper/11
551675291,4sleep2553391-21tr2
544545291,3sleep1544326-21sendmail-msp1
532501291,4sleep2532653-21kthreadcore2
532501291,4sleep2532653-21kthreadcore2
1011908290,1sleep20-21swapper/22
654617280,3sleep0654619-21apt-get0
644117280,3sleep0644136-21apt-get0
638869281,3sleep1638591-21apt-get1
617591281,3sleep2106713-21snmpd2
575987280,2sleep20-21swapper/22
561676281,3sleep2563358-21kthreadcore2
560238280,2sleep00-21swapper/00
549812281,3sleep1550011-21expr1
659332270,1sleep20-21swapper/22
649362270,2sleep20-21swapper/22
649354271,2sleep00-21swapper/00
639975271,2sleep20-21swapper/22
633613270,2sleep10-21swapper/11
622585270,2sleep00-21swapper/00
617423270,2sleep10-21swapper/11
612099270,1sleep20-21swapper/22
612097270,1sleep00-21swapper/00
607079270,1sleep00-21swapper/00
606862270,1sleep20-21swapper/22
598015271,3sleep0599661-21kthreadcore0
596408270,1sleep00-21swapper/00
587703270,3sleep1589362-21kthreadcore1
585862270,1sleep20-21swapper/22
576250270,3sleep0576352-21perl0
570282270,1sleep10-21swapper/11
566111271,3sleep0221rcuc/00
564259271,3sleep10-21swapper/11
559719270,1sleep20-21swapper/22
537040271,2sleep20-21swapper/22
536611270,1sleep00-21swapper/00
536611270,1sleep00-21swapper/00
531977270,1sleep10-21swapper/11
531977270,1sleep10-21swapper/11
649355260,2sleep10-21swapper/11
586996261,2sleep00-21swapper/00
586719260,2sleep20-21swapper/22
575687260,3sleep10-21swapper/11
549791260,1sleep00-21swapper/00
538915240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional