You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 15:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Tue Sep 15, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
36181212853,68sleep30-21swapper/33
50513321270,2sleep20-21swapper/22
3613129062,12sleep20-21swapper/22
3602528155,6sleep00-21swapper/00
3627427961,12sleep10-21swapper/11
3647599240,21cyclictest0-21swapper/33
3647599211,15cyclictest0-21swapper/33
1380152211,15sleep0133124-21sendmail-msp0
4872912201,6sleep0487557-21depmod0
36475992015,2cyclictest66950irq/132-enp1s0-TxRx-33
3647599201,16cyclictest0-21swapper/33
3647599201,15cyclictest0-21swapper/33
4876582193,8sleep2487595-21zstd2
3647599197,10cyclictest0-21swapper/33
3647599193,12cyclictest0-21swapper/33
3647599192,12cyclictest209250-21taskset3
36475991914,3cyclictest66950irq/132-enp1s0-TxRx-33
3647599191,15cyclictest66950irq/132-enp1s0-TxRx-33
3647599191,14cyclictest0-21swapper/33
3647599191,14cyclictest0-21swapper/33
3647599191,14cyclictest0-21swapper/33
3647599191,14cyclictest0-21swapper/33
3647599191,14cyclictest0-21swapper/33
3647599191,14cyclictest0-21swapper/33
3647599191,14cyclictest0-21swapper/33
3647599191,14cyclictest0-21swapper/33
3647599191,14cyclictest0-21swapper/33
3647599185,10cyclictest4177632sleep33
36475991815,2cyclictest0-21swapper/33
36475991815,1cyclictest0-21swapper/33
36475991815,1cyclictest0-21swapper/33
3647599181,14cyclictest66950irq/132-enp1s0-TxRx-33
3647599181,14cyclictest0-21swapper/33
3647599181,14cyclictest0-21swapper/33
3647599181,14cyclictest0-21swapper/33
3647599181,14cyclictest0-21swapper/33
3647599181,14cyclictest0-21swapper/33
3647599181,14cyclictest0-21swapper/33
3647599181,14cyclictest0-21swapper/33
3647599181,14cyclictest0-21swapper/33
3647599181,14cyclictest0-21swapper/33
3647599181,14cyclictest0-21swapper/33
3647599181,13cyclictest0-21swapper/33
3647599181,13cyclictest0-21swapper/33
36475991810,5cyclictest0-21swapper/33
3474482181,1sleep00-21swapper/00
5221222171,3sleep10-21swapper/11
4366672171,3sleep00-21swapper/00
3665832171,3sleep00-21swapper/00
3647599171,3cyclictest0-21swapper/33
3647599171,13cyclictest0-21swapper/33
3647599171,13cyclictest0-21swapper/33
3647599171,13cyclictest0-21swapper/33
36475991710,5cyclictest0-21swapper/33
3647599170,14cyclictest0-21swapper/33
3647599170,14cyclictest0-21swapper/33
3647599170,14cyclictest0-21swapper/33
3647599170,14cyclictest0-21swapper/33
3647599170,14cyclictest0-21swapper/33
3647599170,13cyclictest0-21swapper/33
3647599170,13cyclictest0-21swapper/33
3647599170,13cyclictest0-21swapper/33
2621872171,2sleep20-21swapper/22
2500532171,3sleep10-21swapper/11
2250032171,3sleep10-21swapper/11
1281032171,3sleep10-21swapper/11
4707152161,2sleep00-21swapper/00
4437532161,3sleep0164679-21diskmemload0
3933412160,1sleep20-21swapper/22
3647599161,2cyclictest866282sleep33
3647599161,13cyclictest0-21swapper/33
3647599161,13cyclictest0-21swapper/33
3647599160,13cyclictest0-21swapper/33
3647599160,13cyclictest0-21swapper/33
3647599160,11cyclictest0-21swapper/33
3291772161,3sleep0164679-21diskmemload0
2534662162,3sleep1253461-21apt-get1
2476942160,3sleep244-21ksoftirqd/22
2168762161,2sleep00-21swapper/00
4342242151,10sleep10-21swapper/11
4214962151,5sleep1421719-21idleruntime1
3764472151,9sleep00-21swapper/00
3647599150,13cyclictest0-21swapper/33
3647599150,13cyclictest0-21swapper/33
3647599150,13cyclictest0-21swapper/33
3647599150,13cyclictest0-21swapper/33
3647599150,12cyclictest0-21swapper/33
3647599150,12cyclictest0-21swapper/33
3647599150,12cyclictest0-21swapper/33
3647599150,12cyclictest0-21swapper/33
3391822151,10sleep00-21swapper/00
3127142151,10sleep1312728-21ssh1
2784872151,3sleep20-21swapper/22
2328452151,4sleep2164679-21diskmemload2
2180522151,9sleep0217710-21sendmail-msp0
2049012151,4sleep2164679-21diskmemload2
5411702141,9sleep0541184-21ssh0
4888532141,7sleep2489112-21df2
4644312141,8sleep00-21swapper/00
3647599141,9cyclictest54472-21chrt3
3647599141,2cyclictest0-21swapper/33
3486782141,4sleep1348689-21ssh1
3245722141,4sleep2324734-21ssh2
2330802141,8sleep0164679-21diskmemload0
1827762144,2sleep1171rcu_preempt1
1718272141,2sleep10-21swapper/11
4877322132,6sleep1487595-21zstd1
4614542130,8sleep2164679-21diskmemload2
4477012132,5sleep0447723-21apt-get0
3829992131,7sleep2164679-21diskmemload2
3664472131,3sleep2366454-21ssh2
3501142131,8sleep2350129-21ssh2
2877072131,7sleep2164679-21diskmemload2
2868792131,3sleep0286893-21ssh0
2769852131,3sleep0276996-21ssh0
2440662130,8sleep1164679-21diskmemload1
2092172132,4sleep2209246-21apt-get2
1319692131,8sleep0132094-21/usr/sbin/munin0
863462120,1sleep10-21swapper/11
749542121,7sleep270009-21sendmail-msp2
616992123,5sleep263434-21cut2
5390132121,7sleep1539027-21ssh1
5329252120,1sleep20-21swapper/22
5323232121,7sleep0532334-21ssh0
5300622121,6sleep1164679-21diskmemload1
5033232121,2sleep10-21swapper/11
4940042121,7sleep1494015-21ssh1
4547812121,6sleep1164679-21diskmemload1
4450432121,5sleep2164679-21diskmemload2
4293412121,7sleep0429355-21ssh0
4084732121,7sleep2408487-21ssh2
3921572120,8sleep1392172-21ssh1
3300892121,7sleep1330101-21sh1
3227862121,6sleep2164679-21diskmemload2
2936732121,3sleep2288441-21sendmail-msp2
2494472121,5sleep0164679-21diskmemload0
2056872121,7sleep1205694-21ssh1
1986582121,4sleep20-21swapper/22
1966232121,7sleep0196638-21ssh0
1896722121,7sleep2189685-21ssh2
1821052121,6sleep1164679-21diskmemload1
1591462120,1sleep00-21swapper/00
1067502120,1sleep00-21swapper/00
5291792111,3sleep20-21swapper/22
5212952110,7sleep2521309-21ssh2
5138272111,5sleep1164679-21diskmemload1
5125202111,6sleep2512535-21ssh2
4726812111,5sleep1164679-21diskmemload1
4720072111,3sleep20-21swapper/22
4564092111,4sleep1164679-21diskmemload1
4284682110,2sleep2171rcu_preempt2
4201202111,6sleep1164679-21diskmemload1
3934752111,1sleep00-21swapper/00
3827142116,2sleep00-21swapper/00
3732372111,5sleep1164679-21diskmemload1
3674982111,4sleep1164679-21diskmemload1
3562312111,4sleep1164679-21diskmemload1
3104632111,6sleep0310603-21ssh0
2976172110,2sleep00-21swapper/00
2753062111,5sleep1275407-21ps1
2584862111,6sleep20-21swapper/22
2406982111,4sleep2164679-21diskmemload2
2095402111,5sleep1209654-21perl1
2003712111,3sleep00-21swapper/00
1833022111,7sleep00-21swapper/00
1808422111,3sleep20-21swapper/22
1780872111,5sleep0178153-21ntp_states0
1727932111,4sleep2164679-21diskmemload2
1439502111,6sleep2144210-21df_inode2
1228652111,4sleep2122883-21apt-get2
1070662111,5sleep1107324-21df1
965722101,2sleep20-21swapper/22
918562101,5sleep092844-21cut0
912832101,4sleep291058-21sendmail-msp2
860542101,3sleep286073-21apt-get2
808412101,4sleep281098-21df2
749382100,5sleep070009-21sendmail-msp0
699402100,6sleep069966-21latency_hist0
5227952101,4sleep0164679-21diskmemload0
491582102,3sleep049177-21apt-get0
4548522100,1sleep20-21swapper/22
4436512101,4sleep1164679-21diskmemload1
4353312101,2sleep20-21swapper/22
4169802101,4sleep0417210-21users0
4035312100,3sleep10-21swapper/11
4028932101,3sleep00-21swapper/00
3999462100,1sleep10-21swapper/11
3822572101,3sleep1164679-21diskmemload1
3747772101,3sleep20-21swapper/22
3585892101,2sleep00-21swapper/00
3549562101,4sleep2355166-21sed2
3401102101,5sleep2340124-21ssh2
3390932101,6sleep1339108-21ssh1
3214912101,3sleep1164679-21diskmemload1
3209032101,3sleep0164679-21diskmemload0
3132002100,3sleep20-21swapper/22
2962732101,2sleep10-21swapper/11
2929592101,5sleep0293043-21ntp_states0
2847812100,1sleep10-21swapper/11
2696492101,4sleep1164679-21diskmemload1
2617472100,3sleep00-21swapper/00
2371852101,6sleep0238780-21tr0
2344762101,3sleep10-21swapper/11
2256102100,2sleep20-21swapper/22
1436202101,5sleep039542-21systemd-journal0
1329712100,2sleep20-21swapper/22
98799291,5sleep0100423-21latency0
80818291,4sleep080837-21apt-get0
79846291,4sleep280077-21grep2
79690291,4sleep179845-21sensors1
71753291,4sleep173282-21kthreadcore1
63678291,4sleep059687-21/usr/sbin/munin0
53286291,4sleep253411-21wc2
512278290,5sleep0512292-21ssh0
504480291,4sleep0504491-21ssh0
496065291,2sleep00-21swapper/00
49180291,4sleep1205-21jbd2/sda2-81
43915291,2sleep00-21swapper/00
418827290,2sleep272-21kcompactd02
408446291,2sleep00-21swapper/00
400648291,3sleep2164679-21diskmemload2
38903291,4sleep040521-21latency0
304514291,3sleep1304525-21ssh1
302676291,2sleep20-21swapper/22
267618291,3sleep00-21swapper/00
197688291,3sleep1164679-21diskmemload1
165444291,4sleep0165660-21basename0
154111291,4sleep2154143-21munin-run2
153167290,4sleep1153220-21ntp_states1
138022291,4sleep2133124-21sendmail-msp2
116990291,4sleep2112063-21sendmail-msp2
90176280,5sleep090303-21wc0
76148281,3sleep077092-21kthreadcore0
64957280,3sleep164976-21apt-get1
59708281,3sleep159872-21cstates1
54467280,3sleep20-21swapper/22
36651280,2sleep20-21swapper/22
36648281,4sleep136650-21acpi1
143948280,3sleep172-21kcompactd01
139538281,3sleep2141164-21cut2
133383281,3sleep1133124-21sendmail-msp1
127575281,3sleep1106713-21snmpd1
117655281,2sleep20-21swapper/22
107064280,2sleep00-21swapper/00
103461281,3sleep2105172-21kthreadcore2
92846271,3sleep1331ktimers/11
65540270,4sleep267018-21cut2
59158270,1sleep10-21swapper/11
48494270,1sleep20-21swapper/22
164419270,1sleep00-21swapper/00
159722271,3sleep10-21swapper/11
159697270,1sleep20-21swapper/22
158279270,3sleep2158457-21needreboot2
154399271,2sleep10-21swapper/11
153839270,1sleep00-21swapper/00
148890270,1sleep00-21swapper/00
139192271,3sleep10-21swapper/11
112312271,2sleep10-21swapper/11
112284271,2sleep00-21swapper/00
111671270,1sleep20-21swapper/22
96554260,4sleep10-21swapper/11
80840260,1sleep10-21swapper/11
43937261,2sleep10-21swapper/11
127487260,1sleep00-21swapper/00
122382260,4sleep00-21swapper/00
122338260,2sleep10-21swapper/11
106423260,4sleep10-21swapper/11
54728250,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional