You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 07:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8s.osadl.org (updated Sun Dec 07, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
41518899912240,1221cyclictest41918342sleep33
41518899912030,1200cyclictest675202sleep33
41518899911550,1151cyclictest2244982sleep33
672782340,1sleep167298-21munin-plugin-st1
4151889992719,6cyclictest256863-21sleep3
2472612250,2sleep244-21ksoftirqd/22
190898220,8rtkit-daemon4158238-21munin-node2
415188999209,7cyclictest353980-21turbostat3
4151889991815,1cyclictest0-21swapper/33
2146762180,7sleep0214683-21sh0
4151889991714,1cyclictest0-21swapper/33
4151889991714,1cyclictest0-21swapper/33
4151889991613,1cyclictest0-21swapper/33
1371472160,1sleep2138620-21cut2
415188999151,6cyclictest0-21swapper/33
4151889991512,1cyclictest0-21swapper/33
4151889991512,1cyclictest0-21swapper/33
4151889991512,1cyclictest0-21swapper/33
4151889991512,1cyclictest0-21swapper/33
4151889991512,1cyclictest0-21swapper/33
4151889991512,1cyclictest0-21swapper/33
415188999151,11cyclictest61046-21chrt3
415188999151,10cyclictest23125-21turbostat3
4354212140,1sleep30-21swapper/33
415188999145,6cyclictest2675032sleep33
415188999145,6cyclictest1746922sleep33
415188999144,7cyclictest45422sleep33
415188999144,7cyclictest2253312sleep33
4151889991412,1cyclictest0-21swapper/33
4151889991412,1cyclictest0-21swapper/33
4151889991412,1cyclictest0-21swapper/33
4151889991412,1cyclictest0-21swapper/33
4151889991412,1cyclictest0-21swapper/33
4151889991412,1cyclictest0-21swapper/33
4151889991412,0cyclictest0-21swapper/33
4151889991412,0cyclictest0-21swapper/33
4151889991411,1cyclictest0-21swapper/33
4151889991411,1cyclictest0-21swapper/33
4151889991411,1cyclictest0-21swapper/33
4151889991411,1cyclictest0-21swapper/33
415188999141,10cyclictest92200-21taskset3
415188999141,10cyclictest47633-21taskset3
415188999141,10cyclictest426981-21taskset3
415188999141,10cyclictest426981-21taskset3
415188999141,10cyclictest344082-21taskset3
415188999141,10cyclictest305610-21turbostat3
415188999141,10cyclictest286652-21taskset3
415188999141,10cyclictest119224-21turbostat3
415188999140,11cyclictest390294-21taskset3
415188999135,6cyclictest3620302sleep33
415188999131,9cyclictest4166940-21chrt3
415188999131,9cyclictest4165557-21taskset3
415188999131,9cyclictest151823-21taskset3
415188999131,9cyclictest127812-21taskset3
415188999131,9cyclictest110851-21taskset3
415188999131,9cyclictest104088-21taskset3
415188999131,8cyclictest314354-21taskset3
4151889991312,0cyclictest0-21swapper/33
4151889991312,0cyclictest0-21swapper/33
4151889991311,1cyclictest0-21swapper/33
4151889991311,1cyclictest0-21swapper/33
4151889991311,1cyclictest0-21swapper/33
4151889991311,1cyclictest0-21swapper/33
4151889991311,0cyclictest0-21swapper/33
4151889991310,1cyclictest0-21swapper/33
415188999130,10cyclictest80079-21taskset3
415188999130,10cyclictest53713-21chrt3
415188999130,10cyclictest36188-21taskset3
415188999130,10cyclictest214666-21taskset3
415188999130,10cyclictest150366-21taskset3
415188999130,10cyclictest141943-21chrt3
41517112130,3sleep30-21swapper/33
41792852129,1sleep00-21swapper/00
415188999122,7cyclictest4179536-21chrt3
415188999120,9cyclictest424953-21taskset3
415188999120,10cyclictest159820-21taskset3
2240602121,3sleep1224068-21ssh1
928022110,4sleep192885-21fschecks_time1
2816622110,1sleep0281684-21apt-get0
190898110,7rtkit-daemon408913-21ssh0
190898110,6rtkit-daemon263515-21ssh0
4158322101,7sleep2415958-21/usr/sbin/munin2
41454252100,5sleep14145270-21apt-get1
3967932101,6sleep2398811-21cut2
3708472101,6sleep2371309-21cut2
3300712101,5sleep1330093-21apt-get1
3113912101,6sleep2311656-21/usr/sbin/munin2
190898100,6rtkit-daemon697-21runrttasks1
190898100,6rtkit-daemon430052-21kthreadcore0
190898100,6rtkit-daemon430052-21kthreadcore0
190898100,6rtkit-daemon201380-21sed1
190898100,5rtkit-daemon60230-21ps1
190898100,5rtkit-daemon333817-21kthreadcore0
190898100,5rtkit-daemon295972-21ssh0
190898100,5rtkit-daemon117990-21ssh0
190898100,4rtkit-daemon4158238-21munin-node0
190898100,4rtkit-daemon215639-21ssh1
190898100,3rtkit-daemon667-21snmpd0
190898100,3rtkit-daemon368322-21ssh2
190898100,2rtkit-daemon0-21swapper/00
190898100,1rtkit-daemon0-21swapper/22
1410862100,7sleep0141259-21timerwakeupswit0
67533291,4sleep167566-21apt-get1
4706291,5sleep14905-21hddtemp_smartct1
393282290,6sleep0393290-21ssh0
272208290,1sleep10-21swapper/11
19089890,6rtkit-daemon473-21gmain0
19089890,6rtkit-daemon421-21avahi-daemon0
19089890,6rtkit-daemon1928-21sendmail-mta2
19089890,5rtkit-daemon438-21wpa_supplicant1
19089890,5rtkit-daemon111170-21diskmemload1
19089890,5rtkit-daemon111170-21diskmemload1
19089890,4rtkit-daemon417435-21ssh0
19089890,4rtkit-daemon401340-21ssh0
19089890,4rtkit-daemon321656-21ssh0
19089890,4rtkit-daemon224518-21ssh2
61261281,3sleep061294-21apt-get0
53853280,5sleep053909-21ntp_states0
4184868281,5sleep04184979-21/usr/sbin/munin0
4173831280,6sleep24174762-21kthreadcore2
387400281,4sleep1388326-21cut1
384273281,4sleep0384281-21ssh0
338129280,2sleep1338162-21apt-get1
327266280,5sleep1327346-21awk1
247934281,4sleep1247942-21ssh1
227255280,5sleep1229273-21cut1
224925281,4sleep0225074-21df0
192315281,3sleep0192348-21apt-get0
192315281,3sleep0192348-21apt-get0
19089880,5rtkit-daemon473-21gmain1
19089880,5rtkit-daemon4158238-21munin-node1
19089880,5rtkit-daemon1928-21sendmail-mta2
19089880,5rtkit-daemon1928-21sendmail-mta1
19089880,5rtkit-daemon1928-21sendmail-mta1
19089880,4rtkit-daemon667-21snmpd2
19089880,4rtkit-daemon667-21snmpd1
19089880,4rtkit-daemon4175188-21cut1
19089880,4rtkit-daemon4158238-21munin-node1
19089880,4rtkit-daemon306086-21df_inode0
19089880,4rtkit-daemon247208-21ssh0
19089880,4rtkit-daemon169236-21irqrtprio1
19089880,3rtkit-daemon360110-21ssh1
19089880,3rtkit-daemon12300-21ps1
19089880,1rtkit-daemon0-21swapper/00
181996281,4sleep2182004-21ssh2
175148280,5sleep2175156-21ssh2
158755280,2sleep1158763-21ssh1
157668281,4sleep0157676-21ssh0
156970281,3sleep2157051-21ntp_states2
144766281,4sleep2145650-21grep2
143969280,5sleep0144176-21hddtemp_smartct0
143749281,3sleep1143788-21apt-get1
141260281,4sleep1141428-21vmstat1
119515281,3sleep2119554-21apt-get2
112539280,5sleep2113507-21cut2
92359274,1sleep20-21swapper/22
80118270,5sleep280138-21grep2
72668271,4sleep272713-21/usr/sbin/munin2
60319271,4sleep20-21swapper/22
55040270,4sleep055195-21diskstats0
443523270,5sleep1444297-21sed1
42476270,3sleep142509-21apt-get1
423890271,4sleep0424080-21ssh0
4190956270,4sleep04191012-21/usr/sbin/munin0
418881271,3sleep1418916-21apt-get1
4156197270,4sleep24157033-21memory2
35106270,1sleep00-21swapper/00
346215270,1sleep00-21swapper/00
335341270,1sleep20-21swapper/22
329730270,4sleep2329896-21sed2
286988270,4sleep2287110-21cat2
274910270,4sleep1275977-21kthreadcore1
264855270,4sleep2265101-21sed2
255469270,1sleep10-21swapper/11
240586271,3sleep1240594-21ssh1
200213270,3sleep2200031-21apt-get2
195428270,5sleep2197344-21sed2
195428270,5sleep2197344-21sed2
19089870,4rtkit-daemon81364-21packagekitd1
19089870,4rtkit-daemon81364-21packagekitd1
19089870,4rtkit-daemon81364-21packagekitd0
19089870,4rtkit-daemon671-21ntpd1
19089870,4rtkit-daemon667-21snmpd1
19089870,4rtkit-daemon473-21gmain2
19089870,4rtkit-daemon473-21gmain2
19089870,4rtkit-daemon4158238-21munin-node1
19089870,3rtkit-daemon81364-21packagekitd1
19089870,3rtkit-daemon667-21snmpd1
19089870,3rtkit-daemon667-21snmpd1
19089870,3rtkit-daemon4158238-21munin-node0
19089870,3rtkit-daemon4158238-21munin-node0
19089870,3rtkit-daemon353605-21ssh1
19089870,3rtkit-daemon117664-21kworker/u16:4+events_power_efficient2
19089870,1rtkit-daemon0-21swapper/11
176098270,4sleep1176138-21ssh1
111946270,4sleep1112533-21irqrtprio1
99383260,3sleep2100369-21irqstats2
94070260,4sleep095190-21cut0
86365260,3sleep086398-21apt-get0
443308260,4sleep0443494-21idleruntime0
42105260,1sleep00-21swapper/00
4165479260,4sleep24165556-21ntp_states2
372138260,3sleep0221rcuc/00
369314260,1sleep10-21swapper/11
354307261,3sleep0354462-21df_inode0
354255260,1sleep20-21swapper/22
338165260,1sleep20-21swapper/22
314237260,4sleep2314353-21grep2
312759260,1sleep10-21swapper/11
303783261,3sleep1303791-21ssh1
297367260,1sleep20-21swapper/22
275980261,3sleep2278020-21kthreadcore2
265392261,3sleep2248694-21kworker/u16:1-rpciod2
256755260,4sleep2256761-21ssh2
239244260,1sleep20-21swapper/22
23258260,3sleep00-21swapper/00
23258260,3sleep00-21swapper/00
231411260,1sleep20-21swapper/22
23054261,2sleep20-21swapper/22
191123260,1sleep20-21swapper/22
19089860,3rtkit-daemon671-21ntpd1
189603260,4sleep0189762-21timerwakeupswit0
17478260,3sleep018010-21sed0
167948261,2sleep00-21swapper/00
165318260,3sleep1165448-21timerandwakeup1
12942261,2sleep013880-21kthreadcore0
127248260,3sleep1127501-21sed1
85978250,1sleep00-21swapper/00
79139251,2sleep20-21swapper/22
52349250,3sleep20-21swapper/22
4906250,3sleep24507-21/usr/sbin/munin2
48179250,1sleep00-21swapper/00
48151250,1sleep20-21swapper/22
435819251,2sleep00-21swapper/00
4192119250,2sleep00-21swapper/00
4191141250,3sleep20-21swapper/22
4180526251,2sleep20-21swapper/22
417551250,3sleep10-21swapper/11
4172836250,1sleep00-21swapper/00
4172742250,1sleep20-21swapper/22
4153031250,3sleep04154132-21kthreadcore0
4150596250,2sleep04150805-21strings0
409307250,1sleep20-21swapper/22
408027250,3sleep1408162-21sensors1
3918250,1sleep20-21swapper/22
384449251,2sleep1331ktimers/11
352087250,3sleep20-21swapper/22
30317250,3sleep230900-21tr2
298326251,2sleep20-21swapper/22
263617250,3sleep1263625-21ssh1
25208251,2sleep227211-21kthreadcore2
25208251,2sleep227211-21kthreadcore2
217265251,2sleep00-21swapper/00
216203250,3sleep2207885-21kworker/u16:0+rpciod2
181407250,2sleep00-21swapper/00
133854250,3sleep1133856-21ssh1
106644251,2sleep20-21swapper/22
10421250,1sleep00-21swapper/00
98337240,3sleep20-21swapper/22
73850240,1sleep00-21swapper/00
435094240,2sleep1435213-21entropy1
432236240,2sleep1111170-21diskmemload1
432236240,2sleep1111170-21diskmemload1
425469240,2sleep2425477-21ssh2
42149240,3sleep20-21swapper/22
4159057241,1sleep00-21swapper/00
401793240,2sleep10-21swapper/11
376981240,2sleep1376989-21ssh1
363858240,2sleep00-21swapper/00
314079240,2sleep1314235-21ssh1
283142240,2sleep10-21swapper/11
207696241,2sleep0111170-21diskmemload0
159871240,2sleep2159879-21ssh2
133096240,2sleep0151ktimers/00
111072242,1sleep00-21swapper/00
104711240,3sleep00-21swapper/00
67837230,1sleep00-21swapper/00
67147230,2sleep20-21swapper/22
289629230,1sleep10-21swapper/11
10837230,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional