You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 02:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Wed Jun 10, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
188633213058,67sleep30-21swapper/33
18868528257,18sleep00-21swapper/00
18869428165,10sleep10-21swapper/11
18395928159,12sleep20-21swapper/22
18911499239,10cyclictest472368-21turbostat3
18911499239,10cyclictest472368-21turbostat3
189114992219,1cyclictest0-21swapper/33
189114992111,7cyclictest0-21swapper/33
18911499211,16cyclictest0-21swapper/33
18911499210,19cyclictest0-21swapper/33
6397492201,2sleep00-21swapper/00
18911499202,13cyclictest624625-21chrt3
18911499201,16cyclictest194346-21turbostat3
18911499201,15cyclictest0-21swapper/33
18911499201,15cyclictest0-21swapper/33
18911499200,16cyclictest66950irq/132-enp1s0-TxRx-33
18911499200,13cyclictest0-21swapper/33
3756342191,13sleep0375701-21ntpq0
3203542190,2sleep30-21swapper/33
18911499191,5cyclictest66950irq/132-enp1s0-TxRx-33
18911499191,15cyclictest0-21swapper/33
18911499191,15cyclictest0-21swapper/33
18911499191,14cyclictest66950irq/132-enp1s0-TxRx-33
18911499191,14cyclictest0-21swapper/33
18911499191,14cyclictest0-21swapper/33
18911499191,14cyclictest0-21swapper/33
18911499190,8cyclictest275626-21chrt3
18911499190,15cyclictest0-21swapper/33
5644442180,6sleep0151ktimers/00
4396142181,4sleep0440631-21tr0
3593652181,6sleep0359616-21grep0
18911499182,13cyclictest0-21swapper/33
18911499182,10cyclictest459153-21taskset3
18911499181,5cyclictest0-21swapper/33
189114991812,3cyclictest2434052sleep33
18911499181,15cyclictest66950irq/132-enp1s0-TxRx-33
18911499181,14cyclictest308387-21taskset3
18911499181,14cyclictest0-21swapper/33
18911499181,14cyclictest0-21swapper/33
18911499181,14cyclictest0-21swapper/33
18911499181,14cyclictest0-21swapper/33
18911499181,14cyclictest0-21swapper/33
18911499181,14cyclictest0-21swapper/33
18911499181,13cyclictest0-21swapper/33
18911499181,13cyclictest0-21swapper/33
18911499181,13cyclictest0-21swapper/33
18911499180,14cyclictest0-21swapper/33
4379892171,4sleep1320042-21diskmemload1
4178832171,5sleep1417946-21ntp_states1
3363232171,2sleep20-21swapper/22
18911499177,7cyclictest233682-21turbostat3
18911499172,10cyclictest569823-21taskset3
18911499172,10cyclictest569823-21taskset3
189114991713,3cyclictest66950irq/132-enp1s0-TxRx-33
18911499171,13cyclictest0-21swapper/33
18911499171,13cyclictest0-21swapper/33
18911499171,13cyclictest0-21swapper/33
18911499171,13cyclictest0-21swapper/33
18911499171,13cyclictest0-21swapper/33
18911499170,14cyclictest0-21swapper/33
18911499170,14cyclictest0-21swapper/33
18911499170,14cyclictest0-21swapper/33
6304142161,3sleep20-21swapper/22
5622932161,3sleep20-21swapper/22
4800112161,3sleep0320042-21diskmemload0
4800112161,3sleep0320042-21diskmemload0
4027632161,3sleep10-21swapper/11
3456302161,2sleep20-21swapper/22
2713292161,5sleep0271584-21df0
189114991611,3cyclictest0-21swapper/33
189114991611,3cyclictest0-21swapper/33
18911499161,13cyclictest0-21swapper/33
18911499161,10cyclictest2184512sleep33
18911499160,14cyclictest0-21swapper/33
18911499160,13cyclictest0-21swapper/33
18911499160,13cyclictest0-21swapper/33
18911499160,13cyclictest0-21swapper/33
6162372151,10sleep00-21swapper/00
5283252151,4sleep1320042-21diskmemload1
4781512151,3sleep2320042-21diskmemload2
4781512151,3sleep2320042-21diskmemload2
4236672151,3sleep2425371-21kthreadcore2
189114991512,2cyclictest0-21swapper/33
18911499151,10cyclictest207278-21chrt3
18911499150,13cyclictest0-21swapper/33
18911499150,12cyclictest0-21swapper/33
18911499150,12cyclictest0-21swapper/33
5479372141,8sleep00-21swapper/00
4937772142,6sleep0493835-21ntpq0
4799742141,4sleep1479986-21ssh1
4799742141,4sleep1479986-21ssh1
4464172141,4sleep2320042-21diskmemload2
4378832144,2sleep0171rcu_preempt0
4022902141,7sleep00-21swapper/00
3084222141,7sleep072-21kcompactd00
2490612141,3sleep0249305-21users0
18911499140,2cyclictest0-21swapper/33
18911499140,2cyclictest0-21swapper/33
18911499140,12cyclictest0-21swapper/33
18911499140,12cyclictest0-21swapper/33
18911499140,11cyclictest0-21swapper/33
6644692131,8sleep2664482-21sh2
6407092131,8sleep2640723-21ssh2
6391912131,8sleep1320042-21diskmemload1
5487432131,6sleep0320042-21diskmemload0
5480912131,6sleep1548434-21sed1
5395442131,8sleep2320042-21diskmemload2
5064152132,5sleep1320042-21diskmemload1
4979062131,4sleep2320042-21diskmemload2
4852722130,2sleep10-21swapper/11
4370862131,8sleep2437097-21ssh2
3939402131,8sleep1393954-21ssh1
3866032130,8sleep2320042-21diskmemload2
3456192131,7sleep1320042-21diskmemload1
3265842131,3sleep1326595-21ssh1
2326902131,6sleep1232737-21ntpq1
2006822130,8sleep2200730-21ntpq2
18911499130,11cyclictest0-21swapper/33
6733482121,2sleep1320042-21diskmemload1
6457052121,7sleep1645763-21ntpq1
6215652121,7sleep2621567-21ssh2
6155162121,5sleep20-21swapper/22
6054052121,7sleep2605418-21sh2
5959642121,6sleep0320042-21diskmemload0
5821092121,7sleep1582308-21ssh1
5640402120,1sleep10-21swapper/11
5239792121,7sleep0525058-21tr0
5211452121,2sleep00-21swapper/00
4817602121,2sleep20-21swapper/22
4271972121,7sleep1427207-21ssh1
4128202121,5sleep20-21swapper/22
4120302121,7sleep0412040-21ssh0
3783732121,5sleep10-21swapper/11
3461872121,7sleep1320042-21diskmemload1
3422552121,7sleep0320042-21diskmemload0
2755412121,7sleep2275625-21/usr/sbin/munin2
2593582121,7sleep0259407-21ldconfig0
2539452121,7sleep2253998-21ld2
6470942111,4sleep0320042-21diskmemload0
6309262111,4sleep1320042-21diskmemload1
5899922111,7sleep2320042-21diskmemload2
5743442111,5sleep0574568-21hddtemp_smartct0
5551022111,6sleep2555113-21ssh2
5378972111,6sleep0537911-21ssh0
5156012111,6sleep2517104-21kthreadcore2
4980562111,5sleep1498316-21df1
4941072111,4sleep1320042-21diskmemload1
4084172111,5sleep1409328-21memory1
3885402111,5sleep2388673-21diskstats2
3794162111,4sleep2320042-21diskmemload2
3366812111,3sleep00-21swapper/00
3345682111,3sleep10-21swapper/11
3268292111,4sleep2320042-21diskmemload2
2873802110,2sleep10-21swapper/11
2486552111,5sleep1248697-21ntpq1
2443352111,6sleep1244366-21munin-run1
2072562112,4sleep2207275-21apt-get2
6709642100,4sleep20-21swapper/22
6638702101,4sleep0663884-21ssh0
6582472101,3sleep10-21swapper/11
6549892101,6sleep2654995-21ssh2
6499822101,4sleep1650186-21diskstats1
6177152101,4sleep1619382-21tr1
6147652101,5sleep0614779-21ssh0
6133182101,2sleep10-21swapper/11
5967582100,1sleep10-21swapper/11
5878522101,3sleep00-21swapper/00
5805662101,3sleep20-21swapper/22
5740202101,4sleep1574051-21ssh1
5710142101,3sleep00-21swapper/00
5710142101,3sleep00-21swapper/00
5706492101,3sleep10-21swapper/11
5706492101,3sleep10-21swapper/11
5529422101,4sleep1552998-21ntpq1
5455982101,2sleep20-21swapper/22
5374352101,3sleep10-21swapper/11
5200642101,4sleep1320042-21diskmemload1
5134542101,4sleep0320042-21diskmemload0
5021362101,5sleep0502196-21ntpq0
4895452101,2sleep20-21swapper/22
4599682101,4sleep0460112-21ntpq0
4560112101,4sleep2456239-21df_inode2
4533502101,5sleep0453363-21ssh0
4527262100,3sleep1452740-21ssh1
4225092101,4sleep0422628-21irqstats0
4206982101,4sleep2320042-21diskmemload2
3888972101,6sleep0388973-21sh0
3865512101,4sleep1320042-21diskmemload1
3688412100,3sleep10-21swapper/11
3642372101,5sleep2365856-21kthreadcore2
3598532101,3sleep1320042-21diskmemload1
3546742101,4sleep2354698-21apt-get2
3512132101,3sleep00-21swapper/00
3508332102,4sleep2351021-21grep2
3150972101,4sleep2315220-21diskstats2
3093582101,4sleep2309588-21df_inode2
2647522101,5sleep1264803-21/usr/sbin/munin1
2647002101,4sleep0264750-21ntpq0
1965892103,3sleep1189108-21cyclictest1
666933291,3sleep0320042-21diskmemload0
654878290,3sleep00-21swapper/00
641403291,2sleep20-21swapper/22
631482291,4sleep0631495-21ssh0
604542291,3sleep1320042-21diskmemload1
599175290,3sleep0320042-21diskmemload0
596680291,2sleep20-21swapper/22
566172291,4sleep2566531-21grep2
566172291,4sleep2566531-21grep2
529701291,2sleep20-21swapper/22
513616292,3sleep2320042-21diskmemload2
486869291,2sleep00-21swapper/00
470787291,3sleep2470798-21ssh2
469304291,4sleep0469315-21ssh0
464214291,2sleep10-21swapper/11
456547291,5sleep1457467-21kthreadcore1
452791290,1sleep20-21swapper/22
445678291,3sleep1320042-21diskmemload1
418785291,2sleep00-21swapper/00
402124291,3sleep2402136-21ssh2
386666291,4sleep0386680-21ssh0
368829290,1sleep00-21swapper/00
326097291,5sleep00-21swapper/00
265987291,4sleep1266178-21expr1
265965291,3sleep0265984-21apt-get0
240313291,4sleep2242024-21cut2
228604291,3sleep0228623-21apt-get0
218917291,4sleep0220631-21cut0
218183291,4sleep1218252-21cut1
213798291,4sleep0215522-21kthreadcore0
212868291,3sleep1212971-21perl1
211792291,4sleep1207255-21/usr/sbin/munin1
194650291,4sleep0195304-21grep0
304221281,3sleep2304256-21kthreadcore2
303113281,3sleep2303160-21systemd-run2
303113281,3sleep2303160-21systemd-run2
298066280,1sleep00-21swapper/00
298066280,1sleep00-21swapper/00
297653280,1sleep20-21swapper/22
294078281,3sleep0295826-21grep0
287857281,3sleep0287928-21irqstats0
287075281,3sleep1287176-21sed1
280790280,3sleep10-21swapper/11
254873282,3sleep0183557-21kworker/0:1+events0
230820281,3sleep2232495-21sed2
228060280,1sleep10-21swapper/11
224988281,3sleep2226765-21kthreadcore2
193365280,4sleep20-21swapper/22
189260280,2sleep10-21swapper/11
309321271,2sleep10-21swapper/11
308680270,1sleep10-21swapper/11
281594270,1sleep20-21swapper/22
265588270,1sleep20-21swapper/22
255543271,3sleep1255677-21gltestperf1
222658270,1sleep20-21swapper/22
207538270,4sleep00-21swapper/00
206669270,1sleep10-21swapper/11
319709261,3sleep10-21swapper/11
314932260,1sleep00-21swapper/00
297606260,1sleep10-21swapper/11
292167260,1sleep20-21swapper/22
281994260,1sleep20-21swapper/22
277567261,2sleep00-21swapper/00
276182260,3sleep10-21swapper/11
260267260,1sleep20-21swapper/22
250227260,2sleep10-21swapper/11
249340260,4sleep20-21swapper/22
234500260,2sleep2235701-21cat2
233924260,1sleep00-21swapper/00
227297260,1sleep00-21swapper/00
212576260,1sleep20-21swapper/22
202516261,2sleep20-21swapper/22
201943260,1sleep00-21swapper/00
194239260,1sleep00-21swapper/00
314401250,3sleep00-21swapper/00
298324250,1sleep10-21swapper/11
298324250,1sleep10-21swapper/11
282141250,1sleep00-21swapper/00
238152250,1sleep10-21swapper/11
265684240,1sleep20-21swapper/22
239278240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional