You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 18:50
OSADL QA Farm

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #6, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next 		  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 3620 SMIs that occured during the measurement.
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack6slot4.osadl.org (updated Sat Nov 29, 2025 13:23:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)		T*(,W**)
latency
(µs)		CmdPIDPrioCmd
"interval":200,6448
"cycles":100000000,6447
"load":"idle",6446
"condition":{6445
"clock":"1100"6443
"family":"x86",6442
"vendor":"Intel",6441
"processor":{6439
"dataset":"2024-01-08T03:36:49+01:00"6437
"origin":"2024-01-08T00:43:22+01:00",6436
"timestamps":{6435
"granularity":"microseconds"6433
"maxima":[6429
"cores":[5221
"latency":{5220
"hostname":"rack6slot4.osadl.org"5218
"system":{5217
"version":"1.0",5214
"format":{5213
"patches":[5204
307009938110,365cyclictest26397-21runrttasks0
3070599380369,6cyclictest8446-21kworker/1:0+kec_query1
3070599379368,6cyclictest19211-21kworker/1:2+kec_query1
3070599375365,5cyclictest26999-21kworker/1:1+kec_query1
3070599375365,5cyclictest26999-21kworker/1:1+kec_query1
3070599374363,6cyclictest19211-21kworker/1:2+kec_query1
3070599372361,6cyclictest26999-21kworker/1:1+kec_query1
3070599371361,5cyclictest26999-21kworker/1:1+kec_query1
3070599371361,5cyclictest26999-21kworker/1:1+kec_query1
3070599370358,7cyclictest26999-21kworker/1:1+kec_query1
3070599370358,7cyclictest26999-21kworker/1:1+kec_query1
3070599369358,6cyclictest8446-21kworker/1:0+kec_query1
3070599367356,6cyclictest19211-21kworker/1:2+kec_query1
30700993642,5cyclictest0-21swapper/00
3070599363352,6cyclictest26999-21kworker/1:1+kec_query1
3070599362352,5cyclictest26999-21kworker/1:1+kec_query1
3070599362351,6cyclictest19211-21kworker/1:2+kec_query1
3070099362353,5cyclictest0-21swapper/00
3070599361351,5cyclictest26999-21kworker/1:1+kec_query1
3070599359348,6cyclictest9923-21kworker/1:1+kec_query1
3070599358348,5cyclictest26999-21kworker/1:1+kec_query1
3070599358347,6cyclictest19211-21kworker/1:2+kec_query1
3070599358347,6cyclictest19211-21kworker/1:2+kec_query1
3070599357346,6cyclictest9923-21kworker/1:1+kec_query1
3070599357346,6cyclictest19211-21kworker/1:2+kec_query1
3070099357346,6cyclictest18968-21kworker/0:1+kec_query0
3070599356346,5cyclictest19211-21kworker/1:2+kec_query1
3070599356345,6cyclictest26999-21kworker/1:1+kec_query1
3070599356345,6cyclictest26999-21kworker/1:1+kec_query1
3070099356347,5cyclictest0-21swapper/00
3070099356347,5cyclictest0-21swapper/00
3070099356347,5cyclictest0-21swapper/00
3070099356344,7cyclictest7773-21cat0
30700993561,349cyclictest10578-21runrttasks0
3070599355346,5cyclictest5250irq/9-acpi1
3070599355344,6cyclictest8446-21kworker/1:0+kec_query1
3070599354344,5cyclictest9923-21kworker/1:1+kec_query1
3070599354343,6cyclictest26999-21kworker/1:1+kec_query1
3070599354343,6cyclictest26999-21kworker/1:1+kec_query1
3070599354342,7cyclictest26999-21kworker/1:1+kec_query1
3070599354336,13cyclictest26999-21kworker/1:1+kec_query1
30700993545,339cyclictest18968-21kworker/0:1+mm_percpu_wq0
3070599353342,6cyclictest26999-21kworker/1:1+kec_query1
3070599353342,6cyclictest26999-21kworker/1:1+kec_query1
3070599353342,6cyclictest19211-21kworker/1:2+kec_query1
3070599353332,13cyclictest19211-21kworker/1:2+kec_query1
3070599352342,5cyclictest26999-21kworker/1:1+kec_query1
3070599352341,6cyclictest9923-21kworker/1:1+kec_query1
3070599352341,6cyclictest26999-21kworker/1:1+kec_query1
3070599352341,6cyclictest19211-21kworker/1:2+kec_query1
3070599352338,6cyclictest9923-21kworker/1:1+kec_query1
3070599351340,6cyclictest9923-21kworker/1:1+kec_query1
3070599351340,6cyclictest26999-21kworker/1:1+kec_query1
3070599351339,7cyclictest19211-21kworker/1:2+kec_query1
3070099351341,6cyclictest0-21swapper/00
3070599350340,6cyclictest5250irq/9-acpi1
3070599350339,6cyclictest19211-21kworker/1:2+kec_query1
3070599350339,6cyclictest19211-21kworker/1:2+kec_query1
3070599350338,6cyclictest26999-21kworker/1:1+kec_query1
30700993507,5cyclictest0-21swapper/00
30700993507,5cyclictest0-21swapper/00
3070099350342,5cyclictest0-21swapper/00
30700993501,7cyclictest24736-21cat0
3070599349341,4cyclictest5250irq/9-acpi1
3070599349339,5cyclictest26999-21kworker/1:1+kec_query1
3070599349338,6cyclictest26999-21kworker/1:1+kec_query1
3070599349338,6cyclictest26999-21kworker/1:1+kec_query1
3070599349338,6cyclictest26999-21kworker/1:1+kec_query1
3070599349337,7cyclictest26999-21kworker/1:1+kec_query1
3070599349337,7cyclictest26999-21kworker/1:1+kec_query1
3070599349333,7cyclictest9923-21kworker/1:1+kec_query1
3070599349327,17cyclictest26999-21kworker/1:1+kec_query1
3070599349327,17cyclictest26999-21kworker/1:1+kec_query1
3070099349340,5cyclictest0-21swapper/00
3070099349338,6cyclictest31256-21kworker/0:2+kec_query0
3070099349334,11cyclictest4955-21runrttasks0
3070599348338,5cyclictest26999-21kworker/1:1+kec_query1
3070599348337,6cyclictest9923-21kworker/1:1+kec_query1
3070599348337,6cyclictest26999-21kworker/1:1+kec_query1
3070599348336,7cyclictest19211-21kworker/1:2+kec_query1
3070099348340,5cyclictest0-21swapper/00
3070099348338,6cyclictest0-21swapper/00
30700993482,340cyclictest0-21swapper/00
30700993482,340cyclictest0-21swapper/00
30700993482,340cyclictest0-21swapper/00
30700993482,340cyclictest0-21swapper/00
3070599347336,6cyclictest9923-21kworker/1:1+kec_query1
3070599347336,6cyclictest19211-21kworker/1:2+kec_query1
3070599347336,6cyclictest19211-21kworker/1:2+kec_query1
3070599347336,6cyclictest19211-21kworker/1:2+kec_query1
3070099347340,4cyclictest0-21swapper/00
3070099347338,5cyclictest0-21swapper/00
30700993471,339cyclictest6146-21runrttasks0
3070599346335,6cyclictest26999-21kworker/1:1+kec_query1
3070099346337,5cyclictest0-21swapper/00
30700993461,338cyclictest3051-21runrttasks0
30700993461,338cyclictest3051-21runrttasks0
3070599345334,6cyclictest19211-21kworker/1:2+kec_query1
3070599345334,6cyclictest19211-21kworker/1:2+kec_query1
3070099345333,7cyclictest588-21runrttasks0
30700993451,338cyclictest0-21swapper/00
3070599344335,5cyclictest0-21swapper/11
30700993446,11cyclictest10234-21runrttasks0
30700993442,6cyclictest0-21swapper/00
3070099343333,6cyclictest0-21swapper/00
3070099342333,5cyclictest0-21swapper/00
3070099342333,5cyclictest0-21swapper/00
3070099342333,5cyclictest0-21swapper/00
3070099342333,5cyclictest0-21swapper/00
3070099341333,5cyclictest0-21swapper/00
3070099341332,5cyclictest0-21swapper/00
3070099341327,10cyclictest9959-21runrttasks0
30700993403,331cyclictest0-21swapper/00
3070099340331,5cyclictest0-21swapper/00
3070099340327,8cyclictest30673-21smartctl0
30700993398,325cyclictest3620-21runrttasks0
3070099339329,6cyclictest0-21swapper/00
30700993392,331cyclictest0-21swapper/00
30700993391,3cyclictest0-21swapper/00
3070099338329,5cyclictest0-21swapper/00
30700993381,332cyclictest0-21swapper/00
3070099337328,5cyclictest0-21swapper/00
3070099337327,6cyclictest0-21swapper/00
30700993372,329cyclictest0-21swapper/00
3070099336327,5cyclictest0-21swapper/00
3070099336325,6cyclictest27312-21runrttasks0
3070099335326,5cyclictest0-21swapper/00
3070099335323,6cyclictest9458-21runrttasks0
3070099335323,6cyclictest22388-21runrttasks0
3070099333324,5cyclictest0-21swapper/00
3070099333324,5cyclictest0-21swapper/00
30700993331,3cyclictest0-21swapper/00
30700993331,326cyclictest3563-21runrttasks0
3070099332322,6cyclictest5040-21runrttasks0
30700993301,5cyclictest3227-21runrttasks0
30700993292,6cyclictest0-21swapper/00
3070099327318,5cyclictest0-21swapper/00
3070099327317,6cyclictest0-21swapper/00
3070099324308,11cyclictest870-21runrttasks0
3070099320311,5cyclictest0-21swapper/00
"CONFIG_CC_VERSION_TEXT=\"gccDebian6.3.0-18+deb9u16.3.020170516\"",5
"config":[4
"version":"5.15.32-rt39",3
"kernel":{1
"type":"CeleronN3350",6440
"sched-add-per-cpu-load-measurement.patch"5210
"save-current-patchset-in-kernel.patch",5209
"patch-5.15.32-rt39.patch",5205
"net-ipv4-icmp-ping-sysrq.patch",5208
"name":"RTDataset"5215
"latency-histograms.patch",5207
"cyclictest":"cyclictest-l100000000-m-Sp99-i200-h400--smi-q"6449
"CONFIG_ZSWAP_ZPOOL_DEFAULT_ZBUD=y",684
"CONFIG_ZSWAP_ZPOOL_DEFAULT=\"zbud\"",685
"CONFIG_ZSWAP=y",681
"CONFIG_ZSWAP_COMPRESSOR_DEFAULT_LZO=y",682
"CONFIG_ZSWAP_COMPRESSOR_DEFAULT=\"lzo\"",683
"CONFIG_ZSTD_DECOMPRESS=y",5041
"CONFIG_ZSTD_COMPRESS=m",5040
"CONFIG_ZSMALLOC=m",688
"CONFIG_ZRAM=m",1526
"CONFIG_ZRAM_DEF_COMP_LZORLE=y",1527
"CONFIG_ZRAM_DEF_COMP=\"lzo-rle\"",1528
"CONFIG_ZPOOL=y",686
"CONFIG_ZONE_DMA=y",693
"CONFIG_ZONE_DMA32=y",694
"CONFIG_ZONE_DEVICE=y",695
"CONFIG_ZLIB_INFLATE=y",5033
"CONFIG_ZLIB_DEFLATE=y",5034
"CONFIG_ZISOFS=y",4608
"CONFIG_ZEROPLUS_FF=y",3890
"CONFIG_ZD1211RW=m",2370
"CONFIG_ZBUD=y",687
"CONFIG_YENTA_TOSHIBA=y",1409
"CONFIG_YENTA_TI=y",1407
"CONFIG_YENTA_RICOH=y",1406
"CONFIG_YENTA_O2=y",1405
"CONFIG_YENTA=m",1404
"CONFIG_YENTA_ENE_TUNE=y",1408
"CONFIG_YELLOWFIN=m",2034
"CONFIG_YAM=m",1246
"CONFIG_XZ_DEC=y",5042
"CONFIG_XZ_DEC_X86=y",5043
"CONFIG_XZ_DEC_SPARC=y",5048
"CONFIG_XZ_DEC_POWERPC=y",5044
"CONFIG_XZ_DEC_IA64=y",5045
"CONFIG_XZ_DEC_BCJ=y",5049
"CONFIG_XZ_DEC_ARM=y",5046
"CONFIG_XZ_DEC_ARMTHUMB=y",5047
"CONFIG_XXHASH=y",5032
"CONFIG_XPS=y",1229
"CONFIG_XOR_BLOCKS=m",4848
"CONFIG_XFS_SUPPORT_V4=y",4558
"CONFIG_XFS_RT=y",4561
"CONFIG_XFS_QUOTA=y",4559
"CONFIG_XFS_POSIX_ACL=y",4560
"CONFIG_XFS_FS=m",4557
"CONFIG_XFRM=y",716
"CONFIG_XFRM_USER=m",718
"CONFIG_XFRM_SUB_POLICY=y",719
"CONFIG_XFRM_MIGRATE=y",720
"CONFIG_XFRM_IPCOMP=m",723
"CONFIG_XFRM_ESP=m",722
"CONFIG_XFRM_ALGO=m",717
"CONFIG_XFRM_AH=m",721
"CONFIG_XEN=y",249
"CONFIG_XEN_XENBUS_FRONTEND=y",4264
"CONFIG_XEN_WDT=m",2945
"CONFIG_XEN_UNPOPULATED_ALLOC=y",4279
"CONFIG_XEN_SYS_HYPERVISOR=y",4263
"CONFIG_XEN_SYMS=y",4277
"CONFIG_XEN_SCSI_FRONTEND=m",1658
"CONFIG_XEN_SCSI_BACKEND=m",4269
"CONFIG_XEN_SCRUB_PAGES_DEFAULT=y",4258
"CONFIG_XEN_SAVE_RESTORE=y",257
"CONFIG_XEN_PV=y",250
"CONFIG_XEN_PV_SMP=y",252
"CONFIG_XEN_PVH=y",258
"CONFIG_XEN_PVHVM=y",254
"CONFIG_XEN_PVHVM_SMP=y",255
"CONFIG_XEN_PVHVM_GUEST=y",256
"CONFIG_XEN_PV_DOM0=y",253
"CONFIG_XEN_PRIVCMD=m",4270
"CONFIG_XEN_PCIDEV_FRONTEND=m",1383
"CONFIG_XEN_PCIDEV_BACKEND=m",4268
"CONFIG_XEN_NETDEV_FRONTEND=m",2394
"CONFIG_XEN_NETDEV_BACKEND=m",2395
"CONFIG_XEN_MEMORY_HOTPLUG_LIMIT=512",4257
"CONFIG_XEN_MCE_LOG=y",4272
"CONFIG_XEN_HAVE_VPMU=y",4278
"CONFIG_XEN_HAVE_PVMMU=y",4273
"CONFIG_XEN_GRANT_DEV_ALLOC=m",4266
"CONFIG_XEN_GNTDEV=m",4265
"CONFIG_XENFS=m",4261
"CONFIG_XEN_FBDEV_FRONTEND=y",3562
"CONFIG_XEN_EFI=y",4274
"CONFIG_XEN_DOM0=y",259
"CONFIG_XEN_DEV_EVTCHN=m",4259
"CONFIG_XEN_COMPAT_XENFS=y",4262
"CONFIG_XEN_BLKDEV_FRONTEND=m",1540
"CONFIG_XEN_BLKDEV_BACKEND=m",1541
"CONFIG_XEN_BALLOON=y",4255
"CONFIG_XEN_BALLOON_MEMORY_HOTPLUG=y",4256
"CONFIG_XEN_BACKEND=y",4260
"CONFIG_XEN_AUTO_XLATE=y",4275
"CONFIG_XEN_ACPI=y",4276
"CONFIG_XEN_ACPI_PROCESSOR=m",4271
"CONFIG_XEN_512GB=y",251
"CONFIG_XARRAY_MULTI=y",5067
"CONFIG_X86=y",203
"CONFIG_X86_X32=y",441
"CONFIG_X86_X2APIC=y",236
"CONFIG_X86_VSYSCALL_EMULATION=y",303
"CONFIG_X86_VMX_FEATURE_NAMES=y",273
"CONFIG_X86_UMIP=y",332
"CONFIG_X86_TSC=y",267
"CONFIG_X86_THERMAL_VECTOR=y",2896
"CONFIG_X86_SUPPORTS_MEMORY_FAILURE=y",242
"CONFIG_X86_SMAP=y",331
"CONFIG_X86_REROUTE_FOR_BROKEN_BOOT_IRQS=y",291
"CONFIG_X86_PM_TIMER=y",416
"CONFIG_X86_PMEM_LEGACY=m",323
"CONFIG_X86_PMEM_LEGACY_DEVICE=y",322
"CONFIG_X86_PLATFORM_DEVICES=y",4397
"CONFIG_X86_PKG_TEMP_THERMAL=m",2897
"CONFIG_X86_PAT=y",328
"CONFIG_X86_NEED_RELOCS=y",348
"CONFIG_X86_MSR=m",309
"CONFIG_X86_MPPARSE=y",237
"CONFIG_X86_MINIMUM_CPU_FAMILY=64",270
"CONFIG_X86_MCE=y",292
"CONFIG_X86_MCE_THRESHOLD=y",295
"CONFIG_X86_MCE_INTEL=y",293
"CONFIG_X86_MCE_INJECT=m",296
"CONFIG_X86_MCE_AMD=y",294
"CONFIG_X86_LOCAL_APIC=y",289
"CONFIG_X86_L1_CACHE_SHIFT=6",266
"CONFIG_X86_IOPL_IOPERM=y",304
"CONFIG_X86_IO_APIC=y",290
"CONFIG_X86_INTERNODE_CACHE_SHIFT=6",265
"CONFIG_X86_INTEL_TSX_MODE_OFF=y",334
"CONFIG_X86_INTEL_PSTATE=y",426
"CONFIG_X86_INTEL_MEMORY_PROTECTION_KEYS=y",333
"CONFIG_X86_INTEL_LPSS=y",239
"CONFIG_X86_HV_CALLBACK_VECTOR=y",248
"CONFIG_X86_FEATURE_NAMES=y",235
"CONFIG_X86_ESPFIX64=y",302
"CONFIG_X86_DIRECT_GBPAGES=y",311
"CONFIG_X86_DEBUG_FPU=y",5191
"CONFIG_X86_DEBUGCTLMSR=y",271
"CONFIG_X86_CPUID=m",310
"CONFIG_X86_CMPXCHG64=y",268
"CONFIG_X86_CMOV=y",269
"CONFIG_X86_AMD_PLATFORM_DEVICE=y",240
"CONFIG_X86_ACPI_CPUFREQ=m",427
"CONFIG_X86_ACPI_CPUFREQ_CPB=y",428
"CONFIG_X86_64=y",202
"CONFIG_X86_64_SMP=y",229
"CONFIG_X86_64_ACPI_NUMA=y",314
"CONFIG_X86_16BIT=y",301
"CONFIG_X509_CERTIFICATE_PARSER=y",5004
"CONFIG_WMI_BMOF=m",4399
"CONFIG_WLAN=y",2195
"CONFIG_WLAN_VENDOR_ZYDAS=y",2368
"CONFIG_WLAN_VENDOR_ST=y",2367
"CONFIG_WLAN_VENDOR_RSI=y",2362
"CONFIG_WLAN_VENDOR_REALTEK=y",2341
"CONFIG_WLAN_VENDOR_RALINK=y",2314
"CONFIG_WLAN_VENDOR_QUANTENNA=y",2371
"CONFIG_WLAN_VENDOR_MICROCHIP=y",2313
"CONFIG_WLAN_VENDOR_MEDIATEK=y",2311
"CONFIG_WLAN_VENDOR_MARVELL=y",2298
"CONFIG_WLAN_VENDOR_INTERSIL=y",2280
"CONFIG_WLAN_VENDOR_INTEL=y",2265
"CONFIG_WLAN_VENDOR_CISCO=y",2262
"CONFIG_WLAN_VENDOR_BROADCOM=y",2229
"CONFIG_WLAN_VENDOR_ATMEL=y",2224
"CONFIG_WLAN_VENDOR_ATH=y",2199
"CONFIG_WLAN_VENDOR_ADMTEK=y",2196
"CONFIG_WIRELESS=y",1313
"CONFIG_WIRELESS_EXT=y",1314
"CONFIG_WINBOND_840=m",1951
"CONFIG_WIL6210_TRACING=y",2219
"CONFIG_WIL6210=m",2217
"CONFIG_WIL6210_ISR_COR=y",2218
"CONFIG_WIL6210_DEBUGFS=y",2220
"CONFIG_WEXT_SPY=y",1317
"CONFIG_WEXT_PROC=y",1316
"CONFIG_WEXT_PRIV=y",1318
"CONFIG_WEXT_CORE=y",1315
"CONFIG_WDTPCI=m",2947
"CONFIG_WATCHDOG=y",2905
"CONFIG_WATCHDOG_SYSFS=y",2909
"CONFIG_WATCHDOG_OPEN_TIMEOUT=0",2908
"CONFIG_WATCHDOG_HANDLE_BOOT_ENABLED=y",2907
"CONFIG_WATCHDOG_CORE=y",2906
"CONFIG_WAN=y",2376
"CONFIG_WANXL=m",2385
"CONFIG_WANT_DEV_COREDUMP=y",1422
"CONFIG_WAKEUP_LATENCY_HIST=y",5176
"CONFIG_WAFER_WDT=m",2922
"CONFIG_W83977F_WDT=m",2942
"CONFIG_W83877F_WDT=m",2941
"CONFIG_W83627HF_WDT=m",2940
"CONFIG_W1_SLAVE_THERM=m",2755
"CONFIG_W1_SLAVE_SMEM=m",2756
"CONFIG_W1_SLAVE_DS2433=m",2758
"CONFIG_W1_SLAVE_DS2431=m",2757
"CONFIG_W1_MASTER_GPIO=m",2754
"CONFIG_W1_MASTER_DS2490=m",2752
"CONFIG_W1_MASTER_DS2482=m",2753
"CONFIG_W1=m",2750
"CONFIG_W1_CON=y",2751
"CONFIG_VXLAN=m",1836
"CONFIG_VXGE=m",2022
"CONFIG_VXFS_FS=m",4673
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional