OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Fri Mar 27, 2026 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
623449	99	3329	18,3306	cyclictest	631457	-21	kworker/3:2+events	19:50:12	3
623445	99	2862	14,2843	cyclictest	705821	-21	kworker/2:1+events	00:00:14	2
623445	99	2839	14,2822	cyclictest	679107	-21	kworker/2:0+events	22:25:20	2
623439	99	2821	13,2805	cyclictest	698063	-21	kworker/1:1+events	23:30:01	1
623435	99	2798	13,2782	cyclictest	664791	-21	kworker/0:1+events	21:20:20	0
623445	99	2753	12,2736	cyclictest	647216	-21	kworker/2:0+events	20:25:02	2
623439	99	2736	11,2721	cyclictest	691199	-21	kworker/1:0+events	23:09:52	1
623445	99	2714	9,2701	cyclictest	668499	-21	kworker/2:2+events	21:35:14	2
623435	99	2684	13,2666	cyclictest	694744	-21	kworker/0:1+events	23:30:21	0
623435	99	2630	13,2613	cyclictest	704468	-21	kworker/0:1+events	23:55:15	0
623439	99	2629	13,2613	cyclictest	722416	-21	kworker/1:1+events	00:35:21	1
623439	99	2618	11,2603	cyclictest	682123	-21	kworker/1:0+events	22:32:34	1
623435	99	2607	12,2591	cyclictest	648721	-21	kworker/0:2+events	20:29:09	0
623439	99	2580	13,2563	cyclictest	707666	-21	kworker/1:2+events	00:03:41	1
623449	99	2550	12,2534	cyclictest	696710	-21	kworker/3:2+events	23:21:33	3
623445	99	2528	7,2517	cyclictest	688809	-21	kworker/2:0+events	23:03:48	2
623439	99	2527	10,2513	cyclictest	698063	-21	kworker/1:1+events	23:40:14	1
623435	99	2518	12,2504	cyclictest	710855	-21	kworker/0:0+events	00:10:09	0
623435	99	2515	10,2501	cyclictest	683642	-21	kworker/0:0+events	22:36:00	0
623449	99	2512	12,2497	cyclictest	677653	-21	kworker/3:2+events	22:09:53	3
623439	99	2511	9,2498	cyclictest	671465	-21	kworker/1:2+events	21:51:58	1
623439	99	2508	12,2493	cyclictest	698063	-21	kworker/1:1+events	23:38:20	1
623435	99	2506	11,2492	cyclictest	696342	-21	kworker/0:0+events	23:13:41	0
623435	99	2504	12,2488	cyclictest	660032	-21	kworker/0:1+events	21:02:26	0
623449	99	2501	12,2486	cyclictest	635051	-21	kworker/3:1+events	20:03:50	3
623449	99	2495	8,2484	cyclictest	715935	-21	kworker/3:2+events	00:25:32	3
623449	99	2493	12,2477	cyclictest	673066	-21	kworker/3:0+events	21:42:57	3
623449	99	2492	11,2478	cyclictest	717599	-21	kworker/3:1+events	00:31:34	3
623449	99	2491	10,2478	cyclictest	677653	-21	kworker/3:2+events	22:15:54	3
623435	99	2491	12,2475	cyclictest	686924	-21	kworker/0:0+events	22:48:12	0
623449	99	2490	12,2475	cyclictest	655617	-21	kworker/3:0+events	20:50:45	3
623449	99	2489	12,2474	cyclictest	665011	-21	kworker/3:0+events	21:20:45	3
623449	99	2489	12,2474	cyclictest	652370	-21	kworker/3:2+events	20:45:46	3
623449	99	2489	11,2474	cyclictest	722476	-21	kworker/3:2+events	00:39:12	3
623449	99	2489	11,2474	cyclictest	645535	-21	kworker/3:0+events	20:27:59	3
623449	99	2488	12,2472	cyclictest	677653	-21	kworker/3:2+events	22:41:41	3
623449	99	2488	12,2472	cyclictest	666924	-21	kworker/3:2+events	21:27:38	3
623435	99	2488	12,2472	cyclictest	694744	-21	kworker/0:1+events	23:27:43	0
623449	99	2486	10,2472	cyclictest	639442	-21	kworker/3:2+events	20:12:10	3
623439	99	2478	6,2469	cyclictest	671465	-21	kworker/1:2+events	21:47:26	1
623449	99	2475	11,2461	cyclictest	675570	-21	kworker/3:1+events	22:11:21	3
623449	99	2474	11,2459	cyclictest	642752	-21	kworker/3:1+events	20:16:00	3
623449	99	2474	10,2461	cyclictest	683459	-21	kworker/3:0+events	22:39:26	3
623449	99	2473	12,2457	cyclictest	690384	-21	kworker/3:1+events	22:59:19	3
623439	99	2470	11,2455	cyclictest	686624	-21	kworker/1:2+events	22:42:50	1
623435	99	2467	12,2449	cyclictest	701228	-21	kworker/0:2+events	23:35:19	0
623439	99	2464	11,2450	cyclictest	686993	-21	kworker/1:3+events	22:49:20	1
623449	99	2460	12,2444	cyclictest	715935	-21	kworker/3:2+events	00:18:34	3
623449	99	2458	12,2443	cyclictest	637658	-21	kworker/3:0+events	19:55:52	3
623439	99	2458	12,2442	cyclictest	650686	-21	kworker/1:2+events	20:40:11	1
623449	99	2457	10,2444	cyclictest	673066	-21	kworker/3:0+events	21:45:36	3
623449	99	2455	9,2442	cyclictest	717599	-21	kworker/3:1+events	00:24:44	3
623435	99	2455	11,2440	cyclictest	671557	-21	kworker/0:0+events	21:48:11	0
623449	99	2452	12,2436	cyclictest	645535	-21	kworker/3:0+events	20:23:08	3
623449	99	2452	11,2437	cyclictest	680468	-21	kworker/3:1+events	22:27:12	3
623435	99	2452	12,2436	cyclictest	636085	-21	kworker/0:0+events	19:58:10	0
623445	99	2449	12,2433	cyclictest	655498	-21	kworker/2:0+events	20:48:52	2
623445	99	2447	12,2432	cyclictest	661866	-21	kworker/2:0+events	21:09:47	2
623435	99	2444	11,2430	cyclictest	639287	-21	kworker/0:1+events	20:01:37	0
623449	99	2442	12,2427	cyclictest	701165	-21	kworker/3:1+events	23:34:11	3
623439	99	2438	12,2423	cyclictest	673218	-21	kworker/1:1+events	21:44:27	1
623435	99	2433	8,2422	cyclictest	678815	-21	kworker/0:1+events	22:23:06	0
623439	99	2428	11,2416	cyclictest	684974	-21	kworker/1:1+events	22:50:06	1
623439	99	2428	11,2413	cyclictest	686993	-21	kworker/1:3+events	22:58:55	1
623449	99	2427	12,2412	cyclictest	705850	-21	kworker/3:2+events	23:53:41	3
623439	99	2425	12,2410	cyclictest	693206	-21	kworker/1:1+events	23:10:37	1
623445	99	2424	10,2411	cyclictest	693293	-21	kworker/2:2+events	23:07:34	2
623439	99	2424	12,2409	cyclictest	640971	-21	kworker/1:1+events	20:29:56	1
623435	99	2424	11,2409	cyclictest	650622	-21	kworker/0:1+events	20:37:09	0
623439	99	2423	12,2407	cyclictest	657246	-21	kworker/1:0+events	20:57:09	1
623435	99	2423	12,2408	cyclictest	624529	-21	kworker/0:1+events	19:50:35	0
623435	99	2423	11,2408	cyclictest	704468	-21	kworker/0:1+events	23:45:14	0
623435	99	2423	10,2410	cyclictest	710855	-21	kworker/0:0+events	00:08:36	0
623435	99	2423	10,2409	cyclictest	710855	-21	kworker/0:0+events	00:17:02	0
623435	99	2422	12,2406	cyclictest	699593	-21	kworker/0:0+events	23:24:58	0
623435	99	2422	10,2409	cyclictest	655673	-21	kworker/0:0+events	21:05:55	0
623439	99	2421	11,2406	cyclictest	705940	-21	kworker/1:0+events	23:50:59	1
623435	99	2420	8,2408	cyclictest	676755	-21	kworker/0:1+events	22:06:01	0
623435	99	2420	12,2405	cyclictest	678815	-21	kworker/0:1+events	22:42:29	0
623435	99	2420	12,2404	cyclictest	710855	-21	kworker/0:0+events	00:23:34	0
623449	99	2419	11,2405	cyclictest	694953	-21	kworker/3:1+events	23:15:56	3
623449	99	2419	11,2405	cyclictest	694953	-21	kworker/3:1+events	23:15:56	3
623445	99	2419	11,2405	cyclictest	639504	-21	kworker/2:0+events	20:09:30	2
623439	99	2419	12,2404	cyclictest	693206	-21	kworker/1:1+events	23:01:56	1
623439	99	2419	12,2404	cyclictest	652309	-21	kworker/1:1+events	20:39:26	1
623439	99	2419	12,2403	cyclictest	663319	-21	kworker/1:1+events	21:14:42	1
623435	99	2418	8,2407	cyclictest	666683	-21	kworker/0:2+events	21:32:35	0
623435	99	2418	12,2403	cyclictest	678125	-21	kworker/0:2+events	22:14:01	0
623435	99	2416	11,2402	cyclictest	629859	-21	kworker/0:2+events	19:28:45	0
623435	99	2415	7,2405	cyclictest	645657	-21	kworker/0:0+events	20:19:24	0
623435	99	2411	12,2395	cyclictest	641002	-21	kworker/0:2+events	20:05:43	0
623439	99	2410	11,2395	cyclictest	626810	-21	kworker/1:0+events	19:23:05	1
623435	99	2409	12,2394	cyclictest	655673	-21	kworker/0:0+events	20:51:29	0
623445	99	2404	9,2391	cyclictest	686894	-21	kworker/2:2+events	22:52:02	2
623445	99	2404	12,2388	cyclictest	679107	-21	kworker/2:0+events	22:22:19	2
623449	99	2403	12,2388	cyclictest	623384	-21	kworker/3:3+events	19:16:35	3
623449	99	2402	10,2389	cyclictest	688553	-21	kworker/3:0+events	22:48:35	3
623445	99	2402	11,2387	cyclictest	693293	-21	kworker/2:2+events	23:13:18	2
623449	99	2397	12,2382	cyclictest	628196	-21	kworker/3:1+events	19:30:17	3
623445	99	2397	10,2385	cyclictest	657094	-21	kworker/2:2+events	21:00:09	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00