OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Wed Mar 18, 2026 00:44:18)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
541501	99	2998	14,2980	cyclictest	599623	-21	kworker/2:0+events	22:15:16	2
541501	99	2900	13,2883	cyclictest	603050	-21	kworker/2:2+events	22:50:14	2
541499	99	2785	13,2768	cyclictest	614071	-21	kworker/1:0+events	22:55:10	1
541501	99	2774	13,2756	cyclictest	562922	-21	kworker/2:1+events	20:40:15	2
541501	99	2730	13,2712	cyclictest	554564	-21	kworker/2:2+events	20:10:13	2
541501	99	2722	13,2707	cyclictest	579175	-21	kworker/2:2+events	21:10:14	2
541495	99	2682	10,2668	cyclictest	623767	-21	kworker/0:2+events	23:55:11	0
541495	99	2670	11,2656	cyclictest	623767	-21	kworker/0:2+events	23:50:19	0
541495	99	2670	11,2656	cyclictest	623767	-21	kworker/0:2+events	23:50:19	0
541505	99	2667	13,2649	cyclictest	642719	-21	kworker/3:1+events	00:25:17	3
541505	99	2633	13,2615	cyclictest	593378	-21	kworker/3:2+events	21:50:18	3
541499	99	2627	11,2612	cyclictest	611017	-21	kworker/1:1+events	22:45:17	1
541499	99	2581	12,2566	cyclictest	539599	-21	kworker/1:1+events	19:15:01	1
541499	99	2568	12,2552	cyclictest	554655	-21	kworker/1:0+events	19:48:53	1
541499	99	2556	12,2542	cyclictest	577726	-21	kworker/1:1+events	21:35:05	1
541501	99	2527	12,2512	cyclictest	603050	-21	kworker/2:2+events	22:58:15	2
541495	99	2526	12,2511	cyclictest	556281	-21	kworker/0:0+events	19:53:23	0
541501	99	2504	12,2488	cyclictest	544789	-21	kworker/2:1+events	19:34:48	2
541499	99	2501	12,2486	cyclictest	603137	-21	kworker/1:2+events	22:35:25	1
541499	99	2499	12,2484	cyclictest	574203	-21	kworker/1:0+events	20:58:51	1
541499	99	2495	12,2479	cyclictest	630331	-21	kworker/1:2+events	23:52:09	1
541499	99	2495	12,2479	cyclictest	630331	-21	kworker/1:2+events	23:52:09	1
541495	99	2495	12,2480	cyclictest	598382	-21	kworker/0:1+events	22:07:46	0
541495	99	2495	11,2481	cyclictest	625449	-21	kworker/0:1+events	23:28:40	0
541495	99	2494	12,2478	cyclictest	635217	-21	kworker/0:3+events	00:12:49	0
541495	99	2494	12,2478	cyclictest	577783	-21	kworker/0:2+events	21:16:45	0
541499	99	2493	12,2477	cyclictest	572601	-21	kworker/1:2+events	20:45:14	1
541505	99	2491	12,2475	cyclictest	606124	-21	kworker/3:0+events	22:31:36	3
541499	99	2491	12,2476	cyclictest	583947	-21	kworker/1:0+events	21:24:22	1
541499	99	2485	12,2470	cyclictest	617389	-21	kworker/1:1+events	23:12:01	1
541495	99	2483	12,2468	cyclictest	574237	-21	kworker/0:2+events	20:49:02	0
541499	99	2478	10,2464	cyclictest	592491	-21	kworker/1:2+events	21:46:57	1
541501	99	2475	12,2459	cyclictest	603050	-21	kworker/2:2+events	22:48:41	2
541499	99	2475	11,2461	cyclictest	562804	-21	kworker/1:0+events	20:12:33	1
541505	99	2471	11,2454	cyclictest	638157	-21	kworker/3:2+events	00:35:12	3
541499	99	2463	12,2449	cyclictest	619202	-21	kworker/1:2+events	23:30:11	1
541501	99	2459	10,2446	cyclictest	641407	-21	kworker/2:0+events	00:30:15	2
541499	99	2448	12,2433	cyclictest	550117	-21	kworker/1:2+events	19:53:46	1
541501	99	2445	12,2430	cyclictest	577548	-21	kworker/2:1+events	20:57:23	2
541501	99	2445	11,2430	cyclictest	638218	-21	kworker/2:0+events	00:11:40	2
541501	99	2445	11,2430	cyclictest	575952	-21	kworker/2:0+events	20:54:42	2
541501	99	2444	12,2429	cyclictest	593467	-21	kworker/2:2+events	21:56:25	2
541501	99	2443	12,2428	cyclictest	626869	-21	kworker/2:1+events	23:48:23	2
541501	99	2441	12,2425	cyclictest	544789	-21	kworker/2:1+events	19:19:35	2
541501	99	2439	12,2424	cyclictest	542788	-21	kworker/2:0+events	19:28:45	2
541501	99	2433	11,2418	cyclictest	584157	-21	kworker/2:0+events	21:22:50	2
541501	99	2432	10,2418	cyclictest	626869	-21	kworker/2:1+events	23:34:18	2
541501	99	2431	9,2419	cyclictest	549977	-21	kworker/2:2+events	19:38:33	2
541501	99	2430	11,2416	cyclictest	552577	-21	kworker/2:0+events	19:41:15	2
541501	99	2428	12,2413	cyclictest	579175	-21	kworker/2:2+events	21:31:15	2
541499	99	2426	12,2410	cyclictest	623876	-21	kworker/1:1+events	23:25:17	1
541501	99	2424	11,2410	cyclictest	633399	-21	kworker/2:2+events	00:04:24	2
541495	99	2420	9,2407	cyclictest	630035	-21	kworker/0:1+events	23:45:22	0
541501	99	2419	10,2406	cyclictest	641407	-21	kworker/2:0+events	00:26:02	2
541501	99	2418	11,2404	cyclictest	623993	-21	kworker/2:0+events	23:27:32	2
541505	99	2413	12,2398	cyclictest	553106	-21	kworker/3:1+events	20:26:11	3
541495	99	2401	12,2385	cyclictest	582343	-21	kworker/0:1+events	21:14:52	0
541501	99	2400	11,2386	cyclictest	567866	-21	kworker/2:2+events	20:31:55	2
541495	99	2400	12,2384	cyclictest	587204	-21	kworker/0:0+events	21:30:29	0
541499	99	2399	10,2385	cyclictest	566442	-21	kworker/1:0+events	20:35:19	1
541505	99	2393	11,2378	cyclictest	642719	-21	kworker/3:1+events	00:21:53	3
541505	99	2391	12,2376	cyclictest	553106	-21	kworker/3:1+events	20:15:35	3
541499	99	2390	12,2375	cyclictest	599942	-21	kworker/1:2+events	22:10:22	1
541505	99	2387	12,2372	cyclictest	558007	-21	kworker/3:0+events	20:03:42	3
541505	99	2387	10,2373	cyclictest	604492	-21	kworker/3:1+events	22:23:08	3
541499	99	2386	12,2371	cyclictest	601539	-21	kworker/1:1+events	22:22:46	1
541501	99	2383	11,2368	cyclictest	562922	-21	kworker/2:1+events	20:38:22	2
541499	99	2380	12,2365	cyclictest	603137	-21	kworker/1:2+events	22:40:45	1
541505	99	2377	12,2362	cyclictest	556314	-21	kworker/3:2+events	19:56:30	3
541501	99	2377	10,2364	cyclictest	603050	-21	kworker/2:2+events	22:40:20	2
541505	99	2376	12,2360	cyclictest	569440	-21	kworker/3:1+events	20:56:59	3
541501	99	2371	12,2355	cyclictest	554564	-21	kworker/2:2+events	20:17:30	2
541499	99	2371	11,2357	cyclictest	617389	-21	kworker/1:1+events	23:03:13	1
541505	99	2364	11,2350	cyclictest	551456	-21	kworker/3:0+events	19:42:19	3
541495	99	2363	11,2348	cyclictest	644432	-21	kworker/0:2+events	00:32:31	0
541505	99	2361	11,2346	cyclictest	596640	-21	kworker/3:2+events	22:17:10	3
541501	99	2350	10,2336	cyclictest	603050	-21	kworker/2:2+events	23:06:35	2
541501	99	2346	10,2332	cyclictest	606306	-21	kworker/2:0+events	22:33:53	2
541495	99	2346	10,2333	cyclictest	582343	-21	kworker/0:1+events	21:28:33	0
541505	99	2345	12,2330	cyclictest	596640	-21	kworker/3:2+events	22:59:24	3
541505	99	2345	11,2330	cyclictest	617448	-21	kworker/3:1+events	23:12:47	3
541505	99	2338	10,2325	cyclictest	612287	-21	kworker/3:1+events	22:52:53	3
541501	99	2338	11,2324	cyclictest	593467	-21	kworker/2:2+events	22:09:59	2
541499	99	2334	11,2319	cyclictest	566442	-21	kworker/1:0+events	20:33:47	1
541505	99	2331	11,2316	cyclictest	551456	-21	kworker/3:0+events	19:47:20	3
541495	99	2330	11,2315	cyclictest	616032	-21	kworker/0:0+events	23:19:58	0
541495	99	2329	12,2313	cyclictest	559513	-21	kworker/0:0+events	20:07:56	0
541505	99	2328	11,2314	cyclictest	543003	-21	kworker/3:2+events	19:36:40	3
541499	99	2328	12,2313	cyclictest	630331	-21	kworker/1:2+events	00:04:47	1
541495	99	2328	10,2315	cyclictest	606361	-21	kworker/0:2+events	22:34:38	0
541505	99	2327	12,2312	cyclictest	630420	-21	kworker/3:2+events	23:48:02	3
541505	99	2327	12,2312	cyclictest	576184	-21	kworker/3:2+events	21:11:46	3
541499	99	2327	12,2312	cyclictest	550117	-21	kworker/1:2+events	19:55:20	1
541495	99	2327	12,2312	cyclictest	568075	-21	kworker/0:2+events	20:41:45	0
541495	99	2327	12,2311	cyclictest	546597	-21	kworker/0:1+events	19:31:05	0
541499	99	2326	12,2311	cyclictest	550117	-21	kworker/1:2+events	20:17:52	1
541495	99	2326	12,2311	cyclictest	596726	-21	kworker/0:2+events	22:11:55	0
541505	99	2325	11,2312	cyclictest	636525	-21	kworker/3:1+events	00:10:07	3
541505	99	2325	11,2311	cyclictest	585723	-21	kworker/3:1+events	21:25:31	3
541495	99	2325	11,2311	cyclictest	604697	-21	kworker/0:0+events	22:41:53	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00