OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Mar 26, 2026 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
160895	99	4035	16,4013	cyclictest	243385	-21	kworker/2:2+events	23:25:11	2
160893	99	3406	16,3381	cyclictest	249707	-21	kworker/1:1+events	23:55:17	1
160893	99	2976	14,2957	cyclictest	173819	-21	kworker/1:0+events	19:50:12	1
160888	99	2812	13,2796	cyclictest	264487	-21	kworker/0:1+events	00:35:11	0
160895	99	2806	13,2790	cyclictest	162181	-21	kworker/2:1+events	19:15:12	2
160893	99	2798	14,2780	cyclictest	222132	-21	kworker/1:1+events	22:25:12	1
160888	99	2777	13,2760	cyclictest	221950	-21	kworker/0:0+events	22:35:13	0
160893	99	2616	12,2600	cyclictest	188645	-21	kworker/1:1+events	20:35:19	1
160893	99	2602	12,2586	cyclictest	166124	-21	kworker/1:2+events	19:25:16	1
160895	99	2590	10,2576	cyclictest	220570	-21	kworker/2:2+events	22:20:10	2
160888	99	2527	12,2511	cyclictest	240014	-21	kworker/0:1+events	23:12:43	0
160888	99	2514	12,2498	cyclictest	217378	-21	kworker/0:2+events	22:07:58	0
160893	99	2513	12,2497	cyclictest	190249	-21	kworker/1:0+events	20:45:14	1
160893	99	2510	12,2494	cyclictest	258228	-21	kworker/1:0+events	00:30:13	1
160893	99	2507	12,2491	cyclictest	199623	-21	kworker/1:2+events	21:19:24	1
160898	99	2503	12,2487	cyclictest	187073	-21	kworker/3:2+events	20:35:44	3
160888	99	2499	11,2484	cyclictest	169375	-21	kworker/0:2+events	19:36:09	0
160893	99	2497	12,2481	cyclictest	177039	-21	kworker/1:0+events	19:58:27	1
160898	99	2496	12,2481	cyclictest	234606	-21	kworker/3:2+events	23:11:11	3
160888	99	2496	12,2480	cyclictest	255029	-21	kworker/0:2+events	00:03:36	0
160893	99	2495	12,2479	cyclictest	183550	-21	kworker/1:2+events	20:28:10	1
160888	99	2495	12,2480	cyclictest	191720	-21	kworker/0:0+events	20:47:58	0
160888	99	2495	12,2479	cyclictest	241611	-21	kworker/0:2+events	23:20:34	0
160888	99	2495	12,2479	cyclictest	194926	-21	kworker/0:1+events	21:14:02	0
160888	99	2494	11,2480	cyclictest	210874	-21	kworker/0:2+events	21:48:49	0
160898	99	2493	12,2477	cyclictest	188920	-21	kworker/3:1+events	20:44:05	3
160898	99	2492	12,2476	cyclictest	167516	-21	kworker/3:0+events	19:49:06	3
160893	99	2492	12,2476	cyclictest	210728	-21	kworker/1:0+events	21:50:21	1
160893	99	2490	10,2477	cyclictest	164192	-21	kworker/1:1+events	19:22:39	1
160888	99	2490	11,2475	cyclictest	166094	-21	kworker/0:2+events	19:25:39	0
160888	99	2488	12,2472	cyclictest	164220	-21	kworker/0:0+events	19:31:17	0
160888	99	2487	8,2475	cyclictest	229957	-21	kworker/0:1+events	23:04:19	0
160888	99	2484	12,2469	cyclictest	231589	-21	kworker/0:0+events	22:49:22	0
160888	99	2483	11,2468	cyclictest	185294	-21	kworker/0:0+events	20:29:41	0
160895	99	2482	5,2473	cyclictest	210936	-21	kworker/2:2+events	21:57:16	2
160888	99	2481	12,2465	cyclictest	229957	-21	kworker/0:1+events	22:54:19	0
160888	99	2481	10,2468	cyclictest	177156	-21	kworker/0:2+events	20:02:12	0
160888	99	2480	12,2465	cyclictest	214086	-21	kworker/0:1+events	21:58:27	0
160895	99	2478	12,2463	cyclictest	230133	-21	kworker/2:2+events	22:45:29	2
160888	99	2478	9,2467	cyclictest	206343	-21	kworker/0:0+events	21:40:03	0
160888	99	2476	10,2464	cyclictest	253430	-21	kworker/0:1+events	00:05:09	0
160898	99	2471	12,2456	cyclictest	254688	-21	kworker/3:0+events	23:56:50	3
160888	99	2469	12,2454	cyclictest	208715	-21	kworker/0:1+events	21:37:23	0
160888	99	2468	12,2453	cyclictest	220163	-21	kworker/0:1+events	22:28:41	0
160888	99	2465	14,2448	cyclictest	191720	-21	kworker/0:0+events	20:41:47	0
160893	99	2464	12,2449	cyclictest	178803	-21	kworker/1:1+events	20:18:57	1
160895	99	2460	12,2444	cyclictest	257958	-21	kworker/2:0+events	00:08:15	2
160893	99	2460	12,2444	cyclictest	197976	-21	kworker/1:1+events	21:01:41	1
160893	99	2457	11,2442	cyclictest	245283	-21	kworker/1:2+events	23:32:50	1
160895	99	2449	12,2434	cyclictest	177300	-21	kworker/2:1+events	20:07:55	2
160893	99	2440	10,2427	cyclictest	190249	-21	kworker/1:0+events	21:10:32	1
160888	99	2440	11,2426	cyclictest	238093	-21	kworker/0:2+events	23:08:08	0
160895	99	2439	9,2426	cyclictest	204318	-21	kworker/2:1+events	21:23:37	2
160895	99	2438	12,2422	cyclictest	236648	-21	kworker/2:2+events	23:13:28	2
160898	99	2437	0,2431	cyclictest	217137	-21	kworker/3:2+events	22:10:15	3
160895	99	2436	11,2421	cyclictest	226847	-21	kworker/2:0+events	22:37:33	2
160893	99	2436	12,2421	cyclictest	167750	-21	kworker/1:1+events	19:45:18	1
160895	99	2432	12,2416	cyclictest	224915	-21	kworker/2:1+events	22:30:38	2
160893	99	2432	12,2416	cyclictest	222132	-21	kworker/1:1+events	22:23:16	1
160893	99	2428	12,2413	cyclictest	228424	-21	kworker/1:1+events	22:41:41	1
160898	99	2421	11,2406	cyclictest	243207	-21	kworker/3:1+events	23:29:22	3
160895	99	2421	12,2405	cyclictest	183580	-21	kworker/2:2+events	20:19:21	2
160893	99	2420	12,2404	cyclictest	207473	-21	kworker/1:1+events	21:41:33	1
160895	99	2419	12,2403	cyclictest	193264	-21	kworker/2:2+events	20:50:34	2
160893	99	2417	11,2402	cyclictest	207473	-21	kworker/1:1+events	21:38:11	1
160893	99	2416	12,2401	cyclictest	164192	-21	kworker/1:1+events	19:19:19	1
160893	99	2413	10,2400	cyclictest	199623	-21	kworker/1:2+events	21:28:35	1
160895	99	2412	10,2398	cyclictest	231742	-21	kworker/2:1+events	22:53:58	2
160898	99	2411	12,2397	cyclictest	199684	-21	kworker/3:0+events	21:10:07	3
160895	99	2411	12,2395	cyclictest	249769	-21	kworker/2:0+events	23:45:49	2
160898	99	2409	12,2394	cyclictest	199684	-21	kworker/3:0+events	21:19:02	3
160895	99	2409	11,2394	cyclictest	181683	-21	kworker/2:0+events	20:21:58	2
160893	99	2409	12,2393	cyclictest	249707	-21	kworker/1:1+events	23:48:49	1
160893	99	2408	10,2395	cyclictest	240189	-21	kworker/1:0+events	23:18:19	1
160895	99	2406	12,2390	cyclictest	185354	-21	kworker/2:1+events	20:25:50	2
160895	99	2406	11,2391	cyclictest	217225	-21	kworker/2:0+events	22:12:30	2
160893	99	2406	11,2391	cyclictest	177039	-21	kworker/1:0+events	20:08:19	1
160893	99	2405	12,2390	cyclictest	185202	-21	kworker/1:0+events	20:31:55	1
160893	99	2405	12,2389	cyclictest	253225	-21	kworker/1:0+events	00:02:27	1
160888	99	2404	11,2389	cyclictest	198259	-21	kworker/0:0+events	21:04:43	0
160895	99	2403	12,2388	cyclictest	257958	-21	kworker/2:0+events	00:10:30	2
160895	99	2403	10,2389	cyclictest	262648	-21	kworker/2:2+events	00:33:17	2
160893	99	2403	12,2388	cyclictest	220368	-21	kworker/1:0+events	22:33:42	1
160893	99	2402	12,2387	cyclictest	190249	-21	kworker/1:0+events	20:43:42	1
160898	99	2401	12,2386	cyclictest	223427	-21	kworker/3:1+events	22:24:02	3
160895	99	2401	11,2386	cyclictest	253206	-21	kworker/2:0+events	23:53:25	2
160895	99	2400	12,2385	cyclictest	207715	-21	kworker/2:0+events	21:34:20	2
160895	99	2400	11,2385	cyclictest	199593	-21	kworker/2:1+events	21:06:39	2
160893	99	2400	10,2386	cyclictest	258228	-21	kworker/1:0+events	00:26:02	1
160888	99	2400	12,2384	cyclictest	183488	-21	kworker/0:2+events	20:17:27	0
160893	99	2399	12,2383	cyclictest	249707	-21	kworker/1:1+events	00:08:37	1
160893	99	2399	11,2385	cyclictest	249707	-21	kworker/1:1+events	23:52:15	1
160893	99	2399	11,2384	cyclictest	238329	-21	kworker/1:1+events	23:09:40	1
160898	99	2397	9,2384	cyclictest	167516	-21	kworker/3:0+events	20:10:35	3
160893	99	2397	9,2384	cyclictest	190249	-21	kworker/1:0+events	20:54:25	1
160895	99	2396	11,2381	cyclictest	204318	-21	kworker/2:1+events	21:38:32	2
160893	99	2396	12,2381	cyclictest	236468	-21	kworker/1:3+events	23:10:26	1
160893	99	2396	11,2382	cyclictest	195105	-21	kworker/1:2+events	20:59:24	1
160895	99	2395	12,2379	cyclictest	164171	-21	kworker/2:0+events	19:23:23	2
160893	99	2395	11,2381	cyclictest	258228	-21	kworker/1:0+events	00:36:19	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00