OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Wed Apr 15, 2026 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1224704	99	3153	16,3134	cyclictest	1240643	-21	kworker/3:0+events	20:10:17	3
1224692	99	3121	13,3104	cyclictest	1253196	-21	kworker/0:0+events	20:50:01	0
1224692	99	3097	13,3081	cyclictest	1253196	-21	kworker/0:0+events	20:55:18	0
1224704	99	3001	14,2985	cyclictest	1267992	-21	kworker/3:0+events	21:30:22	3
1224701	99	2824	13,2808	cyclictest	1224789	-21	kworker/2:2+events	19:40:16	2
1224704	99	2778	13,2763	cyclictest	1277697	-21	kworker/3:0+events	21:55:18	3
1224704	99	2776	11,2762	cyclictest	1322124	-21	kworker/3:1+events	00:30:13	3
1224704	99	2776	11,2762	cyclictest	1322124	-21	kworker/3:1+events	00:30:13	3
1224692	99	2766	13,2750	cyclictest	1258984	-21	kworker/0:2+events	21:00:17	0
1224701	99	2757	13,2742	cyclictest	1318406	-21	kworker/2:1+events	00:11:55	2
1224696	99	2755	13,2738	cyclictest	1325568	-21	kworker/1:2+events	00:35:11	1
1224701	99	2747	13,2732	cyclictest	1290907	-21	kworker/2:2+events	22:45:07	2
1224696	99	2727	10,2712	cyclictest	1221006	-21	kworker/1:2+events	19:30:18	1
1224701	99	2711	13,2693	cyclictest	1277901	-21	kworker/2:2+events	22:00:17	2
1224692	99	2697	11,2682	cyclictest	1264825	-21	kworker/0:2+events	21:25:21	0
1224701	99	2634	13,2617	cyclictest	1326946	-21	kworker/2:1+events	00:25:18	2
1224704	99	2574	12,2559	cyclictest	1263435	-21	kworker/3:0+events	21:10:14	3
1224696	99	2571	11,2556	cyclictest	1282788	-21	kworker/1:2+events	22:13:33	1
1224696	99	2568	7,2557	cyclictest	1322030	-21	kworker/1:1+events	00:20:43	1
1224701	99	2538	9,2526	cyclictest	1302621	-21	kworker/2:0+events	23:30:22	2
1224704	99	2527	12,2511	cyclictest	1246825	-21	kworker/3:0+events	20:21:22	3
1224701	99	2520	12,2506	cyclictest	1282436	-21	kworker/2:1+events	22:30:06	2
1224704	99	2518	11,2504	cyclictest	1277697	-21	kworker/3:0+events	22:07:55	3
1224704	99	2513	12,2498	cyclictest	1229574	-21	kworker/3:0+events	19:25:43	3
1224701	99	2508	12,2492	cyclictest	1249997	-21	kworker/2:2+events	20:27:27	2
1224704	99	2506	12,2490	cyclictest	1267992	-21	kworker/3:0+events	21:26:07	3
1224704	99	2491	12,2476	cyclictest	1299449	-21	kworker/3:2+events	23:05:49	3
1224696	99	2491	10,2477	cyclictest	1310466	-21	kworker/1:2+events	23:33:04	1
1224692	99	2479	12,2464	cyclictest	1318467	-21	kworker/0:1+events	00:10:22	0
1224696	99	2478	9,2466	cyclictest	1248542	-21	kworker/1:0+events	20:34:19	1
1224704	99	2477	11,2463	cyclictest	1258398	-21	kworker/3:1+events	20:59:30	3
1224704	99	2476	12,2461	cyclictest	1297498	-21	kworker/3:0+events	23:01:35	3
1224696	99	2476	11,2461	cyclictest	1292748	-21	kworker/1:0+events	22:47:50	1
1224704	99	2474	11,2460	cyclictest	1273145	-21	kworker/3:2+events	21:51:30	3
1224696	99	2473	12,2457	cyclictest	1261743	-21	kworker/1:1+events	21:03:45	1
1224696	99	2472	12,2457	cyclictest	1253223	-21	kworker/1:1+events	20:40:25	1
1224692	99	2472	10,2457	cyclictest	1322603	-21	kworker/0:0+events	00:24:56	0
1224704	99	2470	11,2456	cyclictest	1267992	-21	kworker/3:0+events	21:41:56	3
1224704	99	2467	12,2452	cyclictest	1304372	-21	kworker/3:2+events	23:15:25	3
1224704	99	2460	9,2447	cyclictest	1315351	-21	kworker/3:1+events	23:49:40	3
1224704	99	2460	12,2444	cyclictest	1327065	-21	kworker/3:2+events	00:27:14	3
1224701	99	2458	8,2445	cyclictest	1224789	-21	kworker/2:2+events	19:15:17	2
1224696	99	2458	12,2442	cyclictest	1302560	-21	kworker/1:2+events	23:11:36	1
1224701	99	2454	12,2439	cyclictest	1271405	-21	kworker/2:0+events	21:32:41	2
1224696	99	2454	10,2441	cyclictest	1259996	-21	kworker/1:0+events	21:05:17	1
1224704	99	2453	12,2437	cyclictest	1322124	-21	kworker/3:1+events	00:09:58	3
1224704	99	2453	11,2439	cyclictest	1325427	-21	kworker/3:0+events	00:19:57	3
1224704	99	2452	12,2436	cyclictest	1246825	-21	kworker/3:0+events	20:25:34	3
1224704	99	2451	12,2437	cyclictest	1315351	-21	kworker/3:1+events	23:55:01	3
1224704	99	2451	12,2436	cyclictest	1246825	-21	kworker/3:0+events	20:45:47	3
1224704	99	2451	12,2435	cyclictest	1294316	-21	kworker/3:1+events	22:48:12	3
1224704	99	2451	11,2437	cyclictest	1246825	-21	kworker/3:0+events	20:17:56	3
1224704	99	2450	12,2435	cyclictest	1253460	-21	kworker/3:2+events	20:42:22	3
1224704	99	2450	11,2435	cyclictest	1224112	-21	kworker/3:1+events	19:21:32	3
1224704	99	2449	12,2433	cyclictest	1261829	-21	kworker/3:2+events	21:09:28	3
1224701	99	2449	12,2434	cyclictest	1279621	-21	kworker/2:0+events	22:05:15	2
1224704	99	2445	12,2430	cyclictest	1273145	-21	kworker/3:2+events	21:48:28	3
1224701	99	2445	12,2431	cyclictest	1290907	-21	kworker/2:2+events	22:40:05	2
1224701	99	2445	12,2431	cyclictest	1264945	-21	kworker/2:0+events	21:20:09	2
1224704	99	2444	12,2428	cyclictest	1301163	-21	kworker/3:1+events	23:12:45	3
1224704	99	2444	11,2430	cyclictest	1325427	-21	kworker/3:0+events	00:22:37	3
1224704	99	2444	11,2430	cyclictest	1306621	-21	kworker/3:0+events	23:34:13	3
1224704	99	2444	11,2430	cyclictest	1243035	-21	kworker/3:1+events	20:38:53	3
1224692	99	2444	12,2429	cyclictest	1274610	-21	kworker/0:0+events	21:45:01	0
1224701	99	2443	12,2429	cyclictest	1302621	-21	kworker/2:0+events	23:20:02	2
1224704	99	2442	11,2427	cyclictest	1231267	-21	kworker/3:2+events	19:58:36	3
1224701	99	2440	11,2423	cyclictest	1302621	-21	kworker/2:0+events	23:13:31	2
1224701	99	2433	11,2419	cyclictest	1308865	-21	kworker/2:2+events	23:29:38	2
1224701	99	2430	3,2424	cyclictest	1282436	-21	kworker/2:1+events	22:12:01	2
1224704	99	2429	12,2413	cyclictest	1260145	-21	kworker/3:0+events	21:02:14	3
1224704	99	2428	10,2415	cyclictest	1267992	-21	kworker/3:0+events	21:23:06	3
1224701	99	2427	10,2413	cyclictest	1318406	-21	kworker/2:1+events	00:05:21	2
1224701	99	2426	12,2410	cyclictest	1312188	-21	kworker/2:0+events	23:40:39	2
1224701	99	2425	12,2410	cyclictest	1239037	-21	kworker/2:0+events	20:04:40	2
1224701	99	2425	12,2409	cyclictest	1326946	-21	kworker/2:1+events	00:35:33	2
1224701	99	2425	12,2409	cyclictest	1245494	-21	kworker/2:0+events	20:41:34	2
1224704	99	2420	12,2404	cyclictest	1271554	-21	kworker/3:1+events	21:38:05	3
1224696	99	2417	12,2402	cyclictest	1241990	-21	kworker/1:1+events	20:03:32	1
1224701	99	2411	11,2396	cyclictest	1287626	-21	kworker/2:2+events	22:27:26	2
1224701	99	2411	10,2398	cyclictest	1282436	-21	kworker/2:1+events	22:18:59	2
1224696	99	2409	11,2394	cyclictest	1312099	-21	kworker/1:1+events	23:40:16	1
1224701	99	2408	12,2393	cyclictest	1253255	-21	kworker/2:1+events	20:51:51	2
1224701	99	2408	11,2394	cyclictest	1313837	-21	kworker/2:1+events	23:45:52	2
1224701	99	2407	9,2395	cyclictest	1240762	-21	kworker/2:2+events	20:17:10	2
1224701	99	2406	12,2390	cyclictest	1318406	-21	kworker/2:1+events	00:03:01	2
1224696	99	2402	12,2387	cyclictest	1269622	-21	kworker/1:0+events	22:16:16	1
1224704	99	2400	12,2385	cyclictest	1308391	-21	kworker/3:1+events	23:27:23	3
1224701	99	2399	9,2388	cyclictest	1292779	-21	kworker/2:0+events	22:55:06	2
1224696	99	2399	12,2383	cyclictest	1243624	-21	kworker/1:2+events	20:17:33	1
1224696	99	2397	12,2381	cyclictest	1300923	-21	kworker/1:1+events	23:26:14	1
1224696	99	2395	10,2381	cyclictest	1285841	-21	kworker/1:1+events	22:35:28	1
1224696	99	2391	12,2377	cyclictest	1290880	-21	kworker/1:2+events	23:00:03	1
1224696	99	2391	12,2376	cyclictest	1267867	-21	kworker/1:2+events	21:27:41	1
1224696	99	2391	12,2375	cyclictest	1315379	-21	kworker/1:1+events	23:54:16	1
1224696	99	2390	12,2375	cyclictest	1261743	-21	kworker/1:1+events	21:22:22	1
1224692	99	2390	12,2375	cyclictest	1263166	-21	kworker/0:1+events	21:35:46	0
1224692	99	2390	12,2374	cyclictest	1239129	-21	kworker/0:2+events	19:58:58	0
1224692	99	2390	10,2376	cyclictest	1316802	-21	kworker/0:0+events	23:58:02	0
1224701	99	2389	10,2375	cyclictest	1273040	-21	kworker/2:1+events	21:46:11	2
1224696	99	2389	11,2375	cyclictest	1287475	-21	kworker/1:2+events	22:22:49	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00