OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Wed Mar 11, 2026 00:44:15)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1390993	99	2994	13,2976	cyclictest	1447228	-21	kworker/0:1+events	22:30:16	0
1390993	99	2950	14,2933	cyclictest	1438956	-21	kworker/0:0+events	21:45:00	0
1391000	99	2855	13,2837	cyclictest	1473298	-21	kworker/2:0+events	00:00:18	2
1390997	99	2801	13,2784	cyclictest	1460216	-21	kworker/1:0+events	22:55:18	1
1391000	99	2722	13,2704	cyclictest	1407362	-21	kworker/2:2+events	20:10:12	2
1390993	99	2674	10,2659	cyclictest	1429225	-21	kworker/0:0+events	21:15:13	0
1391003	99	2641	13,2625	cyclictest	1449072	-21	kworker/3:2+events	22:24:56	3
1391000	99	2634	13,2618	cyclictest	1402144	-21	kworker/2:0+events	20:04:29	2
1391003	99	2526	12,2510	cyclictest	1443802	-21	kworker/3:0+events	21:55:32	3
1390997	99	2502	12,2486	cyclictest	1418208	-21	kworker/1:1+events	20:42:10	1
1390993	99	2499	12,2483	cyclictest	1468538	-21	kworker/0:0+events	23:10:13	0
1391003	99	2495	12,2479	cyclictest	1462045	-21	kworker/3:2+events	23:25:14	3
1391000	99	2495	12,2479	cyclictest	1465160	-21	kworker/2:2+events	22:57:35	2
1390993	99	2485	12,2470	cyclictest	1479617	-21	kworker/0:2+events	23:55:01	0
1390997	99	2484	12,2469	cyclictest	1477724	-21	kworker/1:0+events	23:37:54	1
1390993	99	2478	12,2462	cyclictest	1423216	-21	kworker/0:1+events	21:04:33	0
1391000	99	2465	12,2449	cyclictest	1416672	-21	kworker/2:1+events	20:35:18	2
1390993	99	2454	7,2443	cyclictest	1479617	-21	kworker/0:2+events	00:02:13	0
1391000	99	2441	12,2425	cyclictest	1468389	-21	kworker/2:0+events	23:15:16	2
1390993	99	2440	12,2425	cyclictest	1457105	-21	kworker/0:0+events	22:41:44	0
1391000	99	2434	12,2418	cyclictest	1423155	-21	kworker/2:1+events	21:04:57	2
1390993	99	2428	12,2413	cyclictest	1435656	-21	kworker/0:1+events	21:32:23	0
1391000	99	2425	12,2409	cyclictest	1475174	-21	kworker/2:1+events	23:35:14	2
1390993	99	2425	12,2409	cyclictest	1440901	-21	kworker/0:1+events	21:50:13	0
1390997	99	2422	10,2409	cyclictest	1491202	-21	kworker/1:1+events	00:24:24	1
1391003	99	2412	10,2398	cyclictest	1400520	-21	kworker/3:0+events	19:37:47	3
1391003	99	2411	12,2396	cyclictest	1492767	-21	kworker/3:2+events	00:32:20	3
1391000	99	2411	11,2396	cyclictest	1403802	-21	kworker/2:2+events	19:48:23	2
1391000	99	2409	11,2395	cyclictest	1468389	-21	kworker/2:0+events	23:08:17	2
1390997	99	2409	9,2396	cyclictest	1433993	-21	kworker/1:2+events	21:26:38	1
1390993	99	2409	10,2396	cyclictest	1408839	-21	kworker/0:1+events	20:24:20	0
1391003	99	2408	10,2394	cyclictest	1474905	-21	kworker/3:1+events	23:34:04	3
1391000	99	2408	12,2393	cyclictest	1419930	-21	kworker/2:2+events	20:44:48	2
1391000	99	2408	12,2392	cyclictest	1489535	-21	kworker/2:2+events	00:16:42	2
1391000	99	2407	9,2394	cyclictest	1435808	-21	kworker/2:2+events	22:12:20	2
1390997	99	2407	12,2392	cyclictest	1400731	-21	kworker/1:1+events	19:50:18	1
1391000	99	2402	12,2387	cyclictest	1479466	-21	kworker/2:1+events	23:46:58	2
1390993	99	2402	12,2386	cyclictest	1489445	-21	kworker/0:2+events	00:14:46	0
1390993	99	2402	12,2386	cyclictest	1413848	-21	kworker/0:2+events	20:25:52	0
1390993	99	2398	12,2382	cyclictest	1476268	-21	kworker/0:0+events	23:36:21	0
1390993	99	2397	12,2381	cyclictest	1470149	-21	kworker/0:1+events	23:22:10	0
1390993	99	2397	10,2384	cyclictest	1447228	-21	kworker/0:1+events	22:19:12	0
1390993	99	2392	12,2377	cyclictest	1460421	-21	kworker/0:2+events	23:01:23	0
1390993	99	2392	12,2376	cyclictest	1403712	-21	kworker/0:1+events	19:56:27	0
1390993	99	2391	12,2377	cyclictest	1470149	-21	kworker/0:1+events	23:30:36	0
1390993	99	2391	10,2378	cyclictest	1489445	-21	kworker/0:2+events	00:16:19	0
1391003	99	2390	11,2376	cyclictest	1405698	-21	kworker/3:1+events	19:55:17	3
1390997	99	2390	12,2374	cyclictest	1492836	-21	kworker/1:0+events	00:26:59	1
1390993	99	2390	11,2375	cyclictest	1424863	-21	kworker/0:0+events	20:59:41	0
1391000	99	2388	10,2374	cyclictest	1495711	-21	kworker/2:1+events	00:39:11	2
1390993	99	2381	9,2369	cyclictest	1413848	-21	kworker/0:2+events	20:49:46	0
1390997	99	2378	12,2363	cyclictest	1471715	-21	kworker/1:1+events	23:27:32	1
1390993	99	2370	12,2354	cyclictest	1457105	-21	kworker/0:0+events	22:36:00	0
1390997	99	2367	12,2351	cyclictest	1492836	-21	kworker/1:0+events	00:33:05	1
1390993	99	2367	10,2354	cyclictest	1460421	-21	kworker/0:2+events	22:54:56	0
1391003	99	2365	12,2349	cyclictest	1416758	-21	kworker/3:0+events	20:45:33	3
1390993	99	2365	12,2351	cyclictest	1442735	-21	kworker/0:2+events	22:05:05	0
1390993	99	2360	11,2346	cyclictest	1477994	-21	kworker/0:1+events	23:47:22	0
1391003	99	2356	10,2343	cyclictest	1394561	-21	kworker/3:2+events	19:25:11	3
1391000	99	2354	12,2339	cyclictest	1407362	-21	kworker/2:2+events	20:17:48	2
1391000	99	2351	12,2336	cyclictest	1434041	-21	kworker/2:1+events	21:22:05	2
1391000	99	2349	12,2333	cyclictest	1402144	-21	kworker/2:0+events	19:43:50	2
1390997	99	2349	12,2334	cyclictest	1413646	-21	kworker/1:2+events	20:28:53	1
1391003	99	2347	12,2332	cyclictest	1416758	-21	kworker/3:0+events	21:08:21	3
1390997	99	2342	12,2326	cyclictest	1464092	-21	kworker/1:2+events	23:11:01	1
1390997	99	2342	12,2322	cyclictest	1448982	-21	kworker/1:1+events	22:14:16	1
1391000	99	2341	11,2326	cyclictest	1461928	-21	kworker/2:1+events	22:54:34	2
1391003	99	2340	12,2324	cyclictest	1484536	-21	kworker/3:1+events	00:05:18	3
1391000	99	2340	12,2325	cyclictest	1448894	-21	kworker/2:1+events	22:08:31	2
1391000	99	2339	11,2325	cyclictest	1407362	-21	kworker/2:2+events	19:59:52	2
1391000	99	2338	11,2323	cyclictest	1487844	-21	kworker/2:1+events	00:09:29	2
1391000	99	2338	11,2323	cyclictest	1457194	-21	kworker/2:2+events	22:45:52	2
1390997	99	2338	12,2323	cyclictest	1470118	-21	kworker/1:0+events	23:19:30	1
1390997	99	2338	12,2322	cyclictest	1448982	-21	kworker/1:1+events	22:18:05	1
1391003	99	2337	12,2322	cyclictest	1497286	-21	kworker/3:0+events	00:39:34	3
1391000	99	2336	10,2323	cyclictest	1430826	-21	kworker/2:0+events	21:25:53	2
1390997	99	2336	12,2321	cyclictest	1399097	-21	kworker/1:2+events	19:38:10	1
1390997	99	2335	12,2320	cyclictest	1431091	-21	kworker/1:1+events	21:18:39	1
1391003	99	2334	12,2318	cyclictest	1462045	-21	kworker/3:2+events	23:02:54	3
1390997	99	2331	10,2317	cyclictest	1405520	-21	kworker/1:0+events	19:58:45	1
1391003	99	2330	11,2315	cyclictest	1430858	-21	kworker/3:2+events	21:16:20	3
1391003	99	2329	12,2313	cyclictest	1445871	-21	kworker/3:1+events	22:04:42	3
1391003	99	2329	12,2312	cyclictest	1394561	-21	kworker/3:2+events	20:04:52	3
1391000	99	2329	12,2314	cyclictest	1460067	-21	kworker/2:0+events	22:41:19	2
1391000	99	2329	12,2314	cyclictest	1413404	-21	kworker/2:0+events	20:23:09	2
1391000	99	2329	12,2313	cyclictest	1423155	-21	kworker/2:1+events	20:52:01	2
1390997	99	2329	12,2313	cyclictest	1455505	-21	kworker/1:1+events	22:38:14	1
1391000	99	2328	12,2313	cyclictest	1435808	-21	kworker/2:2+events	22:02:24	2
1391000	99	2328	10,2315	cyclictest	1435808	-21	kworker/2:2+events	21:34:18	2
1391000	99	2328	10,2315	cyclictest	1386004	-21	kworker/2:1+events	19:13:43	2
1391003	99	2327	12,2312	cyclictest	1471486	-21	kworker/3:0+events	23:23:20	3
1391003	99	2327	12,2312	cyclictest	1403833	-21	kworker/3:0+events	19:49:33	3
1391003	99	2327	11,2313	cyclictest	1443802	-21	kworker/3:0+events	22:13:55	3
1391000	99	2327	10,2314	cyclictest	1396036	-21	kworker/2:2+events	19:38:34	2
1390997	99	2327	11,2313	cyclictest	1477724	-21	kworker/1:0+events	23:44:42	1
1391003	99	2326	12,2311	cyclictest	1462045	-21	kworker/3:2+events	23:19:55	3
1390997	99	2326	11,2312	cyclictest	1470118	-21	kworker/1:0+events	23:24:06	1
1391003	99	2325	12,2311	cyclictest	1416758	-21	kworker/3:0+events	20:55:05	3
1391003	99	2325	12,2309	cyclictest	1418418	-21	kworker/3:2+events	20:37:59	3
1391003	99	2324	11,2310	cyclictest	1416758	-21	kworker/3:0+events	21:14:03	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00