OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Fri Apr 24, 2026 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1332859	99	3160	15,3139	cyclictest	1365241	-21	kworker/1:1+events	20:55:17	1
1332864	99	2970	10,2955	cyclictest	1354133	-21	kworker/3:1+events	20:15:21	3
1332861	99	2907	14,2889	cyclictest	1397213	-21	kworker/2:0+events	22:35:18	2
1332854	99	2852	13,2834	cyclictest	1384221	-21	kworker/0:1+events	22:05:11	0
1332854	99	2817	13,2800	cyclictest	1347564	-21	kworker/0:2+events	20:20:18	0
1332854	99	2787	11,2772	cyclictest	1342630	-21	kworker/0:2+events	19:45:00	0
1332859	99	2766	10,2753	cyclictest	1381022	-21	kworker/1:0+events	21:45:00	1
1332859	99	2758	11,2742	cyclictest	1326216	-21	kworker/1:0+events	19:25:11	1
1332861	99	2730	12,2714	cyclictest	1316100	-21	kworker/2:0+events	19:20:01	2
1332859	99	2726	13,2709	cyclictest	1363607	-21	kworker/1:2+events	20:45:19	1
1332861	99	2711	13,2693	cyclictest	1384066	-21	kworker/2:1+events	22:00:13	2
1332864	99	2629	7,2618	cyclictest	1358901	-21	kworker/3:0+events	20:50:14	3
1332864	99	2603	13,2586	cyclictest	1396411	-21	kworker/3:2+events	22:38:42	3
1332864	99	2589	13,2574	cyclictest	1368326	-21	kworker/3:2+events	21:05:13	3
1332854	99	2571	12,2554	cyclictest	1429408	-21	kworker/0:1+events	00:10:21	0
1332864	99	2539	12,2523	cyclictest	1398206	-21	kworker/3:0+events	23:20:11	3
1332854	99	2539	12,2523	cyclictest	1365090	-21	kworker/0:0+events	21:14:37	0
1332854	99	2533	12,2517	cyclictest	1339160	-21	kworker/0:2+events	19:27:28	0
1332854	99	2526	11,2511	cyclictest	1374661	-21	kworker/0:2+events	21:48:49	0
1332854	99	2522	12,2506	cyclictest	1392183	-21	kworker/0:2+events	22:34:33	0
1332854	99	2517	7,2506	cyclictest	1423088	-21	kworker/0:2+events	00:04:38	0
1332859	99	2513	11,2498	cyclictest	1437376	-21	kworker/1:1+events	00:35:18	1
1332864	99	2511	7,2500	cyclictest	1336212	-21	kworker/3:2+events	19:41:10	3
1332864	99	2509	12,2493	cyclictest	1379365	-21	kworker/3:2+events	21:48:27	3
1332864	99	2507	11,2492	cyclictest	1418058	-21	kworker/3:1+events	23:56:43	3
1332864	99	2506	12,2491	cyclictest	1403311	-21	kworker/3:1+events	22:50:58	3
1332859	99	2506	3,2500	cyclictest	1377729	-21	kworker/1:1+events	21:46:32	1
1332864	99	2504	9,2491	cyclictest	1387332	-21	kworker/3:2+events	22:05:33	3
1332859	99	2504	12,2488	cyclictest	1339431	-21	kworker/1:1+events	19:33:36	1
1332861	99	2487	12,2472	cyclictest	1419929	-21	kworker/2:0+events	23:49:24	2
1332861	99	2487	12,2472	cyclictest	1419929	-21	kworker/2:0+events	23:49:24	2
1332859	99	2483	12,2466	cyclictest	1368766	-21	kworker/1:2+events	21:01:00	1
1332859	99	2483	11,2468	cyclictest	1368766	-21	kworker/1:2+events	21:07:05	1
1332859	99	2482	12,2466	cyclictest	1396976	-21	kworker/1:2+events	22:28:51	1
1332854	99	2482	12,2466	cyclictest	1423088	-21	kworker/0:2+events	23:54:48	0
1332854	99	2482	12,2466	cyclictest	1416633	-21	kworker/0:0+events	23:32:02	0
1332859	99	2481	12,2465	cyclictest	1423116	-21	kworker/1:2+events	23:56:21	1
1332854	99	2476	12,2461	cyclictest	1371661	-21	kworker/0:1+events	21:26:24	0
1332854	99	2476	12,2460	cyclictest	1397271	-21	kworker/0:1+events	23:01:30	0
1332859	99	2475	12,2460	cyclictest	1347667	-21	kworker/1:2+events	19:55:57	1
1332854	99	2474	11,2459	cyclictest	1360438	-21	kworker/0:0+events	20:34:37	0
1332861	99	2473	12,2456	cyclictest	1349062	-21	kworker/2:1+events	20:31:37	2
1332864	99	2459	11,2445	cyclictest	1398206	-21	kworker/3:0+events	23:26:13	3
1332859	99	2456	8,2445	cyclictest	1411864	-21	kworker/1:2+events	23:14:03	1
1332854	99	2455	10,2443	cyclictest	1400206	-21	kworker/0:0+events	22:40:13	0
1332859	99	2449	12,2433	cyclictest	1368766	-21	kworker/1:2+events	21:25:14	1
1332861	99	2448	12,2432	cyclictest	1377876	-21	kworker/2:2+events	21:45:24	2
1332864	99	2447	12,2431	cyclictest	1436009	-21	kworker/3:0+events	00:30:18	3
1332861	99	2447	12,2431	cyclictest	1365444	-21	kworker/2:1+events	20:52:58	2
1332861	99	2447	10,2435	cyclictest	1349062	-21	kworker/2:1+events	20:06:35	2
1332854	99	2447	11,2433	cyclictest	1351109	-21	kworker/0:0+events	20:06:13	0
1332854	99	2442	12,2428	cyclictest	1377936	-21	kworker/0:0+events	21:30:09	0
1332854	99	2442	12,2428	cyclictest	1377936	-21	kworker/0:0+events	21:30:09	0
1332864	99	2441	12,2426	cyclictest	1372935	-21	kworker/3:1+events	21:26:01	3
1332854	99	2441	12,2426	cyclictest	1434444	-21	kworker/0:0+events	00:37:34	0
1332854	99	2440	12,2426	cyclictest	1344244	-21	kworker/0:1+events	19:55:11	0
1332864	99	2439	11,2424	cyclictest	1372935	-21	kworker/3:1+events	21:22:10	3
1332854	99	2433	11,2418	cyclictest	1384221	-21	kworker/0:1+events	21:59:49	0
1332854	99	2432	12,2417	cyclictest	1366815	-21	kworker/0:2+events	21:05:35	0
1332854	99	2430	12,2414	cyclictest	1347564	-21	kworker/0:2+events	20:12:42	0
1332854	99	2430	11,2415	cyclictest	1366815	-21	kworker/0:2+events	21:02:30	0
1332859	99	2429	12,2413	cyclictest	1365241	-21	kworker/1:1+events	20:52:12	1
1332854	99	2429	12,2413	cyclictest	1421498	-21	kworker/0:1+events	23:49:02	0
1332854	99	2429	12,2413	cyclictest	1421498	-21	kworker/0:1+events	23:49:02	0
1332854	99	2427	12,2411	cyclictest	1344244	-21	kworker/0:1+events	20:01:42	0
1332864	99	2426	11,2412	cyclictest	1336212	-21	kworker/3:2+events	19:28:37	3
1332864	99	2425	12,2410	cyclictest	1398206	-21	kworker/3:0+events	22:44:02	3
1332864	99	2425	11,2410	cyclictest	1354133	-21	kworker/3:1+events	20:25:12	3
1332854	99	2425	11,2411	cyclictest	1347564	-21	kworker/0:2+events	20:35:47	0
1332864	99	2424	11,2410	cyclictest	1372935	-21	kworker/3:1+events	21:32:47	3
1332864	99	2424	11,2410	cyclictest	1372935	-21	kworker/3:1+events	21:32:46	3
1332864	99	2423	12,2407	cyclictest	1436009	-21	kworker/3:0+events	00:39:05	3
1332854	99	2422	12,2407	cyclictest	1366815	-21	kworker/0:2+events	20:54:32	0
1332864	99	2421	12,2406	cyclictest	1418058	-21	kworker/3:1+events	23:32:26	3
1332864	99	2421	12,2406	cyclictest	1412278	-21	kworker/3:2+events	23:15:35	3
1332864	99	2420	8,2408	cyclictest	1358901	-21	kworker/3:0+events	20:35:23	3
1332861	99	2419	9,2406	cyclictest	1349062	-21	kworker/2:1+events	20:29:20	2
1332854	99	2414	12,2398	cyclictest	1397271	-21	kworker/0:1+events	23:13:19	0
1332864	99	2410	8,2398	cyclictest	1372935	-21	kworker/3:1+events	21:16:53	3
1332861	99	2409	11,2395	cyclictest	1337831	-21	kworker/2:2+events	19:55:33	2
1332854	99	2407	11,2392	cyclictest	1416633	-21	kworker/0:0+events	00:06:10	0
1332859	99	2406	12,2391	cyclictest	1409934	-21	kworker/1:1+events	23:07:33	1
1332864	99	2403	11,2388	cyclictest	1396411	-21	kworker/3:2+events	22:30:19	3
1332864	99	2403	10,2390	cyclictest	1358901	-21	kworker/3:0+events	20:41:55	3
1332859	99	2403	12,2389	cyclictest	1392307	-21	kworker/1:0+events	22:17:01	1
1332859	99	2402	10,2389	cyclictest	1363607	-21	kworker/1:2+events	20:43:26	1
1332854	99	2402	11,2388	cyclictest	1397271	-21	kworker/0:1+events	22:37:12	0
1332859	99	2400	12,2385	cyclictest	1413529	-21	kworker/1:1+events	23:19:49	1
1332859	99	2399	12,2383	cyclictest	1413529	-21	kworker/1:1+events	23:23:11	1
1332859	99	2399	12,2383	cyclictest	1407538	-21	kworker/1:0+events	23:25:50	1
1332859	99	2399	11,2385	cyclictest	1421457	-21	kworker/1:0+events	00:05:24	1
1332859	99	2398	12,2382	cyclictest	1390640	-21	kworker/1:1+events	22:10:33	1
1332859	99	2398	12,2382	cyclictest	1386149	-21	kworker/1:1+events	21:56:02	1
1332859	99	2398	12,2382	cyclictest	1358808	-21	kworker/1:0+events	20:31:14	1
1332859	99	2398	12,2382	cyclictest	1344429	-21	kworker/1:1+events	19:52:08	1
1332861	99	2397	12,2381	cyclictest	1424449	-21	kworker/2:2+events	00:02:22	2
1332859	99	2397	12,2382	cyclictest	1347667	-21	kworker/1:2+events	20:17:15	1
1332859	99	2397	12,2381	cyclictest	1376102	-21	kworker/1:0+events	21:21:48	1
1332859	99	2397	12,2381	cyclictest	1358808	-21	kworker/1:0+events	20:36:10	1
1332859	99	2397	10,2384	cyclictest	1432550	-21	kworker/1:1+events	00:20:57	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00