OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Sun May 03, 2026 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1386239	99	3186	12,3169	cyclictest	1391378	-21	kworker/0:2+events	20:35:14	0
1386249	99	3041	14,3022	cyclictest	1394392	-21	kworker/3:2+events	19:35:12	3
1386239	99	2852	14,2833	cyclictest	1435193	-21	kworker/0:2+events	21:45:12	0
1386239	99	2815	0,2811	cyclictest	1391378	-21	kworker/0:2+events	19:30:16	0
1386239	99	2804	13,2787	cyclictest	1460902	-21	kworker/0:2+events	23:02:11	0
1386239	99	2796	12,2780	cyclictest	1479656	-21	kworker/0:2+events	00:17:05	0
1386249	99	2766	12,2750	cyclictest	1447820	-21	kworker/3:0+events	22:19:47	3
1386239	99	2764	12,2748	cyclictest	1456119	-21	kworker/0:1+events	22:48:49	0
1386249	99	2719	13,2702	cyclictest	1396025	-21	kworker/3:0+events	19:41:59	3
1386245	99	2712	10,2700	cyclictest	1435317	-21	kworker/2:2+events	21:40:12	2
1386239	99	2710	13,2692	cyclictest	1425517	-21	kworker/0:0+events	21:15:13	0
1386239	99	2709	12,2693	cyclictest	1391378	-21	kworker/0:2+events	19:50:49	0
1386239	99	2684	13,2668	cyclictest	1402413	-21	kworker/0:0+events	20:00:18	0
1386245	99	2677	13,2661	cyclictest	1455999	-21	kworker/2:0+events	22:43:04	2
1386249	99	2676	13,2659	cyclictest	1455217	-21	kworker/3:2+events	22:41:09	3
1386239	99	2676	13,2661	cyclictest	1479656	-21	kworker/0:2+events	00:10:14	0
1386249	99	2673	13,2658	cyclictest	1447820	-21	kworker/3:0+events	22:45:02	3
1386245	99	2664	12,2649	cyclictest	1470348	-21	kworker/2:2+events	23:39:05	2
1386245	99	2662	12,2646	cyclictest	1444559	-21	kworker/2:1+events	22:19:26	2
1386249	99	2661	12,2645	cyclictest	1435256	-21	kworker/3:1+events	21:47:09	3
1386249	99	2661	10,2647	cyclictest	1435256	-21	kworker/3:1+events	21:58:39	3
1386239	99	2654	12,2639	cyclictest	1430417	-21	kworker/0:1+events	21:36:45	0
1386249	99	2649	13,2632	cyclictest	1449503	-21	kworker/3:1+events	22:25:29	3
1386245	99	2649	13,2632	cyclictest	1418751	-21	kworker/2:0+events	20:47:22	2
1386245	99	2643	13,2626	cyclictest	1438589	-21	kworker/2:3+events	21:58:14	2
1386245	99	2619	10,2604	cyclictest	1388603	-21	kworker/2:0+events	19:20:21	2
1386249	99	2617	13,2601	cyclictest	1402594	-21	kworker/3:2+events	20:06:44	3
1386245	99	2596	12,2581	cyclictest	1450867	-21	kworker/2:1+events	22:28:10	2
1386239	99	2577	12,2561	cyclictest	1471922	-21	kworker/0:1+events	23:38:19	0
1386249	99	2575	12,2559	cyclictest	1400932	-21	kworker/3:0+events	19:57:18	3
1386239	99	2574	12,2558	cyclictest	1481317	-21	kworker/0:1+events	00:06:23	0
1386239	99	2573	12,2557	cyclictest	1391378	-21	kworker/0:2+events	20:26:23	0
1386239	99	2570	12,2556	cyclictest	1408986	-21	kworker/0:0+events	20:21:06	0
1386239	99	2570	12,2554	cyclictest	1420451	-21	kworker/0:2+events	21:06:10	0
1386239	99	2570	11,2555	cyclictest	1418843	-21	kworker/0:0+events	20:48:54	0
1386239	99	2566	13,2549	cyclictest	1444684	-21	kworker/0:2+events	22:09:40	0
1386245	99	2564	9,2551	cyclictest	1430230	-21	kworker/2:0+events	21:36:22	2
1386245	99	2562	12,2546	cyclictest	1452732	-21	kworker/2:2+events	22:37:20	2
1386245	99	2561	12,2546	cyclictest	1426907	-21	kworker/2:0+events	21:14:26	2
1386239	99	2561	12,2546	cyclictest	1478014	-21	kworker/0:0+events	23:50:53	0
1386239	99	2560	12,2546	cyclictest	1418843	-21	kworker/0:0+events	21:00:02	0
1386239	99	2559	12,2544	cyclictest	1433556	-21	kworker/0:0+events	21:42:30	0
1386239	99	2559	11,2544	cyclictest	1448093	-21	kworker/0:3+events	22:34:38	0
1386239	99	2553	12,2537	cyclictest	1479656	-21	kworker/0:2+events	00:21:10	0
1386239	99	2553	12,2537	cyclictest	1447941	-21	kworker/0:0+events	22:23:57	0
1386239	99	2544	12,2528	cyclictest	1450929	-21	kworker/0:1+events	22:29:19	0
1386249	99	2540	13,2523	cyclictest	1472077	-21	kworker/3:3+events	23:38:42	3
1386239	99	2539	9,2526	cyclictest	1425517	-21	kworker/0:0+events	21:24:01	0
1386249	99	2535	11,2520	cyclictest	1404240	-21	kworker/3:0+events	20:15:27	3
1386245	99	2533	12,2517	cyclictest	1442965	-21	kworker/2:0+events	22:03:07	2
1386245	99	2521	12,2505	cyclictest	1402735	-21	kworker/2:3+events	20:41:19	2
1386249	99	2519	11,2504	cyclictest	1435256	-21	kworker/3:1+events	21:44:48	3
1386239	99	2512	12,2496	cyclictest	1473559	-21	kworker/0:2+events	23:43:19	0
1386245	99	2510	12,2494	cyclictest	1435317	-21	kworker/2:2+events	21:52:55	2
1386249	99	2509	11,2495	cyclictest	1447820	-21	kworker/3:0+events	22:23:33	3
1386245	99	2505	11,2488	cyclictest	1422347	-21	kworker/2:2+events	21:03:52	2
1386241	99	2504	11,2490	cyclictest	1486418	-21	kworker/1:0+events	00:26:29	1
1386245	99	2500	11,2485	cyclictest	1478932	-21	kworker/2:0+events	00:00:41	2
1386249	99	2499	10,2484	cyclictest	1387372	-21	kworker/3:0+events	19:24:56	3
1386239	99	2494	12,2479	cyclictest	1448093	-21	kworker/0:3+events	22:40:46	0
1386239	99	2494	12,2479	cyclictest	1405728	-21	kworker/0:0+events	20:13:37	0
1386239	99	2493	12,2477	cyclictest	1459297	-21	kworker/0:0+events	23:05:13	0
1386239	99	2492	11,2477	cyclictest	1479656	-21	kworker/0:2+events	23:57:18	0
1386245	99	2488	12,2474	cyclictest	1397877	-21	kworker/2:2+events	19:45:05	2
1386239	99	2487	12,2472	cyclictest	1448093	-21	kworker/0:3+events	22:36:58	0
1386239	99	2487	11,2472	cyclictest	1459297	-21	kworker/0:0+events	23:26:52	0
1386239	99	2485	12,2470	cyclictest	1459297	-21	kworker/0:0+events	22:56:53	0
1386239	99	2484	12,2469	cyclictest	1444684	-21	kworker/0:2+events	22:18:15	0
1386239	99	2484	12,2468	cyclictest	1443021	-21	kworker/0:0+events	22:02:00	0
1386239	99	2484	10,2470	cyclictest	1488108	-21	kworker/0:1+events	00:28:43	0
1386249	99	2482	10,2468	cyclictest	1446192	-21	kworker/3:1+events	22:14:08	3
1386239	99	2481	12,2466	cyclictest	1446340	-21	kworker/0:1+events	22:14:30	0
1386239	99	2481	11,2467	cyclictest	1418843	-21	kworker/0:0+events	20:51:36	0
1386239	99	2481	10,2468	cyclictest	1391378	-21	kworker/0:2+events	19:26:49	0
1386239	99	2478	12,2463	cyclictest	1476428	-21	kworker/0:1+events	23:46:19	0
1386239	99	2477	12,2462	cyclictest	1391378	-21	kworker/0:2+events	20:19:58	0
1386239	99	2477	12,2461	cyclictest	1456119	-21	kworker/0:1+events	22:54:10	0
1386239	99	2475	12,2460	cyclictest	1391378	-21	kworker/0:2+events	20:40:32	0
1386239	99	2474	12,2459	cyclictest	1433556	-21	kworker/0:0+events	21:34:27	0
1386239	99	2474	12,2459	cyclictest	1399240	-21	kworker/0:1+events	19:48:56	0
1386245	99	2468	12,2452	cyclictest	1476783	-21	kworker/2:1+events	23:53:56	2
1386249	99	2463	11,2448	cyclictest	1464037	-21	kworker/3:1+events	23:10:33	3
1386245	99	2463	11,2449	cyclictest	1396201	-21	kworker/2:1+events	19:40:51	2
1386249	99	2461	10,2447	cyclictest	1462346	-21	kworker/3:2+events	23:07:06	3
1386245	99	2461	11,2447	cyclictest	1430230	-21	kworker/2:0+events	21:30:14	2
1386239	99	2459	12,2444	cyclictest	1436850	-21	kworker/0:1+events	21:51:24	0
1386239	99	2454	12,2440	cyclictest	1423914	-21	kworker/0:1+events	21:10:18	0
1386245	99	2447	7,2437	cyclictest	1375011	-21	kworker/2:1+events	19:30:40	2
1386245	99	2447	10,2434	cyclictest	1438589	-21	kworker/2:3+events	22:06:11	2
1386245	99	2446	12,2430	cyclictest	1420421	-21	kworker/2:1+events	20:54:20	2
1386245	99	2444	12,2429	cyclictest	1405547	-21	kworker/2:0+events	20:09:23	2
1386245	99	2443	10,2429	cyclictest	1462592	-21	kworker/2:1+events	23:06:43	2
1386245	99	2440	12,2424	cyclictest	1475157	-21	kworker/2:0+events	23:45:13	2
1386245	99	2440	12,2424	cyclictest	1402735	-21	kworker/2:3+events	20:35:36	2
1386249	99	2439	10,2425	cyclictest	1459087	-21	kworker/3:0+events	22:55:19	3
1386249	99	2438	7,2427	cyclictest	1420496	-21	kworker/3:1+events	21:09:31	3
1386245	99	2438	5,2429	cyclictest	1394572	-21	kworker/2:2+events	19:35:59	2
1386245	99	2438	11,2424	cyclictest	1402735	-21	kworker/2:3+events	20:30:38	2
1386245	99	2438	11,2423	cyclictest	1452732	-21	kworker/2:2+events	22:32:19	2
1386249	99	2436	6,2427	cyclictest	1413782	-21	kworker/3:1+events	20:40:09	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00