OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Sep 03, 2026 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
989531	99	3103	15,3082	cyclictest	1023464	-21	kworker/3:0+events	21:05:12	3
989531	99	2907	14,2889	cyclictest	1067147	-21	kworker/3:2+events	23:10:17	3
989525	99	2904	14,2885	cyclictest	1057039	-21	kworker/1:0+events	22:45:12	1
989520	99	2835	13,2818	cyclictest	1018829	-21	kworker/0:0+events	20:45:00	0
989528	99	2779	11,2764	cyclictest	1088018	-21	kworker/2:2+events	00:20:14	2
989528	99	2766	13,2749	cyclictest	1039443	-21	kworker/2:0+events	21:54:01	2
989525	99	2763	13,2745	cyclictest	1029636	-21	kworker/1:2+events	21:25:19	1
989520	99	2758	10,2743	cyclictest	1081486	-21	kworker/0:1+events	23:55:11	0
989520	99	2706	12,2692	cyclictest	996302	-21	kworker/0:2+events	19:35:18	0
989520	99	2678	13,2661	cyclictest	1002727	-21	kworker/0:1+events	19:54:48	0
989531	99	2677	13,2660	cyclictest	1049012	-21	kworker/3:1+events	22:30:11	3
989525	99	2662	11,2647	cyclictest	1006016	-21	kworker/1:2+events	20:05:21	1
989525	99	2655	13,2638	cyclictest	990688	-21	kworker/1:0+events	19:20:14	1
989520	99	2653	11,2638	cyclictest	1068510	-21	kworker/0:0+events	23:15:35	0
989525	99	2652	13,2635	cyclictest	1034702	-21	kworker/1:0+events	21:30:42	1
989528	99	2633	12,2617	cyclictest	1088018	-21	kworker/2:2+events	00:25:15	2
989528	99	2573	11,2558	cyclictest	1060383	-21	kworker/2:2+events	22:50:36	2
989528	99	2572	12,2556	cyclictest	1055214	-21	kworker/2:1+events	23:07:15	2
989528	99	2569	12,2554	cyclictest	1002789	-21	kworker/2:2+events	19:51:44	2
989528	99	2566	9,2553	cyclictest	1050883	-21	kworker/2:2+events	22:27:06	2
989528	99	2566	12,2551	cyclictest	1058744	-21	kworker/2:0+events	22:46:22	2
989528	99	2565	11,2551	cyclictest	1056845	-21	kworker/2:2+events	22:37:26	2
989528	99	2558	10,2544	cyclictest	1020246	-21	kworker/2:2+events	20:57:09	2
989528	99	2557	10,2543	cyclictest	1088018	-21	kworker/2:2+events	00:34:19	2
989528	99	2555	12,2539	cyclictest	1039443	-21	kworker/2:0+events	22:16:09	2
989528	99	2553	12,2537	cyclictest	1074894	-21	kworker/2:2+events	23:38:06	2
989520	99	2553	12,2537	cyclictest	1050469	-21	kworker/0:2+events	22:30:58	0
989528	99	2548	11,2534	cyclictest	1023553	-21	kworker/2:1+events	21:12:02	2
989528	99	2547	11,2533	cyclictest	1020246	-21	kworker/2:2+events	20:50:19	2
989528	99	2542	12,2526	cyclictest	1079837	-21	kworker/2:2+events	23:53:19	2
989531	99	2541	9,2529	cyclictest	1091368	-21	kworker/3:2+events	00:37:49	3
989528	99	2539	12,2523	cyclictest	1006000	-21	kworker/2:2+events	20:02:24	2
989520	99	2531	11,2516	cyclictest	1007608	-21	kworker/0:0+events	20:06:51	0
989528	99	2529	12,2513	cyclictest	1034766	-21	kworker/2:1+events	21:38:42	2
989525	99	2518	13,2501	cyclictest	1084496	-21	kworker/1:0+events	00:34:43	1
989528	99	2515	12,2499	cyclictest	1028179	-21	kworker/2:0+events	21:21:55	2
989528	99	2511	10,2498	cyclictest	1010895	-21	kworker/2:0+events	20:25:52	2
989528	99	2498	12,2482	cyclictest	1014173	-21	kworker/2:2+events	20:34:44	2
989525	99	2497	10,2483	cyclictest	1014123	-21	kworker/1:0+events	20:34:21	1
989528	99	2496	12,2480	cyclictest	1020246	-21	kworker/2:2+events	21:02:57	2
989528	99	2496	12,2480	cyclictest	1002789	-21	kworker/2:2+events	19:47:53	2
989528	99	2496	11,2482	cyclictest	1066970	-21	kworker/2:0+events	23:11:24	2
989528	99	2494	12,2480	cyclictest	994501	-21	kworker/2:0+events	19:25:05	2
989528	99	2492	12,2476	cyclictest	991922	-21	kworker/2:2+events	19:31:50	2
989528	99	2491	12,2475	cyclictest	1028179	-21	kworker/2:0+events	21:34:30	2
989520	99	2491	11,2477	cyclictest	993023	-21	kworker/0:0+events	19:28:28	0
989528	99	2490	12,2475	cyclictest	1050883	-21	kworker/2:2+events	22:23:16	2
989528	99	2490	12,2474	cyclictest	1052694	-21	kworker/2:0+events	22:33:13	2
989528	99	2490	12,2474	cyclictest	1039443	-21	kworker/2:0+events	21:46:41	2
989528	99	2490	12,2474	cyclictest	1018531	-21	kworker/2:1+events	20:37:01	2
989528	99	2490	10,2476	cyclictest	994501	-21	kworker/2:0+events	19:21:21	2
989528	99	2488	12,2472	cyclictest	1009268	-21	kworker/2:2+events	20:14:25	2
989528	99	2488	11,2473	cyclictest	1039443	-21	kworker/2:0+events	21:43:37	2
989528	99	2487	12,2471	cyclictest	1088018	-21	kworker/2:2+events	00:13:23	2
989528	99	2485	11,2471	cyclictest	1028179	-21	kworker/2:0+events	21:08:14	2
989528	99	2484	10,2471	cyclictest	1055214	-21	kworker/2:1+events	22:55:12	2
989528	99	2478	11,2464	cyclictest	1083570	-21	kworker/2:3+events	00:00:30	2
989528	99	2474	13,2458	cyclictest	1063753	-21	kworker/2:2+events	23:03:28	2
989528	99	2474	12,2458	cyclictest	1047531	-21	kworker/2:2+events	22:08:53	2
989525	99	2473	11,2458	cyclictest	1042561	-21	kworker/1:0+events	21:56:18	1
989528	99	2460	11,2445	cyclictest	1089669	-21	kworker/2:1+events	00:19:07	2
989531	99	2457	2,2452	cyclictest	1086521	-21	kworker/3:1+events	00:12:36	3
989520	99	2455	12,2439	cyclictest	1079870	-21	kworker/0:0+events	00:03:58	0
989528	99	2449	10,2435	cyclictest	1045930	-21	kworker/2:1+events	22:04:20	2
989525	99	2449	9,2436	cyclictest	994784	-21	kworker/1:1+events	19:33:00	1
989528	99	2448	12,2432	cyclictest	1068601	-21	kworker/2:2+events	23:18:55	2
989525	99	2437	10,2423	cyclictest	1025189	-21	kworker/1:0+events	21:14:42	1
989520	99	2437	11,2422	cyclictest	1062141	-21	kworker/0:2+events	23:32:44	0
989531	99	2436	12,2420	cyclictest	997696	-21	kworker/3:2+events	19:36:03	3
989520	99	2436	12,2421	cyclictest	1062141	-21	kworker/0:2+events	22:58:58	0
989520	99	2436	12,2421	cyclictest	1037733	-21	kworker/0:2+events	21:44:23	0
989520	99	2436	12,2420	cyclictest	993023	-21	kworker/0:0+events	19:24:43	0
989531	99	2433	12,2418	cyclictest	1057031	-21	kworker/3:1+events	22:52:33	3
989525	99	2433	12,2418	cyclictest	1020190	-21	kworker/1:0+events	20:43:08	1
989531	99	2431	12,2415	cyclictest	997696	-21	kworker/3:2+events	20:01:14	3
989525	99	2428	12,2413	cyclictest	1004391	-21	kworker/1:1+events	20:15:33	1
989531	99	2427	12,2411	cyclictest	1053635	-21	kworker/3:0+events	22:36:40	3
989531	99	2427	12,2411	cyclictest	1042831	-21	kworker/3:2+events	22:06:14	3
989525	99	2426	10,2412	cyclictest	1050625	-21	kworker/1:2+events	22:55:37	1
989531	99	2425	12,2409	cyclictest	997696	-21	kworker/3:2+events	20:13:40	3
989531	99	2425	12,2409	cyclictest	1026670	-21	kworker/3:1+events	21:13:58	3
989525	99	2425	10,2411	cyclictest	1088035	-21	kworker/1:1+events	00:15:20	1
989531	99	2424	12,2409	cyclictest	989173	-21	kworker/3:1+events	19:30:21	3
989531	99	2424	12,2408	cyclictest	1041197	-21	kworker/3:1+events	21:52:05	3
989520	99	2424	10,2411	cyclictest	1045899	-21	kworker/0:2+events	22:06:36	0
989520	99	2422	12,2407	cyclictest	1028357	-21	kworker/0:2+events	21:31:27	0
989520	99	2422	10,2408	cyclictest	1001122	-21	kworker/0:0+events	19:46:20	0
989520	99	2421	12,2405	cyclictest	1079870	-21	kworker/0:0+events	00:07:19	0
989528	99	2420	11,2405	cyclictest	989535	-21	kworker/2:1+events	19:15:15	2
989531	99	2418	12,2403	cyclictest	1088152	-21	kworker/3:0+events	00:17:13	3
989525	99	2418	12,2402	cyclictest	1084496	-21	kworker/1:0+events	00:13:47	1
989520	99	2415	12,2400	cyclictest	1037733	-21	kworker/0:2+events	21:46:18	0
989520	99	2414	12,2399	cyclictest	1062141	-21	kworker/0:2+events	23:00:49	0
989520	99	2413	12,2397	cyclictest	1060537	-21	kworker/0:1+events	22:50:14	0
989531	99	2411	12,2396	cyclictest	993175	-21	kworker/3:2+events	19:23:57	3
989525	99	2409	12,2395	cyclictest	1014123	-21	kworker/1:0+events	20:25:04	1
989525	99	2409	12,2393	cyclictest	1065274	-21	kworker/1:0+events	23:06:52	1
989525	99	2408	12,2392	cyclictest	1086432	-21	kworker/1:2+events	00:08:49	1
989531	99	2407	12,2391	cyclictest	1053635	-21	kworker/3:0+events	22:28:17	3
989520	99	2407	10,2394	cyclictest	1037733	-21	kworker/0:2+events	21:50:33	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00