OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Mon Apr 20, 2026 00:44:18)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3608953	99	3407	16,3387	cyclictest	3627070	-21	kworker/3:1+events	20:05:12	3
3608947	99	3216	14,3197	cyclictest	3641348	-21	kworker/1:1+events	20:50:18	1
3608947	99	3003	8,2991	cyclictest	3712230	-21	kworker/1:1+events	00:30:17	1
3608947	99	2810	8,2799	cyclictest	3631787	-21	kworker/1:0+events	20:20:18	1
3608953	99	2798	13,2779	cyclictest	3633137	-21	kworker/3:0+events	20:30:15	3
3608953	99	2714	12,2700	cyclictest	3666642	-21	kworker/3:0+events	22:10:01	3
3608951	99	2624	12,2608	cyclictest	3700598	-21	kworker/2:1+events	00:15:21	2
3608951	99	2605	15,2587	cyclictest	3669880	-21	kworker/2:2+events	22:20:15	2
3608953	99	2599	12,2583	cyclictest	3692779	-21	kworker/3:2+events	23:55:12	3
3608953	99	2537	12,2521	cyclictest	3612467	-21	kworker/3:1+events	19:38:22	3
3608947	99	2537	12,2521	cyclictest	3641348	-21	kworker/1:1+events	20:58:56	1
3608942	99	2535	11,2520	cyclictest	3625656	-21	kworker/0:2+events	20:01:03	0
3608947	99	2533	10,2521	cyclictest	3623634	-21	kworker/1:1+events	19:55:22	1
3608947	99	2532	6,2522	cyclictest	3684330	-21	kworker/1:2+events	23:10:52	1
3608953	99	2530	12,2514	cyclictest	3650841	-21	kworker/3:1+events	21:40:46	3
3608947	99	2522	11,2507	cyclictest	3647381	-21	kworker/1:1+events	21:13:09	1
3608947	99	2522	11,2507	cyclictest	3647381	-21	kworker/1:1+events	21:13:08	1
3608942	99	2519	13,2502	cyclictest	3639748	-21	kworker/0:1+events	20:45:01	0
3608951	99	2512	12,2496	cyclictest	3663499	-21	kworker/2:0+events	22:30:14	2
3608951	99	2498	12,2482	cyclictest	3678171	-21	kworker/2:1+events	23:27:57	2
3608951	99	2498	12,2482	cyclictest	3678171	-21	kworker/2:1+events	23:27:56	2
3608947	99	2498	12,2482	cyclictest	3678614	-21	kworker/1:1+events	22:57:52	1
3608951	99	2496	12,2480	cyclictest	3691238	-21	kworker/2:2+events	23:55:54	2
3608951	99	2496	12,2480	cyclictest	3678171	-21	kworker/2:1+events	23:07:50	2
3608951	99	2496	12,2480	cyclictest	3654199	-21	kworker/2:1+events	21:34:20	2
3608953	99	2494	12,2478	cyclictest	3703921	-21	kworker/3:2+events	00:06:11	3
3608951	99	2493	12,2477	cyclictest	3695744	-21	kworker/2:1+events	23:38:10	2
3608953	99	2492	12,2476	cyclictest	3681432	-21	kworker/3:0+events	22:58:17	3
3608951	99	2489	12,2474	cyclictest	3615889	-21	kworker/2:2+events	19:56:52	2
3608953	99	2488	12,2473	cyclictest	3708694	-21	kworker/3:1+events	00:19:51	3
3608951	99	2487	12,2471	cyclictest	3713837	-21	kworker/2:1+events	00:38:19	2
3608953	99	2485	11,2470	cyclictest	3645905	-21	kworker/3:1+events	21:12:46	3
3608953	99	2485	11,2470	cyclictest	3645905	-21	kworker/3:1+events	21:12:45	3
3608951	99	2485	12,2470	cyclictest	3707419	-21	kworker/2:2+events	00:26:27	2
3608953	99	2484	12,2469	cyclictest	3650841	-21	kworker/3:1+events	21:52:50	3
3608951	99	2484	6,2475	cyclictest	3663499	-21	kworker/2:0+events	22:26:47	2
3608951	99	2484	12,2468	cyclictest	3644191	-21	kworker/2:0+events	21:22:16	2
3608947	99	2484	12,2468	cyclictest	3625243	-21	kworker/1:2+events	20:07:50	1
3608953	99	2483	12,2469	cyclictest	3650841	-21	kworker/3:1+events	21:25:11	3
3608947	99	2483	12,2467	cyclictest	3644616	-21	kworker/1:2+events	21:00:51	1
3608951	99	2481	11,2467	cyclictest	3622211	-21	kworker/2:1+events	19:48:52	2
3608953	99	2480	12,2464	cyclictest	3639862	-21	kworker/3:2+events	20:46:08	3
3608953	99	2477	12,2463	cyclictest	3636389	-21	kworker/3:1+events	20:35:06	3
3608953	99	2477	12,2461	cyclictest	3612467	-21	kworker/3:1+events	19:34:56	3
3608951	99	2477	11,2462	cyclictest	3627129	-21	kworker/2:0+events	20:12:48	2
3608953	99	2476	11,2461	cyclictest	3689466	-21	kworker/3:2+events	23:18:30	3
3608951	99	2473	11,2458	cyclictest	3700598	-21	kworker/2:1+events	00:00:23	2
3608953	99	2471	12,2455	cyclictest	3644282	-21	kworker/3:2+events	21:02:01	3
3608953	99	2469	12,2453	cyclictest	3633137	-21	kworker/3:0+events	20:27:56	3
3608947	99	2469	9,2456	cyclictest	3697283	-21	kworker/1:1+events	23:59:15	1
3608953	99	2468	10,2454	cyclictest	3666642	-21	kworker/3:0+events	22:25:13	3
3608953	99	2463	12,2448	cyclictest	3619495	-21	kworker/3:0+events	19:40:59	3
3608953	99	2463	11,2448	cyclictest	3638127	-21	kworker/3:0+events	20:41:58	3
3608942	99	2463	12,2448	cyclictest	3694205	-21	kworker/0:1+events	23:50:16	0
3608953	99	2462	12,2448	cyclictest	3602119	-21	kworker/3:2+events	19:20:09	3
3608953	99	2458	12,2443	cyclictest	3644282	-21	kworker/3:2+events	21:06:57	3
3608953	99	2457	12,2442	cyclictest	3679712	-21	kworker/3:1+events	22:52:16	3
3608951	99	2456	10,2443	cyclictest	3638066	-21	kworker/2:1+events	20:39:18	2
3608953	99	2455	12,2441	cyclictest	3681432	-21	kworker/3:0+events	23:00:10	3
3608953	99	2455	12,2440	cyclictest	3647598	-21	kworker/3:0+events	21:15:50	3
3608953	99	2454	12,2439	cyclictest	3650841	-21	kworker/3:1+events	21:30:28	3
3608953	99	2449	11,2435	cyclictest	3647598	-21	kworker/3:0+events	21:21:31	3
3608947	99	2449	12,2433	cyclictest	3615810	-21	kworker/1:1+events	19:44:44	1
3608953	99	2447	12,2432	cyclictest	3681432	-21	kworker/3:0+events	23:29:28	3
3608953	99	2447	12,2432	cyclictest	3681432	-21	kworker/3:0+events	23:29:27	3
3608953	99	2447	12,2432	cyclictest	3650841	-21	kworker/3:1+events	21:58:33	3
3608947	99	2447	12,2432	cyclictest	3697283	-21	kworker/1:1+events	23:51:26	1
3608947	99	2447	12,2432	cyclictest	3658762	-21	kworker/1:0+events	21:41:52	1
3608947	99	2447	10,2434	cyclictest	3605357	-21	kworker/1:2+events	19:25:11	1
3608953	99	2446	12,2433	cyclictest	3650841	-21	kworker/3:1+events	22:13:05	3
3608947	99	2446	12,2431	cyclictest	3692807	-21	kworker/1:1+events	23:30:13	1
3608947	99	2446	12,2431	cyclictest	3634739	-21	kworker/1:2+events	20:27:33	1
3608947	99	2446	12,2430	cyclictest	3626980	-21	kworker/1:1+events	20:12:27	1
3608947	99	2446	11,2431	cyclictest	3712230	-21	kworker/1:1+events	00:28:45	1
3608947	99	2445	12,2430	cyclictest	3704639	-21	kworker/1:2+events	00:22:11	1
3608947	99	2445	11,2431	cyclictest	3634739	-21	kworker/1:2+events	20:30:58	1
3608947	99	2444	12,2429	cyclictest	3658762	-21	kworker/1:0+events	21:49:26	1
3608947	99	2444	11,2429	cyclictest	3638004	-21	kworker/1:2+events	20:40:51	1
3608947	99	2444	10,2431	cyclictest	3638004	-21	kworker/1:2+events	20:37:47	1
3608947	99	2442	12,2426	cyclictest	3662079	-21	kworker/1:1+events	21:54:22	1
3608947	99	2442	12,2426	cyclictest	3647381	-21	kworker/1:1+events	21:06:33	1
3608947	99	2441	12,2425	cyclictest	3687891	-21	kworker/1:0+events	23:20:20	1
3608947	99	2440	12,2425	cyclictest	3619202	-21	kworker/1:2+events	19:49:39	1
3608947	99	2440	12,2424	cyclictest	3649146	-21	kworker/1:0+events	21:28:59	1
3608947	99	2439	12,2424	cyclictest	3695655	-21	kworker/1:0+events	23:38:33	1
3608942	99	2436	9,2423	cyclictest	3647536	-21	kworker/0:0+events	21:10:52	0
3608942	99	2436	9,2423	cyclictest	3647536	-21	kworker/0:0+events	21:10:52	0
3608947	99	2434	12,2418	cyclictest	3687891	-21	kworker/1:0+events	23:27:35	1
3608947	99	2434	12,2418	cyclictest	3687891	-21	kworker/1:0+events	23:27:35	1
3608947	99	2434	11,2421	cyclictest	3625243	-21	kworker/1:2+events	20:15:02	1
3608953	99	2431	9,2418	cyclictest	3655168	-21	kworker/3:0+events	21:39:34	3
3608953	99	2429	12,2414	cyclictest	3712079	-21	kworker/3:2+events	00:32:35	3
3608947	99	2429	11,2414	cyclictest	3678614	-21	kworker/1:1+events	22:48:01	1
3608942	99	2426	12,2411	cyclictest	3639748	-21	kworker/0:1+events	20:55:15	0
3608951	99	2424	10,2411	cyclictest	3663499	-21	kworker/2:0+events	22:16:52	2
3608947	99	2423	11,2408	cyclictest	3702250	-21	kworker/1:0+events	00:03:52	1
3608942	99	2423	11,2409	cyclictest	3689776	-21	kworker/0:2+events	23:25:20	0
3608942	99	2423	11,2409	cyclictest	3689776	-21	kworker/0:2+events	23:25:20	0
3608942	99	2422	12,2406	cyclictest	3633201	-21	kworker/0:0+events	20:23:22	0
3608953	99	2419	8,2407	cyclictest	3619495	-21	kworker/3:0+events	19:54:14	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00