OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Sat Jul 18, 2026 12:43:29)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2328308	2	55	20,30	sleep7	0	-21	swapper/7	07:08:26	7
2328184	2	46	36,7	sleep5	0	-21	swapper/5	07:06:39	5
2328307	2	32	21,8	sleep6	0	-21	swapper/6	07:08:25	6
2328687	99	30	28,2	cyclictest	2920174	-21	kworker/u16:0+events_unbound	12:05:10	6
2328693	99	29	13,14	cyclictest	3068283	-21	ssh	12:30:05	7
2328683	99	29	24,4	cyclictest	2351775	-21	pool-gnome-soft	07:18:33	5
2328681	99	29	25,3	cyclictest	2381516	-21	kworker/u16:4+events_unbound	07:34:56	4
2969971	2	28	0,1	chrt	2969941	-21	ssh	11:50:07	7
2328683	99	28	26,2	cyclictest	2995604	-21	kworker/u16:2+events_unbound	12:14:49	5
2328693	99	27	26,0	cyclictest	0	-21	swapper/7	08:15:11	7
2328693	99	26	25,0	cyclictest	0	-21	swapper/7	10:05:14	7
2328687	99	26	24,2	cyclictest	2751247	-21	kworker/u16:5+events_unbound	12:29:55	6
2328683	99	26	24,2	cyclictest	2429468	-21	kworker/u16:2+flush-8:0	08:35:07	5
2328687	99	25	23,2	cyclictest	2488452	-21	kworker/u16:4+flush-8:0	09:15:10	6
2328687	99	25	23,2	cyclictest	2488452	-21	kworker/u16:4+flush-8:0	09:15:10	6
2328687	99	25	22,3	cyclictest	2785754	-21	kworker/u16:1+flush-8:0	11:19:58	6
2328687	99	25	22,3	cyclictest	2785754	-21	kworker/u16:1+flush-8:0	11:19:58	6
2328210	2	25	13,8	sleep4	0	-21	swapper/4	07:07:02	4
2328687	99	24	22,2	cyclictest	2429468	-21	kworker/u16:2+flush-8:0	09:19:48	6
2328687	99	24	20,3	cyclictest	2429468	-21	kworker/u16:2+events_unbound	09:05:07	6
2328693	99	23	22,0	cyclictest	0	-21	swapper/7	09:55:24	7
2328693	99	23	21,1	cyclictest	0	-21	swapper/7	08:30:07	7
2328693	99	23	20,1	cyclictest	0	-21	swapper/7	10:40:06	7
2328693	99	23	0,21	cyclictest	2351778	-21	packagekitd	07:18:54	7
2328683	99	23	21,2	cyclictest	2995604	-21	kworker/u16:2+flush-8:0	12:10:12	5
2328683	99	23	21,2	cyclictest	2920174	-21	kworker/u16:0+events_unbound	11:55:10	5
2328683	99	23	21,2	cyclictest	2574979	-21	kworker/u16:1+flush-8:0	10:14:52	5
2328683	99	23	21,2	cyclictest	2429468	-21	kworker/u16:2+flush-8:0	08:20:08	5
2328683	99	23	21,2	cyclictest	2429468	-21	kworker/u16:2+events_unbound	08:30:12	5
2328693	99	22	21,0	cyclictest	0	-21	swapper/7	12:19:58	7
2328693	99	22	21,0	cyclictest	0	-21	swapper/7	11:09:48	7
2328687	99	22	20,2	cyclictest	2574979	-21	kworker/u16:1+flush-8:0	09:10:22	6
2328687	99	22	19,2	cyclictest	2625372	-21	kworker/u16:0+flush-8:0	09:44:42	6
2328683	99	22	20,2	cyclictest	2887194	-21	kworker/u16:2+flush-8:0	11:40:07	5
2328683	99	22	20,2	cyclictest	2488452	-21	kworker/u16:4+events_unbound	11:10:17	5
2328681	99	22	19,2	cyclictest	2429468	-21	kworker/u16:2+flush-8:0	09:29:53	4
2328693	99	21	20,0	cyclictest	0	-21	swapper/7	09:15:24	7
2328693	99	21	20,0	cyclictest	0	-21	swapper/7	09:15:24	7
2328693	99	21	14,6	cyclictest	648	-21	systemd-journal	11:49:41	7
2328683	99	21	19,2	cyclictest	2488452	-21	kworker/u16:4+events_unbound	10:00:10	5
2328683	99	21	19,2	cyclictest	2429468	-21	kworker/u16:2+events_unbound	09:15:19	5
2328683	99	21	19,2	cyclictest	2429468	-21	kworker/u16:2+events_unbound	09:15:19	5
2328683	99	21	19,2	cyclictest	2400502	-21	kworker/u16:1+events_unbound	07:44:38	5
2328693	99	20	19,0	cyclictest	0	-21	swapper/7	12:09:59	7
2328693	99	20	14,5	cyclictest	648	-21	systemd-journal	09:09:41	7
2328687	99	20	18,2	cyclictest	3056475	-21	kworker/u16:0+events_unbound	12:37:11	6
2328687	99	20	18,2	cyclictest	2625372	-21	kworker/u16:0+flush-8:0	10:25:15	6
2328683	99	20	18,2	cyclictest	2887194	-21	kworker/u16:2+flush-8:0	11:29:47	5
2328683	99	20	18,2	cyclictest	2887194	-21	kworker/u16:2+events_unbound	11:37:51	5
2328683	99	20	18,2	cyclictest	2810424	-21	kworker/u16:2+flush-8:0	10:55:22	5
2328683	99	20	18,2	cyclictest	2785754	-21	kworker/u16:1+events_unbound	10:50:23	5
2328683	99	20	18,2	cyclictest	2488452	-21	kworker/u16:4+flush-8:0	10:45:17	5
2328683	99	20	18,2	cyclictest	2488452	-21	kworker/u16:4+flush-8:0	10:44:36	5
2328683	99	20	18,2	cyclictest	2400502	-21	kworker/u16:1+events_unbound	08:28:54	5
2328683	99	20	18,2	cyclictest	2371449	-21	kworker/u16:0+events_unbound	07:51:11	5
2328693	99	19	18,0	cyclictest	0	-21	swapper/7	11:14:59	7
2328693	99	19	17,1	cyclictest	0	-21	swapper/7	07:44:42	7
2328687	99	19	17,2	cyclictest	2920174	-21	kworker/u16:0+events_unbound	11:34:55	6
2328683	99	19	17,2	cyclictest	2751247	-21	kworker/u16:5+flush-8:0	12:28:55	5
2328683	99	19	17,2	cyclictest	2751247	-21	kworker/u16:5+flush-8:0	10:59:57	5
2328683	99	19	17,2	cyclictest	2625372	-21	kworker/u16:0+flush-8:0	09:40:06	5
2328683	99	19	17,2	cyclictest	2488452	-21	kworker/u16:4+flush-8:0	11:25:16	5
2328683	99	19	17,2	cyclictest	2488452	-21	kworker/u16:4+flush-8:0	09:55:07	5
2328683	99	19	17,2	cyclictest	2390157	-21	kworker/u16:5+events_unbound	08:06:23	5
2328683	99	19	17,2	cyclictest	2351897	-21	kworker/u16:6+flush-8:0	07:20:07	5
2328681	99	19	15,3	cyclictest	2677173	-21	awk	09:54:42	4
2328681	99	19	15,3	cyclictest	2488062	-21	latency_hist	08:29:41	4
2328681	99	19	15,3	cyclictest	2429959	-21	cat	07:59:42	4
2328693	99	18	17,0	cyclictest	0	-21	swapper/7	11:34:39	7
2328693	99	18	17,0	cyclictest	0	-21	swapper/7	09:27:30	7
2328693	99	18	17,0	cyclictest	0	-21	swapper/7	07:10:34	7
2328693	99	18	16,1	cyclictest	2985500	-21	ssh	11:59:42	7
2328693	99	18	16,1	cyclictest	0	-21	swapper/7	10:45:12	7
2328687	99	18	16,2	cyclictest	2506431	-21	kworker/u16:5+flush-8:0	08:35:08	6
2328687	99	18	16,2	cyclictest	2264197	-21	kworker/u16:2+events_unbound	07:34:59	6
2328683	99	18	16,2	cyclictest	2995604	-21	kworker/u16:2+events_unbound	12:01:47	5
2328683	99	18	16,2	cyclictest	2309468	-21	kworker/u16:3+events_unbound	07:46:20	5
2328683	99	18	16,2	cyclictest	2309279	-21	kworker/u16:1+events_unbound	07:27:38	5
2328693	99	17	16,0	cyclictest	0	-21	swapper/7	07:50:11	7
2328693	99	17	15,1	cyclictest	0	-21	swapper/7	10:30:04	7
2328693	99	17	12,4	cyclictest	648	-21	systemd-journal	09:44:36	7
2328693	99	17	0,1	cyclictest	0	-21	swapper/7	08:45:06	7
2328687	99	17	14,2	cyclictest	0	-21	swapper/6	12:00:01	6
2328687	99	17	12,4	cyclictest	2813097	-21	cat	10:49:41	6
2328687	99	17	12,4	cyclictest	2449307	-21	cat	08:09:42	6
2328683	99	17	15,2	cyclictest	2920174	-21	kworker/u16:0+flush-8:0	12:09:18	5
2328683	99	17	15,2	cyclictest	2785754	-21	kworker/u16:1+flush-8:0	11:20:43	5
2328683	99	17	15,2	cyclictest	2785754	-21	kworker/u16:1+flush-8:0	11:20:43	5
2328683	99	17	15,2	cyclictest	2785754	-21	kworker/u16:1+flush-8:0	11:05:11	5
2328683	99	17	15,2	cyclictest	2785754	-21	kworker/u16:1+events_unbound	11:15:12	5
2328683	99	17	15,2	cyclictest	2751247	-21	kworker/u16:5+flush-8:0	10:30:39	5
2328683	99	17	15,2	cyclictest	2574979	-21	kworker/u16:1+events_unbound	10:08:01	5
2328683	99	17	15,2	cyclictest	2506431	-21	kworker/u16:5+flush-8:0	08:59:47	5
2328683	99	17	15,2	cyclictest	2446314	-21	kworker/u16:0+events_unbound	08:43:12	5
2328683	99	17	15,2	cyclictest	2400502	-21	kworker/u16:1+events_unbound	08:01:15	5
2328683	99	17	15,2	cyclictest	2309468	-21	kworker/u16:3+events_unbound	07:11:56	5
2576559	2	16	0,0	sleep7	2576560	-21	sh	09:11:40	7
2328693	99	16	14,1	cyclictest	2565953	-21	diskmemload	12:35:55	7
2328693	99	16	14,1	cyclictest	0	-21	swapper/7	12:24:43	7
2328693	99	16	14,1	cyclictest	0	-21	swapper/7	12:17:19	7
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17