OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Sat Jun 20, 2026 00:43:29)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2343746	2	104	0,1	sleep4	0	-21	swapper/4	21:15:08	4
2114510	2	98	0,1	sleep7	911	-21	dbus-daemon	19:19:49	7
2081765	2	50	38,8	sleep5	0	-21	swapper/5	19:04:57	5
2090986	2	47	13,29	sleep7	0	-21	swapper/7	19:09:25	7
2081764	2	47	36,7	sleep4	0	-21	swapper/4	19:04:56	4
2091282	99	42	40,2	cyclictest	2437172	-21	kworker/u16:3+events_unbound	22:20:04	5
2091282	99	37	35,2	cyclictest	2658886	-21	kworker/u16:0+events_unbound	23:49:48	5
2091282	99	37	35,2	cyclictest	2571361	-21	kworker/u16:1+events_unbound	23:02:19	5
2091282	99	37	35,2	cyclictest	2509988	-21	kworker/u16:2+events_unbound	22:42:44	5
2091282	99	36	34,2	cyclictest	2830415	-21	kworker/u16:4+events_unbound	00:39:28	5
2091282	99	36	34,2	cyclictest	2729947	-21	kworker/u16:1+events_unbound	23:52:19	5
2091282	99	36	34,2	cyclictest	2708189	-21	kworker/u16:3+events_unbound	23:56:48	5
2091282	99	36	34,2	cyclictest	2509988	-21	kworker/u16:2+events_unbound	22:51:44	5
2091282	99	35	33,2	cyclictest	2753845	-21	kworker/u16:5+events_unbound	00:06:52	5
2091282	99	35	33,2	cyclictest	2509988	-21	kworker/u16:2+events_unbound	23:43:23	5
2091282	99	34	32,2	cyclictest	2732569	-21	kworker/u16:2+events_unbound	00:32:36	5
2091282	99	34	32,2	cyclictest	2658886	-21	kworker/u16:0+events_unbound	23:36:52	5
2091282	99	34	32,2	cyclictest	2571361	-21	kworker/u16:1+events_unbound	23:17:20	5
2091282	99	34	32,2	cyclictest	2536147	-21	kworker/u16:1+events_unbound	22:37:20	5
2091282	99	34	32,2	cyclictest	2475934	-21	kworker/u16:0+events_unbound	22:29:39	5
2091282	99	34	32,2	cyclictest	2376958	-21	kworker/u16:1+events_unbound	21:36:20	5
2091282	99	34	32,2	cyclictest	2171986	-21	kworker/u16:5+events_unbound	21:31:24	5
2091282	99	34	32,2	cyclictest	2171986	-21	kworker/u16:5+events_unbound	21:22:31	5
2091282	99	34	32,2	cyclictest	2144079	-21	kworker/u16:2+events_unbound	19:50:09	5
2090723	2	34	23,8	sleep6	0	-21	swapper/6	19:05:39	6
2464094	2	33	0,2	chrt	68	1	rcuog/4	22:05:02	5
2091282	99	33	31,2	cyclictest	2708189	-21	kworker/u16:3+events_unbound	00:11:12	5
2091282	99	33	31,2	cyclictest	2708189	-21	kworker/u16:3+events_unbound	00:11:12	5
2091282	99	33	31,2	cyclictest	2509988	-21	kworker/u16:2+events_unbound	22:45:11	5
2091282	99	33	31,2	cyclictest	2424588	-21	kworker/u16:2+events_unbound	21:56:12	5
2091285	99	32	30,2	cyclictest	2437172	-21	kworker/u16:3+flush-8:0	22:10:20	6
2091285	99	32	30,2	cyclictest	2437172	-21	kworker/u16:3+flush-8:0	22:10:20	6
2091282	99	32	30,2	cyclictest	2732569	-21	kworker/u16:2+flush-8:0	00:27:26	5
2091282	99	32	30,2	cyclictest	2708189	-21	kworker/u16:3+events_unbound	00:16:19	5
2091282	99	32	30,2	cyclictest	2571361	-21	kworker/u16:1+events_unbound	23:24:20	5
2091282	99	32	30,2	cyclictest	2571361	-21	kworker/u16:1+events_unbound	23:07:08	5
2091282	99	32	30,2	cyclictest	2376958	-21	kworker/u16:1+events_unbound	21:48:19	5
2091282	99	32	30,2	cyclictest	2256485	-21	kworker/u16:3+events_unbound	21:16:20	5
2091282	99	32	30,2	cyclictest	2171986	-21	kworker/u16:5+events_unbound	21:41:19	5
2091282	99	32	30,2	cyclictest	2120459	-21	kworker/u16:3+flush-8:0	19:35:14	5
2091282	99	31	29,2	cyclictest	2571361	-21	kworker/u16:1+events_unbound	23:27:35	5
2091282	99	31	29,2	cyclictest	2475934	-21	kworker/u16:0+events_unbound	22:19:31	5
2486174	2	30	0,1	chrt	2486175	-21	sh	22:11:53	7
2486174	2	30	0,1	chrt	2486175	-21	sh	22:11:53	7
2091288	99	30	0,28	cyclictest	2299509	-21	turbostat	20:54:50	7
2091282	99	30	28,2	cyclictest	2732569	-21	kworker/u16:2+events_unbound	00:23:15	5
2091282	99	30	28,2	cyclictest	2509988	-21	kworker/u16:2+flush-8:0	23:14:44	5
2091282	99	30	28,2	cyclictest	2411432	-21	kworker/u16:0+events_unbound	21:53:39	5
2091282	99	30	28,2	cyclictest	2256485	-21	kworker/u16:3+events_unbound	21:26:47	5
2091288	99	29	26,2	cyclictest	2684381	-21	entropy	23:35:03	7
2091288	99	29	26,2	cyclictest	2115670	-21	iostat	19:20:05	7
2091282	99	29	27,2	cyclictest	2509988	-21	kworker/u16:2+events_unbound	23:30:51	5
2091282	99	29	27,2	cyclictest	2120459	-21	kworker/u16:3+flush-8:0	20:05:18	5
2091288	99	28	27,0	cyclictest	0	-21	swapper/7	21:13:45	7
2091285	99	28	26,2	cyclictest	2171986	-21	kworker/u16:5+events_unbound	21:20:08	6
2091285	99	28	25,2	cyclictest	2171986	-21	kworker/u16:5+flush-8:0	20:45:06	6
2091282	99	28	26,2	cyclictest	388231	-21	kworker/u16:4+events_unbound	19:29:00	5
2091282	99	28	26,2	cyclictest	2449709	-21	kworker/u16:1+events_unbound	22:14:34	5
2091282	99	28	26,2	cyclictest	2449709	-21	kworker/u16:1+events_unbound	22:14:34	5
2091282	99	28	26,2	cyclictest	2120459	-21	kworker/u16:3+flush-8:0	19:30:17	5
2091282	99	28	26,2	cyclictest	2026636	-21	kworker/u16:1+events_unbound	20:16:00	5
2547426	2	27	0,1	chrt	2547424	-21	ssh	22:37:10	7
2091288	99	27	23,2	cyclictest	2415726	-21	perl	21:45:03	7
2091285	99	27	25,2	cyclictest	2449709	-21	kworker/u16:1+events_unbound	22:04:32	6
2091282	99	27	26,1	cyclictest	2424588	-21	kworker/u16:2+events_unbound	22:02:07	5
2091282	99	27	25,2	cyclictest	2522967	-21	kworker/u16:3+flush-8:0	22:33:37	5
2091282	99	27	25,2	cyclictest	2241321	-21	kworker/u16:0+events_unbound	21:00:08	5
2091282	99	27	25,2	cyclictest	2085928	-21	kworker/u16:0+events_unbound	19:24:09	5
2091279	99	27	26,1	cyclictest	2171986	-21	kworker/u16:5+events_unbound	21:37:36	4
2091285	99	26	24,2	cyclictest	2708189	-21	kworker/u16:3+events_unbound	23:45:13	6
2091285	99	26	24,2	cyclictest	2536147	-21	kworker/u16:1+events_unbound	22:37:18	6
2091285	99	26	24,2	cyclictest	2411432	-21	kworker/u16:0+events_unbound	21:51:34	6
2091285	99	26	24,2	cyclictest	2120459	-21	kworker/u16:3+events_unbound	20:05:02	6
2091282	99	26	24,2	cyclictest	2753845	-21	kworker/u16:5+flush-8:0	00:02:01	5
2091282	99	26	24,2	cyclictest	2509988	-21	kworker/u16:2+events_unbound	22:56:11	5
2091282	99	26	24,2	cyclictest	2256485	-21	kworker/u16:3+flush-8:0	20:50:36	5
2091279	99	26	21,4	cyclictest	2769152	-21	cat	00:09:49	4
2091288	99	25	22,2	cyclictest	2525741	-21	ip_192.168.114.	22:30:04	7
2091285	99	25	23,2	cyclictest	2475934	-21	kworker/u16:0+flush-8:0	22:47:52	6
2091285	99	25	23,2	cyclictest	2475934	-21	kworker/u16:0+events_unbound	22:18:30	6
2091285	99	25	23,2	cyclictest	2171986	-21	kworker/u16:5+events_unbound	20:27:36	6
2091285	99	25	23,2	cyclictest	2120459	-21	kworker/u16:3+events_unbound	20:13:53	6
2091285	99	25	23,2	cyclictest	2120459	-21	kworker/u16:3+events_unbound	20:13:53	6
2091285	99	25	23,2	cyclictest	2026636	-21	kworker/u16:1+flush-8:0	19:56:36	6
2091282	99	25	23,2	cyclictest	2171986	-21	kworker/u16:5+flush-8:0	19:55:18	5
2091282	99	25	23,2	cyclictest	2026636	-21	kworker/u16:1+events_unbound	19:49:29	5
2091288	99	24	20,3	cyclictest	2832986	-21	tr	00:35:07	7
2091285	99	24	22,2	cyclictest	2708189	-21	kworker/u16:3+flush-8:0	00:10:46	6
2091285	99	24	22,2	cyclictest	2708189	-21	kworker/u16:3+flush-8:0	00:10:46	6
2091285	99	24	22,2	cyclictest	2509988	-21	kworker/u16:2+events_unbound	22:25:15	6
2091282	99	24	22,2	cyclictest	2026636	-21	kworker/u16:1+flush-8:0	20:20:04	5
2091282	99	24	22,2	cyclictest	2026636	-21	kworker/u16:1+events_unbound	19:44:27	5
2091282	99	24	21,2	cyclictest	2171986	-21	kworker/u16:5+events_unbound	20:45:02	5
2091279	99	24	22,2	cyclictest	2120459	-21	kworker/u16:3+flush-8:0	19:30:19	4
2091288	99	23	22,0	cyclictest	0	-21	swapper/7	00:29:49	7
2091288	99	23	17,5	cyclictest	650	-21	systemd-journal	23:29:43	7
2091285	99	23	21,2	cyclictest	388231	-21	kworker/u16:4+events_unbound	19:17:56	6
2091285	99	23	21,2	cyclictest	2708189	-21	kworker/u16:3+flush-8:0	00:19:56	6
2091285	99	23	21,2	cyclictest	2522967	-21	kworker/u16:3+events_unbound	22:30:37	6
2091285	99	23	21,2	cyclictest	2509988	-21	kworker/u16:2+flush-8:0	22:54:00	6
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17