OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #b, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rackbslot1.osadl.org (updated Tue Nov 25, 2025 12:44:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
850729	2	202	179,14	sleep2	0	-21	swapper/2	07:08:38	2
850747	2	199	153,37	sleep0	0	-21	swapper/0	07:08:51	0
850558	2	195	154,14	sleep1	0	-21	swapper/1	07:06:28	1
850819	2	187	163,14	sleep3	0	-21	swapper/3	07:09:43	3
851057	99	89	1,2	cyclictest	247557	-21	chrome	11:45:02	1
851061	99	76	51,23	cyclictest	919487	-21	kworker/u8:4+flush-179:0	09:10:24	2
851062	99	71	62,7	cyclictest	893808	-21	/usr/share/muni	07:50:16	3
851062	99	64	57,4	cyclictest	1130492	-21	latency_hist	11:40:01	3
851061	99	60	56,3	cyclictest	877689	-21	kworker/u8:0+events_unbound	07:50:18	2
851061	99	59	54,4	cyclictest	851154	-21	/usr/share/muni	07:10:08	2
901990	2	58	0,5	sleep1	25	1	irq_work/1	07:55:23	1
851062	99	58	54,3	cyclictest	919487	-21	kworker/u8:4+flush-179:0	09:00:16	3
851061	99	58	54,3	cyclictest	1089201	-21	kworker/u8:2+flush-179:0	11:45:26	2
851061	99	58	52,5	cyclictest	247515	-21	ThreadPoolForeg	11:17:14	2
851061	99	57	54,2	cyclictest	971032	-21	kworker/u8:1+flush-179:0	09:25:09	2
851061	99	56	52,3	cyclictest	919487	-21	kworker/u8:4+flush-179:0	09:50:35	2
851061	99	56	50,5	cyclictest	904387	-21	/usr/share/muni	08:00:03	2
851061	99	56	48,4	cyclictest	1033082	-21	kworker/u8:0+flush-179:0	10:30:10	2
851057	99	56	48,6	cyclictest	247560	-21	ThreadPoolForeg	08:20:14	1
1146759	2	56	0,1	chrt	1146758	-21	snmp_wlanswitch	11:55:04	1
851061	99	55	51,3	cyclictest	919487	-21	kworker/u8:4+flush-179:0	09:17:03	2
851061	99	55	50,4	cyclictest	951045	-21	/usr/share/muni	08:45:07	2
851057	99	55	49,5	cyclictest	1157635	-21	apt-get	12:05:12	1
851061	99	54	51,2	cyclictest	916268	-21	kworker/u8:0+events_unbound	09:40:26	2
851061	99	54	47,5	cyclictest	1064100	-21	/usr/share/muni	10:35:17	2
851057	99	54	49,4	cyclictest	971032	-21	kworker/u8:1+flush-179:0	09:40:34	1
851062	99	53	48,4	cyclictest	903977	-21	cp	08:00:01	3
851061	99	52	49,2	cyclictest	971032	-21	kworker/u8:1+flush-179:0	11:13:01	2
851062	99	51	44,6	cyclictest	3125725	-21	ThreadPoolForeg	09:55:10	3
851062	99	51	37,6	cyclictest	247560	-21	ThreadPoolForeg	11:26:59	3
851061	99	51	48,2	cyclictest	1048371	-21	kworker/u8:5+flush-179:0	10:30:00	2
851061	99	51	48,2	cyclictest	1048371	-21	kworker/u8:5+flush-179:0	10:30:00	2
851061	99	51	47,3	cyclictest	829742	-21	kworker/u8:4+flush-179:0	07:15:05	2
851061	99	51	47,3	cyclictest	1038219	-21	kworker/u8:4+events_unbound	11:05:29	2
851055	99	51	47,3	cyclictest	1101620	-21	ntpq	11:10:17	0
851062	99	50	46,3	cyclictest	877689	-21	kworker/u8:0+flush-179:0	07:35:58	3
851061	99	50	46,3	cyclictest	919487	-21	kworker/u8:4+flush-179:0	09:20:08	2
851061	99	50	3,45	cyclictest	1074366	-21	chrome	10:45:01	2
851062	99	49	44,3	cyclictest	1084748	-21	/usr/share/muni	10:55:09	3
851062	99	49	42,5	cyclictest	1146694	-21	/usr/share/muni	11:55:11	3
851061	99	49	47,2	cyclictest	919487	-21	kworker/u8:4+events_unbound	08:40:30	2
851061	99	49	46,2	cyclictest	971032	-21	kworker/u8:1+flush-179:0	10:53:52	2
851061	99	49	45,3	cyclictest	845108	-21	kworker/u8:1+flush-179:0	07:30:30	2
851061	99	49	45,3	cyclictest	1089201	-21	kworker/u8:2+events_unbound	12:10:24	2
851057	99	49	44,4	cyclictest	919487	-21	kworker/u8:4+flush-179:0	09:45:13	1
851057	99	49	42,5	cyclictest	1068586	-31	munin-graph	10:36:15	1
851061	99	48	45,2	cyclictest	919487	-21	kworker/u8:4+flush-179:0	08:34:29	2
851061	99	48	45,2	cyclictest	1152023	-21	kworker/u8:3+events_unbound	12:05:12	2
851061	99	48	45,2	cyclictest	1089201	-21	kworker/u8:2+flush-179:0	12:15:16	2
851061	99	48	45,2	cyclictest	1089201	-21	kworker/u8:2+flush-179:0	12:15:15	2
851061	99	48	44,3	cyclictest	1089201	-21	kworker/u8:2+events_unbound	11:28:20	2
851061	99	48	44,3	cyclictest	1033163	-21	munin-update	10:05:35	2
851057	99	48	44,3	cyclictest	1089201	-21	kworker/u8:2+flush-179:0	12:10:34	1
851057	99	48	42,4	cyclictest	887961	-21	latency_hist	07:45:01	1
851055	99	48	42,4	cyclictest	1065323	-21	apt-get	10:35:13	0
851062	99	47	36,10	cyclictest	1109608	-21	kworker/u8:5+flush-179:0	11:20:31	3
851061	99	47	44,2	cyclictest	919487	-21	kworker/u8:4+flush-179:0	09:00:31	2
851061	99	47	44,2	cyclictest	877689	-21	kworker/u8:0+flush-179:0	07:40:31	2
851061	99	47	44,2	cyclictest	1119555	-21	kworker/u8:0+flush-179:0	11:40:11	2
851061	99	47	42,4	cyclictest	1182497	-21	/usr/share/muni	12:30:03	2
851057	99	47	41,4	cyclictest	939545	-31	munin-html	08:30:35	1
851057	99	47	41,4	cyclictest	1099452	-31	munin-graph	11:06:22	1
851055	99	47	45,1	cyclictest	892908	-21	kworker/u8:1+flush-179:0	08:11:53	0
851055	99	47	44,2	cyclictest	1109608	-21	kworker/u8:5+flush-179:0	11:25:02	0
851055	99	47	44,2	cyclictest	1089201	-21	kworker/u8:2+events_unbound	11:25:00	0
851055	99	47	41,5	cyclictest	247560	-21	ThreadPoolForeg	10:40:09	0
851062	99	46	40,5	cyclictest	1089201	-21	kworker/u8:2+flush-179:0	12:35:30	3
851062	99	46	32,13	cyclictest	1253	-21	openvpn	07:48:17	3
851062	99	46	28,16	cyclictest	992055	-21	/usr/share/muni	09:25:19	3
851061	99	46	43,2	cyclictest	1033082	-21	kworker/u8:0+flush-179:0	10:55:24	2
851061	99	46	42,3	cyclictest	971032	-21	kworker/u8:1+flush-179:0	09:55:28	2
851061	99	46	42,3	cyclictest	1038219	-21	kworker/u8:4+flush-179:0	11:20:22	2
851061	99	46	41,4	cyclictest	878104	-21	kworker/u8:5+flush-179:0	07:45:20	2
851061	99	46	41,4	cyclictest	1003757	-21	ntpq	09:35:18	2
851061	99	46	40,2	cyclictest	1033082	-21	kworker/u8:0+flush-179:0	10:10:15	2
851057	99	46	42,3	cyclictest	916268	-21	kworker/u8:0+flush-179:0	09:10:21	1
851057	99	46	32,2	cyclictest	3350468	-1	kworker/1:2H+kblockd	08:56:29	1
851057	99	46	32,2	cyclictest	3350468	-1	kworker/1:2H+kblockd	08:56:29	1
851055	99	46	41,3	cyclictest	1119555	-21	kworker/u8:0+flush-179:0	11:39:51	0
851062	99	45	29,15	cyclictest	916610	-21	ntpq	08:10:16	3
851062	99	45	24,13	cyclictest	1183724	-21	apt-get	12:30:13	3
851061	99	45	42,2	cyclictest	1033082	-21	kworker/u8:0+events_unbound	10:15:31	2
851061	99	45	41,3	cyclictest	903143	-31	munin-html	07:55:34	2
851057	99	45	38,5	cyclictest	919487	-21	kworker/u8:4+flush-179:0	09:22:38	1
851055	99	45	41,3	cyclictest	1033082	-21	kworker/u8:0+flush-179:0	11:00:37	0
851062	99	44	38,4	cyclictest	1119555	-21	kworker/u8:0+events_unbound	12:15:10	3
851062	99	44	38,4	cyclictest	1119555	-21	kworker/u8:0+events_unbound	12:15:10	3
851061	99	44	41,2	cyclictest	1119555	-21	kworker/u8:0+events_unbound	12:35:18	2
851061	99	44	40,3	cyclictest	1161691	-21	kworker/u8:4+flush-179:0	12:20:22	2
851061	99	44	40,3	cyclictest	1161691	-21	kworker/u8:4+flush-179:0	12:20:21	2
851061	99	44	39,4	cyclictest	99884	-21	rs:main		2
851061	99	44	39,4	cyclictest	99884	-21	rs:main		2
851061	99	44	39,4	cyclictest	1089201	-21	kworker/u8:2+flush-179:0	11:55:03	2
851057	99	44	38,4	cyclictest	903534	-21	kworker/u8:2+flush-179:0	08:08:22	1
851057	99	44	38,4	cyclictest	903534	-21	kworker/u8:2+flush-179:0	08:08:22	1
851057	99	44	38,4	cyclictest	1187595	-21	/usr/share/muni	12:35:04	1
851055	99	44	40,3	cyclictest	879254	-21	apt-get	07:35:14	0
851061	99	43	41,2	cyclictest	971032	-21	kworker/u8:1+flush-179:0	10:44:58	2
851061	99	43	39,3	cyclictest	971032	-21	kworker/u8:1+flush-179:0	10:00:32	2
851061	99	43	39,3	cyclictest	916268	-21	kworker/u8:0+events_unbound	09:45:27	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17