OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Wed Sep 17, 2025 12:44:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2533276	99	127	114,8	cyclictest	2654263	-21	kworker/u4:4+events_unbound	11:30:17	0
2533276	99	116	108,5	cyclictest	2654266	-21	kworker/u4:10+events_unbound	11:25:16	0
2533278	99	102	95,5	cyclictest	2585926	-21	kworker/u4:2+events_unbound	09:44:58	1
2533278	99	90	80,6	cyclictest	2665266	-21	kworker/u4:4+events_unbound	11:40:19	1
2533276	99	84	54,28	cyclictest	379	-21	dbus-daemon	10:15:03	0
2533276	99	84	16,20	cyclictest	0	-21	swapper/0	12:20:38	0
2533276	99	83	40,41	cyclictest	0	-21	swapper/0	09:00:38	0
2533278	99	81	70,8	cyclictest	53	-21	kswapd0	11:00:12	1
2533278	99	80	70,7	cyclictest	53	-21	kswapd0	09:50:10	1
2533276	99	80	29,8	cyclictest	2590525	-21	apt-get	09:50:06	0
2533276	99	80	25,51	cyclictest	257	50	irq/23-42890000.ethernet	10:25:07	0
2533276	99	79	41,5	cyclictest	2571869	-21	cat	09:20:41	0
2533276	99	78	4,34	cyclictest	2601052	-21	latency_hist	10:05:00	0
2533276	99	78	4,26	cyclictest	2577972	-21	ssh	09:30:38	0
2533276	99	76	46,9	cyclictest	2690747	-21	kworker/u4:5+events_unbound	12:15:25	0
2533276	99	75	41,4	cyclictest	2645276	-21	aten_r7power_cu	11:10:16	0
2533276	99	74	33,7	cyclictest	2567721	-21	df	09:15:22	0
2533276	99	73	64,6	cyclictest	2538361	-21	kworker/u4:4+events_unbound	08:44:45	0
2533276	99	73	36,4	cyclictest	2533720	-21	fschecks_time	07:10:19	0
2533278	99	72	61,8	cyclictest	2694546	-21	kworker/u4:11+events_unbound	12:30:29	1
2533276	99	71	32,6	cyclictest	0	-21	swapper/0	12:35:29	0
2533278	99	69	28,14	cyclictest	2599062	-21	ssh	10:00:45	1
2533276	99	69	40,5	cyclictest	2682277	-21	switchtime	12:00:39	0
2533278	99	68	28,16	cyclictest	2609908	-21	ssh	10:16:20	1
2533278	99	68	28,15	cyclictest	2701877	-21	ssh	12:26:41	1
2533276	99	68	33,7	cyclictest	2601704	-21	fschecks_time	10:05:21	0
2533278	99	67	28,11	cyclictest	2680052	-21	ssh	11:58:19	1
2533276	99	67	58,6	cyclictest	2543505	-21	kworker/u4:16+events_unbound	08:49:47	0
2533278	99	66	29,15	cyclictest	2597270	-21	ssh	09:59:38	1
2533278	99	66	28,14	cyclictest	2671888	-21	ssh	11:46:29	1
2533278	99	66	28,13	cyclictest	2646973	-21	ssh	11:11:48	1
2533276	99	66	58,6	cyclictest	2561554	-21	kworker/u4:4+events_unbound	09:09:51	0
2533278	99	65	57,6	cyclictest	2556424	-21	kworker/u4:5+events_unbound	08:55:00	1
2533278	99	65	56,6	cyclictest	2582503	-21	kworker/u4:6+events_unbound	09:49:57	1
2533278	99	65	27,13	cyclictest	2675742	-21	ssh	11:52:24	1
2533278	99	65	26,14	cyclictest	2658825	-21	ssh	11:28:49	1
2533276	99	65	58,4	cyclictest	2668837	-21	kworker/u4:3+events_unbound	11:45:21	0
2533276	99	65	56,6	cyclictest	2538361	-21	kworker/u4:4+events_unbound	08:09:37	0
2533276	99	65	53,9	cyclictest	379	-21	dbus-daemon	10:35:06	0
2533278	99	64	32,9	cyclictest	2651642	-21	ssh	11:18:55	1
2533278	99	64	27,14	cyclictest	2654527	-21	ssh	11:22:31	1
2533278	99	64	26,14	cyclictest	2565756	-21	ssh	09:11:22	1
2533278	99	63	55,6	cyclictest	2613692	-21	kworker/u4:1+events_unbound	10:30:06	1
2533278	99	63	27,14	cyclictest	2627787	-21	ssh	10:42:18	1
2533278	99	63	27,14	cyclictest	2627787	-21	ssh	10:42:17	1
2533278	99	63	27,13	cyclictest	2576719	-21	ssh	09:29:41	1
2533278	99	63	26,11	cyclictest	2631199	-21	ssh	10:46:49	1
2533278	99	63	25,15	cyclictest	2695625	-21	ssh	12:19:09	1
2533278	99	63	25,14	cyclictest	2606598	-21	ssh	10:11:43	1
2533278	99	62	53,7	cyclictest	2690749	-21	kworker/u4:8+events_unbound	12:20:27	1
2533278	99	62	26,13	cyclictest	2665934	-21	ssh	11:38:42	1
2533278	99	62	26,13	cyclictest	2665934	-21	ssh	11:38:42	1
2533278	99	62	25,13	cyclictest	2688090	-21	ssh	12:09:12	1
2533278	99	62	25,13	cyclictest	2661737	-21	ssh	11:32:17	1
2533278	99	62	24,15	cyclictest	2623897	-21	ssh	10:36:16	1
2533278	99	62	24,13	cyclictest	2614129	-21	ssh	10:22:51	1
2533276	99	62	46,12	cyclictest	2553804	-21	systemd	08:29:42	0
2533276	99	62	40,18	cyclictest	0	-21	swapper/0	08:30:11	0
2533276	99	62	2,49	cyclictest	2678050	-21	ssh	11:55:27	0
2533278	99	61	25,11	cyclictest	2563702	-21	ntpq	09:05:35	1
2533278	99	60	52,6	cyclictest	2613691	-21	kworker/u4:0+events_unbound	10:50:09	1
2533278	99	60	27,10	cyclictest	2571623	-21	ntpq	09:20:32	1
2533278	99	60	25,10	cyclictest	2616508	-21	find	10:25:47	1
2533278	99	60	24,13	cyclictest	2682723	-21	ssh	12:01:02	1
2533278	99	60	22,15	cyclictest	2603921	-21	ssh	10:08:42	1
2533278	99	59	25,10	cyclictest	2568865	-21	ssh	09:15:58	1
2533278	99	59	22,13	cyclictest	2644836	-21	ssh	11:09:51	1
2533276	99	59	51,6	cyclictest	2552513	-21	kworker/u4:3+events_unbound	09:10:04	0
2533276	99	59	47,9	cyclictest	0	-21	swapper/0	12:30:15	0
2533278	99	58	24,10	cyclictest	2710359	-21	ssh	12:38:37	1
2533276	99	58	2,43	cyclictest	2574587	-21	ntpq	09:25:24	0
2533278	99	56	41,11	cyclictest	2555893	-21	ntpq	08:35:25	1
2533278	99	56	38,14	cyclictest	2533989	-21	ntpq	07:10:26	1
2533278	99	56	25,9	cyclictest	2579599	-21	ssh	09:33:21	1
2533278	99	56	24,9	cyclictest	2691398	-21	ssh	12:13:18	1
2533278	99	56	24,10	cyclictest	2582161	-21	ssh	09:36:14	1
2533278	99	56	22,12	cyclictest	2637110	-21	ssh	10:58:43	1
2533276	99	56	45,9	cyclictest	2663613	-21	fschecks_count	11:35:25	0
2533276	99	56	45,9	cyclictest	2663613	-21	fschecks_count	11:35:25	0
2533276	99	56	37,11	cyclictest	2551240	-21	modprobe	08:19:59	0
2533276	99	55	35,18	cyclictest	2667884	-21	wc	11:40:39	0
2533276	99	55	32,19	cyclictest	0	-21	swapper/0	07:50:01	0
2533278	99	54	40,11	cyclictest	2545587	-21	ntpq	07:55:30	1
2533278	99	54	40,11	cyclictest	2545587	-21	ntpq	07:55:29	1
2533278	99	54	37,14	cyclictest	2556641	-21	/usr/sbin/munin	08:40:44	1
2533278	99	54	23,9	cyclictest	2558579	-21	collect2	08:45:32	1
2533278	99	52	23,5	cyclictest	2546289	-21	apt-get	08:00:15	1
2533276	99	52	43,5	cyclictest	2629532	-21	aten_r7power_vo	10:45:16	0
2533276	99	52	41,8	cyclictest	2646941	-21	kworker/u4:8+events_unbound	11:15:16	0
2533276	99	52	41,7	cyclictest	2700272	-21	sh	12:25:17	0
2533276	99	52	40,8	cyclictest	2556055	-21	grep	08:35:37	0
2533276	99	52	39,8	cyclictest	0	-21	swapper/0	09:49:58	0
2533278	99	51	38,10	cyclictest	2543098	-21	ntpq	07:45:34	1
2533278	99	51	38,10	cyclictest	2537857	-21	ntpq	07:25:28	1
2533278	99	51	34,14	cyclictest	2548169	-21	ntpq	08:05:29	1
2533278	99	51	22,8	cyclictest	2560484	-21	apt-get	08:55:15	1
2533276	99	51	41,7	cyclictest	2668837	-21	kworker/u4:3+events_unbound	11:50:14	0
2533276	99	51	28,20	cyclictest	2537533	-21	fschecks_count	07:25:20	0
2533278	99	50	42,5	cyclictest	2541439	-21	fschecks_count	07:40:20	1
2533278	99	50	37,10	cyclictest	2551986	-21	ntpq	08:20:25	1
2533278	99	50	37,10	cyclictest	2540420	-21	ntpq	07:35:26	1
2533278	99	50	36,11	cyclictest	1060	-21	snmpd	07:33:27	1
2533276	99	50	39,7	cyclictest	2638017	-21	ssh	11:00:11	0
2533276	99	50	39,7	cyclictest	2540746	-21	timerwakeupswit	07:35:36	0
2533278	99	49	39,8	cyclictest	2549493	-21	ntpq	08:10:34	1
2533278	99	49	39,8	cyclictest	2549493	-21	ntpq	08:10:33	1
2533278	99	49	38,9	cyclictest	2544367	-21	ntpq	07:50:36	1
2533278	99	49	35,11	cyclictest	2535309	-21	ntpq	07:15:29	1
2533276	99	49	39,6	cyclictest	2642265	-21	/usr/sbin/munin	11:05:27	0
2533276	99	49	38,7	cyclictest	2629095	-21	modprobe	10:45:00	0
2533276	99	49	38,7	cyclictest	2629095	-21	modprobe	10:45:00	0
2533276	99	49	38,6	cyclictest	2547396	-21	modprobe	08:05:00	0
2533278	99	48	38,8	cyclictest	2562376	-21	ntpq	09:00:30	1
2533278	99	48	38,7	cyclictest	2553925	-21	latency_hist	08:30:02	1
2533278	99	48	33,12	cyclictest	2550777	-21	ntpq	08:15:33	1
2533278	99	47	37,7	cyclictest	2535996	-21	/usr/sbin/munin	07:20:42	1
2533278	99	47	31,13	cyclictest	2554059	-21	/usr/sbin/munin	08:30:12	1
2533276	99	47	40,5	cyclictest	2549988	-21	latency_hist	08:15:01	0
2533276	99	47	40,5	cyclictest	2549988	-21	latency_hist	08:15:01	0
2533276	99	47	38,7	cyclictest	379	-21	dbus-daemon	09:39:56	0
2533276	99	47	38,7	cyclictest	2546071	-21	systemd	07:59:34	0
2533276	99	47	38,7	cyclictest	2546071	-21	systemd	07:59:33	0
2533276	99	46	40,4	cyclictest	2605402	-21	kernelversion	10:10:22	0
2533276	99	46	39,5	cyclictest	2689415	-21	ntpq	12:10:25	0
2533276	99	46	38,6	cyclictest	2538615	-21	aten_r7power_cu	07:30:18	0
2533276	99	46	28,15	cyclictest	0	-21	swapper/0	10:50:35	0
2533276	99	46	2,33	cyclictest	2584867	-21	ntp_states	09:40:37	0
2533276	99	46	21,18	cyclictest	2654994	-21	sshd	11:23:28	0
2533276	99	44	36,5	cyclictest	2637719	-21	idleruntime-cro	11:00:01	0
2533276	99	44	34,5	cyclictest	2549917	-21	kworker/u4:14-nfsiod	08:25:01	0
2533276	99	43	35,6	cyclictest	2559226	-21	aten2__	08:50:16	0
2533276	99	43	32,6	cyclictest	2594978	-21	ld	09:55:28	0
2533276	99	42	35,5	cyclictest	2688545	-21	latency_hist	12:10:01	0
2533276	99	42	34,6	cyclictest	1056	-21	lldpd	08:55:44	0
2533276	99	42	31,8	cyclictest	2541251	-21	aten_r7power_po	07:40:16	0
2533278	99	41	30,8	cyclictest	2533360	-21	latency_hist	07:10:02	1
2533276	99	41	33,6	cyclictest	2610131	-21	kworker/u4:5+events_unbound	10:30:04	0
2533276	99	41	32,5	cyclictest	2613694	-21	kworker/u4:6-rpciod	10:25:48	0
2533276	99	41	31,6	cyclictest	2512518	-21	kworker/u4:8-nfsiod	07:20:30	0
2533276	99	40	31,6	cyclictest	0	-21	swapper/0	07:50:18	0
2533276	99	40	26,6	cyclictest	2531985	-21	kworker/u4:2+events_unbound	07:10:01	0
2533276	99	39	29,7	cyclictest	0	-21	swapper/0	07:15:17	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17