OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Wed Jan 14, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2532397	99	129	97,16	cyclictest	0	-21	swapper/1	09:32:13	1
2532396	99	93	53,6	cyclictest	0	-21	swapper/0	09:32:16	0
2532396	99	91	55,7	cyclictest	2580427	-21	mandb	09:29:56	0
2532397	99	83	74,7	cyclictest	2697688	-21	kworker/u4:3+events_unbound	11:58:47	1
2532396	99	79	70,6	cyclictest	2736440	-21	kworker/u4:7+events_unbound	12:33:50	0
2532397	99	78	32,31	cyclictest	2714275	-21	unixbench_singl	12:05:37	1
2532397	99	76	67,6	cyclictest	2577896	-21	dpkg	09:27:33	1
2532396	99	76	67,6	cyclictest	2529917	-21	kworker/u4:1+events_unbound	07:20:00	0
2532396	99	75	66,6	cyclictest	2658861	-21	kworker/u4:2+events_unbound	11:03:36	0
2532397	99	74	40,31	cyclictest	2541362	-21	apt-key	07:45:01	1
2532397	99	73	38,33	cyclictest	388	-21	dbus-daemon	10:48:29	1
2532396	99	72	62,7	cyclictest	54	-21	kswapd0	11:50:10	0
2532396	99	71	63,5	cyclictest	2533605	-21	kworker/u4:8+xprtiod	07:45:11	0
2532396	99	70	61,6	cyclictest	2481228	-21	kworker/u4:7+events_unbound	07:22:54	0
2532397	99	69	40,26	cyclictest	2583724	-21	/usr/sbin/munin	09:35:19	1
2532396	99	69	61,6	cyclictest	2553918	-21	kworker/u4:10+events_unbound	08:43:06	0
2532397	99	68	61,5	cyclictest	2553918	-21	kworker/u4:10+events_unbound	08:45:00	1
2532397	99	68	5,12	cyclictest	2726688	-21	ssh	12:20:28	1
2532396	99	67	59,6	cyclictest	2553917	-21	kworker/u4:9+events_unbound	08:33:05	0
2532396	99	67	58,6	cyclictest	2538669	-21	kworker/u4:16+events_unbound	07:42:55	0
2532397	99	66	33,30	cyclictest	0	-21	swapper/1	12:15:28	1
2532397	99	65	35,28	cyclictest	2532394	-21	cyclictest	11:40:01	1
2532397	99	65	35,28	cyclictest	2532394	-21	cyclictest	11:40:00	1
2532397	99	65	33,29	cyclictest	0	-21	swapper/1	11:40:34	1
2532396	99	65	55,8	cyclictest	54	-21	kswapd0	10:50:00	0
2532396	99	65	48,15	cyclictest	0	-21	swapper/0	09:24:19	0
2532397	99	64	35,26	cyclictest	2627742	-21	timerwakeupswit	10:25:37	1
2532397	99	64	34,25	cyclictest	2699971	-21	grep	11:50:01	1
2532396	99	64	57,5	cyclictest	2532394	-21	cyclictest	11:24:07	0
2532397	99	63	32,29	cyclictest	2532394	-21	cyclictest	10:00:36	1
2532397	99	63	30,30	cyclictest	0	-21	swapper/1	11:10:28	1
2532397	99	63	28,32	cyclictest	0	-21	swapper/1	09:40:36	1
2532396	99	63	55,6	cyclictest	2553918	-21	kworker/u4:10+events_unbound	08:58:09	0
2532396	99	63	55,6	cyclictest	2548853	-21	kworker/u4:1+events_unbound	09:03:10	0
2532397	99	62	3,8	cyclictest	2575238	-21	ssh	09:24:11	1
2532397	99	62	2,17	cyclictest	2648549	-21	ssh	10:50:16	1
2532396	99	62	53,6	cyclictest	2557715	-21	kworker/u4:15+events_unbound	08:53:09	0
2532397	99	61	39,19	cyclictest	2683244	-21	fschecks_time	11:30:20	1
2532397	99	61	32,26	cyclictest	0	-21	swapper/1	10:30:25	1
2532397	99	61	26,32	cyclictest	0	-21	swapper/1	11:25:30	1
2532397	99	61	2,17	cyclictest	2636022	-21	ntpq	10:35:28	1
2532397	99	61	2,14	cyclictest	2553450	-21	ntpq	08:30:28	1
2532397	99	60	52,6	cyclictest	2529916	-21	kworker/u4:0+events_unbound	08:18:02	1
2532397	99	60	4,13	cyclictest	2610059	-21	ntpq	10:05:30	1
2532397	99	60	32,25	cyclictest	0	-21	swapper/1	11:20:37	1
2532397	99	60	29,28	cyclictest	0	-21	swapper/1	10:15:39	1
2532397	99	60	27,29	cyclictest	0	-21	swapper/1	12:30:28	1
2532397	99	60	2,15	cyclictest	2591724	-21	apt-get	09:45:04	1
2532397	99	60	2,11	cyclictest	2708661	-21	apt-get	12:00:12	1
2532397	99	60	1,13	cyclictest	2718151	-21	ssh	12:10:32	1
2532396	99	60	39,18	cyclictest	2691874	-21	fschecks_time	11:40:19	0
2532397	99	59	3,9	cyclictest	2596343	-21	apt-get	09:50:12	1
2532397	99	59	3,9	cyclictest	2596343	-21	apt-get	09:50:12	1
2532397	99	59	3,8	cyclictest	2536966	-21	ntpq	07:25:29	1
2532397	99	59	34,23	cyclictest	2670946	-21	timerandwakeup	11:15:34	1
2532397	99	59	28,28	cyclictest	2557047	-21	sshd	08:45:18	1
2532397	99	59	28,28	cyclictest	0	-21	swapper/1	11:00:19	1
2532396	99	59	49,7	cyclictest	2552591	-21	/usr/sbin/munin	08:25:35	0
2532397	99	58	34,21	cyclictest	2622754	-21	gltestperf	10:20:19	1
2532397	99	58	27,29	cyclictest	0	-21	swapper/1	09:15:09	1
2532397	99	58	25,31	cyclictest	2562618	-21	timerwakeupswit	09:05:35	1
2532397	99	58	25,30	cyclictest	0	-21	swapper/1	11:50:35	1
2532397	99	58	1,13	cyclictest	2538176	-21	ntpq	07:30:25	1
2532396	99	58	45,10	cyclictest	2717469	-21	basename	12:10:14	0
2532396	99	58	43,12	cyclictest	2679662	-21	timerwakeupswit	11:25:37	0
2532397	99	57	4,8	cyclictest	2652602	-21	apt-get	10:55:14	1
2532397	99	57	2,17	cyclictest	2639589	-21	apt-get	10:40:14	1
2532397	99	57	2,17	cyclictest	2639589	-21	apt-get	10:40:14	1
2532397	99	57	13,41	cyclictest	2662128	-21	collect2	11:05:35	1
2532397	99	57	1,13	cyclictest	2563120	-21	apt-get	09:10:17	1
2532396	99	57	47,7	cyclictest	2636853	-21	kworker/u4:2+events_unbound	10:38:59	0
2532396	99	57	45,8	cyclictest	0	-21	swapper/0	10:40:34	0
2532396	99	57	45,8	cyclictest	0	-21	swapper/0	10:40:34	0
2532397	99	56	4,8	cyclictest	2554683	-21	ntpq	08:35:24	1
2532397	99	56	31,22	cyclictest	0	-21	swapper/1	08:50:19	1
2532397	99	56	26,27	cyclictest	0	-21	swapper/1	12:25:33	1
2532397	99	56	22,31	cyclictest	0	-21	swapper/1	07:45:42	1
2532397	99	56	1,14	cyclictest	2552167	-21	ntpq	08:25:25	1
2532396	99	56	46,7	cyclictest	2684580	-21	kworker/u4:4+events_unbound	11:35:14	0
2532396	99	56	46,7	cyclictest	2684580	-21	kworker/u4:4+events_unbound	11:35:14	0
2532396	99	56	42,11	cyclictest	2714231	-21	unixbench_singl	12:05:38	0
2532396	99	56	35,14	cyclictest	2653386	-21	sh	10:55:32	0
2532397	99	55	49,4	cyclictest	2552657	-21	kworker/u4:6+events_unbound	09:05:01	1
2532397	99	55	26,26	cyclictest	0	-21	swapper/1	10:10:23	1
2532397	99	55	26,26	cyclictest	0	-21	swapper/1	09:55:23	1
2532397	99	55	25,27	cyclictest	0	-21	swapper/1	12:35:31	1
2532397	99	55	24,29	cyclictest	0	-21	swapper/1	08:05:02	1
2532397	99	55	23,28	cyclictest	2536171	-21	kworker/u4:4	07:25:00	1
2532396	99	55	47,6	cyclictest	2588692	-21	/usr/sbin/munin	09:40:35	0
2532396	99	55	47,5	cyclictest	54	-21	kswapd0	11:35:00	0
2532396	99	55	46,7	cyclictest	388	-21	dbus-daemon	10:32:18	0
2532396	99	55	46,7	cyclictest	2667648	-21	kworker/u4:1+events_unbound	11:13:36	0
2532396	99	55	45,7	cyclictest	2658862	-21	kworker/u4:6-rpciod	11:15:36	0
2532397	99	54	9,10	cyclictest	1068	-21	snmpd	08:12:23	1
2532397	99	54	25,26	cyclictest	0	-21	swapper/1	07:50:25	1
2532397	99	54	1,13	cyclictest	2534360	-21	ntpq	07:15:25	1
2532396	99	54	38,13	cyclictest	255	50	irq/23-42890000.ethernet	09:15:10	0
2532397	99	53	9,9	cyclictest	1068	-21	snmpd	07:57:31	1
2532397	99	53	26,24	cyclictest	0	-21	swapper/1	07:35:20	1
2532397	99	53	19,31	cyclictest	0	-21	swapper/1	08:05:17	1
2532397	99	53	1,12	cyclictest	2533585	-21	users	07:10:37	1
2532396	99	53	32,18	cyclictest	0	-21	swapper/0	09:50:01	0
2532397	99	52	22,27	cyclictest	0	-21	swapper/1	08:55:39	1
2532397	99	52	1,12	cyclictest	2550565	-21	df_inode	08:20:17	1
2532396	99	52	45,5	cyclictest	2620950	-21	sshd	10:18:23	0
2532396	99	52	33,13	cyclictest	0	-21	swapper/0	10:05:31	0
2532396	99	51	43,6	cyclictest	2552656	-21	kworker/u4:5+events_unbound	09:38:18	0
2532396	99	51	43,5	cyclictest	2704585	-21	/usr/sbin/munin	11:55:21	0
2532396	99	51	36,9	cyclictest	0	-21	swapper/0	09:55:01	0
2532396	99	51	36,9	cyclictest	0	-21	swapper/0	09:55:00	0
2532396	99	51	26,21	cyclictest	2742852	-21	munin-plugin-st	12:40:01	0
2532396	99	49	41,6	cyclictest	2722076	-21	gltestperf	12:15:20	0
2532396	99	49	40,6	cyclictest	2731112	-21	/usr/sbin/munin	12:25:35	0
2532396	99	49	40,6	cyclictest	2546022	-21	cat	08:00:37	0
2532396	99	49	32,13	cyclictest	255	50	irq/23-42890000.ethernet	09:10:10	0
2532396	99	49	2,38	cyclictest	2699848	-21	apt-config	11:50:02	0
2532396	99	48	37,9	cyclictest	2658861	-21	kworker/u4:2+events_unbound	11:08:36	0
2532396	99	48	26,18	cyclictest	0	-21	swapper/0	10:25:18	0
2532396	99	46	39,5	cyclictest	2712686	-21	cron	12:05:00	0
2532396	99	46	39,5	cyclictest	2550152	-21	cron	08:20:01	0
2532396	99	46	37,7	cyclictest	2550741	-21	gltestperf	08:20:19	0
2532396	99	46	36,7	cyclictest	2726139	-21	df_abs	12:20:15	0
2532396	99	46	36,7	cyclictest	2598004	-21	kworker/u4:2-rpciod	09:55:19	0
2532396	99	46	35,9	cyclictest	2622403	-21	aten_r7power_po	10:20:16	0
2532396	99	46	33,10	cyclictest	2648676	-21	fschecks_time	10:50:19	0
2532396	99	45	39,4	cyclictest	2614391	-21	ldconfig	10:10:31	0
2532396	99	45	37,6	cyclictest	2536487	-21	aten_r7power_vo	07:25:17	0
2532396	99	45	36,5	cyclictest	2538884	-21	aten2__	07:35:16	0
2532396	99	45	35,6	cyclictest	2581884	-21	kworker/u4:20-rpciod	10:00:15	0
2532396	99	44	35,7	cyclictest	2556744	-21	aten_r7power_po	08:45:14	0
2532396	99	43	36,5	cyclictest	2481228	-21	kworker/u4:7+events_unbound	07:12:51	0
2532396	99	43	34,7	cyclictest	2546827	-21	fschecks_count	08:05:18	0
2532396	99	42	34,5	cyclictest	2554982	-21	timerandwakeup	08:35:35	0
2532396	99	42	33,6	cyclictest	2548037	-21	fschecks_count	08:10:17	0
2532396	99	42	33,6	cyclictest	2539926	-21	kworker/u4:18+rpciod	07:55:16	0
2532396	99	42	33,5	cyclictest	2537406	-21	kworker/u4:10-rpciod	07:30:34	0
2532396	99	41	27,10	cyclictest	2543562	-21	ls	07:50:38	0
2532396	99	40	31,7	cyclictest	2563001	-21	apt-key	09:10:02	0
2532397	99	33	25,6	cyclictest	0	-21	swapper/1	07:10:01	1
2532396	99	29	20,5	cyclictest	2532345	-21	kworker/u4:2-rpciod	07:10:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17