OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Mon Mar 16, 2026 00:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2827550	99	142	131,7	cyclictest	3019893	-21	kworker/u4:11+events_unbound	00:15:13	1
2827549	99	88	80,5	cyclictest	53	-21	kswapd0	22:35:10	0
2827549	99	85	77,6	cyclictest	2896943	-21	kworker/u4:12+events_unbound	22:26:44	0
2827550	99	81	73,6	cyclictest	2887838	-21	kworker/u4:18+events_unbound	22:31:43	1
2827549	99	81	48,30	cyclictest	2922328	-21	/usr/sbin/munin	22:20:38	0
2827549	99	81	48,30	cyclictest	2922328	-21	/usr/sbin/munin	22:20:37	0
2827549	99	79	44,7	cyclictest	3018546	-21	sed	00:10:21	0
2827549	99	76	68,5	cyclictest	2883236	-21	kworker/u4:0+events_unbound	21:45:41	0
2827549	99	75	67,6	cyclictest	53	-21	kswapd0	23:35:01	0
2827550	99	73	4,31	cyclictest	2877213	-21	ntpq	21:30:24	1
2827550	99	73	39,31	cyclictest	3014899	-21	grep	00:05:40	1
2827549	99	71	61,7	cyclictest	53	-21	kswapd0	22:05:00	0
2827550	99	69	58,8	cyclictest	2919014	-21	kworker/u4:14+events_unbound	22:40:13	1
2827550	99	69	36,30	cyclictest	0	-21	swapper/1	22:55:28	1
2827550	99	68	59,6	cyclictest	2981108	-21	kworker/u4:10+events_unbound	23:37:00	1
2827550	99	68	40,25	cyclictest	2845407	-21	cron	20:19:59	1
2827550	99	68	32,33	cyclictest	3032502	-21	unixbench_singl	00:25:38	1
2827549	99	68	61,4	cyclictest	2887837	-21	kworker/u4:17+events_unbound	21:45:00	0
2827550	99	67	35,29	cyclictest	2912735	-21	fschecks_count	22:10:19	1
2827550	99	66	34,28	cyclictest	2898659	-21	sh	21:55:00	1
2827550	99	66	2,24	cyclictest	1066	-21	snmpd	20:00:30	1
2827550	99	65	34,26	cyclictest	0	-21	swapper/1	23:15:02	1
2827550	99	65	34,26	cyclictest	0	-21	swapper/1	23:15:01	1
2827550	99	65	31,31	cyclictest	2863415	-21	grep	21:15:18	1
2827550	99	65	30,31	cyclictest	0	-21	swapper/1	23:45:34	1
2827550	99	65	30,31	cyclictest	0	-21	swapper/1	20:25:28	1
2827550	99	65	29,31	cyclictest	0	-21	swapper/1	00:00:00	1
2827550	99	64	39,22	cyclictest	2890865	-21	ntpq	21:45:33	1
2827550	99	64	35,26	cyclictest	3009833	-21	kernelversion	00:00:25	1
2827550	99	64	33,28	cyclictest	2983231	-21	/usr/sbin/munin	23:30:19	1
2827550	99	64	29,31	cyclictest	0	-21	swapper/1	21:20:32	1
2827550	99	64	26,36	cyclictest	2928105	-21	kworker/u4:3-rpciod	22:50:27	1
2827550	99	64	19,5	cyclictest	27	1	ktimers/1	22:05:25	1
2827549	99	64	56,6	cyclictest	2949784	-21	kworker/u4:6+events_unbound	22:55:12	0
2827550	99	63	33,27	cyclictest	0	-21	swapper/1	22:00:30	1
2827550	99	63	32,28	cyclictest	0	-21	swapper/1	23:25:17	1
2827550	99	63	31,29	cyclictest	0	-21	swapper/1	00:20:36	1
2827550	99	63	31,28	cyclictest	0	-21	swapper/1	19:59:59	1
2827550	99	63	28,31	cyclictest	3018430	-21	gltestperf	00:10:18	1
2827550	99	63	21,5	cyclictest	0	-21	swapper/1	22:25:17	1
2827549	99	63	49,11	cyclictest	2896503	-21	ssh	21:51:41	0
2827550	99	62	6,53	cyclictest	2992434	-21	ssh	23:40:27	1
2827550	99	62	3,20	cyclictest	2886270	-21	ssh	21:40:28	1
2827550	99	62	29,30	cyclictest	2858009	-21	switchtime	21:05:35	1
2827550	99	62	26,32	cyclictest	0	-21	swapper/1	21:25:39	1
2827550	99	62	2,18	cyclictest	2935283	-21	ssh	22:35:26	1
2827550	99	61	27,30	cyclictest	2850775	-21	latency_hist	20:40:02	1
2827550	99	61	26,32	cyclictest	0	-21	swapper/1	21:35:25	1
2827550	99	60	31,26	cyclictest	0	-21	swapper/1	23:05:42	1
2827550	99	60	31,26	cyclictest	0	-21	swapper/1	21:55:30	1
2827550	99	60	28,30	cyclictest	2972180	-21	kworker/u4:5+rpciod	23:21:23	1
2827550	99	60	27,30	cyclictest	0	-21	swapper/1	22:45:28	1
2827550	99	60	26,32	cyclictest	2834047	-21	latency_hist	19:35:01	1
2827550	99	60	25,32	cyclictest	0	-21	swapper/1	23:15:28	1
2827550	99	60	23,34	cyclictest	0	-21	swapper/1	22:20:41	1
2827550	99	60	23,34	cyclictest	0	-21	swapper/1	22:20:40	1
2827550	99	60	22,35	cyclictest	0	-21	swapper/1	21:10:17	1
2827550	99	60	22,35	cyclictest	0	-21	swapper/1	21:10:17	1
2827549	99	60	52,6	cyclictest	2908225	-21	fschecks_count	22:05:19	0
2827549	99	60	51,6	cyclictest	2948000	-21	df_abs	22:50:18	0
2827550	99	59	3,20	cyclictest	3036298	-21	ntpq	00:30:32	1
2827550	99	59	29,27	cyclictest	0	-21	swapper/1	20:35:01	1
2827549	99	59	45,11	cyclictest	2934362	-21	latency_hist	22:35:01	0
2827550	99	58	29,25	cyclictest	0	-21	swapper/1	21:00:34	1
2827550	99	58	28,28	cyclictest	2960684	-21	awk	23:05:00	1
2827550	99	58	26,29	cyclictest	2853152	-21	kworker/u4:12+rpciod	21:00:00	1
2827550	99	58	22,32	cyclictest	0	-21	swapper/1	00:35:39	1
2827549	99	58	50,6	cyclictest	2840270	-21	kworker/u4:6+events_unbound	20:35:01	0
2827549	99	58	49,7	cyclictest	2835166	-21	kworker/u4:14+events_unbound	19:46:09	0
2827549	99	58	49,6	cyclictest	2998273	-21	kworker/u4:4+events_unbound	23:55:01	0
2827549	99	58	49,6	cyclictest	2998273	-21	kworker/u4:4+events_unbound	23:55:00	0
2827549	99	58	44,10	cyclictest	3027016	-21	cpu	00:20:16	0
2827550	99	57	29,25	cyclictest	0	-21	swapper/1	22:15:25	1
2827550	99	57	22,33	cyclictest	0	-21	swapper/1	19:35:20	1
2827550	99	57	21,32	cyclictest	0	-21	swapper/1	23:50:35	1
2827550	99	57	21,32	cyclictest	0	-21	swapper/1	23:50:35	1
2827549	99	57	47,7	cyclictest	3020539	-21	kworker/u4:13+events_unbound	00:28:45	0
2827550	99	56	23,30	cyclictest	2828043	-21	fschecks_time	19:10:18	1
2827549	99	56	49,5	cyclictest	2896943	-21	kworker/u4:12+events_unbound	21:55:02	0
2827549	99	56	45,7	cyclictest	0	-21	swapper/0	23:05:32	0
2827549	99	56	35,10	cyclictest	2839019	-21	kworker/u4:16	19:55:01	0
2827549	99	55	50,4	cyclictest	2827548	-21	cyclictest	23:16:52	0
2827549	99	55	47,6	cyclictest	2978885	-21	cut	23:25:20	0
2827550	99	54	23,28	cyclictest	2837010	-21	gltestperf	19:45:18	1
2827550	99	54	22,29	cyclictest	0	-21	swapper/1	20:50:22	1
2827550	99	54	22,29	cyclictest	0	-21	swapper/1	20:50:21	1
2827549	99	54	7,20	cyclictest	2840284	-21	modprobe	19:59:59	0
2827549	99	54	47,5	cyclictest	2967703	-21	kworker/u4:1+events_unbound	23:47:00	0
2827549	99	54	46,6	cyclictest	398	-21	systemd-logind	23:36:58	0
2827549	99	54	33,18	cyclictest	0	-21	swapper/0	21:35:25	0
2827550	99	53	21,4	cyclictest	0	-21	swapper/1	20:35:38	1
2827550	99	53	20,30	cyclictest	0	-21	swapper/1	20:15:00	1
2827550	99	53	17,6	cyclictest	0	-21	swapper/1	20:20:45	1
2827549	99	53	38,12	cyclictest	2917945	-21	cat	22:15:37	0
2827550	99	52	47,3	cyclictest	0	-21	swapper/1	19:50:34	1
2827550	99	52	22,27	cyclictest	0	-21	swapper/1	20:45:21	1
2827550	99	52	21,28	cyclictest	0	-21	swapper/1	19:25:27	1
2827550	99	52	20,29	cyclictest	0	-21	swapper/1	20:40:37	1
2827550	99	52	15,9	cyclictest	378	-21	dbus-daemon	19:21:05	1
2827549	99	52	45,5	cyclictest	2954281	-21	kworker/u4:11+events_unbound	23:05:01	0
2827549	99	52	44,5	cyclictest	2954279	-21	kworker/u4:9+events_unbound	23:21:54	0
2827550	99	51	19,6	cyclictest	0	-21	swapper/1	19:40:15	1
2827549	99	51	44,5	cyclictest	3040234	-21	df_abs	00:35:18	0
2827549	99	51	43,6	cyclictest	2943856	-21	/usr/sbin/munin	22:45:19	0
2827549	99	51	43,6	cyclictest	2764653	-21	kworker/u4:7+events_unbound	19:21:06	0
2827550	99	50	21,27	cyclictest	0	-21	swapper/1	19:15:37	1
2827549	99	49	40,7	cyclictest	2825048	-21	kworker/u4:2+events_unbound	20:20:58	0
2827549	99	49	40,6	cyclictest	2915780	-21	ssh	22:13:50	0
2827549	99	49	39,8	cyclictest	3036118	-21	gltestperf	00:30:28	0
2827549	99	49	39,8	cyclictest	2845612	-21	apt-key	20:20:02	0
2827549	99	49	39,7	cyclictest	2865627	-21	kworker/u4:8+events_unbound	21:26:23	0
2827549	99	48	41,5	cyclictest	2877633	-21	awk	21:30:38	0
2827549	99	48	39,7	cyclictest	0	-21	swapper/0	23:40:12	0
2827549	99	48	37,8	cyclictest	2827835	-21	aten_r7power_vo	19:10:17	0
2827549	99	48	26,20	cyclictest	2867531	-21	/usr/sbin/munin	21:20:38	0
2827550	99	47	18,26	cyclictest	0	-21	swapper/1	20:05:19	1
2827549	99	47	40,5	cyclictest	3010180	-21	ps	00:00:39	0
2827549	99	47	40,5	cyclictest	2842161	-21	gltestperf	20:05:19	0
2827549	99	46	39,5	cyclictest	2833113	-21	fschecks_time	19:30:21	0
2827549	99	46	39,4	cyclictest	2856464	-21	sshd	21:00:21	0
2827549	99	46	38,6	cyclictest	2849817	-21	fschecks_time	20:35:19	0
2827549	99	46	38,6	cyclictest	2849817	-21	fschecks_time	20:35:18	0
2827549	99	46	38,6	cyclictest	2830061	-21	kworker/u4:9+events_unbound	19:41:08	0
2827549	99	46	32,7	cyclictest	0	-21	swapper/0	23:55:21	0
2827549	99	45	38,5	cyclictest	1066	-21	snmpd	22:40:17	0
2827549	99	45	36,7	cyclictest	2857257	-21	aten_r7power_en	21:05:15	0
2827549	99	45	34,8	cyclictest	2834169	-21	aten_r7power_en	19:35:16	0
2827549	99	44	4,36	cyclictest	0	-21	swapper/0	21:15:37	0
2827549	99	44	36,6	cyclictest	2830107	-21	kworker/u4:8	19:20:01	0
2827549	99	44	35,7	cyclictest	2859821	-21	unixbench-2d	21:10:41	0
2827549	99	44	35,7	cyclictest	2859821	-21	unixbench-2d	21:10:40	0
2827549	99	44	33,7	cyclictest	0	-21	swapper/0	20:45:40	0
2827549	99	44	23,18	cyclictest	0	-21	swapper/0	00:10:00	0
2827549	99	44	21,21	cyclictest	0	-21	swapper/0	20:55:15	0
2827549	99	43	34,7	cyclictest	2840729	-21	fschecks_count	20:00:20	0
2827549	99	42	33,6	cyclictest	0	-21	swapper/0	20:50:24	0
2827549	99	42	33,6	cyclictest	0	-21	swapper/0	20:50:23	0
2827549	99	42	32,8	cyclictest	3022792	-21	fschecks_time	00:15:20	0
2827549	99	42	32,8	cyclictest	2965445	-21	aten_r7power_cu	23:10:16	0
2827549	99	42	32,8	cyclictest	2965445	-21	aten_r7power_cu	23:10:15	0
2827549	99	41	33,5	cyclictest	2851123	-21	fschecks_time	20:40:19	0
2827549	99	41	30,8	cyclictest	2831911	-21	gltestperf	19:25:19	0
2827549	99	40	31,6	cyclictest	0	-21	swapper/0	20:25:30	0
2827549	99	39	25,9	cyclictest	0	-21	swapper/0	20:10:22	0
2827549	99	36	28,4	cyclictest	0	-21	swapper/0	19:09:59	0
2827550	99	29	20,7	cyclictest	0	-21	swapper/1	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17