OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Mon Aug 17, 2026 12:44:07)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4175571	99	105	86,6	cyclictest	134790	-21	kworker/u4:4+events_unbound	11:36:02	0
4175571	99	100	77,7	cyclictest	19463	-21	kworker/u4:20+events_unbound	09:30:33	0
4175572	99	94	80,4	cyclictest	4175497	-21	kworker/u4:7+events_unbound	07:29:55	1
4175572	99	92	84,6	cyclictest	4185829	-21	kworker/u4:20+events_unbound	08:05:12	1
4175571	99	88	80,6	cyclictest	157285	-21	kworker/u4:4+events_unbound	12:16:07	0
4175572	99	86	78,6	cyclictest	4174288	-21	kworker/u4:0+events_unbound	08:00:08	1
4175572	99	85	78,5	cyclictest	4165282	-21	kworker/u4:15+events_unbound	07:14:51	1
4175572	99	85	66,17	cyclictest	27	1	ktimers/1	12:11:55	1
4175571	99	79	71,5	cyclictest	19463	-21	kworker/u4:20+events_unbound	09:20:33	0
4175571	99	76	58,12	cyclictest	75335	-21	apt-get	10:20:13	0
4175572	99	75	64,7	cyclictest	123935	-21	aten_r7power_cu	11:15:17	1
4175571	99	73	66,5	cyclictest	147658	-21	kworker/u4:6+events_unbound	11:46:02	0
4175572	99	72	64,5	cyclictest	27	1	ktimers/1	09:51:50	1
4175572	99	71	61,7	cyclictest	188018	-21	kworker/u4:13+events_unbound	12:36:10	1
4175572	99	71	44,23	cyclictest	53	-21	kswapd0	12:25:09	1
4175571	99	70	49,14	cyclictest	53	-21	kswapd0	09:35:10	0
4175572	99	67	50,10	cyclictest	81675	-21	kworker/u4:12-writeback	10:30:55	1
4175572	99	67	48,5	cyclictest	27	1	ktimers/1	10:41:48	1
4175571	99	67	58,7	cyclictest	7219	-21	kworker/u4:16+events_unbound	09:15:32	0
4175571	99	65	58,5	cyclictest	104117	-21	kworker/u4:5+events_unbound	10:55:54	0
4175571	99	62	55,5	cyclictest	55137	-21	kworker/u4:5+events_unbound	10:00:40	0
4175572	99	61	48,9	cyclictest	3406	-21	modprobe	08:35:01	1
4175572	99	61	47,6	cyclictest	4175497	-21	kworker/u4:7+events_unbound	07:55:44	1
4175571	99	61	44,15	cyclictest	104113	-21	kworker/u4:1+events_unbound	11:01:10	0
4175572	99	60	46,6	cyclictest	4178059	-21	kworker/u4:10+events_unbound	07:17:02	1
4175571	99	60	51,6	cyclictest	4179366	-21	kworker/u4:12+events_unbound	07:35:02	0
4175571	99	58	48,8	cyclictest	0	-21	swapper/0	10:45:35	0
4175571	99	58	43,13	cyclictest	42246	-21	kworker/u4:19+events_unbound	10:10:42	0
4175572	99	57	47,7	cyclictest	3378	-21	kworker/u4:9+events_unbound	09:00:26	1
4175571	99	57	5,18	cyclictest	0	-21	swapper/0	09:25:13	0
4175571	99	57	50,5	cyclictest	99644	-21	kworker/u4:8+events_unbound	10:50:53	0
4175571	99	57	50,5	cyclictest	49617	-21	timerandwakeup	09:50:37	0
4175572	99	56	49,4	cyclictest	62143	-21	/usr/sbin/munin	10:05:18	1
4175571	99	56	48,6	cyclictest	4175494	-21	kworker/u4:3+events_unbound	07:25:00	0
4175571	99	56	48,6	cyclictest	2105	-21	kworker/u4:6+events_unbound	08:35:02	0
4175572	99	55	48,5	cyclictest	2102	-21	kworker/u4:2+events_unbound	08:50:54	1
4175572	99	55	48,5	cyclictest	110994	-21	fschecks_count	11:00:18	1
4175572	99	55	47,6	cyclictest	130337	-21	kworker/u4:15+events_unbound	12:07:45	1
4175572	99	54	47,5	cyclictest	2104	-21	kworker/u4:4+events_unbound	08:40:03	1
4175572	99	54	43,7	cyclictest	154439	-21	cron	11:50:00	1
4175571	99	54	39,9	cyclictest	124189	-21	diskmemload	11:15:22	0
4175571	99	54	12,28	cyclictest	4175569	-21	cyclictest	07:10:00	0
4175572	99	53	47,4	cyclictest	76316	-21	proc_pri	10:20:42	1
4175572	99	53	39,6	cyclictest	2102	-21	kworker/u4:2+events_unbound	09:06:43	1
4175572	99	53	38,7	cyclictest	4175493	-21	kworker/u4:2+events_unbound	07:36:04	1
4175571	99	53	46,5	cyclictest	42246	-21	kworker/u4:19+events_unbound	10:15:03	0
4175571	99	53	37,14	cyclictest	113095	-21	kworker/u4:8+events_unbound	11:21:41	0
4175572	99	52	44,6	cyclictest	146058	-21	/usr/sbin/munin	11:40:16	1
4175572	99	52	44,6	cyclictest	146058	-21	/usr/sbin/munin	11:40:16	1
4175571	99	52	44,6	cyclictest	113095	-21	kworker/u4:8+events_unbound	11:10:57	0
4175571	99	52	44,5	cyclictest	4175569	-21	cyclictest	12:03:21	0
4175571	99	52	44,5	cyclictest	37063	-21	kworker/u4:14+events_unbound	09:55:39	0
4175571	99	52	44,5	cyclictest	130339	-21	kworker/u4:17+events_unbound	11:45:02	0
4175571	99	52	44,5	cyclictest	130339	-21	kworker/u4:17+events_unbound	11:45:02	0
4175571	99	52	34,16	cyclictest	66062	-21	latency_hist	10:10:01	0
4175572	99	51	44,4	cyclictest	73286	-21	kworker/u4:10+events_unbound	10:35:49	1
4175571	99	51	42,7	cyclictest	5255	-21	gltestperf	08:40:21	0
4175571	99	51	41,7	cyclictest	172206	-21	latency_hist	12:10:03	0
4175572	99	50	45,3	cyclictest	27	1	ktimers/1	11:26:51	1
4175572	99	50	43,5	cyclictest	4186943	-21	timerwakeupswit	07:50:38	1
4175572	99	50	41,7	cyclictest	143787	-21	kworker/u4:1+events_unbound	11:56:04	1
4175572	99	50	39,7	cyclictest	0	-21	swapper/1	10:45:40	1
4175571	99	50	8,27	cyclictest	133432	-21	ssh	11:25:32	0
4175571	99	50	43,5	cyclictest	115055	-21	acpi	11:05:12	0
4175571	99	50	35,11	cyclictest	16081	-21	sh	09:13:48	0
4175572	99	49	42,5	cyclictest	48197	-21	cron	09:50:00	1
4175572	99	49	42,5	cyclictest	40930	-21	unixbench_multi	09:40:44	1
4175572	99	49	37,6	cyclictest	0	-21	swapper/1	10:55:37	1
4175571	99	49	42,5	cyclictest	4178059	-21	kworker/u4:10+events_unbound	08:10:17	0
4175571	99	49	40,7	cyclictest	0	-21	swapper/0	11:30:37	0
4175571	99	49	29,4	cyclictest	0	-21	swapper/0	09:45:40	0
4175571	99	49	22,7	cyclictest	130337	-21	kworker/u4:15+events_unbound	12:38:39	0
4175572	99	48	40,6	cyclictest	58533	-21	switchtime	10:00:39	1
4175572	99	48	40,5	cyclictest	0	-21	swapper/1	09:35:34	1
4175572	99	48	39,7	cyclictest	27053	-21	ssh	09:25:33	1
4175572	99	48	38,7	cyclictest	0	-21	swapper/1	10:25:32	1
4175572	99	48	35,8	cyclictest	0	-21	swapper/1	11:15:01	1
4175572	99	48	3,22	cyclictest	71580	-21	ssh	10:15:27	1
4175572	99	48	16,20	cyclictest	0	-21	swapper/1	12:01:04	1
4175571	99	48	42,4	cyclictest	84584	-21	fschecks_time	10:30:21	0
4175571	99	48	41,5	cyclictest	64199	-21	kworker/u4:6+events_unbound	10:40:52	0
4175571	99	48	41,5	cyclictest	4185864	-21	apt	07:50:00	0
4175571	99	48	40,6	cyclictest	68750	-21	kworker/u4:7+events_unbound	10:25:43	0
4175571	99	48	36,9	cyclictest	4697	-21	idleruntime-cro	08:40:00	0
4175572	99	47	41,4	cyclictest	138171	-21	cat	11:30:38	1
4175572	99	47	40,5	cyclictest	4175495	-21	kworker/u4:4+events_unbound	07:22:57	1
4175572	99	47	39,5	cyclictest	6334	-21	df_abs	08:45:18	1
4175572	99	47	36,7	cyclictest	3381	-21	kworker/u4:12-rpciod	09:20:30	1
4175571	99	47	39,6	cyclictest	4176424	-21	proc_pri	07:10:36	0
4175572	99	46	39,5	cyclictest	180941	-21	latency_hist	12:20:01	1
4175572	99	46	38,5	cyclictest	115156	-21	aten_r7power_cu	11:05:16	1
4175572	99	46	37,7	cyclictest	0	-21	swapper/1	11:20:14	1
4175571	99	46	38,6	cyclictest	183549	-21	kworker/u4:0+events_unbound	12:31:10	0
4175571	99	46	38,6	cyclictest	175951	-21	ssh	12:14:12	0
4175572	99	45	37,6	cyclictest	4192127	-21	unixbench_multi	08:10:40	1
4175572	99	45	37,6	cyclictest	181548	-21	fschecks_count	12:20:19	1
4175572	99	45	37,5	cyclictest	9118	-21	gltestperf	08:55:19	1
4175572	99	45	36,7	cyclictest	1235	-21	df_abs	08:25:18	1
4175572	99	45	35,7	cyclictest	0	-21	swapper/1	10:10:41	1
4175572	99	45	35,6	cyclictest	0	-21	swapper/1	09:30:33	1
4175572	99	45	34,8	cyclictest	4178059	-21	kworker/u4:10-xprtiod	07:45:20	1
4175572	99	45	31,10	cyclictest	37	-21	kcompactd0	09:16:32	1
4175571	99	45	39,4	cyclictest	4188786	-21	df_abs	08:00:18	0
4175571	99	45	38,5	cyclictest	181496	-21	/usr/sbin/munin	12:20:19	0
4175571	99	45	38,4	cyclictest	6407	-21	fschecks_count	08:45:21	0
4175571	99	45	37,5	cyclictest	0	-21	swapper/0	08:00:00	0
4175571	99	45	36,7	cyclictest	7473	-21	aten_r7power_en	08:50:16	0
4175571	99	45	28,6	cyclictest	148297	-21	kworker/u4:8+events_unbound	11:51:10	0
4175571	99	45	18,18	cyclictest	53	-21	kswapd0	12:25:10	0
4175572	99	44	36,5	cyclictest	145596	-21	munin-plugin-st	11:40:00	1
4175572	99	44	35,7	cyclictest	3711	-21	aten_r7power_vo	08:35:18	1
4175572	99	44	35,7	cyclictest	190471	-21	gltestperf	12:30:21	1
4175572	99	44	35,7	cyclictest	103018	-21	timerwakeupswit	10:50:41	1
4175572	99	44	34,7	cyclictest	0	-21	swapper/1	09:55:28	1
4175571	99	44	38,4	cyclictest	4183782	-21	fschecks_time	07:40:21	0
4175571	99	44	35,7	cyclictest	4189964	-21	aten_r7power_po	08:05:18	0
4175571	99	44	34,7	cyclictest	4182266	-21	aten_r7power_en	07:35:16	0
4175571	99	44	33,9	cyclictest	89818	-21	unixbench-2d	10:35:43	0
4175571	99	44	27,13	cyclictest	0	-21	swapper/0	07:25:12	0
4175572	99	43	34,6	cyclictest	4181183	-21	fschecks_count	07:30:19	1
4175572	99	43	22,6	cyclictest	17	1	rcu_preempt	08:17:52	1
4175572	99	43	14,6	cyclictest	27	1	ktimers/1	11:50:34	1
4175571	99	43	36,5	cyclictest	12096	-21	xargs	09:05:36	0
4175571	99	43	34,6	cyclictest	826	-21	kworker/u4:15-rpciod	08:25:21	0
4175571	99	43	33,7	cyclictest	4177354	-21	gltestperf	07:15:20	0
4175572	99	42	36,5	cyclictest	827	-21	kworker/u4:16+events_unbound	08:23:02	1
4175572	99	42	35,5	cyclictest	13841	-21	timerandwakeup	09:10:41	1
4175571	99	42	34,6	cyclictest	4186222	-21	df_abs	07:50:17	0
4175571	99	42	33,7	cyclictest	647	-21	timerwakeupswit	08:20:38	0
4175571	99	42	33,5	cyclictest	37061	-21	kworker/u4:8-rpciod	09:40:33	0
4175571	99	41	34,5	cyclictest	1073	-21	snmpd	11:55:31	0
4175571	99	41	34,5	cyclictest	10264	-21	fschecks_count	09:00:19	0
4175571	99	41	31,7	cyclictest	0	-21	swapper/0	08:55:27	0
4175571	99	40	32,6	cyclictest	4193301	-21	timerwakeupswit	08:15:39	0
4175572	99	39	32,4	cyclictest	0	-21	swapper/1	07:40:31	1
4175572	99	34	25,5	cyclictest	0	-21	swapper/1	07:10:00	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17