OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Tue Apr 07, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
281548	99	126	113,5	cyclictest	481738	-21	kworker/u4:1+events_unbound	12:30:00	0
281548	99	112	99,6	cyclictest	328388	-21	kworker/u4:3+events_unbound	09:34:31	0
281548	99	100	83,7	cyclictest	460274	-21	kworker/u4:0+events_unbound	11:59:55	0
281550	99	98	90,5	cyclictest	416750	-21	kworker/u4:2+events_unbound	11:14:50	1
281548	99	98	91,5	cyclictest	385608	-21	kworker/u4:10+events_unbound	10:49:46	0
281548	99	98	90,6	cyclictest	332912	-21	kworker/u4:2+events_unbound	09:54:34	0
281550	99	96	89,5	cyclictest	282765	-21	kworker/u4:5+events_unbound	07:49:16	1
281548	99	95	88,5	cyclictest	359448	-21	kworker/u4:12+events_unbound	10:09:37	0
281550	99	92	85,5	cyclictest	319340	-21	kworker/u4:4+events_unbound	09:19:31	1
281550	99	92	85,5	cyclictest	319340	-21	kworker/u4:4+events_unbound	09:19:30	1
281548	99	92	85,5	cyclictest	434455	-21	kworker/u4:6+events_unbound	11:34:55	0
281548	99	92	85,5	cyclictest	434455	-21	kworker/u4:6+events_unbound	11:34:54	0
281548	99	92	84,6	cyclictest	455858	-21	kworker/u4:11+events_unbound	12:04:57	0
281548	99	91	83,6	cyclictest	342023	-21	kworker/u4:7+events_unbound	09:44:32	0
281550	99	87	80,5	cyclictest	385608	-21	kworker/u4:10+events_unbound	11:04:49	1
281548	99	85	70,5	cyclictest	416750	-21	kworker/u4:2+events_unbound	11:09:51	0
281550	99	80	73,5	cyclictest	284036	-21	kworker/u4:15+events_unbound	09:09:27	1
281550	99	80	72,6	cyclictest	299538	-21	kworker/u4:17+events_unbound	08:19:20	1
281550	99	79	71,5	cyclictest	363935	-21	kworker/u4:4+events_unbound	10:29:42	1
281550	99	79	70,7	cyclictest	464720	-21	kworker/u4:3+events_unbound	12:20:00	1
281550	99	78	65,5	cyclictest	294342	-21	kworker/u4:3+events_unbound	08:24:21	1
281550	99	76	68,6	cyclictest	311146	-21	kworker/u4:1+events_unbound	09:14:29	1
281550	99	75	68,5	cyclictest	372846	-21	kworker/u4:2+events_unbound	10:19:42	1
281550	99	75	68,5	cyclictest	372846	-21	kworker/u4:2+events_unbound	10:19:41	1
281550	99	75	55,12	cyclictest	343686	-21	modprobe	09:45:00	1
281548	99	75	68,5	cyclictest	469120	-21	kworker/u4:8+events_unbound	12:09:58	0
281548	99	75	67,6	cyclictest	294343	-21	kworker/u4:7+events_unbound	08:09:19	0
281550	99	74	67,5	cyclictest	282767	-21	kworker/u4:13+events_unbound	07:15:01	1
281548	99	73	65,6	cyclictest	385608	-21	kworker/u4:10+events_unbound	10:54:48	0
281550	99	72	59,5	cyclictest	282766	-21	kworker/u4:12+events_unbound	07:39:16	1
281550	99	70	63,5	cyclictest	295642	-21	kworker/u4:10+events_unbound	08:34:21	1
281548	99	68	55,5	cyclictest	328386	-21	kworker/u4:1+events_unbound	09:39:32	0
281550	99	67	61,4	cyclictest	280268	-21	kworker/u4:11+events_unbound	07:19:13	1
281550	99	67	59,6	cyclictest	300847	-21	kworker/u4:19+events_unbound	08:59:27	1
281548	99	67	61,4	cyclictest	293072	-21	kworker/u4:0+events_unbound	07:55:01	0
281550	99	66	53,5	cyclictest	295642	-21	kworker/u4:10+events_unbound	08:04:18	1
281548	99	66	47,7	cyclictest	385608	-21	kworker/u4:10+events_unbound	11:15:35	0
281550	99	64	56,6	cyclictest	284035	-21	kworker/u4:14+events_unbound	08:14:21	1
281550	99	64	49,6	cyclictest	469120	-21	kworker/u4:8+events_unbound	12:11:41	1
281548	99	64	45,5	cyclictest	346514	-21	kworker/u4:1+events_unbound	10:05:00	0
281550	99	63	56,5	cyclictest	377336	-21	kworker/u4:7+events_unbound	10:24:40	1
281550	99	62	42,9	cyclictest	323865	-21	kworker/u4:7+events_unbound	09:23:32	1
281550	99	61	54,5	cyclictest	432656	-21	ld	11:25:29	1
281548	99	61	53,6	cyclictest	346514	-21	kworker/u4:1+events_unbound	09:49:33	0
281550	99	60	52,6	cyclictest	300847	-21	kworker/u4:19+events_unbound	08:49:24	1
281550	99	60	52,5	cyclictest	282766	-21	kworker/u4:12+events_unbound	07:44:16	1
281550	99	60	44,7	cyclictest	455858	-21	kworker/u4:11+events_unbound	11:56:00	1
281548	99	60	53,5	cyclictest	434455	-21	kworker/u4:6+events_unbound	11:29:53	0
281550	99	59	52,5	cyclictest	407851	-21	kworker/u4:3+events_unbound	10:59:49	1
281548	99	59	45,6	cyclictest	429430	-21	kworker/u4:5+events_unbound	11:36:59	0
281550	99	58	45,8	cyclictest	0	-21	swapper/1	11:05:32	1
281548	99	58	51,4	cyclictest	0	-21	swapper/0	12:15:13	0
281548	99	58	41,15	cyclictest	405740	-21	aten2__	10:55:16	0
281550	99	57	45,9	cyclictest	310773	-21	ps	09:00:35	1
281548	99	57	47,8	cyclictest	383285	-21	sshd	10:29:41	0
281550	99	56	49,5	cyclictest	395143	-21	kworker/u4:0+events_unbound	10:43:01	1
281548	99	55	49,4	cyclictest	233126	-21	kworker/u4:4+events_unbound	07:24:14	0
281548	99	55	48,5	cyclictest	412330	-21	kworker/u4:9+events_unbound	11:04:57	0
281550	99	53	46,5	cyclictest	447033	-21	kworker/u4:3+events_unbound	11:42:59	1
281550	99	53	39,5	cyclictest	447035	-21	kworker/u4:7+events_unbound	11:51:00	1
281548	99	53	46,5	cyclictest	318227	-21	grep	09:15:36	0
281548	99	53	46,5	cyclictest	318227	-21	grep	09:15:36	0
281548	99	53	42,5	cyclictest	469122	-21	kworker/u4:12+events_unbound	12:25:01	0
281548	99	53	36,5	cyclictest	451446	-21	kworker/u4:0+events_unbound	11:49:53	0
281548	99	53	33,17	cyclictest	0	-21	swapper/0	10:30:33	0
281548	99	53	31,6	cyclictest	359448	-21	kworker/u4:12+events_unbound	10:10:04	0
281550	99	52	45,5	cyclictest	332912	-21	kworker/u4:2+events_unbound	09:36:00	1
281550	99	52	41,9	cyclictest	467865	-21	timerwakeupswit	12:05:39	1
281550	99	52	36,9	cyclictest	0	-21	swapper/1	11:35:37	1
281550	99	52	33,7	cyclictest	300847	-21	kworker/u4:19+events_unbound	08:50:58	1
281548	99	52	45,5	cyclictest	492417	-21	munin-run	12:35:00	0
281548	99	52	38,9	cyclictest	496869	-21	cat	12:40:02	0
281548	99	52	30,20	cyclictest	454697	-21	switchtime	11:50:38	0
281550	99	51	4,31	cyclictest	489212	-21	ntpq	12:30:33	1
281550	99	51	42,7	cyclictest	286612	-21	kworker/u4:8+events_unbound	08:10:00	1
281550	99	51	42,6	cyclictest	304323	-21	sendmail_mailqu	08:35:35	1
281550	99	51	40,9	cyclictest	496792	-21	sshd	12:40:01	1
281550	99	51	36,12	cyclictest	484442	-21	fschecks_time	12:25:21	1
281550	99	50	42,6	cyclictest	337456	-21	kworker/u4:0+events_unbound	09:58:42	1
281548	99	50	32,6	cyclictest	385608	-21	kworker/u4:10+events_unbound	11:11:59	0
281548	99	50	2,37	cyclictest	353582	-21	ntpq	09:55:24	0
281550	99	49	41,6	cyclictest	280268	-21	kworker/u4:11+events_unbound	07:23:04	1
281550	99	49	36,9	cyclictest	0	-21	swapper/1	08:45:00	1
281548	99	49	42,5	cyclictest	392277	-21	basename	10:40:01	0
281548	99	49	42,5	cyclictest	326673	-21	gltestperf	09:25:20	0
281548	99	49	40,6	cyclictest	294415	-21	sendmail	08:00:00	0
281548	99	48	40,5	cyclictest	378774	-21	sh	10:24:29	0
281548	99	48	40,5	cyclictest	290623	-21	latency_hist	07:45:01	0
281548	99	48	39,5	cyclictest	428223	-21	/usr/sbin/munin	11:20:23	0
281548	99	48	38,8	cyclictest	393535	-21	open_inodes	10:40:41	0
281548	99	48	37,8	cyclictest	308648	-21	apt-key	08:55:02	0
281548	99	48	35,6	cyclictest	282765	-21	kworker/u4:5+events_unbound	07:48:00	0
281550	99	47	4,31	cyclictest	367064	-21	sh	10:10:32	1
281550	99	47	41,4	cyclictest	331657	-21	switchtime	09:30:37	1
281550	99	47	40,5	cyclictest	440317	-21	munin-run	11:35:00	1
281550	99	47	40,5	cyclictest	440317	-21	munin-run	11:35:00	1
281550	99	47	37,7	cyclictest	390758	-21	sshd	10:37:41	1
281550	99	47	34,9	cyclictest	292897	-21	timerwakeupswit	07:50:36	1
281548	99	47	39,5	cyclictest	307156	-21	unixbench_multi	08:45:38	0
281548	99	47	37,8	cyclictest	313394	-21	/usr/sbin/munin	09:10:24	0
281550	99	46	6,29	cyclictest	402049	-21	sh	10:50:28	1
281550	99	46	38,6	cyclictest	462787	-21	gltestperf	12:00:20	1
281550	99	46	38,5	cyclictest	287727	-21	timerwakeupswit	07:30:37	1
281550	99	46	38,5	cyclictest	286456	-21	timerwakeupswit	07:25:37	1
281550	99	46	37,6	cyclictest	397423	-21	gltestperf	10:45:21	1
281550	99	46	35,8	cyclictest	366026	-21	latency_hist	10:10:01	1
281548	99	46	37,6	cyclictest	0	-21	swapper/0	10:15:36	0
281548	99	46	37,6	cyclictest	0	-21	swapper/0	10:15:36	0
281548	99	46	37,5	cyclictest	319340	-21	kworker/u4:4-rpciod	09:20:37	0
281548	99	46	36,8	cyclictest	301982	-21	unixbench-2d	08:25:36	0
281548	99	46	31,5	cyclictest	469120	-21	kworker/u4:8+events_unbound	12:12:13	0
281548	99	46	27,17	cyclictest	445604	-21	diskmemload	11:40:25	0
281550	99	45	37,6	cyclictest	342022	-21	kworker/u4:6+events_unbound	09:52:39	1
281550	99	45	36,7	cyclictest	357438	-21	aten2__	10:00:15	1
281550	99	45	35,7	cyclictest	0	-21	swapper/1	11:24:50	1
281550	99	45	35,7	cyclictest	0	-21	swapper/1	09:25:30	1
281550	99	45	34,8	cyclictest	384078	-21	/usr/sbin/munin	10:30:18	1
281550	99	45	34,7	cyclictest	0	-21	swapper/1	09:45:26	1
281550	99	45	33,10	cyclictest	0	-21	swapper/1	11:15:30	1
281548	99	45	40,3	cyclictest	19	1	rcuc/0	09:09:27	0
281548	99	45	30,5	cyclictest	311147	-21	kworker/u4:8+events_unbound	09:05:01	0
281550	99	44	36,6	cyclictest	449350	-21	aten_r7power_cu	11:45:16	1
281548	99	44	36,5	cyclictest	281546	-21	cyclictest	07:30:29	0
281548	99	43	36,5	cyclictest	285864	-21	fschecks_time	07:25:19	0
281548	99	43	22,19	cyclictest	298236	-21	http	08:15:00	0
281550	99	42	30,8	cyclictest	294342	-21	kworker/u4:3-rpciod	08:25:20	1
281550	99	42	29,5	cyclictest	469121	-21	kworker/u4:9-xprtiod	12:20:31	1
281548	99	42	34,5	cyclictest	295269	-21	grep	08:00:35	0
281548	99	42	34,5	cyclictest	282765	-21	kworker/u4:5-xprtiod	08:55:10	0
281548	99	42	33,7	cyclictest	0	-21	swapper/0	07:35:36	0
281548	99	42	31,8	cyclictest	302585	-21	fschecks_count	08:30:17	0
281550	99	41	29,9	cyclictest	294405	-21	idleruntime-cro	08:00:01	1
281548	99	41	31,7	cyclictest	298793	-21	fschecks_time	08:15:23	0
281548	99	40	30,8	cyclictest	284136	-21	latency_hist	07:20:02	0
281548	99	39	32,5	cyclictest	269070	-21	kworker/u4:8+events_unbound	07:14:14	0
281548	99	39	31,6	cyclictest	299886	-21	aten_r7power_po	08:20:17	0
281548	99	38	29,6	cyclictest	305176	-21	grep	08:40:18	0
281548	99	37	29,5	cyclictest	0	-21	swapper/0	08:35:20	0
281548	99	31	24,4	cyclictest	0	-21	swapper/0	07:10:02	0
281548	99	31	24,4	cyclictest	0	-21	swapper/0	07:10:01	0
281550	99	29	20,7	cyclictest	281656	-21	latency_hist	07:10:02	1
281550	99	29	20,7	cyclictest	281656	-21	latency_hist	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17