OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Sat Jul 11, 2026 00:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4157175	99	115	101,5	cyclictest	151241	-21	kworker/u4:16+events_unbound	00:11:26	0
4157175	99	115	101,5	cyclictest	151241	-21	kworker/u4:16+events_unbound	00:11:25	0
4157176	99	114	106,6	cyclictest	63668	-21	kworker/u4:6+events_unbound	22:31:11	1
4157175	99	105	95,4	cyclictest	4159686	-21	kworker/u4:13+events_unbound	19:35:32	0
4157175	99	102	95,5	cyclictest	116562	-21	kworker/u4:13+events_unbound	23:52:31	0
4157175	99	99	90,7	cyclictest	4157109	-21	kworker/u4:7+events_unbound	19:40:32	0
4157176	99	98	90,6	cyclictest	72678	-21	kworker/u4:2+events_unbound	22:46:14	1
4157176	99	96	89,5	cyclictest	103189	-21	kworker/u4:10+events_unbound	23:16:18	1
4157176	99	91	83,5	cyclictest	4190224	-21	kworker/u4:12+events_unbound	21:15:53	1
4157175	99	88	81,5	cyclictest	59134	-21	kworker/u4:11+events_unbound	22:26:10	0
4157176	99	87	80,5	cyclictest	4183955	-21	kworker/u4:16+events_unbound	20:55:50	1
4157175	99	87	74,6	cyclictest	120953	-21	kworker/u4:15+events_unbound	23:41:22	0
4157175	99	86	79,5	cyclictest	4166082	-21	kworker/u4:8+events_unbound	20:40:44	0
4157176	99	85	78,5	cyclictest	146169	-21	kworker/u4:14+events_unbound	00:18:37	1
4157175	99	85	71,6	cyclictest	5401	-21	kworker/u4:17+events_unbound	21:25:56	0
4157175	99	85	71,6	cyclictest	5401	-21	kworker/u4:17+events_unbound	21:25:55	0
4157176	99	84	76,6	cyclictest	94328	-21	kworker/u4:6+events_unbound	23:21:20	1
4157176	99	84	72,5	cyclictest	4186613	-21	kworker/u4:5+events_unbound	21:05:52	1
4157175	99	83	74,6	cyclictest	146168	-21	kworker/u4:12+events_unbound	00:05:03	0
4157175	99	82	73,7	cyclictest	98732	-21	kworker/u4:8+events_unbound	23:11:20	0
4157175	99	80	72,6	cyclictest	146168	-21	kworker/u4:12+events_unbound	00:02:43	0
4157176	99	75	60,12	cyclictest	27	1	ktimers/1	21:26:57	1
4157176	99	75	60,12	cyclictest	27	1	ktimers/1	21:26:56	1
4157175	99	75	41,29	cyclictest	53	-21	kswapd0	22:35:07	0
4157175	99	74	66,6	cyclictest	9929	-21	kworker/u4:3+events_unbound	21:30:59	0
4157176	99	73	65,6	cyclictest	4176307	-21	kworker/u4:3+events_unbound	20:35:43	1
4157175	99	70	57,6	cyclictest	76523	-21	kworker/u4:3+events_unbound	22:56:17	0
4157176	99	69	60,7	cyclictest	94327	-21	kworker/u4:5+events_unbound	23:26:21	1
4157175	99	69	63,4	cyclictest	23586	-21	kworker/u4:9+events_unbound	21:45:04	0
4157175	99	66	60,4	cyclictest	4172459	-21	kworker/u4:13+events_unbound	20:50:49	0
4157175	99	66	55,4	cyclictest	4181413	-21	kworker/u4:0+events_unbound	21:00:03	0
4157176	99	62	48,7	cyclictest	146168	-21	kworker/u4:12+events_unbound	00:15:01	1
4157176	99	62	48,7	cyclictest	146168	-21	kworker/u4:12+events_unbound	00:15:00	1
4157176	99	62	48,5	cyclictest	137337	-21	kworker/u4:5+events_unbound	23:53:46	1
4157175	99	61	52,7	cyclictest	53	-21	kswapd0	23:00:20	0
4157176	99	60	47,9	cyclictest	3943	-21	/usr/sbin/munin	21:20:26	1
4157175	99	60	52,6	cyclictest	89870	-21	kworker/u4:1+events_unbound	23:06:19	0
4157175	99	60	43,14	cyclictest	53	-21	kswapd0	00:35:11	0
4157176	99	59	46,9	cyclictest	171590	-21	wc	00:30:38	1
4157175	99	59	48,4	cyclictest	4172460	-21	kworker/u4:15+events_unbound	20:15:02	0
4157175	99	59	3,45	cyclictest	4193445	-21	sh	21:15:29	0
4157176	99	58	49,7	cyclictest	4163053	-21	sshd	19:30:29	1
4157175	99	58	50,6	cyclictest	4135049	-21	kworker/u4:1+events_unbound	21:20:55	0
4157175	99	58	48,6	cyclictest	35465	-21	processes	21:55:37	0
4157175	99	58	35,15	cyclictest	53	-21	kswapd0	23:55:09	0
4157176	99	57	47,7	cyclictest	53	-21	kswapd0	22:30:01	1
4157175	99	56	35,18	cyclictest	43117	-21	sh	22:05:00	0
4157176	99	55	48,5	cyclictest	76523	-21	kworker/u4:3+events_unbound	23:01:18	1
4157176	99	55	46,6	cyclictest	0	-21	swapper/1	19:45:32	1
4157176	99	55	44,7	cyclictest	26554	-21	ps	21:45:37	1
4157176	99	55	30,4	cyclictest	50058	-21	kworker/u4:0+events_unbound	22:18:17	1
4157175	99	55	48,5	cyclictest	4172459	-21	kworker/u4:13+events_unbound	20:45:47	0
4157176	99	54	48,4	cyclictest	177228	-21	kworker/u4:7+events_unbound	00:40:01	1
4157176	99	53	45,6	cyclictest	4155903	-21	kworker/u4:6+events_unbound	19:10:04	1
4157176	99	53	42,8	cyclictest	4170822	-21	systemd	20:00:35	1
4157176	99	53	31,7	cyclictest	27469	-21	kworker/u4:10+events_unbound	22:04:15	1
4157175	99	53	44,7	cyclictest	9927	-21	kworker/u4:1+events_unbound	21:41:46	0
4157175	99	53	42,5	cyclictest	45533	-21	kworker/u4:3+events_unbound	22:11:09	0
4157176	99	52	46,4	cyclictest	4186613	-21	kworker/u4:5+events_unbound	21:05:00	1
4157175	99	52	43,6	cyclictest	0	-21	swapper/0	22:45:33	0
4157175	99	52	40,9	cyclictest	162812	-21	/usr/sbin/munin	00:20:37	0
4157175	99	52	40,9	cyclictest	162812	-21	/usr/sbin/munin	00:20:36	0
4157175	99	52	40,5	cyclictest	45531	-21	kworker/u4:1+events_unbound	22:07:45	0
4157175	99	52	30,18	cyclictest	0	-21	swapper/0	00:18:26	0
4157176	99	51	43,6	cyclictest	68187	-21	kworker/u4:8+events_unbound	22:53:45	1
4157176	99	51	40,7	cyclictest	0	-21	swapper/1	19:40:32	1
4157176	99	51	25,8	cyclictest	19005	-21	kworker/u4:6+events_unbound	21:40:44	1
4157175	99	51	43,6	cyclictest	4157173	-21	cyclictest	21:50:12	0
4157176	99	50	44,4	cyclictest	50060	-21	kworker/u4:6+events_unbound	22:20:02	1
4157176	99	50	40,7	cyclictest	0	-21	swapper/1	19:50:34	1
4157176	99	50	33,8	cyclictest	133545	-21	kworker/u4:4+events_unbound	23:48:28	1
4157176	99	50	19,14	cyclictest	142187	-21	ssh	23:56:57	1
4157175	99	50	42,5	cyclictest	74551	-21	rm	22:40:12	0
4157175	99	50	42,5	cyclictest	114989	-21	mailstats	23:25:35	0
4157175	99	50	38,7	cyclictest	4161000	-21	kworker/u4:14	19:25:01	0
4157176	99	49	43,4	cyclictest	44632	-21	unixbench-2d	22:05:40	1
4157176	99	49	42,5	cyclictest	71071	-21	gcc	22:35:40	1
4157176	99	49	42,4	cyclictest	34817	-21	fschecks_count	21:55:17	1
4157176	99	49	40,7	cyclictest	149099	-21	ssh	00:05:20	1
4157176	99	49	28,6	cyclictest	141751	-21	kworker/u4:10+events_unbound	00:00:55	1
4157176	99	49	26,6	cyclictest	4187879	-21	kworker/u4:7+events_unbound	21:10:59	1
4157175	99	49	41,6	cyclictest	4157436	-21	aten_r7power_po	19:10:14	0
4157175	99	49	41,5	cyclictest	123117	-21	gltestperf	23:35:20	0
4157175	99	49	38,8	cyclictest	4171764	-21	gltestperf	20:05:21	0
4157175	99	49	30,17	cyclictest	131564	-21	sed	23:45:16	0
4157176	99	48	41,5	cyclictest	48913	-21	mailstats	22:10:38	1
4157176	99	48	41,5	cyclictest	118737	-21	fschecks_time	23:30:20	1
4157176	99	48	40,6	cyclictest	0	-21	swapper/1	21:30:57	1
4157176	99	48	40,5	cyclictest	4174208	-21	fschecks_count	20:15:18	1
4157176	99	48	39,6	cyclictest	4187915	-21	diskmemload	22:55:23	1
4157176	99	48	39,6	cyclictest	0	-21	swapper/1	20:30:41	1
4157176	99	48	38,7	cyclictest	0	-21	swapper/1	21:35:27	1
4157175	99	48	40,6	cyclictest	4158888	-21	fschecks_time	19:15:19	0
4157175	99	48	37,9	cyclictest	4170854	-21	processes	20:00:36	0
4157175	99	48	37,8	cyclictest	69919	-21	sh	22:35:02	0
4157175	99	48	27,19	cyclictest	0	-21	swapper/0	00:25:22	0
4157176	99	47	41,4	cyclictest	98732	-21	kworker/u4:8-rpciod	23:11:18	1
4157176	99	47	40,5	cyclictest	4171192	-21	kworker/u4:5+events_unbound	20:05:02	1
4157176	99	47	38,6	cyclictest	30433	-21	fschecks_time	21:50:17	1
4157176	99	47	38,6	cyclictest	162030	-21	aten_r7power_po	00:20:16	1
4157176	99	47	38,6	cyclictest	162030	-21	aten_r7power_po	00:20:15	1
4157175	99	47	39,5	cyclictest	4189371	-21	/usr/sbin/munin	21:10:37	0
4157175	99	47	38,6	cyclictest	115916	-21	kworker/u4:12-rpciod	23:35:02	0
4157175	99	47	38,6	cyclictest	106163	-21	grep	23:15:37	0
4157175	99	47	37,7	cyclictest	0	-21	swapper/0	19:55:34	0
4157175	99	47	33,6	cyclictest	17	1	rcu_preempt	22:15:21	0
4157175	99	47	32,5	cyclictest	168358	-21	kworker/u4:2+events_unbound	00:30:45	0
4157175	99	47	29,15	cyclictest	0	-21	swapper/0	22:55:00	0
4157176	99	46	40,4	cyclictest	166306	-21	aten_r7power_cu	00:25:16	1
4157176	99	46	39,5	cyclictest	75796	-21	grep	22:40:40	1
4157176	99	46	39,5	cyclictest	4158787	-21	df_abs	19:15:16	1
4157176	99	46	38,6	cyclictest	97569	-21	/usr/sbin/munin	23:05:38	1
4157175	99	46	38,5	cyclictest	4178175	-21	gltestperf	20:30:20	0
4157175	99	46	37,7	cyclictest	56895	-21	/usr/sbin/munin	22:20:15	0
4157176	99	45	37,6	cyclictest	4172742	-21	aten_r7power_po	20:10:22	1
4157176	99	45	26,6	cyclictest	111467	-21	kworker/u4:8+events_unbound	23:39:05	1
4157175	99	45	38,5	cyclictest	4185294	-21	lockfile-remove	21:00:01	0
4157175	99	45	36,7	cyclictest	17230	-21	/usr/sbin/munin	21:35:21	0
4157175	99	45	33,9	cyclictest	4167890	-21	fschecks_time	19:50:19	0
4157176	99	44	36,6	cyclictest	127329	-21	cut	23:40:20	1
4157176	99	44	31,10	cyclictest	4162036	-21	ls	19:25:38	1
4157175	99	44	37,5	cyclictest	4175420	-21	df_abs	20:20:16	0
4157175	99	44	37,5	cyclictest	4175420	-21	df_abs	20:20:16	0
4157175	99	44	37,5	cyclictest	4160978	-21	kworker/u4:14+events_unbound	20:25:41	0
4157175	99	44	36,6	cyclictest	4174222	-21	fschecks_time	20:15:18	0
4157175	99	44	36,5	cyclictest	4157184	-21	latency_hist	19:10:01	0
4157175	99	44	25,16	cyclictest	4180153	-21	sendmail	20:40:00	0
4157176	99	43	33,7	cyclictest	4169998	-21	latency_hist	20:00:02	1
4157175	99	43	35,5	cyclictest	4187934	-21	sh	21:10:00	0
4157175	99	43	33,7	cyclictest	0	-21	swapper/0	19:25:29	0
4157176	99	42	29,10	cyclictest	4182925	-21	basename	20:50:14	1
4157176	99	42	29,10	cyclictest	0	-21	swapper/1	19:20:37	1
4157176	99	41	34,5	cyclictest	4175442	-21	df_abs	20:20:17	1
4157176	99	41	34,5	cyclictest	4175442	-21	df_abs	20:20:16	1
4157176	99	41	32,6	cyclictest	0	-21	swapper/1	20:30:01	1
4157175	99	41	34,5	cyclictest	94328	-21	kworker/u4:6+events_unbound	23:20:03	0
4157175	99	41	25,7	cyclictest	4159685	-21	kworker/u4:12+events_unbound	19:45:30	0
4157176	99	40	28,9	cyclictest	0	-21	swapper/1	20:45:37	1
4157176	99	39	30,7	cyclictest	4163765	-21	aten_r7power_cu	19:35:16	1
4157175	99	38	29,7	cyclictest	4162828	-21	gltestperf	19:30:21	0
4157176	99	37	26,8	cyclictest	0	-21	swapper/1	20:40:24	1
4157176	99	30	18,8	cyclictest	0	-21	swapper/1	19:10:02	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17