OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Mon Dec 29, 2025 00:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
487905	99	124	107,14	cyclictest	54	-21	kswapd0	23:25:06	0
487908	99	109	96,9	cyclictest	54	-21	kswapd0	21:45:08	1
487905	99	103	45,51	cyclictest	0	-21	swapper/0	20:25:09	0
487908	99	100	93,5	cyclictest	647396	-21	kworker/u4:5+events_unbound	23:43:14	1
487908	99	93	85,6	cyclictest	597448	-21	kworker/u4:0+events_unbound	22:42:59	1
487908	99	90	75,10	cyclictest	0	-21	swapper/1	23:05:34	1
487908	99	90	75,10	cyclictest	0	-21	swapper/1	23:05:33	1
487908	99	83	76,5	cyclictest	651599	-21	kworker/u4:11+events_unbound	23:48:07	1
487905	99	81	71,8	cyclictest	54	-21	kswapd0	21:55:33	0
487908	99	79	70,5	cyclictest	508331	-21	kworker/u4:11+events_unbound	20:45:00	1
487908	99	76	59,6	cyclictest	689182	-21	kworker/u4:1+events_unbound	00:33:47	1
487908	99	75	68,5	cyclictest	580401	-21	kworker/u4:3+events_unbound	22:38:00	1
487908	99	74	66,6	cyclictest	630935	-21	kworker/u4:13+events_unbound	23:28:10	1
487908	99	74	65,6	cyclictest	576137	-21	kworker/u4:4+events_unbound	22:30:14	1
487905	99	69	62,5	cyclictest	613834	-21	kworker/u4:2+events_unbound	23:15:13	0
487905	99	69	34,29	cyclictest	496747	-21	apt-get	19:45:08	0
487908	99	68	51,6	cyclictest	571844	-21	kworker/u4:11+events_unbound	22:47:59	1
487905	99	68	59,6	cyclictest	54	-21	kswapd0	23:00:16	0
487908	99	65	59,5	cyclictest	651595	-21	kworker/u4:4+events_unbound	23:53:07	1
487908	99	64	8,52	cyclictest	620997	-21	sh	23:10:36	1
487908	99	64	56,6	cyclictest	529540	-21	kworker/u4:0+events_unbound	21:22:44	1
487908	99	63	55,6	cyclictest	555406	-21	kworker/u4:8+events_unbound	22:12:55	1
487908	99	63	55,5	cyclictest	476879	-21	kworker/u4:7+events_unbound	19:10:01	1
487905	99	63	55,6	cyclictest	546784	-21	kworker/u4:10+events_unbound	21:42:48	0
487908	99	62	52,8	cyclictest	584658	-21	kworker/u4:2+events_unbound	22:27:56	1
487908	99	62	44,6	cyclictest	613835	-21	kworker/u4:4+events_unbound	23:04:00	1
487908	99	61	54,5	cyclictest	571844	-21	kworker/u4:11+events_unbound	22:50:02	1
487908	99	61	32,16	cyclictest	0	-21	swapper/1	21:10:30	1
487908	99	61	32,16	cyclictest	0	-21	swapper/1	21:10:29	1
487908	99	59	47,9	cyclictest	388	-21	dbus-daemon	00:38:51	1
487905	99	59	49,7	cyclictest	553389	-21	fschecks_time	21:50:22	0
487905	99	58	51,5	cyclictest	605315	-21	kworker/u4:12+events_unbound	23:00:00	0
487905	99	58	51,5	cyclictest	0	-21	swapper/0	22:20:14	0
487908	99	57	49,6	cyclictest	618100	-21	kworker/u4:7+events_unbound	00:05:12	1
487908	99	57	49,6	cyclictest	568300	-21	sd-accept	22:07:52	1
487905	99	57	32,15	cyclictest	14	-21	ksoftirqd/0	21:10:31	0
487905	99	57	32,15	cyclictest	14	-21	ksoftirqd/0	21:10:30	0
487908	99	56	49,5	cyclictest	576137	-21	kworker/u4:4+events_unbound	22:20:02	1
487905	99	56	47,7	cyclictest	684892	-21	kworker/u4:6+events_unbound	00:28:42	0
487905	99	56	42,12	cyclictest	536607	-21	interrupts	21:30:22	0
487908	99	55	49,4	cyclictest	622359	-21	kworker/u4:1+events_unbound	23:18:08	1
487905	99	55	31,13	cyclictest	508610	-21	apt-get	20:30:20	0
487908	99	54	46,6	cyclictest	533841	-21	kworker/u4:13+events_unbound	21:27:44	1
487908	99	54	40,6	cyclictest	660049	-21	kworker/u4:1+events_unbound	00:13:15	1
487905	99	54	44,5	cyclictest	603061	-21	kworker/u4:11	22:50:01	0
487905	99	54	34,18	cyclictest	502394	-21	fschecks_count	20:05:19	0
487908	99	53	46,5	cyclictest	622360	-21	kworker/u4:6+events_unbound	23:20:18	1
487908	99	53	43,7	cyclictest	490380	-21	systemd	19:17:20	1
487908	99	52	42,7	cyclictest	548686	-21	latency_hist	21:45:02	1
487905	99	52	14,10	cyclictest	504641	-21	apt-get	20:15:15	0
487908	99	51	45,4	cyclictest	639752	-21	systemd	23:33:10	1
487908	99	51	43,5	cyclictest	575330	-21	/usr/sbin/munin	22:15:39	1
487908	99	51	42,7	cyclictest	54	-21	kswapd0	21:40:02	1
487905	99	51	34,15	cyclictest	0	-21	swapper/0	22:17:28	0
487905	99	51	34,14	cyclictest	637360	-21	fschecks_time	23:30:23	0
487908	99	50	42,5	cyclictest	651593	-21	kworker/u4:2+events_unbound	00:03:21	1
487905	99	50	39,7	cyclictest	54	-21	kswapd0	23:10:13	0
487905	99	50	22,9	cyclictest	0	-21	swapper/0	20:50:34	0
487905	99	50	19,18	cyclictest	0	-21	swapper/0	00:25:01	0
487908	99	49	42,5	cyclictest	499306	-21	kworker/u4:9+events_unbound	20:30:02	1
487908	99	49	29,8	cyclictest	651600	-21	kworker/u4:12-rpciod	00:20:42	1
487905	99	49	43,4	cyclictest	615971	-21	aten2__	23:05:17	0
487905	99	49	43,4	cyclictest	615971	-21	aten2__	23:05:17	0
487905	99	49	43,4	cyclictest	0	-21	swapper/0	23:55:27	0
487905	99	49	42,5	cyclictest	603505	-21	aten_r7power_vo	22:50:15	0
487905	99	49	42,5	cyclictest	596005	-21	mailstats	22:40:36	0
487905	99	49	41,6	cyclictest	562059	-21	/usr/sbin/munin	22:00:22	0
487905	99	49	39,8	cyclictest	0	-21	swapper/0	23:20:37	0
487905	99	49	37,8	cyclictest	674454	-21	apt-get	00:15:14	0
487905	99	49	24,21	cyclictest	641137	-21	apt-get	23:35:12	0
487908	99	48	40,5	cyclictest	495428	-21	kworker/u4:2+events_unbound	20:12:28	1
487908	99	48	39,7	cyclictest	674579	-21	aten_r7power_en	00:15:17	1
487908	99	48	38,8	cyclictest	661705	-21	tr	00:00:00	1
487905	99	48	8,5	cyclictest	0	-21	swapper/0	19:55:11	0
487905	99	48	39,6	cyclictest	492938	-21	modprobe	19:30:01	0
487905	99	48	15,13	cyclictest	689154	-21	sh	00:32:01	0
487905	99	48	11,34	cyclictest	532568	-21	ssh	21:25:31	0
487908	99	47	39,6	cyclictest	523600	-21	fschecks_count	21:15:21	1
487908	99	47	38,7	cyclictest	510017	-21	aten_r7power_cu	20:35:20	1
487908	99	47	38,7	cyclictest	510017	-21	aten_r7power_cu	20:35:20	1
487908	99	47	38,7	cyclictest	490387	-21	kworker/u4:4-rpciod	19:50:38	1
487908	99	47	37,8	cyclictest	536772	-21	sh	21:30:28	1
487908	99	47	27,14	cyclictest	0	-21	swapper/1	23:35:35	1
487905	99	47	6,38	cyclictest	654525	-21	ssh	23:50:37	0
487905	99	47	39,6	cyclictest	501931	-21	kworker/u4:5+events_unbound	21:45:16	0
487905	99	47	38,7	cyclictest	531507	-21	modprobe	21:24:59	0
487908	99	46	35,9	cyclictest	498092	-21	munin-run	19:50:00	1
487905	99	46	7,10	cyclictest	694278	-21	ssh	00:38:34	0
487905	99	46	39,5	cyclictest	524501	-21	unixbench_multi	21:15:39	0
487905	99	46	39,5	cyclictest	501140	-21	fschecks_count	20:00:20	0
487905	99	46	38,6	cyclictest	54	-21	kswapd0	22:35:01	0
487905	99	46	36,7	cyclictest	0	-21	swapper/0	00:02:28	0
487905	99	46	25,17	cyclictest	582420	-21	apt-get	22:25:12	0
487908	99	45	37,6	cyclictest	501931	-21	kworker/u4:5+events_unbound	21:57:51	1
487908	99	45	37,6	cyclictest	500653	-21	systemd	19:57:25	1
487908	99	45	33,8	cyclictest	0	-21	swapper/1	00:25:29	1
487905	99	45	5,17	cyclictest	541492	-21	unixbench_multi	21:35:39	0
487905	99	45	38,5	cyclictest	591663	-21	ldconfig	22:35:35	0
487905	99	45	37,5	cyclictest	0	-21	swapper/0	00:05:29	0
487905	99	45	26,15	cyclictest	487903	-21	cyclictest	19:10:01	0
487905	99	45	23,17	cyclictest	0	-21	swapper/0	23:45:02	0
487905	99	45	17,22	cyclictest	255	50	irq/23-42890000.ethernet	20:35:11	0
487905	99	45	17,22	cyclictest	255	50	irq/23-42890000.ethernet	20:35:10	0
487905	99	45	11,11	cyclictest	0	-21	swapper/0	19:20:36	0
487908	99	44	38,4	cyclictest	608444	-21	ldconfig	22:55:40	1
487908	99	44	38,4	cyclictest	491665	-21	systemd	19:22:21	1
487908	99	44	37,5	cyclictest	553509	-21	gltestperf	21:50:23	1
487908	99	44	37,5	cyclictest	492976	-21	wc	19:30:00	1
487908	99	44	37,4	cyclictest	516691	-21	gltestperf	21:00:22	1
487908	99	44	36,5	cyclictest	505708	-21	kworker/u4:1+events_unbound	20:32:34	1
487908	99	44	35,7	cyclictest	506277	-21	fschecks_time	20:20:23	1
487908	99	44	31,11	cyclictest	0	-21	swapper/1	21:00:01	1
487905	99	44	33,9	cyclictest	670580	-21	/usr/sbin/munin	00:10:20	0
487905	99	44	3,17	cyclictest	0	-21	swapper/0	22:05:18	0
487905	99	44	22,17	cyclictest	0	-21	swapper/0	21:10:02	0
487908	99	43	36,5	cyclictest	562133	-21	netstat	22:00:23	1
487908	99	43	35,6	cyclictest	503190	-21	systemd	20:07:28	1
487908	99	43	34,6	cyclictest	0	-21	swapper/1	21:10:01	1
487905	99	43	37,4	cyclictest	570805	-21	processes	22:10:38	0
487905	99	43	36,5	cyclictest	517391	-21	munin-plugin-st	21:05:01	0
487905	99	43	36,5	cyclictest	516132	-21	basename	21:00:00	0
487905	99	43	35,6	cyclictest	498539	-21	fschecks_count	19:50:19	0
487905	99	43	33,7	cyclictest	0	-21	swapper/0	20:44:59	0
487905	99	43	14,10	cyclictest	0	-21	swapper/0	19:40:00	0
487908	99	42	36,4	cyclictest	505562	-21	grep	20:15:38	1
487908	99	42	35,5	cyclictest	514870	-21	grep	20:55:01	1
487905	99	42	32,8	cyclictest	649519	-21	/usr/sbin/munin	23:45:14	0
487905	99	42	32,6	cyclictest	512299	-21	kworker/u4:14-events_power_efficient	20:50:01	0
487905	99	42	29,8	cyclictest	496736	-21	modprobe	19:45:01	0
487908	99	41	33,6	cyclictest	501706	-21	threads	20:00:36	1
487908	99	41	33,5	cyclictest	495438	-21	kworker/u4:5-rpciod	19:45:01	1
487908	99	41	32,6	cyclictest	0	-21	swapper/1	20:50:01	1
487905	99	41	32,7	cyclictest	503436	-21	aten_r7power_cu	20:10:16	0
487905	99	41	30,9	cyclictest	0	-21	swapper/0	20:25:01	0
487908	99	40	29,8	cyclictest	0	-21	swapper/1	19:35:32	1
487905	99	40	32,6	cyclictest	489375	-21	aten_r7power_en	19:15:15	0
487905	99	40	32,5	cyclictest	487832	-21	kworker/u4:10-xprtiod	19:10:22	0
487908	99	38	29,6	cyclictest	0	-21	swapper/1	19:30:20	1
487905	99	38	22,13	cyclictest	493806	-21	ps	19:30:35	0
487908	99	35	27,5	cyclictest	0	-21	swapper/1	19:10:19	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17