OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Sat Mar 14, 2026 12:44:07)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
778564	99	110	94,12	cyclictest	53	-21	kswapd0	11:20:11	0
778565	99	108	101,5	cyclictest	887347	-21	kworker/u4:2+events_unbound	10:45:47	1
778564	99	105	96,6	cyclictest	939507	-21	kworker/u4:14+events_unbound	12:11:00	0
778564	99	105	93,9	cyclictest	869420	-21	kworker/u4:4+events_unbound	10:20:42	0
778564	99	102	93,6	cyclictest	825173	-21	kworker/u4:9+events_unbound	09:45:33	0
778565	99	90	82,6	cyclictest	970735	-21	kworker/u4:9+events_unbound	12:16:01	1
778564	99	90	79,8	cyclictest	838829	-21	kworker/u4:7+events_unbound	09:50:34	0
778564	99	87	80,5	cyclictest	769815	-21	kworker/u4:10+events_unbound	09:35:31	0
778564	99	82	72,7	cyclictest	769815	-21	kworker/u4:10+events_unbound	08:15:01	0
778564	99	82	69,10	cyclictest	53	-21	kswapd0	10:30:14	0
778565	99	79	72,5	cyclictest	769815	-21	kworker/u4:10+events_unbound	07:40:02	1
778565	99	77	70,5	cyclictest	776058	-21	kworker/u4:0+events_unbound	07:10:07	1
778565	99	75	68,5	cyclictest	782366	-21	kworker/u4:8+events_unbound	08:25:19	1
778564	99	75	67,6	cyclictest	847791	-21	kworker/u4:6+events_unbound	10:00:16	0
778565	99	73	65,6	cyclictest	764672	-21	kworker/u4:7+events_unbound	07:30:08	1
778564	99	73	59,10	cyclictest	950709	-21	apt-get	11:50:11	0
778565	99	72	65,5	cyclictest	556723	-21	kworker/u4:4+events_unbound	07:20:02	1
778565	99	70	63,5	cyclictest	768514	-21	kworker/u4:9+events_unbound	08:17:01	1
778565	99	69	61,5	cyclictest	829720	-21	kworker/u4:3+events_unbound	09:35:23	1
778564	99	69	62,4	cyclictest	53	-21	kswapd0	10:40:01	0
778565	99	68	58,6	cyclictest	0	-21	swapper/1	11:15:30	1
778564	99	68	60,5	cyclictest	891841	-21	kworker/u4:13+events_unbound	11:00:48	0
778564	99	67	59,5	cyclictest	53	-21	kswapd0	09:30:33	0
778564	99	66	59,5	cyclictest	970736	-21	kworker/u4:10+events_unbound	12:26:01	0
778564	99	66	58,6	cyclictest	805518	-21	kworker/u4:1+events_unbound	08:55:27	0
778565	99	65	51,12	cyclictest	53	-21	kswapd0	12:10:11	1
778564	99	65	51,10	cyclictest	822828	-21	modprobe	09:25:00	0
778565	99	64	57,5	cyclictest	782366	-21	kworker/u4:8+events_unbound	07:55:12	1
778564	99	64	56,6	cyclictest	908988	-21	kworker/u4:7+events_unbound	11:05:49	0
778564	99	64	54,8	cyclictest	809860	-21	cut	09:10:16	0
778565	99	63	56,5	cyclictest	829717	-21	kworker/u4:0+events_unbound	10:16:08	1
778565	99	63	49,5	cyclictest	908988	-21	kworker/u4:7+events_unbound	11:06:42	1
778564	99	63	55,6	cyclictest	53	-21	kswapd0	11:00:01	0
778565	99	62	54,6	cyclictest	778561	-21	cyclictest	12:01:08	1
778565	99	62	51,7	cyclictest	0	-21	swapper/1	11:40:36	1
778565	99	62	45,7	cyclictest	957333	-21	kworker/u4:7+events_unbound	11:57:41	1
778564	99	62	55,5	cyclictest	961833	-21	kworker/u4:3+events_unbound	12:05:02	0
778565	99	61	49,8	cyclictest	0	-21	swapper/1	09:55:37	1
778564	99	61	50,7	cyclictest	256	50	irq/23-42890000.ethernet	12:30:15	0
778564	99	61	50,7	cyclictest	256	50	irq/23-42890000.ethernet	12:30:14	0
778564	99	61	42,13	cyclictest	0	-21	swapper/0	11:25:11	0
778565	99	60	50,7	cyclictest	947235	-21	open_inodes	11:45:35	1
778565	99	60	50,7	cyclictest	873923	-21	kworker/u4:11-rpciod	10:40:37	1
778565	99	59	51,6	cyclictest	913440	-21	kworker/u4:8+events_unbound	11:13:52	1
778565	99	59	46,9	cyclictest	37	-21	kcompactd0	10:11:37	1
778564	99	57	50,5	cyclictest	868269	-21	/usr/sbin/munin	10:15:35	0
778564	99	57	49,6	cyclictest	808863	-21	sshd	09:05:28	0
778564	99	57	48,7	cyclictest	378	-21	dbus-daemon	07:20:09	0
778564	99	56	44,10	cyclictest	53	-21	kswapd0	10:55:01	0
778564	99	56	36,5	cyclictest	809395	-21	diskmemload	09:40:41	0
778565	99	55	6,37	cyclictest	845388	-21	ssh	09:50:13	1
778565	99	55	45,8	cyclictest	787738	-21	sshd	07:45:11	1
778565	99	55	39,7	cyclictest	769815	-21	kworker/u4:10+events_unbound	08:32:59	1
778564	99	55	48,5	cyclictest	796819	-21	wget	08:20:17	0
778564	99	55	47,5	cyclictest	823928	-21	sshd	09:25:31	0
778564	99	55	35,18	cyclictest	781073	-21	kworker/u4:0+events_unbound	08:50:00	0
778564	99	55	1,24	cyclictest	784935	-21	apt-get	07:35:10	0
778565	99	54	47,5	cyclictest	806793	-21	kworker/u4:4+events_unbound	09:00:02	1
778565	99	54	45,5	cyclictest	0	-21	swapper/1	09:32:13	1
778564	99	54	48,4	cyclictest	852268	-21	kworker/u4:13+events_unbound	10:06:06	0
778564	99	54	46,6	cyclictest	942360	-21	cut	11:40:21	0
778565	99	53	46,5	cyclictest	885287	-21	fschecks_count	10:35:20	1
778565	99	53	44,7	cyclictest	796850	-21	aten_r7power_vo	08:20:16	1
778565	99	53	44,6	cyclictest	941659	-21	idleruntime-cro	11:40:00	1
778565	99	53	38,8	cyclictest	0	-21	swapper/1	09:00:01	1
778564	99	53	46,5	cyclictest	891843	-21	kworker/u4:15+events_unbound	10:44:00	0
778564	99	53	45,6	cyclictest	939507	-21	kworker/u4:14+events_unbound	12:03:59	0
778565	99	52	45,5	cyclictest	812186	-21	kworker/u4:0+events_unbound	09:15:01	1
778565	99	52	43,7	cyclictest	53	-21	kswapd0	09:40:09	1
778565	99	52	43,6	cyclictest	801355	-21	sendmail_mailqu	08:35:39	1
778564	99	52	44,6	cyclictest	53	-21	kswapd0	11:35:32	0
778565	99	51	44,5	cyclictest	987354	-21	systemd	12:31:01	1
778565	99	51	44,5	cyclictest	987354	-21	systemd	12:31:01	1
778565	99	51	44,5	cyclictest	977479	-21	fschecks_time	12:20:21	1
778565	99	51	44,5	cyclictest	852268	-21	kworker/u4:13+events_unbound	10:03:00	1
778565	99	51	43,6	cyclictest	781073	-21	kworker/u4:0+events_unbound	07:27:03	1
778565	99	51	43,5	cyclictest	881851	-21	unixbench_singl	10:30:41	1
778565	99	50	44,5	cyclictest	908988	-21	kworker/u4:7+events_unbound	11:02:42	1
778565	99	50	44,4	cyclictest	843299	-21	kworker/u4:3+events_unbound	09:50:00	1
778565	99	50	43,5	cyclictest	925022	-21	irqstats	11:20:26	1
778565	99	50	43,5	cyclictest	785172	-21	acpi	07:35:12	1
778565	99	50	35,6	cyclictest	782366	-21	kworker/u4:8+events_unbound	07:51:41	1
778564	99	50	41,7	cyclictest	916188	-21	/usr/sbin/munin	11:10:22	0
778565	99	49	41,5	cyclictest	902843	-21	/usr/sbin/munin	10:55:21	1
778565	99	49	40,6	cyclictest	880352	-21	latency_hist	10:30:01	1
778565	99	49	39,7	cyclictest	937362	-21	latency_hist	11:35:02	1
778565	99	49	2,16	cyclictest	823777	-21	sh	09:25:23	1
778564	99	49	42,5	cyclictest	946819	-21	gltestperf	11:45:18	0
778565	99	48	42,4	cyclictest	898588	-21	gltestperf	10:50:20	1
778565	99	48	40,5	cyclictest	818643	-21	ssh	09:20:11	1
778565	99	48	40,5	cyclictest	781133	-21	grep	07:20:00	1
778565	99	48	37,8	cyclictest	804303	-21	grep	08:50:01	1
778564	99	48	41,5	cyclictest	976818	-21	latency_hist	12:20:01	0
778564	99	48	31,5	cyclictest	792667	-21	kworker/u4:12+events_unbound	08:30:01	0
778565	99	47	40,5	cyclictest	858735	-21	aten_r7power_po	10:05:15	1
778565	99	47	37,6	cyclictest	815480	-21	unixbench_singl	09:15:40	1
778564	99	47	42,3	cyclictest	786265	-21	kworker/u4:14+events_unbound	07:40:12	0
778564	99	47	41,4	cyclictest	792377	-21	cat	08:00:34	0
778564	99	47	40,5	cyclictest	978023	-21	processes	12:20:37	0
778564	99	47	39,6	cyclictest	933662	-21	gltestperf	11:30:19	0
778564	99	47	37,7	cyclictest	815475	-21	unixbench_singl	09:15:40	0
778564	99	47	27,18	cyclictest	0	-21	swapper/0	09:05:00	0
778565	99	46	36,7	cyclictest	0	-21	swapper/1	11:50:33	1
778565	99	46	34,5	cyclictest	806793	-21	kworker/u4:4+events_unbound	09:06:41	1
778564	99	46	39,5	cyclictest	894685	-21	grep	10:45:36	0
778565	99	45	38,5	cyclictest	786266	-21	kworker/u4:15+events_unbound	08:12:00	1
778565	99	45	35,7	cyclictest	964187	-21	/usr/sbin/munin	12:05:18	1
778565	99	45	34,7	cyclictest	0	-21	swapper/1	12:25:31	1
778565	99	45	10,25	cyclictest	990850	-21	ssh	12:35:25	1
778564	99	45	38,5	cyclictest	800672	-21	aten_r7power_en	08:35:21	0
778564	99	45	37,5	cyclictest	850536	-21	/usr/sbin/munin	09:55:28	0
778564	99	45	37,5	cyclictest	556723	-21	kworker/u4:4+events_unbound	07:45:12	0
778564	99	45	36,7	cyclictest	955505	-21	gltestperf	11:55:19	0
778564	99	45	36,7	cyclictest	792957	-21	aten_r7power_po	08:05:17	0
778564	99	45	35,8	cyclictest	799599	-21	fschecks_time	08:30:20	0
778564	99	45	22,6	cyclictest	0	-21	swapper/0	08:50:17	0
778565	99	44	35,7	cyclictest	778624	-21	latency_hist	07:10:01	1
778564	99	44	37,5	cyclictest	873923	-21	kworker/u4:11+events_unbound	10:25:42	0
778564	99	44	37,5	cyclictest	780371	-21	gltestperf	07:15:20	0
778564	99	44	34,8	cyclictest	994505	-21	latency_hist	12:40:02	0
778564	99	44	22,20	cyclictest	920317	-21	fschecks_count	11:15:18	0
778565	99	43	36,5	cyclictest	872287	-21	irqstats	10:20:21	1
778565	99	43	31,9	cyclictest	0	-21	swapper/1	08:50:20	1
778565	99	43	26,6	cyclictest	926819	-21	kworker/u4:6+events_unbound	11:29:30	1
778564	99	43	36,5	cyclictest	802227	-21	fschecks_time	08:40:19	0
778564	99	43	36,5	cyclictest	769815	-21	kworker/u4:10+events_unbound	07:50:12	0
778564	99	43	35,6	cyclictest	790711	-21	sed	07:55:21	0
778564	99	42	34,6	cyclictest	778820	-21	aten_r7power_po	07:10:15	0
778564	99	41	34,5	cyclictest	863359	-21	/usr/sbin/munin	10:10:17	0
778564	99	41	31,7	cyclictest	0	-21	swapper/0	07:30:18	0
778565	99	40	33,5	cyclictest	793940	-21	kworker/u4:14+events_unbound	08:08:01	1
778565	99	40	31,7	cyclictest	802943	-21	unixbench_singl	08:40:39	1
778564	99	39	30,7	cyclictest	782831	-21	fschecks_count	07:25:19	0
778565	99	37	27,6	cyclictest	0	-21	swapper/1	08:00:18	1
778564	99	37	8,21	cyclictest	778561	-21	cyclictest	07:10:00	0
778564	99	37	15,19	cyclictest	796550	-21	tr	08:20:00	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17