OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Wed Sep 23, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3112616	99	124	116,5	cyclictest	3236369	-21	kworker/u4:6+events_unbound	10:53:39	0
3112616	99	114	24,67	cyclictest	3112617	-21	kworker/u4:5	07:10:00	0
3112616	99	108	101,5	cyclictest	3284680	-21	kworker/u4:0+events_unbound	12:13:55	0
3112616	99	98	80,7	cyclictest	3267313	-21	kworker/u4:7+events_unbound	11:43:49	0
3112616	99	95	84,7	cyclictest	3195935	-21	kworker/u4:3+events_unbound	10:08:29	0
3112619	99	87	80,5	cyclictest	3173743	-21	kworker/u4:2+events_unbound	09:43:25	1
3112616	99	84	76,6	cyclictest	3320500	-21	kworker/u4:1+events_unbound	12:33:59	0
3112616	99	84	76,6	cyclictest	3284680	-21	kworker/u4:0+events_unbound	11:53:51	0
3112616	99	83	77,4	cyclictest	3253729	-21	kworker/u4:13+events_unbound	11:13:44	0
3112616	99	83	75,6	cyclictest	3159947	-21	kworker/u4:5+events_unbound	09:53:27	0
3112616	99	77	68,7	cyclictest	3293815	-21	kworker/u4:6+events_unbound	12:23:57	0
3112619	99	76	33,10	cyclictest	3256160	-21	fschecks_time	11:15:21	1
3112616	99	76	67,7	cyclictest	3284684	-21	kworker/u4:8+events_unbound	11:48:50	0
3112616	99	74	66,6	cyclictest	3329552	-21	kworker/u4:2+events_unbound	12:39:02	0
3112616	99	73	60,9	cyclictest	3162178	-21	ssh	09:30:14	0
3112616	99	73	41,28	cyclictest	256	50	irq/23-42890000.ethernet	07:55:10	0
3112619	99	72	39,5	cyclictest	3113208	-21	gltestperf	07:10:23	1
3112619	99	72	36,32	cyclictest	0	-21	swapper/1	10:10:23	1
3112616	99	72	64,6	cyclictest	3155352	-21	kworker/u4:7+events_unbound	09:23:22	0
3112619	99	71	41,28	cyclictest	3163407	-21	timerwakeupswit	09:30:46	1
3112616	99	71	59,9	cyclictest	3149371	-21	/usr/sbin/munin	09:15:32	0
3112619	99	69	40,25	cyclictest	0	-21	swapper/1	11:48:49	1
3112616	99	69	61,6	cyclictest	3289250	-21	kworker/u4:9+events_unbound	12:18:56	0
3112616	99	69	61,6	cyclictest	3214207	-21	kworker/u4:11+events_unbound	10:33:35	0
3112619	99	68	32,6	cyclictest	0	-21	swapper/1	10:50:33	1
3112616	99	67	60,6	cyclictest	3128158	-21	kworker/u4:9+events_unbound	08:13:06	0
3112616	99	67	57,7	cyclictest	3208490	-21	unixbench_multi	10:20:42	0
3112616	99	67	40,20	cyclictest	53	-21	kswapd0	11:35:09	0
3112616	99	64	50,5	cyclictest	3128158	-21	kworker/u4:9+events_unbound	08:25:00	0
3112616	99	62	54,6	cyclictest	3244704	-21	kworker/u4:0+events_unbound	11:18:45	0
3112616	99	61	50,6	cyclictest	3240180	-21	kworker/u4:2+events_unbound	11:03:41	0
3112616	99	61	44,5	cyclictest	3214207	-21	kworker/u4:11+events_unbound	10:43:39	0
3112619	99	60	48,9	cyclictest	53	-21	kswapd0	11:15:01	1
3112616	99	60	37,18	cyclictest	3214790	-21	ssh	10:28:18	0
3112619	99	58	49,6	cyclictest	3116503	-21	kworker/u4:17+events_unbound	07:37:59	1
3112616	99	58	48,7	cyclictest	0	-21	swapper/0	08:55:38	0
3112616	99	58	36,7	cyclictest	3189722	-21	gltestperf	10:00:23	0
3112616	99	58	35,19	cyclictest	3122136	-21	fschecks_count	07:45:19	0
3112619	99	57	50,4	cyclictest	0	-21	swapper/1	11:03:57	1
3112619	99	57	49,6	cyclictest	3143659	-21	kworker/u4:3+events_unbound	09:58:28	1
3112616	99	56	49,5	cyclictest	3258253	-21	kworker/u4:3+events_unbound	11:23:44	0
3112616	99	56	48,5	cyclictest	0	-21	swapper/0	11:30:28	0
3112616	99	56	47,7	cyclictest	317	-21	systemd-journal	09:43:25	0
3112619	99	55	46,7	cyclictest	3271168	-21	kworker/u4:10+events_unbound	11:33:46	1
3112619	99	55	46,7	cyclictest	3195935	-21	kworker/u4:3+events_unbound	10:48:39	1
3112619	99	55	44,9	cyclictest	0	-21	swapper/1	12:30:31	1
3112616	99	55	48,6	cyclictest	3124232	-21	kworker/u4:5+events_unbound	08:43:11	0
3112616	99	55	46,5	cyclictest	3176769	-21	/usr/sbin/munin	09:45:37	0
3112616	99	55	45,7	cyclictest	3198549	-21	/usr/sbin/munin	10:10:22	0
3112616	99	55	44,8	cyclictest	3113924	-21	kworker/u4:9-rpciod	07:20:38	0
3112616	99	55	36,12	cyclictest	3237980	-21	ssh	10:55:10	0
3112616	99	55	33,16	cyclictest	15	1	ktimers/0	07:10:11	0
3112619	99	54	46,5	cyclictest	3176534	-21	diskmemload	09:45:31	1
3112616	99	54	47,5	cyclictest	3133363	-21	kworker/u4:20+events_unbound	08:53:16	0
3112616	99	54	46,6	cyclictest	3203033	-21	cut	10:15:18	0
3112619	99	53	45,6	cyclictest	3225316	-21	/usr/sbin/munin	10:40:15	1
3112619	99	53	44,6	cyclictest	3116503	-21	kworker/u4:17+events_unbound	07:43:02	1
3112616	99	53	43,7	cyclictest	3221824	-21	switchtime	10:35:39	0
3112619	99	52	45,5	cyclictest	3314509	-21	/usr/sbin/munin	12:20:23	1
3112619	99	52	45,5	cyclictest	3158530	-21	/usr/sbin/munin	09:25:36	1
3112619	99	52	43,7	cyclictest	3221007	-21	/usr/sbin/munin	10:35:19	1
3112619	99	52	42,8	cyclictest	3142395	-21	systemd	09:03:16	1
3112616	99	52	44,5	cyclictest	3185828	-21	sh	09:55:39	0
3112616	99	52	44,5	cyclictest	3143658	-21	kworker/u4:1+events_unbound	09:10:03	0
3112619	99	51	44,5	cyclictest	3144599	-21	uname	09:10:23	1
3112619	99	51	44,5	cyclictest	27	1	ktimers/1	11:05:28	1
3112619	99	51	43,5	cyclictest	0	-21	swapper/1	10:30:16	1
3112616	99	51	43,5	cyclictest	3266651	-21	kworker/u4:6+events_unbound	11:29:46	0
3112616	99	51	42,6	cyclictest	3130517	-21	switchtime	08:15:37	0
3112616	99	51	42,6	cyclictest	3130517	-21	switchtime	08:15:36	0
3112616	99	51	40,8	cyclictest	3121561	-21	unixbench-2d	07:40:37	0
3112619	99	50	42,6	cyclictest	53	-21	kswapd0	12:10:06	1
3112619	99	50	42,6	cyclictest	53	-21	kswapd0	12:10:06	1
3112619	99	50	42,6	cyclictest	3116170	-21	sendmail_mailqu	07:20:36	1
3112619	99	50	42,6	cyclictest	0	-21	swapper/1	10:55:30	1
3112616	99	50	43,5	cyclictest	3213535	-21	kworker/u4:9+events_unbound	10:50:00	0
3112616	99	50	40,7	cyclictest	3247482	-21	kernelversion	11:05:23	0
3112616	99	49	42,5	cyclictest	3125592	-21	kworker/u4:6+events_unbound	08:48:15	0
3112616	99	49	39,7	cyclictest	3124343	-21	latency_hist	07:55:01	0
3112616	99	49	39,7	cyclictest	3124343	-21	latency_hist	07:55:00	0
3112616	99	49	37,6	cyclictest	3298400	-21	kworker/u4:2+events_unbound	12:05:02	0
3112619	99	48	42,4	cyclictest	3112668	-21	date	07:10:01	1
3112619	99	48	40,6	cyclictest	3308919	-21	sshd	12:14:47	1
3112619	99	48	39,7	cyclictest	3142700	-21	aten_r7power_po	09:05:17	1
3112619	99	48	3,38	cyclictest	3181098	-21	ssh	09:50:35	1
3112616	99	48	41,5	cyclictest	3133363	-21	kworker/u4:20+events_unbound	08:33:12	0
3112616	99	48	41,5	cyclictest	3133363	-21	kworker/u4:20+events_unbound	08:33:11	0
3112616	99	48	39,7	cyclictest	3291744	-21	/usr/sbin/munin	11:55:19	0
3112619	99	47	41,4	cyclictest	3299373	-21	systemd	12:03:52	1
3112619	99	47	40,5	cyclictest	3265071	-21	fschecks_time	11:25:19	1
3112619	99	47	40,5	cyclictest	3130631	-21	timerwakeupswit	08:15:38	1
3112619	99	47	40,5	cyclictest	3130631	-21	timerwakeupswit	08:15:38	1
3112619	99	47	40,5	cyclictest	3122968	-21	systemd	07:48:00	1
3112619	99	47	39,6	cyclictest	3298400	-21	kworker/u4:2+events_unbound	12:20:00	1
3112619	99	47	37,7	cyclictest	0	-21	swapper/1	11:40:33	1
3112619	99	46	40,4	cyclictest	3208524	-21	unixbench_multi	10:20:41	1
3112619	99	46	40,4	cyclictest	3156204	-21	systemd	09:23:20	1
3112619	99	46	39,5	cyclictest	3244704	-21	kworker/u4:0+events_unbound	11:20:02	1
3112619	99	46	39,5	cyclictest	3189749	-21	sed	10:00:23	1
3112619	99	46	38,5	cyclictest	3212065	-21	uniq	10:25:20	1
3112616	99	46	39,5	cyclictest	3126888	-21	kworker/u4:7+events_unbound	08:38:13	0
3112616	99	46	38,6	cyclictest	3157924	-21	/usr/sbin/munin	09:25:19	0
3112616	99	46	38,6	cyclictest	3112541	-21	kworker/u4:2+events_unbound	08:03:06	0
3112616	99	46	37,6	cyclictest	0	-21	swapper/0	12:05:18	0
3112616	99	46	37,6	cyclictest	0	-21	swapper/0	12:05:18	0
3112619	99	45	38,5	cyclictest	3148860	-21	fschecks_count	09:15:20	1
3112619	99	45	38,5	cyclictest	3137775	-21	fschecks_time	08:45:19	1
3112619	99	45	37,5	cyclictest	3202892	-21	cpu	10:15:16	1
3112619	99	45	37,5	cyclictest	3124252	-21	cron	07:55:00	1
3112619	99	45	37,5	cyclictest	3124252	-21	cron	07:55:00	1
3112619	99	45	36,7	cyclictest	3132202	-21	latency_hist	08:25:00	1
3112619	99	45	35,8	cyclictest	3167788	-21	timerandwakeup	09:35:38	1
3112619	99	45	31,11	cyclictest	3141146	-21	tr	09:00:01	1
3112616	99	45	37,6	cyclictest	3143659	-21	kworker/u4:3+events_unbound	09:08:17	0
3112616	99	45	37,6	cyclictest	3116970	-21	fschecks_count	07:25:19	0
3112616	99	45	35,7	cyclictest	3119420	-21	aten_r7power_po	07:35:16	0
3112616	99	45	35,7	cyclictest	0	-21	swapper/0	08:25:20	0
3112616	99	45	28,15	cyclictest	3167087	-21	fschecks_time	09:35:20	0
3112619	99	44	38,4	cyclictest	3327805	-21	gltestperf	12:35:20	1
3112619	99	44	37,5	cyclictest	3318846	-21	gltestperf	12:25:21	1
3112619	99	44	37,5	cyclictest	3136950	-21	sendmail_mailqu	08:40:36	1
3112619	99	44	36,5	cyclictest	3127830	-21	sendmail_mailqu	08:05:38	1
3112619	99	44	34,8	cyclictest	3273620	-21	acpi	11:35:14	1
3112616	99	44	36,5	cyclictest	3118325	-21	fschecks_count	07:30:26	0
3112616	99	44	34,8	cyclictest	3115244	-21	cron	07:20:00	0
3112616	99	44	3,31	cyclictest	3319262	-21	ssh	12:25:36	0
3112619	99	43	36,5	cyclictest	3291596	-21	aten_r7power_vo	11:55:16	1
3112619	99	43	34,6	cyclictest	3284680	-21	kworker/u4:0-rpciod	11:55:01	1
3112619	99	43	33,7	cyclictest	0	-21	swapper/1	10:05:34	1
3112616	99	43	30,9	cyclictest	3127280	-21	df	08:05:18	0
3112619	99	42	36,4	cyclictest	3117017	-21	fschecks_time	07:25:19	1
3112619	99	42	35,5	cyclictest	3124232	-21	kworker/u4:5-rpciod	08:00:17	1
3112616	99	42	34,6	cyclictest	3141403	-21	aten_r7power_po	09:00:16	0
3112619	99	41	35,4	cyclictest	3115251	-21	idleruntime-cro	07:20:00	1
3112619	99	41	29,9	cyclictest	0	-21	swapper/1	08:50:39	1
3112619	99	40	31,6	cyclictest	0	-21	swapper/1	08:35:01	1
3112619	99	40	31,6	cyclictest	0	-21	swapper/1	08:35:00	1
3112619	99	40	31,6	cyclictest	0	-21	swapper/1	07:55:43	1
3112619	99	40	28,9	cyclictest	0	-21	swapper/1	08:35:25	1
3112619	99	39	30,7	cyclictest	3103595	-21	kworker/u4:14+events_unbound	07:32:59	1
3112619	99	39	28,8	cyclictest	0	-21	swapper/1	08:10:38	1
3112619	99	39	27,9	cyclictest	3133388	-21	kworker/u4:16	08:30:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17