OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Mon Dec 22, 2025 00:44:13)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
237652	99	117	110,5	cyclictest	391680	-21	kworker/u4:3+events_unbound	23:38:27	1
237652	99	110	104,4	cyclictest	270918	-21	kworker/u4:1+events_unbound	21:38:04	1
237650	99	110	100,7	cyclictest	360428	-21	sshd	23:00:10	0
237650	99	107	64,33	cyclictest	53	-21	kswapd0	22:30:07	0
237652	99	102	94,6	cyclictest	329231	-21	kworker/u4:13+events_unbound	22:23:12	1
237652	99	102	94,6	cyclictest	329231	-21	kworker/u4:13+events_unbound	22:23:11	1
237652	99	101	91,8	cyclictest	374915	-21	kworker/u4:4+events_unbound	23:18:23	1
237652	99	95	88,5	cyclictest	350225	-21	kworker/u4:8+events_unbound	23:03:21	1
237652	99	94	85,6	cyclictest	420330	-21	kworker/u4:9+events_unbound	00:28:44	1
237652	99	89	81,5	cyclictest	261883	-21	kworker/u4:5+events_unbound	21:12:57	1
237652	99	87	80,5	cyclictest	263155	-21	kworker/u4:17+events_unbound	20:52:54	1
237652	99	87	80,5	cyclictest	263155	-21	kworker/u4:17+events_unbound	20:52:54	1
237650	99	84	48,23	cyclictest	53	-21	kswapd0	21:35:07	0
237652	99	83	74,7	cyclictest	247826	-21	kworker/u4:10+events_unbound	21:28:00	1
237652	99	81	68,9	cyclictest	53	-21	kswapd0	23:50:00	1
237650	99	80	45,6	cyclictest	258572	-21	fschecks_time	20:30:18	0
237652	99	75	67,6	cyclictest	236284	-21	kworker/u4:2+events_unbound	19:42:43	1
237650	99	74	69,3	cyclictest	261883	-21	kworker/u4:5+events_unbound	21:12:59	0
237652	99	72	64,6	cyclictest	379113	-21	kworker/u4:9+events_unbound	23:23:24	1
237652	99	68	62,4	cyclictest	237579	-21	kworker/u4:7+events_unbound	20:30:01	1
237650	99	68	60,6	cyclictest	337618	-21	kworker/u4:0+events_unbound	23:20:00	0
237650	99	68	59,7	cyclictest	238874	-21	kworker/u4:13+events_unbound	20:37:53	0
237652	99	66	58,6	cyclictest	313054	-21	kworker/u4:3+events_unbound	22:03:08	1
237652	99	64	56,6	cyclictest	337623	-21	kworker/u4:8+events_unbound	22:33:13	1
237652	99	64	55,5	cyclictest	0	-21	swapper/1	23:50:33	1
237652	99	64	54,8	cyclictest	291833	-21	kworker/u4:4+events_unbound	21:53:06	1
237650	99	64	45,16	cyclictest	0	-21	swapper/0	21:50:38	0
237652	99	62	52,7	cyclictest	374913	-21	kworker/u4:1+events_unbound	23:35:01	1
237650	99	62	52,8	cyclictest	354410	-21	kworker/u4:2+events_unbound	22:58:19	0
237650	99	61	52,6	cyclictest	379113	-21	kworker/u4:9+events_unbound	23:25:03	0
237652	99	60	53,5	cyclictest	291833	-21	kworker/u4:4+events_unbound	22:18:10	1
237652	99	60	53,5	cyclictest	291833	-21	kworker/u4:4+events_unbound	22:18:10	1
237652	99	60	52,6	cyclictest	412002	-21	kworker/u4:6+events_unbound	00:03:34	1
237650	99	60	52,5	cyclictest	238874	-21	kworker/u4:13+events_unbound	20:47:54	0
237650	99	59	50,7	cyclictest	296094	-21	kworker/u4:18+events_unbound	22:13:10	0
237652	99	58	48,7	cyclictest	306844	-21	df_abs	21:55:16	1
237650	99	58	50,6	cyclictest	370675	-21	kworker/u4:8+events_unbound	23:33:28	0
237652	99	57	47,7	cyclictest	266656	-21	sendmail_mailqu	21:00:37	1
237650	99	57	48,7	cyclictest	53	-21	kswapd0	22:25:01	0
237650	99	57	48,7	cyclictest	53	-21	kswapd0	22:25:01	0
237652	99	56	47,7	cyclictest	246555	-21	kworker/u4:6+events_unbound	20:05:01	1
237652	99	56	46,6	cyclictest	380780	-21	apt-get	23:25:11	1
237650	99	56	49,5	cyclictest	350223	-21	kworker/u4:6+events_unbound	22:53:16	0
237652	99	55	48,5	cyclictest	238874	-21	kworker/u4:13+events_unbound	19:35:01	1
237652	99	55	42,10	cyclictest	394169	-21	ssh	23:40:28	1
237650	99	55	22,28	cyclictest	256	50	irq/23-42890000.ethernet	23:50:06	0
237652	99	54	46,6	cyclictest	366475	-21	kworker/u4:12+events_unbound	23:10:02	1
237652	99	54	45,6	cyclictest	425282	-21	systemd	00:18:40	1
237650	99	54	45,6	cyclictest	0	-21	swapper/0	21:45:12	0
237652	99	53	43,7	cyclictest	364536	-21	apt-get	23:05:17	1
237652	99	53	38,11	cyclictest	37	-21	kcompactd0	21:41:46	1
237652	99	53	37,10	cyclictest	0	-21	swapper/1	22:50:33	1
237650	99	53	46,5	cyclictest	365526	-21	/usr/sbin/munin	23:05:40	0
237650	99	53	45,6	cyclictest	241451	-21	kworker/u4:17+events_unbound	20:02:48	0
237650	99	53	34,17	cyclictest	325901	-21	sshd	22:18:09	0
237650	99	53	34,17	cyclictest	325901	-21	sshd	22:18:09	0
237652	99	52	45,5	cyclictest	354410	-21	kworker/u4:2+events_unbound	22:58:00	1
237652	99	52	45,5	cyclictest	261883	-21	kworker/u4:5+events_unbound	21:00:00	1
237652	99	52	44,6	cyclictest	428704	-21	kworker/u4:4+events_unbound	00:40:01	1
237652	99	52	44,6	cyclictest	313052	-21	kworker/u4:0+events_unbound	22:12:59	1
237652	99	52	42,7	cyclictest	344038	-21	cpu	22:40:17	1
237650	99	52	44,6	cyclictest	241451	-21	kworker/u4:17+events_unbound	19:27:38	0
237650	99	52	4,24	cyclictest	398292	-21	ssh	23:45:32	0
237650	99	52	32,18	cyclictest	442416	-21	sendmail	00:40:00	0
237650	99	52	31,19	cyclictest	267599	-21	fschecks_time	21:05:24	0
237652	99	51	43,6	cyclictest	424531	-21	kworker/u4:6+events_unbound	00:30:43	1
237650	99	51	8,26	cyclictest	390084	-21	ssh	23:35:31	0
237650	99	51	45,4	cyclictest	242721	-21	kworker/u4:18+events_unbound	19:32:41	0
237650	99	51	43,6	cyclictest	275242	-21	kworker/u4:3+events_unbound	21:22:59	0
237650	99	51	43,6	cyclictest	238872	-21	kworker/u4:11+events_unbound	19:12:39	0
237650	99	51	43,5	cyclictest	332260	-21	ntp_states	22:25:33	0
237650	99	51	43,5	cyclictest	256	50	irq/23-42890000.ethernet	00:15:26	0
237650	99	51	39,9	cyclictest	286726	-21	mailstats	21:30:46	0
237652	99	50	43,5	cyclictest	418263	-21	aten_r7power_vo	00:10:18	1
237652	99	50	43,5	cyclictest	288369	-21	systemd	21:33:02	1
237652	99	50	38,7	cyclictest	279544	-21	kworker/u4:9+events_unbound	21:25:01	1
237650	99	50	4,37	cyclictest	237651	-21	modprobe	19:09:59	0
237650	99	50	43,5	cyclictest	435563	-21	switchtime	00:30:41	0
237650	99	50	43,5	cyclictest	395274	-21	kworker/u4:6+events_unbound	23:45:00	0
237652	99	49	42,5	cyclictest	259323	-21	systemd	20:32:52	1
237652	99	49	27,19	cyclictest	0	-21	swapper/1	21:45:24	1
237650	99	49	4,41	cyclictest	315730	-21	ssh	22:05:34	0
237650	99	49	42,5	cyclictest	250367	-21	kworker/u4:15+events_unbound	21:02:58	0
237650	99	49	42,5	cyclictest	0	-21	swapper/0	22:35:42	0
237650	99	49	40,7	cyclictest	272996	-21	/usr/sbin/munin	21:15:16	0
237650	99	49	40,6	cyclictest	242721	-21	kworker/u4:18+events_unbound	19:52:45	0
237650	99	49	37,10	cyclictest	377347	-21	/usr/sbin/munin	23:20:18	0
237652	99	48	38,7	cyclictest	249138	-21	idleruntime-cro	19:55:00	1
237652	99	48	37,8	cyclictest	246966	-21	df_abs	19:45:17	1
237652	99	47	38,6	cyclictest	426916	-21	if_eth0	00:20:23	1
237652	99	47	38,6	cyclictest	316135	-21	unixbench_multi	22:05:41	1
237652	99	47	38,5	cyclictest	274343	-21	who	21:15:48	1
237652	99	47	37,7	cyclictest	337623	-21	kworker/u4:8-rpciod	22:40:00	1
237652	99	47	37,7	cyclictest	251998	-21	aten_r7power_vo	20:05:15	1
237652	99	47	37,6	cyclictest	268186	-21	timerwakeupswit	21:05:49	1
237652	99	47	36,7	cyclictest	0	-21	swapper/1	23:55:36	1
237652	99	47	36,7	cyclictest	0	-21	swapper/1	23:55:36	1
237650	99	47	41,4	cyclictest	410288	-21	fschecks_time	00:00:22	0
237650	99	47	40,5	cyclictest	414437	-21	gltestperf	00:05:21	0
237650	99	47	40,5	cyclictest	406292	-21	/usr/sbin/munin	23:55:21	0
237650	99	47	40,5	cyclictest	406292	-21	/usr/sbin/munin	23:55:21	0
237650	99	47	40,5	cyclictest	348421	-21	grep	22:45:21	0
237650	99	47	40,5	cyclictest	256718	-21	grep	20:20:38	0
237650	99	47	40,5	cyclictest	256718	-21	grep	20:20:38	0
237650	99	47	40,5	cyclictest	253395	-21	fschecks_count	20:10:23	0
237650	99	47	38,7	cyclictest	294587	-21	gltestperf	21:40:22	0
237650	99	47	28,17	cyclictest	255541	-21	tr	20:20:01	0
237652	99	46	39,5	cyclictest	238874	-21	kworker/u4:13+events_unbound	20:00:02	1
237652	99	46	37,6	cyclictest	238543	-21	sendmail_mailqu	19:10:35	1
237652	99	46	36,7	cyclictest	329231	-21	kworker/u4:13-rpciod	22:25:27	1
237652	99	46	33,8	cyclictest	0	-21	swapper/1	00:05:28	1
237650	99	46	39,5	cyclictest	421932	-21	awk	00:15:01	0
237650	99	46	39,5	cyclictest	307032	-21	/usr/sbin/munin	21:55:20	0
237650	99	46	38,6	cyclictest	431021	-21	sh	00:25:25	0
237650	99	46	38,5	cyclictest	263155	-21	kworker/u4:17+rpciod	20:55:39	0
237652	99	45	36,6	cyclictest	254431	-21	aten2__	20:15:17	1
237652	99	45	36,5	cyclictest	341811	-21	kworker/u4:1-nfsiod	22:45:29	1
237652	99	45	33,7	cyclictest	0	-21	swapper/1	19:35:39	1
237652	99	45	31,10	cyclictest	262410	-21	sort	20:45:20	1
237650	99	45	36,7	cyclictest	260889	-21	aten_r7power_en	20:40:17	0
237650	99	45	36,7	cyclictest	250280	-21	unixbench_multi	19:55:39	0
237652	99	44	35,6	cyclictest	261943	-21	grep	20:45:00	1
237650	99	44	38,4	cyclictest	281488	-21	aten_r7power_en	21:25:18	0
237650	99	44	36,6	cyclictest	240620	-21	fschecks_count	19:20:20	0
237650	99	44	34,8	cyclictest	368887	-21	cpu	23:10:19	0
237652	99	43	36,5	cyclictest	239119	-21	aten_r7power_cu	19:15:17	1
237652	99	43	35,5	cyclictest	238874	-21	kworker/u4:13+events_unbound	20:40:00	1
237652	99	43	29,10	cyclictest	0	-21	swapper/1	19:20:36	1
237650	99	43	36,5	cyclictest	264463	-21	grep	20:55:00	0
237650	99	43	36,5	cyclictest	264463	-21	grep	20:55:00	0
237650	99	43	35,6	cyclictest	245557	-21	aten_r7power_en	19:40:15	0
237650	99	43	34,7	cyclictest	257268	-21	fschecks_count	20:25:19	0
237652	99	42	33,7	cyclictest	254201	-21	kworker/u4:3+events_unbound	20:20:02	1
237652	99	42	33,7	cyclictest	254201	-21	kworker/u4:3+events_unbound	20:20:01	1
237650	99	42	36,4	cyclictest	427243	-21	ntp_states	00:20:37	0
237650	99	41	35,4	cyclictest	252127	-21	grep	20:05:17	0
237650	99	41	33,5	cyclictest	341811	-21	kworker/u4:1+rpciod	22:40:34	0
237650	99	41	33,5	cyclictest	0	-21	swapper/0	22:00:22	0
237650	99	41	14,6	cyclictest	0	-21	swapper/0	19:20:01	0
237652	99	40	30,6	cyclictest	0	-21	swapper/1	19:25:21	1
237652	99	40	29,8	cyclictest	0	-21	swapper/1	20:10:23	1
237650	99	40	31,7	cyclictest	246838	-21	aten_r7power_en	19:45:15	0
237650	99	38	31,5	cyclictest	0	-21	swapper/0	19:35:22	0
237652	99	29	20,6	cyclictest	0	-21	swapper/1	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17