OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Mon Dec 01, 2025 12:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2302927	99	179	156,16	cyclictest	2306761	-21	kworker/u4:16+events_unbound	08:20:06	0
2302927	99	134	127,5	cyclictest	2372652	-21	kworker/u4:10+events_unbound	10:10:22	0
2302927	99	126	117,7	cyclictest	2304153	-21	kworker/u4:0+events_unbound	07:20:25	0
2302927	99	126	117,7	cyclictest	2304153	-21	kworker/u4:0+events_unbound	07:20:25	0
2302927	99	116	109,5	cyclictest	2470566	-21	kworker/u4:3+events_unbound	12:31:04	0
2302927	99	112	102,6	cyclictest	2345225	-21	kworker/u4:6+events_unbound	09:30:18	0
2302927	99	104	98,4	cyclictest	2430875	-21	kworker/u4:1+events_unbound	11:36:21	0
2302927	99	95	84,8	cyclictest	2400502	-21	kworker/u4:11+events_unbound	10:50:38	0
2302929	99	94	81,9	cyclictest	2369326	-21	kworker/u4:4+events_unbound	10:40:36	1
2302927	99	94	85,6	cyclictest	2328754	-21	kworker/u4:12+events_unbound	09:20:54	0
2302927	99	92	83,6	cyclictest	2382650	-21	kworker/u4:2+events_unbound	10:30:34	0
2302927	99	87	79,6	cyclictest	2351704	-21	kworker/u4:9+events_unbound	09:40:58	0
2302929	99	85	76,6	cyclictest	2305442	-21	kworker/u4:12+events_unbound	07:39:56	1
2302927	99	83	75,6	cyclictest	2440976	-21	kworker/u4:5+events_unbound	11:46:23	0
2302927	99	83	74,6	cyclictest	2447826	-21	kworker/u4:12+events_unbound	12:01:01	0
2302927	99	83	73,7	cyclictest	2458647	-21	kworker/u4:7+events_unbound	12:16:04	0
2302929	99	82	74,6	cyclictest	2458643	-21	kworker/u4:1+events_unbound	12:21:03	1
2302927	99	82	74,6	cyclictest	2396991	-21	kworker/u4:5+events_unbound	11:05:41	0
2302927	99	82	73,7	cyclictest	2306761	-21	kworker/u4:16+events_unbound	08:55:13	0
2302929	99	81	76,3	cyclictest	2365822	-21	kworker/u4:13+events_unbound	10:31:05	1
2302929	99	81	71,7	cyclictest	2351704	-21	kworker/u4:9+events_unbound	09:51:00	1
2302929	99	80	72,5	cyclictest	2345223	-21	kworker/u4:3+events_unbound	09:40:22	1
2302929	99	80	70,7	cyclictest	2300398	-21	kworker/u4:5+events_unbound	07:10:25	1
2302927	99	80	71,6	cyclictest	2300396	-21	kworker/u4:3+events_unbound	07:55:39	0
2302929	99	79	71,6	cyclictest	2326164	-21	kworker/u4:11+events_unbound	09:05:51	1
2302929	99	79	70,6	cyclictest	2345226	-21	kworker/u4:7+events_unbound	10:05:22	1
2302929	99	79	69,6	cyclictest	2326164	-21	kworker/u4:11+events_unbound	08:45:11	1
2302929	99	79	62,5	cyclictest	2326163	-21	kworker/u4:9+events_unbound	08:50:48	1
2302929	99	78	73,3	cyclictest	2407267	-21	kworker/u4:13+events_unbound	11:11:15	1
2302929	99	78	69,7	cyclictest	2305439	-21	kworker/u4:9+events_unbound	07:19:51	1
2302927	99	77	69,6	cyclictest	2462583	-21	kworker/u4:2+events_unbound	12:25:00	0
2302927	99	77	68,6	cyclictest	2304153	-21	kworker/u4:0+events_unbound	08:05:04	0
2302929	99	76	68,5	cyclictest	2332627	-21	kworker/u4:13+events_unbound	09:10:53	1
2302929	99	76	67,6	cyclictest	2305442	-21	kworker/u4:12+events_unbound	07:49:57	1
2302929	99	76	66,7	cyclictest	2365822	-21	kworker/u4:13+events_unbound	10:00:22	1
2302927	99	75	68,5	cyclictest	2396991	-21	kworker/u4:5+events_unbound	11:10:43	0
2302927	99	75	67,6	cyclictest	2396991	-21	kworker/u4:5+events_unbound	11:21:17	0
2302927	99	73	65,6	cyclictest	2444757	-21	kworker/u4:2+events_unbound	12:11:26	0
2302927	99	73	63,7	cyclictest	2306761	-21	kworker/u4:16+events_unbound	08:30:09	0
2302927	99	73	58,7	cyclictest	2462586	-21	kworker/u4:5+events_unbound	12:26:05	0
2302929	99	72	42,27	cyclictest	2436976	-21	sendmail_mailqu	11:40:39	1
2302929	99	71	62,6	cyclictest	2306761	-21	kworker/u4:16+events_unbound	07:44:57	1
2302929	99	71	37,4	cyclictest	2377595	-21	df_abs	10:15:17	1
2302927	99	71	64,5	cyclictest	2444756	-21	kworker/u4:1+events_unbound	11:55:59	0
2302929	99	70	61,6	cyclictest	2355153	-21	kworker/u4:12+events_unbound	09:56:01	1
2302929	99	70	39,4	cyclictest	2357528	-21	/usr/sbin/munin	09:45:37	1
2302929	99	70	38,4	cyclictest	2443626	-21	ps	11:50:44	1
2302927	99	70	62,6	cyclictest	2322320	-21	kworker/u4:6+events_unbound	08:35:10	0
2302929	99	67	33,7	cyclictest	0	-21	swapper/1	11:15:38	1
2302929	99	66	60,4	cyclictest	2444757	-21	kworker/u4:2+events_unbound	12:01:25	1
2302929	99	65	36,5	cyclictest	0	-21	swapper/1	09:35:36	1
2302929	99	65	36,5	cyclictest	0	-21	swapper/1	09:35:36	1
2302929	99	65	32,7	cyclictest	2374376	-21	fschecks_time	10:10:21	1
2302927	99	65	56,7	cyclictest	2372649	-21	kworker/u4:3+events_unbound	10:15:25	0
2302929	99	64	57,5	cyclictest	2338847	-21	kworker/u4:18+events_unbound	09:20:18	1
2302929	99	63	53,7	cyclictest	2407268	-21	kworker/u4:14+events_unbound	11:00:39	1
2302929	99	62	53,7	cyclictest	2322320	-21	kworker/u4:6+events_unbound	09:15:18	1
2302927	99	62	55,5	cyclictest	2450845	-21	kworker/u4:14+events_unbound	12:06:00	0
2302929	99	61	53,6	cyclictest	2450845	-21	kworker/u4:14+events_unbound	12:06:25	1
2302927	99	56	49,5	cyclictest	2368515	-21	/usr/sbin/munin	10:00:40	0
2302927	99	55	48,5	cyclictest	2351704	-21	kworker/u4:9+events_unbound	09:45:22	0
2302927	99	55	33,6	cyclictest	0	-21	swapper/0	11:00:39	0
2302927	99	55	32,21	cyclictest	2313662	-21	fschecks_count	07:50:19	0
2302927	99	54	41,7	cyclictest	2328786	-21	kworker/u4:9	08:50:00	0
2302929	99	53	45,5	cyclictest	2300396	-21	kworker/u4:3+events_unbound	07:35:02	1
2302927	99	53	30,20	cyclictest	2304685	-21	fschecks_time	07:15:19	0
2302927	99	53	29,21	cyclictest	0	-21	swapper/0	10:25:40	0
2302929	99	52	43,6	cyclictest	2332661	-21	sh	09:05:00	1
2302929	99	52	43,5	cyclictest	0	-21	swapper/1	11:05:16	1
2302927	99	52	43,6	cyclictest	2304153	-21	kworker/u4:0+events_unbound	09:00:51	0
2302927	99	52	31,19	cyclictest	0	-21	swapper/0	09:15:49	0
2302929	99	51	43,5	cyclictest	2346360	-21	sh	09:30:00	1
2302929	99	51	43,5	cyclictest	2292774	-21	kworker/u4:14+events_unbound	07:55:00	1
2302929	99	51	41,7	cyclictest	2432294	-21	latency_hist	11:35:02	1
2302927	99	51	43,5	cyclictest	2398901	-21	gltestperf	10:45:26	0
2302927	99	51	43,5	cyclictest	2398901	-21	gltestperf	10:45:26	0
2302927	99	51	42,7	cyclictest	2400503	-21	kworker/u4:12+events_unbound	10:55:39	0
2302927	99	51	41,8	cyclictest	2332624	-21	kworker/u4:5+events_unbound	09:05:17	0
2302927	99	51	40,8	cyclictest	2329254	-21	fschecks_time	08:50:24	0
2302927	99	51	32,17	cyclictest	2425534	-21	aten2__	11:25:16	0
2302929	99	50	43,4	cyclictest	0	-21	swapper/1	12:25:14	1
2302929	99	50	41,7	cyclictest	2472927	-21	sh	12:30:23	1
2302929	99	50	39,8	cyclictest	2322043	-21	switchtime	08:20:42	1
2302929	99	50	36,8	cyclictest	0	-21	swapper/1	07:30:00	1
2302927	99	50	43,5	cyclictest	2365822	-21	kworker/u4:13+events_unbound	10:20:33	0
2302929	99	49	41,5	cyclictest	0	-21	swapper/1	10:50:37	1
2302929	99	49	40,7	cyclictest	2384535	-21	aten_r7power_en	10:25:18	1
2302929	99	49	38,8	cyclictest	2477206	-21	timerwakeupswit	12:35:39	1
2302929	99	49	37,9	cyclictest	2398750	-21	fschecks_count	10:45:25	1
2302929	99	49	37,9	cyclictest	2398750	-21	fschecks_count	10:45:25	1
2302927	99	49	42,5	cyclictest	2419522	-21	sendmail_mailqu	11:15:43	0
2302927	99	49	42,5	cyclictest	2369326	-21	kworker/u4:4+events_unbound	10:41:11	0
2302929	99	48	41,5	cyclictest	2383234	-21	sshd	10:23:04	1
2302927	99	48	41,5	cyclictest	2436518	-21	gltestperf	11:40:23	0
2302927	99	48	39,7	cyclictest	2474445	-21	kworker/u4:10+events_unbound	12:36:05	0
2302927	99	48	30,12	cyclictest	257	50	irq/23-42890000.ethernet	09:10:08	0
2302929	99	47	40,4	cyclictest	2394621	-21	kworker/u4:9	10:40:00	1
2302929	99	47	40,4	cyclictest	2394621	-21	kworker/u4:9	10:40:00	1
2302929	99	47	38,7	cyclictest	2326376	-21	systemd	08:40:10	1
2302929	99	47	38,6	cyclictest	2325823	-21	sendmail_mailqu	08:35:40	1
2302929	99	47	38,6	cyclictest	0	-21	swapper/1	12:15:14	1
2302929	99	47	37,7	cyclictest	0	-21	swapper/1	11:45:53	1
2302929	99	47	36,7	cyclictest	0	-21	swapper/1	11:35:12	1
2302927	99	47	41,4	cyclictest	0	-21	swapper/0	07:30:29	0
2302927	99	47	40,5	cyclictest	2360703	-21	fschecks_count	09:50:26	0
2302927	99	47	39,6	cyclictest	2391679	-21	sed	10:35:18	0
2302927	99	47	39,6	cyclictest	2391679	-21	sed	10:35:18	0
2302927	99	47	39,6	cyclictest	2370945	-21	fschecks_count	10:05:22	0
2302927	99	47	39,6	cyclictest	2313235	-21	munin-run	07:50:00	0
2302927	99	47	38,5	cyclictest	2349830	-21	apt-get	09:35:16	0
2302927	99	47	38,5	cyclictest	2349830	-21	apt-get	09:35:16	0
2302927	99	47	26,19	cyclictest	2322762	-21	fschecks_count	08:25:18	0
2302927	99	47	26,19	cyclictest	2322762	-21	fschecks_count	08:25:18	0
2302927	99	47	26,18	cyclictest	0	-21	swapper/0	07:40:15	0
2302929	99	46	36,8	cyclictest	2422313	-21	/usr/sbin/munin	11:20:20	1
2302929	99	46	36,7	cyclictest	2457866	-21	unixbench-2d	12:10:40	1
2302929	99	46	36,7	cyclictest	2315620	-21	unixbench-2d	07:55:40	1
2302927	99	46	38,6	cyclictest	2318873	-21	fschecks_time	08:10:20	0
2302927	99	46	38,5	cyclictest	2317063	-21	kworker/u4:1+events_unbound	09:25:56	0
2302929	99	45	37,6	cyclictest	2446198	-21	df_abs	11:55:22	1
2302929	99	45	37,6	cyclictest	2318032	-21	mailstats	08:05:40	1
2302929	99	45	36,6	cyclictest	2413863	-21	kworker/u4:4-rpciod	11:25:30	1
2302927	99	45	36,6	cyclictest	2307908	-21	unixbench-2d	07:25:40	0
2302929	99	44	35,7	cyclictest	2406712	-21	systemd	10:56:13	1
2302929	99	44	34,8	cyclictest	2302987	-21	latency_hist	07:10:01	1
2302929	99	44	34,7	cyclictest	0	-21	swapper/1	08:20:01	1
2302927	99	44	37,5	cyclictest	2326426	-21	aten2__	08:40:14	0
2302927	99	44	36,5	cyclictest	2314474	-21	kworker/u4:11+events_unbound	08:00:36	0
2302927	99	44	35,7	cyclictest	2443137	-21	fschecks_time	11:50:24	0
2302929	99	43	35,6	cyclictest	2346828	-21	df_abs	09:30:18	1
2302929	99	43	35,5	cyclictest	2314471	-21	kworker/u4:2-xprtiod	08:04:59	1
2302927	99	43	35,5	cyclictest	2358727	-21	kworker/u4:14-rpciod	09:55:41	0
2302929	99	42	32,7	cyclictest	0	-21	swapper/1	07:25:00	1
2302929	99	42	32,7	cyclictest	0	-21	swapper/1	07:25:00	1
2302929	99	41	35,4	cyclictest	2319619	-21	systemd	08:10:41	1
2302929	99	41	32,6	cyclictest	2306761	-21	kworker/u4:16-rpciod	08:30:17	1
2302929	99	40	32,6	cyclictest	2323299	-21	cat	08:25:38	1
2302929	99	40	32,6	cyclictest	2323299	-21	cat	08:25:38	1
2302927	99	40	33,5	cyclictest	2303106	-21	aten2__	07:10:16	0
2302927	99	40	32,5	cyclictest	2321161	-21	latency_hist	08:20:01	0
2302929	99	39	31,5	cyclictest	0	-21	swapper/1	08:55:24	1
2302927	99	39	29,7	cyclictest	2429075	-21	aten_r7power_cu	11:30:17	0
2302927	99	39	28,9	cyclictest	2310163	-21	systemd	07:35:30	0
2302927	99	35	27,6	cyclictest	0	-21	swapper/0	07:10:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17