OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Sat Aug 22, 2026 12:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2474511	99	125	113,9	cyclictest	2641564	-21	kworker/u4:1+events_unbound	11:50:48	1
2474509	99	115	91,11	cyclictest	2504036	-21	kworker/u4:13+events_unbound	09:15:28	0
2474509	99	110	96,7	cyclictest	2583719	-21	kworker/u4:14+events_unbound	10:45:41	0
2474509	99	110	90,8	cyclictest	2566342	-21	kworker/u4:0+events_unbound	10:25:38	0
2474511	99	103	84,6	cyclictest	2497541	-21	kworker/u4:5+events_unbound	09:35:31	1
2474511	99	102	81,13	cyclictest	2678939	-21	apt-get	12:25:15	1
2474509	99	102	94,6	cyclictest	2624206	-21	kworker/u4:14+events_unbound	11:25:48	0
2474509	99	102	94,6	cyclictest	2624206	-21	kworker/u4:14+events_unbound	11:25:47	0
2474511	99	101	92,7	cyclictest	2659585	-21	kworker/u4:15+events_unbound	12:05:52	1
2474511	99	101	92,6	cyclictest	2521497	-21	kworker/u4:15+events_unbound	09:45:34	1
2474509	99	100	92,6	cyclictest	2475730	-21	kworker/u4:5+events_unbound	07:45:05	0
2474509	99	96	87,7	cyclictest	2655051	-21	kworker/u4:12+events_unbound	12:00:51	0
2474511	99	95	85,8	cyclictest	2561829	-21	kworker/u4:6+events_unbound	10:15:35	1
2474511	99	91	69,8	cyclictest	2497545	-21	kworker/u4:10+events_unbound	08:50:25	1
2474511	99	87	78,6	cyclictest	2494998	-21	kworker/u4:3+events_unbound	08:30:21	1
2474509	99	87	78,6	cyclictest	2650529	-21	kworker/u4:6+events_unbound	11:55:50	0
2474511	99	86	75,8	cyclictest	2489795	-21	kworker/u4:1+events_unbound	08:45:21	1
2474509	99	85	77,6	cyclictest	2664084	-21	kworker/u4:6+events_unbound	12:25:54	0
2474509	99	83	75,6	cyclictest	2601659	-21	kworker/u4:8+events_unbound	11:00:44	0
2474511	99	79	69,7	cyclictest	2548295	-21	kworker/u4:3+events_unbound	10:05:34	1
2474509	99	79	71,6	cyclictest	2672434	-21	kworker/u4:14+events_unbound	12:20:53	0
2474509	99	79	71,6	cyclictest	2672434	-21	kworker/u4:14+events_unbound	12:20:52	0
2474511	99	78	68,7	cyclictest	2489795	-21	kworker/u4:1+events_unbound	08:40:21	1
2474509	99	77	65,9	cyclictest	256	50	irq/23-42890000.ethernet	09:25:33	0
2474509	99	75	68,5	cyclictest	2681429	-21	kworker/u4:16+events_unbound	12:30:52	0
2474509	99	75	68,5	cyclictest	2619706	-21	kworker/u4:9+events_unbound	11:20:47	0
2474509	99	69	4,8	cyclictest	2640107	-21	ssh	11:40:31	0
2474509	99	69	44,21	cyclictest	256	50	irq/23-42890000.ethernet	08:20:09	0
2474509	99	68	59,6	cyclictest	53	-21	kswapd0	10:50:10	0
2474509	99	68	41,20	cyclictest	256	50	irq/23-42890000.ethernet	07:10:00	0
2474511	99	66	56,8	cyclictest	2480853	-21	kworker/u4:7+events_unbound	08:00:13	1
2474509	99	66	60,4	cyclictest	2475734	-21	kworker/u4:10+events_unbound	07:14:54	0
2474509	99	66	56,7	cyclictest	0	-21	swapper/0	09:35:36	0
2474509	99	65	57,6	cyclictest	2438213	-21	kworker/u4:15+events_unbound	07:19:54	0
2474511	99	64	55,6	cyclictest	2601658	-21	kworker/u4:5+events_unbound	11:05:45	1
2474509	99	63	5,35	cyclictest	2541815	-21	ssh	09:50:10	0
2474509	99	63	5,35	cyclictest	2541815	-21	ssh	09:50:09	0
2474511	99	62	54,6	cyclictest	2579857	-21	kworker/u4:11+events_unbound	10:50:42	1
2474511	99	62	53,7	cyclictest	2484692	-21	kworker/u4:16+events_unbound	09:05:27	1
2474511	99	61	52,7	cyclictest	2480853	-21	kworker/u4:7+events_unbound	08:20:17	1
2474511	99	60	51,6	cyclictest	2494998	-21	kworker/u4:3+events_unbound	08:35:21	1
2474511	99	60	51,6	cyclictest	0	-21	swapper/1	11:20:13	1
2474511	99	60	50,8	cyclictest	2480847	-21	kworker/u4:0+events_unbound	08:05:16	1
2474511	99	59	5,50	cyclictest	2586948	-21	ssh	10:40:29	1
2474511	99	59	51,6	cyclictest	2641566	-21	kworker/u4:4+events_unbound	11:45:48	1
2474511	99	59	44,11	cyclictest	2475261	-21	ntpq	07:10:27	1
2474509	99	57	48,6	cyclictest	2628052	-21	kworker/u4:18+events_unbound	11:30:02	0
2474509	99	57	43,6	cyclictest	2664083	-21	kworker/u4:5+events_unbound	12:15:03	0
2474511	99	56	48,6	cyclictest	2530674	-21	kworker/u4:8+events_unbound	09:50:35	1
2474511	99	56	48,6	cyclictest	2530674	-21	kworker/u4:8+events_unbound	09:50:34	1
2474511	99	56	39,7	cyclictest	53	-21	kswapd0	10:34:59	1
2474509	99	56	4,43	cyclictest	2635846	-21	ssh	11:35:38	0
2474509	99	56	41,9	cyclictest	2650533	-21	kworker/u4:10-rpciod	11:54:24	0
2474509	99	56	36,15	cyclictest	256	50	irq/23-42890000.ethernet	08:40:11	0
2474511	99	55	49,4	cyclictest	2480853	-21	kworker/u4:7+events_unbound	07:45:01	1
2474511	99	55	46,6	cyclictest	2479576	-21	kworker/u4:11+events_unbound	07:29:57	1
2474509	99	55	48,5	cyclictest	2512288	-21	kworker/u4:10+events_unbound	09:20:02	0
2474509	99	55	48,5	cyclictest	2512288	-21	kworker/u4:10+events_unbound	09:20:02	0
2474509	99	55	47,6	cyclictest	2666501	-21	/usr/sbin/munin	12:10:23	0
2474509	99	55	47,5	cyclictest	2600709	-21	unixbench_multi	10:55:41	0
2474509	99	55	43,8	cyclictest	2480851	-21	kworker/u4:4-rpciod	08:05:37	0
2474511	99	54	39,11	cyclictest	0	-21	swapper/1	11:12:42	1
2474509	99	54	48,4	cyclictest	2484692	-21	kworker/u4:16+events_unbound	08:35:02	0
2474509	99	54	44,7	cyclictest	2547042	-21	/usr/sbin/munin	09:55:31	0
2474509	99	54	44,7	cyclictest	2547042	-21	/usr/sbin/munin	09:55:30	0
2474509	99	54	31,19	cyclictest	0	-21	swapper/0	08:30:21	0
2474509	99	54	30,21	cyclictest	0	-21	swapper/0	09:00:00	0
2474511	99	53	41,10	cyclictest	0	-21	swapper/1	11:00:12	1
2474511	99	53	40,10	cyclictest	2666298	-21	grep	12:10:20	1
2474511	99	52	46,4	cyclictest	2657175	-21	aten_r7power_en	12:00:17	1
2474511	99	52	42,8	cyclictest	2501467	-21	kworker/u4:6+events_unbound	09:20:29	1
2474511	99	52	42,8	cyclictest	2501467	-21	kworker/u4:6+events_unbound	09:20:28	1
2474511	99	52	40,8	cyclictest	2590963	-21	ls	10:45:20	1
2474509	99	52	6,22	cyclictest	2614698	-21	ssh	11:11:36	0
2474509	99	52	45,5	cyclictest	2557333	-21	kworker/u4:4+events_unbound	10:17:01	0
2474509	99	52	44,6	cyclictest	2530672	-21	kworker/u4:6+events_unbound	10:01:26	0
2474509	99	52	42,6	cyclictest	2474507	-21	cyclictest	11:15:37	0
2474509	99	52	41,7	cyclictest	256	50	irq/23-42890000.ethernet	12:35:50	0
2474509	99	52	41,7	cyclictest	256	50	irq/23-42890000.ethernet	12:35:50	0
2474509	99	52	36,4	cyclictest	2569200	-21	ntpq	10:20:28	0
2474511	99	51	43,6	cyclictest	0	-21	swapper/1	09:15:26	1
2474511	99	51	41,8	cyclictest	2574215	-21	unixbench_singl	10:25:40	1
2474511	99	51	41,8	cyclictest	2530668	-21	kworker/u4:1+events_unbound	09:40:32	1
2474509	99	51	44,5	cyclictest	2557333	-21	kworker/u4:4+events_unbound	10:14:45	0
2474509	99	51	44,5	cyclictest	0	-21	swapper/0	11:45:12	0
2474509	99	51	43,6	cyclictest	2530672	-21	kworker/u4:6+events_unbound	09:45:02	0
2474509	99	51	43,6	cyclictest	2438213	-21	kworker/u4:15+events_unbound	07:25:14	0
2474509	99	51	41,7	cyclictest	2478187	-21	grep	07:20:38	0
2474509	99	51	33,4	cyclictest	2582009	-21	df_abs	10:35:17	0
2474511	99	50	43,5	cyclictest	2530672	-21	kworker/u4:6+events_unbound	10:00:01	1
2474511	99	50	43,5	cyclictest	2530672	-21	kworker/u4:6+events_unbound	10:00:00	1
2474511	99	50	3,38	cyclictest	2600271	-21	ssh	10:55:33	1
2474509	99	50	44,5	cyclictest	2552835	-21	kworker/u4:7+events_unbound	10:05:01	0
2474509	99	50	42,6	cyclictest	2474507	-21	cyclictest	09:12:14	0
2474509	99	50	35,6	cyclictest	2646036	-21	kworker/u4:3+events_unbound	12:07:32	0
2474511	99	49	43,4	cyclictest	2479805	-21	grep	07:30:16	1
2474511	99	49	42,5	cyclictest	2688378	-21	fschecks_count	12:35:20	1
2474511	99	49	42,5	cyclictest	2688378	-21	fschecks_count	12:35:20	1
2474511	99	49	37,10	cyclictest	2527955	-21	cron	09:35:01	1
2474509	99	49	41,6	cyclictest	2521500	-21	kworker/u4:17+events_unbound	09:30:30	0
2474511	99	48	6,38	cyclictest	2618029	-21	sh	11:15:34	1
2474511	99	48	41,5	cyclictest	2683983	-21	grep	12:30:26	1
2474511	99	48	41,5	cyclictest	2630880	-21	fschecks_count	11:30:25	1
2474511	99	48	41,5	cyclictest	2551351	-21	/usr/sbin/munin	10:00:24	1
2474509	99	48	39,6	cyclictest	2579856	-21	kworker/u4:10+events_unbound	10:40:03	0
2474511	99	47	40,5	cyclictest	2506192	-21	cat	09:10:21	1
2474511	99	47	40,5	cyclictest	2504189	-21	latency_hist	09:05:01	1
2474511	99	47	39,6	cyclictest	2626377	-21	fschecks_count	11:25:22	1
2474511	99	47	39,6	cyclictest	2626377	-21	fschecks_count	11:25:21	1
2474509	99	47	4,39	cyclictest	0	-21	swapper/0	11:05:13	0
2474509	99	47	41,4	cyclictest	0	-21	swapper/0	10:30:42	0
2474509	99	47	26,18	cyclictest	0	-21	swapper/0	07:55:36	0
2474511	99	46	39,5	cyclictest	2675179	-21	fschecks_count	12:20:25	1
2474511	99	46	39,5	cyclictest	2675179	-21	fschecks_count	12:20:24	1
2474511	99	46	39,5	cyclictest	2582145	-21	fschecks_time	10:35:21	1
2474511	99	46	39,4	cyclictest	27	1	ktimers/1	11:55:31	1
2474511	99	46	38,5	cyclictest	2460319	-21	kworker/u4:3+events_unbound	07:25:00	1
2474511	99	46	37,7	cyclictest	2557332	-21	kworker/u4:2+events_unbound	10:10:34	1
2474511	99	46	37,6	cyclictest	2674521	-21	apt-get	12:20:01	1
2474509	99	46	37,7	cyclictest	2492500	-21	latency_hist	08:20:02	0
2474509	99	46	37,6	cyclictest	2503312	-21	gltestperf	09:00:19	0
2474509	99	46	36,7	cyclictest	2494190	-21	fschecks_count	08:25:20	0
2474511	99	45	36,7	cyclictest	2480849	-21	kworker/u4:2-rpciod	07:35:16	1
2474511	99	44	38,4	cyclictest	2484692	-21	kworker/u4:16+events_unbound	08:10:14	1
2474511	99	44	37,5	cyclictest	2568719	-21	df_abs	10:20:17	1
2474511	99	44	36,5	cyclictest	2483814	-21	sed	07:45:17	1
2474511	99	44	35,7	cyclictest	2639767	-21	gltestperf	11:40:20	1
2474509	99	44	37,5	cyclictest	2533936	-21	wc	09:40:42	0
2474509	99	44	29,9	cyclictest	2485985	-21	cron	07:54:59	0
2474511	99	43	33,8	cyclictest	2502084	-21	head	08:55:20	1
2474509	99	43	33,8	cyclictest	2487724	-21	fschecks_count	08:00:20	0
2474511	99	42	34,6	cyclictest	2635480	-21	kernelversion	11:35:23	1
2474511	99	42	32,6	cyclictest	0	-21	swapper/1	09:25:27	1
2474509	99	42	35,5	cyclictest	0	-21	swapper/0	08:45:22	0
2474509	99	42	33,6	cyclictest	2505266	-21	unixbench_singl	09:05:38	0
2474509	99	42	23,16	cyclictest	2480853	-21	kworker/u4:7-rpciod	07:39:59	0
2474511	99	41	35,4	cyclictest	2492392	-21	sendmail	08:20:01	1
2474511	99	41	33,6	cyclictest	27	1	ktimers/1	07:50:33	1
2474511	99	41	32,7	cyclictest	378	-21	dbus-daemon	08:25:16	1
2474509	99	41	33,5	cyclictest	2480852	-21	kworker/u4:6-rpciod	07:40:38	0
2474509	99	40	31,6	cyclictest	0	-21	swapper/0	08:10:16	0
2474509	99	40	30,7	cyclictest	0	-21	swapper/0	08:55:01	0
2474509	99	40	30,7	cyclictest	0	-21	swapper/0	07:30:16	0
2474511	99	39	33,4	cyclictest	2474518	-21	latency_hist	07:10:01	1
2474511	99	39	32,5	cyclictest	0	-21	swapper/1	07:19:53	1
2474511	99	39	29,7	cyclictest	0	-21	swapper/1	07:55:36	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17