OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Sun Nov 09, 2025 00:44:07)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2469412	99	138	130,6	cyclictest	2609375	-21	kworker/u4:4+events_unbound	23:43:41	0
2469412	99	127	118,7	cyclictest	2624538	-21	kworker/u4:6+events_unbound	23:53:41	0
2469412	99	122	112,7	cyclictest	2525605	-21	kworker/u4:8+events_unbound	21:43:15	0
2469412	99	116	108,6	cyclictest	2601402	-21	kworker/u4:16+events_unbound	23:28:39	0
2469412	99	114	106,6	cyclictest	2616805	-21	kworker/u4:8+events_unbound	23:58:44	0
2469412	99	111	102,7	cyclictest	2533368	-21	kworker/u4:4+events_unbound	21:53:17	0
2469412	99	108	101,5	cyclictest	2517904	-21	kworker/u4:10+events_unbound	21:33:15	0
2469412	99	107	100,5	cyclictest	2521721	-21	kworker/u4:1+events_unbound	21:38:14	0
2469412	99	105	97,6	cyclictest	2541142	-21	kworker/u4:1+events_unbound	22:13:22	0
2469412	99	104	95,7	cyclictest	2537233	-21	kworker/u4:7+events_unbound	22:03:20	0
2469412	99	104	95,7	cyclictest	2537233	-21	kworker/u4:7+events_unbound	22:03:20	0
2469412	99	104	84,6	cyclictest	2525600	-21	kworker/u4:0+events_unbound	21:48:16	0
2469412	99	102	95,5	cyclictest	2500459	-21	kworker/u4:7+events_unbound	21:13:10	0
2469412	99	102	95,5	cyclictest	2500459	-21	kworker/u4:7+events_unbound	21:13:09	0
2469412	99	101	92,7	cyclictest	2559713	-21	kworker/u4:12+events_unbound	22:33:30	0
2469412	99	98	81,6	cyclictest	2578863	-21	kworker/u4:8+events_unbound	22:53:31	0
2469414	99	96	86,7	cyclictest	2475802	-21	kworker/u4:2+events_unbound	20:17:59	1
2469414	99	96	86,7	cyclictest	2475802	-21	kworker/u4:2+events_unbound	20:17:58	1
2469412	99	95	87,6	cyclictest	2470631	-21	kworker/u4:4+events_unbound	19:12:52	0
2469414	99	90	81,7	cyclictest	2578862	-21	kworker/u4:7+events_unbound	23:23:37	1
2469414	99	87	82,3	cyclictest	2474519	-21	kworker/u4:14+events_unbound	19:27:53	1
2469414	99	86	79,5	cyclictest	2548793	-21	kworker/u4:14+events_unbound	22:13:25	1
2469412	99	86	79,5	cyclictest	2646414	-21	kworker/u4:11+events_unbound	00:38:55	0
2469412	99	83	75,6	cyclictest	2475802	-21	kworker/u4:2+events_unbound	20:53:06	0
2469412	99	83	75,6	cyclictest	2475802	-21	kworker/u4:2+events_unbound	20:18:03	0
2469412	99	83	75,6	cyclictest	2475802	-21	kworker/u4:2+events_unbound	20:18:02	0
2469414	99	81	77,2	cyclictest	2500460	-21	kworker/u4:8+events_unbound	21:08:07	1
2469414	99	81	18,19	cyclictest	0	-21	swapper/1	22:00:32	1
2469414	99	81	18,19	cyclictest	0	-21	swapper/1	22:00:31	1
2469412	99	81	73,6	cyclictest	2541147	-21	kworker/u4:9+events_unbound	22:23:25	0
2469412	99	80	72,6	cyclictest	2639399	-21	kworker/u4:4+events_unbound	00:18:49	0
2469412	99	80	72,6	cyclictest	2632228	-21	kworker/u4:4+events_unbound	00:03:44	0
2469412	99	79	71,6	cyclictest	2483543	-21	kworker/u4:19+events_unbound	20:22:59	0
2469412	99	79	70,7	cyclictest	2578862	-21	kworker/u4:7+events_unbound	23:13:36	0
2469414	99	78	35,38	cyclictest	2573545	-21	ssh	22:45:26	1
2469412	99	77	68,6	cyclictest	2651753	-21	ld	00:30:34	0
2469414	99	76	40,33	cyclictest	2641183	-21	/usr/sbin/munin	00:15:19	1
2469412	99	76	67,7	cyclictest	2491347	-21	kworker/u4:4+events_unbound	20:33:05	0
2469414	99	75	70,3	cyclictest	2473239	-21	kworker/u4:12+events_unbound	19:22:51	1
2469414	99	75	58,12	cyclictest	2584395	-21	ssh	23:00:14	1
2469414	99	74	65,7	cyclictest	2500459	-21	kworker/u4:7+events_unbound	21:33:13	1
2469414	99	74	65,7	cyclictest	2460541	-21	kworker/u4:13+events_unbound	20:02:59	1
2469414	99	74	65,7	cyclictest	2460541	-21	kworker/u4:13+events_unbound	20:02:59	1
2469414	99	74	65,6	cyclictest	2578860	-21	kworker/u4:5+events_unbound	22:58:32	1
2469414	99	74	65,6	cyclictest	2525601	-21	kworker/u4:3+events_unbound	21:43:16	1
2469414	99	74	39,32	cyclictest	2558427	-21	gltestperf	22:25:27	1
2469412	99	74	64,8	cyclictest	2559713	-21	kworker/u4:12+events_unbound	22:43:30	0
2469412	99	73	65,5	cyclictest	2567337	-21	kworker/u4:10+events_unbound	22:50:02	0
2469414	99	72	67,3	cyclictest	2479675	-21	kworker/u4:16+events_unbound	20:43:05	1
2469414	99	72	63,7	cyclictest	2470637	-21	kworker/u4:6+events_unbound	20:38:01	1
2469412	99	72	64,6	cyclictest	2474519	-21	kworker/u4:14+events_unbound	20:07:57	0
2469412	99	72	61,9	cyclictest	53	-21	kswapd0	00:10:13	0
2469414	99	71	61,7	cyclictest	2474519	-21	kworker/u4:14+events_unbound	20:23:03	1
2469412	99	69	61,6	cyclictest	2500459	-21	kworker/u4:7+events_unbound	21:30:00	0
2469414	99	68	59,7	cyclictest	2541147	-21	kworker/u4:9+events_unbound	22:18:24	1
2469414	99	68	59,6	cyclictest	2639400	-21	kworker/u4:8+events_unbound	00:28:54	1
2469414	99	68	58,7	cyclictest	2475801	-21	kworker/u4:1+events_unbound	19:37:54	1
2469414	99	68	35,5	cyclictest	2654309	-21	/usr/sbin/munin	00:35:21	1
2469414	99	68	35,30	cyclictest	2616805	-21	kworker/u4:8-rpciod	00:00:33	1
2469412	99	68	61,5	cyclictest	2613353	-21	kworker/u4:6+events_unbound	23:38:39	0
2469412	99	67	59,6	cyclictest	2477085	-21	kworker/u4:9+events_unbound	19:47:55	0
2469414	99	66	58,6	cyclictest	2635945	-21	kworker/u4:2+events_unbound	00:10:01	1
2469414	99	66	58,6	cyclictest	2510724	-21	kworker/u4:5+events_unbound	21:23:09	1
2469414	99	66	58,6	cyclictest	2478392	-21	kworker/u4:10+events_unbound	20:12:57	1
2469414	99	66	33,5	cyclictest	2590264	-21	kworker/u4:3-nfsiod	23:25:11	1
2469412	99	66	61,3	cyclictest	2497783	-21	kworker/u4:5+events_unbound	20:58:06	0
2469412	99	66	60,4	cyclictest	2548793	-21	kworker/u4:14+events_unbound	22:28:27	0
2469414	99	65	57,5	cyclictest	2578863	-21	kworker/u4:8+events_unbound	23:18:36	1
2469412	99	64	56,6	cyclictest	2621172	-21	kworker/u4:2+events_unbound	23:50:01	0
2469414	99	63	56,5	cyclictest	2635948	-21	kworker/u4:6+events_unbound	00:15:01	1
2469414	99	62	36,5	cyclictest	2543422	-21	uname	22:05:24	1
2469412	99	62	54,6	cyclictest	2474519	-21	kworker/u4:14+events_unbound	19:57:55	0
2469414	99	61	29,6	cyclictest	2527709	-21	aten_r7power_po	21:45:22	1
2469412	99	61	42,11	cyclictest	0	-21	swapper/0	22:05:33	0
2469412	99	61	37,12	cyclictest	257	50	irq/23-42890000.ethernet	19:10:01	0
2469412	99	60	45,9	cyclictest	2581550	-21	mailstats	22:55:37	0
2469414	99	59	5,51	cyclictest	2535829	-21	ssh	21:55:25	1
2469414	99	59	51,6	cyclictest	398	-21	systemd-logind	23:48:42	1
2469412	99	58	50,6	cyclictest	2500460	-21	kworker/u4:8+events_unbound	21:18:07	0
2469412	99	58	50,6	cyclictest	2500460	-21	kworker/u4:8+events_unbound	21:18:06	0
2469412	99	58	49,6	cyclictest	2474519	-21	kworker/u4:14+events_unbound	19:42:55	0
2469412	99	57	37,18	cyclictest	2480208	-21	fschecks_time	19:50:21	0
2469414	99	56	51,3	cyclictest	2497781	-21	kworker/u4:1+events_unbound	21:03:08	1
2469412	99	56	46,5	cyclictest	2647756	-21	ssh	00:25:13	0
2469414	99	54	46,6	cyclictest	2475803	-21	kworker/u4:7+events_unbound	19:52:59	1
2469414	99	54	45,6	cyclictest	2479675	-21	kworker/u4:16+events_unbound	19:57:57	1
2469414	99	54	44,8	cyclictest	379	-21	dbus-daemon	23:38:39	1
2469412	99	54	27,18	cyclictest	257	50	irq/23-42890000.ethernet	21:05:10	0
2469412	99	53	40,5	cyclictest	2470631	-21	kworker/u4:4+events_unbound	19:22:54	0
2469414	99	52	44,5	cyclictest	2515790	-21	awk	21:30:00	1
2469412	99	52	46,5	cyclictest	2474519	-21	kworker/u4:14+events_unbound	19:32:56	0
2469414	99	51	41,8	cyclictest	2593489	-21	kworker/u4:9+events_unbound	23:15:00	1
2469412	99	51	44,5	cyclictest	2508891	-21	gltestperf	21:20:20	0
2469412	99	51	43,6	cyclictest	2608184	-21	sh	23:30:39	0
2469414	99	50	45,4	cyclictest	2609375	-21	kworker/u4:4+events_unbound	23:33:40	1
2469414	99	50	43,5	cyclictest	2479684	-21	systemd	19:47:56	1
2469414	99	50	39,7	cyclictest	2588053	-21	dpkg	23:05:12	1
2469412	99	50	6,10	cyclictest	0	-21	swapper/0	23:00:13	0
2469414	99	49	41,6	cyclictest	2470631	-21	kworker/u4:4+events_unbound	19:42:58	1
2469414	99	49	40,7	cyclictest	379	-21	dbus-daemon	23:53:42	1
2469414	99	49	40,7	cyclictest	2497782	-21	kworker/u4:3+events_unbound	20:58:07	1
2469414	99	49	40,6	cyclictest	0	-21	swapper/1	23:43:39	1
2469412	99	49	40,6	cyclictest	2568923	-21	grep	22:40:01	0
2469414	99	48	39,7	cyclictest	379	-21	dbus-daemon	21:38:14	1
2469414	99	48	39,7	cyclictest	2483543	-21	kworker/u4:19+events_unbound	20:08:00	1
2469414	99	48	39,6	cyclictest	2554121	-21	/usr/sbin/munin	22:20:13	1
2469412	99	48	35,8	cyclictest	2635945	-21	kworker/u4:2-rpciod	00:10:00	0
2469412	99	48	28,18	cyclictest	0	-21	swapper/0	21:55:19	0
2469414	99	47	39,6	cyclictest	2609374	-21	kworker/u4:1+events_unbound	00:00:00	1
2469414	99	47	38,7	cyclictest	2506841	-21	kworker/u4:1+events_unbound	21:20:00	1
2469414	99	47	38,7	cyclictest	2506841	-21	kworker/u4:1+events_unbound	21:20:00	1
2469412	99	47	40,5	cyclictest	2599688	-21	df_abs	23:20:17	0
2469412	99	47	38,7	cyclictest	2492693	-21	idleruntime-cro	20:39:59	0
2469414	99	46	39,5	cyclictest	2577337	-21	/usr/sbin/munin	22:50:23	1
2469412	99	46	6,7	cyclictest	2550381	-21	apt-get	22:15:19	0
2469414	99	45	37,6	cyclictest	2475802	-21	kworker/u4:2+events_unbound	20:48:07	1
2469414	99	45	37,6	cyclictest	2475802	-21	kworker/u4:2+events_unbound	20:28:05	1
2469412	99	45	38,5	cyclictest	2482816	-21	fschecks_time	20:00:21	0
2469412	99	45	38,5	cyclictest	2482816	-21	fschecks_time	20:00:20	0
2469412	99	45	36,7	cyclictest	2644990	-21	gltestperf	00:20:20	0
2469412	99	45	35,7	cyclictest	340	-21	systemd-udevd	23:07:35	0
2469414	99	44	36,5	cyclictest	2482236	-21	kworker/u4:18+events_unbound	20:35:01	1
2469412	99	44	38,4	cyclictest	2493639	-21	cat	20:40:37	0
2469412	99	44	35,7	cyclictest	2485967	-21	unixbench-2d	20:10:40	0
2469414	99	43	36,5	cyclictest	2471981	-21	apt	19:19:59	1
2469412	99	43	23,7	cyclictest	2470636	-21	kworker/u4:5+rpciod	19:35:44	0
2469414	99	42	35,5	cyclictest	2561975	-21	cat	22:30:20	1
2469414	99	42	34,6	cyclictest	0	-21	swapper/1	22:35:37	1
2469414	99	42	34,5	cyclictest	2531596	-21	sshd	21:50:20	1
2469414	99	42	34,5	cyclictest	2496527	-21	kworker/u4:2	20:55:00	1
2469414	99	42	33,6	cyclictest	0	-21	swapper/1	22:40:30	1
2469414	99	42	31,8	cyclictest	2500458	-21	kworker/u4:0-rpciod	21:10:23	1
2469414	99	42	31,8	cyclictest	2500458	-21	kworker/u4:0-rpciod	21:10:22	1
2469412	99	42	34,5	cyclictest	2499264	-21	awk	21:05:02	0
2469412	99	42	32,7	cyclictest	0	-21	swapper/0	20:25:21	0
2469414	99	41	34,5	cyclictest	2645444	-21	processes	00:20:36	1
2469414	99	41	28,9	cyclictest	0	-21	swapper/1	19:30:23	1
2469414	99	40	32,5	cyclictest	0	-21	swapper/1	19:10:39	1
2469414	99	40	30,7	cyclictest	37	-21	kcompactd0	00:34:48	1
2469412	99	40	34,4	cyclictest	2595819	-21	df_abs	23:15:18	0
2469412	99	40	32,5	cyclictest	2470640	-21	kworker/u4:10-xprtiod	19:15:36	0
2469412	99	38	31,5	cyclictest	0	-21	swapper/0	20:45:21	0
2469412	99	37	25,9	cyclictest	0	-21	swapper/0	19:25:14	0
2469414	99	29	22,5	cyclictest	2469520	-21	latency_hist	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17