OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Sun Sep 13, 2026 12:44:07)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2575989	99	86	78,5	cyclictest	2702325	-21	kworker/u4:10+events_unbound	11:00:26	0
2575992	99	82	56,5	cyclictest	2649671	-21	kworker/u4:11+events_unbound	10:00:16	1
2575989	99	82	7,37	cyclictest	2727443	-21	ssh	11:25:28	0
2575989	99	81	43,36	cyclictest	2577224	-21	systemd	07:14:34	0
2575989	99	81	34,44	cyclictest	0	-21	swapper/0	11:55:45	0
2575992	99	80	73,5	cyclictest	2746600	-21	kworker/u4:7+events_unbound	12:05:47	1
2575989	99	77	34,40	cyclictest	0	-21	swapper/0	11:20:32	0
2575989	99	74	39,32	cyclictest	2664871	-21	aten_r7power_po	10:15:16	0
2575989	99	73	42,29	cyclictest	2776675	-21	/usr/sbin/munin	12:20:42	0
2575992	99	72	64,6	cyclictest	2631654	-21	kworker/u4:7+events_unbound	09:45:10	1
2575989	99	72	40,29	cyclictest	2578436	-21	unixbench_singl	07:15:36	0
2575989	99	71	41,28	cyclictest	2700926	-21	ldconfig	10:55:28	0
2575989	99	71	35,31	cyclictest	0	-21	swapper/0	08:00:20	0
2575992	99	70	52,5	cyclictest	2622638	-21	kworker/u4:11+events_unbound	09:50:11	1
2575989	99	70	32,35	cyclictest	2612633	-21	xargs	09:15:38	0
2575989	99	70	31,6	cyclictest	0	-21	swapper/0	10:20:29	0
2575989	99	70	27,7	cyclictest	2695912	-21	aten_r7power_po	10:50:20	0
2575989	99	70	1,14	cyclictest	2601059	-21	ntpq	08:45:26	0
2575989	99	69	32,34	cyclictest	2643166	-21	/usr/sbin/munin	09:50:27	0
2575989	99	69	30,7	cyclictest	0	-21	swapper/0	11:35:14	0
2575992	99	68	60,6	cyclictest	2595202	-21	kworker/u4:2+events_unbound	08:50:01	1
2575989	99	68	36,29	cyclictest	2762878	-21	netstat	12:05:23	0
2575989	99	68	31,6	cyclictest	0	-21	swapper/0	09:30:33	0
2575989	99	67	34,5	cyclictest	2753036	-21	idleruntime-cro	11:55:01	0
2575989	99	67	32,32	cyclictest	2656691	-21	ld	10:05:29	0
2575989	99	67	30,8	cyclictest	2583739	-21	idleruntime-cro	07:40:00	0
2575992	99	66	57,6	cyclictest	2751119	-21	kworker/u4:4+events_unbound	11:55:03	1
2575992	99	66	53,7	cyclictest	2700448	-21	diskstats	10:55:17	1
2575992	99	66	49,14	cyclictest	2735547	-21	sh	11:35:12	1
2575989	99	66	4,24	cyclictest	2649452	-21	ssh	09:57:16	0
2575989	99	66	39,25	cyclictest	2731165	-21	aten2__	11:30:15	0
2575989	99	66	31,31	cyclictest	0	-21	swapper/0	09:25:02	0
2575989	99	66	29,5	cyclictest	0	-21	swapper/0	10:10:42	0
2575989	99	66	2,32	cyclictest	2677717	-21	modprobe	10:30:00	0
2575992	99	65	55,7	cyclictest	2618111	-21	kworker/u4:5+events_unbound	09:25:05	1
2575992	99	65	49,12	cyclictest	2722388	-21	aten2__	11:20:16	1
2575989	99	65	35,28	cyclictest	2575988	-21	cyclictest	10:45:36	0
2575989	99	65	32,5	cyclictest	0	-21	swapper/0	12:13:27	0
2575989	99	65	32,30	cyclictest	0	-21	swapper/0	07:25:27	0
2575989	99	65	29,5	cyclictest	0	-21	swapper/0	09:50:01	0
2575989	99	65	27,5	cyclictest	2711341	-21	kworker/u4:6-rpciod	11:40:37	0
2575989	99	65	23,39	cyclictest	2682492	-21	aten2__	10:35:16	0
2575989	99	64	27,34	cyclictest	2687016	-21	aten_r7power_en	10:40:18	0
2575989	99	64	26,8	cyclictest	0	-21	swapper/0	12:25:32	0
2575989	99	64	26,6	cyclictest	0	-21	swapper/0	11:45:25	0
2575989	99	63	31,4	cyclictest	2769246	-21	kworker/u4:3-rpciod	12:15:46	0
2575989	99	63	30,4	cyclictest	0	-21	swapper/0	12:00:31	0
2575989	99	63	29,5	cyclictest	0	-21	swapper/0	11:15:20	0
2575989	99	62	28,6	cyclictest	0	-21	swapper/0	07:50:39	0
2575989	99	62	28,5	cyclictest	0	-21	swapper/0	11:05:20	0
2575989	99	62	28,5	cyclictest	0	-21	swapper/0	09:40:22	0
2575992	99	61	53,6	cyclictest	2760134	-21	kworker/u4:4+events_unbound	12:15:49	1
2575992	99	61	53,6	cyclictest	2587527	-21	kworker/u4:4+events_unbound	07:59:45	1
2575992	99	61	53,6	cyclictest	2587527	-21	kworker/u4:4+events_unbound	07:59:45	1
2575992	99	60	52,5	cyclictest	2634159	-21	fschecks_count	09:40:19	1
2575989	99	60	27,6	cyclictest	0	-21	swapper/0	09:35:26	0
2575989	99	60	26,5	cyclictest	2590528	-21	fschecks_count	08:05:20	0
2575989	99	59	8,28	cyclictest	2651535	-21	ssh	10:00:13	0
2575989	99	59	22,27	cyclictest	256	50	irq/23-42890000.ethernet	07:20:08	0
2575992	99	58	49,6	cyclictest	2729266	-21	kworker/u4:4+events_unbound	11:45:01	1
2575992	99	58	46,8	cyclictest	0	-21	swapper/1	12:35:35	1
2575992	99	58	43,12	cyclictest	0	-21	swapper/1	12:00:25	1
2575992	99	57	49,6	cyclictest	2671423	-21	kworker/u4:2+events_unbound	10:25:20	1
2575992	99	57	47,7	cyclictest	2711337	-21	kworker/u4:0-rpciod	11:10:24	1
2575992	99	57	44,7	cyclictest	2668848	-21	kworker/u4:6	10:20:00	1
2575992	99	56	43,8	cyclictest	0	-21	swapper/1	12:20:14	1
2575992	99	56	36,12	cyclictest	2660039	-21	modprobe	10:10:00	1
2575992	99	55	49,4	cyclictest	2578485	-21	kworker/u4:13+events_unbound	07:45:01	1
2575992	99	55	46,7	cyclictest	53	-21	kswapd0	11:05:01	1
2575992	99	55	45,7	cyclictest	2581703	-21	gltestperf	07:30:18	1
2575992	99	55	45,5	cyclictest	2606685	-21	kworker/u4:18+events_unbound	09:15:03	1
2575992	99	55	44,7	cyclictest	0	-21	swapper/1	12:25:36	1
2575989	99	55	46,7	cyclictest	2769247	-21	kworker/u4:6+events_unbound	12:30:52	0
2575992	99	54	46,6	cyclictest	2724834	-21	kworker/u4:11+events_unbound	11:45:41	1
2575992	99	54	44,6	cyclictest	2606744	-21	kworker/u4:18	09:10:01	1
2575992	99	54	43,8	cyclictest	2591370	-21	systemd	08:09:45	1
2575992	99	54	41,9	cyclictest	0	-21	swapper/1	09:20:22	1
2575992	99	53	44,6	cyclictest	2598858	-21	timerwakeupswit	08:35:38	1
2575992	99	53	42,5	cyclictest	0	-21	swapper/1	10:30:28	1
2575992	99	53	11,35	cyclictest	2686934	-21	ssh	10:40:17	1
2575992	99	52	40,4	cyclictest	0	-21	swapper/1	09:55:39	1
2575992	99	52	39,9	cyclictest	2671421	-21	ssh	10:22:05	1
2575989	99	52	42,6	cyclictest	2711340	-21	kworker/u4:5+events_unbound	11:10:29	0
2575989	99	52	33,17	cyclictest	2600341	-21	sh	08:45:00	0
2575992	99	51	43,6	cyclictest	2697010	-21	unixbench-2d	10:50:43	1
2575992	99	51	43,6	cyclictest	2578486	-21	kworker/u4:14+events_unbound	08:20:01	1
2575992	99	51	41,7	cyclictest	2751119	-21	kworker/u4:4+events_unbound	11:55:01	1
2575989	99	51	38,10	cyclictest	2622637	-21	kworker/u4:9+events_unbound	09:30:01	0
2575989	99	51	36,9	cyclictest	2793034	-21	ssh	12:39:55	0
2575992	99	50	42,5	cyclictest	2683310	-21	sh	10:35:33	1
2575992	99	50	40,6	cyclictest	2622638	-21	kworker/u4:11-rpciod	09:30:31	1
2575992	99	50	40,6	cyclictest	2575988	-21	cyclictest	08:52:29	1
2575992	99	50	37,11	cyclictest	2720306	-21	kworker/u4:3+events_unbound	11:30:28	1
2575989	99	50	38,10	cyclictest	2678514	-21	gltestperf	10:30:20	0
2575992	99	49	41,6	cyclictest	2715800	-21	kworker/u4:8+events_unbound	11:15:30	1
2575992	99	49	37,8	cyclictest	2564330	-21	kworker/u4:12-events_unbound	07:15:01	1
2575992	99	48	41,5	cyclictest	2580824	-21	sendmail_mailqu	07:25:35	1
2575989	99	48	40,6	cyclictest	2591902	-21	fschecks_time	08:10:21	0
2575992	99	47	40,4	cyclictest	2692017	-21	ntpq	10:45:27	1
2575992	99	47	38,7	cyclictest	2767897	-21	timerwakeupswit	12:10:39	1
2575992	99	47	37,6	cyclictest	2595243	-21	awk	08:25:00	1
2575992	99	46	39,5	cyclictest	2595695	-21	fschecks_time	08:25:20	1
2575992	99	46	37,7	cyclictest	2585510	-21	fschecks_time	07:45:21	1
2575992	99	46	37,5	cyclictest	2715797	-21	kworker/u4:2-rpciod	11:25:24	1
2575989	99	46	38,6	cyclictest	2585885	-21	grep	07:45:37	0
2575992	99	45	38,5	cyclictest	2606685	-21	kworker/u4:18+events_unbound	09:10:04	1
2575992	99	45	35,7	cyclictest	2622638	-21	kworker/u4:11-rpciod	09:35:26	1
2575989	99	45	36,6	cyclictest	2595716	-21	fschecks_time	08:25:20	0
2575992	99	44	38,4	cyclictest	2573477	-21	kworker/u4:2+events_unbound	07:20:28	1
2575992	99	44	36,5	cyclictest	0	-21	swapper/1	11:05:27	1
2575992	99	44	35,7	cyclictest	2588797	-21	kworker/u4:5+events_unbound	08:35:01	1
2575992	99	44	34,6	cyclictest	2587526	-21	kworker/u4:3-rpciod	07:55:00	1
2575989	99	44	33,9	cyclictest	2593963	-21	sendmail	08:20:00	0
2575989	99	44	25,17	cyclictest	0	-21	swapper/0	09:10:16	0
2575992	99	43	36,5	cyclictest	2785420	-21	proc_pri	12:30:40	1
2575992	99	43	35,6	cyclictest	2575919	-21	kworker/u4:1+events_unbound	07:10:01	1
2575992	99	43	35,5	cyclictest	2587526	-21	kworker/u4:3-rpciod	08:55:21	1
2575992	99	43	31,8	cyclictest	0	-21	swapper/1	10:10:41	1
2575989	99	43	35,5	cyclictest	2582477	-21	grep	07:35:01	0
2575992	99	42	35,5	cyclictest	2577549	-21	aten_r7power_vo	07:15:15	1
2575992	99	42	34,6	cyclictest	2604118	-21	kworker/u4:8+events_unbound	09:05:00	1
2575989	99	42	33,6	cyclictest	2588797	-21	kworker/u4:5-rpciod	08:35:37	0
2575989	99	42	33,6	cyclictest	2588119	-21	gltestperf	07:55:17	0
2575989	99	42	33,6	cyclictest	2588119	-21	gltestperf	07:55:17	0
2575989	99	42	31,9	cyclictest	2584039	-21	aten_r7power_vo	07:40:16	0
2575992	99	41	32,7	cyclictest	2591588	-21	aten2__	08:10:17	1
2575989	99	41	31,8	cyclictest	2604421	-21	aten_r7power_en	09:00:16	0
2575989	99	41	30,9	cyclictest	2595202	-21	kworker/u4:2+rpciod	08:50:36	0
2575989	99	41	27,12	cyclictest	2583691	-21	kworker/u4:6-rpciod	08:21:32	0
2575992	99	40	29,8	cyclictest	2600322	-21	cron	08:45:00	1
2575989	99	40	31,7	cyclictest	2597403	-21	processes	08:30:35	0
2575992	99	39	33,4	cyclictest	2583701	-21	systemd	07:39:39	1
2575992	99	39	31,5	cyclictest	0	-21	swapper/1	08:00:44	1
2575989	99	38	30,6	cyclictest	0	-21	swapper/0	08:55:16	0
2575989	99	38	26,7	cyclictest	0	-21	swapper/0	09:05:23	0
2575989	99	32	18,7	cyclictest	2575965	-21	munin-run	07:10:00	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17