OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Wed Jan 07, 2026 00:44:12)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
473860	99	83	76,5	cyclictest	619173	-21	kworker/u4:13+events_unbound	23:42:30	1
473860	99	83	73,7	cyclictest	540194	-21	kworker/u4:6+events_unbound	22:02:09	1
473860	99	80	70,8	cyclictest	590152	-21	kworker/u4:0+events_unbound	22:55:00	1
473860	99	77	68,6	cyclictest	503043	-21	kworker/u4:16+events_unbound	21:17:00	1
473859	99	76	62,9	cyclictest	546981	-21	ssh	22:00:21	0
473859	99	75	55,15	cyclictest	54	-21	kswapd0	23:50:07	0
473860	99	73	43,5	cyclictest	54	-21	kswapd0	23:05:01	1
473860	99	72	64,5	cyclictest	506559	-21	kworker/u4:18+events_unbound	21:12:00	1
473859	99	72	24,24	cyclictest	659636	-21	mailstats	00:15:39	0
473860	99	69	61,6	cyclictest	506557	-21	kworker/u4:13+events_unbound	21:22:01	1
473860	99	68	60,5	cyclictest	648695	-21	kworker/u4:3+events_unbound	00:30:01	1
473860	99	68	60,5	cyclictest	648695	-21	kworker/u4:3+events_unbound	00:30:01	1
473859	99	68	32,12	cyclictest	486750	-21	apt-get	20:00:12	0
473859	99	68	32,12	cyclictest	486750	-21	apt-get	20:00:12	0
473860	99	67	60,5	cyclictest	491568	-21	kworker/u4:17+events_unbound	21:05:01	1
473860	99	67	60,5	cyclictest	476330	-21	kworker/u4:7+events_unbound	19:26:40	1
473860	99	66	61,3	cyclictest	486523	-21	kworker/u4:14+events_unbound	19:56:47	1
473860	99	66	61,3	cyclictest	478878	-21	kworker/u4:13+events_unbound	19:41:43	1
473860	99	65	53,6	cyclictest	0	-21	swapper/1	22:40:16	1
473859	99	65	23,14	cyclictest	561446	-21	ssh	22:17:28	0
473859	99	64	33,28	cyclictest	572436	-21	ps	22:30:36	0
473859	99	64	18,21	cyclictest	643059	-21	/usr/sbin/munin	23:55:32	0
473859	99	63	26,11	cyclictest	629407	-21	ssh	23:39:48	0
473859	99	63	25,11	cyclictest	578651	-21	ssh	22:38:33	0
473859	99	63	24,11	cyclictest	593905	-21	ssh	22:56:16	0
473859	99	63	23,14	cyclictest	630702	-21	ntpq	23:40:34	0
473859	99	63	21,14	cyclictest	604089	-21	ssh	23:09:27	0
473859	99	63	17,24	cyclictest	532381	-21	ssh	21:42:32	0
473860	99	62	54,6	cyclictest	469005	-21	kworker/u4:14+events_unbound	19:21:40	1
473859	99	62	42,15	cyclictest	563220	-21	apt-get	22:20:12	0
473859	99	62	22,15	cyclictest	585846	-21	ssh	22:46:40	0
473859	99	62	22,13	cyclictest	557743	-21	ssh	22:13:18	0
473859	99	62	22,11	cyclictest	493740	-21	ntpq	20:25:30	0
473859	99	62	20,16	cyclictest	635956	-21	ssh	23:46:45	0
473859	99	62	18,24	cyclictest	625377	-21	ls	23:35:01	0
473859	99	62	13,23	cyclictest	508607	-21	awk	21:15:00	0
473860	99	61	53,6	cyclictest	492951	-21	kworker/u4:7+events_unbound	20:21:50	1
473860	99	61	48,9	cyclictest	536565	-21	kworker/u4:4+events_unbound	21:50:34	1
473859	99	61	48,9	cyclictest	538331	-21	apt-get	21:50:12	0
473859	99	61	22,14	cyclictest	599644	-21	ssh	23:03:57	0
473859	99	61	22,11	cyclictest	514507	-21	ssh	21:20:51	0
473859	99	61	20,14	cyclictest	668595	-21	ssh	00:26:29	0
473859	99	61	20,14	cyclictest	668595	-21	ssh	00:26:29	0
473859	99	61	19,23	cyclictest	526547	-21	ntpq	21:35:33	0
473860	99	60	51,7	cyclictest	523106	-21	kworker/u4:3+events_unbound	21:40:14	1
473860	99	60	48,9	cyclictest	54	-21	kswapd0	22:20:33	1
473859	99	60	23,11	cyclictest	620158	-21	ssh	23:28:18	0
473859	99	60	23,10	cyclictest	657656	-21	ssh	00:13:48	0
473859	99	60	23,10	cyclictest	583180	-21	ssh	22:44:10	0
473859	99	60	22,11	cyclictest	503878	-21	ntp_states	21:05:31	0
473859	99	60	21,14	cyclictest	677119	-21	ssh	00:37:05	0
473859	99	60	19,18	cyclictest	568103	-21	ntpq	22:25:28	0
473859	99	60	19,16	cyclictest	523110	-21	ssh	21:31:09	0
473859	99	60	17,16	cyclictest	496754	-21	cron	20:40:01	0
473860	99	59	39,14	cyclictest	480123	-21	sshd	19:31:39	1
473859	99	59	24,10	cyclictest	591421	-21	ssh	22:54:07	0
473859	99	59	21,14	cyclictest	651998	-21	ssh	00:06:04	0
473859	99	59	21,11	cyclictest	498786	-21	ntpq	20:45:27	0
473859	99	59	20,16	cyclictest	484750	-21	ntpq	19:50:29	0
473859	99	59	20,14	cyclictest	666505	-21	ssh	00:24:57	0
473859	99	59	20,14	cyclictest	611934	-21	ssh	23:18:32	0
473859	99	59	19,14	cyclictest	482149	-21	ntpq	19:40:23	0
473859	99	59	16,20	cyclictest	495089	-21	grep	20:30:33	0
473860	99	58	50,6	cyclictest	485267	-21	kworker/u4:8+events_unbound	20:11:50	1
473859	99	58	45,7	cyclictest	255	50	irq/23-42890000.ethernet	21:15:11	0
473859	99	58	38,16	cyclictest	475265	-21	apt-get	19:15:11	0
473859	99	58	38,16	cyclictest	475265	-21	apt-get	19:15:11	0
473859	99	58	24,11	cyclictest	613875	-21	ntpq	23:20:30	0
473859	99	58	22,11	cyclictest	500080	-21	ntpq	20:50:29	0
473859	99	58	21,14	cyclictest	520707	-21	ssh	21:29:11	0
473859	99	58	21,11	cyclictest	649690	-21	ssh	00:04:10	0
473860	99	57	50,5	cyclictest	656428	-21	kworker/u4:18+events_unbound	00:17:38	1
473859	99	57	42,12	cyclictest	477165	-21	ntpq	19:20:29	0
473859	99	57	35,18	cyclictest	477817	-21	apt-get	19:25:14	0
473859	99	57	21,13	cyclictest	674157	-21	ssh	00:34:03	0
473859	99	57	16,19	cyclictest	552066	-21	awk	22:05:38	0
473860	99	56	48,6	cyclictest	559429	-21	/usr/sbin/munin	22:15:19	1
473859	99	56	47,6	cyclictest	531673	-21	kworker/u4:9+events_unbound	21:57:08	0
473859	99	56	35,17	cyclictest	480330	-21	apt-get	19:35:11	0
473859	99	56	35,16	cyclictest	501990	-21	apt-get	21:00:12	0
473859	99	56	23,9	cyclictest	491622	-21	apt-get	20:20:05	0
473859	99	56	20,16	cyclictest	537903	-21	ssh	21:49:46	0
473859	99	56	20,11	cyclictest	486054	-21	ntpq	19:55:27	0
473859	99	56	14,22	cyclictest	491656	-21	http	20:20:01	0
473859	99	55	36,15	cyclictest	474584	-21	ntpq	19:10:26	0
473859	99	55	36,14	cyclictest	500709	-21	apt-get	20:55:12	0
473859	99	55	19,10	cyclictest	479541	-21	irqstats	19:30:22	0
473859	99	55	14,20	cyclictest	605606	-21	/usr/sbin/munin	23:10:35	0
473860	99	54	46,6	cyclictest	602777	-21	kworker/u4:0+events_unbound	23:47:33	1
473859	99	54	34,17	cyclictest	483411	-21	ntpq	19:45:24	0
473860	99	53	45,6	cyclictest	497997	-21	kworker/u4:15+events_unbound	20:41:54	1
473860	99	53	44,7	cyclictest	640354	-21	kworker/u4:5+events_unbound	00:02:34	1
473860	99	53	44,7	cyclictest	552973	-21	sshd	22:07:09	1
473859	99	53	36,12	cyclictest	489795	-21	ntpq	20:10:23	0
473859	99	53	17,19	cyclictest	497860	-21	grep	20:40:35	0
473860	99	52	46,4	cyclictest	614957	-21	kworker/u4:4+events_unbound	23:52:32	1
473860	99	51	43,5	cyclictest	0	-21	swapper/1	00:05:15	1
473860	99	51	41,7	cyclictest	567714	-21	fschecks_count	22:25:21	1
473860	99	51	37,4	cyclictest	590157	-21	kworker/u4:6+events_unbound	23:22:26	1
473860	99	50	43,5	cyclictest	555389	-21	gltestperf	22:10:20	1
473860	99	50	2,36	cyclictest	663028	-21	diskstats	00:20:18	1
473859	99	50	36,10	cyclictest	488549	-21	ntpq	20:05:25	0
473860	99	49	42,5	cyclictest	54	-21	kswapd0	21:55:13	1
473860	99	49	40,7	cyclictest	492948	-21	kworker/u4:3+events_unbound	20:55:01	1
473860	99	49	40,6	cyclictest	483925	-21	kworker/u4:4+events_unbound	20:46:56	1
473860	99	49	39,7	cyclictest	535024	-21	ps	21:45:33	1
473860	99	48	41,5	cyclictest	677187	-21	kworker/u4:1+events_unbound	00:37:43	1
473860	99	48	41,5	cyclictest	629573	-21	idleruntime-cro	23:40:00	1
473860	99	48	41,5	cyclictest	475987	-21	sendmail_mailqu	19:15:34	1
473860	99	48	41,5	cyclictest	475987	-21	sendmail_mailqu	19:15:34	1
473860	99	48	2,42	cyclictest	521485	-21	apt-get	21:30:11	1
473860	99	47	40,5	cyclictest	621563	-21	aten_r7power_en	23:30:16	1
473860	99	47	40,5	cyclictest	526734	-21	switchtime	21:35:36	1
473860	99	47	39,5	cyclictest	473855	-21	cyclictest	23:20:01	1
473860	99	46	40,4	cyclictest	521223	-21	idleruntime-cro	21:30:00	1
473860	99	46	39,5	cyclictest	643445	-21	diskmemload	23:55:39	1
473860	99	46	37,7	cyclictest	617295	-21	dpkg	23:25:12	1
473860	99	45	38,5	cyclictest	473855	-21	cyclictest	20:25:40	1
473860	99	45	37,6	cyclictest	504308	-21	kworker/u4:9+events_unbound	21:07:01	1
473860	99	45	3,29	cyclictest	572368	-21	ssh	22:30:33	1
473860	99	45	22,16	cyclictest	0	-21	swapper/1	22:55:34	1
473860	99	44	36,6	cyclictest	501821	-21	tr	21:00:00	1
473860	99	44	36,5	cyclictest	462836	-21	kworker/u4:9-rpciod	20:00:15	1
473860	99	44	36,5	cyclictest	462836	-21	kworker/u4:9-rpciod	20:00:15	1
473860	99	44	36,4	cyclictest	0	-21	swapper/1	23:05:03	1
473860	99	44	36,4	cyclictest	0	-21	swapper/1	19:45:29	1
473860	99	44	35,7	cyclictest	488085	-21	aten_r7power_en	20:05:17	1
473860	99	44	35,7	cyclictest	474293	-21	fschecks_count	19:10:19	1
473860	99	44	34,7	cyclictest	0	-21	swapper/1	22:45:25	1
473860	99	43	36,5	cyclictest	655825	-21	users	00:10:39	1
473860	99	43	36,5	cyclictest	604878	-21	aten_r7power_vo	23:10:16	1
473860	99	43	36,5	cyclictest	0	-21	swapper/1	22:40:00	1
473860	99	43	35,6	cyclictest	496721	-21	systemd	20:36:53	1
473860	99	43	34,7	cyclictest	481157	-21	threads	19:35:35	1
473860	99	43	32,9	cyclictest	0	-21	swapper/1	20:35:00	1
473860	99	42	32,7	cyclictest	0	-21	swapper/1	00:30:23	1
473860	99	41	33,6	cyclictest	483925	-21	kworker/u4:4+rpciod	20:15:19	1
473860	99	38	31,5	cyclictest	483924	-21	kworker/u4:3+events_unbound	19:51:45	1
473860	99	38	29,7	cyclictest	0	-21	swapper/1	19:10:01	1
473859	99	37	23,11	cyclictest	473892	-21	latency_hist	19:10:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17