OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Sun Jun 14, 2026 00:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
321202	99	133	112,7	cyclictest	481763	-21	kworker/u4:19+events_unbound	23:38:44	1
321202	99	98	90,6	cyclictest	464048	-21	kworker/u4:10+events_unbound	00:08:52	1
321201	99	93	42,5	cyclictest	415018	-21	cat	22:20:43	0
321202	99	91	83,6	cyclictest	512083	-21	kworker/u4:3+events_unbound	00:23:55	1
321202	99	89	82,5	cyclictest	363207	-21	kworker/u4:3+events_unbound	21:28:18	1
321202	99	89	81,6	cyclictest	424925	-21	kworker/u4:1+events_unbound	22:38:35	1
321202	99	85	77,6	cyclictest	411676	-21	kworker/u4:4+events_unbound	22:43:35	1
321201	99	83	39,6	cyclictest	0	-21	swapper/0	23:10:35	0
321202	99	82	74,5	cyclictest	345528	-21	kworker/u4:2+events_unbound	20:55:01	1
321202	99	82	71,8	cyclictest	372202	-21	kworker/u4:6+events_unbound	21:35:01	1
321202	99	81	72,6	cyclictest	372201	-21	kworker/u4:5+events_unbound	22:03:27	1
321202	99	80	72,6	cyclictest	503280	-21	kworker/u4:11+events_unbound	00:18:53	1
321202	99	77	70,5	cyclictest	381215	-21	kworker/u4:4+events_unbound	21:58:25	1
321202	99	77	70,5	cyclictest	381215	-21	kworker/u4:4+events_unbound	21:58:24	1
321202	99	77	69,6	cyclictest	455257	-21	kworker/u4:3+events_unbound	23:25:01	1
321201	99	74	39,7	cyclictest	327798	-21	aten_r7power_cu	19:35:16	0
321202	99	73	59,4	cyclictest	341691	-21	kworker/u4:0+events_unbound	20:40:00	1
321202	99	73	54,5	cyclictest	464048	-21	kworker/u4:10+events_unbound	00:03:52	1
321202	99	72	62,7	cyclictest	533701	-21	kworker/u4:5+events_unbound	00:38:59	1
321202	99	72	62,7	cyclictest	468455	-21	kworker/u4:1+events_unbound	23:43:45	1
321202	99	71	63,6	cyclictest	322417	-21	kworker/u4:4+events_unbound	19:55:01	1
321201	99	71	31,8	cyclictest	459644	-21	kworker/u4:6+rpciod	23:55:13	0
321202	99	70	46,8	cyclictest	416129	-21	kworker/u4:12+events_unbound	22:31:59	1
321202	99	69	59,7	cyclictest	455257	-21	kworker/u4:3+events_unbound	23:15:00	1
321202	99	68	43,7	cyclictest	322423	-21	kworker/u4:9+events_unbound	20:25:00	1
321202	99	66	47,5	cyclictest	381215	-21	kworker/u4:4+events_unbound	21:53:24	1
321202	99	65	55,6	cyclictest	327542	-21	kworker/u4:10+events_unbound	21:00:16	1
321201	99	64	57,5	cyclictest	321128	-21	kworker/u4:2+events_unbound	19:27:48	0
321202	99	63	54,6	cyclictest	354822	-21	kworker/u4:15+events_unbound	21:15:01	1
321202	99	62	54,6	cyclictest	328814	-21	kworker/u4:12+events_unbound	19:40:01	1
321202	99	62	54,6	cyclictest	322417	-21	kworker/u4:4+events_unbound	20:04:59	1
321201	99	62	53,7	cyclictest	455257	-21	kworker/u4:3+events_unbound	23:23:41	0
321202	99	61	51,7	cyclictest	0	-21	swapper/1	23:15:18	1
321201	99	61	56,3	cyclictest	472885	-21	kworker/u4:5+events_unbound	23:45:01	0
321201	99	61	54,5	cyclictest	345528	-21	kworker/u4:2+events_unbound	20:53:09	0
321201	99	59	47,9	cyclictest	503280	-21	kworker/u4:11+events_unbound	00:05:18	0
321202	99	58	50,6	cyclictest	453527	-21	/usr/sbin/munin	23:05:20	1
321201	99	58	51,5	cyclictest	0	-21	swapper/0	20:40:35	0
321201	99	58	45,5	cyclictest	351990	-21	kworker/u4:6+events_unbound	21:18:12	0
321202	99	57	43,11	cyclictest	0	-21	swapper/1	00:30:36	1
321201	99	57	49,6	cyclictest	332656	-21	kworker/u4:21+events_unbound	21:03:09	0
321202	99	56	49,5	cyclictest	420539	-21	kworker/u4:16+events_unbound	22:28:34	1
321201	99	56	48,6	cyclictest	322423	-21	kworker/u4:9+events_unbound	20:23:03	0
321201	99	56	46,8	cyclictest	502651	-21	kworker/u4:9+events_unbound	00:20:01	0
321202	99	55	39,10	cyclictest	523500	-21	ssh	00:25:31	1
321201	99	55	48,5	cyclictest	519421	-21	switchtime	00:20:39	0
321202	99	54	46,6	cyclictest	491941	-21	idleruntime-cro	23:50:00	1
321202	99	54	46,6	cyclictest	424925	-21	kworker/u4:1+events_unbound	22:47:47	1
321202	99	54	46,6	cyclictest	363852	-21	kworker/u4:9+events_unbound	21:25:01	1
321202	99	54	46,6	cyclictest	332656	-21	kworker/u4:21+events_unbound	20:45:02	1
321202	99	54	45,7	cyclictest	414032	-21	/usr/sbin/munin	22:20:18	1
321202	99	54	2,14	cyclictest	17	1	rcu_preempt	22:55:29	1
321201	99	54	46,6	cyclictest	353477	-21	timerandwakeup	21:10:40	0
321201	99	54	45,6	cyclictest	459643	-21	kworker/u4:2+events_unbound	23:30:16	0
321201	99	54	43,9	cyclictest	444240	-21	latency_hist	22:55:01	0
321202	99	52	45,5	cyclictest	408271	-21	systemd	22:13:28	1
321201	99	52	45,5	cyclictest	372201	-21	kworker/u4:5+events_unbound	21:38:20	0
321201	99	52	42,7	cyclictest	327542	-21	kworker/u4:10+events_unbound	19:57:56	0
321201	99	52	37,6	cyclictest	327542	-21	kworker/u4:10+events_unbound	20:08:59	0
321202	99	51	44,5	cyclictest	321127	-21	kworker/u4:1+events_unbound	19:25:02	1
321202	99	51	43,6	cyclictest	340906	-21	fschecks_count	20:25:19	1
321202	99	51	43,6	cyclictest	332654	-21	kworker/u4:19+events_unbound	20:18:01	1
321202	99	51	40,8	cyclictest	0	-21	swapper/1	23:00:30	1
321202	99	51	39,9	cyclictest	350943	-21	aten2__	21:05:16	1
321202	99	51	38,10	cyclictest	342965	-21	systemd	20:33:04	1
321202	99	51	38,10	cyclictest	342965	-21	systemd	20:33:04	1
321201	99	51	43,5	cyclictest	53	-21	kswapd0	23:55:01	0
321202	99	50	41,6	cyclictest	475257	-21	ssh	23:30:26	1
321202	99	50	40,7	cyclictest	493478	-21	unixbench_multi	23:50:41	1
321202	99	50	39,8	cyclictest	410427	-21	ld	22:15:35	1
321202	99	50	37,8	cyclictest	379110	-21	cut	21:40:15	1
321201	99	50	40,8	cyclictest	431662	-21	fschecks_count	22:40:20	0
321201	99	50	35,12	cyclictest	510362	-21	ssh	00:10:33	0
321201	99	50	30,17	cyclictest	0	-21	swapper/0	22:15:20	0
321201	99	50	30,17	cyclictest	0	-21	swapper/0	22:10:34	0
321202	99	49	39,7	cyclictest	0	-21	swapper/1	19:30:29	1
321202	99	49	38,8	cyclictest	386382	-21	systemd	21:48:22	1
321202	99	49	34,12	cyclictest	53	-21	kswapd0	23:55:16	1
321201	99	49	41,6	cyclictest	322425	-21	kworker/u4:11+events_unbound	19:12:46	0
321202	99	48	40,6	cyclictest	360953	-21	sendmail	21:20:01	1
321202	99	48	40,6	cyclictest	327542	-21	kworker/u4:10+events_unbound	20:07:58	1
321202	99	48	37,7	cyclictest	326315	-21	idleruntime-cro	19:30:00	1
321201	99	48	4,38	cyclictest	396569	-21	ssh	22:00:21	0
321201	99	48	41,5	cyclictest	396210	-21	gpgv	22:00:01	0
321201	99	48	41,5	cyclictest	396210	-21	gpgv	22:00:01	0
321201	99	48	41,5	cyclictest	338980	-21	unixbench-2d	20:15:39	0
321201	99	48	39,6	cyclictest	450846	-21	ssh	23:01:56	0
321201	99	48	31,15	cyclictest	325040	-21	munin-plugin-st	19:25:00	0
321201	99	48	26,7	cyclictest	483243	-21	sendmail	23:40:01	0
321201	99	48	1,16	cyclictest	401455	-21	ntpq	22:05:23	0
321202	99	47	40,5	cyclictest	327542	-21	kworker/u4:10+events_unbound	20:12:58	1
321202	99	47	40,5	cyclictest	327542	-21	kworker/u4:10+events_unbound	20:12:57	1
321202	99	47	38,7	cyclictest	322465	-21	idleruntime-cro	19:14:59	1
321202	99	47	37,6	cyclictest	346014	-21	fschecks_count	20:45:18	1
321201	99	47	38,7	cyclictest	423914	-21	unixbench_singl	22:30:44	0
321201	99	47	26,17	cyclictest	0	-21	swapper/0	19:45:01	0
321202	99	46	37,7	cyclictest	404862	-21	ssh	22:10:01	1
321202	99	46	34,9	cyclictest	0	-21	swapper/1	22:50:28	1
321201	99	46	39,5	cyclictest	0	-21	swapper/0	00:00:35	0
321201	99	46	36,7	cyclictest	535671	-21	latency_hist	00:40:02	0
321201	99	46	36,7	cyclictest	337774	-21	unixbench_multi	20:10:39	0
321201	99	46	36,7	cyclictest	337774	-21	unixbench_multi	20:10:38	0
321202	99	45	7,32	cyclictest	471262	-21	ntpq	23:25:33	1
321202	99	45	36,6	cyclictest	510717	-21	switchtime	00:10:46	1
321201	99	45	38,5	cyclictest	522676	-21	acpi	00:25:10	0
321201	99	45	38,5	cyclictest	388026	-21	/usr/sbin/munin	21:50:19	0
321201	99	45	38,4	cyclictest	453531	-21	gltestperf	23:05:19	0
321201	99	45	37,6	cyclictest	531169	-21	ssh	00:35:01	0
321201	99	45	37,5	cyclictest	379939	-21	/usr/sbin/munin	21:40:37	0
321201	99	45	36,6	cyclictest	332655	-21	kworker/u4:20+events_unbound	19:52:55	0
321201	99	45	35,8	cyclictest	462124	-21	uniq	23:15:20	0
321201	99	45	32,8	cyclictest	370959	-21	ntpq	21:30:35	0
321202	99	44	35,6	cyclictest	374799	-21	fschecks_count	21:35:18	1
321202	99	44	35,6	cyclictest	330169	-21	grep	19:45:01	1
321201	99	44	37,5	cyclictest	470833	-21	/usr/sbin/munin	23:25:20	0
321201	99	44	37,5	cyclictest	349463	-21	latency_hist	21:00:02	0
321201	99	44	37,4	cyclictest	418438	-21	aten_r7power_po	22:25:17	0
321201	99	44	37,4	cyclictest	0	-21	swapper/0	21:25:37	0
321201	99	43	37,4	cyclictest	346856	-21	latency_hist	20:50:00	0
321201	99	43	36,5	cyclictest	488274	-21	cut	23:45:21	0
321201	99	43	35,5	cyclictest	0	-21	swapper/0	21:20:36	0
321201	99	43	33,7	cyclictest	343939	-21	mailstats	20:35:37	0
321202	99	42	33,6	cyclictest	323514	-21	timerwakeupswit	19:15:37	1
321202	99	42	32,8	cyclictest	331148	-21	switchtime	19:45:37	1
321202	99	42	30,9	cyclictest	332655	-21	kworker/u4:20+events_unbound	19:55:03	1
321202	99	42	29,10	cyclictest	349401	-21	sendmail	21:00:00	1
321201	99	42	35,5	cyclictest	436030	-21	fschecks_count	22:45:19	0
321201	99	42	35,5	cyclictest	351236	-21	fschecks_time	21:05:19	0
321201	99	42	35,5	cyclictest	326665	-21	df_abs	19:30:17	0
321201	99	42	35,4	cyclictest	330113	-21	kworker/u4:15-nfsiod	19:45:28	0
321201	99	42	34,6	cyclictest	444616	-21	df_abs	22:55:17	0
321201	99	42	34,6	cyclictest	342153	-21	grep	20:30:19	0
321201	99	42	34,6	cyclictest	342153	-21	grep	20:30:18	0
321201	99	42	32,7	cyclictest	0	-21	swapper/0	21:45:16	0
321201	99	41	34,5	cyclictest	427343	-21	fschecks_time	22:35:20	0
321201	99	41	34,5	cyclictest	322750	-21	aten_r7power_vo	19:15:16	0
321201	99	38	27,8	cyclictest	321308	-21	latency_hist	19:10:02	0
321201	99	38	27,8	cyclictest	321308	-21	latency_hist	19:10:01	0
321201	99	37	29,5	cyclictest	341319	-21	grep	20:25:36	0
321201	99	35	27,6	cyclictest	334295	-21	aten_r7power_en	20:00:14	0
321202	99	34	25,6	cyclictest	0	-21	swapper/1	19:10:02	1
321202	99	34	25,6	cyclictest	0	-21	swapper/1	19:10:02	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17