OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Fri Apr 10, 2026 12:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
208109	99	100	93,5	cyclictest	206835	-21	kworker/u4:0+events_unbound	07:34:57	0
208109	99	97	90,5	cyclictest	198180	-21	kworker/u4:21+events_unbound	08:20:02	0
208109	99	97	90,5	cyclictest	198180	-21	kworker/u4:21+events_unbound	08:20:02	0
208109	99	90	83,5	cyclictest	235154	-21	kworker/u4:17+events_unbound	08:55:09	0
208109	99	88	73,13	cyclictest	53	-21	kswapd0	11:40:08	0
208109	99	85	79,5	cyclictest	210618	-21	kworker/u4:17+events_unbound	07:49:59	0
208109	99	85	78,5	cyclictest	464	-21	kworker/u4:4+events_unbound	08:30:04	0
208109	99	83	76,5	cyclictest	346372	-21	kworker/u4:6+events_unbound	11:20:36	0
208109	99	82	75,5	cyclictest	233884	-21	kworker/u4:12+events_unbound	09:05:10	0
208110	99	79	70,6	cyclictest	53	-21	kswapd0	09:55:19	1
208110	99	79	56,5	cyclictest	376711	-21	kworker/u4:5+events_unbound	12:25:49	1
208110	99	78	67,9	cyclictest	293811	-21	kworker/u4:5+events_unbound	10:15:24	1
208110	99	76	26,6	cyclictest	0	-21	swapper/1	12:35:11	1
208110	99	75	7,23	cyclictest	414982	-21	ssh	12:30:42	1
208110	99	75	25,8	cyclictest	0	-21	swapper/1	09:10:10	1
208110	99	75	25,8	cyclictest	0	-21	swapper/1	09:10:10	1
208109	99	73	66,5	cyclictest	217111	-21	kworker/u4:6+events_unbound	08:40:05	0
208110	99	71	42,26	cyclictest	362200	-21	/usr/sbin/munin	11:30:20	1
208110	99	71	38,29	cyclictest	328080	-21	sh	10:50:40	1
208110	99	71	32,36	cyclictest	393445	-21	unixbench_singl	12:05:41	1
208110	99	71	28,4	cyclictest	0	-21	swapper/1	11:10:27	1
208110	99	70	34,32	cyclictest	0	-21	swapper/1	10:55:39	1
208110	99	69	36,31	cyclictest	387921	-21	basename	12:00:26	1
208110	99	69	27,5	cyclictest	0	-21	swapper/1	09:40:24	1
208109	99	69	48,5	cyclictest	281162	-21	kworker/u4:0+events_unbound	10:06:43	0
208110	99	68	31,35	cyclictest	212540	-21	head	07:25:20	1
208110	99	68	29,5	cyclictest	398906	-21	kworker/u4:14-xprtiod	12:15:28	1
208110	99	68	29,34	cyclictest	368493	-21	kworker/u4:12-rpciod	11:50:01	1
208110	99	68	28,6	cyclictest	241735	-21	kworker/u4:24-rpciod	09:35:32	1
208109	99	68	34,22	cyclictest	387797	-21	ssh	12:00:10	0
208110	99	67	31,5	cyclictest	0	-21	swapper/1	09:30:20	1
208110	99	67	28,5	cyclictest	0	-21	swapper/1	11:15:36	1
208110	99	66	5,15	cyclictest	312088	-21	ssh	10:33:00	1
208110	99	66	35,28	cyclictest	357415	-21	aten_r7power_po	11:25:18	1
208110	99	66	34,29	cyclictest	232788	-21	systemd	08:45:04	1
208110	99	66	31,32	cyclictest	0	-21	swapper/1	10:45:32	1
208110	99	65	58,5	cyclictest	221005	-21	kworker/u4:15+events_unbound	08:20:00	1
208110	99	65	34,28	cyclictest	298242	-21	kworker/u4:14-rpciod	10:20:23	1
208110	99	65	32,4	cyclictest	302706	-21	kworker/u4:7-rpciod	10:25:21	1
208110	99	65	31,4	cyclictest	328627	-21	kworker/u4:11-rpciod	11:05:44	1
208110	99	65	30,6	cyclictest	0	-21	swapper/1	09:25:40	1
208110	99	65	30,5	cyclictest	231314	-21	kworker/u4:5-rpciod	09:20:20	1
208110	99	65	27,4	cyclictest	0	-21	swapper/1	07:10:11	1
208110	99	65	27,10	cyclictest	0	-21	swapper/1	08:00:24	1
208110	99	64	31,7	cyclictest	405384	-21	aten_r7power_po	12:20:15	1
208110	99	64	29,4	cyclictest	0	-21	swapper/1	11:40:36	1
208110	99	63	34,25	cyclictest	0	-21	swapper/1	11:50:31	1
208110	99	63	31,5	cyclictest	241735	-21	kworker/u4:24-rpciod	10:10:39	1
208110	99	63	31,5	cyclictest	241735	-21	kworker/u4:24-rpciod	10:10:39	1
208110	99	63	31,4	cyclictest	376711	-21	kworker/u4:5-nfsiod	11:55:16	1
208110	99	63	29,6	cyclictest	0	-21	swapper/1	10:35:23	1
208110	99	63	28,5	cyclictest	0	-21	swapper/1	11:00:22	1
208110	99	63	28,31	cyclictest	0	-21	swapper/1	09:05:15	1
208110	99	63	24,11	cyclictest	0	-21	swapper/1	07:15:38	1
208110	99	62	55,5	cyclictest	206835	-21	kworker/u4:0+events_unbound	08:10:01	1
208110	99	62	53,7	cyclictest	315970	-21	kworker/u4:6+events_unbound	10:40:28	1
208110	99	62	29,6	cyclictest	0	-21	swapper/1	09:15:19	1
208110	99	62	27,6	cyclictest	0	-21	swapper/1	07:40:28	1
208110	99	61	34,24	cyclictest	210619	-21	kworker/u4:19-rpciod	07:45:37	1
208110	99	61	28,7	cyclictest	366055	-21	aten_r7power_cu	11:35:15	1
208109	99	61	7,42	cyclictest	300584	-21	ssh	10:20:13	0
208109	99	61	54,5	cyclictest	222390	-21	kworker/u4:22+events_unbound	08:05:01	0
208109	99	61	53,6	cyclictest	231314	-21	kworker/u4:5+events_unbound	09:20:35	0
208110	99	60	53,5	cyclictest	281162	-21	kworker/u4:0+events_unbound	10:00:21	1
208110	99	60	30,5	cyclictest	0	-21	swapper/1	08:35:21	1
208110	99	60	30,5	cyclictest	0	-21	swapper/1	08:35:21	1
208110	99	60	28,5	cyclictest	353036	-21	aten_r7power_en	11:20:15	1
208110	99	59	30,5	cyclictest	287423	-21	/usr/sbin/munin	10:05:15	1
208109	99	59	51,6	cyclictest	310005	-21	ssh	10:30:25	0
208110	99	55	45,7	cyclictest	53	-21	kswapd0	09:50:11	1
208109	99	55	48,4	cyclictest	0	-21	swapper/0	12:25:37	0
208109	99	55	32,20	cyclictest	233074	-21	fschecks_count	08:45:19	0
208109	99	52	46,5	cyclictest	346376	-21	kworker/u4:11+events_unbound	11:17:00	0
208109	99	52	46,4	cyclictest	279052	-21	systemd	09:55:19	0
208109	99	52	45,5	cyclictest	359649	-21	kworker/u4:4+events_unbound	11:30:59	0
208109	99	52	45,5	cyclictest	340416	-21	kernelversion	11:05:22	0
208109	99	52	45,5	cyclictest	230043	-21	kworker/u4:0+events_unbound	09:44:58	0
208110	99	51	44,5	cyclictest	229261	-21	fschecks_count	08:30:18	1
208109	99	51	44,5	cyclictest	257408	-21	/usr/sbin/munin	09:30:20	0
208109	99	51	43,6	cyclictest	307139	-21	kworker/u4:0+events_unbound	10:48:00	0
208110	99	50	41,7	cyclictest	204394	-21	kworker/u4:5+events_unbound	07:54:59	1
208109	99	50	45,4	cyclictest	210613	-21	kworker/u4:12+events_unbound	08:14:02	0
208109	99	50	43,5	cyclictest	376003	-21	unixbench_singl	11:45:43	0
208109	99	50	43,4	cyclictest	0	-21	swapper/0	11:25:41	0
208109	99	50	42,6	cyclictest	233883	-21	kworker/u4:11+events_unbound	08:51:01	0
208109	99	50	41,6	cyclictest	0	-21	swapper/0	11:00:31	0
208110	99	49	41,5	cyclictest	270402	-21	fschecks_count	09:45:17	1
208109	99	49	43,5	cyclictest	206835	-21	kworker/u4:0+events_unbound	07:26:02	0
208109	99	49	42,5	cyclictest	223693	-21	munin-plugin-st	08:09:59	0
208109	99	49	42,5	cyclictest	210614	-21	kworker/u4:13+events_unbound	07:18:42	0
208109	99	49	41,6	cyclictest	307139	-21	kworker/u4:0+events_unbound	10:36:41	0
208109	99	49	41,6	cyclictest	195640	-21	kworker/u4:18+events_unbound	07:14:02	0
208109	99	49	39,8	cyclictest	319052	-21	mailstats	10:40:37	0
208110	99	48	40,6	cyclictest	231517	-21	systemd	08:40:04	1
208109	99	48	42,4	cyclictest	291926	-21	aten_r7power_po	10:10:15	0
208109	99	48	42,4	cyclictest	291926	-21	aten_r7power_po	10:10:15	0
208109	99	48	41,5	cyclictest	240257	-21	grep	09:10:35	0
208109	99	48	41,5	cyclictest	240257	-21	grep	09:10:35	0
208109	99	48	40,5	cyclictest	393403	-21	unixbench_multi	12:05:41	0
208109	99	48	33,8	cyclictest	0	-21	swapper/0	07:50:13	0
208109	99	48	30,6	cyclictest	243913	-21	aten_r7power_po	09:15:16	0
208109	99	47	41,4	cyclictest	231021	-21	cat	08:35:36	0
208109	99	47	41,4	cyclictest	231021	-21	cat	08:35:36	0
208109	99	47	40,5	cyclictest	298242	-21	kworker/u4:14+events_unbound	10:16:59	0
208109	99	47	40,5	cyclictest	210614	-21	kworker/u4:13+events_unbound	09:01:02	0
208109	99	47	39,5	cyclictest	379445	-21	gltestperf	11:50:19	0
208109	99	47	35,8	cyclictest	332723	-21	ssh	10:56:07	0
208109	99	47	27,17	cyclictest	0	-21	swapper/0	11:35:37	0
208109	99	46	40,4	cyclictest	261612	-21	aten_r7power_cu	09:35:22	0
208109	99	46	39,5	cyclictest	219736	-21	kworker/u4:8+events_unbound	08:26:59	0
208109	99	46	39,5	cyclictest	210618	-21	kworker/u4:17+events_unbound	08:17:02	0
208109	99	46	38,5	cyclictest	221075	-21	sendmail-msp	08:00:01	0
208109	99	46	37,7	cyclictest	253225	-21	kernelversion	09:25:21	0
208109	99	46	36,8	cyclictest	405056	-21	latency_hist	12:20:01	0
208109	99	46	36,7	cyclictest	415303	-21	grep	12:30:46	0
208110	99	45	39,4	cyclictest	215801	-21	http	07:40:01	1
208109	99	45	8,4	cyclictest	15	1	ktimers/0	09:50:00	0
208109	99	45	39,5	cyclictest	464	-21	kworker/u4:4+events_unbound	07:43:04	0
208109	99	45	39,4	cyclictest	346376	-21	kworker/u4:11+events_unbound	11:12:59	0
208109	99	45	38,5	cyclictest	211974	-21	latency_hist	07:25:00	0
208109	99	45	37,5	cyclictest	0	-21	swapper/0	10:50:30	0
208109	99	45	37,5	cyclictest	0	-21	swapper/0	07:40:00	0
208109	99	45	36,6	cyclictest	0	-21	swapper/0	12:25:00	0
208109	99	44	38,4	cyclictest	305287	-21	fschecks_count	10:25:20	0
208109	99	44	35,8	cyclictest	283664	-21	if_err_eth0	10:00:21	0
208109	99	44	35,7	cyclictest	393817	-21	kworker/u4:10+events_unbound	12:14:59	0
208110	99	43	36,5	cyclictest	220259	-21	cut	07:55:18	1
208110	99	42	36,4	cyclictest	396632	-21	basename	12:10:16	1
208109	99	42	31,9	cyclictest	383745	-21	fschecks_time	11:55:16	0
208110	99	41	34,5	cyclictest	224172	-21	tune2fs	08:10:18	1
208110	99	41	32,6	cyclictest	0	-21	swapper/1	08:55:01	1
208109	99	41	34,5	cyclictest	278475	-21	sh	09:55:00	0
208109	99	41	32,6	cyclictest	0	-21	swapper/0	12:35:25	0
208110	99	40	34,4	cyclictest	235596	-21	fschecks_count	08:55:18	1
208110	99	40	32,6	cyclictest	228529	-21	switchtime	08:25:38	1
208110	99	39	29,8	cyclictest	227319	-21	timerandwakeup	08:20:37	1
208110	99	39	29,8	cyclictest	227319	-21	timerandwakeup	08:20:37	1
208109	99	39	30,7	cyclictest	208144	-21	latency_hist	07:10:01	0
208110	99	38	31,5	cyclictest	213629	-21	sort	07:30:17	1
208110	99	37	23,11	cyclictest	0	-21	swapper/1	09:00:34	1
208110	99	35	26,6	cyclictest	0	-21	swapper/1	07:20:35	1
208110	99	34	24,8	cyclictest	0	-21	swapper/1	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17