OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Sun Jun 14, 2026 12:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
989157	99	131	119,9	cyclictest	1044649	-21	kworker/u4:0+events_unbound	10:20:36	1
989156	99	90	73,10	cyclictest	1070907	-21	kworker/u4:14+events_unbound	10:10:34	0
989157	99	84	77,5	cyclictest	986567	-21	kworker/u4:9+events_unbound	07:35:02	1
989156	99	82	75,5	cyclictest	1044650	-21	kworker/u4:3+events_unbound	09:45:32	0
989157	99	80	73,4	cyclictest	0	-21	swapper/1	11:55:06	1
989156	99	79	42,8	cyclictest	1169428	-21	latency_hist	12:00:01	0
989157	99	77	70,5	cyclictest	991665	-21	kworker/u4:10+events_unbound	07:55:00	1
989156	99	76	39,8	cyclictest	1008961	-21	sshd	08:25:22	0
989156	99	73	63,7	cyclictest	1066447	-21	kworker/u4:10+events_unbound	10:05:35	0
989156	99	73	57,13	cyclictest	1110261	-21	kworker/u4:10+events_unbound	11:15:43	0
989156	99	72	63,7	cyclictest	1132465	-21	kworker/u4:0+events_unbound	11:35:45	0
989156	99	72	63,6	cyclictest	991668	-21	kworker/u4:13+events_unbound	08:15:01	0
989156	99	69	56,7	cyclictest	53	-21	kswapd0	10:50:12	0
989156	99	69	48,14	cyclictest	1055836	-21	ssh	09:50:11	0
989156	99	66	1,50	cyclictest	1152846	-21	ssh	11:40:26	0
989157	99	65	57,6	cyclictest	1122684	-21	timerwakeupswit	11:05:40	1
989156	99	65	57,5	cyclictest	1154097	-21	kworker/u4:8+events_unbound	11:50:48	0
989157	99	64	50,10	cyclictest	0	-21	swapper/1	09:35:15	1
989156	99	64	57,5	cyclictest	991665	-21	kworker/u4:10+events_unbound	07:55:17	0
989156	99	64	5,39	cyclictest	1156549	-21	ssh	11:45:15	0
989156	99	62	53,7	cyclictest	1062613	-21	kworker/u4:8+events_unbound	10:00:34	0
989157	99	61	54,5	cyclictest	979023	-21	kworker/u4:4+events_unbound	07:20:03	1
989157	99	61	54,5	cyclictest	979023	-21	kworker/u4:4+events_unbound	07:20:02	1
989156	99	61	54,5	cyclictest	1176297	-21	kworker/u4:7+events_unbound	12:15:49	0
989157	99	58	50,6	cyclictest	986567	-21	kworker/u4:9+events_unbound	08:05:18	1
989157	99	58	44,11	cyclictest	1008074	-21	timerandwakeup	08:20:37	1
989157	99	57	50,5	cyclictest	991668	-21	kworker/u4:13+events_unbound	08:25:04	1
989157	99	57	50,5	cyclictest	1044650	-21	kworker/u4:3+events_unbound	09:44:59	1
989157	99	56	50,4	cyclictest	991668	-21	kworker/u4:13+events_unbound	08:15:03	1
989157	99	56	47,6	cyclictest	989153	-21	cyclictest	11:22:44	1
989156	99	56	49,5	cyclictest	0	-21	swapper/0	10:20:12	0
989156	99	56	48,5	cyclictest	1132470	-21	kworker/u4:6+events_unbound	11:35:00	0
989156	99	56	48,5	cyclictest	1132470	-21	kworker/u4:6+events_unbound	11:34:59	0
989156	99	56	38,8	cyclictest	986567	-21	kworker/u4:9+events_unbound	07:40:15	0
989156	99	56	38,16	cyclictest	1017211	-21	kworker/u4:8+events_unbound	09:09:59	0
989157	99	55	48,5	cyclictest	1108223	-21	latency_hist	10:50:01	1
989157	99	55	48,5	cyclictest	1108223	-21	latency_hist	10:50:00	1
989157	99	54	47,5	cyclictest	991668	-21	kworker/u4:13+events_unbound	08:10:03	1
989157	99	53	46,6	cyclictest	1079797	-21	kworker/u4:19+events_unbound	10:19:46	1
989157	99	53	45,6	cyclictest	1183168	-21	fschecks_time	12:15:18	1
989156	99	53	44,6	cyclictest	1200879	-21	sh	12:35:25	0
989156	99	53	40,8	cyclictest	1191152	-21	modprobe	12:25:00	0
989156	99	52	46,4	cyclictest	1088707	-21	kworker/u4:3+events_unbound	10:30:38	0
989156	99	52	45,5	cyclictest	1176297	-21	kworker/u4:7+events_unbound	12:15:01	0
989156	99	52	41,8	cyclictest	1100145	-21	grep	10:40:22	0
989156	99	52	30,19	cyclictest	994727	-21	fschecks_time	07:30:19	0
989157	99	51	43,6	cyclictest	1109614	-21	unixbench-2d	10:50:39	1
989156	99	51	45,4	cyclictest	1008294	-21	kworker/u4:19+events_unbound	09:10:27	0
989156	99	51	42,6	cyclictest	1024749	-21	aten_r7power_cu	09:15:16	0
989156	99	51	32,16	cyclictest	1196231	-21	fschecks_time	12:30:19	0
989157	99	50	44,5	cyclictest	1126971	-21	find	11:10:36	1
989157	99	50	42,6	cyclictest	1115349	-21	kworker/u4:13+events_unbound	11:00:42	1
989157	99	50	42,6	cyclictest	0	-21	swapper/1	09:15:27	1
989157	99	50	41,6	cyclictest	0	-21	swapper/1	12:25:26	1
989157	99	50	40,7	cyclictest	991668	-21	kworker/u4:13+events_unbound	08:40:21	1
989157	99	50	40,7	cyclictest	0	-21	swapper/1	10:00:33	1
989157	99	50	39,9	cyclictest	1148099	-21	fschecks_count	11:35:19	1
989156	99	50	39,8	cyclictest	1014670	-21	kworker/u4:6+events_unbound	09:30:31	0
989156	99	50	39,6	cyclictest	256	50	irq/23-42890000.ethernet	11:03:20	0
989156	99	50	36,5	cyclictest	998071	-21	kworker/u4:0+events_unbound	08:35:22	0
989156	99	50	34,10	cyclictest	1015951	-21	modprobe	08:55:00	0
989157	99	49	42,5	cyclictest	1000612	-21	kworker/u4:11+events_unbound	08:47:01	1
989157	99	49	39,8	cyclictest	1087434	-21	sh	10:25:37	1
989156	99	49	41,6	cyclictest	979023	-21	kworker/u4:4+events_unbound	07:17:00	0
989156	99	49	40,6	cyclictest	994100	-21	unixbench-2d	07:25:37	0
989157	99	48	42,4	cyclictest	1095319	-21	aten2__	10:35:14	1
989157	99	48	42,4	cyclictest	1029718	-21	kernelversion	09:20:22	1
989157	99	48	41,5	cyclictest	1160697	-21	sed	11:50:01	1
989157	99	48	41,5	cyclictest	1153449	-21	sed	11:40:40	1
989157	99	48	41,5	cyclictest	1039120	-21	switchtime	09:30:38	1
989157	99	48	39,6	cyclictest	1187308	-21	ssh	12:20:18	1
989157	99	48	34,6	cyclictest	1136946	-21	kworker/u4:4+events_unbound	11:26:44	1
989156	99	48	41,5	cyclictest	1191588	-21	aten_r7power_vo	12:25:15	0
989156	99	48	40,5	cyclictest	1053738	-21	kworker/u4:1-rpciod	09:55:32	0
989156	99	48	38,7	cyclictest	1033862	-21	df_abs	09:25:17	0
989157	99	47	5,29	cyclictest	1174870	-21	ssh	12:05:33	1
989156	99	47	41,4	cyclictest	1143187	-21	latency_hist	11:30:01	0
989156	99	47	41,4	cyclictest	1105194	-21	timerwakeupswit	10:45:40	0
989156	99	47	41,4	cyclictest	1105194	-21	timerwakeupswit	10:45:40	0
989156	99	47	41,4	cyclictest	0	-21	swapper/0	09:35:30	0
989156	99	47	40,5	cyclictest	989153	-21	cyclictest	08:55:24	0
989156	99	47	39,5	cyclictest	1004468	-21	kworker/u4:3	08:10:00	0
989156	99	47	39,5	cyclictest	0	-21	swapper/0	10:15:35	0
989156	99	47	39,5	cyclictest	0	-21	swapper/0	09:40:27	0
989156	99	47	38,7	cyclictest	1029632	-21	gltestperf	09:20:20	0
989156	99	47	37,6	cyclictest	1079797	-21	kworker/u4:19-nfsiod	10:25:33	0
989157	99	46	40,4	cyclictest	1014669	-21	kworker/u4:1+events_unbound	08:50:23	1
989157	99	46	39,5	cyclictest	1196249	-21	gltestperf	12:30:19	1
989157	99	46	39,5	cyclictest	1099879	-21	aten_r7power_vo	10:40:19	1
989157	99	46	35,9	cyclictest	1070235	-21	sort	10:05:45	1
989157	99	46	33,6	cyclictest	989092	-21	kworker/u4:1+events_unbound	07:26:00	1
989156	99	46	36,7	cyclictest	991668	-21	kworker/u4:13-xprtiod	08:40:20	0
989156	99	46	36,7	cyclictest	1170250	-21	kernelversion	12:00:25	0
989156	99	46	36,7	cyclictest	1013832	-21	fschecks_count	08:45:18	0
989156	99	46	3,23	cyclictest	1126669	-21	ssh	11:10:29	0
989157	99	45	38,5	cyclictest	990057	-21	sendmail_mailqu	07:10:34	1
989157	99	45	34,7	cyclictest	0	-21	swapper/1	07:15:36	1
989157	99	45	24,18	cyclictest	27	1	ktimers/1	12:12:19	1
989156	99	45	38,5	cyclictest	1116896	-21	sendmail	11:00:01	0
989156	99	45	38,5	cyclictest	1007591	-21	gltestperf	08:20:20	0
989156	99	45	37,5	cyclictest	998323	-21	wget	07:45:16	0
989156	99	45	36,7	cyclictest	996851	-21	latency_hist	07:40:01	0
989156	99	45	35,7	cyclictest	999667	-21	aten_r7power_vo	07:50:16	0
989156	99	45	27,6	cyclictest	1093146	-21	kworker/u4:6+events_unbound	10:35:37	0
989157	99	44	37,5	cyclictest	1055740	-21	latency_hist	09:50:02	1
989157	99	44	37,5	cyclictest	1014670	-21	kworker/u4:6+events_unbound	08:56:59	1
989157	99	44	36,6	cyclictest	1130503	-21	df_abs	11:15:17	1
989157	99	44	36,6	cyclictest	1091274	-21	/usr/sbin/munin	10:30:16	1
989157	99	44	36,6	cyclictest	0	-21	swapper/1	10:10:34	1
989157	99	44	36,5	cyclictest	1143412	-21	aten2__	11:30:13	1
989157	99	44	36,5	cyclictest	1143412	-21	aten2__	11:30:13	1
989157	99	44	36,5	cyclictest	1019280	-21	kernelversion	09:05:26	1
989157	99	44	35,6	cyclictest	0	-21	swapper/1	12:05:02	1
989157	99	44	35,6	cyclictest	0	-21	swapper/1	09:10:39	1
989157	99	44	33,8	cyclictest	999123	-21	timerandwakeup	07:45:37	1
989156	99	44	36,5	cyclictest	1135853	-21	unixbench-2d	11:20:38	0
989156	99	44	36,5	cyclictest	1018736	-21	cat	09:05:02	0
989157	99	43	36,5	cyclictest	1033760	-21	basename	09:25:15	1
989157	99	43	34,6	cyclictest	0	-21	swapper/1	11:50:25	1
989157	99	43	34,6	cyclictest	0	-21	swapper/1	09:50:33	1
989157	99	43	33,8	cyclictest	1064337	-21	idleruntime-cro	10:00:00	1
989157	99	42	35,5	cyclictest	986567	-21	kworker/u4:9+events_unbound	07:59:01	1
989156	99	42	34,5	cyclictest	1007176	-21	latency_hist	08:20:01	0
989156	99	42	33,7	cyclictest	1175147	-21	timerandwakeup	12:05:38	0
989156	99	42	33,6	cyclictest	1010588	-21	switchtime	08:30:38	0
989157	99	41	34,5	cyclictest	1112942	-21	cpu	10:55:15	1
989157	99	41	33,6	cyclictest	986567	-21	kworker/u4:9+events_unbound	07:35:14	1
989156	99	41	33,5	cyclictest	0	-21	swapper/0	11:05:17	0
989156	99	41	31,8	cyclictest	1003188	-21	cron	08:05:00	0
989156	99	41	30,7	cyclictest	0	-21	swapper/0	07:20:25	0
989156	99	41	30,7	cyclictest	0	-21	swapper/0	07:20:24	0
989157	99	40	31,6	cyclictest	0	-21	swapper/1	08:30:39	1
989157	99	40	30,8	cyclictest	997850	-21	timerandwakeup	07:40:37	1
989157	99	40	30,7	cyclictest	0	-21	swapper/1	09:00:35	1
989157	99	40	27,6	cyclictest	1176297	-21	kworker/u4:7+events_unbound	12:39:32	1
989156	99	39	30,7	cyclictest	989657	-21	fschecks_time	07:10:18	0
989157	99	38	28,8	cyclictest	1011236	-21	grep	08:35:18	1
989157	99	37	29,6	cyclictest	986567	-21	kworker/u4:9+events_unbound	08:00:17	1
989156	99	31	21,7	cyclictest	0	-21	swapper/0	07:10:01	0
989157	99	30	8,5	cyclictest	27	1	ktimers/1	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17