OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Mon Jun 29, 2026 12:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
654786	99	115	107,6	cyclictest	656014	-21	kworker/u4:10+events_unbound	08:35:41	1
654786	99	114	106,6	cyclictest	737975	-21	kworker/u4:6+events_unbound	10:21:00	1
654783	99	109	102,5	cyclictest	751590	-21	kworker/u4:12+events_unbound	10:31:00	0
654786	99	106	98,6	cyclictest	778194	-21	kworker/u4:4+events_unbound	11:01:07	1
654786	99	100	89,8	cyclictest	654717	-21	kworker/u4:0+events_unbound	07:35:12	1
654783	99	97	75,12	cyclictest	724949	-21	kworker/u4:2+xprtiod	10:00:12	0
654786	99	91	77,5	cyclictest	813679	-21	kworker/u4:7+events_unbound	11:41:15	1
654786	99	90	81,6	cyclictest	667518	-21	kworker/u4:5+events_unbound	08:00:20	1
654786	99	87	80,5	cyclictest	831611	-21	kworker/u4:10+events_unbound	12:01:20	1
654786	99	82	62,5	cyclictest	667518	-21	kworker/u4:5+events_unbound	08:50:00	1
654786	99	81	70,8	cyclictest	657289	-21	kworker/u4:9+events_unbound	07:55:00	1
654786	99	77	69,6	cyclictest	0	-21	swapper/1	12:35:17	1
654786	99	77	66,8	cyclictest	658596	-21	kworker/u4:11+events_unbound	08:10:30	1
654786	99	77	60,5	cyclictest	657289	-21	kworker/u4:9+events_unbound	07:55:17	1
654783	99	77	7,18	cyclictest	654784	-21	modprobe	07:10:00	0
654783	99	77	68,7	cyclictest	667516	-21	kworker/u4:3+events_unbound	08:20:36	0
654783	99	77	68,7	cyclictest	667516	-21	kworker/u4:3+events_unbound	08:20:36	0
654783	99	77	28,46	cyclictest	256	50	irq/23-42890000.ethernet	09:20:16	0
654786	99	76	67,5	cyclictest	0	-21	swapper/1	10:30:13	1
654783	99	76	27,45	cyclictest	0	-21	swapper/0	11:45:22	0
654786	99	73	65,6	cyclictest	800811	-21	kworker/u4:10+events_unbound	11:36:14	1
654786	99	73	63,8	cyclictest	642210	-21	kworker/u4:6+events_unbound	07:15:00	1
654783	99	73	66,5	cyclictest	827138	-21	kworker/u4:0+events_unbound	11:55:00	0
654786	99	72	62,5	cyclictest	685502	-21	kworker/u4:21+events_unbound	09:10:50	1
654783	99	72	49,20	cyclictest	53	-21	kswapd0	11:05:01	0
654783	99	72	36,33	cyclictest	754865	-21	unixbench_multi	10:25:41	0
654783	99	72	2,31	cyclictest	736706	-21	ssh	10:05:38	0
654786	99	71	63,5	cyclictest	685502	-21	kworker/u4:21+events_unbound	09:10:02	1
654783	99	71	62,7	cyclictest	778192	-21	kworker/u4:2+events_unbound	10:56:07	0
654786	99	70	60,7	cyclictest	773650	-21	kworker/u4:0+events_unbound	10:50:00	1
654786	99	70	60,6	cyclictest	656014	-21	kworker/u4:10+events_unbound	07:35:00	1
654783	99	70	59,4	cyclictest	667515	-21	kworker/u4:2+events_unbound	08:55:01	0
654783	99	70	42,26	cyclictest	672843	-21	awk	08:20:02	0
654783	99	70	40,28	cyclictest	712890	-21	sendmail	09:40:00	0
654783	99	70	34,33	cyclictest	808329	-21	ssh	11:25:37	0
654786	99	69	62,5	cyclictest	706447	-21	kworker/u4:9+events_unbound	09:35:55	1
654783	99	69	39,28	cyclictest	852421	-21	switchtime	12:15:38	0
654783	99	69	35,32	cyclictest	53	-21	kswapd0	11:05:11	0
654783	99	68	7,14	cyclictest	0	-21	swapper/0	09:45:25	0
654783	99	68	7,14	cyclictest	0	-21	swapper/0	09:45:25	0
654783	99	68	60,6	cyclictest	862447	-21	kworker/u4:3+events_unbound	12:31:27	0
654783	99	68	59,6	cyclictest	840624	-21	kworker/u4:8+events_unbound	12:06:21	0
654783	99	68	31,35	cyclictest	799403	-21	ssh	11:15:40	0
654783	99	67	32,32	cyclictest	804046	-21	/usr/sbin/munin	11:20:40	0
654783	99	67	31,33	cyclictest	821424	-21	mailstats	11:40:37	0
654783	99	67	31,32	cyclictest	0	-21	swapper/0	11:30:25	0
654783	99	67	25,7	cyclictest	677080	-21	fschecks_time	08:35:21	0
654786	99	66	58,5	cyclictest	786586	-21	kworker/u4:5+events_unbound	11:06:08	1
654786	99	66	56,7	cyclictest	769103	-21	kworker/u4:10+events_unbound	10:45:00	1
654783	99	66	32,31	cyclictest	669070	-21	aten_r7power_en	08:05:16	0
654783	99	66	28,34	cyclictest	0	-21	swapper/0	09:15:17	0
654783	99	66	2,17	cyclictest	860931	-21	ntpq	12:25:26	0
654783	99	66	1,15	cyclictest	727572	-21	ntpq	09:55:31	0
654783	99	65	56,7	cyclictest	642210	-21	kworker/u4:6+events_unbound	07:50:14	0
654783	99	65	33,30	cyclictest	856393	-21	/usr/sbin/munin	12:20:22	0
654786	99	64	57,5	cyclictest	787254	-21	kworker/u4:13+events_unbound	11:16:10	1
654783	99	64	29,32	cyclictest	670576	-21	fschecks_time	08:10:21	0
654783	99	64	29,32	cyclictest	0	-21	swapper/0	09:50:29	0
654783	99	64	29,32	cyclictest	0	-21	swapper/0	07:15:16	0
654783	99	64	25,6	cyclictest	0	-21	swapper/0	09:10:20	0
654786	99	63	55,5	cyclictest	688571	-21	kworker/u4:0+events_unbound	09:15:53	1
654786	99	63	52,7	cyclictest	317	-21	systemd-journal	09:45:55	1
654786	99	63	52,7	cyclictest	317	-21	systemd-journal	09:45:55	1
654783	99	63	30,30	cyclictest	680394	-21	kworker/u4:0-rpciod	08:46:43	0
654783	99	63	28,32	cyclictest	0	-21	swapper/0	12:00:45	0
654783	99	63	28,32	cyclictest	0	-21	swapper/0	10:40:36	0
654783	99	63	26,34	cyclictest	0	-21	swapper/0	11:55:28	0
654783	99	63	26,34	cyclictest	0	-21	swapper/0	07:10:36	0
654783	99	63	1,11	cyclictest	741004	-21	ntpq	10:10:30	0
654783	99	62	31,29	cyclictest	700322	-21	ntp_kernel_pll_	09:25:28	0
654783	99	62	30,28	cyclictest	0	-21	swapper/0	11:35:41	0
654783	99	62	24,35	cyclictest	675831	-21	fschecks_time	08:30:17	0
654783	99	61	27,30	cyclictest	0	-21	swapper/0	09:30:25	0
654783	99	61	26,33	cyclictest	0	-21	swapper/0	10:15:15	0
654783	99	61	23,8	cyclictest	717474	-21	wc	09:45:01	0
654783	99	61	23,7	cyclictest	0	-21	swapper/0	07:55:17	0
654786	99	60	50,8	cyclictest	728879	-21	kworker/u4:16-rpciod	10:05:22	1
654786	99	60	10,38	cyclictest	744687	-21	/usr/sbin/munin	10:15:14	1
654783	99	60	29,28	cyclictest	0	-21	swapper/0	10:20:23	0
654783	99	60	27,30	cyclictest	0	-21	swapper/0	12:35:26	0
654783	99	60	26,4	cyclictest	0	-21	swapper/0	10:35:34	0
654783	99	60	24,6	cyclictest	0	-21	swapper/0	09:00:13	0
654783	99	60	23,33	cyclictest	0	-21	swapper/0	07:20:29	0
654783	99	60	22,6	cyclictest	662155	-21	switchtime	07:35:37	0
654786	99	59	53,4	cyclictest	840621	-21	kworker/u4:2+events_unbound	12:20:04	1
654783	99	59	26,31	cyclictest	769103	-21	kworker/u4:10-rpciod	10:45:37	0
654783	99	59	25,6	cyclictest	685411	-21	unixbench_multi	09:05:40	0
654783	99	59	25,4	cyclictest	0	-21	swapper/0	12:10:32	0
654783	99	59	23,6	cyclictest	0	-21	swapper/0	08:40:33	0
654783	99	58	26,28	cyclictest	0	-21	swapper/0	11:10:27	0
654783	99	58	24,6	cyclictest	658989	-21	grep	07:25:15	0
654783	99	58	24,30	cyclictest	0	-21	swapper/0	07:45:02	0
654786	99	57	47,7	cyclictest	37	-21	kcompactd0	12:05:25	1
654786	99	57	47,6	cyclictest	699825	-21	/usr/sbin/munin	09:25:17	1
654783	99	57	25,29	cyclictest	0	-21	swapper/0	09:00:01	0
654783	99	57	25,29	cyclictest	0	-21	swapper/0	09:00:01	0
654783	99	57	20,7	cyclictest	773650	-21	kworker/u4:0-rpciod	10:50:35	0
654786	99	56	49,5	cyclictest	711064	-21	kworker/u4:0+events_unbound	09:55:15	1
654786	99	55	41,6	cyclictest	667515	-21	kworker/u4:2+events_unbound	08:55:46	1
654786	99	55	41,6	cyclictest	667515	-21	kworker/u4:2+events_unbound	08:55:46	1
654783	99	55	16,10	cyclictest	668301	-21	ntpq	08:00:25	0
654786	99	54	44,6	cyclictest	0	-21	swapper/1	12:25:16	1
654786	99	54	21,29	cyclictest	704881	-21	ssh	09:30:31	1
654786	99	53	46,5	cyclictest	865271	-21	/usr/sbin/munin	12:30:23	1
654786	99	52	44,5	cyclictest	711064	-21	kworker/u4:0+events_unbound	10:00:16	1
654786	99	52	42,7	cyclictest	793883	-21	basename	11:10:16	1
654786	99	51	6,33	cyclictest	829256	-21	ssh	11:50:13	1
654786	99	51	42,6	cyclictest	776257	-21	/usr/sbin/munin	10:50:19	1
654786	99	51	39,8	cyclictest	37	-21	kcompactd0	12:15:36	1
654786	99	51	33,7	cyclictest	840620	-21	kworker/u4:0+events_unbound	12:15:01	1
654786	99	50	42,5	cyclictest	791779	-21	kworker/u4:6+events_unbound	11:30:01	1
654786	99	50	41,6	cyclictest	781475	-21	mailstats	10:55:39	1
654786	99	50	40,7	cyclictest	815667	-21	cron	11:35:00	1
654786	99	49	43,4	cyclictest	692541	-21	kworker/u4:10+events_unbound	09:20:03	1
654786	99	49	41,6	cyclictest	657555	-21	aten2__	07:20:16	1
654786	99	49	39,8	cyclictest	679138	-21	cron	08:45:00	1
654786	99	49	39,7	cyclictest	676551	-21	systemd	08:30:38	1
654786	99	48	38,7	cyclictest	824803	-21	/usr/sbin/munin	11:45:37	1
654786	99	48	37,8	cyclictest	663706	-21	kworker/u4:16+rpciod	08:05:24	1
654786	99	48	34,5	cyclictest	706449	-21	kworker/u4:11+events_unbound	09:42:59	1
654786	99	47	41,4	cyclictest	740953	-21	ntpq	10:10:27	1
654786	99	47	39,6	cyclictest	763824	-21	grep	10:35:44	1
654786	99	46	39,5	cyclictest	827138	-21	kworker/u4:0+events_unbound	11:56:19	1
654786	99	46	35,4	cyclictest	751590	-21	kworker/u4:12+events_unbound	10:30:01	1
654786	99	46	33,6	cyclictest	670085	-21	kworker/u4:1+events_unbound	08:50:45	1
654786	99	45	37,5	cyclictest	0	-21	swapper/1	09:50:14	1
654786	99	45	36,7	cyclictest	672502	-21	unixbench-2d	08:15:38	1
654786	99	43	37,4	cyclictest	802781	-21	aten_r7power_cu	11:20:15	1
654786	99	43	36,5	cyclictest	683469	-21	fschecks_time	09:00:18	1
654786	99	42	32,6	cyclictest	657351	-21	sendmail	07:20:01	1
654786	99	42	29,10	cyclictest	0	-21	swapper/1	07:40:20	1
654786	99	41	31,8	cyclictest	666246	-21	kworker/u4:8+events_unbound	08:20:38	1
654786	99	41	31,8	cyclictest	666246	-21	kworker/u4:8+events_unbound	08:20:38	1
654786	99	41	29,8	cyclictest	0	-21	swapper/1	07:45:26	1
654786	99	40	30,8	cyclictest	400	-21	systemd-logind	07:25:08	1
654783	99	40	30,7	cyclictest	0	-21	swapper/0	07:45:23	0
654786	99	39	31,6	cyclictest	0	-21	swapper/1	08:25:18	1
654783	99	39	30,7	cyclictest	674297	-21	aten_r7power_en	08:25:15	0
654783	99	37	30,5	cyclictest	660460	-21	gltestperf	07:30:22	0
654786	99	35	27,5	cyclictest	0	-21	swapper/1	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17