OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Sat Dec 13, 2025 12:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
534125	99	95	86,7	cyclictest	717508	-21	kworker/u4:14+events_unbound	12:30:59	0
534125	99	88	80,6	cyclictest	751483	-21	kworker/u4:5+events_unbound	12:36:01	0
534125	99	87	78,6	cyclictest	607105	-21	kworker/u4:9+events_unbound	10:05:38	0
534126	99	83	41,39	cyclictest	0	-21	swapper/1	11:25:37	1
534125	99	82	75,5	cyclictest	650306	-21	kworker/u4:9+events_unbound	10:45:46	0
534125	99	79	72,5	cyclictest	713338	-21	kworker/u4:13+events_unbound	11:50:50	0
534125	99	79	71,6	cyclictest	688863	-21	kworker/u4:0+events_unbound	11:20:48	0
534126	99	76	42,31	cyclictest	715547	-21	diskmemload	11:45:17	1
534126	99	76	38,36	cyclictest	744678	-21	ntp_kernel_err	12:15:25	1
534125	99	76	66,5	cyclictest	0	-21	swapper/0	12:05:11	0
534125	99	75	68,5	cyclictest	626626	-21	kworker/u4:3+events_unbound	10:15:41	0
534125	99	75	67,6	cyclictest	555791	-21	kworker/u4:1+events_unbound	08:50:11	0
534126	99	73	35,35	cyclictest	0	-21	swapper/1	09:20:25	1
534125	99	72	65,5	cyclictest	717508	-21	kworker/u4:14+events_unbound	12:10:53	0
534125	99	72	64,6	cyclictest	635702	-21	kworker/u4:11+events_unbound	10:25:42	0
534126	99	70	33,34	cyclictest	570248	-21	aten2__	09:15:15	1
534125	99	70	55,10	cyclictest	564944	-21	diskmemload	12:00:36	0
534126	99	69	7,50	cyclictest	614212	-21	ssh	10:00:06	1
534126	99	69	40,27	cyclictest	581048	-21	ldconfig	09:25:36	1
534126	99	69	36,31	cyclictest	643210	-21	aten_r7power_en	10:30:18	1
534126	99	69	36,31	cyclictest	643210	-21	aten_r7power_en	10:30:18	1
534125	99	69	62,5	cyclictest	650306	-21	kworker/u4:9+events_unbound	11:00:47	0
534126	99	68	34,31	cyclictest	594604	-21	sendmail	09:40:01	1
534125	99	68	61,5	cyclictest	664123	-21	kworker/u4:2+events_unbound	11:10:49	0
534125	99	68	61,5	cyclictest	645441	-21	kworker/u4:0+events_unbound	10:35:44	0
534126	99	67	36,29	cyclictest	706104	-21	fschecks_count	11:35:20	1
534126	99	67	33,31	cyclictest	0	-21	swapper/1	09:10:39	1
534126	99	66	33,30	cyclictest	726025	-21	switchtime	11:55:38	1
534126	99	66	31,4	cyclictest	0	-21	swapper/1	12:20:28	1
534126	99	66	30,6	cyclictest	0	-21	swapper/1	10:15:17	1
534126	99	65	34,28	cyclictest	0	-21	swapper/1	11:05:39	1
534126	99	65	31,4	cyclictest	0	-21	swapper/1	09:50:25	1
534126	99	65	31,4	cyclictest	0	-21	swapper/1	09:50:25	1
534126	99	65	30,8	cyclictest	553265	-21	cron	08:25:00	1
534126	99	64	32,29	cyclictest	0	-21	swapper/1	09:40:36	1
534126	99	64	30,5	cyclictest	0	-21	swapper/1	10:45:01	1
534126	99	64	29,5	cyclictest	0	-21	swapper/1	12:00:51	1
534126	99	64	27,8	cyclictest	0	-21	swapper/1	07:10:31	1
534125	99	64	57,5	cyclictest	698667	-21	kworker/u4:2+events_unbound	11:55:51	0
534125	99	64	40,17	cyclictest	562296	-21	apt-get	09:00:10	0
534125	99	64	29,20	cyclictest	748798	-21	sshd	12:20:15	0
534126	99	62	31,5	cyclictest	735813	-21	unixbench_multi	12:05:44	1
534126	99	62	30,5	cyclictest	0	-21	swapper/1	10:05:19	1
534126	99	62	29,6	cyclictest	0	-21	swapper/1	10:50:28	1
534125	99	62	37,12	cyclictest	0	-21	swapper/0	10:00:09	0
534125	99	61	52,7	cyclictest	548135	-21	kworker/u4:6+events_unbound	08:20:06	0
534125	99	61	52,6	cyclictest	543857	-21	/usr/sbin/munin	07:45:30	0
534125	99	60	44,6	cyclictest	703559	-21	kworker/u4:10+events_unbound	11:44:44	0
534126	99	58	28,8	cyclictest	0	-21	swapper/1	10:25:24	1
534126	99	58	28,4	cyclictest	0	-21	swapper/1	12:10:13	1
534126	99	57	28,6	cyclictest	0	-21	swapper/1	10:00:00	1
534126	99	57	28,6	cyclictest	0	-21	swapper/1	10:00:00	1
534125	99	57	49,6	cyclictest	697396	-21	/usr/sbin/munin	11:25:40	0
534125	99	56	49,6	cyclictest	703559	-21	kworker/u4:10+events_unbound	11:35:49	0
534125	99	56	41,12	cyclictest	0	-21	swapper/0	09:40:50	0
534125	99	55	40,6	cyclictest	548134	-21	kworker/u4:3+events_unbound	08:14:59	0
534125	99	54	47,5	cyclictest	607105	-21	kworker/u4:9+events_unbound	09:52:59	0
534125	99	54	47,5	cyclictest	607105	-21	kworker/u4:9+events_unbound	09:52:59	0
534125	99	54	47,5	cyclictest	587240	-21	kworker/u4:18+events_unbound	09:32:59	0
534125	99	54	46,6	cyclictest	558363	-21	kworker/u4:2+events_unbound	09:38:59	0
534125	99	54	46,6	cyclictest	535350	-21	kworker/u4:9+events_unbound	07:44:55	0
534125	99	54	45,7	cyclictest	702132	-21	/usr/sbin/munin	11:30:39	0
534125	99	54	33,19	cyclictest	546664	-21	timerwakeupswit	07:55:34	0
534126	99	53	45,6	cyclictest	589669	-21	idleruntime-cro	09:35:01	1
534125	99	53	46,5	cyclictest	536632	-21	kworker/u4:1+events_unbound	07:34:44	0
534126	99	52	44,6	cyclictest	550694	-21	systemd	08:14:59	1
534126	99	52	35,13	cyclictest	624949	-21	mailstats	10:10:44	1
534125	99	52	45,5	cyclictest	616898	-21	kworker/u4:4+events_unbound	10:12:59	0
534125	99	52	44,6	cyclictest	644372	-21	sed	10:30:41	0
534125	99	52	44,6	cyclictest	644372	-21	sed	10:30:41	0
534125	99	51	44,5	cyclictest	558363	-21	kworker/u4:2+events_unbound	09:46:59	0
534125	99	51	41,8	cyclictest	549445	-21	munin-run	08:10:00	0
534126	99	50	43,5	cyclictest	521	-21	in:imuxsock	09:45:29	1
534125	99	50	43,5	cyclictest	745892	-21	kworker/u4:11+events_unbound	12:30:00	0
534125	99	50	42,6	cyclictest	534056	-21	kworker/u4:4+events_unbound	08:35:09	0
534125	99	49	41,6	cyclictest	688863	-21	kworker/u4:0+events_unbound	11:20:00	0
534125	99	49	39,8	cyclictest	668442	-21	systemd	10:55:46	0
534125	99	49	39,8	cyclictest	668442	-21	systemd	10:55:46	0
534125	99	49	31,16	cyclictest	534122	-21	cyclictest	09:10:42	0
534126	99	48	39,7	cyclictest	753800	-21	/usr/sbin/munin	12:25:19	1
534126	99	48	37,8	cyclictest	664844	-21	kworker/u4:4-nfsiod	11:15:26	1
534126	99	48	33,10	cyclictest	548160	-21	modprobe	08:05:00	1
534125	99	48	42,4	cyclictest	555792	-21	kworker/u4:5+events_unbound	09:28:59	0
534125	99	48	41,5	cyclictest	653383	-21	sh	10:40:29	0
534125	99	48	41,5	cyclictest	633525	-21	/usr/sbin/munin	10:20:16	0
534125	99	48	40,5	cyclictest	0	-21	swapper/0	09:55:32	0
534125	99	48	40,5	cyclictest	0	-21	swapper/0	09:55:32	0
534125	99	48	38,7	cyclictest	677766	-21	sendmail_mailqu	11:05:37	0
534126	99	47	40,5	cyclictest	546512	-21	sendmail_mailqu	07:55:33	1
534125	99	47	30,10	cyclictest	0	-21	swapper/0	12:15:16	0
534126	99	46	39,5	cyclictest	720584	-21	fschecks_time	11:50:20	1
534126	99	46	39,4	cyclictest	0	-21	swapper/1	12:35:54	1
534126	99	46	32,8	cyclictest	554545	-21	kworker/u4:3	08:29:59	1
534125	99	46	40,4	cyclictest	550678	-21	kworker/u4:18+events_unbound	08:30:08	0
534125	99	46	39,5	cyclictest	1058	-21	snmpd	09:10:01	0
534125	99	46	38,6	cyclictest	570626	-21	fschecks_time	09:15:19	0
534125	99	46	35,5	cyclictest	664845	-21	kworker/u4:5+events_unbound	10:53:59	0
534126	99	45	39,4	cyclictest	758580	-21	fschecks_count	12:30:19	1
534126	99	45	39,4	cyclictest	691455	-21	aten_r7power_po	11:20:16	1
534126	99	45	38,5	cyclictest	562567	-21	apt-get	09:00:13	1
534126	99	45	37,6	cyclictest	536646	-21	cron	07:20:00	1
534126	99	45	21,5	cyclictest	0	-21	swapper/1	10:20:31	1
534125	99	45	37,5	cyclictest	0	-21	swapper/0	11:45:37	0
534125	99	45	36,7	cyclictest	575333	-21	aten_r7power_vo	09:20:16	0
534125	99	45	35,7	cyclictest	552010	-21	sendmail	08:20:00	0
534126	99	44	35,6	cyclictest	558515	-21	latency_hist	08:45:01	1
534125	99	44	37,5	cyclictest	535351	-21	kworker/u4:10+events_unbound	08:25:08	0
534125	99	44	36,6	cyclictest	537181	-21	fschecks_time	07:20:19	0
534125	99	44	34,4	cyclictest	535351	-21	kworker/u4:10+events_unbound	08:45:11	0
534126	99	43	37,4	cyclictest	561454	-21	fschecks_count	08:55:19	1
534126	99	43	36,5	cyclictest	0	-21	swapper/1	11:00:18	1
534126	99	43	34,7	cyclictest	682410	-21	ssh	11:10:29	1
534126	99	43	32,8	cyclictest	0	-21	swapper/1	07:50:20	1
534126	99	43	31,9	cyclictest	0	-21	swapper/1	07:30:17	1
534125	99	43	34,7	cyclictest	558465	-21	latency_hist	08:45:00	0
534125	99	43	33,8	cyclictest	541799	-21	sendmail	07:40:00	0
534126	99	42	36,4	cyclictest	538369	-21	fschecks_count	07:25:20	1
534126	99	42	35,5	cyclictest	559744	-21	latency_hist	08:50:01	1
534126	99	42	34,5	cyclictest	560993	-21	kworker/u4:9-rpciod	08:55:01	1
534126	99	42	33,6	cyclictest	0	-21	swapper/1	11:40:24	1
534126	99	42	32,7	cyclictest	0	-21	swapper/1	07:35:36	1
534125	99	42	31,9	cyclictest	534122	-21	cyclictest	07:12:15	0
534126	99	41	34,5	cyclictest	557106	-21	munin-run	08:40:00	1
534126	99	41	34,4	cyclictest	648836	-21	rm	10:35:38	1
534126	99	41	33,6	cyclictest	0	-21	swapper/1	10:55:33	1
534126	99	41	33,6	cyclictest	0	-21	swapper/1	10:55:33	1
534126	99	41	33,5	cyclictest	705472	-21	latency_hist	11:35:01	1
534126	99	41	31,7	cyclictest	0	-21	swapper/1	10:45:29	1
534125	99	41	34,5	cyclictest	545569	-21	kworker/u4:7+events_unbound	08:04:58	0
534125	99	41	34,4	cyclictest	0	-21	swapper/0	07:50:29	0
534125	99	41	33,6	cyclictest	538216	-21	aten_r7power_po	07:25:17	0
534125	99	41	33,5	cyclictest	535582	-21	aten_r7power_cu	07:15:12	0
534126	99	40	31,7	cyclictest	0	-21	swapper/1	09:05:17	1
534126	99	40	30,8	cyclictest	0	-21	swapper/1	08:15:17	1
534126	99	40	29,9	cyclictest	0	-21	swapper/1	07:45:20	1
534125	99	40	33,5	cyclictest	561586	-21	gltestperf	08:55:20	0
534126	99	39	31,6	cyclictest	549231	-21	timerwakeupswit	08:05:36	1
534126	99	38	29,6	cyclictest	0	-21	swapper/1	08:30:18	1
534125	99	37	29,5	cyclictest	0	-21	swapper/0	07:10:00	0
534126	99	36	25,8	cyclictest	0	-21	swapper/1	07:20:16	1
534126	99	35	25,7	cyclictest	0	-21	swapper/1	07:40:15	1
534126	99	30	22,6	cyclictest	0	-21	swapper/1	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17