OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #6

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack3slot6.osadl.org (updated Sat May 09, 2026 12:45:01)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
24873	2	108	0,8	chrt	0	-21	swapper/1	09:10:16	1
13482	2	105	27,65	sleep1	0	-21	swapper/1	07:08:51	1
13456	2	96	14,71	sleep0	0	-21	swapper/0	07:08:34	0
13768	99	88	12,63	cyclictest	0	-21	swapper/0	10:30:11	0
13768	99	87	10,60	cyclictest	0	-21	swapper/0	07:40:04	0
13768	99	85	7,67	cyclictest	32073	-21	apt-get	08:00:14	0
13768	99	85	6,63	cyclictest	10460	-21	apt-get	08:30:15	0
13775	99	84	7,67	cyclictest	0	-21	swapper/1	08:30:15	1
13768	99	84	11,58	cyclictest	0	-21	swapper/0	11:10:12	0
13768	99	84	11,58	cyclictest	0	-21	swapper/0	10:40:13	0
13768	99	84	10,62	cyclictest	0	-21	swapper/0	07:55:13	0
13775	99	83	6,65	cyclictest	0	-21	swapper/1	08:35:16	1
13768	99	83	3,73	cyclictest	6504	-21	basename	09:50:16	0
13768	99	83	13,55	cyclictest	0	-21	swapper/0	10:55:11	0
13768	99	83	11,62	cyclictest	0	-21	swapper/0	12:00:13	0
13768	99	83	11,59	cyclictest	0	-21	swapper/0	09:55:13	0
13768	99	83	11,59	cyclictest	0	-21	swapper/0	08:45:11	0
13768	99	83	11,58	cyclictest	0	-21	swapper/0	08:50:22	0
13768	99	83	11,56	cyclictest	0	-21	swapper/0	07:10:13	0
13775	99	82	7,64	cyclictest	0	-21	swapper/1	08:40:12	1
13768	99	82	3,11	cyclictest	26572	-21	apt-get	09:15:16	0
13768	99	82	17,58	cyclictest	32387	-21	apt-key	12:35:02	0
13768	99	82	14,58	cyclictest	0	-21	swapper/0	08:05:15	0
13768	99	82	12,60	cyclictest	0	-21	swapper/0	10:10:16	0
13768	99	82	12,56	cyclictest	0	-21	swapper/0	08:20:24	0
13768	99	82	12,56	cyclictest	0	-21	swapper/0	08:20:24	0
13768	99	82	12,54	cyclictest	0	-21	swapper/0	11:55:13	0
13768	99	82	11,58	cyclictest	0	-21	swapper/0	10:50:11	0
13768	99	82	11,57	cyclictest	0	-21	swapper/0	11:00:23	0
13768	99	82	10,61	cyclictest	0	-21	swapper/0	09:25:11	0
13775	99	81	7,59	cyclictest	20732	-21	apt-get	10:30:11	1
13775	99	81	6,66	cyclictest	2944	-21	apt-get	09:40:14	1
13775	99	81	6,60	cyclictest	0	-21	swapper/1	11:35:12	1
13775	99	81	5,66	cyclictest	14942	-21	apt-get	11:45:11	1
13768	99	81	9,65	cyclictest	503	-21	snmpd	09:35:13	0
13768	99	81	7,58	cyclictest	9649	-21	apt-get	11:30:15	0
13768	99	81	4,70	cyclictest	24668	-21	diskmemload	09:10:19	0
13768	99	81	12,56	cyclictest	0	-21	swapper/0	08:35:15	0
13768	99	81	11,58	cyclictest	0	-21	swapper/0	11:40:11	0
13768	99	81	10,58	cyclictest	0	-21	swapper/0	07:50:13	0
13768	99	81	10,57	cyclictest	0	-21	swapper/0	07:45:13	0
13775	99	80	6,58	cyclictest	20185	-21	apt-get	12:00:13	1
13775	99	80	5,63	cyclictest	15758	-21	apt-get	08:45:11	1
13775	99	80	29,46	cyclictest	15312	-21	cron	10:15:00	1
13768	99	80	12,55	cyclictest	0	-21	swapper/0	12:20:09	0
13768	99	80	11,59	cyclictest	0	-21	swapper/0	11:35:11	0
13768	99	80	10,58	cyclictest	0	-21	swapper/0	09:20:14	0
13768	99	80	10,56	cyclictest	0	-21	swapper/0	12:10:13	0
13768	99	80	10,56	cyclictest	0	-21	swapper/0	12:10:12	0
13775	99	79	8,61	cyclictest	0	-21	swapper/1	12:25:12	1
13775	99	79	5,63	cyclictest	24911	-21	apt-get	07:40:04	1
13768	99	79	7,59	cyclictest	14018	-21	apt-get	08:40:12	0
13768	99	79	7,54	cyclictest	26021	-21	apt-get	10:45:12	0
13768	99	79	5,10	cyclictest	0	-21	swapper/0	09:34:57	0
13768	99	79	4,68	cyclictest	21586	-21	cstates	09:00:19	0
13768	99	79	3,69	cyclictest	19674	-21	aten2.4_r3power	08:55:16	0
13768	99	79	3,18	cyclictest	30525	-21	cron	12:30:00	0
13768	99	79	12,59	cyclictest	0	-21	swapper/0	10:25:14	0
13768	99	79	11,57	cyclictest	0	-21	swapper/0	11:05:12	0
13775	99	78	7,61	cyclictest	0	-21	swapper/1	11:15:13	1
13775	99	78	6,61	cyclictest	8157	-21	apt-get	09:55:13	1
13775	99	78	6,61	cyclictest	0	-21	swapper/1	11:30:15	1
13775	99	78	5,60	cyclictest	23710	-21	apt-get	12:10:13	1
13775	99	78	5,60	cyclictest	23710	-21	apt-get	12:10:13	1
13775	99	78	5,59	cyclictest	30314	-21	apt-get	07:55:13	1
13775	99	78	3,70	cyclictest	30355	-21	chrt	10:55:33	1
13775	99	78	23,45	cyclictest	31563	-21	apt-get	11:00:23	1
13768	99	78	7,56	cyclictest	21922	-21	apt-get	12:05:15	0
13768	99	78	4,67	cyclictest	3504	-21	/usr/sbin/munin	08:10:19	0
13768	99	78	11,56	cyclictest	0	-21	swapper/0	08:15:14	0
7382	2	77	0,5	sleep1	7384	-21	timerwakeupswit	09:50:34	1
13775	99	77	6,63	cyclictest	0	-21	swapper/1	08:55:12	1
13775	99	77	5,10	cyclictest	0	-21	swapper/1	10:25:24	1
13775	99	77	10,60	cyclictest	0	-21	swapper/1	10:40:12	1
13768	99	77	7,65	cyclictest	36	-21	kcompactd0	12:15:11	0
13768	99	77	24,48	cyclictest	243	-21	systemd-journal	11:28:28	0
13768	99	77	21,50	cyclictest	243	-21	systemd-journal	07:27:43	0
13768	99	77	11,57	cyclictest	0	-21	swapper/0	09:05:13	0
13768	99	77	11,54	cyclictest	0	-21	swapper/0	11:50:14	0
13768	99	77	11,54	cyclictest	0	-21	swapper/0	11:50:14	0
13768	99	77	10,55	cyclictest	0	-21	swapper/0	10:20:12	0
13768	99	77	10,53	cyclictest	23096	-21	sshd	07:35:11	0
13775	99	76	9,60	cyclictest	32556	-21	ntpq	09:30:31	1
13775	99	76	7,62	cyclictest	0	-21	swapper/1	07:30:13	1
13775	99	76	7,60	cyclictest	0	-21	swapper/1	11:40:12	1
13775	99	76	6,61	cyclictest	17797	-21	apt-get	08:50:22	1
13775	99	76	6,61	cyclictest	0	-21	swapper/1	10:00:11	1
13775	99	76	6,60	cyclictest	2667	-21	apt-get	11:10:12	1
13775	99	76	6,60	cyclictest	13860	-21	apt-get	07:10:12	1
13775	99	76	6,59	cyclictest	30077	-21	apt-get	09:25:13	1
13775	99	76	6,58	cyclictest	27210	-21	apt-get	12:20:09	1
13775	99	76	5,66	cyclictest	0	-21	swapper/1	11:55:01	1
13775	99	76	5,66	cyclictest	0	-21	swapper/1	11:55:01	1
13775	99	76	5,59	cyclictest	26832	-21	apt-get	07:45:13	1
13775	99	76	17,53	cyclictest	31848	-21	awk	12:30:39	1
13768	99	76	7,54	cyclictest	11955	-21	apt-get	10:05:22	0
13768	99	76	57,14	cyclictest	0	-21	swapper/0	07:20:11	0
13768	99	76	5,65	cyclictest	0	-21	swapper/0	11:45:18	0
13768	99	76	5,55	cyclictest	16119	-21	apt-get	07:15:14	0
13768	99	76	4,66	cyclictest	5257	-21	python3	11:15:34	0
13768	99	76	3,17	cyclictest	32268	-21	apt-get	12:35:14	0
13775	99	75	7,61	cyclictest	0	-21	swapper/1	10:45:13	1
13775	99	75	7,57	cyclictest	0	-21	swapper/1	09:15:14	1
13775	99	75	6,58	cyclictest	0	-21	swapper/1	07:15:14	1
13775	99	75	6,55	cyclictest	27765	-21	apt-get	10:50:11	1
13775	99	75	6,55	cyclictest	0	-21	swapper/1	10:20:13	1
13775	99	75	6,54	cyclictest	875	-21	apt-get	11:05:12	1
13768	99	75	7,52	cyclictest	6167	-21	apt-get	11:20:12	0
13768	99	75	6,51	cyclictest	21358	-21	apt-get	07:30:13	0
13775	99	74	7,59	cyclictest	0	-21	swapper/1	07:50:12	1
13775	99	74	7,54	cyclictest	0	-21	swapper/1	10:05:23	1
13775	99	74	6,61	cyclictest	0	-21	swapper/1	10:35:13	1
13775	99	74	6,60	cyclictest	0	-21	swapper/1	09:05:14	1
13775	99	74	6,60	cyclictest	0	-21	swapper/1	07:25:14	1
13775	99	74	6,59	cyclictest	0	-21	swapper/1	09:35:15	1
13775	99	74	6,58	cyclictest	6979	-21	apt-get	08:20:24	1
13775	99	74	6,58	cyclictest	6979	-21	apt-get	08:20:24	1
13775	99	74	6,57	cyclictest	18421	-21	apt-get	11:55:13	1
13775	99	74	5,55	cyclictest	1387	-21	apt-get	08:05:15	1
13775	99	74	5,52	cyclictest	4915	-21	apt-get	08:15:14	1
13775	99	74	2,66	cyclictest	26105	-21	cut	12:15:26	1
13775	99	74	2,13	cyclictest	4738	-21	latency_hist	08:15:01	1
13768	99	74	7,55	cyclictest	8723	-21	apt-get	08:25:14	0
13768	99	74	7,53	cyclictest	4679	-21	apt-get	09:45:14	0
13768	99	74	7,52	cyclictest	9913	-21	apt-get	10:00:11	0
13775	99	73	6,61	cyclictest	0	-21	swapper/1	11:25:14	1
13775	99	73	6,60	cyclictest	0	-21	swapper/1	09:00:12	1
13775	99	73	6,57	cyclictest	0	-21	swapper/1	12:05:15	1
13775	99	73	6,54	cyclictest	0	-21	swapper/1	08:25:14	1
13775	99	73	5,9	cyclictest	0	-21	swapper/1	07:39:14	1
13768	99	73	11,52	cyclictest	0	-21	swapper/0	10:35:12	0
13775	99	72	8,55	cyclictest	0	-21	swapper/1	12:35:23	1
13775	99	72	6,58	cyclictest	0	-21	swapper/1	11:20:12	1
13775	99	72	6,55	cyclictest	0	-21	swapper/1	10:15:14	1
13775	99	72	5,55	cyclictest	17878	-21	apt-get	07:20:12	1
13775	99	72	5,54	cyclictest	28339	-21	apt-get	09:20:14	1
13768	99	72	10,50	cyclictest	0	-21	swapper/0	09:40:14	0
13775	99	71	8,54	cyclictest	0	-21	swapper/1	08:00:13	1
13775	99	71	6,55	cyclictest	0	-21	swapper/1	09:45:14	1
13768	99	69	6,50	cyclictest	15492	-21	apt-get	10:15:14	0
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17