OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #6

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack3slot6.osadl.org (updated Sat May 02, 2026 00:45:01)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
16261	2	97	18,33	sleep1	0	-21	swapper/1	19:09:56	1
16424	99	96	12,68	cyclictest	0	-21	swapper/1	19:40:12	1
16424	99	89	16,63	cyclictest	0	-21	swapper/1	21:15:13	1
16414	99	89	5,71	cyclictest	27839	-21	apt-get	19:40:12	0
16424	99	88	15,65	cyclictest	0	-21	swapper/1	21:20:12	1
16424	99	88	15,57	cyclictest	0	-21	swapper/1	21:05:13	1
16414	99	88	34,48	cyclictest	3719	-21	apt-get	00:35:19	0
16424	99	87	6,67	cyclictest	4515	-21	apt-get	21:35:11	1
16424	99	87	6,67	cyclictest	4515	-21	apt-get	21:35:10	1
16424	99	87	18,61	cyclictest	0	-21	swapper/1	23:05:11	1
16424	99	87	18,53	cyclictest	0	-21	swapper/1	22:45:10	1
16424	99	87	16,61	cyclictest	0	-21	swapper/1	23:40:13	1
16414	99	87	5,52	cyclictest	0	-21	swapper/0	22:05:30	0
16424	99	86	6,65	cyclictest	7492	-21	apt-get	23:15:12	1
16424	99	86	14,58	cyclictest	0	-21	swapper/1	23:00:16	1
16424	99	85	8,63	cyclictest	1031	-21	apt-get	21:25:13	1
16424	99	85	30,45	cyclictest	11366	-21	cron	21:55:00	1
16424	99	85	15,60	cyclictest	0	-21	swapper/1	20:35:12	1
16414	99	85	30,48	cyclictest	9825	-21	cron	20:20:01	0
16424	99	84	7,67	cyclictest	31148	-21	apt-get	22:50:11	1
16424	99	84	7,61	cyclictest	10021	-21	apt-get	20:20:12	1
16424	99	84	6,64	cyclictest	15043	-21	apt-get	22:05:13	1
16424	99	84	18,55	cyclictest	0	-21	swapper/1	21:00:14	1
16424	99	84	14,60	cyclictest	0	-21	swapper/1	23:55:13	1
16414	99	84	29,49	cyclictest	457	-21	dbus-daemon	21:20:00	0
16424	99	83	9,69	cyclictest	0	-21	swapper/1	22:20:33	1
16424	99	83	6,65	cyclictest	12733	-21	apt-get	23:30:11	1
16424	99	83	16,59	cyclictest	0	-21	swapper/1	22:35:13	1
16424	99	83	15,57	cyclictest	0	-21	swapper/1	00:15:13	1
16424	99	83	14,62	cyclictest	0	-21	swapper/1	19:35:13	1
16424	99	83	14,59	cyclictest	0	-21	swapper/1	20:15:12	1
16424	99	83	13,63	cyclictest	0	-21	swapper/1	20:58:42	1
16414	99	83	31,46	cyclictest	26028	-21	apt-get	19:35:14	0
16424	99	82	6,62	cyclictest	16490	-21	apt-get	19:10:13	1
16424	99	82	6,61	cyclictest	9256	-21	apt-get	23:20:15	1
16424	99	82	6,60	cyclictest	2776	-21	apt-get	21:30:13	1
16424	99	82	6,59	cyclictest	19100	-21	apt-get	20:45:14	1
16424	99	82	15,58	cyclictest	0	-21	swapper/1	22:55:16	1
16424	99	82	15,54	cyclictest	0	-21	swapper/1	22:10:15	1
16424	99	82	14,59	cyclictest	0	-21	swapper/1	19:55:12	1
16424	99	81	6,66	cyclictest	22550	-21	apt-get	19:25:12	1
16424	99	81	6,66	cyclictest	22550	-21	apt-get	19:25:12	1
16424	99	81	6,65	cyclictest	19767	-21	apt-get	23:50:11	1
16424	99	81	6,63	cyclictest	4734	-21	apt-get	20:05:12	1
16424	99	81	6,59	cyclictest	23300	-21	apt-get	00:00:13	1
16424	99	81	6,58	cyclictest	24122	-21	apt-get	22:30:12	1
16424	99	81	15,58	cyclictest	0	-21	swapper/1	20:30:14	1
16424	99	81	14,59	cyclictest	0	-21	swapper/1	00:30:13	1
16424	99	81	13,59	cyclictest	0	-21	swapper/1	21:40:12	1
16424	99	81	12,60	cyclictest	0	-21	swapper/1	22:15:11	1
16424	99	80	7,58	cyclictest	17370	-21	apt-get	20:40:19	1
16424	99	80	6,58	cyclictest	30632	-21	apt-get	00:20:14	1
16424	99	80	16,56	cyclictest	0	-21	swapper/1	23:10:13	1
16424	99	80	16,56	cyclictest	0	-21	swapper/1	22:00:11	1
16424	99	80	14,60	cyclictest	0	-21	swapper/1	00:35:24	1
16424	99	80	13,60	cyclictest	0	-21	swapper/1	21:10:26	1
16424	99	80	12,60	cyclictest	0	-21	swapper/1	23:35:14	1
16424	99	79	7,61	cyclictest	2996	-21	apt-get	20:00:15	1
16424	99	79	7,58	cyclictest	27673	-21	apt-get	22:40:12	1
16424	99	79	7,55	cyclictest	8064	-21	apt-get	21:45:12	1
16424	99	79	5,63	cyclictest	20808	-21	apt-get	19:20:10	1
16424	99	79	5,58	cyclictest	24289	-21	apt-get	19:30:13	1
16414	99	79	5,62	cyclictest	2230	-21	apt-get	23:00:16	0
16414	99	79	5,59	cyclictest	16287	-21	apt-get	23:40:13	0
14667	2	79	29,37	sleep0	0	-21	swapper/0	19:05:13	0
16424	99	78	7,61	cyclictest	18030	-21	apt-get	23:45:12	1
16424	99	78	3,66	cyclictest	29995	-21	basename	19:45:24	1
16424	99	78	15,56	cyclictest	0	-21	swapper/1	19:15:26	1
16424	99	78	14,57	cyclictest	0	-21	swapper/1	19:50:22	1
16424	99	78	13,57	cyclictest	0	-21	swapper/1	00:25:12	1
16414	99	78	6,57	cyclictest	21508	-21	apt-get	23:55:13	0
16424	99	77	7,54	cyclictest	20833	-21	apt-get	20:50:10	1
16424	99	77	6,57	cyclictest	27130	-21	apt-get	00:10:13	1
16424	99	77	4,65	cyclictest	11087	-21	aten2.4_r3power	23:25:17	1
16424	99	77	16,54	cyclictest	0	-21	swapper/1	20:10:11	1
16424	99	77	16,54	cyclictest	0	-21	swapper/1	00:05:20	1
16414	99	77	24,46	cyclictest	7840	-21	entropy	23:15:22	0
16414	99	76	5,56	cyclictest	1228	-21	apt-get	19:55:12	0
16424	99	75	7,55	cyclictest	11543	-21	apt-get	21:55:12	1
16424	99	75	7,54	cyclictest	22383	-21	apt-get	22:25:12	1
16424	99	75	3,64	cyclictest	12552	-21	kernelversion	20:25:35	1
16424	99	75	3,64	cyclictest	12552	-21	kernelversion	20:25:35	1
16414	99	75	5,55	cyclictest	28870	-21	apt-get	00:15:13	0
16414	99	74	7,51	cyclictest	16842	-21	apt-get	22:10:13	0
16414	99	74	5,59	cyclictest	26126	-21	apt-get	21:05:13	0
16414	99	74	29,39	cyclictest	21006	-21	diskstats	22:20:31	0
16414	99	73	6,58	cyclictest	31718	-21	apt-get	21:20:11	0
16414	99	73	6,51	cyclictest	3963	-21	apt-get	23:05:11	0
16414	99	73	5,57	cyclictest	29410	-21	apt-get	22:45:10	0
16414	99	73	5,51	cyclictest	25862	-21	apt-get	22:35:13	0
16414	99	73	5,51	cyclictest	13305	-21	apt-get	22:00:12	0
16414	99	73	5,50	cyclictest	22574	-21	apt-get	20:55:15	0
16414	99	73	22,45	cyclictest	6402	-21	strings	23:10:26	0
16414	99	73	11,55	cyclictest	0	-21	swapper/0	00:05:19	0
16414	99	72	5,57	cyclictest	32368	-21	apt-get	00:25:12	0
16414	99	72	5,56	cyclictest	426	-21	apt-get	22:55:13	0
16414	99	72	5,53	cyclictest	15542	-21	apt-get	20:35:12	0
16414	99	71	6,54	cyclictest	22550	-21	apt-get	19:25:11	0
16414	99	71	6,54	cyclictest	22550	-21	apt-get	19:25:11	0
16414	99	71	6,53	cyclictest	0	-21	swapper/0	21:35:11	0
16414	99	71	6,53	cyclictest	0	-21	swapper/0	21:35:11	0
16414	99	71	6,49	cyclictest	12733	-21	apt-get	23:30:12	0
16414	99	70	5,56	cyclictest	0	-21	swapper/0	20:25:23	0
16414	99	70	5,56	cyclictest	0	-21	swapper/0	20:25:23	0
16414	99	70	5,52	cyclictest	24387	-21	apt-get	21:00:14	0
16414	99	70	24,41	cyclictest	6523	-21	apt-get	20:10:12	0
16414	99	70	10,53	cyclictest	0	-21	swapper/0	21:55:11	0
16414	99	69	6,47	cyclictest	13804	-21	apt-get	20:30:12	0
16414	99	69	5,49	cyclictest	6327	-21	apt-get	21:40:12	0
16414	99	69	5,48	cyclictest	19048	-21	apt-get	19:15:25	0
16414	99	69	3,37	cyclictest	23109	-21	ntp_states	22:25:29	0
16414	99	68	7,46	cyclictest	0	-21	swapper/0	22:50:11	0
16414	99	68	6,53	cyclictest	0	-21	swapper/0	20:50:10	0
16414	99	68	5,48	cyclictest	1682	-21	apt-get	00:30:13	0
16414	99	68	5,46	cyclictest	18577	-21	apt-get	22:15:13	0
16414	99	68	4,35	cyclictest	0	-21	swapper/0	20:22:45	0
16414	99	68	3,12	cyclictest	28001	-21	df	22:40:18	0
16414	99	68	24,38	cyclictest	20009	-21	find	20:45:35	0
16414	99	68	23,38	cyclictest	27970	-21	sensors_fan	00:10:32	0
16414	99	68	12,47	cyclictest	0	-21	swapper/0	20:40:19	0
16414	99	67	5,48	cyclictest	28218	-21	apt-get	21:10:26	0
16414	99	67	4,35	cyclictest	0	-21	swapper/0	00:24:14	0
16414	99	67	3,59	cyclictest	24852	-21	runrttasks	00:04:56	0
16414	99	67	3,46	cyclictest	5868	-21	users	20:05:37	0
16414	99	67	3,30	cyclictest	31916	-21	apt-get	19:50:16	0
16414	99	67	22,24	cyclictest	457	-21	dbus-daemon	19:15:01	0
16414	99	66	7,51	cyclictest	0	-21	swapper/0	23:35:11	0
16414	99	66	3,57	cyclictest	24119	-21	/usr/sbin/munin	22:30:20	0
16414	99	66	2,59	cyclictest	20500	-21	ntp_states	23:50:29	0
16414	99	66	2,57	cyclictest	29410	-21	apt-get	19:45:13	0
16414	99	65	40,18	cyclictest	14	-21	ksoftirqd/0	19:20:10	0
16414	99	64	9,47	cyclictest	0	-21	swapper/0	21:30:13	0
16414	99	64	6,49	cyclictest	0	-21	swapper/0	21:25:13	0
16414	99	64	5,51	cyclictest	0	-21	swapper/0	19:30:12	0
16414	99	63	6,45	cyclictest	0	-21	swapper/0	21:50:11	0
16414	99	62	20,37	cyclictest	3279	-21	cstates	20:00:19	0
16414	99	61	6,44	cyclictest	0	-21	swapper/0	23:20:15	0
16414	99	61	5,48	cyclictest	0	-21	swapper/0	23:45:13	0
16414	99	61	16,39	cyclictest	12571	-21	idleruntime-cro	23:30:00	0
16414	99	61	10,45	cyclictest	243	-21	systemd-journal	21:46:31	0
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17