OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #6

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack3slot6.osadl.org (updated Mon Jul 06, 2026 00:45:04)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
10839	99	90	15,59	cyclictest	0	-21	swapper/1	19:20:12	1
10276	2	90	26,16	sleep1	0	-21	swapper/1	19:06:01	1
10254	2	89	25,53	sleep0	0	-21	swapper/0	19:05:45	0
10839	99	88	26,48	cyclictest	0	-21	swapper/1	20:20:15	1
10839	99	87	14,62	cyclictest	0	-21	swapper/1	22:00:16	1
10832	99	87	8,54	cyclictest	0	-21	swapper/0	20:45:13	0
10832	99	87	6,73	cyclictest	0	-21	swapper/0	21:35:13	0
10832	99	87	6,73	cyclictest	0	-21	swapper/0	20:10:13	0
10839	99	86	8,71	cyclictest	0	-21	swapper/1	20:15:15	1
10839	99	86	15,58	cyclictest	0	-21	swapper/1	23:50:11	1
10839	99	85	6,66	cyclictest	30173	-21	apt-get	23:05:12	1
10839	99	85	6,29	cyclictest	17301	-21	apt-get	22:30:12	1
10839	99	85	18,52	cyclictest	0	-21	swapper/1	22:25:13	1
10839	99	85	18,52	cyclictest	0	-21	swapper/1	22:25:13	1
10832	99	85	6,72	cyclictest	0	-21	swapper/0	20:30:14	0
10832	99	85	6,67	cyclictest	0	-21	swapper/0	23:05:12	0
10839	99	84	16,57	cyclictest	0	-21	swapper/1	21:15:13	1
10839	99	84	15,53	cyclictest	0	-21	swapper/1	23:55:13	1
10839	99	84	14,57	cyclictest	0	-21	swapper/1	23:20:15	1
10839	99	84	14,57	cyclictest	0	-21	swapper/1	23:20:15	1
10832	99	84	8,60	cyclictest	0	-21	swapper/0	20:35:14	0
10832	99	84	8,60	cyclictest	0	-21	swapper/0	20:35:14	0
10839	99	83	5,68	cyclictest	9075	-21	apt-get	20:35:14	1
10839	99	83	5,68	cyclictest	9075	-21	apt-get	20:35:14	1
10839	99	83	15,57	cyclictest	0	-21	swapper/1	19:10:11	1
10839	99	83	14,59	cyclictest	0	-21	swapper/1	19:35:14	1
10839	99	83	14,58	cyclictest	0	-21	swapper/1	00:25:15	1
10839	99	83	14,56	cyclictest	0	-21	swapper/1	20:05:14	1
10839	99	83	14,55	cyclictest	0	-21	swapper/1	22:10:14	1
10839	99	83	13,57	cyclictest	0	-21	swapper/1	21:40:14	1
10832	99	83	5,70	cyclictest	0	-21	swapper/0	23:25:14	0
10832	99	83	2,73	cyclictest	23509	-21	memory	00:15:25	0
10839	99	82	7,64	cyclictest	18169	-21	apt-get	21:00:14	1
10839	99	82	4,71	cyclictest	29479	-21	grep	21:30:32	1
10839	99	82	4,71	cyclictest	29479	-21	grep	21:30:32	1
10839	99	82	16,56	cyclictest	0	-21	swapper/1	21:55:13	1
10839	99	82	14,58	cyclictest	0	-21	swapper/1	19:30:24	1
10839	99	82	14,58	cyclictest	0	-21	swapper/1	00:20:13	1
10839	99	82	14,57	cyclictest	0	-21	swapper/1	22:45:25	1
10839	99	82	14,56	cyclictest	0	-21	swapper/1	21:25:13	1
10839	99	82	14,55	cyclictest	0	-21	swapper/1	19:15:13	1
10832	99	82	7,68	cyclictest	0	-21	swapper/0	20:15:12	0
10832	99	82	7,67	cyclictest	0	-21	swapper/0	23:45:12	0
10832	99	82	7,67	cyclictest	0	-21	swapper/0	20:00:13	0
10839	99	81	7,61	cyclictest	28191	-21	apt-get	00:30:14	1
10839	99	81	6,63	cyclictest	12415	-21	apt-get	23:45:12	1
10839	99	81	13,57	cyclictest	0	-21	swapper/1	23:40:24	1
10832	99	81	7,66	cyclictest	0	-21	swapper/0	22:40:15	0
10832	99	81	6,68	cyclictest	0	-21	swapper/0	21:50:14	0
10832	99	81	6,67	cyclictest	0	-21	swapper/0	19:40:15	0
10839	99	80	7,57	cyclictest	17687	-21	apt-get	00:00:12	1
10839	99	80	7,56	cyclictest	16673	-21	apt-get	19:25:12	1
10839	99	80	6,69	cyclictest	0	-21	swapper/1	20:55:35	1
10839	99	80	6,68	cyclictest	0	-21	swapper/1	21:40:02	1
10839	99	80	6,60	cyclictest	28433	-21	apt-get	23:00:13	1
10839	99	80	6,18	cyclictest	21700	-21	apt-get	21:10:13	1
10839	99	80	15,54	cyclictest	0	-21	swapper/1	21:05:13	1
10839	99	80	15,54	cyclictest	0	-21	swapper/1	21:05:13	1
10839	99	80	15,51	cyclictest	0	-21	swapper/1	20:40:22	1
10839	99	80	14,54	cyclictest	0	-21	swapper/1	23:15:22	1
10832	99	80	7,68	cyclictest	0	-21	swapper/0	22:05:17	0
10832	99	80	7,66	cyclictest	0	-21	swapper/0	22:55:12	0
10832	99	80	7,65	cyclictest	0	-21	swapper/0	22:50:16	0
10832	99	80	6,67	cyclictest	0	-21	swapper/0	21:40:15	0
10832	99	80	6,67	cyclictest	0	-21	swapper/0	20:40:23	0
10832	99	80	6,67	cyclictest	0	-21	swapper/0	20:25:12	0
10832	99	80	6,66	cyclictest	0	-21	swapper/0	21:45:13	0
10832	99	80	6,64	cyclictest	0	-21	swapper/0	21:20:14	0
10832	99	80	6,62	cyclictest	0	-21	swapper/0	00:30:14	0
10832	99	80	6,58	cyclictest	6792	-21	apt-get	22:00:16	0
10832	99	80	5,68	cyclictest	0	-21	swapper/0	19:45:11	0
10832	99	80	2,72	cyclictest	19458	-21	ntp_states	19:30:39	0
10839	99	79	7,57	cyclictest	7333	-21	apt-get	20:30:13	1
10839	99	79	7,57	cyclictest	12060	-21	apt-get	22:15:13	1
10839	99	79	14,52	cyclictest	0	-21	swapper/1	00:15:13	1
10832	99	79	7,65	cyclictest	0	-21	swapper/0	20:50:15	0
10832	99	79	7,59	cyclictest	0	-21	swapper/0	22:15:13	0
10832	99	79	6,66	cyclictest	0	-21	swapper/0	23:30:14	0
10832	99	79	6,66	cyclictest	0	-21	swapper/0	00:35:15	0
10832	99	79	6,65	cyclictest	0	-21	swapper/0	22:35:22	0
10832	99	79	6,61	cyclictest	0	-21	swapper/0	23:00:13	0
10839	99	78	7,55	cyclictest	13823	-21	apt-get	22:20:13	1
10839	99	78	6,62	cyclictest	5594	-21	apt-get	20:25:14	1
10839	99	78	6,62	cyclictest	24937	-21	apt-get	22:50:14	1
10839	99	78	15,56	cyclictest	417	-21	aten2.4_r3power	20:10:18	1
10839	99	78	10,54	cyclictest	19430	-21	apt-get	00:05:13	1
10832	99	78	7,63	cyclictest	0	-21	swapper/0	22:30:12	0
10832	99	78	7,62	cyclictest	0	-21	swapper/0	22:20:15	0
10832	99	78	7,59	cyclictest	13173	-21	apt-get	19:15:13	0
10832	99	78	6,64	cyclictest	0	-21	swapper/0	23:15:21	0
10832	99	78	6,64	cyclictest	0	-21	swapper/0	23:10:13	0
10832	99	78	6,64	cyclictest	0	-21	swapper/0	19:50:13	0
10839	99	77	8,54	cyclictest	6816	-21	apt-get	23:30:13	1
10832	99	77	6,65	cyclictest	0	-21	swapper/0	00:10:13	0
10832	99	77	6,64	cyclictest	0	-21	swapper/0	20:55:11	0
10832	99	77	6,62	cyclictest	0	-21	swapper/0	21:05:12	0
10832	99	77	6,62	cyclictest	0	-21	swapper/0	21:05:12	0
10832	99	77	6,60	cyclictest	14936	-21	apt-get	19:20:12	0
10832	99	77	6,60	cyclictest	0	-21	swapper/0	21:00:14	0
10832	99	77	6,59	cyclictest	0	-21	swapper/0	00:00:14	0
10832	99	77	6,55	cyclictest	10671	-21	apt-get	23:40:23	0
10839	99	76	9,61	cyclictest	0	-21	swapper/1	19:55:20	1
10839	99	76	7,58	cyclictest	12931	-21	apt-get	20:45:14	1
10839	99	76	7,54	cyclictest	5078	-21	apt-get	23:25:14	1
10839	99	76	7,54	cyclictest	31966	-21	apt-get	23:10:14	1
10839	99	76	7,53	cyclictest	8533	-21	apt-get	22:05:15	1
10839	99	76	6,17	cyclictest	19338	-21	apt-get	22:35:24	1
10839	99	76	5,66	cyclictest	0	-21	swapper/1	22:55:27	1
10832	99	76	6,61	cyclictest	0	-21	swapper/0	19:55:13	0
10832	99	76	6,61	cyclictest	0	-21	swapper/0	19:25:12	0
10832	99	76	6,58	cyclictest	3342	-21	apt-get	23:20:15	0
10832	99	76	6,58	cyclictest	3342	-21	apt-get	23:20:15	0
10832	99	76	6,58	cyclictest	30989	-21	apt-get	20:05:14	0
10832	99	76	6,58	cyclictest	26455	-21	apt-get	00:25:14	0
10832	99	76	6,54	cyclictest	23439	-21	apt-get	21:15:13	0
10832	99	76	25,44	cyclictest	20566	-21	users	00:05:38	0
10839	99	75	9,51	cyclictest	8556	-21	apt-get	23:35:13	1
10839	99	75	7,54	cyclictest	29932	-21	apt-get	00:35:14	1
10839	99	75	7,54	cyclictest	21219	-21	apt-get	00:10:14	1
10839	99	75	6,63	cyclictest	0	-21	swapper/1	20:50:27	1
10832	99	75	6,61	cyclictest	0	-21	swapper/0	21:25:14	0
10832	99	75	6,58	cyclictest	10916	-21	apt-get	19:10:11	0
10832	99	75	6,56	cyclictest	10316	-21	apt-get	22:10:14	0
10832	99	75	6,54	cyclictest	24717	-21	apt-get	00:20:13	0
10839	99	74	7,55	cyclictest	21157	-21	apt-get	22:40:13	1
10839	99	74	7,18	cyclictest	25209	-21	apt-get	21:20:14	1
10839	99	74	5,63	cyclictest	0	-21	swapper/1	21:50:25	1
10839	99	74	3,65	cyclictest	25874	-21	aten2.4_r3power	19:50:17	1
10832	99	74	7,54	cyclictest	14152	-21	apt-get	23:50:11	0
10832	99	74	17,51	cyclictest	243	-21	systemd-journal	20:21:43	0
10839	99	73	6,23	cyclictest	29251	-21	apt-get	20:00:13	1
10839	99	73	6,20	cyclictest	22271	-21	apt-get	19:40:15	1
10832	99	73	6,58	cyclictest	0	-21	swapper/0	21:10:11	0
10832	99	73	6,55	cyclictest	20461	-21	apt-get	19:35:14	0
10832	99	73	6,53	cyclictest	28687	-21	apt-get	21:30:13	0
10832	99	73	6,53	cyclictest	28687	-21	apt-get	21:30:13	0
10839	99	72	7,50	cyclictest	1551	-21	apt-get	21:45:14	1
10839	99	72	7,49	cyclictest	24002	-21	apt-get	19:45:11	1
10832	99	72	7,57	cyclictest	0	-21	swapper/0	23:35:14	0
10832	99	72	6,54	cyclictest	15566	-21	apt-get	22:25:15	0
10832	99	72	6,54	cyclictest	15566	-21	apt-get	22:25:15	0
10832	99	72	5,52	cyclictest	23193	-21	apt-get	22:45:23	0
10832	99	71	6,60	cyclictest	0	-21	swapper/0	23:55:11	0
10832	99	69	4,52	cyclictest	5027	-21	apt-get	21:55:13	0
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17