OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #5, slot #0

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack5slot0.osadl.org (updated Mon Dec 08, 2025 00:44:44)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
13078	2	150	0,0	sleep2	0	-21	swapper/2	22:54:14	2
17995	2	138	0,1	sleep3	0	-21	swapper/3	23:31:27	3
7539	2	125	0,2	sleep1	10184	99	cyclictest	22:44:31	1
7568	2	116	0,4	sleep3	10188	99	cyclictest	22:17:07	3
8756	2	115	0,2	sleep2	0	-21	swapper/2	00:01:20	2
2436	2	111	0,2	sleep3	0	-21	swapper/3	23:11:38	3
22326	2	108	0,1	sleep3	1845	-21	nfsd	23:59:37	3
4747	2	101	0,1	sleep1	10184	99	cyclictest	23:45:24	1
5052	2	100	0,2	sleep0	10179	99	cyclictest	23:05:43	0
5052	2	100	0,2	sleep0	10179	99	cyclictest	23:05:42	0
15923	2	95	0,1	sleep0	10179	99	cyclictest	23:52:45	0
25393	2	94	0,2	sleep2	2405	-21	runrttasks	23:32:09	2
9819	2	92	33,47	sleep1	0	-21	swapper/1	19:08:36	1
30448	2	89	0,3	sleep2	10187	99	cyclictest	22:25:20	2
27578	2	88	0,3	sleep3	27567	-21	sshd	22:40:16	3
26991	2	88	0,3	sleep0	10179	99	cyclictest	22:00:42	0
14690	2	88	0,3	sleep3	14691	-21	sshd	00:01:58	3
12899	2	88	0,4	sleep2	10187	99	cyclictest	23:03:28	2
9762	2	87	33,50	sleep3	0	-21	swapper/3	19:07:54	3
13112	2	87	0,2	sleep3	0	-21	swapper/3	23:40:08	3
20868	2	86	0,1	sleep0	20861	-21	sshd	23:40:45	0
3605	2	84	0,2	sleep3	0	-21	swapper/3	00:31:07	3
28543	2	83	0,3	sleep3	10188	99	cyclictest	22:37:20	3
9197	2	82	0,2	sleep3	9194	-21	sshd	23:18:28	3
32478	2	82	0,2	sleep2	0	-21	swapper/2	22:19:32	2
24137	2	82	0,2	sleep3	24138	-21	sshd	23:01:25	3
21890	2	82	0,2	sleep2	0	-21	swapper/2	22:45:45	2
15794	2	82	0,2	sleep3	15792	-21	sshd	21:23:33	3
15794	2	82	0,2	sleep3	15792	-21	sshd	21:23:33	3
21025	2	79	0,0	sleep0	0	-21	swapper/0	22:06:15	0
12903	2	79	0,1	sleep1	12888	-21	sshd	23:25:00	1
26716	2	78	0,1	sleep3	0	-21	swapper/3	22:28:01	3
1391	2	78	0,2	sleep3	0	-21	swapper/3	21:43:18	3
13724	2	77	0,3	sleep1	0	-21	swapper/1	22:14:45	1
20145	2	76	0,2	sleep3	0	-21	swapper/3	23:22:32	3
7778	2	75	0,2	sleep3	0	-21	swapper/3	22:50:30	3
27001	2	69	0,1	sleep1	0	-21	swapper/1	21:12:28	1
11922	2	67	0,0	sleep0	0	-21	swapper/0	00:28:44	0
5495	2	61	0,2	sleep1	0	-21	swapper/1	00:17:51	1
26957	2	59	0,0	sleep1	1848	-21	nfsd	23:29:21	1
28494	2	57	0,1	sleep2	0	-21	swapper/2	23:26:20	2
9734	2	56	31,22	sleep0	0	-21	swapper/0	19:07:31	0
19089	2	56	0,2	sleep2	19076	-21	sshd	21:11:41	2
2491	2	53	0,3	sleep3	2382	-21	sshd	23:48:22	3
9594	2	50	34,11	sleep2	0	-21	swapper/2	19:06:06	2
21171	2	46	0,44	sleep1	1356	50	irq/27-eth0	23:44:01	1
10188	99	37	26,7	cyclictest	1959	-21	sshd	23:37:11	3
10188	99	36	28,5	cyclictest	13618	-21	id	22:20:39	3
10188	99	35	28,5	cyclictest	0	-21	swapper/3	22:59:07	3
10188	99	35	25,6	cyclictest	0	-21	swapper/3	23:50:24	3
10188	99	35	25,5	cyclictest	1848	-21	nfsd	23:08:01	3
10188	99	35	25,5	cyclictest	1848	-21	nfsd	23:08:01	3
10188	99	35	24,7	cyclictest	0	-21	swapper/3	00:15:46	3
16600	2	34	0,3	sleep2	0	-21	swapper/2	22:36:11	2
10188	99	34	28,4	cyclictest	1848	-21	nfsd	22:49:09	3
10188	99	34	26,5	cyclictest	360	-21	sshd	23:29:55	3
10188	99	34	20,9	cyclictest	15241	-21	sshd	22:33:02	3
10187	99	34	29,4	cyclictest	1847	-21	nfsd	00:24:26	2
10188	99	33	23,6	cyclictest	11072	-21	sshd	00:35:25	3
10188	99	33	23,6	cyclictest	0	-21	swapper/3	00:10:14	3
10188	99	32	26,3	cyclictest	16489	-21	sshd	21:29:37	3
10188	99	32	26,3	cyclictest	0	-21	swapper/3	00:05:45	3
10188	99	32	25,5	cyclictest	4667	-21	sshd	00:24:42	3
10188	99	32	21,6	cyclictest	1847	-21	nfsd	00:27:27	3
10188	99	31	25,4	cyclictest	27354	-21	id	22:03:52	3
27861	2	28	0,1	sleep0	27862	-21	bash	22:34:17	0
27706	2	28	0,5	sleep1	0	-21	swapper/1	23:35:21	1
11957	2	28	0,2	sleep2	47	-21	rcuop/3	23:58:35	2
10188	99	28	24,3	cyclictest	9579	-21	sshd	21:50:07	3
10188	99	28	21,4	cyclictest	0	-21	swapper/3	22:08:39	3
10184	99	28	15,5	cyclictest	31922	-21	sshd	00:30:39	1
10188	99	27	19,4	cyclictest	22662	-21	sshd	21:45:15	3
10188	99	27	11,8	cyclictest	31677	-21	sshd	21:30:55	3
10187	99	27	8,9	cyclictest	5010	-21	sshd	23:21:03	2
2164	2	26	0,1	sleep2	0	-21	swapper/2	21:37:18	2
14689	2	26	0,3	sleep1	10184	99	cyclictest	20:30:13	1
10184	99	26	12,6	cyclictest	5966	-21	bash	23:51:45	1
10188	99	25	5,6	cyclictest	3557	-21	sshd	21:19:26	3
10184	99	25	4,19	cyclictest	22	-21	ksoftirqd/1	22:50:13	1
10184	99	25	12,4	cyclictest	1845	-21	nfsd	23:33:55	1
10179	99	25	0,20	cyclictest	31070	-21	sshd	00:13:36	0
20690	2	24	0,2	sleep1	20667	-21	sshd	00:02:35	1
19100	2	24	0,2	sleep1	0	-21	swapper/1	22:18:13	1
10188	99	24	4,8	cyclictest	1356	50	irq/27-eth0	21:37:36	3
10188	99	24	19,3	cyclictest	0	-21	swapper/3	22:10:04	3
10184	99	24	17,4	cyclictest	19767	-21	sshd	22:57:58	1
10184	99	24	0,21	cyclictest	22	-21	ksoftirqd/1	22:24:21	1
10179	99	24	14,8	cyclictest	3	-21	ksoftirqd/0	23:21:03	0
10179	99	24	13,4	cyclictest	3	-21	ksoftirqd/0	22:35:20	0
25869	2	23	0,2	sleep2	0	-21	swapper/2	22:00:35	2
20789	2	23	0,0	sleep0	4	1	ktimersoftd/0	23:46:58	0
10188	99	23	5,13	cyclictest	15553	-21	grep	19:20:17	3
10188	99	23	13,9	cyclictest	17686	-21	sshd	21:14:43	3
10184	99	23	9,3	cyclictest	1125	-21	sshd	23:57:31	1
10184	99	23	9,12	cyclictest	22	-21	ksoftirqd/1	00:05:46	1
10184	99	23	1,20	cyclictest	22	-21	ksoftirqd/1	22:36:40	1
10188	99	22	3,8	cyclictest	20601	-21	sshd	21:57:08	3
10188	99	22	10,8	cyclictest	28993	-21	nfsd4	21:00:19	3
10184	99	22	14,6	cyclictest	0	-21	swapper/1	21:51:14	1
10184	99	22	14,5	cyclictest	24642	-21	rm	23:01:28	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17