OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #5, slot #0

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack5slot0.osadl.org (updated Sat Dec 06, 2025 00:44:44)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
6041	2	168	0,1	sleep3	0	-21	swapper/3	21:43:24	3
29691	2	135	0,1	sleep3	29690	-21	sshd	22:09:42	3
28488	2	135	0,4	sleep1	12051	99	cyclictest	22:49:57	1
5580	2	129	0,4	sleep1	12051	99	cyclictest	21:16:21	1
28984	2	127	0,3	sleep1	12051	99	cyclictest	00:02:47	1
21524	2	123	0,2	sleep1	0	-21	swapper/1	21:56:49	1
14649	2	117	0,0	sleep2	14648	-21	sshd	00:17:35	2
18029	2	114	0,2	sleep3	12062	99	cyclictest	22:51:58	3
26845	2	111	0,0	sleep0	0	-21	swapper/0	21:57:20	0
28720	2	109	0,4	sleep1	12051	99	cyclictest	22:03:35	1
31574	2	106	0,1	sleep3	31565	-21	sshd	23:47:13	3
23421	2	105	0,1	sleep1	0	-21	swapper/1	23:36:57	1
11789	2	104	0,1	sleep0	8	-21	rcu_preempt	23:20:05	0
5547	2	101	0,0	sleep0	0	-21	swapper/0	23:29:00	0
17579	2	98	0,2	sleep2	17575	-21	bash	23:36:22	2
5671	2	93	0,1	sleep2	0	-21	swapper/2	21:49:25	2
6973	2	90	0,2	sleep1	6967	-21	users	22:35:25	1
30763	2	89	0,1	sleep3	1847	-21	nfsd	21:21:40	3
897	2	88	0,6	sleep3	0	-21	swapper/3	21:48:58	3
465	2	88	0,1	sleep2	0	-21	swapper/2	23:28:29	2
30494	2	88	0,4	sleep2	30491	-21	cp	21:15:38	2
29220	2	88	0,0	sleep0	0	-21	swapper/0	21:27:34	0
26057	2	87	0,4	sleep0	12045	99	cyclictest	22:59:10	0
6568	2	86	0,1	sleep3	0	-21	swapper/3	21:52:26	3
31839	2	86	0,1	sleep2	0	-21	swapper/2	21:39:51	2
29608	2	86	0,1	sleep3	29573	-21	sshd	23:25:01	3
11590	2	85	34,38	sleep3	0	-21	swapper/3	19:07:08	3
11509	2	83	33,45	sleep1	0	-21	swapper/1	19:06:06	1
4914	2	80	0,1	sleep0	4916	-21	sshd	23:38:21	0
31520	2	80	0,1	sleep1	0	-21	swapper/1	00:29:40	1
30966	2	79	0,2	sleep3	30961	-21	sshd	23:37:44	3
17733	2	79	0,1	sleep1	0	-21	swapper/1	23:14:21	1
26666	2	78	0,1	sleep3	44	-21	ksoftirqd/3	22:21:36	3
25604	2	77	0,2	sleep1	25605	-21	sshd	21:21:10	1
32204	2	75	0,3	sleep1	0	-21	swapper/1	22:56:29	1
2762	2	75	0,0	sleep0	0	-21	swapper/0	22:38:13	0
3465	2	74	0,2	sleep0	0	-21	swapper/0	23:19:17	0
13179	2	74	0,1	sleep3	13181	-21	id	21:59:08	3
15099	2	73	0,2	sleep2	15098	-21	bash	00:14:27	2
11768	2	73	34,9	sleep2	0	-21	swapper/2	19:09:24	2
13659	2	72	0,2	sleep3	0	-21	swapper/3	23:23:25	3
3523	2	71	0,1	sleep1	0	-21	swapper/1	23:44:39	1
32474	2	71	0,2	sleep2	12057	99	cyclictest	23:09:26	2
30862	2	69	0,2	sleep2	0	-21	swapper/2	21:00:19	2
30862	2	69	0,2	sleep2	0	-21	swapper/2	21:00:19	2
18119	2	69	0,1	sleep1	0	-21	swapper/1	22:11:32	1
12043	2	68	0,2	sleep2	0	-21	swapper/2	22:01:59	2
15728	2	67	0,1	sleep1	12051	99	cyclictest	23:48:52	1
5881	2	65	0,4	sleep3	12062	99	cyclictest	22:44:41	3
28280	2	62	0,2	sleep3	0	-21	swapper/3	23:50:06	3
27624	2	61	0,4	sleep2	1848	-21	nfsd	21:51:21	2
11636	2	57	32,13	sleep0	0	-21	swapper/0	19:07:41	0
32455	2	49	0,1	sleep1	0	-21	swapper/1	23:06:11	1
31897	2	49	0,0	sleep2	31899	-21	id	23:31:29	2
5085	2	40	0,38	sleep1	269	50	irq/26-ahci[000	23:54:11	1
12045	99	40	33,5	cyclictest	28445	-21	sshd	23:40:34	0
12045	99	39	31,6	cyclictest	30774	-21	sshd	00:33:09	0
12045	99	39	31,6	cyclictest	30774	-21	sshd	00:33:09	0
12045	99	38	13,22	cyclictest	3	-21	ksoftirqd/0	23:06:46	0
12057	99	37	23,8	cyclictest	2065	-21	id	23:03:16	2
12057	99	36	31,3	cyclictest	11579	-21	sshd	00:04:18	2
12057	99	36	29,5	cyclictest	20777	-21	bash	22:42:58	2
12057	99	36	29,5	cyclictest	20091	-21	sshd	00:24:48	2
12057	99	35	20,13	cyclictest	0	-21	swapper/2	23:22:27	2
12045	99	35	11,16	cyclictest	3	-21	ksoftirqd/0	23:57:55	0
12057	99	34	28,3	cyclictest	12893	-21	sshd	22:39:13	2
12057	99	34	27,4	cyclictest	583	-21	sshd	22:19:09	2
12057	99	34	26,4	cyclictest	2929	-21	sshd	22:56:49	2
12057	99	33	26,4	cyclictest	19544	-21	bash	21:26:38	2
12057	99	33	25,4	cyclictest	7213	-21	sshd	22:07:34	2
12057	99	33	23,7	cyclictest	16783	-21	bash	23:42:45	2
12045	99	33	15,4	cyclictest	3	-21	ksoftirqd/0	22:25:03	0
12045	99	33	1,27	cyclictest	0	-21	swapper/0	21:54:46	0
12057	99	32	28,2	cyclictest	11064	-21	sshd	22:29:37	2
12057	99	32	27,3	cyclictest	6279	-21	sshd	21:55:22	2
12057	99	32	25,4	cyclictest	8312	-21	sshd	22:50:59	2
12057	99	32	25,4	cyclictest	2715	-21	sshd	00:26:15	2
12057	99	32	25,4	cyclictest	21813	-21	sshd	23:58:57	2
12057	99	32	25,4	cyclictest	10056	-21	diskstats	23:45:14	2
12057	99	32	24,4	cyclictest	31391	-21	sshd	22:12:48	2
12057	99	32	23,4	cyclictest	8310	-21	bash	21:34:40	2
12045	99	32	13,13	cyclictest	3	-21	ksoftirqd/0	21:35:48	0
12057	99	31	4,5	cyclictest	5221	-21	sshd	21:43:21	2
12057	99	31	26,3	cyclictest	17465	-21	sshd	21:11:22	2
12057	99	31	25,4	cyclictest	8857	-21	sshd	00:30:34	2
12057	99	31	25,4	cyclictest	8857	-21	sshd	00:30:34	2
12057	99	30	24,3	cyclictest	2754	-21	sshd	00:06:40	2
12057	99	30	23,4	cyclictest	5046	-21	sshd	23:19:26	2
12057	99	30	23,4	cyclictest	17136	-21	sshd	22:48:49	2
12057	99	30	23,4	cyclictest	15066	-21	sshd	22:20:27	2
12057	99	30	23,3	cyclictest	1848	-21	nfsd	23:52:01	2
12057	99	30	18,9	cyclictest	1959	-21	sshd	22:30:13	2
12057	99	30	18,9	cyclictest	1959	-21	sshd	22:30:13	2
12045	99	30	6,2	cyclictest	0	-21	swapper/0	21:32:22	0
12057	99	29	23,4	cyclictest	19770	-21	sshd	21:23:43	2
12057	99	29	19,8	cyclictest	16412	-21	sshd	23:14:13	2
12057	99	29	19,6	cyclictest	12108	-21	sshd	00:38:17	2
12045	99	28	0,25	cyclictest	0	-21	swapper/0	21:41:19	0
28867	2	27	2,23	sleep1	1356	50	irq/27-eth0	23:18:36	1
12045	99	27	15,11	cyclictest	3	-21	ksoftirqd/0	22:02:29	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17