OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #5, slot #0

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack5slot0.osadl.org (updated Mon Nov 24, 2025 00:44:49)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
16185	2	160	0,3	sleep0	4582	99	cyclictest	00:16:00	0
7549	2	147	0,1	sleep1	0	-21	swapper/1	22:59:12	1
9427	2	136	0,2	sleep2	0	-21	swapper/2	23:50:56	2
14743	2	131	0,0	sleep0	14742	-21	sshd	23:33:10	0
14119	2	131	0,1	sleep1	14118	-21	bash	21:11:47	1
24428	2	128	0,5	sleep2	4584	99	cyclictest	22:45:22	2
27011	2	112	0,0	sleep0	0	-21	swapper/0	22:45:36	0
26882	2	111	0,2	sleep1	26881	-21	sshd	23:07:07	1
18377	2	103	0,1	sleep0	18373	-21	sshd	22:08:57	0
11615	2	97	0,3	sleep0	4582	99	cyclictest	23:08:46	0
5613	2	91	0,1	sleep0	4581	-21	cyclictest	23:29:22	0
4254	2	90	26,44	sleep3	0	-21	swapper/3	19:09:06	3
19270	2	90	0,1	sleep1	0	-21	swapper/1	21:21:18	1
13123	2	90	0,3	sleep1	4583	99	cyclictest	22:41:21	1
11918	2	89	0,1	sleep1	0	-21	swapper/1	21:29:38	1
8982	2	88	0,0	sleep1	8979	-21	sshd	22:10:59	1
8044	2	87	0,1	sleep0	8033	-21	sshd	22:37:56	0
23240	2	87	0,2	sleep1	0	-21	swapper/1	23:03:46	1
4149	2	85	33,43	sleep1	0	-21	swapper/1	19:07:48	1
22244	2	85	0,4	sleep2	36	-21	rcuop/2	23:06:39	2
25746	2	84	0,1	sleep0	25743	-21	sshd	22:00:36	0
15339	2	84	0,1	sleep3	0	-21	swapper/3	22:47:36	3
5525	2	82	0,0	sleep0	0	-21	swapper/0	00:27:37	0
28930	2	82	0,0	sleep0	0	-21	swapper/0	23:01:07	0
17991	2	82	0,2	sleep2	0	-21	swapper/2	00:19:17	2
26474	2	81	0,2	sleep2	32	1	ktimersoftd/2	23:31:13	2
17084	2	81	0,2	sleep2	0	-21	swapper/2	22:23:47	2
16520	2	81	0,2	sleep3	0	-21	swapper/3	23:27:21	3
17029	2	80	0,3	sleep2	17005	-21	sshd	23:24:26	2
4071	2	78	0,1	sleep2	4070	-21	sshd	21:14:00	2
3303	2	78	0,0	sleep0	0	-21	swapper/0	23:23:09	0
2622	2	77	0,2	sleep3	0	-21	swapper/3	00:08:45	3
25580	2	77	0,1	sleep0	1848	-21	nfsd	19:55:14	0
21647	2	77	0,2	sleep3	1847	-21	nfsd	22:33:14	3
10896	2	77	0,2	sleep3	0	-21	swapper/3	00:37:51	3
10005	2	76	0,2	sleep2	9993	-21	sshd	22:17:06	2
6405	2	75	0,1	sleep1	0	-21	swapper/1	00:27:43	1
9326	2	72	0,2	sleep3	0	-21	swapper/3	23:20:35	3
16047	2	70	0,4	sleep2	4584	99	cyclictest	22:53:52	2
12126	2	69	0,3	sleep0	4582	99	cyclictest	21:44:33	0
31644	2	62	0,1	sleep1	4583	99	cyclictest	22:16:03	1
4251	2	61	37,13	sleep0	0	-21	swapper/0	19:09:03	0
4219	2	56	33,11	sleep2	0	-21	swapper/2	19:08:42	2
784	2	52	0,3	sleep2	786	-21	sshd	23:56:17	2
4585	99	44	35,7	cyclictest	0	-21	swapper/3	23:34:10	3
4583	99	44	28,14	cyclictest	417	-21	jbd2/dm-0-8	23:34:11	1
1318	2	37	0,0	sleep1	1319	-21	sshd	21:19:44	1
31786	2	33	0,0	sleep3	31785	-21	sshd	22:19:11	3
21816	2	32	0,2	sleep1	21814	-21	bash	22:51:15	1
4006	2	30	0,2	sleep3	0	-21	swapper/3	00:24:20	3
4584	99	28	11,1	cyclictest	33	-21	ksoftirqd/2	23:19:02	2
15968	2	28	0,26	sleep2	1356	50	irq/27-eth0	00:06:57	2
4584	99	27	15,3	cyclictest	33	-21	ksoftirqd/2	00:38:44	2
4584	99	27	13,4	cyclictest	23392	-21	sshd	23:00:36	2
4584	99	27	10,16	cyclictest	33	-21	ksoftirqd/2	23:40:56	2
4584	99	27	0,20	cyclictest	33	-21	ksoftirqd/2	00:33:26	2
8961	2	26	0,2	sleep1	8941	-21	sshd	21:35:17	1
19458	2	26	0,2	sleep3	0	-21	swapper/3	22:57:15	3
4584	99	25	1,18	cyclictest	33	-21	ksoftirqd/2	23:14:54	2
4584	99	25	0,5	cyclictest	5436	-21	sshd	21:55:45	2
4582	99	25	15,8	cyclictest	17513	-21	sshd	00:13:08	0
29946	2	25	0,3	sleep2	0	-21	swapper/2	22:42:59	2
6092	2	24	0,21	sleep2	1356	50	irq/27-eth0	00:02:59	2
4584	99	24	12,3	cyclictest	0	-21	swapper/2	23:27:43	2
4584	99	24	11,4	cyclictest	33	-21	ksoftirqd/2	22:56:20	2
4584	99	24	0,15	cyclictest	33	-21	ksoftirqd/2	00:27:00	2
4582	99	24	5,10	cyclictest	1847	-21	nfsd	22:50:09	0
4582	99	24	0,14	cyclictest	30569	-21	sshd	22:55:15	0
20105	2	24	0,2	sleep2	0	-21	swapper/2	22:30:03	2
19755	2	24	0,2	sleep1	19754	-21	sshd	00:10:19	1
1321	2	24	0,22	sleep2	1356	50	irq/27-eth0	21:37:34	2
4584	99	23	14,4	cyclictest	30596	-21	sshd	00:23:45	2
4582	99	23	0,22	cyclictest	0	-21	swapper/0	00:37:30	0
29411	2	23	0,2	sleep3	0	-21	swapper/3	21:55:06	3
16906	2	23	0,1	sleep0	4581	-21	cyclictest	22:26:41	0
15497	2	23	0,2	sleep1	15491	-21	sshd	21:50:44	1
4584	99	22	18,2	cyclictest	1959	-21	sshd	00:12:33	2
4584	99	22	13,3	cyclictest	17003	-21	id	23:45:32	2
4584	99	22	0,19	cyclictest	33	-21	ksoftirqd/2	23:35:54	2
27083	2	22	0,0	sleep0	0	-21	swapper/0	21:28:02	0
19094	2	22	2,18	sleep2	1356	50	irq/27-eth0	20:50:21	2
4626	2	21	0,2	sleep2	4625	-21	sshd	21:20:01	2
4583	99	21	15,4	cyclictest	2609	-21	sshd	00:36:58	1
4583	99	21	14,2	cyclictest	109	50	irq/23-ehci_hcd	00:31:32	1
4582	99	21	17,3	cyclictest	0	-21	swapper/0	00:09:47	0
4582	99	21	11,2	cyclictest	0	-21	swapper/0	23:36:11	0
4582	99	21	0,9	cyclictest	0	-21	swapper/0	22:41:36	0
4582	99	21	0,17	cyclictest	25845	-21	sshd	22:12:35	0
4582	99	21	0,12	cyclictest	0	-21	swapper/0	00:31:52	0
4585	99	20	11,6	cyclictest	4212	-21	sshd	23:50:25	3
4583	99	20	4,3	cyclictest	109	50	irq/23-ehci_hcd	22:49:38	1
4583	99	20	10,2	cyclictest	1848	-21	nfsd	00:21:26	1
4582	99	20	13,1	cyclictest	3420	-21	sshd	23:53:31	0
4582	99	20	0,17	cyclictest	32455	-21	sshd	23:40:53	0
4585	99	19	15,3	cyclictest	1848	-21	nfsd	23:07:53	3
4585	99	19	12,5	cyclictest	15697	-21	sshd	22:41:35	3
4583	99	19	8,5	cyclictest	109	50	irq/23-ehci_hcd	23:24:10	1
4583	99	19	13,2	cyclictest	109	50	irq/23-ehci_hcd	00:18:26	1
4582	99	19	3,4	cyclictest	1117	-21	sshd	23:10:44	0
4582	99	19	1,9	cyclictest	0	-21	swapper/0	00:20:14	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17