OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #d, slot #3

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rackdslot3.osadl.org (updated Sat Apr 25, 2026 00:45:52)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
18345	2	202	169,22	sleep3	0	-21	swapper/3	19:09:27	3
18343	2	201	169,21	sleep1	0	-21	swapper/1	19:09:25	1
18314	2	197	163,22	sleep0	0	-21	swapper/0	19:09:16	0
18318	2	187	155,21	sleep2	0	-21	swapper/2	19:09:18	2
1393	91	109	0,1	ptp4l	11330	-21	grep	19:25:00	3
2175	2	66	0,16	sleep0	2166	-21	expr	19:27:57	0
2175	2	66	0,16	sleep0	2166	-21	expr	19:27:57	0
14814	2	65	0,6	sleep2	18681	99	cyclictest	23:40:20	2
30178	2	64	0,3	sleep2	31	1	rcuc/2	19:40:26	2
15675	2	64	0,4	sleep0	15680	-21	rm	19:30:27	0
18681	99	62	27,6	cyclictest	33	-21	ksoftirqd/2	22:45:15	2
6829	2	61	0,7	sleep2	18681	99	cyclictest	19:30:13	2
26053	2	61	0,5	sleep2	26054	-21	multi.sh	19:28:23	2
26053	2	61	0,5	sleep2	26054	-21	multi.sh	19:28:23	2
18681	99	61	28,3	cyclictest	33	-21	ksoftirqd/2	19:15:00	2
13770	2	59	0,2	sleep1	0	-21	swapper/1	20:15:19	1
28976	2	58	0,6	sleep2	18681	99	cyclictest	19:21:57	2
1393	91	58	0,1	ptp4l	40	1	ktimersoftd/3	19:15:01	3
18681	99	55	24,4	cyclictest	33	-21	ksoftirqd/2	20:35:15	2
18681	99	55	21,4	cyclictest	33	-21	ksoftirqd/2	22:35:20	2
31353	2	54	0,5	sleep1	31357	-21	sort	19:27:26	1
31353	2	54	0,5	sleep1	31357	-21	sort	19:27:26	1
18681	99	54	23,5	cyclictest	33	-21	ksoftirqd/2	21:05:20	2
18681	99	52	22,4	cyclictest	33	-21	ksoftirqd/2	23:05:23	2
4244	2	50	0,3	sleep3	4245	-21	latency_hist	21:05:00	3
18681	99	50	19,5	cyclictest	33	-21	ksoftirqd/2	21:00:22	2
18681	99	50	18,3	cyclictest	33	-21	ksoftirqd/2	21:55:13	2
18681	99	49	21,3	cyclictest	33	-21	ksoftirqd/2	00:05:23	2
1393	91	48	0,1	ptp4l	40	1	ktimersoftd/3	00:07:55	3
18681	99	47	8,6	cyclictest	33	-21	ksoftirqd/2	20:59:59	2
18681	99	47	13,6	cyclictest	33	-21	ksoftirqd/2	00:20:13	2
18681	99	46	19,4	cyclictest	33	-21	ksoftirqd/2	21:43:15	2
18681	99	46	16,4	cyclictest	33	-21	ksoftirqd/2	20:15:22	2
18681	99	46	15,3	cyclictest	33	-21	ksoftirqd/2	22:15:01	2
18681	99	46	14,6	cyclictest	33	-21	ksoftirqd/2	20:50:15	2
18681	99	46	13,9	cyclictest	33	-21	ksoftirqd/2	23:25:14	2
18681	99	46	0,14	cyclictest	27035	-21	apt-get	23:00:13	2
18681	99	45	9,6	cyclictest	33	-21	ksoftirqd/2	22:20:00	2
18681	99	45	12,4	cyclictest	33	-21	ksoftirqd/2	20:25:22	2
18681	99	44	8,3	cyclictest	33	-21	ksoftirqd/2	00:00:22	2
18681	99	44	15,4	cyclictest	33	-21	ksoftirqd/2	20:05:01	2
18681	99	44	14,4	cyclictest	33	-21	ksoftirqd/2	21:45:14	2
18681	99	44	12,4	cyclictest	33	-21	ksoftirqd/2	22:25:15	2
18681	99	44	11,5	cyclictest	33	-21	ksoftirqd/2	20:15:00	2
1393	91	44	0,0	ptp4l	40	1	ktimersoftd/3	20:05:28	3
18681	99	43	9,6	cyclictest	33	-21	ksoftirqd/2	22:05:21	2
18681	99	43	8,7	cyclictest	33	-21	ksoftirqd/2	00:18:21	2
18681	99	43	1,3	cyclictest	33	-21	ksoftirqd/2	00:35:00	2
1393	91	43	0,0	ptp4l	40	1	ktimersoftd/3	23:32:11	3
1393	91	43	0,0	ptp4l	40	1	ktimersoftd/3	22:32:13	3
1393	91	43	0,0	ptp4l	40	1	ktimersoftd/3	22:01:04	3
1393	91	43	0,0	ptp4l	40	1	ktimersoftd/3	00:20:28	3
18681	99	42	6,5	cyclictest	33	-21	ksoftirqd/2	21:25:14	2
18681	99	42	5,2	cyclictest	12	1	rcu_preempt	23:50:16	2
18681	99	42	33,2	cyclictest	12	1	rcu_preempt	19:14:45	2
18681	99	42	2,2	cyclictest	12	1	rcu_preempt	23:55:19	2
18681	99	42	12,4	cyclictest	33	-21	ksoftirqd/2	22:30:24	2
18681	99	42	0,3	cyclictest	12	1	rcu_preempt	23:20:15	2
18681	99	41	36,3	cyclictest	33	-21	ksoftirqd/2	21:40:01	2
18681	99	41	30,8	cyclictest	33	-21	ksoftirqd/2	19:55:24	2
18681	99	41	11,4	cyclictest	33	-21	ksoftirqd/2	23:15:14	2
1393	91	41	0,0	ptp4l	40	1	ktimersoftd/3	22:55:27	3
18681	99	40	9,9	cyclictest	33	-21	ksoftirqd/2	22:20:13	2
18681	99	40	8,6	cyclictest	33	-21	ksoftirqd/2	22:40:01	2
18681	99	40	36,2	cyclictest	33	-21	ksoftirqd/2	19:50:01	2
1393	91	40	0,0	ptp4l	40	1	ktimersoftd/3	20:45:23	3
18681	99	39	34,3	cyclictest	33	-21	ksoftirqd/2	00:39:59	2
18681	99	39	34,2	cyclictest	33	-21	ksoftirqd/2	22:54:59	2
18681	99	39	3,3	cyclictest	12	1	rcu_preempt	21:25:00	2
18681	99	39	3,3	cyclictest	12	1	rcu_preempt	21:25:00	2
18681	99	39	2,6	cyclictest	33	-21	ksoftirqd/2	22:00:20	2
18681	99	39	2,3	cyclictest	12	1	rcu_preempt	21:15:00	2
18681	99	39	23,14	cyclictest	33	-21	ksoftirqd/2	20:04:27	2
18681	99	38	3,5	cyclictest	33	-21	ksoftirqd/2	20:20:25	2
18681	99	38	33,3	cyclictest	33	-21	ksoftirqd/2	21:15:13	2
18681	99	38	33,3	cyclictest	33	-21	ksoftirqd/2	21:15:13	2
18681	99	38	33,3	cyclictest	33	-21	ksoftirqd/2	19:39:59	2
18681	99	38	3,2	cyclictest	12	1	rcu_preempt	23:35:19	2
18681	99	38	32,3	cyclictest	33	-21	ksoftirqd/2	00:30:00	2
18681	99	38	2,3	cyclictest	12	1	rcu_preempt	20:30:26	2
18681	99	38	0,5	cyclictest	33	-21	ksoftirqd/2	23:30:25	2
18680	99	38	33,3	cyclictest	25	-21	ksoftirqd/1	19:30:28	1
18680	99	38	32,4	cyclictest	25	-21	ksoftirqd/1	20:38:42	1
18680	99	38	32,4	cyclictest	25	-21	ksoftirqd/1	00:21:26	1
18682	99	37	32,3	cyclictest	41	-21	ksoftirqd/3	19:27:57	3
18682	99	37	32,3	cyclictest	41	-21	ksoftirqd/3	19:27:57	3
18681	99	37	33,2	cyclictest	33	-21	ksoftirqd/2	20:40:23	2
18680	99	37	33,2	cyclictest	25	-21	ksoftirqd/1	21:55:01	1
18680	99	37	33,2	cyclictest	23	1	rcuc/1	19:22:10	1
18680	99	37	32,3	cyclictest	25	-21	ksoftirqd/1	21:59:59	1
18680	99	37	31,4	cyclictest	25	-21	ksoftirqd/1	19:38:33	1
18682	99	36	30,4	cyclictest	41	-21	ksoftirqd/3	23:16:37	3
18682	99	36	30,4	cyclictest	41	-21	ksoftirqd/3	22:52:19	3
18682	99	36	30,4	cyclictest	41	-21	ksoftirqd/3	21:59:07	3
18681	99	36	32,2	cyclictest	33	-21	ksoftirqd/2	23:45:20	2
18681	99	36	32,2	cyclictest	33	-21	ksoftirqd/2	22:55:19	2
18681	99	36	31,3	cyclictest	33	-21	ksoftirqd/2	23:10:16	2
18681	99	36	31,3	cyclictest	33	-21	ksoftirqd/2	20:45:21	2
18681	99	36	31,3	cyclictest	33	-21	ksoftirqd/2	19:51:02	2
18681	99	36	31,2	cyclictest	33	-21	ksoftirqd/2	00:10:22	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-06-15 - 15:03