OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack3slot5s.osadl.org (updated Tue May 12, 2026 00:43:30)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
12991	2	168	0	sleep1	1214	50	irq/29-eth0_g0_	22:02:15	1
12	1	111	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:08:57	1
12	1	95	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	19:24:01	1
12	1	94	0	ksoftirqd/1	17114	2	sleep0	22:42:51	0
12	1	86	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	21:43:59	1
16042	2	59	0	sleep0	1215	50	irq/30-eth0_g0_	22:32:14	0
12	1	57	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:41:58	1
17954	2	56	0	sleep1	1215	50	irq/30-eth0_g0_	22:50:48	1
12	1	56	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:56:08	1
15428	2	54	0	chrt	1214	50	irq/29-eth0_g0_	22:26:01	0
7809	2	52	0	sleep0	1214	50	irq/29-eth0_g0_	21:11:08	0
27029	2	51	0	sleep1	1215	50	irq/30-eth0_g0_	00:19:51	1
22198	2	51	0	chrt	1214	50	irq/29-eth0_g0_	23:32:50	0
12	1	51	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:33:45	1
12	1	50	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:30:39	1
17399	2	49	0	sleep1	1215	50	irq/30-eth0_g0_	22:45:17	1
12	1	48	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:23:38	1
12	1	47	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:53:31	1
1214	50	45	0	irq/29-eth0_g0_	13848	2	sleep1	22:10:25	1
1214	50	45	0	irq/29-eth0_g0_	13848	2	sleep1	22:10:25	1
12	1	45	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	21:10:18	1
12	1	44	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:12:34	0
12	1	44	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:20:56	0
12	1	44	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:15:03	1
12	1	44	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:15:03	1
1215	50	43	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	23:36:23	1
1215	50	43	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	23:36:23	1
12	1	43	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:22:20	1
12	1	43	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:07:49	1
12	1	43	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	20:30:38	1
23564	2	42	0	sleep1	1214	50	irq/29-eth0_g0_	23:46:00	1
12626	2	42	0	sleep0	1214	50	irq/29-eth0_g0_	21:58:55	0
1214	50	42	0	irq/29-eth0_g0_	1911	-21	runrttasks	19:08:15	0
12	1	42	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:19:48	0
12	1	42	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	00:24:48	0
1215	50	41	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	00:17:52	1
1214	50	41	0	irq/29-eth0_g0_	7549	-21	diskmemload	00:34:00	0
1214	50	41	0	irq/29-eth0_g0_	7549	-21	diskmemload	00:34:00	0
12	1	41	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:46:02	0
12	1	41	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:27:56	1
1215	50	40	0	irq/30-eth0_g0_	22123	2	sleep1	23:31:59	1
1215	50	40	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	22:39:37	1
1215	50	40	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	21:58:45	1
1215	50	40	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	00:31:59	1
1215	50	40	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	00:31:59	1
1214	50	40	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	23:47:45	0
1214	50	40	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	21:49:14	0
1214	50	40	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:17:50	0
1214	50	40	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:47:54	0
1214	50	40	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:10:02	0
1214	50	40	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:10:02	0
1214	50	40	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	23:59:03	1
12	1	40	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:24:37	0
12	1	40	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:28:06	1
12	1	40	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:26:08	0
12	1	40	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	22:49:32	0
1215	50	39	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	23:14:11	1
1215	50	39	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	23:03:26	1
1214	50	39	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	23:22:29	0
1214	50	39	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	22:54:47	0
1214	50	39	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	21:15:14	0
1214	50	39	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	21:15:14	0
1214	50	39	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	00:09:12	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:56:41	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:52:23	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:04:41	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	21:37:14	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	21:31:07	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	00:37:38	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:00:31	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	19:43:44	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:19:19	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:00:39	0
12	1	39	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	23:09:33	1
1215	50	38	0	irq/30-eth0_g0_	27741	-21	taskset	00:27:13	1
1215	50	38	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	00:09:24	1
1215	50	38	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	23:39:14	1
1215	50	38	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	21:34:25	1
1215	50	38	0	irq/30-eth0_g0_	0	-21	swapper/1	23:06:30	1
1214	50	38	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:02:40	0
12	1	38	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:14:58	0
12	1	38	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:14:58	0
27746	99	37	8	cyclictest	1215	50	irq/30-eth0_g0_	00:34:04	1
1215	50	37	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	23:56:59	1
1215	50	37	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	23:28:11	1
1215	50	37	0	irq/30-eth0_g0_	0	-21	swapper/1	21:44:03	1
1214	50	37	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:36:41	0
1214	50	37	0	irq/29-eth0_g0_	13	-21	kworker/0:1	21:39:46	0
1214	50	37	0	irq/29-eth0_g0_	13	-21	kworker/0:1	00:14:42	0
1214	50	37	0	irq/29-eth0_g0_	1221	-21	kworker/1:2	23:20:04	1
1214	50	37	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	22:35:10	1
12	1	37	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	23:34:06	0
12	1	37	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	23:34:06	0
27746	99	36	2	cyclictest	31849	-21	cat	19:49:01	1
27746	99	36	1	cyclictest	0	-21	swapper/1	19:19:00	1
1215	50	36	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	21:15:57	1
1215	50	36	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	21:15:57	1
1214	50	36	0	irq/29-eth0_g0_	27515	-21	runrttasks	19:06:28	1
1214	50	36	0	irq/29-eth0_g0_	1911	-21	runrttasks	21:03:05	0
1214	50	36	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:39:11	0
1214	50	36	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:04:28	0
1214	50	36	0	irq/29-eth0_g0_	13	-21	kworker/0:1	00:04:43	0
1214	50	36	0	irq/29-eth0_g0_	0	-21	swapper/0	19:49:01	0
12	1	36	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:51:49	0
12	1	36	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	19:24:00	0
1215	50	35	0	irq/30-eth0_g0_	0	-21	swapper/0	19:14:01	0
1214	50	35	0	irq/29-eth0_g0_	1454	-21	cat	20:09:01	0
12	1	35	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:39:30	0
12	1	35	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:28:24	0
27746	99	34	1	cyclictest	6587	-21	latency_hist	20:59:01	1
27746	99	34	1	cyclictest	379	-21	latency_hist	19:59:01	1
27746	99	34	1	cyclictest	1911	-21	runrttasks	20:16:02	1
27746	99	34	1	cyclictest	1911	-21	runrttasks	19:43:06	1
27746	99	34	1	cyclictest	0	-21	swapper/1	20:51:40	1
27746	99	34	1	cyclictest	0	-21	swapper/1	19:35:42	1
1215	50	34	0	irq/30-eth0_g0_	0	-21	swapper/1	23:51:52	1
1214	50	34	0	irq/29-eth0_g0_	1694	-21	runrttasks	20:11:16	0
1214	50	34	0	irq/29-eth0_g0_	0	-21	swapper/0	19:57:18	0
12	1	34	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:36:59	0
12	1	34	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:19:21	1
12	1	34	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:19:04	0
12	1	34	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:02:02	0
27746	99	33	1	cyclictest	0	-21	swapper/1	20:25:26	1
27746	99	33	1	cyclictest	0	-21	swapper/1	20:06:35	1
27746	99	33	1	cyclictest	0	-21	swapper/1	20:01:52	1
27746	99	33	1	cyclictest	0	-21	swapper/1	19:29:10	1
27746	99	33	1	cyclictest	0	-21	swapper/1	19:12:50	1
1215	50	33	0	irq/30-eth0_g0_	29360	-21	taskset	19:24:08	1
1214	50	33	0	irq/29-eth0_g0_	30804	-21	latency_hist	19:39:01	0
1214	50	33	0	irq/29-eth0_g0_	29994	-21	seq	19:30:36	0
1214	50	33	0	irq/29-eth0_g0_	2095	-21	runrttasks	20:14:49	0
1214	50	33	0	irq/29-eth0_g0_	1982	-21	lldpd	19:53:22	0
1214	50	33	0	irq/29-eth0_g0_	1911	-21	runrttasks	21:05:01	0
1214	50	33	0	irq/29-eth0_g0_	1911	-21	runrttasks	20:35:40	1
12	1	33	0	ksoftirqd/1	7497	-21	taskset	21:08:27	1
12	1	33	0	ksoftirqd/1	5248	-21	taskset	20:46:00	1
27746	99	32	1	cyclictest	7062	-21	runrttasks	21:04:01	1
27746	99	32	1	cyclictest	0	-21	swapper/1	20:11:25	1
27746	99	32	1	cyclictest	0	-21	swapper/1	19:53:56	1
1214	50	32	0	irq/29-eth0_g0_	0	-21	swapper/0	19:15:12	0
12	1	32	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:54:21	0
1214	50	31	0	irq/29-eth0_g0_	1911	-21	runrttasks	20:47:33	0
1214	50	31	0	irq/29-eth0_g0_	0	-21	swapper/0	20:33:20	0
1214	50	31	0	irq/29-eth0_g0_	0	-21	swapper/0	19:25:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17