OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack3slot5s.osadl.org (updated Fri Apr 17, 2026 00:43:30)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
12	1	95	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:18:39	1
12	1	63	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:31:36	1
12	1	55	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:51:28	1
21510	2	52	0	chrt	1215	50	irq/30-eth0_g0_	22:06:46	1
12	1	52	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:54:34	1
12	1	51	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:59:02	1
12	1	51	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:21:42	1
12	1	51	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:17:58	1
12	1	51	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:29:22	1
12	1	49	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:06:20	1
12	1	48	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:24:42	1
1214	50	46	0	irq/29-eth0_g0_	1911	-21	runrttasks	20:04:39	0
17477	2	45	0	sleep1	1215	50	irq/30-eth0_g0_	21:26:58	1
1215	50	45	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	21:35:04	1
1215	50	45	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	00:12:13	1
12	1	45	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	21:59:51	1
12	1	44	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:15:20	1
1214	50	43	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	22:52:58	0
12	1	43	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	19:26:13	1
12	1	43	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	00:24:04	1
1215	50	42	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	21:33:50	1
1214	50	42	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	22:41:06	0
1214	50	42	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	22:19:27	0
1215	50	41	0	irq/30-eth0_g0_	19013	2	sleep1	21:42:12	1
1214	50	41	0	irq/29-eth0_g0_	3586	-21	cyclictest	19:09:58	0
1214	50	41	0	irq/29-eth0_g0_	13	-21	kworker/0:1	00:36:12	0
1214	50	41	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	22:33:20	0
12	1	41	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:38:19	0
12	1	41	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:38:56	1
12	1	41	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	23:12:40	1
12	1	41	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	23:05:44	1
12	1	41	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	23:05:44	1
12	1	41	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	21:25:04	0
1214	50	40	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	21:42:27	0
1214	50	40	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	21:30:32	0
1214	50	40	0	irq/29-eth0_g0_	1911	-21	runrttasks	19:56:58	0
1214	50	40	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:28:40	0
1214	50	40	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:18:29	0
1214	50	40	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:57:39	0
1214	50	40	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:20:36	0
1214	50	40	0	irq/29-eth0_g0_	13	-21	kworker/0:1	00:11:55	0
1214	50	40	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	23:13:46	0
1214	50	40	0	irq/29-eth0_g0_	0	-21	swapper/0	00:19:52	0
12	1	40	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:11:18	1
12	1	40	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:08:15	0
12	1	40	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:36:49	0
12	1	40	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	19:29:41	0
3588	99	39	1	cyclictest	6144	-21	latency_hist	19:34:58	1
3588	99	39	1	cyclictest	17252	-21	cat	21:24:58	1
1215	50	39	0	irq/30-eth0_g0_	3	1	ksoftirqd/0	23:32:38	0
1215	50	39	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	22:01:16	1
1215	50	39	0	irq/30-eth0_g0_	0	-21	swapper/1	23:47:51	1
1214	50	39	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	23:45:07	0
1214	50	39	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	21:15:49	0
1214	50	39	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	00:26:24	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:01:09	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:48:52	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:26:39	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:10:40	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:00:58	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	21:21:47	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	00:05:59	0
1214	50	39	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	23:20:42	0
1214	50	39	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	00:01:32	0
1214	50	39	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	00:01:32	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:56:38	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:44:06	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:37:31	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:55:44	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:49:06	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:49:06	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:12:32	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:54:14	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:54:14	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:31:24	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:25:38	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:20:13	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:13:21	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	19:47:22	0
12	1	39	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	22:44:14	1
1215	50	38	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	23:27:17	1
1215	50	38	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	22:26:23	1
1215	50	38	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	22:15:04	1
1215	50	38	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	21:12:19	1
1215	50	38	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	21:48:58	1
1215	50	38	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	21:48:58	1
1214	50	38	0	irq/29-eth0_g0_	3975	2	sleep1	00:34:17	1
1214	50	38	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	23:08:14	0
1214	50	38	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	23:08:14	0
1214	50	38	0	irq/29-eth0_g0_	13	-21	kworker/0:1	21:50:03	0
1214	50	38	0	irq/29-eth0_g0_	13	-21	kworker/0:1	00:21:52	0
12	1	38	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:17:01	0
12	1	38	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:09:28	0
12	1	38	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	19:10:01	0
12	1	38	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	23:00:17	1
12	1	38	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	22:35:07	1
3588	99	37	23	cyclictest	1911	-21	runrttasks	00:00:30	1
3588	99	37	23	cyclictest	1911	-21	runrttasks	00:00:30	1
3588	99	37	1	cyclictest	26850	-21	latency_hist	22:59:58	1
3588	99	37	1	cyclictest	15722	-21	sort	21:09:58	1
3588	99	37	1	cyclictest	1221	-21	kworker/1:2	22:20:53	1
1215	50	37	0	irq/30-eth0_g0_	8788	-21	taskset	20:00:50	1
1215	50	37	0	irq/30-eth0_g0_	3586	-21	cyclictest	23:30:23	1
1215	50	37	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	22:46:07	1
1214	50	37	0	irq/29-eth0_g0_	1911	-21	runrttasks	19:34:34	0
1214	50	37	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:50:51	0
1214	50	37	0	irq/29-eth0_g0_	13	-21	kworker/0:1	00:30:49	0
12	1	37	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	19:44:13	1
3588	99	36	6	cyclictest	0	-21	swapper/1	23:36:18	1
3588	99	36	1	cyclictest	15708	-21	diskmemload	23:53:06	1
1214	50	36	0	irq/29-eth0_g0_	1911	-21	runrttasks	21:02:56	0
1214	50	36	0	irq/29-eth0_g0_	1911	-21	runrttasks	19:44:01	0
12	1	36	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	19:54:03	1
1214	50	35	0	irq/29-eth0_g0_	1911	-21	runrttasks	21:05:16	0
1214	50	35	0	irq/29-eth0_g0_	1911	-21	runrttasks	20:40:08	0
1214	50	35	0	irq/29-eth0_g0_	1911	-21	runrttasks	20:36:18	0
12	1	35	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	21:02:18	1
3588	99	34	1	cyclictest	4694	2	sleep1	19:20:14	1
3588	99	34	1	cyclictest	4694	2	sleep1	19:20:14	1
3588	99	34	1	cyclictest	0	-21	swapper/1	23:42:03	1
1214	50	34	0	irq/29-eth0_g0_	6429	-21	runrttasks	19:37:44	1
1214	50	34	0	irq/29-eth0_g0_	4665	-21	taskset	19:19:58	0
1214	50	34	0	irq/29-eth0_g0_	4665	-21	taskset	19:19:58	0
1214	50	34	0	irq/29-eth0_g0_	1911	-21	runrttasks	19:52:23	0
1214	50	34	0	irq/29-eth0_g0_	1911	-21	runrttasks	19:37:48	0
3588	99	33	1	cyclictest	0	-21	swapper/1	20:55:55	1
1215	50	33	0	irq/30-eth0_g0_	12309	-21	seq	20:35:39	1
1214	50	33	0	irq/29-eth0_g0_	1911	-21	runrttasks	20:55:12	0
1214	50	33	0	irq/29-eth0_g0_	1911	-21	runrttasks	20:46:54	0
1214	50	33	0	irq/29-eth0_g0_	0	-21	swapper/0	19:24:57	0
1214	50	33	0	irq/29-eth0_g0_	0	-21	swapper/0	19:24:57	0
12	1	33	0	ksoftirqd/1	9374	-21	taskset	20:06:42	1
12	1	33	0	ksoftirqd/1	3585	-21	munin-run	19:09:58	1
3588	99	32	2	cyclictest	10658	-21	munin-run	20:19:58	1
3588	99	32	1	cyclictest	7634	-21	cat	19:49:58	1
3588	99	32	1	cyclictest	0	-21	swapper/1	20:30:48	1
3588	99	32	1	cyclictest	0	-21	swapper/1	20:27:55	1
12	1	32	0	ksoftirqd/1	3669	-21	taskset	19:10:03	1
12	1	32	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	20:48:38	1
3588	99	31	1	cyclictest	0	-21	swapper/1	19:15:57	1
3588	99	31	1	cyclictest	0	-21	swapper/1	19:15:57	1
1214	50	31	0	irq/29-eth0_g0_	8673	-21	latency_hist	19:59:58	1
3588	99	30	1	cyclictest	0	-21	swapper/1	20:11:13	1
3588	99	30	0	cyclictest	0	-21	swapper/1	20:53:33	1
3588	99	30	0	cyclictest	0	-21	swapper/1	20:53:33	1
1214	50	30	0	irq/29-eth0_g0_	13080	-21	runrttasks	20:43:45	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17