OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack3slot5s.osadl.org (updated Sun May 10, 2026 00:43:29)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
14015	2	149	0	sleep1	1214	50	irq/29-eth0_g0_	23:58:29	1
16940	2	144	0	sleep0	1214	50	irq/29-eth0_g0_	00:27:19	0
17323	2	136	0	sleep0	1215	50	irq/30-eth0_g0_	00:30:50	0
4182	2	119	0	sleep0	1214	50	irq/29-eth0_g0_	22:20:47	0
30475	2	118	0	sleep0	1215	50	irq/30-eth0_g0_	21:19:49	0
11752	2	116	0	sleep0	1214	50	irq/29-eth0_g0_	23:35:33	0
2774	2	105	0	sleep1	1214	50	irq/29-eth0_g0_	22:06:54	1
12	1	85	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:34:16	1
12	1	85	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	00:10:48	0
12	1	79	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:46:26	1
7588	2	72	0	sleep1	1214	50	irq/29-eth0_g0_	22:54:09	1
6546	2	56	0	sleep1	1215	50	irq/30-eth0_g0_	22:44:05	1
12	1	55	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:41:42	1
12	1	49	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:40:33	1
12	1	49	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:48:38	1
29651	2	48	0	sleep0	1214	50	irq/29-eth0_g0_	21:11:59	0
12	1	47	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:35:18	1
12	1	47	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:22:25	1
12	1	45	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:29:28	1
8457	2	44	0	sleep0	1215	50	irq/30-eth0_g0_	23:03:22	0
12	1	44	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:07:40	0
1215	50	43	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	22:24:46	1
1215	50	43	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	22:12:34	1
12	1	43	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:56:36	1
12	1	43	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:33:45	0
12	1	43	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:01:20	0
12	1	43	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	22:50:46	1
12	1	43	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	22:25:15	0
1214	50	42	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	23:54:26	0
1214	50	42	0	irq/29-eth0_g0_	1911	-21	runrttasks	19:04:50	0
1214	50	42	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	23:34:03	0
12	1	42	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:15:28	0
1215	50	41	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	00:06:27	1
1215	50	41	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	00:06:27	1
1215	50	41	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	00:02:14	1
1215	50	41	0	irq/30-eth0_g0_	0	-21	swapper/1	22:46:53	1
1214	50	41	0	irq/29-eth0_g0_	32313	-21	taskset	21:38:41	0
1214	50	41	0	irq/29-eth0_g0_	13373	-21	chrt	23:51:51	0
12	1	41	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:30:36	1
12	1	41	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	23:37:22	1
1215	50	40	0	irq/30-eth0_g0_	3	1	ksoftirqd/0	22:45:12	0
1215	50	40	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	23:15:59	1
1215	50	40	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	00:12:35	1
1215	50	40	0	irq/30-eth0_g0_	0	-21	swapper/1	23:19:13	1
1214	50	40	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:41:05	0
1214	50	40	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:10:30	0
1214	50	40	0	irq/29-eth0_g0_	13	-21	kworker/0:1	00:37:47	0
1214	50	40	0	irq/29-eth0_g0_	13	-21	kworker/0:1	00:23:00	0
12	1	40	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:36:44	0
17240	99	39	1	cyclictest	9081	-21	taskset	23:09:05	1
1215	50	39	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	23:01:13	1
1215	50	39	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	22:32:49	1
1215	50	39	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	22:16:35	1
1215	50	39	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	21:17:23	1
1215	50	39	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	23:51:18	1
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:04:26	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:55:28	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:40:36	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:29:33	0
1214	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:10:01	0
1214	50	39	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	21:28:26	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:24:53	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:51:05	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:59:32	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:39:11	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:49:41	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:09:22	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:07:17	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:01:23	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	19:55:34	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	19:49:56	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	19:39:54	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	19:32:24	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:16:09	0
12	1	39	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	21:44:12	0
12	1	39	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	21:37:50	1
12	1	39	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	20:23:10	1
1215	50	38	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	00:36:46	1
1215	50	38	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	00:20:37	1
1215	50	38	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	23:47:11	1
1215	50	38	0	irq/30-eth0_g0_	0	-21	swapper/1	21:59:41	1
1214	50	38	0	irq/29-eth0_g0_	1911	-21	runrttasks	21:52:57	0
1214	50	38	0	irq/29-eth0_g0_	1911	-21	runrttasks	20:36:12	0
1214	50	38	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	23:09:43	1
12	1	38	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	19:38:06	0
12	1	38	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	19:10:16	0
12	1	38	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:05:17	0
12	1	38	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:05:17	0
17240	99	37	1	cyclictest	31274	-21	chrt	21:28:24	1
17240	99	37	1	cyclictest	22269	2	sleep1	19:59:05	1
17240	99	37	1	cyclictest	19257	2	sleep1	19:29:06	1
1215	50	37	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	23:24:25	1
1215	50	37	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	00:27:38	1
1215	50	37	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	00:17:39	1
1214	50	37	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	21:58:53	0
1214	50	37	0	irq/29-eth0_g0_	26810	-21	latency_hist	20:44:05	0
1214	50	37	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:22:50	0
1214	50	37	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:18:32	0
1214	50	37	0	irq/29-eth0_g0_	13	-21	kworker/0:1	21:17:29	0
17240	99	36	1	cyclictest	28821	-21	chrt	21:04:06	1
1214	50	36	0	irq/29-eth0_g0_	13059	-21	munin-run	23:49:04	0
1214	50	36	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	23:29:07	1
1214	50	36	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	22:21:17	1
12	1	36	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	20:12:31	1
17240	99	35	1	cyclictest	25404	-21	sshd	20:29:29	1
1215	50	35	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	21:49:18	1
1215	50	35	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	21:09:25	1
1214	50	35	0	irq/29-eth0_g0_	29328	-21	munin-run	21:09:04	0
1214	50	35	0	irq/29-eth0_g0_	27309	-21	seq	20:49:05	0
1214	50	35	0	irq/29-eth0_g0_	1911	-21	runrttasks	20:59:13	0
1214	50	35	0	irq/29-eth0_g0_	1911	-21	runrttasks	20:19:52	0
1214	50	35	0	irq/29-eth0_g0_	1911	-21	runrttasks	20:18:20	0
1214	50	35	0	irq/29-eth0_g0_	1911	-21	runrttasks	19:22:18	0
17240	99	34	1	cyclictest	27413	2	sleep1	20:49:26	1
17240	99	34	1	cyclictest	21296	-21	latency_hist	19:49:06	1
17240	99	34	1	cyclictest	0	-21	swapper/1	19:12:59	1
1214	50	34	0	irq/29-eth0_g0_	21270	-21	ls	19:49:05	0
1214	50	34	0	irq/29-eth0_g0_	1911	-21	runrttasks	20:26:27	0
1214	50	34	0	irq/29-eth0_g0_	1911	-21	runrttasks	19:14:19	0
12	1	34	0	ksoftirqd/1	20835	-21	sed	19:44:06	1
12	1	34	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	20:43:19	1
1214	50	33	0	irq/29-eth0_g0_	1911	-21	runrttasks	19:28:42	0
17240	99	32	1	cyclictest	0	-21	swapper/1	19:29:13	1
17240	99	32	1	cyclictest	0	-21	swapper/1	19:21:07	1
17240	99	32	0	cyclictest	0	-21	swapper/1	21:07:19	1
1215	50	32	0	irq/30-eth0_g0_	17233	-21	munin-plugin-st	19:09:05	1
1214	50	32	0	irq/29-eth0_g0_	1911	-21	runrttasks	20:54:31	0
1215	50	31	0	irq/30-eth0_g0_	0	-21	swapper/1	20:14:30	1
1215	50	31	0	irq/30-eth0_g0_	0	-21	swapper/1	19:15:13	1
1214	50	31	0	irq/29-eth0_g0_	19907	-21	runrttasks	19:34:59	1
1214	50	31	0	irq/29-eth0_g0_	1972	-21	lldpd	20:33:47	0
12	1	31	0	ksoftirqd/1	24897	-21	taskset	20:24:25	1
17240	99	30	1	cyclictest	0	-21	swapper/1	20:56:25	1
1215	50	30	0	irq/30-eth0_g0_	17240	99	cyclictest	20:05:39	1
1214	50	29	0	irq/29-eth0_g0_	22566	-21	runrttasks	20:01:39	1
1214	50	29	0	irq/29-eth0_g0_	21623	-21	sshd	19:52:29	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17