OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack3slot5s.osadl.org (updated Sat Jun 06, 2026 00:43:30)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
17528	2	126	0	sleep1	1216	50	irq/29-eth0_g0_	21:40:44	1
25620	2	123	0	sleep1	1216	50	irq/29-eth0_g0_	00:27:12	1
12	1	123	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	22:29:48	1
12	1	123	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	22:29:48	1
14726	2	78	0	sleep0	1216	50	irq/29-eth0_g0_	23:43:26	0
12	1	75	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	21:59:00	1
6045	2	67	0	sleep1	1216	50	irq/29-eth0_g0_	23:07:11	1
27366	2	62	0	sleep0	1217	50	irq/30-eth0_g0_	20:09:41	0
26974	2	62	0	sleep0	1217	50	irq/30-eth0_g0_	22:19:45	0
17921	2	58	0	sleep0	1217	50	irq/30-eth0_g0_	23:54:48	0
18208	2	54	0	sleep1	1217	50	irq/30-eth0_g0_	21:44:43	1
1216	50	54	0	irq/29-eth0_g0_	12396	99	cyclictest	19:44:47	0
12	1	54	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	00:01:25	1
12	1	53	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	00:26:15	0
1216	50	52	0	irq/29-eth0_g0_	12396	99	cyclictest	23:34:38	0
12	1	52	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	22:49:49	0
12	1	51	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	22:38:42	0
12	1	50	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	21:04:46	0
1217	50	49	0	irq/30-eth0_g0_	12396	99	cyclictest	22:54:49	0
1217	50	49	0	irq/30-eth0_g0_	12396	99	cyclictest	21:19:02	0
1217	50	49	0	irq/30-eth0_g0_	12396	99	cyclictest	20:44:43	0
12	1	49	0	ksoftirqd/1	12397	99	cyclictest	21:30:08	1
1216	50	48	0	irq/29-eth0_g0_	12396	99	cyclictest	22:09:49	0
12	1	48	0	ksoftirqd/1	12396	99	cyclictest	23:14:46	0
12	1	48	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	23:39:13	1
1217	50	47	0	irq/30-eth0_g0_	12396	99	cyclictest	21:59:06	0
1217	50	47	0	irq/30-eth0_g0_	12396	99	cyclictest	19:59:39	0
1217	50	47	0	irq/30-eth0_g0_	12396	99	cyclictest	00:13:24	0
1217	50	47	0	irq/30-eth0_g0_	12396	99	cyclictest	00:13:24	0
1216	50	47	0	irq/29-eth0_g0_	12396	99	cyclictest	21:37:14	0
1216	50	47	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	21:34:14	0
12	1	47	0	ksoftirqd/1	12396	99	cyclictest	21:20:12	0
1217	50	46	0	irq/30-eth0_g0_	12396	99	cyclictest	21:52:45	0
1217	50	46	0	irq/30-eth0_g0_	12396	99	cyclictest	21:27:42	0
12	1	46	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	23:47:24	1
1217	50	45	0	irq/30-eth0_g0_	12396	99	cyclictest	23:52:44	0
1217	50	45	0	irq/30-eth0_g0_	12396	99	cyclictest	23:21:04	0
1217	50	45	0	irq/30-eth0_g0_	12396	99	cyclictest	00:23:28	0
1216	50	45	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	21:39:47	0
1216	50	45	0	irq/29-eth0_g0_	12396	99	cyclictest	23:31:50	0
12	1	45	0	ksoftirqd/1	12396	99	cyclictest	23:01:41	0
12	1	45	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	22:48:51	1
12	1	45	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	21:11:27	1
1217	50	44	0	irq/30-eth0_g0_	12396	99	cyclictest	22:26:43	0
1217	50	44	0	irq/30-eth0_g0_	12396	99	cyclictest	00:32:40	0
1216	50	44	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	20:39:41	0
1216	50	44	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	20:39:41	0
12	1	44	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	23:53:43	1
12	1	44	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	00:10:42	1
12	1	44	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	00:10:42	1
12	1	44	0	ksoftirqd/1	1216	50	irq/29-eth0_g0_	23:22:46	1
12	1	44	0	ksoftirqd/1	1216	50	irq/29-eth0_g0_	22:57:36	1
1217	50	43	0	irq/30-eth0_g0_	12396	99	cyclictest	23:12:47	0
1217	50	43	0	irq/30-eth0_g0_	1219	-21	kworker/1:2	22:24:00	1
1216	50	43	0	irq/29-eth0_g0_	0	-21	swapper/0	19:04:38	0
12	1	43	0	ksoftirqd/1	12396	99	cyclictest	23:06:18	0
12	1	43	0	ksoftirqd/1	12396	99	cyclictest	19:37:18	0
12	1	43	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	22:04:56	0
1217	50	42	0	irq/30-eth0_g0_	12396	99	cyclictest	22:04:05	0
1217	50	42	0	irq/30-eth0_g0_	12396	99	cyclictest	21:47:22	0
1217	50	42	0	irq/30-eth0_g0_	12396	99	cyclictest	21:11:57	0
1217	50	42	0	irq/30-eth0_g0_	1219	-21	kworker/1:2	22:10:33	1
1216	50	42	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	22:34:19	0
1216	50	42	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	22:34:19	0
1216	50	42	0	irq/29-eth0_g0_	12396	99	cyclictest	20:59:48	0
12	1	42	0	ksoftirqd/1	12396	99	cyclictest	22:17:18	0
12	1	42	0	ksoftirqd/1	12396	99	cyclictest	20:56:17	0
12	1	42	0	ksoftirqd/1	12396	99	cyclictest	20:36:36	0
12	1	42	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	23:25:15	0
12	1	42	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	20:14:43	0
1217	50	41	0	irq/30-eth0_g0_	12396	99	cyclictest	00:06:27	0
1217	50	41	0	irq/30-eth0_g0_	12396	99	cyclictest	00:00:09	0
12	1	41	0	ksoftirqd/1	12396	99	cyclictest	20:29:41	0
12	1	41	0	ksoftirqd/1	12396	99	cyclictest	00:18:55	0
12	1	41	0	ksoftirqd/1	1216	50	irq/29-eth0_g0_	23:55:19	1
12	1	41	0	ksoftirqd/1	1216	50	irq/29-eth0_g0_	23:25:09	1
1217	50	40	0	irq/30-eth0_g0_	1964	-21	runrttasks	19:09:14	1
1217	50	39	0	irq/30-eth0_g0_	10998	-21	taskset	21:14:45	1
1216	50	39	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	22:42:33	0
1216	50	39	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	00:37:07	0
12	1	39	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	22:45:53	0
12	1	39	0	ksoftirqd/1	1216	50	irq/29-eth0_g0_	22:59:39	1
12	1	39	0	ksoftirqd/1	1216	50	irq/29-eth0_g0_	19:24:36	1
12397	99	38	1	cyclictest	24105	-21	tail	00:19:46	1
1217	50	38	0	irq/30-eth0_g0_	1219	-21	kworker/1:2	21:38:27	1
1217	50	38	0	irq/30-eth0_g0_	1219	-21	kworker/1:2	00:32:56	1
1217	50	38	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	22:27:59	1
1217	50	38	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	21:24:02	1
12	1	38	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	19:54:58	0
12	1	38	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	19:30:42	0
12	1	38	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	19:19:35	0
12	1	38	0	ksoftirqd/1	1216	50	irq/29-eth0_g0_	20:19:44	1
12397	99	37	2	cyclictest	16065	-21	wc	19:24:28	1
1217	50	37	0	irq/30-eth0_g0_	1219	-21	kworker/1:2	23:30:59	1
1217	50	37	0	irq/30-eth0_g0_	1219	-21	kworker/1:2	22:03:03	1
1217	50	37	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	22:07:36	1
1216	50	37	0	irq/29-eth0_g0_	1964	-21	runrttasks	20:57:32	1
1216	50	37	0	irq/29-eth0_g0_	0	-21	swapper/1	20:29:28	1
1216	50	37	0	irq/29-eth0_g0_	0	-21	swapper/1	19:59:43	1
12	1	37	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	20:08:42	0
12	1	37	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	19:16:16	0
12	1	37	0	ksoftirqd/1	1216	50	irq/29-eth0_g0_	20:51:54	1
12397	99	36	6	cyclictest	30223	-21	cpu	22:34:38	1
12397	99	36	2	cyclictest	13651	-21	sort	21:24:48	1
12397	99	36	1	cyclictest	9283	-21	diskmemload	22:39:39	1
12397	99	36	1	cyclictest	20577	2	sleep1	00:05:20	1
1217	50	36	0	irq/30-eth0_g0_	8213	-21	grep	23:14:49	1
1217	50	36	0	irq/30-eth0_g0_	1219	-21	kworker/1:2	23:39:46	1
1217	50	36	0	irq/30-eth0_g0_	1219	-21	kworker/1:2	00:16:02	1
1217	50	36	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	00:36:24	1
1216	50	36	0	irq/29-eth0_g0_	8061	-21	taskset	21:04:27	1
12	1	36	0	ksoftirqd/1	1217	50	irq/30-eth0_g0_	19:49:46	1
12	1	36	0	ksoftirqd/1	1216	50	irq/29-eth0_g0_	22:15:19	1
12	1	36	0	ksoftirqd/1	1216	50	irq/29-eth0_g0_	21:51:12	1
12397	99	35	2	cyclictest	0	-21	swapper/1	22:51:57	1
12397	99	35	1	cyclictest	26311	-21	grep	20:04:46	1
12397	99	35	1	cyclictest	2352	-21	cat	20:39:42	1
12397	99	35	1	cyclictest	2352	-21	cat	20:39:42	1
12397	99	35	1	cyclictest	1964	-21	runrttasks	19:17:52	1
1217	50	35	0	irq/30-eth0_g0_	1219	-21	kworker/1:2	23:13:55	1
1216	50	35	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:46:44	0
1216	50	35	0	irq/29-eth0_g0_	12396	99	cyclictest	20:24:27	0
12397	99	34	1	cyclictest	24028	2	sleep1	19:54:49	1
12397	99	34	1	cyclictest	13108	2	sleep1	19:09:49	1
1216	50	34	0	irq/29-eth0_g0_	32500	2	sleep1	20:29:45	1
1216	50	34	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	20:09:42	1
12397	99	33	1	cyclictest	1227	2	sleep1	20:34:46	1
12397	99	33	1	cyclictest	0	-21	swapper/1	19:43:46	1
12397	99	33	1	cyclictest	0	-21	swapper/1	19:35:12	1
1217	50	33	0	irq/30-eth0_g0_	3798	-21	grep	20:44:45	1
1216	50	33	0	irq/29-eth0_g0_	1964	-21	runrttasks	20:50:01	0
1216	50	33	0	irq/29-eth0_g0_	1964	-21	runrttasks	19:53:55	0
12397	99	32	1	cyclictest	0	-21	swapper/1	19:31:24	1
1217	50	32	0	irq/30-eth0_g0_	20336	-21	zcat	19:39:45	0
1217	50	32	0	irq/30-eth0_g0_	0	-21	swapper/1	19:44:39	1
1216	50	32	0	irq/29-eth0_g0_	8144	-21	runrttasks	21:04:32	1
1217	50	31	0	irq/30-eth0_g0_	28742	-21	awk	20:14:43	1
1216	50	31	0	irq/29-eth0_g0_	0	-21	swapper/0	20:24:28	0
1216	50	30	0	irq/29-eth0_g0_	13644	-21	latency_hist	19:14:28	0
1216	50	29	0	irq/29-eth0_g0_	0	-21	swapper/0	19:27:56	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17