OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack3slot5s.osadl.org (updated Tue Dec 16, 2025 01:37:43)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1471	99	385532	385507	cyclictest	0	-21	swapper/1	22:46:07	1
1469	99	385395	1	cyclictest	1941	-21	runrttasks	22:46:07	0
12	1	105	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	19:57:25	1
12	1	102	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:36:39	0
4135	2	96	0	sleep0	1214	50	irq/29-eth0_g0_	23:46:47	0
13330	2	96	0	sleep1	1215	50	irq/30-eth0_g0_	22:11:57	1
12	1	94	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:57:42	1
12	1	88	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	19:15:14	1
12	1	83	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:07:36	1
12	1	81	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	00:02:31	1
6254	2	70	0	sleep1	1215	50	irq/30-eth0_g0_	23:53:50	1
12	1	67	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:35:02	0
12	1	66	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	23:42:15	0
12	1	66	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	23:15:19	1
12	1	66	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	23:15:19	1
12	1	53	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:13:08	1
12	1	53	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	21:43:10	0
1214	50	50	0	irq/29-eth0_g0_	1469	99	cyclictest	00:27:33	0
1214	50	50	0	irq/29-eth0_g0_	1469	99	cyclictest	00:27:33	0
1214	50	49	0	irq/29-eth0_g0_	1469	99	cyclictest	19:42:42	0
12	1	48	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:55:32	1
12	1	48	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:30:41	1
7068	2	47	0	chrt	1215	50	irq/30-eth0_g0_	19:32:39	1
1215	50	47	0	irq/30-eth0_g0_	1469	99	cyclictest	22:41:15	0
1215	50	47	0	irq/30-eth0_g0_	1469	99	cyclictest	19:57:12	0
1214	50	47	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	21:52:43	0
1214	50	47	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	00:07:42	1
1214	50	46	0	irq/29-eth0_g0_	1469	99	cyclictest	23:07:09	0
12	1	46	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:46:25	1
12	1	46	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	19:52:36	1
1214	50	45	0	irq/29-eth0_g0_	1469	99	cyclictest	22:34:03	0
12	1	45	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	23:30:16	0
12	1	45	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	23:13:01	1
12	1	45	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	22:36:58	1
11837	2	45	0	sleep0	1215	50	irq/30-eth0_g0_	22:04:41	0
1214	50	44	0	irq/29-eth0_g0_	1469	99	cyclictest	23:37:47	0
12	1	44	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:48:35	1
12	1	44	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:01:52	1
12	1	44	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:22:02	0
12	1	44	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:39:21	1
12	1	44	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:18:51	0
12	1	44	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	20:48:12	1
1214	50	43	0	irq/29-eth0_g0_	1198	-21	unixbench_singl	19:07:42	0
12	1	43	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:29:23	1
12	1	43	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:07:35	0
1215	50	42	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	23:30:01	1
1215	50	42	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	22:19:07	1
1215	50	42	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	21:41:08	1
1215	50	42	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	21:19:59	1
1214	50	42	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	22:52:33	0
1214	50	42	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	00:12:20	0
1214	50	42	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	20:44:55	1
1214	50	42	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	20:17:44	1
12	1	42	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	23:29:07	0
12	1	42	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	21:49:50	0
1214	50	41	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	23:02:37	0
1214	50	41	0	irq/29-eth0_g0_	0	-21	swapper/0	23:54:16	0
1214	50	41	0	irq/29-eth0_g0_	0	-21	swapper/0	23:10:29	0
1471	99	40	1	cyclictest	2392	-21	unixbench_multi	23:37:42	1
1215	50	40	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	21:33:27	1
1215	50	40	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	21:33:27	1
1214	50	40	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	22:57:42	0
1214	50	40	0	irq/29-eth0_g0_	16215	-21	sshd	00:33:42	0
1214	50	40	0	irq/29-eth0_g0_	1469	99	cyclictest	21:17:40	0
1214	50	40	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	20:07:42	1
12	1	40	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	00:10:55	1
1471	99	39	1	cyclictest	3109	-21	df_abs	23:42:34	1
1215	50	39	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	21:29:22	1
1215	50	39	0	irq/30-eth0_g0_	12	1	ksoftirqd/1	21:58:26	1
1214	50	39	0	irq/29-eth0_g0_	1469	99	cyclictest	00:02:42	0
12	1	39	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:12:09	1
12	1	39	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	00:27:54	1
12	1	39	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	00:27:54	1
12	1	39	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	00:20:15	1
1471	99	38	2	cyclictest	29904	-21	egrep	21:07:33	1
1215	50	38	0	irq/30-eth0_g0_	643	-21	df_abs	19:07:34	1
1215	50	38	0	irq/30-eth0_g0_	30822	-21	diskmemload	23:27:25	1
1215	50	38	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	22:50:24	1
1214	50	38	0	irq/29-eth0_g0_	1469	99	cyclictest	22:29:10	0
1214	50	38	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	19:27:33	1
12	1	38	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:21:39	1
12	1	38	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	22:18:08	0
12	1	38	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:25:24	0
12	1	38	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:57:34	0
12	1	38	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:57:34	0
12	1	38	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:10:38	0
1471	99	37	1	cyclictest	9176	-21	grep	21:52:45	1
1471	99	37	1	cyclictest	18924	-21	grep	22:32:43	1
1215	50	37	0	irq/30-eth0_g0_	2104	-21	lldpd	20:03:25	1
1215	50	37	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	21:39:24	1
1215	50	37	0	irq/30-eth0_g0_	1221	-21	kworker/1:2	21:15:47	1
1214	50	37	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	22:05:17	0
1214	50	37	0	irq/29-eth0_g0_	1941	-21	runrttasks	23:18:41	0
1214	50	37	0	irq/29-eth0_g0_	1941	-21	runrttasks	23:18:41	0
1214	50	37	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	19:37:38	1
1214	50	37	0	irq/29-eth0_g0_	0	-21	swapper/0	21:57:54	0
1214	50	37	0	irq/29-eth0_g0_	0	-21	swapper/0	21:10:43	0
12	1	37	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:22:21	0
12	1	37	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:23:42	0
1471	99	36	1	cyclictest	30822	-21	diskmemload	23:20:33	1
1471	99	36	1	cyclictest	21387	-21	unixbench_singl	22:42:42	1
1471	99	36	1	cyclictest	19490	-21	cat	20:22:42	1
1215	50	36	0	irq/30-eth0_g0_	1941	-21	runrttasks	22:05:57	1
1215	50	36	0	irq/30-eth0_g0_	10	99	migration/1	20:27:42	1
1214	50	36	0	irq/29-eth0_g0_	1941	-21	runrttasks	21:07:31	0
1214	50	36	0	irq/29-eth0_g0_	1941	-21	runrttasks	20:35:10	0
1214	50	36	0	irq/29-eth0_g0_	1941	-21	runrttasks	20:15:42	0
1214	50	36	0	irq/29-eth0_g0_	1941	-21	runrttasks	19:25:29	0
1214	50	36	0	irq/29-eth0_g0_	0	-21	swapper/0	23:21:06	0
1214	50	36	0	irq/29-eth0_g0_	0	-21	swapper/0	22:12:51	0
12	1	36	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:34:46	0
12	1	36	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	21:34:46	0
12	1	36	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	00:08:26	0
12	1	36	0	ksoftirqd/1	1214	50	irq/29-eth0_g0_	19:21:39	1
1471	99	35	1	cyclictest	2389	-21	timerandwakeup	19:12:41	1
1471	99	35	1	cyclictest	11938	-21	ntpq	00:17:39	1
1215	50	35	0	irq/30-eth0_g0_	21708	-21	netstat	20:32:36	1
1215	50	35	0	irq/30-eth0_g0_	11175	-21	/usr/sbin/munin	22:02:36	1
1214	50	35	0	irq/29-eth0_g0_	20788	-21	unixbench_singl	20:27:42	0
1214	50	35	0	irq/29-eth0_g0_	19550	-21	unixbench_multi	20:22:43	0
1214	50	35	0	irq/29-eth0_g0_	1941	-21	runrttasks	20:31:01	0
1214	50	35	0	irq/29-eth0_g0_	1941	-21	runrttasks	20:04:39	0
1214	50	35	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:58:30	0
1214	50	35	0	irq/29-eth0_g0_	10600	-21	latency	19:47:35	0
1214	50	35	0	irq/29-eth0_g0_	0	-21	swapper/0	00:37:17	0
12	1	35	0	ksoftirqd/1	22789	-21	chrt	20:37:35	1
1471	99	34	1	cyclictest	26471	-21	seq	20:52:36	1
1214	50	34	0	irq/29-eth0_g0_	3664	-21	sed	19:17:42	0
1214	50	34	0	irq/29-eth0_g0_	29380	-21	unixbench_singl	21:02:43	0
1214	50	34	0	irq/29-eth0_g0_	26238	-21	cpu	20:52:33	0
1214	50	34	0	irq/29-eth0_g0_	1769	-21	/usr/sbin/munin	19:12:38	0
12	1	34	0	ksoftirqd/1	27915	-21	ps	20:57:40	1
12	1	34	0	ksoftirqd/1	27915	-21	ps	20:57:40	1
12	1	34	0	ksoftirqd/1	1215	50	irq/30-eth0_g0_	20:42:13	0
1214	50	33	0	irq/29-eth0_g0_	9109	-21	runrttasks	19:42:30	1
1214	50	33	0	irq/29-eth0_g0_	7401	-21	vmstat	19:32:44	0
1214	50	33	0	irq/29-eth0_g0_	1941	-21	runrttasks	20:45:28	0
1214	50	33	0	irq/29-eth0_g0_	1941	-21	runrttasks	19:35:19	0
1214	50	33	0	irq/29-eth0_g0_	1941	-21	runrttasks	19:20:28	0
1214	50	33	0	irq/29-eth0_g0_	11618	-21	df	19:52:32	0
1471	99	32	1	cyclictest	10919	-21	timerandwakeup	19:47:41	1
1215	50	32	0	irq/30-eth0_g0_	0	-21	swapper/1	21:03:09	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17