OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack4slot1s.osadl.org (updated Sun Jun 07, 2026 06:45:44)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
9678	2	148	0,2	sleep3	0	-21	swapper/3	06:14:05	3
9678	2	148	0,2	sleep3	0	-21	swapper/3	06:14:05	3
9678	2	148	0,2	sleep3	0	-21	swapper/3	06:14:05	3
22030	2	145	0,6	chrt	22040	-21	sort	06:14:43	0
22030	2	145	0,6	chrt	22040	-21	sort	06:14:43	0
22030	2	145	0,6	chrt	22040	-21	sort	06:14:43	0
14969	2	144	0,2	sleep1	14973	-21	rm	06:14:21	1
14969	2	144	0,2	sleep1	14973	-21	rm	06:14:21	1
14969	2	144	0,2	sleep1	14973	-21	rm	06:14:21	1
22754	2	139	0,2	sleep2	0	-21	swapper/2	06:14:45	2
22754	2	139	0,2	sleep2	0	-21	swapper/2	06:14:45	2
22754	2	139	0,2	sleep2	0	-21	swapper/2	06:14:45	2
3110	2	137	0,2	sleep2	0	-21	swapper/2	05:22:41	2
3110	2	137	0,2	sleep2	0	-21	swapper/2	05:22:41	2
7356	2	129	0,2	sleep2	0	-21	swapper/2	05:53:15	2
7356	2	129	0,2	sleep2	0	-21	swapper/2	05:53:15	2
7356	2	129	0,2	sleep2	0	-21	swapper/2	05:53:15	2
6302	2	124	0,3	sleep2	0	-21	swapper/2	05:35:12	2
25126	2	124	0,3	sleep2	0	-21	swapper/2	05:45:17	2
25126	2	124	0,3	sleep2	0	-21	swapper/2	05:45:17	2
25126	2	124	0,3	sleep2	0	-21	swapper/2	05:45:17	2
25126	2	124	0,3	sleep2	0	-21	swapper/2	05:45:17	2
7084	2	123	0,3	chrt	0	-21	swapper/2	05:52:43	2
7084	2	123	0,3	chrt	0	-21	swapper/2	05:52:43	2
22898	2	121	0,3	chrt	0	-21	swapper/0	05:43:37	0
22898	2	121	0,3	chrt	0	-21	swapper/0	05:43:37	0
22898	2	121	0,3	chrt	0	-21	swapper/0	05:43:37	0
22898	2	121	0,3	chrt	0	-21	swapper/0	05:43:37	0
22163	2	118	0,1	sleep2	0	-21	swapper/2	06:13:01	2
22163	2	118	0,1	sleep2	0	-21	swapper/2	06:13:01	2
22163	2	118	0,1	sleep2	0	-21	swapper/2	06:13:01	2
22163	2	118	0,1	sleep2	0	-21	swapper/2	06:13:01	2
18012	2	115	0,3	chrt	0	-21	swapper/2	06:06:05	2
18012	2	115	0,3	chrt	0	-21	swapper/2	06:06:05	2
18012	2	115	0,3	chrt	0	-21	swapper/2	06:06:05	2
5627	2	114	0,2	sleep2	0	-21	swapper/2	05:31:22	2
5627	2	114	0,2	sleep2	0	-21	swapper/2	05:31:22	2
9830	2	113	0,2	sleep2	0	-21	swapper/2	06:02:18	2
9830	2	113	0,2	sleep2	0	-21	swapper/2	06:02:18	2
9830	2	113	0,2	sleep2	0	-21	swapper/2	06:02:18	2
5508	2	110	0,1	chrt	5479	-21	fstime	05:30:04	1
5508	2	110	0,1	chrt	5479	-21	fstime	05:30:04	1
30639	2	110	0,3	sleep1	0	-21	swapper/1	05:37:17	1
3447	2	105	0,3	sleep1	27	1	rcuc/1	05:23:45	1
3447	2	105	0,3	sleep1	27	1	rcuc/1	05:23:45	1
3447	2	105	0,3	sleep1	27	1	rcuc/1	05:23:45	1
7339	2	101	0,2	sleep0	7335	-21	execl	05:53:01	0
7339	2	101	0,2	sleep0	7335	-21	execl	05:53:01	0
7339	2	101	0,2	sleep0	7335	-21	execl	05:53:01	0
28486	2	101	0,2	sleep1	0	-21	swapper/1	05:42:20	1
28486	2	101	0,2	sleep1	0	-21	swapper/1	05:42:20	1
28486	2	101	0,2	sleep1	0	-21	swapper/1	05:42:20	1
24543	2	100	0,3	chrt	0	-21	swapper/2	05:42:09	2
24543	2	100	0,3	chrt	0	-21	swapper/2	05:42:09	2
24543	2	100	0,3	chrt	0	-21	swapper/2	05:42:09	2
7797	2	99	0,2	sleep3	0	-21	swapper/3	05:57:31	3
7797	2	99	0,2	sleep3	0	-21	swapper/3	05:57:31	3
7797	2	99	0,2	sleep3	0	-21	swapper/3	05:57:31	3
3748	2	97	0,1	chrt	3694	-21	fstime	05:27:10	0
3748	2	97	0,1	chrt	3694	-21	fstime	05:27:10	0
3748	2	97	0,1	chrt	3694	-21	fstime	05:27:10	0
24643	2	94	0,4	sleep1	24639	-21	sort	06:10:15	1
24643	2	94	0,4	sleep1	24639	-21	sort	06:10:15	1
24643	2	94	0,4	sleep1	24639	-21	sort	06:10:15	1
24643	2	94	0,4	sleep1	24639	-21	sort	06:10:15	1
21419	2	94	0,3	sleep0	21440	-21	basename	06:12:58	0
21419	2	94	0,3	sleep0	21440	-21	basename	06:12:58	0
21419	2	94	0,3	sleep0	21440	-21	basename	06:12:58	0
21419	2	94	0,3	sleep0	21440	-21	basename	06:12:58	0
13446	2	92	0,2	sleep3	0	-21	swapper/3	05:43:11	3
13446	2	92	0,2	sleep3	0	-21	swapper/3	05:43:11	3
13446	2	92	0,2	sleep3	0	-21	swapper/3	05:43:11	3
13446	2	92	0,2	sleep3	0	-21	swapper/3	05:43:11	3
24503	2	88	0,7	sleep1	24506	-21	unixbench-2d	06:43:10	1
24503	2	88	0,7	sleep1	24506	-21	unixbench-2d	06:43:10	1
24503	2	88	0,7	sleep1	24506	-21	unixbench-2d	06:43:10	1
8409	2	87	0,5	chrt	8407	-21	if_err_eth0	05:57:57	1
8409	2	87	0,5	chrt	8407	-21	if_err_eth0	05:57:57	1
8409	2	87	0,5	chrt	8407	-21	if_err_eth0	05:57:57	1
23269	2	85	0,1	sleep1	0	-21	swapper/1	05:43:38	1
23269	2	85	0,1	sleep1	0	-21	swapper/1	05:43:38	1
23269	2	85	0,1	sleep1	0	-21	swapper/1	05:43:38	1
23269	2	85	0,1	sleep1	0	-21	swapper/1	05:43:38	1
26555	2	84	0,3	sleep3	0	-21	swapper/3	06:11:43	3
26555	2	84	0,3	sleep3	0	-21	swapper/3	06:11:43	3
26555	2	84	0,3	sleep3	0	-21	swapper/3	06:11:43	3
26555	2	84	0,3	sleep3	0	-21	swapper/3	06:11:43	3
9986	2	83	0,2	sleep1	9900	-21	pipe	06:02:49	1
9986	2	83	0,2	sleep1	9900	-21	pipe	06:02:49	1
9986	2	83	0,2	sleep1	9900	-21	pipe	06:02:49	1
11588	2	82	0,2	sleep3	0	-21	swapper/3	06:03:56	3
11588	2	82	0,2	sleep3	0	-21	swapper/3	06:03:56	3
11588	2	82	0,2	sleep3	0	-21	swapper/3	06:03:56	3
7083	2	81	0,1	sleep1	7065	-21	execl	05:52:42	1
7083	2	81	0,1	sleep1	7065	-21	execl	05:52:42	1
3856	2	81	0,3	sleep2	0	-21	swapper/2	05:27:48	2
3856	2	81	0,3	sleep2	0	-21	swapper/2	05:27:48	2
3856	2	81	0,3	sleep2	0	-21	swapper/2	05:27:48	2
11494	2	79	0,3	chrt	21389	-21	spawn	06:06:44	1
11494	2	79	0,3	chrt	21389	-21	spawn	06:06:44	1
11494	2	79	0,3	chrt	21389	-21	spawn	06:06:44	1
13014	2	76	0,3	sleep0	11944	-21	spawn	06:06:03	0
13014	2	76	0,3	sleep0	11944	-21	spawn	06:06:03	0
13014	2	76	0,3	sleep0	11944	-21	spawn	06:06:03	0
3094	2	75	0,1	chrt	0	-21	swapper/1	05:22:28	1
3094	2	75	0,1	chrt	0	-21	swapper/1	05:22:28	1
25056	2	70	0,3	chrt	0	-21	swapper/2	06:47:49	2
25056	2	70	0,3	chrt	0	-21	swapper/2	06:47:49	2
25056	2	70	0,3	chrt	0	-21	swapper/2	06:47:49	2
5392	2	60	0,4	sleep0	0	-21	swapper/0	05:28:48	0
5392	2	60	0,4	sleep0	0	-21	swapper/0	05:28:48	0
3731	2	59	0,3	sleep3	0	-21	swapper/3	05:26:57	3
3731	2	59	0,3	sleep3	0	-21	swapper/3	05:26:57	3
3731	2	59	0,3	sleep3	0	-21	swapper/3	05:26:57	3
9702	2	58	0,3	sleep3	43	1	rcuc/3	06:01:34	3
9702	2	58	0,3	sleep3	43	1	rcuc/3	06:01:34	3
9702	2	58	0,3	sleep3	43	1	rcuc/3	06:01:34	3
5709	2	56	0,2	chrt	0	-21	swapper/3	05:32:04	3
5709	2	56	0,2	chrt	0	-21	swapper/3	05:32:04	3
22133	2	55	0,3	sleep3	0	-21	swapper/3	06:38:06	3
22133	2	55	0,3	sleep3	0	-21	swapper/3	06:38:06	3
16213	2	55	0,1	chrt	16205	-21	if_wlan0	06:23:03	0
16213	2	55	0,1	chrt	16205	-21	if_wlan0	06:23:03	0
16213	2	55	0,1	chrt	16205	-21	if_wlan0	06:23:03	0
7337	2	54	0,1	sleep0	26758	-21	spawn	05:36:24	0
9903	2	51	0,1	sleep0	9898	-21	pipe	06:02:45	0
9903	2	51	0,1	sleep0	9898	-21	pipe	06:02:45	0
9903	2	51	0,1	sleep0	9898	-21	pipe	06:02:45	0
10196	2	49	0,4	sleep3	0	-21	swapper/3	05:41:25	3
10196	2	49	0,4	sleep3	0	-21	swapper/3	05:41:25	3
10196	2	49	0,4	sleep3	0	-21	swapper/3	05:41:25	3
9296	2	45	0,3	sleep0	17	1	ktimers/0	05:43:00	0
7184	2	45	0,2	sleep3	0	-21	swapper/3	05:52:52	3
7184	2	45	0,2	sleep3	0	-21	swapper/3	05:52:52	3
7740	2	44	0,3	sleep0	7743	-21	sort	05:42:55	0
7740	2	44	0,3	sleep0	7743	-21	sort	05:42:55	0
3106	2	41	0,2	chrt	0	-21	swapper/3	05:22:38	3
3106	2	41	0,2	chrt	0	-21	swapper/3	05:22:38	3
6077	2	39	0,2	sleep3	0	-21	swapper/3	05:33:20	3
30298	99	36	29,5	cyclictest	27	1	rcuc/1	05:15:33	1
7067	2	35	0,2	sleep0	0	-21	swapper/0	05:52:29	0
7067	2	35	0,2	sleep0	0	-21	swapper/0	05:52:29	0
30298	99	30	9,10	cyclictest	29	-21	ksoftirqd/1	06:28:29	1
30298	99	30	9,10	cyclictest	29	-21	ksoftirqd/1	06:28:29	1
30298	99	30	9,10	cyclictest	29	-21	ksoftirqd/1	06:28:29	1
30298	99	29	15,3	cyclictest	18	1	rcu_preempt	06:38:00	1
30298	99	29	15,3	cyclictest	18	1	rcu_preempt	06:38:00	1
30297	99	29	21,6	cyclictest	550	-21	cron	06:43:00	0
30297	99	29	21,6	cyclictest	550	-21	cron	06:43:00	0
30297	99	29	21,6	cyclictest	550	-21	cron	06:43:00	0
30298	99	28	15,2	cyclictest	18	1	rcu_preempt	06:22:31	1
30298	99	28	15,2	cyclictest	18	1	rcu_preempt	06:22:31	1
30298	99	27	20,2	cyclictest	18	1	rcu_preempt	06:27:07	1
30298	99	27	20,2	cyclictest	18	1	rcu_preempt	06:27:07	1
30298	99	27	20,2	cyclictest	18	1	rcu_preempt	06:27:07	1
30298	99	27	19,6	cyclictest	20703	-21	unixbench-2d	06:33:09	1
30298	99	27	19,6	cyclictest	20703	-21	unixbench-2d	06:33:09	1
30297	99	27	23,2	cyclictest	0	-21	swapper/0	06:42:46	0
30297	99	27	23,2	cyclictest	0	-21	swapper/0	06:42:46	0
30297	99	26	22,2	cyclictest	0	-21	swapper/0	06:18:05	0
30297	99	26	22,2	cyclictest	0	-21	swapper/0	06:18:05	0
30297	99	26	22,2	cyclictest	0	-21	swapper/0	05:22:47	0
30297	99	26	22,2	cyclictest	0	-21	swapper/0	05:22:47	0
30297	99	23	18,3	cyclictest	0	-21	swapper/0	05:17:46	0
30297	99	22	17,3	cyclictest	0	-21	swapper/0	06:33:01	0
30297	99	22	17,3	cyclictest	0	-21	swapper/0	06:33:01	0
30297	99	22	16,4	cyclictest	19347	-21	idleruntime-cro	06:32:48	0
30297	99	22	16,4	cyclictest	19347	-21	idleruntime-cro	06:32:48	0
30297	99	22	16,4	cyclictest	19347	-21	idleruntime-cro	06:32:48	0
20186	2	20	0,3	sleep3	0	-21	swapper/3	06:33:03	3
20186	2	20	0,3	sleep3	0	-21	swapper/3	06:33:03	3
30299	99	17	1,11	cyclictest	17795	-21	chrt	06:27:59	2
30299	99	17	1,11	cyclictest	17795	-21	chrt	06:27:59	2
30299	99	17	1,11	cyclictest	17795	-21	chrt	06:27:59	2
30301	99	15	1,8	cyclictest	0	-21	swapper/3	05:12:58	3
30301	99	15	1,11	cyclictest	0	-21	swapper/3	06:47:52	3
30301	99	15	1,11	cyclictest	0	-21	swapper/3	06:47:52	3
30301	99	15	1,11	cyclictest	0	-21	swapper/3	06:47:52	3
30301	99	15	1,10	cyclictest	0	-21	swapper/3	06:23:01	3
30301	99	15	1,10	cyclictest	0	-21	swapper/3	06:23:01	3
30301	99	15	1,10	cyclictest	0	-21	swapper/3	06:23:01	3
30299	99	15	3,8	cyclictest	0	-21	swapper/2	06:38:22	2
30299	99	15	3,8	cyclictest	0	-21	swapper/2	06:38:22	2
15308	2	15	1,2	sleep2	0	-21	swapper/2	06:20:17	2
15308	2	15	1,2	sleep2	0	-21	swapper/2	06:20:17	2
30301	99	14	1,9	cyclictest	18669	-21	chrt	06:28:09	3
30301	99	14	1,9	cyclictest	18669	-21	chrt	06:28:09	3
30301	99	14	1,9	cyclictest	18669	-21	chrt	06:28:09	3
30299	99	14	1,10	cyclictest	32042	-21	chrt	05:13:00	2
30299	99	14	1,10	cyclictest	20314	-21	taskset	06:33:06	2
30299	99	14	1,10	cyclictest	20314	-21	taskset	06:33:06	2
30301	99	13	9,2	cyclictest	0	-21	swapper/3	06:18:03	3
30301	99	13	9,2	cyclictest	0	-21	swapper/3	06:18:03	3
30299	99	13	8,3	cyclictest	19211	2	chrt	06:31:13	2
30299	99	13	8,3	cyclictest	19211	2	chrt	06:31:13	2
30299	99	13	8,3	cyclictest	19211	2	chrt	06:31:13	2
plot	10:48:58	8
set	yrange	[0.8:*]		5
set	ylabel	"Number	of	latency	samples"		6
set	xrange	[0:400]		4
set	xlabel	"Latency	us	-	Maximum	us	plotted	on		2
set	title	"Latency	rack4slot1s"		0
set	terminal	pbm	color		1
set	output	"r4s1s.ppm"		7
set	logscale	y		3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17