OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot3s.osadl.org (updated Mon Apr 06, 2026 00:43:36)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
22096	2	96	0,2	sleep2	0	-21	swapper/2	09:50:57	2
5332	99	95	25,18	cyclictest	12011	-21	ssh	08:20:48	0
1257	2	94	0,3	sleep2	5344	99	cyclictest	05:46:07	2
12026	2	92	0,2	sleep2	0	-21	swapper/2	08:20:50	2
1780	2	84	0,2	sleep3	1779	-21	ssh	06:50:57	3
27663	2	82	0,5	sleep0	5332	99	cyclictest	08:39:32	0
5332	99	79	19,48	cyclictest	0	-21	swapper/0	06:00:49	0
328	2	79	0,5	sleep3	5347	99	cyclictest	05:45:56	3
15449	2	79	0,2	sleep2	0	-21	swapper/2	09:03:38	2
5339	99	78	5,12	cyclictest	0	-21	swapper/1	09:45:51	1
5332	99	78	24,10	cyclictest	0	-21	swapper/0	07:40:50	0
5332	99	78	24,10	cyclictest	0	-21	swapper/0	07:40:50	0
5332	99	77	9,20	cyclictest	7869	-21	sh	08:15:49	0
27387	2	77	0,5	sleep2	5344	99	cyclictest	09:56:28	2
5339	99	75	37,12	cyclictest	1819	-21	/usr/sbin/munin	09:26:02	1
5339	99	73	36,13	cyclictest	12742	-21	aten_rbpower_cu	04:50:51	1
5339	99	73	33,16	cyclictest	17330	-21	if_err_eth0	09:05:57	1
20188	2	73	0,3	sleep0	20187	-21	tune2fs	05:10:55	0
17318	2	73	0,5	sleep0	5332	99	cyclictest	09:45:39	0
17318	2	73	0,5	sleep0	5332	99	cyclictest	09:45:39	0
5332	99	72	6,45	cyclictest	9	-21	ksoftirqd/0	07:50:51	0
5339	99	71	31,14	cyclictest	1	-21	systemd	07:21:05	1
5339	99	71	31,14	cyclictest	1	-21	systemd	07:21:05	1
16232	2	71	0,2	sleep1	0	-21	swapper/1	07:07:05	1
9453	2	70	0,3	sleep1	11	-21	rcu_preempt	07:38:05	1
5344	99	70	8,12	cyclictest	78	50	irq/56-dwc_otg_	08:55:51	2
5339	99	70	33,15	cyclictest	21051	-21	ssh	07:13:07	1
5339	99	69	31,24	cyclictest	17097	-21	sh	09:45:20	1
5339	99	69	31,24	cyclictest	17097	-21	sh	09:45:20	1
5339	99	69	30,19	cyclictest	31310	-21	rm	09:22:20	1
5339	99	68	33,19	cyclictest	27521	-21	ssh	06:42:55	1
5339	99	67	31,19	cyclictest	26307	-21	sed	05:26:04	1
5332	99	67	6,7	cyclictest	0	-21	swapper/0	06:50:51	0
5339	99	66	33,20	cyclictest	10060	-21	ssh	08:17:42	1
5339	99	66	31,20	cyclictest	26743	-21	ssh	09:16:34	1
5339	99	66	22,27	cyclictest	79	50	irq/56-dwc_otg_	09:31:26	1
5332	99	66	8,54	cyclictest	12540	-21	apt-get	06:20:39	0
5332	99	66	8,54	cyclictest	12540	-21	apt-get	06:20:39	0
5332	99	66	3,53	cyclictest	15979	-21	kworker/0:1	06:44:58	0
32748	2	66	0,3	sleep1	32738	-21	ssh	08:45:49	1
24221	2	66	0,5	sleep3	5347	99	cyclictest	05:21:00	3
5339	99	65	34,22	cyclictest	2019	-21	sort	06:50:59	1
5339	99	64	38,19	cyclictest	15156	-21	ssh	09:03:06	1
5339	99	64	32,15	cyclictest	17552	-21	ssh	08:26:14	1
5339	99	64	29,21	cyclictest	27436	-21	ssh	09:56:33	1
5339	99	64	28,14	cyclictest	27692	-21	ssh	08:00:42	1
5339	99	64	27,24	cyclictest	24658	-21	sh	09:54:02	1
5339	99	63	38,12	cyclictest	22198	-21	ssh	08:32:10	1
5339	99	63	35,18	cyclictest	17011	-21	ssh	07:46:46	1
5339	99	63	25,10	cyclictest	79	50	irq/56-dwc_otg_	08:40:48	1
5339	99	63	24,20	cyclictest	13961	-21	ssh	07:05:35	1
27344	2	63	0,2	sleep2	0	-21	swapper/2	08:38:58	2
5344	99	62	21,16	cyclictest	79	50	irq/56-dwc_otg_	06:40:52	2
5344	99	62	20,22	cyclictest	78	50	irq/56-dwc_otg_	05:30:52	2
5344	99	62	20,22	cyclictest	78	50	irq/56-dwc_otg_	05:30:52	2
5339	99	62	36,8	cyclictest	3751	-21	apt-get	05:55:52	1
5339	99	62	33,12	cyclictest	6994	-21	ssh	08:14:51	1
5339	99	62	32,15	cyclictest	24067	-21	latency	05:20:58	1
5339	99	62	31,17	cyclictest	22993	-21	ssh	07:55:06	1
5339	99	62	31,11	cyclictest	15366	-21	/usr/sbin/munin	06:26:00	1
5339	99	62	30,19	cyclictest	29469	-21	rm	06:45:45	1
5339	99	62	27,15	cyclictest	1998	-21	aten_rbpower_en	05:50:52	1
5339	99	62	26,13	cyclictest	23345	-21	latency_hist	05:20:39	1
5339	99	62	23,24	cyclictest	24417	-21	ssh	09:14:53	1
5332	99	62	2,29	cyclictest	0	-21	swapper/0	08:50:50	0
27028	2	62	0,2	sleep0	0	-21	swapper/0	07:59:55	0
5339	99	61	33,17	cyclictest	5679	-21	ssh	06:55:49	1
5339	99	61	30,14	cyclictest	13831	-21	ssh	07:43:31	1
5339	99	61	30,14	cyclictest	13831	-21	ssh	07:43:31	1
5339	99	61	28,22	cyclictest	745	-21	ssh	07:27:26	1
5339	99	61	28,11	cyclictest	0	-21	swapper/1	07:35:39	1
5339	99	61	27,11	cyclictest	78	50	irq/56-dwc_otg_	04:45:56	1
5344	99	60	22,20	cyclictest	0	-21	swapper/2	08:00:52	2
5339	99	60	34,8	cyclictest	23002	-21	df_inode	07:15:52	1
5339	99	60	29,12	cyclictest	11632	-21	ntpq	06:15:59	1
5339	99	60	29,12	cyclictest	11632	-21	ntpq	06:15:59	1
5339	99	60	27,16	cyclictest	26163	-21	ssh	07:58:19	1
5339	99	60	22,13	cyclictest	0	-21	swapper/1	09:00:38	1
5332	99	60	1,34	cyclictest	30748	-21	munin-run	07:25:39	0
5332	99	60	1,34	cyclictest	30748	-21	munin-run	07:25:39	0
5339	99	59	31,14	cyclictest	12817	-21	ssh	09:40:04	1
5339	99	59	27,14	cyclictest	6333	-21	ssh	08:52:07	1
5332	99	59	2,37	cyclictest	22330	-21	unixbench_singl	09:11:07	0
5332	99	59	13,11	cyclictest	0	-21	swapper/0	06:10:51	0
5339	99	58	33,16	cyclictest	23788	-21	ssh	06:38:53	1
5339	99	58	24,10	cyclictest	77	50	irq/56-dwc_otg	05:15:39	1
5339	99	58	21,24	cyclictest	0	-21	swapper/1	06:34:56	1
5332	99	58	31,5	cyclictest	78	50	irq/56-dwc_otg_	08:06:05	0
5339	99	57	32,13	cyclictest	28611	-21	chrt	05:34:30	1
5339	99	57	32,13	cyclictest	28611	-21	chrt	05:34:30	1
5339	99	57	27,11	cyclictest	12465	-21	if_eth0	08:20:57	1
5332	99	57	7,25	cyclictest	0	-21	swapper/0	04:40:52	0
5332	99	57	1,27	cyclictest	27969	-21	ls	08:00:53	0
5332	99	57	1,27	cyclictest	11365	-21	unixbench_singl	07:01:08	0
5339	99	56	27,10	cyclictest	0	-21	swapper/1	06:15:17	1
5339	99	56	25,16	cyclictest	28404	-21	date	08:40:39	1
5339	99	56	25,12	cyclictest	946	-21	ssh	08:06:24	1
5339	99	56	23,10	cyclictest	0	-21	swapper/1	05:50:38	1
5339	99	56	21,9	cyclictest	77	50	irq/56-dwc_otg	06:07:11	1
5347	99	55	33,9	cyclictest	79	50	irq/56-dwc_otg_	08:01:07	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17