OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot4s.osadl.org (updated Sun Mar 22, 2026 12:44:15)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1111271	2	161	0,2	sleep3	47	1	rcuc/3	12:06:39	3
1075388	2	153	0,3	sleep3	75	-21	kworker/3:1+events	11:31:40	3
1030209	2	101	0,0	chrt	20	1	rcuc/0	10:46:38	0
904833	2	86	0,6	chrt	0	-21	swapper/1	08:41:35	1
854120	2	65	0,3	sleep3	75	-21	kworker/3:1-events	07:46:48	3
932897	2	54	0,6	chrt	0	-21	swapper/2	09:06:40	2
813034	99	53	47,4	cyclictest	780480	-21	kworker/u8:3+events_unbound	07:15:05	1
813034	99	53	47,4	cyclictest	780480	-21	kworker/u8:3+events_unbound	07:15:04	1
813034	99	52	47,3	cyclictest	1038441	-21	kworker/u8:2+events_unbound	12:21:39	1
813034	99	52	46,5	cyclictest	941777	-21	kworker/u8:3+events_unbound	11:05:01	1
813034	99	50	41,7	cyclictest	1082989	-21	latency_hist	11:40:01	1
840170	2	49	0,5	sleep1	840171	-21	aten2_r5power_e	07:36:31	1
813034	99	49	43,4	cyclictest	1057246	-21	kworker/u8:1+events_unbound	11:50:00	1
813034	99	49	40,6	cyclictest	869564	-21	latency_hist	08:05:01	1
813038	99	47	43,3	cyclictest	1003816	-21	kworker/u8:1+flush-8:0	10:21:47	2
813034	99	47	41,4	cyclictest	1038441	-21	kworker/u8:2+events_unbound	11:55:00	1
813034	99	46	41,3	cyclictest	988997	-21	kworker/u8:0+events_unbound	11:41:47	1
813034	99	46	40,4	cyclictest	770542	-21	kworker/u8:1+events_unbound	07:26:47	1
813034	99	46	38,6	cyclictest	988997	-21	kworker/u8:0+flush-8:0	10:51:37	1
813034	99	45	40,3	cyclictest	1038441	-21	kworker/u8:2+events_unbound	12:05:00	1
813034	99	45	38,5	cyclictest	820054	-21	kworker/u8:2+flush-8:0	08:51:49	1
813034	99	45	38,5	cyclictest	820054	-21	kworker/u8:2+flush-8:0	08:51:49	1
813031	99	45	35,7	cyclictest	978803	-21	latency_hist	09:55:01	0
813034	99	44	39,4	cyclictest	820054	-21	kworker/u8:2+events_unbound	09:30:01	1
813034	99	44	37,5	cyclictest	780480	-21	kworker/u8:3+flush-8:0	07:11:47	1
813034	99	44	37,5	cyclictest	1038441	-21	kworker/u8:2+flush-8:0	11:16:43	1
813031	99	44	35,6	cyclictest	817870	-21	latency_hist	07:15:00	0
813038	99	43	38,3	cyclictest	820054	-21	kworker/u8:2+flush-8:0	09:16:47	2
813034	99	43	38,3	cyclictest	963972	-21	kworker/u8:1+flush-8:0	09:46:34	1
813034	99	43	37,5	cyclictest	974096	-21	kworker/u8:0+flush-8:0	09:56:37	1
813034	99	43	36,5	cyclictest	1038441	-21	kworker/u8:2+flush-8:0	10:56:34	1
813034	99	43	35,6	cyclictest	820054	-21	kworker/u8:2+flush-8:0	08:36:47	1
813034	99	42	37,3	cyclictest	820054	-21	kworker/u8:2+events_unbound	08:56:39	1
813034	99	42	34,6	cyclictest	1093102	-21	kworker/u8:3+flush-8:0	12:11:42	1
813031	99	42	1,39	cyclictest	1	-21	systemd	07:20:00	0
813031	99	42	1,39	cyclictest	1	-21	systemd	07:20:00	0
813034	99	41	36,3	cyclictest	820054	-21	kworker/u8:2+events_unbound	09:36:36	1
813034	99	41	36,3	cyclictest	1038441	-21	kworker/u8:2+flush-8:0	11:11:38	1
813034	99	41	35,5	cyclictest	1003816	-21	kworker/u8:1+flush-8:0	10:21:42	1
813034	99	41	34,5	cyclictest	1093102	-21	kworker/u8:3+events_unbound	12:06:43	1
813034	99	41	32,7	cyclictest	899211	-21	latency_hist	08:35:01	1
813038	99	40	35,4	cyclictest	844769	-21	idleruntime-cro	07:40:00	2
813034	99	40	36,3	cyclictest	1057246	-21	kworker/u8:1+events_unbound	11:21:49	1
813034	99	40	35,4	cyclictest	854927	-21	kworker/u8:3+events_unbound	07:55:01	1
813034	99	39	34,4	cyclictest	820054	-21	kworker/u8:2+events_unbound	09:21:31	1
813034	99	39	32,5	cyclictest	988997	-21	kworker/u8:0+flush-8:0	10:41:48	1
813034	99	39	32,5	cyclictest	988997	-21	kworker/u8:0+flush-8:0	10:41:48	1
813034	99	39	32,4	cyclictest	1013474	-21	latency_hist	10:30:01	1
813034	99	39	31,6	cyclictest	1137935	-21	latency_hist	12:35:00	1
813034	99	38	34,3	cyclictest	820054	-21	kworker/u8:2+flush-8:0	10:16:49	1
813034	99	38	33,4	cyclictest	988997	-21	kworker/u8:0+events_unbound	11:06:33	1
813034	99	37	32,4	cyclictest	919173	-21	kworker/u8:1+events_unbound	09:16:33	1
813034	99	37	29,6	cyclictest	1133001	-21	latency_hist	12:30:00	1
813034	99	37	27,7	cyclictest	280	-21	systemd-journal	07:57:14	1
813034	99	36	31,4	cyclictest	854927	-21	kworker/u8:3+flush-8:0	08:16:36	1
813034	99	36	29,5	cyclictest	1018410	-21	latency_hist	10:35:01	1
813031	99	36	28,5	cyclictest	280	-21	systemd-journal	07:30:28	0
813031	99	36	27,7	cyclictest	848908	-21	ntpq	07:41:42	0
813038	99	35	30,3	cyclictest	941777	-21	kworker/u8:3+events_unbound	09:41:46	2
813038	99	35	30,3	cyclictest	1123033	-21	latency_hist	12:20:00	2
813034	99	35	29,5	cyclictest	1132434	-21	kworker/u8:1+flush-8:0	12:36:49	1
813034	99	35	29,5	cyclictest	1132434	-21	kworker/u8:1+flush-8:0	12:36:49	1
813034	99	35	29,4	cyclictest	854927	-21	kworker/u8:3+events_unbound	08:06:33	1
813034	99	35	27,6	cyclictest	941777	-21	kworker/u8:3+flush-8:0	09:31:40	1
813034	99	35	27,6	cyclictest	849455	-21	grep	07:41:48	1
813034	99	35	27,6	cyclictest	1038441	-21	kworker/u8:2+flush-8:0	11:26:37	1
813038	99	34	31,2	cyclictest	879455	-21	apt	08:15:00	2
813038	99	34	30,3	cyclictest	1003816	-21	kworker/u8:1+flush-8:0	10:31:42	2
813034	99	34	30,3	cyclictest	963972	-21	kworker/u8:1+events_unbound	09:40:38	1
813034	99	34	29,3	cyclictest	1038441	-21	kworker/u8:2+events_unbound	11:56:41	1
813034	99	34	28,4	cyclictest	820054	-21	kworker/u8:2+events_unbound	10:06:36	1
813034	99	34	28,4	cyclictest	820054	-21	kworker/u8:2+events_unbound	07:21:45	1
813034	99	34	23,8	cyclictest	933802	-21	true	09:10:01	1
813038	99	33	28,3	cyclictest	958510	-21	apt-get	09:35:00	2
813038	99	33	26,5	cyclictest	1083320	-21	cat	11:40:01	2
813038	99	33	24,7	cyclictest	280	-21	systemd-journal	10:20:00	2
813034	99	33	27,4	cyclictest	1003816	-21	kworker/u8:1+flush-8:0	10:36:37	1
813031	99	33	26,4	cyclictest	889342	-21	latency_hist	08:25:01	0
813031	99	33	25,6	cyclictest	958506	-21	latency_hist	09:35:01	0
813031	99	33	1,29	cyclictest	1063024	-21	munin-run	11:20:02	0
808250	2	33	3,6	sleep1	0	-21	swapper/1	07:06:18	1
813038	99	32	27,3	cyclictest	870146	-21	cpuspeed_turbos	08:06:32	2
813034	99	32	26,4	cyclictest	864631	-21	kworker/u8:0+flush-8:0	08:11:39	1
813031	99	32	25,5	cyclictest	854927	-21	kworker/u8:3+flush-8:0	07:56:35	0
813031	99	32	23,6	cyclictest	998988	-21	/usr/sbin/munin	10:16:48	0
813034	99	31	26,4	cyclictest	854927	-21	kworker/u8:3+events_unbound	08:46:43	1
813034	99	31	25,4	cyclictest	820054	-21	kworker/u8:2+events_unbound	08:26:41	1
813034	99	31	23,6	cyclictest	1078077	-21	latency_hist	11:35:01	1
813031	99	31	22,6	cyclictest	1008539	-21	latency_hist	10:25:01	0
813038	99	30	25,3	cyclictest	1013178	-21	unixbench_singl	10:26:49	2
813034	99	30	24,4	cyclictest	889359	-21	systemd-run	08:25:00	1
813031	99	30	25,3	cyclictest	401	-21	dbus-daemon	08:10:00	0
813031	99	30	20,8	cyclictest	1098632	-21	diskstats	11:56:34	0
889696	2	29	0,2	chrt	45	1	irq_work/3	08:26:29	3
813038	99	29	26,2	cyclictest	839477	-21	unixbench_singl	07:31:52	2
813038	99	29	25,2	cyclictest	963707	-21	systemctl	09:40:00	2
813038	99	29	24,4	cyclictest	854927	-21	kworker/u8:3+flush-8:0	08:41:39	2
813034	99	29	23,5	cyclictest	974096	-21	kworker/u8:0+flush-8:0	09:51:44	1
813031	99	29	22,5	cyclictest	280	-21	systemd-journal	09:00:51	0
813034	99	28	24,2	cyclictest	1029404	-21	irqrtprio	10:46:37	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17