OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot4s.osadl.org (updated Wed Nov 19, 2025 12:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
51926	99	66	55,7	cyclictest	282	-21	systemd-journal	09:01:35	1
379402	2	65	0,5	sleep2	0	-21	swapper/2	12:36:26	2
358786	2	61	0,5	chrt	0	-21	swapper/2	12:16:23	2
51919	99	58	52,4	cyclictest	267606	-21	kworker/u8:0+events_unbound	11:36:31	0
51930	99	57	52,4	cyclictest	284875	-21	kworker/u8:1+events_unbound	11:11:36	2
51926	99	56	46,7	cyclictest	98332	-21	latency_hist	07:55:01	1
51919	99	56	46,7	cyclictest	132870	-21	kworker/u8:2+flush-8:0	08:51:26	0
51919	99	56	44,9	cyclictest	306207	-21	ntpq	11:21:32	0
51926	99	55	31,15	cyclictest	16	1	rcu_preempt	12:20:00	1
51926	99	54	31,15	cyclictest	16	1	rcu_preempt	11:45:00	1
309117	2	54	0,3	chrt	0	-21	swapper/1	11:26:22	1
51926	99	53	36,14	cyclictest	256632	-21	ntpq	10:31:27	1
51926	99	52	42,8	cyclictest	152082	-21	ntpq	08:46:25	1
51919	99	52	39,8	cyclictest	267606	-21	kworker/u8:0+events_unbound	11:31:14	0
51926	99	51	24,13	cyclictest	16	1	rcu_preempt	07:31:33	1
51919	99	51	46,3	cyclictest	284875	-21	kworker/u8:1+flush-8:0	11:06:36	0
51919	99	50	43,5	cyclictest	142922	-21	cp	08:40:00	0
51919	99	50	43,5	cyclictest	142922	-21	cp	08:40:00	0
51919	99	50	1,46	cyclictest	1	-21	systemd	11:30:00	0
51919	99	49	44,3	cyclictest	225423	-21	kworker/u8:1+flush-8:0	10:31:27	0
51919	99	49	44,3	cyclictest	10361	-21	kworker/u8:3+events_unbound	08:06:25	0
51919	99	48	42,4	cyclictest	10361	-21	kworker/u8:3+flush-8:0	07:21:29	0
301139	2	48	0,4	sleep3	586	-21	kworker/3:2-events	11:16:29	3
51930	99	46	42,3	cyclictest	10361	-21	kworker/u8:3+events_unbound	07:41:27	2
51919	99	46	42,3	cyclictest	10361	-21	kworker/u8:3+flush-8:0	11:16:36	0
51919	99	46	40,4	cyclictest	306976	-21	kworker/u8:2+flush-8:0	12:21:25	0
51919	99	46	40,4	cyclictest	225423	-21	kworker/u8:1+events_unbound	10:41:29	0
51926	99	45	25,9	cyclictest	68973	-21	apt-get	07:26:14	1
51926	99	45	20,11	cyclictest	0	-21	swapper/1	10:45:01	1
51919	99	45	39,4	cyclictest	10361	-21	kworker/u8:3+flush-8:0	07:11:31	0
51930	99	44	39,4	cyclictest	132870	-21	kworker/u8:2+events_unbound	08:46:29	2
51926	99	44	34,8	cyclictest	172226	-21	ntpq	09:06:28	1
51926	99	44	33,9	cyclictest	92627	-21	ntpq	07:46:29	1
51919	99	44	40,3	cyclictest	316723	-21	kworker/u8:4+flush-8:0	12:16:33	0
51919	99	44	35,6	cyclictest	282	-21	systemd-journal	08:00:00	0
51919	99	44	34,8	cyclictest	346155	-21	ntpq	12:01:27	0
51926	99	43	34,7	cyclictest	217964	-21	/usr/sbin/munin	09:56:29	1
51926	99	43	30,10	cyclictest	342919	-21	irqcore	12:01:21	1
51926	99	43	1,25	cyclictest	587	-21	runrttasks	08:01:30	1
51919	99	43	39,3	cyclictest	316723	-21	kworker/u8:4+events_unbound	11:51:32	0
51919	99	43	38,3	cyclictest	10361	-21	kworker/u8:3+events_unbound	11:01:35	0
51926	99	42	33,6	cyclictest	282	-21	systemd-journal	10:20:00	1
51926	99	42	1,27	cyclictest	87694	-21	taskset	07:41:30	1
51926	99	42	1,25	cyclictest	587	-21	runrttasks	08:51:26	1
51919	99	42	37,3	cyclictest	163291	-21	kworker/u8:4+flush-8:0	09:46:40	0
51926	99	41	21,16	cyclictest	113176	-21	latency_hist	08:10:01	1
51919	99	41	36,4	cyclictest	56924	-21	kworker/u8:1+events_unbound	08:11:24	0
51919	99	41	35,4	cyclictest	123284	-21	kworker/u8:0+flush-8:0	08:31:33	0
51919	99	41	35,4	cyclictest	123284	-21	kworker/u8:0+flush-8:0	08:31:33	0
51919	99	41	34,5	cyclictest	163291	-21	kworker/u8:4+flush-8:0	10:06:34	0
51919	99	41	30,4	cyclictest	56924	-21	kworker/u8:1+events_unbound	07:36:28	0
51930	99	40	36,3	cyclictest	4193785	-21	kworker/u8:0+events_unbound	07:11:33	2
51930	99	40	36,3	cyclictest	306976	-21	kworker/u8:2+events_unbound	11:56:19	2
51926	99	40	33,5	cyclictest	188131	-21	apt-get	09:26:13	1
51926	99	40	33,5	cyclictest	113575	-21	tr	08:11:16	1
51926	99	40	29,9	cyclictest	187046	-21	ntpq	09:21:31	1
51926	99	40	28,9	cyclictest	282	-21	systemd-journal	09:55:01	1
51926	99	40	13,16	cyclictest	0	-21	swapper/1	10:14:57	1
51919	99	40	34,4	cyclictest	271515	-21	ntpq	10:46:28	0
47112	2	40	4,10	sleep1	0	-21	swapper/1	07:05:31	1
57315	2	39	0,5	sleep2	57319	-21	grep	07:15:02	2
51930	99	39	31,5	cyclictest	282	-21	systemd-journal	11:50:00	2
51926	99	39	1,23	cyclictest	198571	-21	irqcore	09:36:21	1
51926	99	39	0,23	cyclictest	376849	-21	runrttasks	12:35:23	1
51919	99	39	30,6	cyclictest	252556	-21	latency_hist	10:30:01	0
51926	99	38	28,6	cyclictest	282	-21	systemd-journal	10:58:36	1
51926	99	38	23,12	cyclictest	193066	-21	apt-get	09:31:14	1
51919	99	38	33,4	cyclictest	267606	-21	kworker/u8:0+events_unbound	12:06:22	0
51919	99	38	33,4	cyclictest	267606	-21	kworker/u8:0+events_unbound	12:06:22	0
51919	99	38	33,3	cyclictest	163290	-21	kworker/u8:1+flush-8:0	09:16:28	0
182109	2	38	0,6	sleep2	0	-21	swapper/2	09:16:29	2
51930	99	37	32,4	cyclictest	163291	-21	kworker/u8:4+events_unbound	09:36:24	2
51926	99	37	29,6	cyclictest	351077	-21	ntpq	12:06:26	1
51926	99	37	29,6	cyclictest	351077	-21	ntpq	12:06:25	1
51926	99	37	28,6	cyclictest	262428	-21	latency_hist	10:40:01	1
51926	99	37	27,8	cyclictest	181990	-21	ntpq	09:16:25	1
51926	99	37	27,8	cyclictest	0	-21	swapper/1	12:00:00	1
51926	99	37	25,10	cyclictest	352500	-21	cpuspeed_turbos	12:11:17	1
51926	99	37	25,10	cyclictest	352500	-21	cpuspeed_turbos	12:11:17	1
51926	99	37	0,22	cyclictest	282	-21	systemd-journal	09:47:37	1
51926	99	37	0,21	cyclictest	137282	-21	tr	08:31:33	1
51926	99	37	0,21	cyclictest	137282	-21	tr	08:31:33	1
51919	99	37	31,4	cyclictest	206754	-21	ntpq	09:41:31	0
51926	99	36	28,6	cyclictest	123284	-21	kworker/u8:0+flush-8:0	08:36:30	1
51926	99	36	28,6	cyclictest	123284	-21	kworker/u8:0+flush-8:0	08:36:29	1
51926	99	36	28,5	cyclictest	267721	-21	apt-get	10:46:13	1
51926	99	36	0,21	cyclictest	317081	-21	runrttasks	11:35:11	1
51926	99	36	0,20	cyclictest	316768	-21	runrttasks	11:34:11	1
51919	99	36	30,4	cyclictest	306976	-21	kworker/u8:2+flush-8:0	11:56:34	0
51919	99	36	29,5	cyclictest	163290	-21	kworker/u8:1+flush-8:0	09:26:26	0
51919	99	36	28,6	cyclictest	213318	-21	grep	09:51:17	0
51926	99	35	1,19	cyclictest	223110	-21	ls	10:01:16	1
51926	99	35	11,15	cyclictest	0	-21	swapper/1	08:25:06	1
51926	99	35	0,20	cyclictest	56641	-21	runrttasks	07:13:27	1
51926	99	35	0,20	cyclictest	297183	-21	latency_hist	11:15:01	1
51926	99	35	0,20	cyclictest	287097	-21	runrttasks	11:03:57	1
51926	99	35	0,19	cyclictest	247396	-21	runrttasks	10:22:36	1
51919	99	35	28,5	cyclictest	123284	-21	kworker/u8:0+flush-8:0	08:40:01	0
51919	99	35	28,5	cyclictest	123284	-21	kworker/u8:0+flush-8:0	08:40:01	0
51919	99	35	27,5	cyclictest	162795	-21	apt-get	09:00:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17