OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackbslot5s.osadl.org (updated Thu Aug 20, 2026 12:44:44)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3092084	99	55	41,9	cyclictest	3164900	-21	sendmail	10:40:00	2
3092080	99	51	41,7	cyclictest	3173407	-21	cron	11:05:00	1
3092075	99	51	16,32	cyclictest	11	-21	ksoftirqd/0	11:10:11	0
3092089	99	48	37,7	cyclictest	3169582	-21	grep	10:50:24	3
3092075	99	48	36,8	cyclictest	3123533	-21	idleruntime-cro	08:40:00	0
3092075	99	48	36,8	cyclictest	3123533	-21	idleruntime-cro	08:40:00	0
3092080	99	46	37,5	cyclictest	1	-21	systemd	08:15:27	1
3092089	99	45	37,4	cyclictest	3206018	-21	auditctl	12:40:00	3
3092075	99	45	38,4	cyclictest	3185377	-21	idleruntime-cro	11:40:00	0
3092089	99	44	32,8	cyclictest	3103065	-21	sendmail	07:40:01	3
3092084	99	43	35,6	cyclictest	3119921	-21	kworker/u8:1+events_unbound	09:00:41	2
3092075	99	43	30,9	cyclictest	3135665	-21	cron	09:15:01	0
3092089	99	42	33,5	cyclictest	1	-21	systemd	08:30:28	3
3092084	99	42	36,4	cyclictest	3126639	-21	kworker/u8:2+events_unbound	08:55:40	2
3092084	99	42	29,9	cyclictest	31	1	ktimers/2	07:10:11	2
3092080	99	42	33,6	cyclictest	3169519	-21	unixbench_multi	10:50:25	1
3092075	99	42	32,6	cyclictest	3143944	-21	grep	09:35:27	0
3092075	99	41	31,6	cyclictest	3109859	-21	cron	08:00:01	0
3092084	99	40	31,7	cyclictest	3126639	-21	kworker/u8:2+events_unbound	08:50:41	2
3092089	99	39	31,4	cyclictest	0	-21	swapper/3	08:15:26	3
3092084	99	39	33,4	cyclictest	3164497	-21	kworker/u8:0+events_unbound	11:31:04	2
3092084	99	39	33,4	cyclictest	3154432	-21	kworker/u8:1+events_unbound	10:20:50	2
3092084	99	39	29,7	cyclictest	31	1	ktimers/2	12:25:10	2
3092084	99	39	27,8	cyclictest	3133502	-21	grep	09:05:24	2
3092084	99	38	32,4	cyclictest	3176518	-21	kworker/u8:1+events_unbound	11:15:58	2
3092084	99	38	32,4	cyclictest	3147502	-21	kworker/u8:1+events_unbound	09:50:48	2
3092084	99	38	27,7	cyclictest	3197065	-21	grep	12:10:25	2
3092084	99	38	26,9	cyclictest	3092070	-21	cyclictest	12:20:11	2
3092080	99	38	30,4	cyclictest	0	-21	swapper/1	11:45:25	1
3092075	99	38	26,7	cyclictest	3183172	-21	grep	11:30:24	0
3092089	99	37	27,7	cyclictest	3180661	-21	fschecks_time	11:25:17	3
3092084	99	37	25,9	cyclictest	31	1	ktimers/2	11:40:15	2
3092080	99	37	26,7	cyclictest	0	-21	swapper/1	12:05:26	1
3092075	99	37	29,4	cyclictest	0	-21	swapper/0	12:20:01	0
3092084	99	36	30,4	cyclictest	3164497	-21	kworker/u8:0+events_unbound	11:10:59	2
3092084	99	36	25,7	cyclictest	3152483	-21	grep	10:00:25	2
3092080	99	36	26,6	cyclictest	0	-21	swapper/1	12:35:17	1
3092080	99	36	26,6	cyclictest	0	-21	swapper/1	10:55:23	1
3092080	99	36	20,10	cyclictest	0	-21	swapper/1	11:35:25	1
3092089	99	35	27,5	cyclictest	1	-21	systemd	08:05:25	3
3092084	99	35	29,4	cyclictest	3164497	-21	kworker/u8:0+events_unbound	11:00:57	2
3092084	99	35	29,4	cyclictest	3161451	-21	kworker/u8:2+events_unbound	10:40:54	2
3092084	99	35	27,4	cyclictest	0	-21	swapper/2	09:55:26	2
3092084	99	35	21,4	cyclictest	13	1	rcu_preempt	11:39:28	2
3092080	99	35	26,5	cyclictest	0	-21	swapper/1	11:55:23	1
3092080	99	35	25,5	cyclictest	0	-21	swapper/1	12:21:06	1
3092089	99	34	24,6	cyclictest	0	-21	swapper/3	11:20:25	3
3092084	99	34	23,3	cyclictest	13	1	rcu_preempt	10:47:14	2
3092084	99	34	20,10	cyclictest	31	1	ktimers/2	12:15:09	2
3092084	99	34	19,3	cyclictest	13	1	rcu_preempt	09:34:27	2
3092084	99	34	1,7	cyclictest	0	-21	swapper/2	09:40:11	2
3092080	99	34	26,4	cyclictest	0	-21	swapper/1	09:55:00	1
3092080	99	34	26,4	cyclictest	0	-21	swapper/1	08:10:26	1
3092080	99	34	24,6	cyclictest	0	-21	swapper/1	07:55:24	1
3092080	99	34	23,7	cyclictest	0	-21	swapper/1	11:40:29	1
3092075	99	34	29,3	cyclictest	0	-21	swapper/0	08:45:11	0
3092075	99	34	28,3	cyclictest	3202619	-21	kthreadd	12:30:00	0
3092089	99	33	27,4	cyclictest	3128410	-21	kworker/u8:3+events_unbound	09:10:42	3
3092089	99	33	25,4	cyclictest	0	-21	swapper/3	09:30:25	3
3092089	99	33	23,6	cyclictest	0	-21	swapper/3	11:15:24	3
3092084	99	33	8,15	cyclictest	32	-21	ksoftirqd/2	07:40:25	2
3092084	99	33	27,4	cyclictest	3167975	-21	kworker/u8:1+events_unbound	10:50:56	2
3092084	99	33	22,8	cyclictest	3097477	-21	grep	07:20:25	2
3092084	99	33	19,6	cyclictest	13	1	rcu_preempt	07:55:11	2
3092084	99	33	17,5	cyclictest	13	1	rcu_preempt	11:49:16	2
3092080	99	33	25,4	cyclictest	0	-21	swapper/1	08:30:27	1
3092075	99	33	24,5	cyclictest	0	-21	swapper/0	10:35:26	0
3092089	99	32	25,5	cyclictest	3173441	-21	latency_hist	11:05:01	3
3092089	99	32	25,4	cyclictest	3194098	-21	idleruntime-cro	12:05:01	3
3092089	99	32	25,4	cyclictest	3191894	-21	unixbench_multi	11:55:24	3
3092089	99	32	23,6	cyclictest	0	-21	swapper/3	07:35:01	3
3092089	99	32	21,7	cyclictest	0	-21	swapper/3	09:05:25	3
3092084	99	32	23,6	cyclictest	3117080	-21	grep	08:20:14	2
3092084	99	32	15,5	cyclictest	3164497	-21	kworker/u8:0-events_power_efficient	11:08:33	2
3092084	99	32	13,5	cyclictest	13	1	rcu_preempt	08:45:18	2
3092084	99	32	12,5	cyclictest	13	1	rcu_preempt	10:15:18	2
3092084	99	32	11,12	cyclictest	32	-21	ksoftirqd/2	08:05:25	2
3092084	99	32	10,11	cyclictest	32	-21	ksoftirqd/2	09:25:18	2
3092080	99	32	24,5	cyclictest	204	-21	dbus-daemon	07:45:20	1
3092080	99	32	23,4	cyclictest	0	-21	swapper/1	10:45:55	1
3092080	99	32	22,6	cyclictest	0	-21	swapper/1	09:15:25	1
3092080	99	32	21,7	cyclictest	0	-21	swapper/1	12:00:24	1
3092075	99	32	23,7	cyclictest	3187729	-21	fschecks_time	11:45:15	0
3092075	99	32	23,5	cyclictest	11	-21	ksoftirqd/0	08:55:12	0
3092084	99	31	8,7	cyclictest	32	-21	ksoftirqd/2	10:29:59	2
3092084	99	31	25,4	cyclictest	3118198	-21	kworker/u8:0+events_unbound	08:42:41	2
3092084	99	31	23,6	cyclictest	3135402	-21	kworker/u8:1+events_unbound	09:20:43	2
3092084	99	31	18,5	cyclictest	13	1	rcu_preempt	12:00:01	2
3092084	99	31	14,5	cyclictest	3119921	-21	kworker/u8:1-events_unbound	08:36:45	2
3092084	99	31	14,5	cyclictest	3119921	-21	kworker/u8:1-events_unbound	08:36:45	2
3092084	99	31	11,6	cyclictest	13	1	rcu_preempt	10:05:13	2
3092080	99	31	19,7	cyclictest	0	-21	swapper/1	10:05:28	1
3092075	99	31	25,4	cyclictest	3142523	-21	apt-get	09:35:01	0
3092075	99	31	24,4	cyclictest	3103041	-21	cron	07:40:00	0
3092075	99	31	23,4	cyclictest	0	-21	swapper/0	12:00:01	0
3092075	99	31	23,4	cyclictest	0	-21	swapper/0	09:20:15	0
3092075	99	31	22,4	cyclictest	0	-21	swapper/0	12:06:04	0
3092075	99	31	20,8	cyclictest	3145707	-21	grep	09:40:26	0
3092089	99	30	23,4	cyclictest	0	-21	swapper/3	10:35:00	3
3092089	99	30	23,4	cyclictest	0	-21	swapper/3	10:35:00	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17