OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot4s.osadl.org (updated Sun Aug 02, 2026 12:44:12)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2899651	2	228	0,3	sleep3	575	-21	kworker/3:2+events	09:03:01	3
2815646	2	70	0,2	sleep3	47	1	rcuc/3	07:38:00	3
2890833	2	63	0,5	sleep3	0	-21	swapper/3	08:52:58	3
2833880	2	62	0,2	sleep1	16	1	rcu_preempt	07:58:00	1
2785771	99	54	49,4	cyclictest	2776081	-21	kworker/u8:0+flush-8:0	07:43:09	1
2785769	99	52	43,7	cyclictest	2867305	-21	latency_hist	08:30:01	0
2785771	99	48	40,6	cyclictest	275	-21	systemd-journal	12:30:00	1
2785775	99	45	37,6	cyclictest	2887166	-21	gpgv	08:50:00	2
2785771	99	45	40,4	cyclictest	2790820	-21	kworker/u8:3+flush-8:0	09:38:10	1
2785771	99	45	38,5	cyclictest	3030973	-21	kworker/u8:1+events_unbound	11:58:12	1
2785771	99	44	37,5	cyclictest	3115956	-21	latency_hist	12:40:00	1
2785771	99	43	39,3	cyclictest	2852329	-21	kworker/u8:2+events_unbound	08:32:58	1
2785769	99	43	38,3	cyclictest	2951724	-21	kworker/u8:1+events_unbound	10:37:55	0
2785769	99	41	35,4	cyclictest	1427849	-21	kworker/u8:1+flush-8:0	07:47:53	0
2785771	99	40	34,5	cyclictest	2790820	-21	kworker/u8:3+events_unbound	07:23:10	1
2785769	99	40	35,3	cyclictest	1	-21	systemd	07:25:00	0
2823706	2	39	0,4	sleep1	0	-21	swapper/1	07:47:57	1
2785769	99	39	32,5	cyclictest	3061125	-21	kworker/u8:2+flush-8:0	12:38:06	0
2785771	99	38	33,4	cyclictest	2790820	-21	kworker/u8:3+flush-8:0	08:08:13	1
2785771	99	38	33,4	cyclictest	2790820	-21	kworker/u8:3+events_unbound	10:23:10	1
2785771	99	38	33,3	cyclictest	2961586	-21	kworker/u8:2+events_unbound	10:15:01	1
2785771	99	38	32,5	cyclictest	2961586	-21	kworker/u8:2+flush-8:0	10:48:08	1
2785771	99	38	32,4	cyclictest	2996456	-21	kworker/u8:0+events_unbound	11:17:54	1
2785771	99	38	30,6	cyclictest	2912462	-21	/usr/sbin/munin	09:18:09	1
2785775	99	37	30,5	cyclictest	3091383	-21	cat	12:15:01	2
2785771	99	37	31,4	cyclictest	2961586	-21	kworker/u8:2+events_unbound	10:18:07	1
2785771	99	37	30,3	cyclictest	1427849	-21	kworker/u8:1+events_unbound	08:03:10	1
2785769	99	37	0,35	cyclictest	3076174	-21	munin-run	12:00:00	0
2781129	2	37	4,11	sleep1	0	-21	swapper/1	07:07:33	1
2785771	99	36	31,4	cyclictest	2790820	-21	kworker/u8:3+flush-8:0	10:38:09	1
2785771	99	36	30,4	cyclictest	2790820	-21	kworker/u8:3+events_unbound	11:13:10	1
2785771	99	35	29,4	cyclictest	2790820	-21	kworker/u8:3+flush-8:0	07:28:08	1
2785771	99	35	29,4	cyclictest	1427849	-21	kworker/u8:1+events_unbound	08:58:04	1
2785771	99	35	28,5	cyclictest	2790820	-21	kworker/u8:3+flush-8:0	10:03:10	1
2785771	99	35	28,4	cyclictest	1427849	-21	kworker/u8:1+events_unbound	08:18:02	1
2785769	99	35	26,7	cyclictest	3041523	-21	/usr/sbin/munin	11:28:02	0
2785771	99	34	30,3	cyclictest	2790820	-21	kworker/u8:3+events_unbound	09:47:56	1
2785771	99	34	28,4	cyclictest	3030973	-21	kworker/u8:1+flush-8:0	11:38:09	1
2785771	99	34	28,4	cyclictest	2793041	-21	apt-get	07:17:52	1
2785771	99	34	27,5	cyclictest	3036638	-21	apt-get	11:22:51	1
2785769	99	34	29,3	cyclictest	2907009	-21	cron	09:10:00	0
2785769	99	34	26,6	cyclictest	2987164	-21	/usr/sbin/munin	10:33:09	0
2781138	2	34	1,27	sleep0	0	-21	swapper/0	07:07:40	0
2785771	99	33	28,3	cyclictest	2852329	-21	kworker/u8:2+events_unbound	08:28:11	1
2785771	99	33	19,10	cyclictest	3070966	-21	latency_hist	11:55:02	1
2785771	99	32	28,3	cyclictest	3030973	-21	kworker/u8:1+events_unbound	11:27:58	1
2785771	99	32	27,4	cyclictest	2790820	-21	kworker/u8:3+flush-8:0	11:07:59	1
2785771	99	32	27,3	cyclictest	3047227	-21	irqrtprio	11:32:58	1
2785771	99	32	26,4	cyclictest	3085888	-21	kworker/u8:0+events_unbound	12:23:05	1
2785771	99	32	26,4	cyclictest	2857903	-21	apt-get	08:22:50	1
2785771	99	32	24,6	cyclictest	3085888	-21	kworker/u8:0+flush-8:0	12:18:07	1
2785771	99	32	24,6	cyclictest	3006941	-21	/usr/sbin/munin	10:53:05	1
2785769	99	32	26,5	cyclictest	2790820	-21	kworker/u8:3+flush-8:0	07:28:07	0
2780953	2	32	4,10	sleep2	0	-21	swapper/2	07:05:17	2
2785771	99	31	27,3	cyclictest	2790820	-21	kworker/u8:3+events_unbound	10:28:05	1
2785771	99	31	26,3	cyclictest	2951724	-21	kworker/u8:1+flush-8:0	10:07:56	1
2785769	99	31	27,3	cyclictest	2982566	-21	fschecks_time	10:27:56	0
2785769	99	31	22,7	cyclictest	3101589	-21	/usr/sbin/munin	12:28:09	0
2785769	99	31	20,8	cyclictest	2916300	-21	ntpq	09:18:04	0
2785775	99	30	27,2	cyclictest	3085888	-21	kworker/u8:0+events_unbound	12:30:13	2
2785775	99	30	24,4	cyclictest	275	-21	systemd-journal	09:38:13	2
2785771	99	30	24,4	cyclictest	2907044	-21	kworker/u8:0+events_unbound	09:22:57	1
2785771	99	30	24,4	cyclictest	1427849	-21	kworker/u8:1+events_unbound	08:47:57	1
2785771	99	30	21,6	cyclictest	3030973	-21	kworker/u8:1+flush-8:0	12:08:05	1
2785769	99	30	27,2	cyclictest	3047038	-21	irqcore	11:32:57	0
2785769	99	30	25,4	cyclictest	1427849	-21	kworker/u8:1+flush-8:0	09:28:22	0
2785769	99	30	25,3	cyclictest	2948461	-21	kthreadcore	09:53:00	0
2785769	99	30	25,3	cyclictest	2912003	-21	sh	09:15:00	0
2785775	99	29	24,4	cyclictest	3021324	-21	idleruntime-cro	11:05:00	2
2785775	99	29	23,4	cyclictest	2996343	-21	unixbench_multi	10:38:10	2
2785775	99	29	20,7	cyclictest	2972095	-21	cp	10:15:01	2
2785771	99	29	24,4	cyclictest	1427849	-21	kworker/u8:1+flush-8:0	09:27:57	1
2785771	99	29	24,3	cyclictest	2987417	-21	tr	10:32:54	1
2785771	99	29	23,4	cyclictest	401	-21	dbus-daemon	08:15:00	1
2785771	99	29	23,4	cyclictest	1427849	-21	kworker/u8:1+flush-8:0	09:33:10	1
2785769	99	29	25,3	cyclictest	2790820	-21	kworker/u8:3+events_unbound	08:08:16	0
2785769	99	29	24,4	cyclictest	1427849	-21	kworker/u8:1+flush-8:0	08:47:55	0
2785769	99	29	24,3	cyclictest	401	-21	dbus-daemon	08:25:00	0
2785769	99	29	22,5	cyclictest	2872707	-21	/usr/sbin/munin	08:38:11	0
2785769	99	29	20,7	cyclictest	3081083	-21	latency_hist	12:05:01	0
2785775	99	28	22,4	cyclictest	2981531	-21	unixbench_multi	10:23:12	2
2785775	99	28	18,8	cyclictest	275	-21	systemd-journal	09:10:00	2
2785771	99	28	24,3	cyclictest	2996456	-21	kworker/u8:0+events_unbound	10:57:59	1
2785771	99	28	24,3	cyclictest	2790820	-21	kworker/u8:3+flush-8:0	09:08:05	1
2785771	99	28	23,4	cyclictest	3061125	-21	kworker/u8:2+flush-8:0	12:13:03	1
2785771	99	28	22,4	cyclictest	2790820	-21	kworker/u8:3+flush-8:0	10:43:06	1
2785771	99	28	19,7	cyclictest	2951151	-21	ntpq	09:53:05	1
2785771	99	28	13,10	cyclictest	275	-21	systemd-journal	07:55:00	1
2785769	99	28	24,2	cyclictest	3055126	-21	needreboot	11:38:01	0
2785769	99	28	22,4	cyclictest	2790422	-21	unixbench_multi	07:13:13	0
2785769	99	28	20,6	cyclictest	2836848	-21	needreboot	07:58:05	0
2785775	99	27	22,3	cyclictest	3051670	-21	cpuspeed_turbos	11:37:53	2
2785775	99	27	0,10	cyclictest	2810050	-21	cut	07:32:59	2
2785775	99	27	0,10	cyclictest	2810050	-21	cut	07:32:59	2
2785771	99	27	20,5	cyclictest	1427849	-21	kworker/u8:1+flush-8:0	07:13:06	1
2785771	99	27	20,3	cyclictest	0	-21	swapper/1	11:02:58	1
2785769	99	27	22,3	cyclictest	3007693	-21	irqrtprio	10:52:57	0
2785769	99	27	21,4	cyclictest	2897164	-21	basename	09:00:00	0
2785769	99	27	20,5	cyclictest	2776081	-21	kworker/u8:0+events_unbound	07:40:00	0
2785775	99	26	20,4	cyclictest	2897865	-21	cpuspeed_turbos	09:02:55	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17