OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackeslot4s.osadl.org (updated Wed Aug 05, 2026 12:44:07)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
802353	99	68	62,4	cyclictest	335557	-21	systemd-journal	12:07:48	1
802360	99	55	51,3	cyclictest	335557	-21	systemd-journal	12:16:24	3
802360	99	54	48,4	cyclictest	815893	-21	latency_hist	08:55:01	3
802360	99	53	48,4	cyclictest	335557	-21	systemd-journal	11:27:08	3
802350	99	51	1,49	cyclictest	980475	-21	systemd	12:16:24	0
802353	99	50	47,2	cyclictest	911988	-21	kworker/u8:0+flush-259:0	11:27:10	1
802353	99	48	43,3	cyclictest	335557	-21	systemd-journal	10:21:36	1
802353	99	42	39,2	cyclictest	75	-21	kswapd0	10:39:21	1
802353	99	38	35,2	cyclictest	819389	-21	gpgv	09:15:01	1
802358	99	36	30,4	cyclictest	927759	-21	getprofile	11:27:06	2
802350	99	36	33,2	cyclictest	803180	-21	kworker/u8:1+flush-259:0	07:25:00	0
802350	99	35	30,4	cyclictest	986031	-21	latency_hist	12:25:01	0
802350	99	33	27,4	cyclictest	823652	-21	latency_hist	09:50:00	0
802350	99	30	26,3	cyclictest	823906	-21	apt-get	09:50:07	0
802350	99	30	23,5	cyclictest	858845	-21	ntpq	10:20:20	0
802360	99	29	24,4	cyclictest	335557	-21	systemd-journal	07:30:00	3
802350	99	29	25,3	cyclictest	801665	-21	kworker/u8:2+flush-259:0	07:30:00	0
802360	99	28	24,3	cyclictest	821780	-21	kworker/u8:3+flush-259:0	10:45:24	3
802358	99	28	21,4	cyclictest	849447	-21	latency_hist	10:15:00	2
802353	99	28	24,3	cyclictest	833981	-21	latency_hist	10:00:01	1
802360	99	27	21,4	cyclictest	335557	-21	systemd-journal	07:45:00	3
802358	99	27	22,4	cyclictest	335557	-21	systemd-journal	12:16:35	2
802358	99	27	22,3	cyclictest	911988	-21	kworker/u8:0+events_unbound	12:35:01	2
802353	99	27	23,3	cyclictest	886284	-21	kworker/u8:1+events_unbound	11:19:20	1
802353	99	27	22,4	cyclictest	335557	-21	systemd-journal	10:55:00	1
802350	99	27	0,25	cyclictest	1	-21	systemd	10:40:00	0
802360	99	26	22,3	cyclictest	335557	-21	systemd-journal	11:00:38	3
802358	99	26	22,3	cyclictest	886284	-21	kworker/u8:1+flush-259:0	11:05:16	2
802353	99	26	22,3	cyclictest	807977	-21	kworker/u8:1+events_unbound	08:33:07	1
802353	99	26	21,3	cyclictest	911988	-21	kworker/u8:0+flush-259:0	12:30:00	1
802350	99	25	19,4	cyclictest	807112	-21	latency_hist	07:45:00	0
802360	99	24	20,3	cyclictest	939203	-21	apt-get	11:40:11	3
802360	99	24	19,3	cyclictest	335557	-21	systemd-journal	11:49:38	3
802358	99	24	19,4	cyclictest	335557	-21	systemd-journal	09:25:00	2
802358	99	24	19,3	cyclictest	944357	-21	apt-get	11:45:12	2
802353	99	24	21,2	cyclictest	922324	-21	kworker/u8:3+events_unbound	11:40:13	1
802353	99	24	20,3	cyclictest	817582	-21	kworker/u8:3+events_unbound	09:13:08	1
802350	99	24	21,2	cyclictest	1	-21	systemd	11:00:37	0
802350	99	24	20,3	cyclictest	911988	-21	kworker/u8:0+flush-259:0	12:25:28	0
802350	99	24	20,3	cyclictest	880922	-21	kworker/u8:2+events_unbound	11:27:29	0
802350	99	24	18,4	cyclictest	335557	-21	systemd-journal	11:13:30	0
802360	99	23	20,2	cyclictest	821780	-21	kworker/u8:3+flush-259:0	10:40:16	3
802358	99	23	20,2	cyclictest	886284	-21	kworker/u8:1+events_unbound	11:20:01	2
802353	99	23	19,3	cyclictest	801665	-21	kworker/u8:2+events_unbound	07:28:00	1
802350	99	23	20,2	cyclictest	911988	-21	kworker/u8:0+flush-259:0	11:45:18	0
802350	99	23	17,4	cyclictest	509	-21	rs:main		0
802360	99	22	19,2	cyclictest	807977	-21	kworker/u8:1+flush-259:0	10:00:26	3
802360	99	22	19,2	cyclictest	807977	-21	kworker/u8:1+flush-259:0	10:00:26	3
802360	99	22	18,3	cyclictest	807977	-21	kworker/u8:1+flush-259:0	10:05:23	3
802360	99	22	18,3	cyclictest	807977	-21	kworker/u8:1+flush-259:0	10:05:22	3
802360	99	22	18,3	cyclictest	807977	-21	kworker/u8:1+events_unbound	09:56:39	3
802360	99	22	18,3	cyclictest	806717	-21	kworker/u8:3+events_unbound	08:10:00	3
802360	99	22	16,4	cyclictest	817148	-21	cp	09:00:01	3
802358	99	22	20,1	cyclictest	922324	-21	kworker/u8:3+events_unbound	11:34:59	2
802358	99	22	18,3	cyclictest	911988	-21	kworker/u8:0+events_unbound	12:05:01	2
802358	99	22	18,3	cyclictest	911988	-21	kworker/u8:0+events_unbound	12:05:00	2
802353	99	22	19,2	cyclictest	807977	-21	kworker/u8:1+flush-259:0	09:39:59	1
802353	99	22	19,2	cyclictest	490	-21	dbus-daemon	09:00:01	1
802353	99	22	18,3	cyclictest	819902	-21	kworker/u8:2+events_unbound	09:25:00	1
802350	99	22	19,2	cyclictest	803180	-21	kworker/u8:1+flush-259:0	07:20:01	0
802360	99	21	17,3	cyclictest	860017	-21	apt-get	10:25:11	3
802360	99	21	17,3	cyclictest	807977	-21	kworker/u8:1+flush-259:0	10:15:25	3
802358	99	21	5,9	cyclictest	911972	-21	munin-run	11:15:01	2
802358	99	21	18,2	cyclictest	807977	-21	kworker/u8:1+flush-259:0	10:20:24	2
802353	99	21	17,3	cyclictest	911988	-21	kworker/u8:0+events_unbound	12:00:00	1
802353	99	21	17,3	cyclictest	821780	-21	kworker/u8:3+events_unbound	10:30:38	1
802353	99	21	17,3	cyclictest	807977	-21	kworker/u8:1+flush-259:0	09:45:00	1
802353	99	21	17,3	cyclictest	335557	-21	systemd-journal	11:06:37	1
802350	99	21	17,3	cyclictest	807977	-21	kworker/u8:1+events_unbound	10:00:39	0
802350	99	21	17,3	cyclictest	807977	-21	kworker/u8:1+events_unbound	10:00:39	0
802350	99	21	16,3	cyclictest	822387	-21	latency_hist	09:40:00	0
802360	99	20	17,2	cyclictest	805367	-21	gpgv	07:30:00	3
802350	99	20	17,2	cyclictest	859775	-21	kworker/u8:0+events_unbound	10:30:18	0
802350	99	20	17,2	cyclictest	807977	-21	kworker/u8:1+events_unbound	08:23:05	0
802350	99	20	16,3	cyclictest	911988	-21	kworker/u8:0+events_unbound	11:43:33	0
802350	99	20	16,3	cyclictest	807977	-21	kworker/u8:1+flush-259:0	10:30:01	0
802350	99	20	14,4	cyclictest	938939	-21	latency_hist	11:40:00	0
802360	99	19	14,3	cyclictest	819061	-21	store	09:15:00	3
802360	99	19	14,3	cyclictest	335557	-21	systemd-journal	10:25:01	3
802353	99	19	17,1	cyclictest	0	-21	swapper/1	11:55:00	1
802353	99	19	15,3	cyclictest	865132	-21	gpgv	10:30:00	1
802353	99	19	15,3	cyclictest	807977	-21	kworker/u8:1+events_unbound	09:51:38	1
802360	99	18	15,2	cyclictest	911988	-21	kworker/u8:0+flush-259:0	11:30:23	3
802360	99	18	15,2	cyclictest	906845	-21	idleruntime-cro	11:10:00	3
802360	99	18	14,3	cyclictest	922324	-21	kworker/u8:3+flush-259:0	11:50:20	3
802360	99	18	14,3	cyclictest	917387	-21	apt-get	11:20:11	3
802353	99	18	15,2	cyclictest	859775	-21	kworker/u8:0+events_unbound	10:43:28	1
802353	99	18	13,3	cyclictest	335557	-21	systemd-journal	12:11:38	1
802350	99	18	15,2	cyclictest	902319	-21	irqcore	11:05:17	0
802350	99	18	15,2	cyclictest	802299	-21	kworker/u8:4+events_unbound	07:40:00	0
802350	99	18	14,3	cyclictest	954424	-21	kworker/u8:1+flush-259:0	11:55:14	0
802360	99	17	14,3	cyclictest	808609	-21	kworker/u8:0+events_unbound	08:03:04	3
802360	99	17	14,2	cyclictest	960295	-21	irqcore	12:00:19	3
802360	99	17	14,2	cyclictest	960295	-21	irqcore	12:00:18	3
802360	99	17	14,2	cyclictest	954424	-21	kworker/u8:1+flush-259:0	12:30:16	3
802360	99	17	14,2	cyclictest	812141	-21	kworker/u8:2+events_unbound	08:38:28	3
802353	99	17	15,2	cyclictest	806717	-21	kworker/u8:3+events_unbound	08:18:04	1
802353	99	17	14,2	cyclictest	821780	-21	kworker/u8:3+flush-259:0	10:55:13	1
802353	99	17	13,2	cyclictest	807977	-21	kworker/u8:1+flush-259:0	10:15:17	1
802353	99	17	10,5	cyclictest	804181	-21	latency_hist	07:25:00	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2021-09-01 - 00:34