OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot4s.osadl.org (updated Thu Aug 06, 2026 00:44:14)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4032121	2	69	0,2	sleep0	20	1	rcuc/0	00:03:07	0
3959782	2	52	0,1	chrt	3959786	-21	kthreadcore	22:52:57	0
3736182	99	52	4,33	cyclictest	4047330	-21	latency_hist	00:20:00	0
3736186	99	51	47,3	cyclictest	3686723	-21	kworker/u8:1+flush-8:0	19:33:05	1
3736182	99	51	26,17	cyclictest	3993100	-21	/usr/sbin/munin	23:28:05	0
3736186	99	49	45,3	cyclictest	4012682	-21	kworker/u8:2+events_unbound	00:08:06	1
3736182	99	48	39,6	cyclictest	4057262	-21	latency_hist	00:30:01	0
3736182	99	48	1,33	cyclictest	573	-21	runrttasks	00:12:53	0
3736182	99	47	23,21	cyclictest	3763696	-21	/usr/sbin/munin	19:38:04	0
3736186	99	46	41,4	cyclictest	3741122	-21	kworker/u8:3+events_unbound	19:28:04	1
3736186	99	45	40,4	cyclictest	3878192	-21	kworker/u8:1+flush-8:0	21:58:06	1
3736186	99	45	39,4	cyclictest	3731395	-21	kworker/u8:2+events_unbound	19:22:52	1
3736186	99	43	38,4	cyclictest	4012682	-21	kworker/u8:2+flush-8:0	00:22:52	1
3736186	99	43	37,5	cyclictest	3878192	-21	kworker/u8:1+events_unbound	21:45:02	1
3736186	99	43	37,5	cyclictest	3793157	-21	kworker/u8:2+events_unbound	20:27:51	1
3736182	99	43	1,24	cyclictest	4007962	-21	/usr/sbin/munin	23:42:48	0
3736186	99	42	37,4	cyclictest	3818151	-21	kworker/u8:3+events_unbound	20:47:52	1
3736186	99	42	36,4	cyclictest	3928538	-21	kworker/u8:2+flush-8:0	22:37:52	1
3736182	99	42	33,6	cyclictest	3852284	-21	ntpq	21:03:01	0
3736182	99	42	1,30	cyclictest	573	-21	runrttasks	00:23:04	0
3736182	99	42	1,29	cyclictest	573	-21	runrttasks	21:12:50	0
3736182	99	42	1,29	cyclictest	573	-21	runrttasks	00:37:49	0
3899320	2	41	0,1	chrt	3899322	-21	irqrtprio	21:52:55	0
3736186	99	41	37,3	cyclictest	4037241	-21	kworker/u8:1+events_unbound	00:32:53	1
3736182	99	41	31,7	cyclictest	275	-21	systemd-journal	23:34:59	0
3736182	99	41	26,13	cyclictest	3802840	-21	http	20:15:00	0
3736182	99	41	1,23	cyclictest	3857293	-21	sshd	21:08:00	0
3736182	99	41	0,39	cyclictest	3887812	-21	munin-run	21:40:01	0
3736187	99	40	34,4	cyclictest	3908078	-21	gpgv	22:00:00	2
3736186	99	40	34,4	cyclictest	3878192	-21	kworker/u8:1+events_unbound	23:12:54	1
3736182	99	40	33,5	cyclictest	3967900	-21	latency_hist	23:00:01	0
3736182	99	40	32,6	cyclictest	3736536	-21	/usr/sbin/munin	19:13:04	0
3736182	99	40	2,26	cyclictest	3838647	-21	apt-get	20:52:48	0
3736182	99	40	22,16	cyclictest	3992734	-21	latency_hist	23:25:00	0
3736182	99	40	22,16	cyclictest	3923102	-21	idleruntime-cro	22:15:00	0
3736182	99	40	21,17	cyclictest	3797145	-21	ntpq	20:08:00	0
3736187	99	39	33,4	cyclictest	3757860	-21	apt-get	19:28:06	2
3736186	99	39	34,4	cyclictest	3847936	-21	kworker/u8:0+events_unbound	21:07:50	1
3736186	99	39	33,4	cyclictest	4002804	-21	kworker/u8:3+events_unbound	23:37:55	1
3736186	99	39	31,6	cyclictest	3958008	-21	latency_hist	22:50:01	1
3736186	99	38	34,3	cyclictest	3952890	-21	kworker/u8:0+events_unbound	23:08:05	1
3736186	99	38	34,3	cyclictest	3686723	-21	kworker/u8:1+events_unbound	19:37:11	1
3736186	99	38	33,4	cyclictest	3952890	-21	kworker/u8:0+events_unbound	23:52:51	1
3736186	99	38	33,4	cyclictest	3922949	-21	kworker/u8:3+events_unbound	22:23:02	1
3736186	99	38	33,4	cyclictest	3758090	-21	kworker/u8:0+events_unbound	20:12:53	1
3736182	99	38	3,30	cyclictest	0	-21	swapper/0	22:42:49	0
3736182	99	38	3,27	cyclictest	0	-21	swapper/0	22:32:46	0
3736182	99	38	3,25	cyclictest	0	-21	swapper/0	23:14:08	0
3736182	99	38	19,15	cyclictest	0	-21	swapper/0	22:00:01	0
3736186	99	37	33,3	cyclictest	3952890	-21	kworker/u8:0+events_unbound	00:02:50	1
3736186	99	37	33,3	cyclictest	3793157	-21	kworker/u8:2+flush-8:0	20:38:02	1
3736186	99	37	32,4	cyclictest	3793157	-21	kworker/u8:2+events_unbound	20:07:51	1
3736182	99	37	9,20	cyclictest	42	1	rcuog/2	19:21:12	0
3736182	99	37	3,28	cyclictest	0	-21	swapper/0	20:27:48	0
3736182	99	37	3,26	cyclictest	0	-21	swapper/0	21:27:51	0
3736182	99	37	3,19	cyclictest	0	-21	swapper/0	20:47:02	0
3736182	99	37	3,18	cyclictest	0	-21	swapper/0	19:33:45	0
3736182	99	37	3,17	cyclictest	0	-21	swapper/0	23:52:23	0
3736182	99	37	28,7	cyclictest	3968357	-21	/usr/sbin/munin	23:03:00	0
3736182	99	37	22,12	cyclictest	4027358	-21	systemd-run	00:00:01	0
3736182	99	37	2,20	cyclictest	0	-21	swapper/0	19:41:46	0
3736182	99	37	2,18	cyclictest	3783506	-21	apt-get	19:57:51	0
3736182	99	37	2,18	cyclictest	3783506	-21	apt-get	19:57:51	0
3736182	99	37	21,14	cyclictest	0	-21	swapper/0	19:20:01	0
3736187	99	36	29,5	cyclictest	3922949	-21	kworker/u8:3+events_unbound	22:52:58	2
3736186	99	36	32,3	cyclictest	3793157	-21	kworker/u8:2+flush-8:0	20:33:08	1
3736182	99	36	4,18	cyclictest	0	-21	swapper/0	20:56:45	0
3736182	99	36	3,19	cyclictest	0	-21	swapper/0	22:27:09	0
3736182	99	36	3,19	cyclictest	0	-21	swapper/0	22:27:09	0
3736182	99	36	3,19	cyclictest	0	-21	swapper/0	20:00:36	0
3736182	99	36	3,19	cyclictest	0	-21	swapper/0	19:46:23	0
3736182	99	36	2,21	cyclictest	0	-21	swapper/0	21:24:33	0
3736182	99	36	2,20	cyclictest	0	-21	swapper/0	19:25:53	0
3736182	99	36	2,1	cyclictest	0	-21	swapper/0	22:37:49	0
3736182	99	36	2,19	cyclictest	0	-21	swapper/0	22:16:13	0
3736182	99	36	2,19	cyclictest	0	-21	swapper/0	00:06:19	0
3736182	99	36	2,18	cyclictest	0	-21	swapper/0	19:53:46	0
3736187	99	35	30,4	cyclictest	3758090	-21	kworker/u8:0+flush-8:0	20:12:56	2
3736186	99	35	31,3	cyclictest	4037241	-21	kworker/u8:1+flush-8:0	00:12:56	1
3736186	99	35	31,3	cyclictest	3952890	-21	kworker/u8:0+flush-8:0	22:58:05	1
3736186	99	35	31,3	cyclictest	3922949	-21	kworker/u8:3+flush-8:0	22:42:52	1
3736186	99	35	31,3	cyclictest	3857947	-21	kworker/u8:3+flush-8:0	21:28:11	1
3736186	99	35	31,3	cyclictest	3758090	-21	kworker/u8:0+flush-8:0	19:52:58	1
3736186	99	35	30,4	cyclictest	3952890	-21	kworker/u8:0+events_unbound	23:23:06	1
3736186	99	35	30,4	cyclictest	3793157	-21	kworker/u8:2+events_unbound	20:52:49	1
3736186	99	35	26,7	cyclictest	4027316	-21	latency_hist	00:00:01	1
3736182	99	35	6,16	cyclictest	0	-21	swapper/0	20:36:03	0
3736182	99	35	6,16	cyclictest	0	-21	swapper/0	00:30:06	0
3736182	99	35	3,28	cyclictest	0	-21	swapper/0	22:07:48	0
3736182	99	35	3,17	cyclictest	0	-21	swapper/0	23:46:21	0
3736182	99	35	2,20	cyclictest	0	-21	swapper/0	21:48:13	0
3736182	99	35	2,19	cyclictest	0	-21	swapper/0	23:05:28	0
3736182	99	35	2,19	cyclictest	0	-21	swapper/0	22:45:18	0
3736182	99	35	2,19	cyclictest	0	-21	swapper/0	21:42:39	0
3736182	99	35	2,19	cyclictest	0	-21	swapper/0	21:17:32	0
3736182	99	35	2,19	cyclictest	0	-21	swapper/0	21:17:31	0
3736182	99	35	2,19	cyclictest	0	-21	swapper/0	20:44:21	0
3736182	99	35	2,19	cyclictest	0	-21	swapper/0	20:32:38	0
3736182	99	35	2,19	cyclictest	0	-21	swapper/0	20:21:02	0
3736187	99	34	28,4	cyclictest	275	-21	systemd-journal	22:30:00	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17