OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #b, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rackbslot1.osadl.org (updated Tue Aug 26, 2025 12:44:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4043707	2	217	189,18	sleep0	0	-21	swapper/0	07:08:23	0
4043720	2	212	183,19	sleep3	0	-21	swapper/3	07:08:34	3
4043662	2	207	166,32	sleep2	0	-21	swapper/2	07:07:48	2
4043638	2	200	151,40	sleep1	0	-21	swapper/1	07:07:31	1
4044071	99	59	55,3	cyclictest	517	-21	kworker/u8:3+events_unbound	10:00:00	2
4044063	99	56	51,3	cyclictest	4178685	-31	munin-html	09:15:34	0
4044071	99	55	51,3	cyclictest	68493	-21	kworker/u8:4+events_unbound	10:45:01	2
4044071	99	55	51,3	cyclictest	68493	-21	kworker/u8:4+events_unbound	10:45:00	2
4044067	99	54	48,4	cyclictest	115399	-21	/usr/share/muni	11:25:09	1
4044067	99	52	48,3	cyclictest	47265	-21	kworker/u8:3+events_unbound	10:17:03	1
4044067	99	52	48,2	cyclictest	166569	-21	kworker/u8:1+events_unbound	12:15:30	1
4044071	99	51	46,4	cyclictest	4097225	-21	/usr/share/muni	08:00:03	2
4044071	99	50	46,2	cyclictest	93777	-31	munin-html	11:00:35	2
4044067	99	50	38,10	cyclictest	4051602	-21	kworker/u8:0+events_unbound	08:30:30	1
4044063	99	50	47,2	cyclictest	4179352	-21	kworker/u8:1+events_unbound	10:10:10	0
4044071	99	49	42,2	cyclictest	74567	-21	kworker/u8:1+flush-179:0	10:50:06	2
4044073	99	48	32,14	cyclictest	4011812	-1	kworker/3:1H+kblockd	08:05:04	3
4044067	99	48	44,3	cyclictest	84112	-21	kworker/u8:2+flush-179:0	11:20:34	1
4044067	99	48	44,3	cyclictest	4117104	-21	kworker/u8:3+events_unbound	08:20:33	1
4044067	99	48	44,3	cyclictest	4051602	-21	kworker/u8:0+events_unbound	07:55:14	1
4044071	99	47	43,3	cyclictest	4051602	-21	kworker/u8:0+events_unbound	07:40:10	2
4044071	99	47	43,3	cyclictest	4043896	-21	kworker/u8:1+events_unbound	07:10:10	2
4044063	99	47	42,3	cyclictest	47265	-21	kworker/u8:3+events_unbound	10:40:13	0
4044063	99	47	42,3	cyclictest	47265	-21	kworker/u8:3+events_unbound	10:40:13	0
4044067	99	46	43,2	cyclictest	4065122	-21	kworker/u8:2+flush-179:0	07:45:16	1
4044063	99	46	40,5	cyclictest	47265	-21	kworker/u8:3+events_unbound	10:20:00	0
4044071	99	45	42,2	cyclictest	84032	-21	kworker/u8:0+events_unbound	11:05:10	2
4044071	99	45	38,2	cyclictest	4132597	-21	kworker/u8:2+events_unbound	08:45:29	2
4044071	99	45	33,11	cyclictest	4158843	-21	kworker/2:2+pm	09:00:04	2
4044063	99	45	41,3	cyclictest	4142345	-31	munin-html	08:40:34	0
4044073	99	44	40,3	cyclictest	4007164	-21	kworker/u8:4+flush-179:0	07:15:31	3
4044071	99	44	41,2	cyclictest	99775	-21	kworker/u8:3+flush-179:0	11:30:06	2
4044071	99	44	41,2	cyclictest	99775	-21	kworker/u8:3+events_unbound	11:40:18	2
4044071	99	44	41,2	cyclictest	4051602	-21	kworker/u8:0+events_unbound	08:20:06	2
4044071	99	44	40,3	cyclictest	4179352	-21	kworker/u8:1+events_unbound	10:05:09	2
4044071	99	44	39,4	cyclictest	110303	-21	/usr/share/muni	11:20:04	2
4044067	99	44	41,2	cyclictest	4117104	-21	kworker/u8:3+events_unbound	08:25:33	1
4044067	99	44	41,2	cyclictest	124954	-21	kworker/u8:0+flush-179:0	11:35:05	1
4044063	99	44	41,2	cyclictest	4153640	-21	kworker/u8:4+flush-179:0	09:10:37	0
4044063	99	44	41,2	cyclictest	36963	-21	gpgv	10:10:01	0
4044063	99	44	39,4	cyclictest	68493	-21	kworker/u8:4+flush-179:0	10:45:23	0
4044063	99	44	37,6	cyclictest	4122920	-21	/usr/share/muni	08:25:14	0
4044073	99	43	39,2	cyclictest	4011812	-1	kworker/3:1H+kblockd	10:24:16	3
4044071	99	43	39,3	cyclictest	84112	-21	kworker/u8:2+events_unbound	11:10:31	2
4044071	99	43	2,15	cyclictest	40654	-21	chrome	12:01:38	2
4044067	99	43	40,2	cyclictest	4070935	-1	kworker/1:1H+kblockd	07:50:04	1
4044063	99	43	39,3	cyclictest	4007164	-21	kworker/u8:4+flush-179:0	07:15:18	0
4044073	99	42	33,8	cyclictest	4011812	-1	kworker/3:1H+kblockd	09:45:11	3
4044071	99	42	38,3	cyclictest	4051602	-21	kworker/u8:0+events_unbound	08:30:05	2
4044067	99	42	39,2	cyclictest	4132597	-21	kworker/u8:2+flush-179:0	09:15:10	1
4044067	99	42	37,3	cyclictest	4179352	-21	kworker/u8:1+events_unbound	10:05:29	1
4044063	99	42	39,2	cyclictest	99775	-21	kworker/u8:3+events_unbound	12:05:17	0
4044063	99	42	38,3	cyclictest	147635	-21	apt-get	11:55:14	0
4044071	99	41	37,3	cyclictest	84112	-21	kworker/u8:2+events_unbound	11:25:13	2
4044071	99	41	29,11	cyclictest	1260	-21	snmpd	08:56:39	2
4044067	99	41	37,3	cyclictest	4189399	-21	kworker/u8:0+flush-179:0	10:35:20	1
4044067	99	41	28,10	cyclictest	4043896	-21	kworker/u8:1+flush-179:0	07:35:06	1
4044073	99	40	37,1	cyclictest	3957260	-21	kworker/3:2+pm	08:13:46	3
4044073	99	40	35,3	cyclictest	4011812	-1	kworker/3:1H+kblockd	07:23:11	3
4044073	99	40	34,4	cyclictest	74244	-13	chrome	10:45:01	3
4044073	99	40	33,4	cyclictest	115403	-21	/usr/share/muni	11:25:13	3
4044073	99	40	31,7	cyclictest	4011812	-1	kworker/3:1H+kblockd	11:35:14	3
4044071	99	40	38,1	cyclictest	100270	-21	kworker/2:0+pm	12:20:31	2
4044071	99	40	37,2	cyclictest	4054891	-21	kworker/2:0+pm	07:30:32	2
4044071	99	40	37,2	cyclictest	16126	-21	kworker/2:0+pm	10:29:16	2
4044071	99	40	37,2	cyclictest	134596	-21	kworker/u8:1+events_unbound	11:50:15	2
4044071	99	40	37,2	cyclictest	100270	-21	kworker/2:0+pm	12:09:29	2
4044071	99	40	36,3	cyclictest	6220	-21	/usr/share/muni	09:40:12	2
4044071	99	40	36,3	cyclictest	4051602	-21	kworker/u8:0+events_unbound	08:07:01	2
4044071	99	40	1,14	cyclictest	16021	-31	munin-html	09:45:40	2
4044067	99	40	37,2	cyclictest	4179352	-21	kworker/u8:1+events_unbound	10:13:42	1
4044067	99	40	36,3	cyclictest	4179352	-21	kworker/u8:1+flush-179:0	09:39:16	1
4044067	99	40	36,3	cyclictest	4179352	-21	kworker/u8:1+flush-179:0	09:25:30	1
4044063	99	40	37,2	cyclictest	40680	-13	Chrome_ChildIOT	08:45:32	0
4044063	99	40	37,2	cyclictest	161325	-21	kworker/u8:2+events_unbound	12:20:14	0
4044063	99	40	35,4	cyclictest	4164390	-21	/usr/share/muni	09:05:15	0
4044073	99	39	36,2	cyclictest	4148901	-21	kworker/3:0+pm	09:42:16	3
4044071	99	39	37,1	cyclictest	4081468	-21	kworker/2:0+pm	07:53:01	2
4044071	99	39	37,1	cyclictest	100270	-21	kworker/2:0+pm	12:28:22	2
4044071	99	39	37,1	cyclictest	100270	-21	kworker/2:0+pm	11:46:41	2
4044071	99	39	36,2	cyclictest	16126	-21	kworker/2:0+pm	10:30:28	2
4044071	99	39	35,3	cyclictest	16126	-21	kworker/2:0+pm	10:01:06	2
4044067	99	39	37,2	cyclictest	173515	-21	kworker/u8:0+flush-179:0	12:20:37	1
4044067	99	39	35,3	cyclictest	4051602	-21	kworker/u8:0+events_unbound	07:30:26	1
4044067	99	39	34,4	cyclictest	146321	-21	/usr/share/muni	11:55:04	1
4044063	99	39	36,2	cyclictest	4189399	-21	kworker/u8:0+flush-179:0	10:25:27	0
4044063	99	39	35,3	cyclictest	4179352	-21	kworker/u8:1+events_unbound	09:20:01	0
4044063	99	39	35,3	cyclictest	4065122	-21	kworker/u8:2+flush-179:0	07:35:27	0
4044063	99	39	35,2	cyclictest	4096270	-1	kworker/0:1H+kblockd	09:55:04	0
4044063	99	39	34,3	cyclictest	104836	-21	latency_hist	11:15:01	0
4044073	99	38	35,2	cyclictest	40654	-21	chrome	09:26:46	3
4044073	99	38	35,2	cyclictest	3957260	-21	kworker/3:2+pm	07:48:36	3
4044073	99	38	35,2	cyclictest	105470	-21	isc-net-0000	11:22:07	3
4044073	99	38	34,3	cyclictest	4011812	-1	kworker/3:1H+kblockd	08:03:51	3
4044073	99	38	34,2	cyclictest	4011812	-1	kworker/3:1H+kblockd	12:05:45	3
4044073	99	38	34,2	cyclictest	4011812	-1	kworker/3:1H+kblockd	11:30:27	3
4044073	99	38	34,2	cyclictest	4011812	-1	kworker/3:1H+kblockd	10:09:32	3
4044073	99	38	34,2	cyclictest	4011812	-1	kworker/3:1H+kblockd	09:50:53	3
4044073	99	38	32,4	cyclictest	4159281	-21	/usr/share/muni	09:00:10	3
4044073	99	38	32,4	cyclictest	4148814	-21	latency_hist	08:50:01	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17