OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sun Jul 19, 2026 12:46:36)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4015920	2	2194	2174,11	sleep4	0	-21	swapper/4	07:07:31	4
4014465	2	1554	1539,6	sleep2	4014011	-21	kworker/2:1+events@ dbs_work_handler	07:05:15	2
4016272	99	175	112,55	cyclictest	26305	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:30:40	0
4016272	99	175	112,55	cyclictest	26305	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:30:40	0
4016272	99	164	75,58	cyclictest	38354	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:45:42	0
4016272	99	141	108,24	cyclictest	53282	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:15:47	0
4016272	99	135	94,33	cyclictest	53282	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:50:42	0
4016272	99	121	85,29	cyclictest	4070488	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:20:15	0
4016272	99	116	2,50	cyclictest	13	-21	ksoftirqd/0	10:25:37	0
4016272	99	116	2,50	cyclictest	13	-21	ksoftirqd/0	10:25:36	0
4016272	99	115	37,42	cyclictest	4121272	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:00:29	0
4016272	99	115	3,6	cyclictest	4089117	-21	ssh	09:30:01	0
4016272	99	114	33,51	cyclictest	0	-21	swapper/0	11:20:07	0
4016272	99	113	2,85	cyclictest	13	-21	ksoftirqd/0	10:38:29	0
4016282	99	112	100,6	cyclictest	4082524	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:25:16	2
4016272	99	112	30,26	cyclictest	13	-21	ksoftirqd/0	09:55:01	0
4016272	99	107	2,73	cyclictest	0	-21	swapper/0	09:05:20	0
4016272	99	107	2,73	cyclictest	0	-21	swapper/0	09:05:19	0
4016272	99	104	1,3	cyclictest	0	-21	swapper/0	09:10:41	0
4016272	99	102	67,15	cyclictest	4013465	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:19:53	0
4016272	99	102	36,34	cyclictest	38354	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:05:12	0
4016272	99	100	58,15	cyclictest	4131553	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:10:25	0
4016272	99	100	58,15	cyclictest	4131553	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:10:24	0
4016272	99	97	37,40	cyclictest	107731	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:10:15	0
4016298	99	95	88,3	cyclictest	0	-21	swapper/5	09:45:19	5
4016272	99	95	34,41	cyclictest	26305	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:25:19	0
4016272	99	95	34,41	cyclictest	26305	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:25:18	0
4016272	99	93	2,55	cyclictest	135075	-21	/usr/sbin/munin	12:30:20	0
4016272	99	92	29,13	cyclictest	0	-21	swapper/0	10:40:40	0
4016272	99	92	21,25	cyclictest	0	-21	swapper/0	10:47:01	0
4016272	99	90	2,4	cyclictest	0	-21	swapper/0	12:35:41	0
4016292	99	89	81,3	cyclictest	0	-21	swapper/4	10:20:24	4
4016272	99	89	35,12	cyclictest	0	-21	swapper/0	12:04:20	0
4016272	99	89	35,12	cyclictest	0	-21	swapper/0	12:04:19	0
4016298	99	88	80,4	cyclictest	0	-21	swapper/5	11:30:40	5
4016298	99	88	80,4	cyclictest	0	-21	swapper/5	11:30:40	5
4016272	99	88	23,24	cyclictest	0	-21	swapper/0	10:54:28	0
4016272	99	88	23,24	cyclictest	0	-21	swapper/0	10:54:27	0
4016282	99	87	72,8	cyclictest	4131553	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:30:28	2
4016276	99	86	73,6	cyclictest	4063021	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:23:45	1
4016272	99	86	42,15	cyclictest	13	-21	ksoftirqd/0	11:10:43	0
4016272	99	86	40,24	cyclictest	0	-21	swapper/0	11:35:16	0
4016272	99	86	2,63	cyclictest	70108	-21	processes	11:40:41	0
4016272	99	85	47,23	cyclictest	0	-21	swapper/0	08:50:39	0
4016298	99	84	77,3	cyclictest	0	-21	swapper/5	12:15:22	5
4016272	99	84	67,13	cyclictest	4442	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:55:33	0
4016272	99	84	67,13	cyclictest	4442	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:55:32	0
4016272	99	84	37,13	cyclictest	4123886	-21	ntpq	09:55:30	0
4016272	99	84	2,4	cyclictest	0	-21	swapper/0	11:00:14	0
4016272	99	84	2,26	cyclictest	0	-21	swapper/0	10:07:28	0
4016272	99	84	13,42	cyclictest	13	-21	ksoftirqd/0	09:45:38	0
4016292	99	83	72,6	cyclictest	4184307	-21	ssh	10:40:42	4
4016282	99	83	69,7	cyclictest	61185	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:00:45	2
4016282	99	83	69,7	cyclictest	61185	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:00:45	2
4016272	99	83	6,25	cyclictest	13	-21	ksoftirqd/0	12:27:47	0
4016272	99	83	42,13	cyclictest	674	50	irq/528-eth0-Tx	11:16:20	0
4016272	99	83	40,22	cyclictest	0	-21	swapper/0	07:30:43	0
4016272	99	83	38,24	cyclictest	0	-21	swapper/0	09:30:44	0
4016272	99	83	38,24	cyclictest	0	-21	swapper/0	09:30:43	0
4016272	99	83	37,23	cyclictest	0	-21	swapper/0	10:33:44	0
4016272	99	83	1,61	cyclictest	0	-21	swapper/0	09:40:12	0
4016272	99	83	1,61	cyclictest	0	-21	swapper/0	09:40:11	0
4016272	99	82	7,51	cyclictest	13	-21	ksoftirqd/0	11:08:24	0
4016276	99	81	69,6	cyclictest	4015816	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:14:52	1
4016272	99	81	51,18	cyclictest	674	50	irq/528-eth0-Tx	09:35:28	0
4016298	99	80	73,3	cyclictest	0	-21	swapper/5	10:45:30	5
4016292	99	80	69,6	cyclictest	4089623	-21	ssh	09:30:17	4
4016292	99	80	69,6	cyclictest	4089623	-21	ssh	09:30:16	4
4016272	99	80	49,12	cyclictest	674	50	irq/528-eth0-Tx	10:20:33	0
4016272	99	80	32,16	cyclictest	4034270	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:05:30	0
4016292	99	79	74,3	cyclictest	0	-21	swapper/4	07:45:35	4
4016272	99	79	49,12	cyclictest	0	-21	swapper/0	09:15:39	0
4016272	99	79	35,23	cyclictest	0	-21	swapper/0	08:35:01	0
4016272	99	79	21,41	cyclictest	13	-21	ksoftirqd/0	12:20:20	0
4016292	99	78	65,8	cyclictest	4106445	-21	ssh	09:42:29	4
4016292	99	78	65,8	cyclictest	4106445	-21	ssh	09:42:28	4
4016292	99	77	71,3	cyclictest	0	-21	swapper/4	09:12:34	4
4016272	99	77	35,23	cyclictest	0	-21	swapper/0	08:15:29	0
4016292	99	75	70,2	cyclictest	0	-21	swapper/4	07:20:29	4
4016292	99	75	68,3	cyclictest	0	-21	swapper/4	12:31:45	4
4016292	99	75	68,3	cyclictest	0	-21	swapper/4	12:25:00	4
4016282	99	75	61,7	cyclictest	4131553	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:40:29	2
4016272	99	75	50,13	cyclictest	0	-21	swapper/0	07:50:01	0
4016272	99	75	2,5	cyclictest	4150931	-21	ssh	10:15:41	0
4016272	99	75	2,5	cyclictest	4150931	-21	ssh	10:15:40	0
4016298	99	74	66,4	cyclictest	0	-21	swapper/5	09:30:01	5
4016292	99	74	68,3	cyclictest	0	-21	swapper/4	10:25:13	4
4016292	99	74	68,3	cyclictest	0	-21	swapper/4	10:25:12	4
4016292	99	73	67,3	cyclictest	0	-21	swapper/4	10:51:53	4
4016292	99	73	67,3	cyclictest	0	-21	swapper/4	10:51:52	4
4016272	99	73	43,13	cyclictest	673	50	irq/527-eth0-Tx	08:25:14	0
4016272	99	73	25,7	cyclictest	13	-21	ksoftirqd/0	11:55:13	0
4016292	99	72	63,5	cyclictest	9977	-21	ssh	10:55:33	4
4016292	99	72	63,5	cyclictest	9977	-21	ssh	10:55:32	4
4016292	99	71	66,2	cyclictest	0	-21	swapper/4	12:18:23	4
4016292	99	71	65,3	cyclictest	0	-21	swapper/4	08:45:27	4
4016292	99	71	65,3	cyclictest	0	-21	swapper/4	08:45:27	4
4016292	99	71	62,5	cyclictest	4133459	-21	ssh	10:02:46	4
4016292	99	71	60,6	cyclictest	4068074	-21	diskmemload-4	10:11:28	4
4016292	99	71	60,6	cyclictest	4068074	-21	diskmemload-4	10:11:28	4
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17