OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Tue Jun 23, 2026 00:46:41)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2770777	99	150	112,19	cyclictest	2968120	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:47:50	0
2770777	99	150	112,19	cyclictest	2968120	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:47:50	0
2770777	99	123	2,40	cyclictest	13	-21	ksoftirqd/0	23:10:40	0
2770777	99	120	65,35	cyclictest	210	-21	kswapd0	22:55:06	0
2770777	99	116	2,101	cyclictest	0	-21	swapper/0	00:35:43	0
2770777	99	113	68,38	cyclictest	2940755	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:02:07	0
2770777	99	110	51,51	cyclictest	2796702	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:12:24	0
2770777	99	108	83,15	cyclictest	2817128	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:02:37	0
2770777	99	108	83,15	cyclictest	2817128	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:02:36	0
2770777	99	107	1,96	cyclictest	2819162	-21	diskmemload	21:10:01	0
2770777	99	105	24,16	cyclictest	14	-21	rcu_preempt	23:05:27	0
2770783	99	102	89,6	cyclictest	2796702	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:22:23	1
2770777	99	102	42,7	cyclictest	13	-21	ksoftirqd/0	21:20:28	0
2770777	99	100	64,24	cyclictest	15	-21	rcuc/0	20:40:41	0
2770777	99	98	30,8	cyclictest	2852317	-21	ssh	21:37:07	0
2770803	99	97	90,4	cyclictest	0	-21	swapper/5	23:45:13	5
2770803	99	97	90,4	cyclictest	0	-21	swapper/5	23:45:13	5
2770777	99	97	36,3	cyclictest	0	-21	swapper/0	21:45:32	0
2770777	99	97	32,25	cyclictest	13	-21	ksoftirqd/0	22:50:42	0
2770777	99	96	25,26	cyclictest	2887966	-21	memory	22:05:26	0
2770777	99	96	25,26	cyclictest	2887966	-21	memory	22:05:26	0
2770803	99	95	89,3	cyclictest	0	-21	swapper/5	21:12:29	5
2770777	99	95	47,24	cyclictest	0	-21	swapper/0	22:29:13	0
2770783	99	94	84,6	cyclictest	210	-21	kswapd0	22:35:00	1
2770777	99	94	72,15	cyclictest	3043540	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:25:15	0
2770777	99	94	37,13	cyclictest	0	-21	swapper/0	00:05:38	0
2770777	99	94	37,13	cyclictest	0	-21	swapper/0	00:05:38	0
2770777	99	94	29,15	cyclictest	13	-21	ksoftirqd/0	22:33:57	0
2770777	99	93	55,24	cyclictest	0	-21	swapper/0	19:30:23	0
2770777	99	93	55,24	cyclictest	0	-21	swapper/0	19:30:23	0
2770777	99	93	35,8	cyclictest	3033359	-21	/usr/sbin/munin	00:00:31	0
2942596	2	92	0,6	sleep3	0	-21	swapper/3	22:48:59	3
2770777	99	92	35,52	cyclictest	13	-21	ksoftirqd/0	21:25:17	0
2770787	99	90	75,8	cyclictest	2817128	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:47:35	2
2770777	99	90	30,6	cyclictest	13	-21	ksoftirqd/0	00:15:25	0
2770777	99	90	30,6	cyclictest	13	-21	ksoftirqd/0	00:15:25	0
2770777	99	90	2,74	cyclictest	3027266	-21	expr	23:55:41	0
2770777	99	90	2,74	cyclictest	3027266	-21	expr	23:55:41	0
2770777	99	89	52,24	cyclictest	674	50	irq/528-eth0-Tx	23:15:29	0
2770777	99	89	48,31	cyclictest	0	-21	swapper/0	22:35:14	0
2770777	99	89	39,5	cyclictest	2869320	-21	ntpq	21:50:33	0
2770777	99	89	2,5	cyclictest	2943634	-21	ssh	22:50:01	0
2770783	99	88	78,7	cyclictest	210	-21	kswapd0	22:10:06	1
2770783	99	88	78,7	cyclictest	210	-21	kswapd0	22:10:05	1
2770803	99	87	81,3	cyclictest	0	-21	swapper/5	21:42:33	5
2770792	99	87	73,7	cyclictest	2968120	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:37:50	3
2770777	99	87	54,23	cyclictest	674	50	irq/528-eth0-Tx	21:42:36	0
2770777	99	87	23,15	cyclictest	0	-21	swapper/0	23:40:31	0
2770777	99	87	1,3	cyclictest	0	-21	swapper/0	23:50:44	0
2770803	99	86	80,3	cyclictest	0	-21	swapper/5	21:57:35	5
2770803	99	86	80,3	cyclictest	0	-21	swapper/5	21:57:34	5
2770787	99	86	73,7	cyclictest	3010910	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:55:13	2
2770787	99	86	73,7	cyclictest	3010910	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:55:13	2
2770777	99	86	1,55	cyclictest	0	-21	swapper/0	23:25:21	0
2770777	99	86	10,28	cyclictest	15	-21	rcuc/0	21:30:29	0
2770803	99	85	79,3	cyclictest	0	-21	swapper/5	20:47:28	5
2770777	99	85	52,3	cyclictest	0	-21	swapper/0	20:00:32	0
2770777	99	85	1,45	cyclictest	0	-21	swapper/0	20:45:29	0
2770777	99	85	1,38	cyclictest	3006418	-21	ssh	23:39:42	0
2770777	99	84	36,15	cyclictest	0	-21	swapper/0	20:30:38	0
2770777	99	84	21,24	cyclictest	0	-21	swapper/0	22:18:24	0
2770777	99	84	21,24	cyclictest	0	-21	swapper/0	22:18:23	0
2770777	99	83	14,33	cyclictest	674	50	irq/528-eth0-Tx	00:33:24	0
2770777	99	82	37,18	cyclictest	674	50	irq/528-eth0-Tx	23:30:45	0
2770792	99	81	67,7	cyclictest	2774604	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:52:22	3
2770777	99	81	38,4	cyclictest	0	-21	swapper/0	19:15:27	0
2770777	99	81	38,4	cyclictest	0	-21	swapper/0	19:15:27	0
2770777	99	81	33,6	cyclictest	13	-21	ksoftirqd/0	00:11:33	0
2770777	99	81	30,17	cyclictest	13	-21	ksoftirqd/0	21:15:25	0
2770777	99	81	30,17	cyclictest	13	-21	ksoftirqd/0	21:15:24	0
2770777	99	81	26,21	cyclictest	0	-21	swapper/0	20:05:31	0
2770777	99	81	18,14	cyclictest	13	-21	ksoftirqd/0	22:10:34	0
2770777	99	81	18,14	cyclictest	13	-21	ksoftirqd/0	22:10:33	0
2770798	99	79	67,6	cyclictest	2991851	-21	ssh	23:27:46	4
2770803	99	78	72,3	cyclictest	0	-21	swapper/5	20:32:27	5
2770792	99	77	63,7	cyclictest	2817128	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:32:32	3
2770777	99	77	2,39	cyclictest	2814974	-21	kworker/u12:2+flush-179:96@ wb_workfn	21:00:00	0
2770803	99	76	70,3	cyclictest	0	-21	swapper/5	22:05:43	5
2770803	99	76	70,3	cyclictest	0	-21	swapper/5	22:05:43	5
2770777	99	76	52,16	cyclictest	2814974	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:10:45	0
2770777	99	76	40,4	cyclictest	673	50	irq/527-eth0-Tx	19:10:13	0
2770777	99	76	40,4	cyclictest	673	50	irq/527-eth0-Tx	19:10:12	0
2770803	99	75	68,3	cyclictest	0	-21	swapper/5	23:09:43	5
2770803	99	75	67,4	cyclictest	0	-21	swapper/5	23:25:25	5
2770783	99	75	62,7	cyclictest	3068195	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:37:57	1
2770777	99	74	54,16	cyclictest	2891250	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:22:39	0
2913077	2	73	0,5	sleep3	0	-21	swapper/3	22:25:22	3
2770803	99	72	65,3	cyclictest	0	-21	swapper/5	20:20:40	5
2770777	99	72	49,7	cyclictest	13	-21	ksoftirqd/0	00:20:29	0
2770803	99	71	66,2	cyclictest	0	-21	swapper/5	19:10:17	5
2770803	99	71	66,2	cyclictest	0	-21	swapper/5	19:10:17	5
2770787	99	71	59,6	cyclictest	2933386	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:12:47	2
2849531	2	70	0,6	sleep5	0	-21	swapper/5	21:35:19	5
2770803	99	70	64,3	cyclictest	0	-21	swapper/5	19:34:01	5
2770803	99	70	64,3	cyclictest	0	-21	swapper/5	19:34:01	5
2770803	99	70	63,3	cyclictest	0	-21	swapper/5	23:20:44	5
2770803	99	69	62,3	cyclictest	0	-21	swapper/5	22:45:20	5
2770798	99	69	52,12	cyclictest	3017011	-21	ssh	23:47:50	4
2770798	99	69	52,12	cyclictest	3017011	-21	ssh	23:47:50	4
2770792	99	69	57,6	cyclictest	3028167	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:07:53	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17