OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Wed Jan 07, 2026 12:46:47)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2833954	2	3454	3428,16	sleep4	0	-21	swapper/4	07:05:21	4
2833666	2	1152	1133,10	sleep5	0	-21	swapper/5	07:05:17	5
3003792	2	148	0,3	sleep4	0	-21	swapper/4	10:49:23	4
2835348	99	146	131,7	cyclictest	2973340	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:49:34	2
2835348	99	145	130,7	cyclictest	3049027	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:29:40	2
2835337	99	137	18,65	cyclictest	2877593	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:01:18	0
2835337	99	135	24,77	cyclictest	2855291	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:15:47	0
2835348	99	132	118,7	cyclictest	2923793	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:44:20	2
2835337	99	130	56,51	cyclictest	2923793	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:52:39	0
2835337	99	130	29,68	cyclictest	2835033	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:20:34	0
2835342	99	129	116,6	cyclictest	2940657	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:29:29	1
2835337	99	129	2,112	cyclictest	0	-21	swapper/0	12:10:21	0
2835337	99	129	2,112	cyclictest	0	-21	swapper/0	12:10:20	0
2835348	99	128	114,7	cyclictest	3041889	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:24:39	2
2835342	99	127	113,6	cyclictest	2909167	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:50:13	1
2835342	99	125	110,8	cyclictest	2923793	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:09:25	1
2835353	99	121	106,8	cyclictest	2973340	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:44:33	3
2835353	99	121	106,8	cyclictest	2973340	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:44:33	3
2835348	99	121	109,6	cyclictest	3072404	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:49:45	2
2835337	99	120	96,17	cyclictest	2942396	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	10:04:24	0
2835337	99	119	2,8	cyclictest	2974111	-21	/usr/sbin/munin	10:25:23	0
2835348	99	118	103,7	cyclictest	2883662	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:24:16	2
2835337	99	116	71,27	cyclictest	2835033	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:16:06	0
2835337	99	116	40,54	cyclictest	3049027	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:27:40	0
2835348	99	115	101,7	cyclictest	3059616	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:38:34	2
2835337	99	115	82,29	cyclictest	210	-21	kswapd0	10:15:26	0
2835337	99	115	34,46	cyclictest	691	50	irq/529-eth0-Tx	11:50:30	0
2835337	99	115	34,46	cyclictest	691	50	irq/529-eth0-Tx	11:50:30	0
2835337	99	115	24,66	cyclictest	2835033	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:28:27	0
2835348	99	113	99,7	cyclictest	2956950	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:15:22	2
2835342	99	112	103,6	cyclictest	210	-21	kswapd0	12:10:24	1
2835342	99	112	103,6	cyclictest	210	-21	kswapd0	12:10:24	1
2835337	99	111	78,26	cyclictest	3081216	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:05:19	0
2835337	99	111	78,26	cyclictest	3081216	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:05:18	0
2835362	99	110	104,3	cyclictest	0	-21	swapper/5	10:15:26	5
2835337	99	110	2,70	cyclictest	2916808	-21	kworker/u12:0+rpciod@ rpc_async_schedule	09:55:27	0
2835337	99	109	85,16	cyclictest	3034630	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:19:40	0
2835337	99	109	2,94	cyclictest	0	-21	swapper/0	09:40:25	0
2835342	99	107	94,7	cyclictest	3107781	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:20:01	1
2835337	99	107	1,92	cyclictest	0	-21	swapper/0	11:45:48	0
2835337	99	105	1,95	cyclictest	0	-21	swapper/0	08:54:05	0
2835337	99	105	1,95	cyclictest	0	-21	swapper/0	08:54:05	0
2835342	99	104	94,6	cyclictest	210	-21	kswapd0	11:15:11	1
2835337	99	104	2,89	cyclictest	0	-21	swapper/0	08:42:01	0
2835337	99	104	1,82	cyclictest	0	-21	swapper/0	10:31:07	0
2835337	99	104	1,81	cyclictest	0	-21	swapper/0	11:08:30	0
2835348	99	103	88,8	cyclictest	3059616	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:56:03	2
2835348	99	103	88,8	cyclictest	3059616	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:56:02	2
2835337	99	103	69,21	cyclictest	691	50	irq/529-eth0-Tx	07:35:32	0
2835337	99	103	37,42	cyclictest	3049027	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:43:08	0
2835337	99	103	1,88	cyclictest	0	-21	swapper/0	08:03:31	0
2835337	99	103	1,88	cyclictest	0	-21	swapper/0	08:03:30	0
2835342	99	102	90,5	cyclictest	3025434	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:14:38	1
2835337	99	102	9,88	cyclictest	145	50	irq/98-imx_mu_c	09:25:33	0
2835337	99	102	7,57	cyclictest	2923793	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:05:53	0
2835337	99	102	31,40	cyclictest	690	50	irq/528-eth0-Tx	10:35:34	0
2835337	99	102	31,40	cyclictest	690	50	irq/528-eth0-Tx	10:35:34	0
2835337	99	102	1,86	cyclictest	0	-21	swapper/0	08:57:47	0
2835337	99	102	1,65	cyclictest	2996347	-21	kworker/u12:0+rpciod@ rpc_async_schedule	10:45:15	0
2835337	99	101	67,20	cyclictest	0	-21	swapper/0	07:10:47	0
2835337	99	101	67,20	cyclictest	0	-21	swapper/0	07:10:46	0
2835337	99	101	1,94	cyclictest	0	-21	swapper/0	07:58:13	0
2835337	99	101	1,88	cyclictest	0	-21	swapper/0	12:24:03	0
2835337	99	101	1,86	cyclictest	0	-21	swapper/0	08:31:12	0
2835337	99	101	1,86	cyclictest	0	-21	swapper/0	08:12:11	0
2835337	99	101	1,86	cyclictest	0	-21	swapper/0	08:12:10	0
2835337	99	101	1,76	cyclictest	3064085	-21	ssh	11:38:09	0
2835337	99	100	69,20	cyclictest	691	50	irq/529-eth0-Tx	08:45:15	0
2835337	99	100	1,83	cyclictest	0	-21	swapper/0	12:28:34	0
2835348	99	99	85,7	cyclictest	3072404	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:26:33	2
2835337	99	99	1,82	cyclictest	0	-21	swapper/0	07:40:31	0
2835337	99	98	65,20	cyclictest	690	50	irq/528-eth0-Tx	09:15:37	0
2835337	99	98	65,20	cyclictest	690	50	irq/528-eth0-Tx	09:15:36	0
2835337	99	98	55,28	cyclictest	689	50	irq/527-eth0-Tx	10:54:58	0
2835337	99	98	32,46	cyclictest	692	50	irq/530-eth0-Tx	11:10:45	0
2835337	99	98	1,82	cyclictest	0	-21	swapper/0	07:30:06	0
2835337	99	98	1,81	cyclictest	3087182	-21	ssh	11:56:36	0
2835337	99	98	1,81	cyclictest	3087182	-21	ssh	11:56:36	0
2835337	99	98	1,80	cyclictest	0	-21	swapper/0	10:22:27	0
2835337	99	97	3,7	cyclictest	3017974	-21	/usr/sbin/munin	11:00:24	0
2835353	99	96	81,8	cyclictest	3137086	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:39:56	3
2835337	99	96	70,13	cyclictest	690	50	irq/528-eth0-Tx	10:55:08	0
2835337	99	96	1,90	cyclictest	0	-21	swapper/0	08:27:49	0
2835337	99	96	1,54	cyclictest	0	-21	swapper/0	10:15:01	0
2835348	99	95	81,7	cyclictest	2826370	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:14:35	2
2835348	99	95	81,7	cyclictest	2826370	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:14:34	2
2835337	99	95	70,16	cyclictest	0	-21	swapper/0	09:11:51	0
2835337	99	95	1,82	cyclictest	0	-21	swapper/0	09:24:39	0
2835337	99	95	1,74	cyclictest	0	-21	swapper/0	08:05:15	0
2835342	99	94	82,6	cyclictest	3107781	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:25:03	1
2835342	99	94	81,6	cyclictest	2860671	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:14:07	1
2835342	99	94	81,6	cyclictest	2860671	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:14:06	1
2835337	99	94	1,82	cyclictest	0	-21	swapper/0	12:39:50	0
2835337	99	93	8,71	cyclictest	692	50	irq/530-eth0-Tx	11:24:06	0
2835337	99	93	5,65	cyclictest	2883662	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:09:31	0
2835337	99	93	34,41	cyclictest	692	50	irq/530-eth0-Tx	09:35:39	0
2835337	99	93	15,62	cyclictest	0	-21	swapper/0	12:15:30	0
2835358	99	92	76,10	cyclictest	2948634	-21	ssh	10:04:23	4
2835348	99	92	64,6	cyclictest	2940657	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:11:40	2
2835342	99	92	78,7	cyclictest	3119189	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:34:54	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17