OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sun May 17, 2026 12:46:36)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2141176	2	1934	1920,6	sleep2	2136808	-21	kworker/2:0+events@ dbs_work_handler	07:09:15	2
2139762	2	1176	1150,16	sleep4	0	-21	swapper/4	07:05:20	4
2139662	2	546	512,21	sleep3	2132059	-21	kworker/3:3+events@ dbs_work_handler	07:05:18	3
2141396	99	134	63,41	cyclictest	2194885	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:30:25	0
2141401	99	118	103,8	cyclictest	2428524	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:23:34	1
2141401	99	118	103,8	cyclictest	2428524	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:23:34	1
2141414	99	114	108,3	cyclictest	0	-21	swapper/4	09:44:47	4
2141396	99	110	15,73	cyclictest	0	-21	swapper/0	10:25:38	0
2141414	99	108	103,2	cyclictest	0	-21	swapper/4	10:09:57	4
2141396	99	105	13,61	cyclictest	2321514	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:40:17	0
2141419	99	104	98,3	cyclictest	0	-21	swapper/5	12:29:34	5
2141414	99	102	95,3	cyclictest	0	-21	swapper/4	10:25:01	4
2141396	99	101	26,57	cyclictest	2153901	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:00:09	0
2141396	99	101	26,57	cyclictest	2153901	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:00:09	0
2141419	99	97	91,3	cyclictest	0	-21	swapper/5	11:16:35	5
2141419	99	97	89,3	cyclictest	0	-21	swapper/5	10:52:14	5
2428271	2	96	0,3	sleep0	15	-21	rcuc/0	12:20:18	0
2428271	2	96	0,3	sleep0	15	-21	rcuc/0	12:20:18	0
2141414	99	95	90,2	cyclictest	0	-21	swapper/4	11:30:59	4
2141401	99	95	77,14	cyclictest	210	-21	kswapd0	12:35:26	1
2141414	99	94	88,3	cyclictest	0	-21	swapper/4	12:20:15	4
2141414	99	94	88,3	cyclictest	0	-21	swapper/4	12:20:14	4
2141396	99	94	79,7	cyclictest	2190366	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:44:47	0
2141396	99	93	70,7	cyclictest	2321514	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:23:07	0
2141396	99	93	22,58	cyclictest	0	-21	swapper/0	11:10:35	0
2141419	99	91	85,3	cyclictest	0	-21	swapper/5	10:25:01	5
2141419	99	90	83,3	cyclictest	0	-21	swapper/5	12:13:14	5
2141414	99	90	85,2	cyclictest	0	-21	swapper/4	11:45:41	4
2141396	99	90	51,36	cyclictest	2299376	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:46:10	0
2141410	99	89	75,7	cyclictest	2167367	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:49:37	3
2141396	99	89	75,7	cyclictest	2256213	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:09:57	0
2141419	99	88	81,3	cyclictest	0	-21	swapper/5	08:05:34	5
2141396	99	88	64,7	cyclictest	0	-21	swapper/0	08:50:17	0
2141396	99	88	64,7	cyclictest	0	-21	swapper/0	08:50:17	0
2141419	99	87	80,3	cyclictest	0	-21	swapper/5	12:23:33	5
2141419	99	87	80,3	cyclictest	0	-21	swapper/5	12:23:32	5
2141419	99	87	80,3	cyclictest	0	-21	swapper/5	11:25:39	5
2141414	99	87	82,2	cyclictest	0	-21	swapper/4	11:50:14	4
2141414	99	87	82,2	cyclictest	0	-21	swapper/4	11:50:13	4
2141414	99	87	81,3	cyclictest	0	-21	swapper/4	09:34:14	4
2141419	99	86	80,3	cyclictest	0	-21	swapper/5	11:08:33	5
2141419	99	85	78,3	cyclictest	0	-21	swapper/5	11:55:15	5
2141419	99	85	78,3	cyclictest	0	-21	swapper/5	11:55:14	5
2141419	99	85	78,3	cyclictest	0	-21	swapper/5	10:25:33	5
2141401	99	85	71,6	cyclictest	2409212	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	12:10:18	1
2141419	99	84	79,2	cyclictest	0	-21	swapper/5	09:30:13	5
2141419	99	84	78,3	cyclictest	0	-21	swapper/5	09:37:22	5
2141414	99	84	79,2	cyclictest	0	-21	swapper/4	10:03:21	4
2141414	99	84	71,7	cyclictest	2195876	-21	ssh	09:15:34	4
2141410	99	84	74,7	cyclictest	2321514	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:31:35	3
2141404	99	84	70,7	cyclictest	2374628	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:02:34	2
2141404	99	84	70,7	cyclictest	2374628	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:02:33	2
2141396	99	84	35,7	cyclictest	13	-21	ksoftirqd/0	11:50:19	0
2141396	99	84	35,7	cyclictest	13	-21	ksoftirqd/0	11:50:18	0
2141414	99	83	72,6	cyclictest	2444221	-21	ssh	12:32:35	4
2141404	99	83	52,14	cyclictest	2194885	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:25:28	2
2141396	99	83	71,6	cyclictest	2437590	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:35:48	0
2141396	99	83	56,14	cyclictest	690	50	irq/528-eth0-Tx	11:00:01	0
2141396	99	83	44,28	cyclictest	2167367	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:31:47	0
2152717	2	82	0,2	sleep5	0	-21	swapper/5	07:35:39	5
2141419	99	82	75,3	cyclictest	0	-21	swapper/5	11:01:41	5
2141419	99	82	75,3	cyclictest	0	-21	swapper/5	09:27:34	5
2141414	99	82	76,3	cyclictest	0	-21	swapper/4	07:45:35	4
2141414	99	82	75,4	cyclictest	0	-21	swapper/4	07:25:40	4
2141414	99	82	71,6	cyclictest	2357836	-21	ssh	11:24:20	4
2141404	99	82	28,16	cyclictest	2341094	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:30:27	2
2141396	99	82	2,76	cyclictest	15	-21	rcuc/0	09:50:45	0
2141419	99	81	75,3	cyclictest	0	-21	swapper/5	10:19:07	5
2141419	99	81	75,3	cyclictest	0	-21	swapper/5	08:29:31	5
2141419	99	81	75,3	cyclictest	0	-21	swapper/5	07:11:35	5
2141419	99	81	74,3	cyclictest	0	-21	swapper/5	07:34:22	5
2141419	99	81	74,3	cyclictest	0	-21	swapper/5	07:34:22	5
2141410	99	81	66,7	cyclictest	2273683	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:45:07	3
2141419	99	80	74,3	cyclictest	0	-21	swapper/5	10:07:05	5
2141419	99	80	74,2	cyclictest	0	-21	swapper/5	09:43:28	5
2141419	99	80	73,3	cyclictest	0	-21	swapper/5	09:59:35	5
2141419	99	80	73,3	cyclictest	0	-21	swapper/5	09:59:35	5
2141419	99	80	72,5	cyclictest	0	-21	swapper/5	07:56:33	5
2141419	99	80	70,6	cyclictest	0	-21	swapper/5	12:00:14	5
2141419	99	80	70,6	cyclictest	0	-21	swapper/5	12:00:14	5
2141414	99	80	73,3	cyclictest	0	-21	swapper/4	10:15:57	4
2141404	99	80	2,60	cyclictest	2303718	-21	cat	10:40:45	2
2141404	99	80	2,60	cyclictest	2303718	-21	cat	10:40:45	2
2141396	99	80	65,8	cyclictest	2223558	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:55:18	0
2141396	99	80	65,8	cyclictest	2223558	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:55:18	0
2141419	99	79	73,3	cyclictest	0	-21	swapper/5	10:40:06	5
2141419	99	79	73,3	cyclictest	0	-21	swapper/5	10:40:05	5
2141419	99	79	72,3	cyclictest	0	-21	swapper/5	12:18:00	5
2141419	99	79	72,3	cyclictest	0	-21	swapper/5	12:17:59	5
2141419	99	79	72,3	cyclictest	0	-21	swapper/5	10:58:15	5
2141419	99	79	72,3	cyclictest	0	-21	swapper/5	08:34:35	5
2141419	99	79	71,4	cyclictest	0	-21	swapper/5	11:30:48	5
2141414	99	79	74,2	cyclictest	0	-21	swapper/4	10:13:47	4
2141414	99	79	73,3	cyclictest	0	-21	swapper/4	12:17:48	4
2141414	99	79	73,3	cyclictest	0	-21	swapper/4	12:17:47	4
2141410	99	79	65,7	cyclictest	2239183	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:02:33	3
2141401	99	79	69,7	cyclictest	210	-21	kswapd0	11:25:27	1
2141396	99	79	56,4	cyclictest	689	50	irq/527-eth0-Tx	12:10:28	0
2141396	99	79	28,5	cyclictest	15	-21	rcuc/0	10:00:46	0
2141419	99	78	71,4	cyclictest	0	-21	swapper/5	08:19:18	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17