OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sun Jul 05, 2026 00:46:30)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2288649	2	2691	2679,6	sleep2	2263693	-21	kworker/2:0+events@ dbs_work_handler	19:07:54	2
2288752	2	1432	1409,14	sleep4	0	-21	swapper/4	19:09:22	4
2288967	99	115	102,7	cyclictest	2438235	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:37:58	2
2288967	99	114	101,7	cyclictest	2290727	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:21:59	2
2288957	99	114	88,7	cyclictest	2402165	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:07:39	0
2288957	99	109	1,48	cyclictest	13	-21	ksoftirqd/0	00:19:29	0
2335912	2	98	0,5	sleep5	0	-21	swapper/5	21:05:10	5
2288984	99	98	93,2	cyclictest	0	-21	swapper/5	22:37:46	5
2288967	99	98	85,6	cyclictest	2537671	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:58:04	2
2288957	99	98	73,6	cyclictest	2421355	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:37:46	0
2288977	99	94	87,3	cyclictest	0	-21	swapper/4	00:25:29	4
2288957	99	91	32,6	cyclictest	13	-21	ksoftirqd/0	22:43:16	0
2288957	99	91	19,59	cyclictest	0	-21	swapper/0	22:33:46	0
2288977	99	90	79,6	cyclictest	2560569	-21	ssh	00:10:39	4
2288977	99	88	79,5	cyclictest	0	-21	swapper/4	22:05:37	4
2288977	99	88	76,7	cyclictest	2349637	-21	ssh	21:20:33	4
2288977	99	87	81,3	cyclictest	0	-21	swapper/4	23:35:39	4
2288957	99	86	18,19	cyclictest	0	-21	swapper/0	00:20:36	0
2288967	99	85	71,7	cyclictest	2214783	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:42:01	2
2288977	99	84	73,5	cyclictest	2417862	-21	ssh	22:15:29	4
2288977	99	84	73,5	cyclictest	2417862	-21	ssh	22:15:29	4
2288977	99	84	71,7	cyclictest	2474626	-21	ssh	23:00:48	4
2288967	99	84	72,6	cyclictest	2485440	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:12:52	2
2288977	99	83	76,3	cyclictest	0	-21	swapper/4	21:20:00	4
2288977	99	82	70,7	cyclictest	2547619	-21	ssh	00:00:20	4
2288957	99	82	1,59	cyclictest	0	-21	swapper/0	22:50:33	0
2288957	99	82	1,59	cyclictest	0	-21	swapper/0	22:50:33	0
2391136	2	81	0,4	chrt	0	-21	swapper/0	21:54:39	0
2288967	99	81	68,6	cyclictest	2526553	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:03:05	2
2288963	99	81	65,8	cyclictest	2340320	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:32:28	1
2288977	99	80	74,3	cyclictest	0	-21	swapper/4	22:20:11	4
2288977	99	80	74,3	cyclictest	0	-21	swapper/4	00:30:30	4
2288957	99	80	24,3	cyclictest	0	-21	swapper/0	23:35:38	0
2288977	99	79	73,3	cyclictest	0	-21	swapper/4	23:24:51	4
2288977	99	79	72,3	cyclictest	0	-21	swapper/4	23:55:33	4
2288977	99	78	69,5	cyclictest	0	-21	swapper/4	23:10:35	4
2288977	99	78	69,5	cyclictest	0	-21	swapper/4	21:55:39	4
2288977	99	78	64,8	cyclictest	2399227	-21	taskset	22:00:29	4
2288973	99	78	64,7	cyclictest	2438235	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:32:57	3
2288984	99	77	70,4	cyclictest	0	-21	swapper/5	22:30:16	5
2288977	99	77	71,3	cyclictest	0	-21	swapper/4	22:25:38	4
2288977	99	77	71,3	cyclictest	0	-21	swapper/4	19:50:00	4
2288977	99	77	66,6	cyclictest	2446068	-21	ssh	22:38:23	4
2288973	99	77	63,7	cyclictest	2493062	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:27:56	3
2288967	99	77	64,7	cyclictest	2321702	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	20:32:16	2
2288977	99	76	70,3	cyclictest	0	-21	swapper/4	23:31:35	4
2288977	99	76	70,3	cyclictest	0	-21	swapper/4	22:50:38	4
2288977	99	76	70,3	cyclictest	0	-21	swapper/4	22:50:37	4
2288977	99	76	70,3	cyclictest	0	-21	swapper/4	22:40:35	4
2288977	99	76	70,3	cyclictest	0	-21	swapper/4	19:50:35	4
2288967	99	76	63,6	cyclictest	2493062	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:17:51	2
2288963	99	76	63,6	cyclictest	2593719	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:38:10	1
2288984	99	75	68,3	cyclictest	0	-21	swapper/5	23:05:19	5
2288973	99	75	61,7	cyclictest	2577555	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:28:08	3
2288957	99	75	19,28	cyclictest	2364279	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:41:23	0
2288957	99	75	19,28	cyclictest	2364279	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:41:23	0
2288977	99	74	67,3	cyclictest	0	-21	swapper/4	21:45:01	4
2288977	99	74	67,3	cyclictest	0	-21	swapper/4	21:45:01	4
2288977	99	74	60,8	cyclictest	2437037	-21	ssh	22:30:41	4
2288984	99	73	67,3	cyclictest	0	-21	swapper/5	21:12:23	5
2288977	99	73	66,3	cyclictest	0	-21	swapper/4	20:45:31	4
2288977	99	72	66,3	cyclictest	0	-21	swapper/4	21:07:23	4
2288977	99	72	66,3	cyclictest	0	-21	swapper/4	19:35:27	4
2288977	99	72	65,3	cyclictest	0	-21	swapper/4	00:19:00	4
2288977	99	72	59,7	cyclictest	2362222	-21	ssh	21:30:41	4
2288967	99	72	57,7	cyclictest	2454055	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:06:46	2
2288957	99	72	64,5	cyclictest	210	-21	kswapd0	22:10:25	0
2288957	99	72	64,5	cyclictest	210	-21	kswapd0	22:10:25	0
2424084	2	71	0,4	sleep5	0	-21	swapper/5	22:20:24	5
2288977	99	71	61,6	cyclictest	2504941	-21	ssh	23:25:32	4
2288977	99	71	60,6	cyclictest	2571868	-21	ssh	00:20:12	4
2288977	99	71	59,7	cyclictest	2340942	-21	diskmemload-4	22:48:59	4
2288977	99	71	59,7	cyclictest	2340942	-21	diskmemload-4	22:48:59	4
2288957	99	71	9,20	cyclictest	2479497	-21	df_inode	23:05:22	0
2592318	2	70	0,6	sleep4	2592315	-21	ssh	00:36:00	4
2288963	99	70	55,7	cyclictest	2392498	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:12:40	1
2288963	99	70	55,7	cyclictest	2392498	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:12:40	1
2288963	99	70	38,9	cyclictest	2337395	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:00:13	1
2288957	99	70	19,3	cyclictest	0	-21	swapper/0	00:00:04	0
2288957	99	70	1,3	cyclictest	0	-21	swapper/0	23:40:41	0
2288977	99	69	63,3	cyclictest	0	-21	swapper/4	21:10:35	4
2288977	99	69	63,3	cyclictest	0	-21	swapper/4	20:55:35	4
2288977	99	69	63,3	cyclictest	0	-21	swapper/4	20:00:36	4
2288977	99	69	62,3	cyclictest	0	-21	swapper/4	23:50:32	4
2288957	99	69	23,25	cyclictest	15	-21	rcuc/0	00:11:16	0
2288984	99	68	61,3	cyclictest	0	-21	swapper/5	22:10:25	5
2288984	99	68	61,3	cyclictest	0	-21	swapper/5	22:10:25	5
2288977	99	68	63,2	cyclictest	0	-21	swapper/4	19:25:35	4
2288977	99	68	61,3	cyclictest	0	-21	swapper/4	00:05:15	4
2288977	99	68	61,3	cyclictest	0	-21	swapper/4	00:05:14	4
2288977	99	68	60,4	cyclictest	0	-21	swapper/4	21:54:21	4
2288977	99	68	55,7	cyclictest	2368244	-21	ssh	21:35:35	4
2288977	99	68	55,7	cyclictest	2368244	-21	ssh	21:35:35	4
2288957	99	68	28,23	cyclictest	2486654	-21	switchtime	23:10:41	0
2288957	99	68	1,64	cyclictest	0	-21	swapper/0	21:45:29	0
2288957	99	68	1,26	cyclictest	0	-21	swapper/0	23:15:32	0
2288984	99	67	62,2	cyclictest	0	-21	swapper/5	19:47:03	5
2288977	99	67	62,2	cyclictest	0	-21	swapper/4	21:00:43	4
2288977	99	67	62,2	cyclictest	0	-21	swapper/4	20:20:28	4
2288977	99	67	61,3	cyclictest	0	-21	swapper/4	19:55:31	4
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17