OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Tue Aug 04, 2026 12:46:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1140866	2	1512	1498,6	sleep2	1134844	-21	kworker/2:0+events@ dbs_work_handler	07:07:08	2
1141258	99	135	121,7	cyclictest	1342716	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:24:48	3
1141248	99	114	99,8	cyclictest	1213783	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:34:38	1
1141248	99	114	99,8	cyclictest	1213783	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:34:37	1
1141242	99	113	88,6	cyclictest	1405116	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:09:55	0
1141242	99	113	88,6	cyclictest	1405116	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:09:55	0
1141248	99	110	96,7	cyclictest	1296775	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:39:51	1
1141248	99	106	94,6	cyclictest	1317362	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:04:44	1
1141242	99	104	38,43	cyclictest	1304705	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:38:51	0
1141242	99	99	1,82	cyclictest	1202009	-21	grep	09:20:24	0
1141248	99	98	84,7	cyclictest	1389506	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:44:52	1
1141242	99	98	43,5	cyclictest	13	-21	ksoftirqd/0	09:33:58	0
1141242	99	98	43,5	cyclictest	13	-21	ksoftirqd/0	09:33:58	0
1141263	99	96	83,7	cyclictest	1320795	-21	ssh	10:50:13	4
1141242	99	96	71,15	cyclictest	673	50	irq/527-eth0-Tx	11:03:21	0
1141248	99	94	80,7	cyclictest	1304705	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:44:40	1
1141248	99	94	80,7	cyclictest	1304705	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:44:39	1
1356628	2	91	0,5	sleep4	0	-21	swapper/4	11:16:40	4
1141242	99	91	1,76	cyclictest	1189167	-21	head	09:05:44	0
1141268	99	89	82,3	cyclictest	0	-21	swapper/5	11:29:49	5
1141268	99	89	82,3	cyclictest	0	-21	swapper/5	11:29:49	5
1232854	2	85	0,5	sleep5	0	-21	swapper/5	09:44:04	5
1141263	99	85	79,3	cyclictest	0	-21	swapper/4	07:35:34	4
1141263	99	85	78,4	cyclictest	0	-21	swapper/4	09:12:00	4
1141242	99	85	60,16	cyclictest	674	50	irq/528-eth0-Tx	10:20:13	0
1141242	99	85	60,15	cyclictest	673	50	irq/527-eth0-Tx	11:40:41	0
1141242	99	85	59,17	cyclictest	674	50	irq/528-eth0-Tx	10:30:33	0
1141242	99	85	59,17	cyclictest	674	50	irq/528-eth0-Tx	10:30:33	0
1141242	99	85	52,17	cyclictest	0	-21	swapper/0	08:10:33	0
1141242	99	85	50,7	cyclictest	1198667	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:27:27	0
1141242	99	85	23,37	cyclictest	0	-21	swapper/0	11:25:27	0
1141242	99	85	23,37	cyclictest	0	-21	swapper/0	11:25:27	0
1322641	2	84	0,4	sleep3	0	-21	swapper/3	10:50:48	3
1141263	99	84	70,8	cyclictest	1193007	-21	diskmemload-4	12:34:09	4
1141258	99	84	72,6	cyclictest	1241878	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:59:34	3
1280104	2	83	0,4	sleep3	0	-21	swapper/3	10:19:54	3
1280104	2	83	0,4	sleep3	0	-21	swapper/3	10:19:53	3
1141263	99	83	71,5	cyclictest	1460735	-21	ssh	12:35:33	4
1141242	99	83	46,18	cyclictest	1146145	-21	missed_timers	07:20:25	0
1141242	99	83	41,4	cyclictest	1287917	-21	df_inode	10:25:21	0
1141242	99	83	41,4	cyclictest	1287917	-21	df_inode	10:25:20	0
1141258	99	82	68,7	cyclictest	1169848	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:34:15	3
1141242	99	82	59,5	cyclictest	1460367	-21	cat	12:35:25	0
1141242	99	82	1,8	cyclictest	1280393	-21	cat	10:20:01	0
1141242	99	82	1,8	cyclictest	1280393	-21	cat	10:20:00	0
1141263	99	81	68,7	cyclictest	1309987	-21	ssh	10:41:23	4
1141263	99	81	68,7	cyclictest	1309987	-21	ssh	10:41:22	4
1410386	2	80	0,4	chrt	0	-21	swapper/2	11:57:20	2
1141263	99	80	74,3	cyclictest	0	-21	swapper/4	08:15:35	4
1141263	99	80	73,4	cyclictest	0	-21	swapper/4	08:40:36	4
1141263	99	80	73,4	cyclictest	0	-21	swapper/4	08:40:35	4
1141242	99	80	58,4	cyclictest	674	50	irq/528-eth0-Tx	10:50:01	0
1141242	99	80	2,56	cyclictest	1174513	-21	taskset	08:30:31	0
1141268	99	79	73,2	cyclictest	0	-21	swapper/5	09:14:20	5
1141258	99	79	65,7	cyclictest	1396351	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:49:52	3
1141242	99	79	2,38	cyclictest	0	-21	swapper/0	11:35:43	0
1141242	99	79	1,50	cyclictest	1157390	-21	latency_hist	07:50:02	0
1141242	99	79	1,50	cyclictest	1157390	-21	latency_hist	07:50:01	0
1141263	99	78	71,3	cyclictest	0	-21	swapper/4	11:25:27	4
1141263	99	78	71,3	cyclictest	0	-21	swapper/4	11:25:27	4
1141258	99	78	65,7	cyclictest	1222046	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:35:46	3
1141242	99	78	69,6	cyclictest	1414948	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:04:54	0
1141242	99	78	66,4	cyclictest	673	50	irq/527-eth0-Tx	10:50:33	0
1141242	99	78	60,5	cyclictest	0	-21	swapper/0	09:19:21	0
1141258	99	77	64,7	cyclictest	1396351	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:58:46	3
1141242	99	77	34,26	cyclictest	673	50	irq/527-eth0-Tx	12:20:39	0
1141242	99	77	2,5	cyclictest	1144310	-21	ntpq	07:15:37	0
1141268	99	76	70,3	cyclictest	0	-21	swapper/5	07:25:27	5
1141263	99	76	71,2	cyclictest	0	-21	swapper/4	11:10:27	4
1141263	99	76	64,7	cyclictest	1403039	-21	ssh	11:51:41	4
1141242	99	76	47,16	cyclictest	674	50	irq/528-eth0-Tx	09:35:19	0
1141242	99	76	2,57	cyclictest	0	-21	swapper/0	08:20:02	0
1141263	99	75	69,3	cyclictest	0	-21	swapper/4	12:25:47	4
1141242	99	75	9,53	cyclictest	14	-21	rcu_preempt	09:48:27	0
1141242	99	75	53,14	cyclictest	0	-21	swapper/0	08:20:42	0
1141242	99	75	53,14	cyclictest	0	-21	swapper/0	08:20:41	0
1141242	99	75	41,16	cyclictest	1189535	-21	diskmemload	11:45:23	0
1141263	99	74	68,3	cyclictest	0	-21	swapper/4	08:50:37	4
1141263	99	74	68,3	cyclictest	0	-21	swapper/4	07:55:25	4
1141263	99	74	67,4	cyclictest	0	-21	swapper/4	07:30:23	4
1141263	99	74	67,3	cyclictest	0	-21	swapper/4	08:45:28	4
1141263	99	74	65,5	cyclictest	1412275	-21	ssh	11:59:12	4
1141258	99	74	62,6	cyclictest	1359946	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:31:46	3
1141258	99	74	60,7	cyclictest	1213783	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:14:36	3
1141258	99	74	60,7	cyclictest	1213783	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:14:36	3
1141242	99	74	47,19	cyclictest	675	50	irq/529-eth0-Tx	08:00:33	0
1141268	99	73	67,3	cyclictest	0	-21	swapper/5	10:31:47	5
1141268	99	73	67,3	cyclictest	0	-21	swapper/5	10:31:46	5
1141263	99	73	68,2	cyclictest	0	-21	swapper/4	10:15:35	4
1141263	99	73	68,2	cyclictest	0	-21	swapper/4	10:15:34	4
1141258	99	73	59,7	cyclictest	1296775	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:14:45	3
1141242	99	73	8,53	cyclictest	13	-21	ksoftirqd/0	09:56:54	0
1141242	99	73	64,6	cyclictest	1179867	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:49:17	0
1141242	99	73	1,63	cyclictest	675	50	irq/529-eth0-Tx	12:10:24	0
1141242	99	73	1,56	cyclictest	0	-21	swapper/0	09:00:41	0
1141263	99	72	66,2	cyclictest	0	-21	swapper/4	09:30:19	4
1141263	99	72	66,2	cyclictest	0	-21	swapper/4	09:30:18	4
1141263	99	72	65,3	cyclictest	0	-21	swapper/4	11:09:46	4
1141258	99	72	58,7	cyclictest	1405116	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:20:23	3
1141242	99	72	51,4	cyclictest	674	50	irq/528-eth0-Tx	07:40:41	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17