OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Fri Apr 17, 2026 12:46:37)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1316570	2	964	940,9	sleep0	1314763	-21	kworker/0:0+events@ dbs_work_handler	07:06:02	0
1317098	99	135	122,6	cyclictest	1568191	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:20:16	3
1317090	99	126	111,8	cyclictest	1596764	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:29:24	2
1317098	99	124	110,7	cyclictest	1596764	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:09:20	3
1317090	99	124	110,7	cyclictest	1399155	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:38:57	2
1317073	99	121	1,108	cyclictest	0	-21	swapper/0	08:25:34	0
1317073	99	118	1,79	cyclictest	0	-21	swapper/0	10:35:28	0
1317073	99	117	1,91	cyclictest	0	-21	swapper/0	09:40:39	0
1317090	99	116	102,7	cyclictest	1477375	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:59:08	2
1317090	99	116	102,7	cyclictest	1477375	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:59:07	2
1317090	99	115	101,7	cyclictest	1327293	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:13:37	2
1317073	99	111	72,28	cyclictest	689	50	irq/527-eth0-Tx	08:50:31	0
1317073	99	111	72,28	cyclictest	689	50	irq/527-eth0-Tx	08:50:31	0
1317073	99	111	2,94	cyclictest	1365638	-21	diskmemload	11:30:32	0
1317073	99	111	1,62	cyclictest	0	-21	swapper/0	12:05:18	0
1317073	99	109	73,19	cyclictest	689	50	irq/527-eth0-Tx	12:15:27	0
1317073	99	107	75,19	cyclictest	1365638	-21	diskmemload	11:45:35	0
1317073	99	107	57,25	cyclictest	0	-21	swapper/0	08:37:39	0
1317073	99	107	57,25	cyclictest	0	-21	swapper/0	08:37:38	0
1317073	99	106	70,26	cyclictest	689	50	irq/527-eth0-Tx	12:10:32	0
1317073	99	106	1,69	cyclictest	0	-21	swapper/0	09:40:01	0
1317073	99	105	2,17	cyclictest	1416784	-21	cat	09:50:19	0
1317073	99	105	1,67	cyclictest	0	-21	swapper/0	10:15:30	0
1317073	99	104	72,21	cyclictest	689	50	irq/527-eth0-Tx	08:03:35	0
1317073	99	104	70,22	cyclictest	690	50	irq/528-eth0-Tx	09:55:32	0
1317073	99	104	62,32	cyclictest	689	50	irq/527-eth0-Tx	07:15:33	0
1317073	99	103	47,44	cyclictest	0	-21	swapper/0	11:55:37	0
1317073	99	103	47,44	cyclictest	0	-21	swapper/0	11:55:36	0
1317073	99	103	2,63	cyclictest	1575988	-21	ssh	11:51:31	0
1317073	99	103	2,63	cyclictest	1575988	-21	ssh	11:51:30	0
1317073	99	103	2,57	cyclictest	1508126	-21	ssh	11:00:15	0
1317073	99	103	1,56	cyclictest	0	-21	swapper/0	11:16:16	0
1317073	99	102	73,15	cyclictest	1354714	-21	ntp_states	08:40:37	0
1317073	99	102	62,28	cyclictest	690	50	irq/528-eth0-Tx	12:30:05	0
1317073	99	102	54,29	cyclictest	1333021	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:50:39	0
1317073	99	102	2,87	cyclictest	1318084	-21	/usr/sbin/munin	07:10:29	0
1317073	99	102	2,86	cyclictest	0	-21	swapper/0	10:50:30	0
1317073	99	102	2,86	cyclictest	0	-21	swapper/0	10:50:30	0
1317073	99	102	1,88	cyclictest	0	-21	swapper/0	12:25:31	0
1317073	99	102	1,82	cyclictest	0	-21	swapper/0	10:05:34	0
1317073	99	102	1,82	cyclictest	0	-21	swapper/0	10:05:34	0
1317098	99	101	87,7	cyclictest	1568191	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:04:20	3
1317073	99	101	67,21	cyclictest	689	50	irq/527-eth0-Tx	12:01:47	0
1317073	99	101	63,24	cyclictest	690	50	irq/528-eth0-Tx	10:55:31	0
1317073	99	101	63,24	cyclictest	690	50	irq/528-eth0-Tx	10:55:30	0
1317073	99	101	47,22	cyclictest	1325209	-21	latency_hist	07:30:01	0
1317073	99	101	2,15	cyclictest	1360619	-21	ntpq	08:55:29	0
1317073	99	101	1,83	cyclictest	0	-21	swapper/0	10:30:34	0
1317073	99	100	70,17	cyclictest	689	50	irq/527-eth0-Tx	09:45:15	0
1317073	99	100	65,26	cyclictest	689	50	irq/527-eth0-Tx	11:12:25	0
1317073	99	100	2,65	cyclictest	1340437	-21	ntp_states	08:05:37	0
1317073	99	100	2,65	cyclictest	1340437	-21	ntp_states	08:05:36	0
1317090	99	99	85,7	cyclictest	1505496	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:04:10	2
1317073	99	99	66,21	cyclictest	691	50	irq/529-eth0-Tx	07:55:21	0
1317073	99	99	66,21	cyclictest	691	50	irq/529-eth0-Tx	07:55:20	0
1317073	99	99	59,27	cyclictest	1477375	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:38:51	0
1317098	99	98	83,8	cyclictest	1412728	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:00:22	3
1317098	99	98	83,8	cyclictest	1412728	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:00:22	3
1317073	99	98	1,79	cyclictest	1383928	-21	basename	09:25:19	0
1317073	99	98	1,68	cyclictest	0	-21	swapper/0	12:20:14	0
1317090	99	97	83,7	cyclictest	1359433	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:03:49	2
1317073	99	97	57,24	cyclictest	1445065	-21	ssh	10:11:22	0
1317073	99	97	1,92	cyclictest	0	-21	swapper/0	08:35:01	0
1317073	99	97	1,72	cyclictest	1356549	-21	bingrep	08:45:25	0
1317073	99	96	70,15	cyclictest	0	-21	swapper/0	10:45:41	0
1317073	99	96	1,82	cyclictest	0	-21	swapper/0	10:00:36	0
1317073	99	96	1,82	cyclictest	0	-21	swapper/0	10:00:36	0
1317073	99	96	1,80	cyclictest	0	-21	swapper/0	10:43:40	0
1317073	99	96	1,79	cyclictest	0	-21	swapper/0	07:30:27	0
1317098	99	95	81,7	cyclictest	1378183	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:48:55	3
1317090	99	95	81,7	cyclictest	1322928	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:40:35	2
1317090	99	94	80,7	cyclictest	1515409	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:19:13	2
1317073	99	94	55,27	cyclictest	690	50	irq/528-eth0-Tx	07:35:11	0
1317073	99	94	1,76	cyclictest	0	-21	swapper/0	11:40:36	0
1317098	99	93	79,7	cyclictest	1612480	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:27:34	3
1317098	99	93	79,7	cyclictest	1498580	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:18:35	3
1317090	99	93	79,7	cyclictest	1349281	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:40:29	2
1317090	99	93	79,7	cyclictest	1333021	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:17:33	2
1317090	99	93	78,7	cyclictest	1533450	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:49:14	2
1317073	99	93	50,22	cyclictest	0	-21	swapper/0	09:22:29	0
1317073	99	93	42,19	cyclictest	1366765	-21	sed	09:10:25	0
1317073	99	93	42,19	cyclictest	1366765	-21	sed	09:10:25	0
1317073	99	93	2,79	cyclictest	15	-21	rcuc/0	11:25:24	0
1317098	99	92	78,7	cyclictest	1388593	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	10:16:44	3
1317098	99	92	78,7	cyclictest	1388593	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	09:44:23	3
1317090	99	92	77,7	cyclictest	1491637	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:52:15	2
1317090	99	92	77,7	cyclictest	1491637	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:52:15	2
1317073	99	92	2,13	cyclictest	1344345	-21	ntpq	08:15:29	0
1317098	99	91	77,7	cyclictest	1533450	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:26:53	3
1317098	99	91	76,7	cyclictest	1533450	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:36:26	3
1317090	99	91	61,7	cyclictest	1388593	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	09:50:22	2
1317073	99	91	60,17	cyclictest	0	-21	swapper/0	07:20:19	0
1317073	99	91	60,17	cyclictest	0	-21	swapper/0	07:20:18	0
1317073	99	91	54,23	cyclictest	0	-21	swapper/0	09:00:19	0
1317073	99	91	1,85	cyclictest	15	-21	rcuc/0	10:20:42	0
1317073	99	91	1,12	cyclictest	0	-21	swapper/0	11:20:24	0
1317073	99	90	59,16	cyclictest	0	-21	swapper/0	12:35:17	0
1317073	99	90	59,16	cyclictest	0	-21	swapper/0	12:35:16	0
1317073	99	90	51,21	cyclictest	0	-21	swapper/0	08:21:53	0
1317073	99	90	48,17	cyclictest	0	-21	swapper/0	09:09:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17