OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Fri Apr 24, 2026 12:46:35)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1426691	2	3332	3312,7	sleep0	1424796	-21	kworker/0:0+events@ dbs_work_handler	07:05:42	0
1427218	99	124	31,45	cyclictest	1473587	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:06:29	0
1427218	99	124	31,45	cyclictest	1473587	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:06:28	0
1427218	99	120	2,94	cyclictest	0	-21	swapper/0	09:43:13	0
1427218	99	118	1,78	cyclictest	1475616	-21	kworker/u12:1+rpciod@ rpc_async_schedule	09:10:40	0
1706470	2	117	0,4	sleep5	0	-21	swapper/5	12:08:11	5
1427218	99	117	80,16	cyclictest	1443187	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:49:26	0
1427218	99	116	2,61	cyclictest	1434345	-21	ntpq	07:25:33	0
1427218	99	116	1,86	cyclictest	0	-21	swapper/0	07:43:30	0
1427218	99	115	1,76	cyclictest	0	-21	swapper/0	10:50:43	0
1427218	99	115	1,76	cyclictest	0	-21	swapper/0	10:50:43	0
1427218	99	114	32,49	cyclictest	690	50	irq/528-eth0-Tx	09:25:29	0
1427218	99	114	1,96	cyclictest	15	-21	rcuc/0	07:15:01	0
1427218	99	114	16,43	cyclictest	0	-21	swapper/0	11:20:10	0
1427227	99	113	98,7	cyclictest	1471452	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:59:48	1
1427218	99	113	52,26	cyclictest	1448615	-21	ps	08:00:38	0
1427218	99	113	52,26	cyclictest	1448615	-21	ps	08:00:38	0
1427218	99	113	19,62	cyclictest	0	-21	swapper/0	10:45:21	0
1427218	99	112	1,81	cyclictest	0	-21	swapper/0	07:17:24	0
1427218	99	111	34,48	cyclictest	689	50	irq/527-eth0-Tx	09:10:00	0
1427218	99	111	34,48	cyclictest	689	50	irq/527-eth0-Tx	09:10:00	0
1427218	99	110	57,22	cyclictest	1652894	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:29:58	0
1427218	99	110	57,22	cyclictest	1652894	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:29:58	0
1427218	99	110	2,78	cyclictest	1520476	-21	latency	09:45:23	0
1427218	99	110	1,4	cyclictest	1683630	-21	ssh	11:50:26	0
1427246	99	109	96,7	cyclictest	1717268	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:20:29	3
1427218	99	109	35,42	cyclictest	689	50	irq/527-eth0-Tx	12:10:31	0
1427218	99	109	2,4	cyclictest	1566531	-21	ssh	10:20:33	0
1427227	99	108	94,7	cyclictest	1434712	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:23:34	1
1427218	99	108	59,21	cyclictest	0	-21	swapper/0	08:06:05	0
1427227	99	102	90,6	cyclictest	1400499	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:14:20	1
1427246	99	100	85,8	cyclictest	1583787	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:50:10	3
1427246	99	100	85,8	cyclictest	1583787	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:50:10	3
1427227	99	99	86,7	cyclictest	1620740	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:24:34	1
1427227	99	99	85,7	cyclictest	1473587	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:10:51	1
1427236	99	98	72,8	cyclictest	1652894	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:13:35	2
1427227	99	98	84,7	cyclictest	1620740	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:44:34	1
1427227	99	98	84,7	cyclictest	1620740	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:44:34	1
1570408	2	97	0,5	sleep4	1570407	-21	ssh	10:23:57	4
1427227	99	96	82,7	cyclictest	1645686	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:46:43	1
1427218	99	96	26,38	cyclictest	0	-21	swapper/0	10:16:01	0
1427218	99	96	1,90	cyclictest	0	-21	swapper/0	09:00:03	0
1427218	99	96	1,89	cyclictest	0	-21	swapper/0	09:55:21	0
1427254	99	95	82,8	cyclictest	1689821	-21	ssh	11:55:22	4
1427218	99	95	2,9	cyclictest	1617056	-21	rm	11:00:00	0
1427218	99	95	2,9	cyclictest	1617056	-21	rm	11:00:00	0
1427218	99	95	1,88	cyclictest	1724634	-21	ssh	12:21:43	0
1427227	99	94	81,6	cyclictest	1573259	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:29:34	1
1427218	99	94	1,81	cyclictest	0	-21	swapper/0	10:12:09	0
1427246	99	93	78,9	cyclictest	1645686	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:30:44	3
1427218	99	93	36,40	cyclictest	690	50	irq/528-eth0-Tx	12:05:21	0
1427218	99	93	27,53	cyclictest	1578705	-21	cpu	10:30:17	0
1427218	99	93	20,63	cyclictest	0	-21	swapper/0	11:42:33	0
1427218	99	93	20,63	cyclictest	0	-21	swapper/0	11:42:32	0
1427218	99	93	1,80	cyclictest	0	-21	swapper/0	08:40:36	0
1427218	99	93	14,52	cyclictest	1590837	-1	kworker/0:2H-events_highpri	10:40:22	0
1427246	99	92	68,6	cyclictest	1652894	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:27:40	3
1427218	99	92	3,3	cyclictest	0	-21	swapper/0	11:30:10	0
1427218	99	92	2,5	cyclictest	1466602	-21	ntpq	08:45:31	0
1427254	99	91	86,2	cyclictest	0	-21	swapper/4	10:05:00	4
1427254	99	91	86,2	cyclictest	0	-21	swapper/4	10:05:00	4
1427246	99	91	77,7	cyclictest	1670757	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:50:21	3
1427236	99	91	66,7	cyclictest	1473587	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:45:43	2
1427227	99	91	78,6	cyclictest	1703003	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:27:34	1
1427227	99	91	78,6	cyclictest	1703003	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:27:34	1
1427227	99	91	78,6	cyclictest	1652894	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:15:27	1
1427227	99	91	77,7	cyclictest	1583787	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:06:15	1
1427218	99	91	2,6	cyclictest	1446546	-21	ld	07:55:39	0
1427218	99	91	2,4	cyclictest	0	-21	swapper/0	09:50:23	0
1427218	99	91	2,3	cyclictest	0	-21	swapper/0	09:30:41	0
1427218	99	91	22,50	cyclictest	0	-21	swapper/0	11:05:28	0
1427218	99	91	1,79	cyclictest	0	-21	swapper/0	10:00:59	0
1427218	99	91	1,79	cyclictest	0	-21	swapper/0	10:00:58	0
1427218	99	91	1,73	cyclictest	0	-21	swapper/0	08:16:35	0
1427246	99	90	60,6	cyclictest	1591295	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:55:37	3
1427246	99	90	60,6	cyclictest	1591295	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:55:37	3
1427227	99	90	78,6	cyclictest	1652894	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:57:33	1
1427218	99	90	26,48	cyclictest	691	50	irq/529-eth0-Tx	11:25:28	0
1427218	99	90	1,84	cyclictest	0	-21	swapper/0	08:20:23	0
1427218	99	90	1,70	cyclictest	0	-21	swapper/0	07:30:12	0
1427246	99	89	75,7	cyclictest	1520948	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:54:58	3
1427246	99	89	68,8	cyclictest	1512593	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:20:58	3
1427227	99	89	76,6	cyclictest	1423520	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:23:35	1
1427218	99	89	2,68	cyclictest	1475691	-21	diskmemload	10:25:15	0
1427218	99	89	2,67	cyclictest	1742427	-21	sshd	12:35:30	0
1427218	99	89	1,73	cyclictest	0	-21	swapper/0	08:35:25	0
1427218	99	89	1,73	cyclictest	0	-21	swapper/0	08:35:24	0
1427246	99	88	78,4	cyclictest	1537794	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:59:59	3
1427246	99	88	51,7	cyclictest	1717268	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:34:49	3
1427246	99	88	51,7	cyclictest	1717268	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:34:49	3
1427227	99	88	75,6	cyclictest	1591295	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:58:35	1
1427227	99	88	75,6	cyclictest	1591295	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:58:35	1
1427227	99	88	74,7	cyclictest	1652894	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:35:23	1
1427227	99	88	74,7	cyclictest	1434712	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:25:47	1
1427218	99	88	58,21	cyclictest	0	-21	swapper/0	07:37:55	0
1427218	99	88	58,21	cyclictest	0	-21	swapper/0	07:37:55	0
1427218	99	88	1,78	cyclictest	0	-21	swapper/0	12:31:14	0
1427218	99	88	1,78	cyclictest	0	-21	swapper/0	12:31:14	0
1427218	99	88	1,78	cyclictest	0	-21	swapper/0	08:52:29	0
1427218	99	88	1,78	cyclictest	0	-21	swapper/0	08:52:28	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17