OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Wed Jul 08, 2026 00:46:39)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1115956	99	141	61,62	cyclictest	1135906	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	20:11:38	0
1114768	2	117	0,11	sleep5	0	-21	swapper/5	19:05:24	5
1115956	99	112	21,64	cyclictest	1353863	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	23:50:31	0
1115956	99	112	1,64	cyclictest	13	-21	ksoftirqd/0	21:15:38	0
1295600	2	109	0,5	sleep5	0	-21	swapper/5	22:55:29	5
1115968	99	107	87,8	cyclictest	1282762	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:51:58	3
1115956	99	107	47,47	cyclictest	0	-21	swapper/0	22:55:14	0
1115968	99	104	90,7	cyclictest	1309211	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:12:01	3
1115956	99	104	77,20	cyclictest	1249363	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:25:28	0
1115956	99	104	70,23	cyclictest	674	50	irq/528-eth0-Tx	21:50:36	0
1115956	99	104	70,23	cyclictest	674	50	irq/528-eth0-Tx	21:50:35	0
1115956	99	104	33,47	cyclictest	1405370	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:31:28	0
1115956	99	102	1,75	cyclictest	1178456	-21	taskset	21:21:57	0
1115956	99	102	1,75	cyclictest	1178456	-21	taskset	21:21:57	0
1115956	99	101	6,61	cyclictest	13	-21	ksoftirqd/0	22:40:24	0
1115956	99	101	6,61	cyclictest	13	-21	ksoftirqd/0	22:40:23	0
1115956	99	100	1,79	cyclictest	0	-21	swapper/0	23:11:15	0
1115956	99	99	74,18	cyclictest	1309211	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:42:10	0
1115956	99	99	64,25	cyclictest	0	-21	swapper/0	22:30:17	0
1115956	99	99	37,42	cyclictest	675	50	irq/529-eth0-Tx	23:45:26	0
1115956	99	99	37,42	cyclictest	675	50	irq/529-eth0-Tx	23:45:25	0
1115956	99	98	35,39	cyclictest	1228904	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:10:28	0
1115956	99	98	35,39	cyclictest	1228904	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:10:28	0
1115956	99	98	2,92	cyclictest	0	-21	swapper/0	00:23:39	0
1115956	99	98	22,24	cyclictest	68	-21	kcompactd0	23:24:51	0
1115956	99	97	70,20	cyclictest	1158151	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:11:47	0
1115956	99	97	34,39	cyclictest	1335267	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:35:37	0
1115956	99	97	29,43	cyclictest	1132124	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:52:44	0
1115956	99	97	2,84	cyclictest	0	-21	swapper/0	22:37:41	0
1115968	99	96	83,7	cyclictest	1171679	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:26:49	3
1115956	99	95	61,23	cyclictest	674	50	irq/528-eth0-Tx	22:20:41	0
1115968	99	94	80,7	cyclictest	1166357	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:41:52	3
1115956	99	94	1,81	cyclictest	1194724	-21	ssh	21:35:19	0
1413689	2	93	0,3	sleep4	0	-21	swapper/4	00:30:20	4
1115965	99	93	79,7	cyclictest	1235757	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:11:55	2
1115965	99	93	79,7	cyclictest	1235757	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:11:55	2
1115956	99	93	36,37	cyclictest	15	-21	rcuc/0	21:25:30	0
1115956	99	93	36,26	cyclictest	13	-21	ksoftirqd/0	22:05:23	0
1115956	99	92	47,26	cyclictest	1304309	-21	seq	23:02:27	0
1115956	99	91	1,60	cyclictest	13	-21	ksoftirqd/0	23:15:45	0
1115956	99	91	1,60	cyclictest	13	-21	ksoftirqd/0	23:15:45	0
1115968	99	90	79,5	cyclictest	1335267	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:32:06	3
1115956	99	90	5,62	cyclictest	0	-21	swapper/0	22:15:54	0
1115956	99	90	5,62	cyclictest	0	-21	swapper/0	22:15:54	0
1115956	99	90	24,48	cyclictest	0	-21	swapper/0	00:15:46	0
1115956	99	90	24,48	cyclictest	0	-21	swapper/0	00:15:45	0
1115956	99	89	56,23	cyclictest	0	-21	swapper/0	19:35:27	0
1115956	99	89	56,23	cyclictest	0	-21	swapper/0	19:35:26	0
1115956	99	89	50,25	cyclictest	0	-21	swapper/0	19:25:01	0
1115956	99	89	49,30	cyclictest	673	50	irq/527-eth0-Tx	22:50:02	0
1115956	99	89	49,30	cyclictest	673	50	irq/527-eth0-Tx	22:50:01	0
1115956	99	89	32,35	cyclictest	1335267	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:31:15	0
1115956	99	88	1,69	cyclictest	0	-21	swapper/0	20:55:33	0
1115956	99	88	1,69	cyclictest	0	-21	swapper/0	20:55:33	0
1115972	99	87	77,6	cyclictest	1405226	-21	ssh	00:23:39	4
1115965	99	87	75,6	cyclictest	1309211	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:07:02	2
1115956	99	87	45,25	cyclictest	1109656	-1	kworker/0:1H-events_highpri	19:15:19	0
1115961	99	86	73,7	cyclictest	1205304	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:51:54	1
1115961	99	86	73,7	cyclictest	1205304	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:51:54	1
1115956	99	86	35,24	cyclictest	674	50	irq/528-eth0-Tx	00:03:02	0
1115956	99	86	33,24	cyclictest	673	50	irq/527-eth0-Tx	23:09:04	0
1115968	99	85	73,6	cyclictest	1367999	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:37:21	3
1115968	99	85	61,8	cyclictest	1249363	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:36:57	3
1115956	99	85	26,44	cyclictest	0	-21	swapper/0	21:59:10	0
1115956	99	85	12,24	cyclictest	0	-21	swapper/0	21:40:23	0
1115972	99	84	66,11	cyclictest	1353892	-21	ssh	23:42:09	4
1115968	99	84	72,6	cyclictest	1156103	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:56:44	3
1115968	99	84	72,6	cyclictest	1156103	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:56:43	3
1115965	99	84	70,7	cyclictest	1146053	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:31:43	2
1115965	99	84	70,7	cyclictest	1146053	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:31:43	2
1115956	99	84	43,31	cyclictest	0	-21	swapper/0	00:35:42	0
1115956	99	84	3,67	cyclictest	48	-21	rcuop/4	22:01:44	0
1115956	99	84	34,42	cyclictest	1154069	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:45:34	0
1115956	99	84	34,23	cyclictest	676	50	irq/530-eth0-Tx	00:06:10	0
1115956	99	83	38,24	cyclictest	0	-21	swapper/0	20:35:18	0
1115956	99	83	32,16	cyclictest	1370622	-21	ntpq	23:55:37	0
1115956	99	83	25,16	cyclictest	15	-21	rcuc/0	21:45:11	0
1115956	99	83	25,16	cyclictest	15	-21	rcuc/0	21:45:11	0
1115956	99	83	22,23	cyclictest	674	50	irq/528-eth0-Tx	00:10:27	0
1115977	99	82	73,5	cyclictest	0	-21	swapper/5	22:30:17	5
1115968	99	81	69,6	cyclictest	1289561	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:17:04	3
1115968	99	81	69,6	cyclictest	1289561	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:17:03	3
1115972	99	80	64,12	cyclictest	1360088	-21	sh	23:47:11	4
1115972	99	80	64,12	cyclictest	1360088	-21	sh	23:47:10	4
1115956	99	80	6,61	cyclictest	0	-21	swapper/0	23:25:05	0
1115956	99	80	53,13	cyclictest	0	-21	swapper/0	20:25:35	0
1115956	99	80	51,21	cyclictest	1134877	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:55:45	0
1115956	99	80	35,22	cyclictest	0	-21	swapper/0	00:25:29	0
1115956	99	80	2,64	cyclictest	0	-21	swapper/0	19:45:37	0
1115956	99	79	44,27	cyclictest	0	-21	swapper/0	20:00:29	0
1115956	99	79	1,69	cyclictest	0	-21	swapper/0	21:33:47	0
1115968	99	78	66,6	cyclictest	1128035	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:41:35	3
1115968	99	77	64,7	cyclictest	1309211	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:37:09	3
1115965	99	77	61,8	cyclictest	1249363	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:56:59	2
1115961	99	77	66,6	cyclictest	210	-21	kswapd0	23:40:24	1
1115956	99	77	3,46	cyclictest	0	-21	swapper/0	22:54:39	0
1115956	99	77	1,72	cyclictest	0	-21	swapper/0	19:45:01	0
1115965	99	76	61,7	cyclictest	1397678	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:25:01	2
1115956	99	76	2,7	cyclictest	1146431	-21	sed	20:25:01	0
1115977	99	75	69,3	cyclictest	0	-21	swapper/5	20:11:38	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17