OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sun Mar 15, 2026 12:46:47)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
828470	2	3467	3442,9	sleep2	827166	-21	kworker/2:3+events@ dbs_work_handler	07:05:37	2
829392	99	134	35,36	cyclictest	691	50	irq/529-eth0-Tx	10:40:45	0
829392	99	134	35,36	cyclictest	691	50	irq/529-eth0-Tx	10:40:45	0
829392	99	130	31,59	cyclictest	845346	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:59:52	0
829401	99	126	111,8	cyclictest	905178	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:34:36	2
829401	99	123	109,7	cyclictest	905178	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:44:36	2
829417	99	119	112,3	cyclictest	0	-21	swapper/5	11:24:49	5
829417	99	119	112,3	cyclictest	0	-21	swapper/5	11:24:49	5
829417	99	119	111,3	cyclictest	0	-21	swapper/5	09:49:39	5
829417	99	119	111,3	cyclictest	0	-21	swapper/5	09:49:39	5
832463	2	117	0,4	sleep0	0	-21	swapper/0	07:15:36	0
829392	99	117	6,65	cyclictest	1127752	-21	ssh	12:22:16	0
829392	99	111	29,28	cyclictest	691	50	irq/529-eth0-Tx	11:45:28	0
829401	99	110	97,7	cyclictest	873464	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:59:31	2
829401	99	110	97,7	cyclictest	873464	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:59:30	2
829392	99	110	1,4	cyclictest	0	-21	swapper/0	10:57:47	0
829401	99	109	96,7	cyclictest	991022	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:14:49	2
829417	99	108	103,2	cyclictest	0	-21	swapper/5	10:59:45	5
829392	99	108	79,7	cyclictest	877692	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:40:02	0
829392	99	108	21,4	cyclictest	0	-21	swapper/0	10:49:15	0
829392	99	108	21,4	cyclictest	0	-21	swapper/0	10:49:15	0
829392	99	108	14,3	cyclictest	0	-21	swapper/0	09:40:41	0
829392	99	106	41,54	cyclictest	871426	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:52:43	0
829401	99	104	92,6	cyclictest	869365	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:49:29	2
829401	99	104	91,6	cyclictest	886139	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:24:41	2
829401	99	104	90,7	cyclictest	886139	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:54:39	2
829406	99	103	91,6	cyclictest	871426	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:54:31	3
949618	2	102	0,3	sleep3	0	-21	swapper/3	10:05:37	3
829392	99	102	78,16	cyclictest	886139	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:54:46	0
829401	99	101	88,7	cyclictest	980022	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:57:35	2
829401	99	101	88,7	cyclictest	853855	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:17:35	2
829417	99	99	93,3	cyclictest	0	-21	swapper/5	07:39:21	5
829392	99	98	58,13	cyclictest	905178	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:32:24	0
829392	99	98	58,13	cyclictest	905178	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:32:24	0
829401	99	96	81,8	cyclictest	991022	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:21:35	2
829401	99	96	81,8	cyclictest	991022	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:21:35	2
829392	99	95	60,11	cyclictest	1093921	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:08:31	0
829392	99	95	60,11	cyclictest	1093921	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:08:30	0
829401	99	93	78,8	cyclictest	991022	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:25:44	2
829401	99	93	78,8	cyclictest	991022	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:25:44	2
829417	99	92	86,3	cyclictest	0	-21	swapper/5	10:51:34	5
829417	99	92	86,3	cyclictest	0	-21	swapper/5	07:15:22	5
829411	99	92	79,8	cyclictest	895009	-21	ssh	09:24:34	4
829392	99	92	1,78	cyclictest	0	-21	swapper/0	08:47:24	0
829417	99	91	84,3	cyclictest	0	-21	swapper/5	08:14:24	5
829406	99	91	77,7	cyclictest	1085236	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:05:02	3
829406	99	91	77,7	cyclictest	1085236	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:05:02	3
829401	99	91	76,7	cyclictest	1110285	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:29:57	2
829392	99	91	31,28	cyclictest	689	50	irq/527-eth0-Tx	12:35:19	0
829392	99	91	31,28	cyclictest	689	50	irq/527-eth0-Tx	12:35:19	0
829392	99	91	29,41	cyclictest	849256	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:05:51	0
829392	99	91	2,5	cyclictest	692	50	irq/530-eth0-Tx	12:00:40	0
829392	99	91	2,5	cyclictest	692	50	irq/530-eth0-Tx	12:00:40	0
829392	99	91	1,77	cyclictest	0	-21	swapper/0	09:06:28	0
829417	99	90	85,2	cyclictest	0	-21	swapper/5	08:23:35	5
829401	99	90	76,7	cyclictest	845116	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:47:19	2
829401	99	90	76,7	cyclictest	845116	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:47:19	2
829401	99	90	76,7	cyclictest	839235	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:33:34	2
829401	99	90	75,7	cyclictest	980022	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:42:29	2
829392	99	90	62,7	cyclictest	877692	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:24:34	0
829392	99	90	2,30	cyclictest	1060444	-21	ssh	11:30:38	0
829392	99	90	2,30	cyclictest	1060444	-21	ssh	11:30:38	0
829392	99	90	1,77	cyclictest	0	-21	swapper/0	08:59:25	0
829392	99	90	1,77	cyclictest	0	-21	swapper/0	08:59:24	0
829392	99	89	31,39	cyclictest	690	50	irq/528-eth0-Tx	10:35:29	0
829392	99	89	31,39	cyclictest	690	50	irq/528-eth0-Tx	10:35:29	0
829392	99	89	29,37	cyclictest	905178	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:27:17	0
829392	99	89	29,37	cyclictest	905178	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:27:17	0
829392	99	89	1,6	cyclictest	856816	-21	processes	08:15:41	0
829401	99	88	75,6	cyclictest	991022	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:41:34	2
829401	99	88	75,6	cyclictest	991022	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:41:34	2
829401	99	88	75,6	cyclictest	875505	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:23:35	2
829392	99	88	6,63	cyclictest	0	-21	swapper/0	11:25:06	0
829392	99	88	6,63	cyclictest	0	-21	swapper/0	11:25:06	0
829392	99	88	1,71	cyclictest	0	-21	swapper/0	09:25:14	0
829392	99	88	1,67	cyclictest	0	-21	swapper/0	09:05:01	0
829392	99	88	1,58	cyclictest	829387	-21	cyclictest	07:50:23	0
829417	99	87	82,2	cyclictest	0	-21	swapper/5	07:54:23	5
829417	99	87	81,3	cyclictest	0	-21	swapper/5	09:41:35	5
829417	99	87	80,3	cyclictest	0	-21	swapper/5	07:57:24	5
829401	99	87	74,6	cyclictest	873464	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:04:31	2
829401	99	87	73,7	cyclictest	980022	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:34:43	2
829401	99	87	73,7	cyclictest	980022	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:34:43	2
829401	99	87	73,7	cyclictest	853855	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:14:15	2
829392	99	87	2,59	cyclictest	949330	-21	rm	10:05:27	0
829392	99	87	1,57	cyclictest	936492	-21	gcc	09:55:39	0
829417	99	86	81,2	cyclictest	0	-21	swapper/5	08:29:27	5
829417	99	86	81,2	cyclictest	0	-21	swapper/5	08:05:35	5
829406	99	86	58,6	cyclictest	810892	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:36:31	3
829401	99	86	72,7	cyclictest	905178	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:35:35	2
829401	99	86	72,7	cyclictest	886139	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:35:30	2
829401	99	86	72,7	cyclictest	886139	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:35:30	2
829417	99	85	78,3	cyclictest	0	-21	swapper/5	12:34:58	5
829401	99	85	74,4	cyclictest	991022	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:39:05	2
829401	99	85	70,7	cyclictest	886139	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:57:34	2
829392	99	85	1,71	cyclictest	0	-21	swapper/0	10:10:41	0
829392	99	85	1,5	cyclictest	1088606	-21	ssh	11:52:08	0
829406	99	84	71,6	cyclictest	849256	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:08:26	3
829401	99	84	69,7	cyclictest	873464	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:05:22	2
829392	99	84	1,71	cyclictest	0	-21	swapper/0	08:31:25	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17