OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Wed Nov 12, 2025 12:47:18)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
865614	2	2361	2346,6	sleep3	838609	-21	kworker/3:1+events@ dbs_work_handler	07:05:26	3
866347	2	517	496,10	sleep2	864316	-21	kworker/2:0+events@ dbs_work_handler	07:06:38	2
866764	99	137	2,117	cyclictest	968718	-21	cron	09:55:00	0
866764	99	134	97,30	cyclictest	1017669	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:50:46	0
866764	99	133	102,24	cyclictest	1088079	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:30:52	0
866764	99	132	27,35	cyclictest	642	50	irq/527-eth0-Tx	09:45:11	0
866786	99	128	123,2	cyclictest	0	-21	swapper/5	09:20:28	5
866764	99	128	92,27	cyclictest	902904	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:50:23	0
866764	99	128	92,27	cyclictest	902904	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:50:22	0
866764	99	124	73,41	cyclictest	642	50	irq/527-eth0-Tx	11:55:21	0
866764	99	124	73,41	cyclictest	642	50	irq/527-eth0-Tx	11:55:21	0
866764	99	122	90,24	cyclictest	1088079	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:35:54	0
866764	99	122	90,24	cyclictest	1088079	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:35:54	0
866764	99	121	67,25	cyclictest	946537	-21	sshd	09:36:39	0
866764	99	120	84,28	cyclictest	864749	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	07:20:06	0
866764	99	119	2,72	cyclictest	0	-21	swapper/0	08:30:01	0
866764	99	117	86,24	cyclictest	1073371	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:20:49	0
866764	99	116	84,24	cyclictest	1109203	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:50:55	0
866764	99	116	84,24	cyclictest	1109203	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:50:55	0
866764	99	116	1,49	cyclictest	0	-21	swapper/0	09:35:03	0
866764	99	116	1,49	cyclictest	0	-21	swapper/0	09:35:02	0
866764	99	115	1,79	cyclictest	0	-21	swapper/0	11:00:16	0
866764	99	115	1,79	cyclictest	0	-21	swapper/0	11:00:15	0
866780	99	114	100,7	cyclictest	1073371	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:35:52	3
866780	99	114	100,7	cyclictest	1073371	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:35:52	3
866764	99	112	31,66	cyclictest	645	50	irq/530-eth0-Tx	10:55:32	0
866780	99	111	96,8	cyclictest	931379	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:20:38	3
866764	99	111	37,43	cyclictest	0	-21	swapper/0	07:25:26	0
866764	99	111	2,3	cyclictest	0	-21	swapper/0	09:40:41	0
866780	99	110	96,7	cyclictest	989588	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:10:37	3
866780	99	110	96,7	cyclictest	989588	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:10:37	3
866780	99	110	96,7	cyclictest	1073371	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:16:00	3
866764	99	109	6,63	cyclictest	996077	-21	proc_pri	10:15:42	0
866764	99	109	6,63	cyclictest	996077	-21	proc_pri	10:15:42	0
866764	99	108	76,23	cyclictest	952873	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:55:36	0
866764	99	108	26,25	cyclictest	0	-21	swapper/0	10:04:55	0
866764	99	108	26,25	cyclictest	0	-21	swapper/0	10:04:54	0
866769	99	107	93,7	cyclictest	868436	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:15:01	1
866764	99	107	17,46	cyclictest	0	-21	swapper/0	12:21:15	0
866764	99	107	17,46	cyclictest	0	-21	swapper/0	12:21:15	0
866764	99	105	63,18	cyclictest	643	50	irq/528-eth0-Tx	12:15:13	0
866764	99	105	30,7	cyclictest	13	-21	ksoftirqd/0	11:40:39	0
866780	99	102	88,7	cyclictest	1073371	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:40:53	3
866764	99	102	77,22	cyclictest	1152000	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:31:01	0
866769	99	100	86,7	cyclictest	1073371	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:45:54	1
866764	99	99	68,23	cyclictest	876911	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	07:50:12	0
866764	99	99	68,23	cyclictest	876911	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	07:50:11	0
866764	99	99	42,4	cyclictest	643	50	irq/528-eth0-Tx	11:05:35	0
866764	99	99	42,4	cyclictest	643	50	irq/528-eth0-Tx	11:05:34	0
866781	99	96	90,3	cyclictest	0	-21	swapper/4	10:25:40	4
866781	99	96	90,3	cyclictest	0	-21	swapper/4	09:20:27	4
866776	99	96	81,7	cyclictest	902904	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:45:18	2
866776	99	95	81,7	cyclictest	1017669	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:55:45	2
866776	99	94	81,6	cyclictest	876911	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	08:00:12	2
866776	99	94	81,6	cyclictest	876911	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	08:00:11	2
866764	99	93	28,6	cyclictest	13	-21	ksoftirqd/0	09:25:31	0
866780	99	92	78,7	cyclictest	916472	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:45:31	3
866764	99	92	54,15	cyclictest	13	-21	ksoftirqd/0	12:25:40	0
866764	99	92	1,85	cyclictest	13	-21	ksoftirqd/0	10:20:21	0
866786	99	91	85,3	cyclictest	0	-21	swapper/5	11:25:51	5
866780	99	91	77,7	cyclictest	876447	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:35:08	3
866769	99	91	77,7	cyclictest	1161410	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:26:02	1
866764	99	91	40,26	cyclictest	989568	-21	ssh	10:10:35	0
866764	99	91	40,26	cyclictest	989568	-21	ssh	10:10:34	0
866764	99	91	16,26	cyclictest	888327	-1	kworker/0:1H+mmc_complete@ mmc_blk_mq_complete_work	08:05:03	0
866764	99	91	16,26	cyclictest	888327	-1	kworker/0:1H+mmc_complete@ mmc_blk_mq_complete_work	08:05:02	0
866780	99	90	77,6	cyclictest	876447	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:40:09	3
866780	99	90	77,6	cyclictest	876447	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:40:08	3
866764	99	90	41,29	cyclictest	0	-21	swapper/0	07:15:18	0
866764	99	90	38,7	cyclictest	13	-21	ksoftirqd/0	12:10:27	0
866764	99	90	38,7	cyclictest	13	-21	ksoftirqd/0	12:10:26	0
866764	99	90	2,36	cyclictest	914491	-21	diskmemload	12:05:37	0
866764	99	90	1,47	cyclictest	0	-21	swapper/0	12:00:30	0
866764	99	90	1,47	cyclictest	0	-21	swapper/0	12:00:30	0
866764	99	89	2,46	cyclictest	13	-21	ksoftirqd/0	10:35:24	0
866764	99	89	2,46	cyclictest	13	-21	ksoftirqd/0	10:35:24	0
866764	99	89	16,8	cyclictest	1085962	-21	vmstat	11:25:45	0
866764	99	88	35,6	cyclictest	13	-21	ksoftirqd/0	10:40:24	0
866769	99	87	73,7	cyclictest	908266	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:15:29	1
866769	99	87	73,7	cyclictest	908266	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:15:28	1
1080615	2	87	0,4	sleep5	0	-21	swapper/5	11:21:47	5
866776	99	86	73,6	cyclictest	876911	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	08:05:11	2
866776	99	86	73,6	cyclictest	876911	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	08:05:11	2
866769	99	86	71,8	cyclictest	880892	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:25:17	1
866764	99	86	6,40	cyclictest	13	-21	ksoftirqd/0	10:27:45	0
866764	99	86	50,15	cyclictest	643	50	irq/528-eth0-Tx	09:10:19	0
866764	99	86	50,15	cyclictest	643	50	irq/528-eth0-Tx	09:10:19	0
866764	99	86	35,4	cyclictest	643	50	irq/528-eth0-Tx	10:07:24	0
866764	99	86	35,4	cyclictest	643	50	irq/528-eth0-Tx	10:07:23	0
1140528	2	86	0,6	sleep1	0	-21	swapper/1	12:09:12	1
866780	99	85	72,6	cyclictest	868436	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:25:05	3
866764	99	85	43,5	cyclictest	868833	-21	latency_hist	07:15:02	0
866764	99	85	31,16	cyclictest	13	-21	ksoftirqd/0	10:30:34	0
866764	99	85	31,16	cyclictest	13	-21	ksoftirqd/0	10:30:33	0
866764	99	85	27,4	cyclictest	642	50	irq/527-eth0-Tx	12:36:01	0
866764	99	84	34,4	cyclictest	645	50	irq/530-eth0-Tx	11:10:38	0
866764	99	84	34,4	cyclictest	645	50	irq/530-eth0-Tx	11:10:38	0
866764	99	84	22,6	cyclictest	13	-21	ksoftirqd/0	10:46:30	0
866769	99	82	66,8	cyclictest	880892	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:50:10	1
866769	99	82	66,8	cyclictest	880892	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:50:09	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17