OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sun Jan 11, 2026 12:46:38)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4051846	99	137	106,23	cyclictest	4079810	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:34:47	0
4051846	99	133	71,26	cyclictest	4044871	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:10:38	0
4051861	99	132	118,7	cyclictest	54184	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:20:23	3
4051861	99	132	118,7	cyclictest	54184	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:20:23	3
4051846	99	132	97,15	cyclictest	4091993	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:49:53	0
4051846	99	132	97,15	cyclictest	4091993	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:49:52	0
4051851	99	131	117,7	cyclictest	20768	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:45:15	1
4051856	99	129	114,7	cyclictest	54184	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:30:27	2
4051856	99	128	114,7	cyclictest	54184	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:45:27	2
4051846	99	126	91,15	cyclictest	4182293	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:26:02	0
4051846	99	126	91,15	cyclictest	4182293	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:26:02	0
4051846	99	123	60,39	cyclictest	2987	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:49:03	0
4051872	99	122	117,2	cyclictest	0	-21	swapper/5	10:05:27	5
4051846	99	118	99,14	cyclictest	210	-21	kswapd0	11:40:01	0
4051856	99	116	102,7	cyclictest	4098048	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:20:12	2
4051856	99	116	102,7	cyclictest	4098048	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:20:11	2
4051861	99	112	98,7	cyclictest	36326	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:00:18	3
4051846	99	112	52,37	cyclictest	54184	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:59:37	0
4051866	99	109	98,6	cyclictest	147152	-21	ssh	12:30:36	4
4051851	99	109	94,7	cyclictest	36326	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:35:25	1
4051846	99	109	1,4	cyclictest	4076722	-21	irqstats	08:10:22	0
4051856	99	108	93,7	cyclictest	74171	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:20:36	2
4051846	99	108	78,19	cyclictest	0	-21	swapper/0	09:00:37	0
4051846	99	108	7,50	cyclictest	13	-21	ksoftirqd/0	09:35:45	0
4051846	99	108	1,94	cyclictest	0	-21	swapper/0	12:26:39	0
4051846	99	107	74,23	cyclictest	689	50	irq/527-eth0-Tx	10:55:20	0
4051846	99	107	2,72	cyclictest	20421	-21	awk	10:45:01	0
4051866	99	106	88,12	cyclictest	76152	-21	ssh	11:30:24	4
4051851	99	106	98,5	cyclictest	210	-21	kswapd0	10:10:12	1
4051851	99	106	98,5	cyclictest	210	-21	kswapd0	10:10:11	1
4051851	99	106	93,6	cyclictest	4109863	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:45:01	1
4051851	99	106	92,7	cyclictest	4098048	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:04:53	1
4051846	99	106	88,14	cyclictest	210	-21	kswapd0	12:05:13	0
4051846	99	106	88,14	cyclictest	210	-21	kswapd0	12:05:13	0
4051846	99	106	63,27	cyclictest	0	-21	swapper/0	07:19:32	0
4051846	99	106	63,27	cyclictest	0	-21	swapper/0	07:19:32	0
4051866	99	105	92,8	cyclictest	4153819	-21	ssh	09:55:17	4
4051846	99	105	2,87	cyclictest	0	-21	swapper/0	09:15:40	0
4051846	99	105	1,92	cyclictest	0	-21	swapper/0	08:55:32	0
4051846	99	105	1,59	cyclictest	0	-21	swapper/0	12:10:29	0
4051846	99	104	83,14	cyclictest	4138922	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:14:34	0
4051846	99	104	83,14	cyclictest	4138922	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:14:33	0
4051846	99	104	66,27	cyclictest	691	50	irq/529-eth0-Tx	12:00:15	0
4051851	99	103	89,7	cyclictest	43937	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:10:59	1
4051846	99	103	66,27	cyclictest	689	50	irq/527-eth0-Tx	11:01:01	0
4051846	99	103	65,26	cyclictest	689	50	irq/527-eth0-Tx	11:30:34	0
4051846	99	103	2,9	cyclictest	4149888	-21	runrttasks	09:51:12	0
4051851	99	102	88,7	cyclictest	36326	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:05:19	1
4051846	99	102	86,12	cyclictest	4098048	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:24:56	0
4051846	99	102	81,14	cyclictest	4053588	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:36:35	0
4051846	99	102	56,33	cyclictest	0	-21	swapper/0	11:15:31	0
4051846	99	102	56,33	cyclictest	0	-21	swapper/0	11:15:31	0
4051856	99	101	92,6	cyclictest	210	-21	kswapd0	09:55:18	2
4051856	99	101	86,7	cyclictest	130200	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:17:43	2
4051846	99	101	63,29	cyclictest	0	-21	swapper/0	11:25:41	0
4051846	99	101	60,37	cyclictest	4138922	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:48:23	0
4051846	99	101	55,13	cyclictest	0	-21	swapper/0	07:25:38	0
4051866	99	100	87,7	cyclictest	15669	-21	ssh	10:40:26	4
4051851	99	100	86,7	cyclictest	4138922	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:50:26	1
4051846	99	100	63,26	cyclictest	691	50	irq/529-eth0-Tx	09:40:34	0
4051846	99	100	61,28	cyclictest	690	50	irq/528-eth0-Tx	10:50:43	0
4051846	99	100	59,38	cyclictest	4098048	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:09:39	0
4051866	99	99	94,2	cyclictest	0	-21	swapper/4	11:35:24	4
4051846	99	99	69,21	cyclictest	689	50	irq/527-eth0-Tx	09:34:40	0
4051846	99	99	50,28	cyclictest	130200	-21	kworker/u12:0+flush-0:56@ wb_workfn	12:35:19	0
4051872	99	98	93,2	cyclictest	0	-21	swapper/5	11:40:01	5
4051846	99	98	79,15	cyclictest	210	-21	kswapd0	10:30:25	0
4051846	99	98	61,26	cyclictest	0	-21	swapper/0	11:40:43	0
4051846	99	98	60,28	cyclictest	690	50	irq/528-eth0-Tx	07:50:39	0
4051846	99	98	59,36	cyclictest	65679	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:21:53	0
4051846	99	98	59,36	cyclictest	65679	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:21:52	0
4051846	99	98	25,30	cyclictest	133774	-21	awk	12:20:01	0
4051866	99	97	92,2	cyclictest	0	-21	swapper/4	10:20:11	4
4051866	99	97	92,2	cyclictest	0	-21	swapper/4	10:20:10	4
4051846	99	97	59,27	cyclictest	689	50	irq/527-eth0-Tx	12:30:33	0
4051846	99	97	45,17	cyclictest	14345	-21	grep	10:40:00	0
4051846	99	96	60,14	cyclictest	54184	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:50:48	0
4051846	99	95	77,14	cyclictest	210	-21	kswapd0	11:15:00	0
4051846	99	95	71,17	cyclictest	4076434	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:17:24	0
4051856	99	94	63,9	cyclictest	143759	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:37:18	2
4051851	99	94	82,6	cyclictest	36326	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:15:22	1
4051851	99	94	82,6	cyclictest	36326	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:15:22	1
4051851	99	94	62,8	cyclictest	4100207	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:16:26	1
4051846	99	94	77,14	cyclictest	4079810	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:14:34	0
4051846	99	94	77,14	cyclictest	4079810	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:14:33	0
4051846	99	94	75,16	cyclictest	4053588	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:20:22	0
4051846	99	94	55,29	cyclictest	689	50	irq/527-eth0-Tx	10:15:35	0
4051846	99	94	55,29	cyclictest	689	50	irq/527-eth0-Tx	10:15:34	0
4051846	99	94	1,69	cyclictest	0	-21	swapper/0	09:05:29	0
4051846	99	94	1,69	cyclictest	0	-21	swapper/0	09:05:28	0
4051872	99	93	88,2	cyclictest	0	-21	swapper/5	10:40:26	5
4051846	99	93	68,17	cyclictest	4079810	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:39:37	0
4051846	99	93	1,33	cyclictest	0	-21	swapper/0	11:05:21	0
4051856	99	92	82,6	cyclictest	210	-21	kswapd0	11:10:26	2
4051856	99	92	78,7	cyclictest	2987	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:36:00	2
4051846	99	92	73,15	cyclictest	210	-21	kswapd0	10:00:08	0
4051846	99	92	69,16	cyclictest	54184	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:45:04	0
4051846	99	92	67,17	cyclictest	4085999	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:41:43	0
4051846	99	92	61,4	cyclictest	0	-21	swapper/0	08:20:23	0
4051846	99	92	61,4	cyclictest	0	-21	swapper/0	08:20:22	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17