OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sat Aug 01, 2026 12:46:37)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2193126	2	565	539,17	sleep4	0	-21	swapper/4	07:05:25	4
2194330	99	129	103,19	cyclictest	2193174	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:15:04	0
2194334	99	120	106,7	cyclictest	2403209	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:36:01	1
2194334	99	119	105,7	cyclictest	2457519	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:21:11	1
2194330	99	118	92,19	cyclictest	2212369	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:55:17	0
2194353	99	117	102,8	cyclictest	2175238	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:10:04	3
2194330	99	117	92,18	cyclictest	2206288	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:40:09	0
2194353	99	116	101,8	cyclictest	2228561	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:35:35	3
2194334	99	113	100,7	cyclictest	2200146	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:35:08	1
2194334	99	113	100,7	cyclictest	2200146	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:35:07	1
2194330	99	110	84,19	cyclictest	2386399	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	11:00:58	0
2194330	99	109	82,20	cyclictest	2403209	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:56:05	0
2194330	99	109	82,20	cyclictest	2403209	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:56:05	0
2194330	99	107	71,22	cyclictest	673	50	irq/527-eth0-Tx	10:00:27	0
2194353	99	106	92,7	cyclictest	2238616	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:05:43	3
2194330	99	105	78,19	cyclictest	2222520	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:55:42	0
2194330	99	105	78,19	cyclictest	2222520	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:55:41	0
2194330	99	105	59,32	cyclictest	2492397	-21	ps	12:20:41	0
2194334	99	102	88,7	cyclictest	2206288	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:45:11	1
2194330	99	102	69,23	cyclictest	674	50	irq/528-eth0-Tx	09:10:19	0
2194330	99	102	5,77	cyclictest	15	-21	rcuc/0	10:20:27	0
2194330	99	102	1,87	cyclictest	0	-21	swapper/0	09:05:33	0
2194330	99	101	36,41	cyclictest	2313038	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:13:52	0
2194330	99	101	36,41	cyclictest	2313038	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:13:51	0
2194330	99	101	31,56	cyclictest	673	50	irq/527-eth0-Tx	10:15:41	0
2194330	99	101	31,56	cyclictest	673	50	irq/527-eth0-Tx	10:15:40	0
2194330	99	100	74,19	cyclictest	2210255	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:50:15	0
2194330	99	100	74,19	cyclictest	2210255	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:50:14	0
2194330	99	99	53,39	cyclictest	2386399	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	11:35:16	0
2194968	2	98	0,4	sleep4	0	-21	swapper/4	07:10:21	4
2194330	99	98	72,19	cyclictest	2411617	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:21:01	0
2194330	99	98	57,27	cyclictest	0	-21	swapper/0	08:15:19	0
2194330	99	97	2,63	cyclictest	2366772	-21	ssh	10:45:18	0
2194330	99	97	2,63	cyclictest	2366772	-21	ssh	10:45:17	0
2194330	99	96	58,28	cyclictest	673	50	irq/527-eth0-Tx	11:32:09	0
2489375	2	95	0,5	sleep1	0	-21	swapper/1	12:18:48	1
2194370	99	95	89,3	cyclictest	0	-21	swapper/5	09:55:48	5
2194330	99	95	31,40	cyclictest	2403209	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:25:29	0
2194353	99	94	81,6	cyclictest	2286535	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:50:48	3
2194334	99	94	80,7	cyclictest	2442087	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:06:07	1
2194330	99	93	62,14	cyclictest	2374147	-21	ntpq	10:50:33	0
2194330	99	93	62,14	cyclictest	2374147	-21	ntpq	10:50:32	0
2194330	99	93	57,23	cyclictest	674	50	irq/528-eth0-Tx	11:55:01	0
2194330	99	93	54,26	cyclictest	674	50	irq/528-eth0-Tx	12:05:43	0
2194334	99	92	79,7	cyclictest	2266191	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:40:45	1
2194330	99	92	50,27	cyclictest	0	-21	swapper/0	10:26:23	0
2194330	99	92	41,28	cyclictest	0	-21	swapper/0	09:20:00	0
2194330	99	92	3,51	cyclictest	13	-21	ksoftirqd/0	09:26:35	0
2194330	99	92	3,51	cyclictest	13	-21	ksoftirqd/0	09:26:34	0
2194353	99	91	79,6	cyclictest	2386399	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	11:31:01	3
2194330	99	91	60,22	cyclictest	0	-21	swapper/0	08:35:37	0
2194330	99	91	59,16	cyclictest	210	-21	kswapd0	09:35:27	0
2194330	99	91	49,23	cyclictest	0	-21	swapper/0	10:05:44	0
2194330	99	91	49,23	cyclictest	0	-21	swapper/0	10:05:44	0
2194330	99	91	2,77	cyclictest	0	-21	swapper/0	11:40:22	0
2194330	99	90	41,41	cyclictest	2222520	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:45:19	0
2194342	99	89	76,7	cyclictest	2267725	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	09:30:45	2
2194334	99	89	76,7	cyclictest	2238616	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:15:45	1
2194330	99	89	57,23	cyclictest	674	50	irq/528-eth0-Tx	07:20:21	0
2194330	99	89	48,23	cyclictest	0	-21	swapper/0	12:10:33	0
2194330	99	89	46,25	cyclictest	0	-21	swapper/0	11:05:25	0
2194330	99	89	46,25	cyclictest	0	-21	swapper/0	11:05:24	0
2194370	99	88	82,2	cyclictest	0	-21	swapper/5	11:26:02	5
2194353	99	88	75,7	cyclictest	2338437	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:25:50	3
2194330	99	88	63,18	cyclictest	2386399	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	11:10:58	0
2194330	99	88	30,36	cyclictest	2222520	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:22:56	0
2194330	99	87	9,5	cyclictest	676	50	irq/530-eth0-Tx	11:45:39	0
2194330	99	87	53,22	cyclictest	674	50	irq/528-eth0-Tx	12:26:33	0
2194330	99	87	1,74	cyclictest	673	50	irq/527-eth0-Tx	10:30:15	0
2194353	99	86	73,6	cyclictest	2266191	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:05:49	3
2194353	99	86	73,6	cyclictest	2266191	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:05:48	3
2194330	99	86	50,16	cyclictest	2240048	-21	mailstats	09:00:41	0
2194330	99	86	46,31	cyclictest	0	-21	swapper/0	12:15:39	0
2194330	99	86	38,32	cyclictest	0	-21	swapper/0	09:21:45	0
2194330	99	86	38,32	cyclictest	0	-21	swapper/0	09:21:44	0
2194330	99	85	52,23	cyclictest	673	50	irq/527-eth0-Tx	08:05:13	0
2194330	99	85	52,23	cyclictest	673	50	irq/527-eth0-Tx	08:05:13	0
2194330	99	85	46,22	cyclictest	0	-21	swapper/0	07:25:19	0
2194330	99	84	60,16	cyclictest	2231066	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:50:37	0
2194330	99	84	57,13	cyclictest	2287986	-21	ssh	09:45:22	0
2194330	99	84	42,25	cyclictest	0	-21	swapper/0	09:30:32	0
2194330	99	84	33,27	cyclictest	2300198	-21	ssh	09:55:01	0
2194370	99	83	76,3	cyclictest	0	-21	swapper/5	12:08:11	5
2194330	99	83	40,27	cyclictest	673	50	irq/527-eth0-Tx	10:40:31	0
2194330	99	83	2,76	cyclictest	0	-21	swapper/0	08:10:42	0
2194334	99	82	70,6	cyclictest	2403209	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:26:12	1
2194330	99	82	54,13	cyclictest	0	-21	swapper/0	07:45:17	0
2194330	99	82	1,75	cyclictest	0	-21	swapper/0	08:25:30	0
2194330	99	82	1,69	cyclictest	0	-21	swapper/0	12:33:35	0
2194330	99	82	1,52	cyclictest	2353272	-21	ssh	10:35:05	0
2194370	99	81	75,2	cyclictest	0	-21	swapper/5	11:55:35	5
2194370	99	81	75,2	cyclictest	0	-21	swapper/5	11:55:35	5
2194342	99	81	67,7	cyclictest	2313038	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:35:50	2
2194330	99	81	46,26	cyclictest	0	-21	swapper/0	07:30:33	0
2194330	99	81	41,24	cyclictest	2465992	-21	ssh	12:00:33	0
2194330	99	80	51,16	cyclictest	0	-21	swapper/0	07:35:25	0
2194330	99	80	51,16	cyclictest	0	-21	swapper/0	07:35:25	0
2194330	99	79	48,22	cyclictest	0	-21	swapper/0	11:15:37	0
2194330	99	79	48,22	cyclictest	0	-21	swapper/0	11:15:36	0
2194330	99	79	48,18	cyclictest	674	50	irq/528-eth0-Tx	08:30:17	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17