OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Mon Jul 20, 2026 12:46:24)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2294724	99	149	68,53	cyclictest	2296612	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:34:59	0
2294724	99	124	92,25	cyclictest	2378177	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:40:32	0
2294724	99	113	2,52	cyclictest	2390914	-21	ssh	09:46:32	0
2294724	99	113	1,97	cyclictest	0	-21	swapper/0	11:50:41	0
2294724	99	110	1,95	cyclictest	676	50	irq/530-eth0-Tx	12:00:45	0
2294724	99	109	69,23	cyclictest	673	50	irq/527-eth0-Tx	10:05:43	0
2294724	99	109	29,66	cyclictest	674	50	irq/528-eth0-Tx	10:10:23	0
2294724	99	106	2,82	cyclictest	2475853	-21	ntpq	10:50:33	0
2294744	99	104	92,7	cyclictest	2382668	-21	ssh	09:40:31	4
2294738	99	103	89,7	cyclictest	2419226	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:10:36	3
2294724	99	103	75,20	cyclictest	2446389	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:40:39	0
2294724	99	102	22,5	cyclictest	2431532	-21	ssh	10:17:13	0
2294724	99	101	22,6	cyclictest	2495896	-21	ntp_states	11:05:38	0
2294724	99	101	22,6	cyclictest	2495896	-21	ntp_states	11:05:37	0
2294724	99	101	19,68	cyclictest	673	50	irq/527-eth0-Tx	10:20:43	0
2294724	99	100	2,85	cyclictest	0	-21	swapper/0	11:50:01	0
2294724	99	100	2,85	cyclictest	0	-21	swapper/0	11:50:00	0
2294724	99	100	22,4	cyclictest	0	-21	swapper/0	12:40:02	0
2294724	99	100	1,75	cyclictest	2609140	-21	ssh	12:31:10	0
2294724	99	100	1,58	cyclictest	0	-21	swapper/0	09:20:18	0
2294724	99	99	75,15	cyclictest	2430831	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:20:47	0
2294724	99	99	28,39	cyclictest	674	50	irq/528-eth0-Tx	09:52:20	0
2294724	99	99	16,48	cyclictest	2362838	-21	ntp_offset	09:25:34	0
2294724	99	98	9,57	cyclictest	2545428	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:20:07	0
2294724	99	97	26,5	cyclictest	2446206	-21	ssh	10:28:37	0
2294724	99	97	2,42	cyclictest	2508472	-21	ssh	11:15:26	0
2294724	99	97	12,68	cyclictest	15	-21	rcuc/0	10:55:25	0
2294724	99	96	4,73	cyclictest	13	-21	ksoftirqd/0	11:30:34	0
2294724	99	96	1,58	cyclictest	2419226	-21	kworker/u12:3+rpciod@ rpc_async_schedule	10:35:59	0
2294724	99	96	1,58	cyclictest	2419226	-21	kworker/u12:3+rpciod@ rpc_async_schedule	10:35:58	0
2294724	99	95	23,5	cyclictest	2448605	-21	ssh	10:30:21	0
2294724	99	95	23,5	cyclictest	2448605	-21	ssh	10:30:21	0
2294724	99	94	27,47	cyclictest	673	50	irq/527-eth0-Tx	10:45:31	0
2294724	99	93	1,80	cyclictest	0	-21	swapper/0	08:00:01	0
2294724	99	92	21,64	cyclictest	0	-21	swapper/0	12:15:18	0
2294724	99	92	1,62	cyclictest	2351576	-21	ssh	09:17:03	0
2294734	99	90	75,8	cyclictest	2306464	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:05:12	2
2294724	99	90	48,23	cyclictest	2301527	-21	sed	07:25:21	0
2294724	99	90	33,15	cyclictest	673	50	irq/527-eth0-Tx	08:15:21	0
2294724	99	89	58,22	cyclictest	0	-21	swapper/0	07:50:01	0
2294724	99	88	9,18	cyclictest	675	50	irq/529-eth0-Tx	09:55:33	0
2294724	99	88	1,25	cyclictest	0	-21	swapper/0	11:37:43	0
2294724	99	88	1,25	cyclictest	0	-21	swapper/0	09:00:12	0
2294724	99	88	1,25	cyclictest	0	-21	swapper/0	09:00:12	0
2294724	99	88	1,16	cyclictest	0	-21	swapper/0	12:13:39	0
2294724	99	87	1,26	cyclictest	0	-21	swapper/0	11:25:11	0
2294724	99	87	1,25	cyclictest	0	-21	swapper/0	08:35:22	0
2294724	99	87	1,24	cyclictest	0	-21	swapper/0	09:32:08	0
2294724	99	87	1,24	cyclictest	0	-21	swapper/0	09:32:07	0
2294724	99	86	29,25	cyclictest	676	50	irq/530-eth0-Tx	09:35:36	0
2294724	99	86	29,25	cyclictest	676	50	irq/530-eth0-Tx	09:35:35	0
2294724	99	86	20,8	cyclictest	13	-21	ksoftirqd/0	11:10:31	0
2294724	99	86	16,45	cyclictest	2306464	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:50:18	0
2294724	99	86	1,50	cyclictest	2323384	-21	/usr/sbin/munin	08:20:18	0
2294724	99	86	1,49	cyclictest	0	-21	swapper/0	11:00:18	0
2420128	2	85	0,5	chrt	0	-21	swapper/3	10:09:12	3
2294744	99	85	75,6	cyclictest	2462671	-21	ssh	10:40:38	4
2294744	99	85	75,5	cyclictest	2516345	-21	ssh	11:20:48	4
2294724	99	85	19,4	cyclictest	0	-21	swapper/0	12:05:45	0
2294724	99	85	1,25	cyclictest	2590199	-21	kworker/u12:2+rpciod@ rpc_async_schedule	12:29:32	0
2294724	99	85	1,25	cyclictest	2590199	-21	kworker/u12:2+rpciod@ rpc_async_schedule	12:29:32	0
2294744	99	84	70,8	cyclictest	2416399	-21	ssh	10:05:42	4
2294724	99	84	60,21	cyclictest	2296612	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:24:58	0
2294724	99	84	2,24	cyclictest	0	-21	swapper/0	11:58:57	0
2294728	99	83	69,7	cyclictest	2545428	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:10:54	1
2294724	99	83	26,27	cyclictest	2547176	-21	latency_hist	11:45:02	0
2294734	99	82	68,7	cyclictest	2430831	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:50:39	2
2294724	99	81	45,23	cyclictest	0	-21	swapper/0	09:10:31	0
2294724	99	81	25,6	cyclictest	673	50	irq/527-eth0-Tx	07:40:33	0
2294724	99	81	22,5	cyclictest	15	-21	rcuc/0	10:00:15	0
2294373	2	81	53,20	sleep4	0	-21	swapper/4	07:07:29	4
2294724	99	80	1,51	cyclictest	0	-21	swapper/0	09:05:13	0
2294750	99	79	74,2	cyclictest	0	-21	swapper/5	09:05:25	5
2294728	99	79	67,6	cyclictest	2553157	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:00:53	1
2294724	99	79	2,27	cyclictest	2295827	-21	pluginstate	07:10:39	0
2294724	99	79	2,21	cyclictest	2335664	-21	aten2.4-expect	08:50:18	0
2294724	99	78	2,28	cyclictest	2296944	-21	/usr/sbin/munin	07:15:27	0
2294724	99	78	2,28	cyclictest	2296944	-21	/usr/sbin/munin	07:15:27	0
2294724	99	78	1,27	cyclictest	0	-21	swapper/0	08:05:22	0
2294724	99	77	2,49	cyclictest	2315178	-21	find	08:00:03	0
2294734	99	76	66,4	cyclictest	2601042	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:31:02	2
2294744	99	75	69,3	cyclictest	0	-21	swapper/4	07:34:59	4
2294738	99	75	61,7	cyclictest	2430831	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:15:47	3
2294738	99	75	43,7	cyclictest	2347218	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:20:27	3
2294724	99	75	1,58	cyclictest	0	-21	swapper/0	08:55:26	0
2301931	2	74	0,5	sleep3	0	-21	swapper/3	07:25:37	3
2294750	99	74	68,3	cyclictest	0	-21	swapper/5	07:19:25	5
2294750	99	74	68,3	cyclictest	0	-21	swapper/5	07:19:25	5
2294738	99	74	60,7	cyclictest	2430831	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:45:46	3
2294724	99	74	2,30	cyclictest	2327911	-21	kernelversion	08:30:24	0
2294724	99	74	17,5	cyclictest	2325395	-21	/usr/sbin/munin	08:25:18	0
2294728	99	73	59,7	cyclictest	2306464	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:00:06	1
2294724	99	73	1,57	cyclictest	0	-21	swapper/0	07:35:12	0
2294750	99	72	66,3	cyclictest	0	-21	swapper/5	10:10:55	5
2294750	99	72	66,2	cyclictest	0	-21	swapper/5	12:19:46	5
2294738	99	72	61,5	cyclictest	2430831	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:25:37	3
2294728	99	72	58,7	cyclictest	2491276	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:10:46	1
2598533	2	71	0,5	sleep3	0	-21	swapper/3	12:23:47	3
2294750	99	71	65,3	cyclictest	0	-21	swapper/5	07:54:09	5
2294738	99	71	55,7	cyclictest	2341006	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:15:28	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17