OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sat Jan 10, 2026 12:46:38)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1630774	2	185	168,6	sleep2	1624814	-21	kworker/2:1+events@ dbs_work_handler	07:05:41	2
1631320	99	135	121,7	cyclictest	1742920	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:25:45	3
1631308	99	130	102,20	cyclictest	1742920	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:20:44	0
1631308	99	126	85,32	cyclictest	1661372	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:25:26	0
1631313	99	124	110,7	cyclictest	1837259	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:05:11	1
1631308	99	124	41,73	cyclictest	13	-21	ksoftirqd/0	11:00:02	0
1631308	99	122	95,23	cyclictest	210	-21	kswapd0	12:35:17	0
1631320	99	121	109,6	cyclictest	1778729	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:35:57	3
1631313	99	121	107,7	cyclictest	1675617	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:40:39	1
1631320	99	119	105,7	cyclictest	1882580	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:06:00	3
1631320	99	117	103,7	cyclictest	1850721	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:40:57	3
1631308	99	117	80,29	cyclictest	1649423	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:15:24	0
1631320	99	115	103,6	cyclictest	1801454	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:55:48	3
1631320	99	114	101,6	cyclictest	1709485	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:50:41	3
1631317	99	114	102,6	cyclictest	1637049	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:40:07	2
1631308	99	114	95,15	cyclictest	15	-21	rcuc/0	11:29:35	0
1631308	99	114	95,15	cyclictest	15	-21	rcuc/0	11:29:35	0
1631317	99	113	100,6	cyclictest	1808087	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:15:52	2
1929272	2	111	0,13	sleep2	30	-21	ksoftirqd/2	12:35:53	2
1631320	99	111	97,7	cyclictest	1765459	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:30:46	3
1631320	99	111	97,7	cyclictest	1765459	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:30:46	3
1631320	99	111	97,7	cyclictest	1663496	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:30:28	3
1631313	99	111	97,7	cyclictest	1765459	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:50:48	1
1631308	99	111	33,65	cyclictest	0	-21	swapper/0	12:10:35	0
1631308	99	110	1,92	cyclictest	0	-21	swapper/0	11:45:12	0
1631308	99	110	1,65	cyclictest	0	-21	swapper/0	10:25:42	0
1631308	99	109	28,42	cyclictest	689	50	irq/527-eth0-Tx	11:05:24	0
1631320	99	108	95,6	cyclictest	1823158	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:20:53	3
1631308	99	108	70,29	cyclictest	1709485	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:01:33	0
1631308	99	108	70,29	cyclictest	1709485	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:01:32	0
1631317	99	106	92,7	cyclictest	1696440	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:25:40	2
1631308	99	106	72,30	cyclictest	210	-21	kswapd0	12:30:28	0
1631313	99	104	90,7	cyclictest	1675617	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:00:29	1
1631313	99	104	90,7	cyclictest	1675617	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:00:28	1
1631308	99	102	70,25	cyclictest	1837259	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:32:39	0
1631308	99	102	70,25	cyclictest	1837259	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:32:39	0
1631308	99	102	27,42	cyclictest	1778729	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:59:00	0
1631308	99	102	25,25	cyclictest	1732640	-21	wc	09:55:02	0
1631308	99	102	10,46	cyclictest	1782293	-21	basename	10:35:19	0
1631308	99	101	65,29	cyclictest	1709485	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:35:41	0
1631308	99	101	63,30	cyclictest	1640598	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:58:59	0
1631308	99	101	1,83	cyclictest	0	-21	swapper/0	11:55:11	0
1631308	99	100	81,15	cyclictest	210	-21	kswapd0	09:55:23	0
1631308	99	100	63,29	cyclictest	1908945	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:21:00	0
1631320	99	99	84,8	cyclictest	1837259	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:26:02	3
1631313	99	99	84,8	cyclictest	1865020	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:57:35	1
1631313	99	98	88,6	cyclictest	210	-21	kswapd0	11:20:24	1
1631308	99	98	56,32	cyclictest	689	50	irq/527-eth0-Tx	08:50:29	0
1631308	99	98	56,32	cyclictest	689	50	irq/527-eth0-Tx	08:50:28	0
1631308	99	98	22,63	cyclictest	0	-21	swapper/0	09:25:44	0
1631308	99	98	2,13	cyclictest	0	-21	swapper/0	11:52:49	0
1631317	99	97	83,7	cyclictest	1908945	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:25:27	2
1631308	99	97	2,68	cyclictest	0	-21	swapper/0	08:10:23	0
1631317	99	96	81,8	cyclictest	1665516	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:00:37	2
1631313	99	96	81,7	cyclictest	1703396	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:33:29	1
1631308	99	96	58,28	cyclictest	1696440	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:30:22	0
1631308	99	96	51,41	cyclictest	1788263	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:40:16	0
1631320	99	95	81,7	cyclictest	1613262	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	07:20:34	3
1631320	99	95	63,13	cyclictest	1882580	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:10:27	3
1631308	99	95	61,27	cyclictest	1808087	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:13:31	0
1631308	99	95	2,73	cyclictest	1838081	-21	/usr/sbin/munin	11:20:43	0
1631320	99	94	79,7	cyclictest	1808087	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:00:48	3
1631320	99	94	64,17	cyclictest	1882580	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:32:08	3
1631308	99	94	37,35	cyclictest	1671633	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:50:00	0
1631308	99	94	1,8	cyclictest	692	50	irq/530-eth0-Tx	09:10:43	0
1631308	99	94	1,8	cyclictest	692	50	irq/530-eth0-Tx	09:10:42	0
1631313	99	93	78,7	cyclictest	1653511	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:10:22	1
1631308	99	93	7,73	cyclictest	0	-21	swapper/0	10:30:14	0
1631308	99	93	7,73	cyclictest	0	-21	swapper/0	10:30:14	0
1631308	99	93	61,25	cyclictest	1742920	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:05:48	0
1631308	99	93	47,39	cyclictest	1665516	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:06:02	0
1631308	99	93	29,49	cyclictest	0	-21	swapper/0	11:42:38	0
1631308	99	93	2,50	cyclictest	1692276	-21	unixbench_multi	09:20:41	0
1631320	99	92	78,7	cyclictest	1778729	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:30:56	3
1631320	99	92	78,7	cyclictest	1778729	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:30:56	3
1631320	99	92	78,7	cyclictest	1675617	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:45:41	3
1631313	99	92	77,6	cyclictest	1837259	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:26:35	1
1631313	99	92	77,6	cyclictest	1837259	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:26:35	1
1631308	99	92	58,27	cyclictest	1651461	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:02:28	0
1631308	99	92	3,5	cyclictest	689	50	irq/527-eth0-Tx	07:33:06	0
1631308	99	92	3,5	cyclictest	689	50	irq/527-eth0-Tx	07:33:06	0
1631308	99	92	2,78	cyclictest	0	-21	swapper/0	10:45:39	0
1631320	99	91	67,10	cyclictest	1837259	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:16:05	3
1631320	99	91	60,8	cyclictest	1801454	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:52:30	3
1631313	99	91	76,8	cyclictest	1908945	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:22:15	1
1631313	99	91	62,7	cyclictest	1709485	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:36:18	1
1631308	99	91	52,32	cyclictest	1626866	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:19:43	0
1631308	99	91	35,22	cyclictest	13	-21	ksoftirqd/0	12:25:32	0
1631308	99	91	2,84	cyclictest	0	-21	swapper/0	12:15:07	0
1631308	99	91	2,84	cyclictest	0	-21	swapper/0	07:50:41	0
1631320	99	90	80,6	cyclictest	210	-21	kswapd0	09:40:01	3
1631320	99	90	75,7	cyclictest	1675617	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:55:19	3
1631320	99	90	75,7	cyclictest	1675617	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:16:35	3
1631320	99	90	75,7	cyclictest	1675617	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:16:35	3
1631320	99	90	74,6	cyclictest	210	-21	kswapd0	11:29:35	3
1631320	99	90	74,6	cyclictest	210	-21	kswapd0	11:29:35	3
1631313	99	90	62,6	cyclictest	1865020	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:52:15	1
1631320	99	89	76,6	cyclictest	1837259	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:22:34	3
1631313	99	89	74,7	cyclictest	1823158	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:10:50	1
1631308	99	89	2,5	cyclictest	1896724	-21	sed	12:10:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17