OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Sat Dec 20, 2025 00:44:13)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1650344	99	104	96,6	cyclictest	1762287	-21	kworker/u4:9+events_unbound	22:56:46	0
1650344	99	101	93,6	cyclictest	1708703	-21	kworker/u4:7+events_unbound	21:56:37	0
1650344	99	100	86,7	cyclictest	1844268	-21	kworker/u4:1+events_unbound	00:38:55	0
1650344	99	92	84,6	cyclictest	1704505	-21	kworker/u4:11+events_unbound	22:26:41	0
1650344	99	90	63,19	cyclictest	1751563	-21	munin-run	22:35:13	0
1650344	99	90	63,19	cyclictest	1751563	-21	munin-run	22:35:12	0
1650344	99	84	77,5	cyclictest	1712867	-21	kworker/u4:6+events_unbound	22:16:41	0
1650347	99	83	74,7	cyclictest	53	-21	kswapd0	20:30:18	1
1650344	99	83	39,32	cyclictest	1655453	-21	apt-get	19:30:06	0
1650344	99	83	39,32	cyclictest	1655453	-21	apt-get	19:30:05	0
1650344	99	81	71,8	cyclictest	1827646	-21	kworker/u4:4+events_unbound	00:10:13	0
1650344	99	81	71,8	cyclictest	1827646	-21	kworker/u4:4+events_unbound	00:10:13	0
1650344	99	79	73,5	cyclictest	1774279	-21	kworker/u4:3+events_unbound	23:06:49	0
1650344	99	79	69,7	cyclictest	1782670	-21	kworker/u4:2+events_unbound	23:15:15	0
1650347	99	74	37,17	cyclictest	53	-21	kswapd0	23:15:15	1
1650347	99	73	7,56	cyclictest	1768972	-21	ssh	22:55:33	1
1650347	99	73	37,29	cyclictest	1756327	-21	cat	22:40:22	1
1650347	99	73	28,22	cyclictest	0	-21	swapper/1	21:40:34	1
1650347	99	72	24,28	cyclictest	0	-21	swapper/1	23:55:28	1
1650347	99	71	25,41	cyclictest	0	-21	swapper/1	23:05:39	1
1650347	99	71	23,27	cyclictest	0	-21	swapper/1	23:30:11	1
1650344	99	71	62,7	cyclictest	1753943	-21	kworker/u4:3+events_unbound	22:46:45	0
1650344	99	71	62,7	cyclictest	1753943	-21	kworker/u4:3+events_unbound	22:46:44	0
1650347	99	70	61,6	cyclictest	1823505	-21	kworker/u4:6+events_unbound	00:03:19	1
1650347	99	70	55,11	cyclictest	1700335	-21	kworker/u4:10+events_unbound	21:55:35	1
1650347	99	70	30,35	cyclictest	0	-21	swapper/1	23:10:57	1
1650344	99	70	62,6	cyclictest	1655424	-21	kworker/u4:11+events_unbound	20:11:19	0
1650344	99	70	47,14	cyclictest	53	-21	kswapd0	22:20:09	0
1650347	99	69	57,8	cyclictest	1744295	-21	ld	22:25:32	1
1650347	99	69	2,41	cyclictest	1812028	-21	ssh	23:48:16	1
1650347	99	69	2,40	cyclictest	1736584	-21	ssh	22:15:42	1
1650347	99	69	1,42	cyclictest	1801812	-21	ntpq	23:35:30	1
1650344	99	69	43,20	cyclictest	1058	-21	snmpd	21:15:11	0
1650347	99	68	4,58	cyclictest	1826828	-21	ssh	00:05:42	1
1650347	99	68	3,39	cyclictest	1749157	-21	ssh	22:31:00	1
1650347	99	68	3,39	cyclictest	1749157	-21	ssh	22:31:00	1
1650347	99	68	3,39	cyclictest	1730407	-21	ssh	22:09:06	1
1650347	99	68	2,42	cyclictest	1705792	-21	ssh	21:39:08	1
1650347	99	68	23,26	cyclictest	0	-21	swapper/1	21:30:23	1
1650347	99	68	1,41	cyclictest	1694827	-21	ntpq	21:25:26	1
1650347	99	68	13,30	cyclictest	0	-21	swapper/1	00:15:50	1
1650347	99	67	3,38	cyclictest	1688409	-21	ssh	21:17:56	1
1650344	99	67	58,7	cyclictest	1431208	-21	kworker/u4:0+events_unbound	19:26:16	0
1650347	99	66	3,40	cyclictest	1752360	-21	ssh	22:35:28	1
1650347	99	66	3,37	cyclictest	1693240	-21	ssh	21:23:54	1
1650347	99	66	2,37	cyclictest	1761891	-21	ssh	22:46:46	1
1650347	99	66	2,37	cyclictest	1761891	-21	ssh	22:46:46	1
1650347	99	66	23,37	cyclictest	0	-21	swapper/1	20:45:01	1
1650347	99	66	21,39	cyclictest	0	-21	swapper/1	23:50:29	1
1650347	99	66	14,31	cyclictest	1842164	-21	diskstats	00:25:20	1
1650347	99	66	1,39	cyclictest	1713932	-21	ssh	21:48:55	1
1650347	99	65	2,40	cyclictest	1717790	-21	ssh	21:53:32	1
1650344	99	65	57,6	cyclictest	1669570	-21	kworker/u4:3+events_unbound	20:26:22	0
1650344	99	65	56,7	cyclictest	1823505	-21	kworker/u4:6+events_unbound	00:05:07	0
1650347	99	64	8,33	cyclictest	1795549	-21	ssh	23:27:57	1
1650347	99	64	30,31	cyclictest	0	-21	swapper/1	00:35:21	1
1650344	99	64	52,7	cyclictest	1802023	-21	mailstats	23:35:37	0
1650344	99	63	55,6	cyclictest	1670842	-21	kworker/u4:0+events_unbound	22:00:04	0
1650347	99	62	41,19	cyclictest	1724007	-21	processes	22:00:37	1
1650347	99	62	14,30	cyclictest	1840402	-21	ssh	00:22:59	1
1650347	99	62	1,38	cyclictest	1764674	-21	memory	22:50:21	1
1650347	99	61	31,28	cyclictest	1772455	-21	aten_r7power_po	23:00:18	1
1650347	99	61	16,27	cyclictest	0	-21	swapper/1	21:10:29	1
1650347	99	61	14,26	cyclictest	0	-21	swapper/1	22:10:42	1
1650344	99	61	3,49	cyclictest	1752517	-21	ssh	22:35:35	0
1650347	99	60	3,54	cyclictest	1789852	-21	ps	23:20:43	1
1650347	99	60	32,26	cyclictest	1830534	-21	proc_pri	00:10:38	1
1650347	99	60	32,26	cyclictest	1830534	-21	proc_pri	00:10:37	1
1650347	99	60	31,27	cyclictest	1844268	-21	kworker/u4:1-rpciod	00:30:42	1
1650347	99	59	54,2	cyclictest	1431208	-21	kworker/u4:0+events_unbound	19:25:01	1
1650347	99	59	3,52	cyclictest	1805165	-21	ssh	23:40:12	1
1650347	99	59	2,50	cyclictest	1660810	-21	apt-get	19:50:12	1
1650344	99	59	52,5	cyclictest	1698483	-21	aten2__	21:30:17	0
1650344	99	59	51,6	cyclictest	1652857	-21	kworker/u4:6+events_unbound	20:01:20	0
1650347	99	58	27,27	cyclictest	1659097	-21	sort	19:40:35	1
1650347	99	58	16,26	cyclictest	0	-21	swapper/1	22:20:36	1
1650344	99	58	51,6	cyclictest	1669572	-21	kworker/u4:5+events_unbound	20:36:23	0
1650344	99	58	51,5	cyclictest	1715214	-21	fschecks_time	21:50:21	0
1650347	99	57	3,48	cyclictest	1058	-21	snmpd	21:00:33	1
1650347	99	57	1,52	cyclictest	1652356	-21	ntpq	19:15:28	1
1650344	99	57	50,5	cyclictest	1670846	-21	kworker/u4:7+events_unbound	20:30:02	0
1650347	99	56	2,51	cyclictest	1664014	-21	ntpq	20:00:31	1
1650347	99	56	2,50	cyclictest	1664646	-21	apt-get	20:05:15	1
1650347	99	56	1,51	cyclictest	1680633	-21	ntpq	21:05:26	1
1650344	99	56	45,7	cyclictest	1784389	-21	ssh	23:15:01	0
1650347	99	55	3,46	cyclictest	1657512	-21	ntpq	19:35:26	1
1650347	99	55	2,50	cyclictest	1656333	-21	ntpq	19:30:34	1
1650347	99	55	2,50	cyclictest	1656333	-21	ntpq	19:30:34	1
1650347	99	55	2,49	cyclictest	1651043	-21	ntpq	19:10:22	1
1650344	99	55	49,4	cyclictest	1663155	-21	kworker/u4:9+events_unbound	20:17:00	0
1650344	99	55	48,5	cyclictest	1431208	-21	kworker/u4:0+events_unbound	19:56:20	0
1650344	99	55	46,6	cyclictest	1799280	-21	kworker/u4:1-rpciod	23:40:38	0
1650347	99	54	2,48	cyclictest	1666562	-21	ntpq	20:10:33	1
1650347	99	54	1,47	cyclictest	1058	-21	snmpd	20:20:13	1
1650344	99	54	47,5	cyclictest	1673475	-21	kworker/u4:11+events_unbound	21:13:59	0
1650344	99	54	46,6	cyclictest	1840152	-21	kworker/u4:7+events_unbound	00:22:59	0
1650344	99	54	46,6	cyclictest	1840150	-21	kworker/u4:3+events_unbound	00:25:02	0
1650344	99	54	46,6	cyclictest	0	-21	swapper/0	23:30:13	0
1650344	99	54	43,5	cyclictest	1831825	-21	kworker/u4:7+events_unbound	00:17:02	0
1650344	99	54	34,7	cyclictest	1658050	-21	kworker/u4:1+events_unbound	20:06:01	0
1650344	99	54	27,24	cyclictest	0	-21	swapper/0	23:20:31	0
1650347	99	53	3,46	cyclictest	1673044	-21	ntpq	20:35:36	1
1650347	99	53	2,46	cyclictest	1678051	-21	ntpq	20:55:26	1
1650344	99	53	47,4	cyclictest	1712530	-21	sshd	21:46:31	0
1650344	99	53	47,4	cyclictest	1669570	-21	kworker/u4:3+events_unbound	20:50:02	0
1650344	99	53	46,5	cyclictest	1680263	-21	df_abs	21:05:17	0
1650344	99	53	37,6	cyclictest	1672204	-21	kworker/u4:9+events_unbound	20:55:04	0
1650347	99	52	2,46	cyclictest	1676832	-21	ntpq	20:50:27	1
1650347	99	52	2,46	cyclictest	1654901	-21	ntpq	19:25:25	1
1650347	99	52	2,45	cyclictest	1058	-21	snmpd	20:45:25	1
1650347	99	52	2,45	cyclictest	1058	-21	snmpd	19:55:07	1
1650347	99	52	13,31	cyclictest	1640521	-21	kworker/u4:19+rpciod	20:25:15	1
1650344	99	52	45,5	cyclictest	1728966	-21	kworker/u4:4+events_unbound	22:10:02	0
1650344	99	52	32,16	cyclictest	1807610	-21	kworker/u4:19-rpciod	23:55:37	0
1650347	99	51	2,44	cyclictest	1667812	-21	ntpq	20:15:32	1
1650347	99	51	1,47	cyclictest	1660153	-21	ntpq	19:45:30	1
1650344	99	51	40,8	cyclictest	1846589	-21	/usr/sbin/munin	00:30:25	0
1650344	99	51	39,6	cyclictest	1700335	-21	kworker/u4:10+events_unbound	21:38:00	0
1650344	99	50	43,6	cyclictest	1267135	-21	kworker/u4:5+events_unbound	19:11:15	0
1650344	99	50	10,28	cyclictest	1694992	-21	ssh	21:25:32	0
1650344	99	49	42,5	cyclictest	1773387	-21	switchtime	23:00:39	0
1650344	99	48	43,4	cyclictest	1803422	-21	kworker/u4:15+events_unbound	23:50:59	0
1650344	99	48	41,5	cyclictest	1728966	-21	kworker/u4:4+events_unbound	22:12:43	0
1650347	99	47	2,42	cyclictest	1650361	-21	sed	19:10:01	1
1650344	99	47	40,5	cyclictest	1825609	-21	/usr/sbin/munin	00:05:16	0
1650344	99	47	40,5	cyclictest	1756580	-21	ntp_offset	22:40:32	0
1650344	99	47	40,5	cyclictest	1683818	-21	kworker/u4:12+events_unbound	21:20:03	0
1650344	99	47	37,8	cyclictest	1766007	-21	sd-accept	22:51:45	0
1650344	99	47	25,19	cyclictest	0	-21	swapper/0	19:45:49	0
1650344	99	46	39,5	cyclictest	1793913	-21	processes	23:25:39	0
1650344	99	46	32,6	cyclictest	1673831	-21	aten_r7power_vo	20:40:15	0
1650344	99	45	38,5	cyclictest	1658050	-21	kworker/u4:1+events_unbound	19:50:03	0
1650344	99	45	38,5	cyclictest	1653270	-21	df_abs	19:20:15	0
1650344	99	44	37,5	cyclictest	1658091	-21	munin-run	19:39:59	0
1650344	99	43	36,5	cyclictest	1669334	-21	awk	20:20:37	0
1650344	99	43	36,5	cyclictest	0	-21	swapper/0	23:45:23	0
1650344	99	43	34,7	cyclictest	1659447	-21	latency_hist	19:45:01	0
1650344	99	43	22,18	cyclictest	0	-21	swapper/0	20:50:01	0
1650344	99	43	11,24	cyclictest	14	-21	ksoftirqd/0	21:40:20	0
1650344	99	40	32,6	cyclictest	1651886	-21	aten_r7power_vo	19:15:17	0
1650344	99	39	32,5	cyclictest	1591408	-21	kworker/u4:8-rpciod	21:00:37	0
1650344	99	38	7,24	cyclictest	1650342	-21	cyclictest	19:10:00	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17