OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Thu Jun 18, 2026 00:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1515719	99	145	128,11	cyclictest	53	-21	kswapd0	21:45:17	0
1515719	99	145	128,11	cyclictest	53	-21	kswapd0	21:45:17	0
1515719	99	93	88,3	cyclictest	1651802	-21	kworker/u4:6+events_unbound	23:11:45	0
1515723	99	86	78,6	cyclictest	1558299	-21	kworker/u4:1+events_unbound	21:26:20	1
1515719	99	86	76,7	cyclictest	1584746	-21	kworker/u4:1+events_unbound	22:00:00	0
1515723	99	84	75,7	cyclictest	1580274	-21	kworker/u4:5+events_unbound	22:26:37	1
1515719	99	78	30,21	cyclictest	1543072	-21	fschecks_time	20:55:19	0
1515719	99	77	68,6	cyclictest	1516952	-21	kworker/u4:11+events_unbound	19:30:59	0
1515719	99	77	40,8	cyclictest	1536750	-21	fschecks_time	20:30:17	0
1515719	99	76	39,5	cyclictest	0	-21	swapper/0	21:30:27	0
1515719	99	72	63,6	cyclictest	1523332	-21	kworker/u4:7+events_unbound	19:45:00	0
1515723	99	71	40,29	cyclictest	1698188	-21	cpu	00:00:18	1
1515719	99	70	62,6	cyclictest	1629218	-21	kworker/u4:3+events_unbound	23:16:48	0
1515723	99	68	32,33	cyclictest	1627079	-21	aten_r7power_po	22:40:18	1
1515723	99	68	31,33	cyclictest	0	-21	swapper/1	23:35:25	1
1515723	99	68	30,35	cyclictest	1685356	-21	ssh	23:45:29	1
1515719	99	68	12,41	cyclictest	1515718	-21	cyclictest	19:10:01	0
1515723	99	66	32,29	cyclictest	0	-21	swapper/1	21:15:21	1
1515723	99	66	28,34	cyclictest	0	-21	swapper/1	23:25:28	1
1515723	99	65	37,25	cyclictest	1596705	-21	/usr/sbin/munin	22:05:36	1
1515723	99	65	31,31	cyclictest	0	-21	swapper/1	21:35:16	1
1515723	99	65	27,33	cyclictest	1502052	-21	kworker/u4:0+rpciod	19:25:00	1
1515719	99	65	56,6	cyclictest	1515655	-21	kworker/u4:2+events_unbound	19:20:59	0
1515719	99	65	55,7	cyclictest	1720439	-21	aten_r7power_vo	00:25:16	0
1515723	99	64	34,28	cyclictest	1654492	-21	ld	23:10:41	1
1515723	99	64	30,30	cyclictest	0	-21	swapper/1	21:20:28	1
1515723	99	63	31,29	cyclictest	0	-21	swapper/1	21:10:25	1
1515723	99	63	29,31	cyclictest	1689560	-21	gltestperf	23:50:21	1
1515723	99	63	28,32	cyclictest	0	-21	swapper/1	21:45:48	1
1515723	99	63	28,32	cyclictest	0	-21	swapper/1	21:45:48	1
1515723	99	63	2,19	cyclictest	1671225	-21	apt-get	23:30:11	1
1515719	99	63	7,19	cyclictest	1703352	-21	ssh	00:05:40	0
1515723	99	62	3,11	cyclictest	1601054	-21	ntpq	22:10:33	1
1515723	99	62	2,18	cyclictest	1662964	-21	ntpq	23:20:24	1
1515719	99	62	53,6	cyclictest	1611093	-21	kworker/u4:19+events_unbound	22:31:40	0
1515723	99	61	53,6	cyclictest	1528535	-21	kworker/u4:12+events_unbound	20:35:01	1
1515723	99	61	32,27	cyclictest	1720705	-21	gltestperf	00:25:20	1
1515723	99	61	3,14	cyclictest	1724745	-21	apt-get	00:30:10	1
1515723	99	61	28,30	cyclictest	0	-21	swapper/1	20:35:20	1
1515723	99	61	27,30	cyclictest	0	-21	swapper/1	20:45:26	1
1515723	99	61	19,8	cyclictest	1527000	-21	sed	19:50:40	1
1515723	99	61	14,13	cyclictest	1588021	-21	sed	21:55:39	1
1515723	99	60	50,6	cyclictest	0	-21	swapper/1	23:15:14	1
1515723	99	60	30,27	cyclictest	1709162	-21	kworker/u4:8+rpciod	00:15:17	1
1515723	99	60	30,26	cyclictest	0	-21	swapper/1	00:20:27	1
1515723	99	60	28,29	cyclictest	0	-21	swapper/1	00:10:26	1
1515723	99	60	27,30	cyclictest	0	-21	swapper/1	00:35:32	1
1515723	99	60	27,30	cyclictest	0	-21	swapper/1	00:35:32	1
1515723	99	60	26,30	cyclictest	0	-21	swapper/1	22:35:37	1
1515723	99	60	26,30	cyclictest	0	-21	swapper/1	22:35:36	1
1515723	99	60	23,34	cyclictest	0	-21	swapper/1	00:05:44	1
1515723	99	60	20,10	cyclictest	1565183	-21	sed	21:30:21	1
1515723	99	59	37,20	cyclictest	1636099	-21	/usr/sbin/munin	22:50:19	1
1515723	99	59	26,30	cyclictest	0	-21	swapper/1	21:10:02	1
1515723	99	59	25,31	cyclictest	0	-21	swapper/1	22:20:19	1
1515723	99	59	24,31	cyclictest	0	-21	swapper/1	23:05:41	1
1515723	99	59	2,15	cyclictest	1529451	-21	ps	20:00:35	1
1515719	99	59	38,18	cyclictest	0	-21	swapper/0	00:40:02	0
1515719	99	59	38,18	cyclictest	0	-21	swapper/0	00:40:02	0
1515723	99	58	5,15	cyclictest	1535869	-21	ps	20:25:36	1
1515723	99	58	3,17	cyclictest	1574308	-21	ssh	21:40:23	1
1515723	99	58	29,26	cyclictest	1605617	-21	ld	22:15:44	1
1515723	99	58	28,26	cyclictest	0	-21	swapper/1	19:55:36	1
1515723	99	58	26,29	cyclictest	0	-21	swapper/1	22:55:30	1
1515723	99	58	26,29	cyclictest	0	-21	swapper/1	22:55:30	1
1515723	99	58	20,9	cyclictest	378	-21	dbus-daemon	20:56:15	1
1515723	99	57	47,8	cyclictest	1524623	-21	systemd	19:41:01	1
1515723	99	57	27,27	cyclictest	0	-21	swapper/1	22:00:38	1
1515723	99	57	25,28	cyclictest	0	-21	swapper/1	20:50:37	1
1515723	99	57	14,7	cyclictest	0	-21	swapper/1	23:40:20	1
1515719	99	57	49,6	cyclictest	1580273	-21	kworker/u4:4+events_unbound	22:01:27	0
1515719	99	57	34,20	cyclictest	1526482	-21	fschecks_time	19:50:23	0
1515723	99	56	25,28	cyclictest	0	-21	swapper/1	21:50:21	1
1515723	99	56	2,20	cyclictest	1693581	-21	ssh	23:55:16	1
1515719	99	56	44,7	cyclictest	0	-21	swapper/0	21:25:33	0
1515719	99	56	42,11	cyclictest	400	-21	systemd-logind	22:21:35	0
1515723	99	55	23,30	cyclictest	1631474	-21	aten_r7power_en	22:45:15	1
1515723	99	55	21,31	cyclictest	0	-21	swapper/1	23:00:35	1
1515723	99	55	18,33	cyclictest	0	-21	swapper/1	20:15:01	1
1515723	99	54	23,28	cyclictest	1528534	-21	kworker/u4:11-rpciod	20:05:36	1
1515719	99	54	45,6	cyclictest	1628165	-21	unixbench-2d	22:40:41	0
1515719	99	54	44,8	cyclictest	1700599	-21	systemd	00:02:40	0
1515719	99	54	41,9	cyclictest	1528535	-21	kworker/u4:12+events_unbound	20:30:00	0
1515719	99	54	41,9	cyclictest	0	-21	swapper/0	23:00:28	0
1515719	99	54	36,16	cyclictest	1516984	-21	munin-plugin-st	19:15:00	0
1515719	99	54	34,17	cyclictest	0	-21	swapper/0	00:20:15	0
1515719	99	54	29,23	cyclictest	1697676	-21	munin-run	00:00:00	0
1515723	99	53	22,28	cyclictest	1619312	-21	awk	22:30:40	1
1515719	99	53	46,5	cyclictest	1525906	-21	kworker/u4:6+events_unbound	19:56:06	0
1515719	99	53	45,6	cyclictest	1662864	-21	/usr/sbin/munin	23:20:21	0
1515719	99	53	45,6	cyclictest	1641448	-21	unixbench-2d	22:55:39	0
1515719	99	53	45,6	cyclictest	1641448	-21	unixbench-2d	22:55:38	0
1515719	99	53	45,5	cyclictest	531	-21	in:imuxsock	21:36:21	0
1515719	99	53	43,7	cyclictest	1534956	-21	modprobe	20:25:00	0
1515719	99	53	43,7	cyclictest	1525905	-21	kworker/u4:5+events_unbound	20:46:15	0
1515719	99	53	42,8	cyclictest	1707614	-21	/usr/sbin/munin	00:10:27	0
1515719	99	53	35,10	cyclictest	0	-21	swapper/0	20:10:00	0
1515723	99	52	18,31	cyclictest	1533827	-21	latency_hist	20:20:02	1
1515723	99	52	17,7	cyclictest	1534791	-21	timerwakeupswit	20:20:39	1
1515719	99	52	41,9	cyclictest	1679848	-21	kworker/u4:0	23:40:00	0
1515719	99	52	34,11	cyclictest	0	-21	swapper/0	19:49:59	0
1515719	99	52	32,16	cyclictest	0	-21	swapper/0	23:25:17	0
1515723	99	51	2,16	cyclictest	1539559	-21	ntpq	20:40:27	1
1515723	99	51	19,29	cyclictest	0	-21	swapper/1	21:00:38	1
1515719	99	51	42,6	cyclictest	1684980	-21	fschecks_count	23:45:19	0
1515719	99	51	42,6	cyclictest	1671778	-21	if_eth0	23:30:20	0
1515719	99	51	42,6	cyclictest	1544810	-21	find	21:00:35	0
1515719	99	51	35,8	cyclictest	1639926	-21	cron	22:55:00	0
1515719	99	51	21,25	cyclictest	1712120	-21	ssh	00:15:29	0
1515719	99	50	43,5	cyclictest	1580277	-21	kworker/u4:7+events_unbound	21:51:59	0
1515719	99	50	41,6	cyclictest	1690359	-21	/usr/sbin/munin	23:50:40	0
1515719	99	50	40,7	cyclictest	1600529	-21	/usr/sbin/munin	22:10:21	0
1515719	99	50	39,7	cyclictest	1608788	-21	modprobe	22:20:00	0
1515723	99	49	18,28	cyclictest	0	-21	swapper/1	19:35:19	1
1515723	99	49	14,5	cyclictest	1522117	-21	wc	19:35:01	1
1515723	99	49	13,6	cyclictest	0	-21	swapper/1	19:45:28	1
1515719	99	49	41,5	cyclictest	1600040	-21	latency_hist	22:10:01	0
1515719	99	49	40,6	cyclictest	1531098	-21	kworker/u4:3+events_unbound	20:11:09	0
1515719	99	49	40,6	cyclictest	1522554	-21	fschecks_time	19:35:21	0
1515723	99	48	17,6	cyclictest	1515654	-21	kworker/u4:1+rpciod	19:10:26	1
1515719	99	48	41,5	cyclictest	1577865	-21	http	21:45:00	0
1515723	99	47	17,4	cyclictest	1519800	-21	aten_r7power_en	19:25:15	1
1515723	99	47	13,9	cyclictest	0	-21	swapper/1	19:15:36	1
1515719	99	47	37,7	cyclictest	1520075	-21	gltestperf	19:25:19	0
1515719	99	47	37,7	cyclictest	0	-21	swapper/0	23:40:30	0
1515719	99	47	28,17	cyclictest	1649799	-21	netstat	23:05:26	0
1515719	99	46	38,5	cyclictest	1725782	-21	mailstats	00:30:37	0
1515719	99	46	38,5	cyclictest	1555555	-21	latency_hist	21:20:02	0
1515719	99	46	38,5	cyclictest	1528534	-21	kworker/u4:11+events_unbound	20:41:14	0
1515719	99	46	36,7	cyclictest	1547527	-21	ntp_kernel_pll_	21:10:30	0
1515719	99	46	35,9	cyclictest	1556851	-21	timerandwakeup	21:20:39	0
1515719	99	45	37,6	cyclictest	1515718	-21	cyclictest	22:48:17	0
1515719	99	45	33,8	cyclictest	0	-21	swapper/0	22:25:17	0
1515719	99	44	38,4	cyclictest	1532887	-21	fschecks_time	20:15:18	0
1515719	99	44	35,6	cyclictest	0	-21	swapper/0	22:35:28	0
1515719	99	44	35,6	cyclictest	0	-21	swapper/0	22:35:27	0
1515719	99	43	35,5	cyclictest	1516951	-21	kworker/u4:9-rpciod	19:15:38	0
1515719	99	43	32,7	cyclictest	0	-21	swapper/0	20:35:39	0
1515719	99	42	35,5	cyclictest	1069	-21	lldpd	21:07:34	0
1515719	99	42	32,7	cyclictest	1541800	-21	fschecks_time	20:50:19	0
1515719	99	40	30,6	cyclictest	0	-21	swapper/0	20:00:15	0
1515723	99	30	20,7	cyclictest	0	-21	swapper/1	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17