OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Wed Jul 15, 2026 00:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1350082	99	90	83,5	cyclictest	1527135	-21	kworker/u4:8+events_unbound	23:56:54	1
1350082	99	90	83,5	cyclictest	1527135	-21	kworker/u4:8+events_unbound	23:56:54	1
1350082	99	89	81,6	cyclictest	1356478	-21	kworker/u4:18+events_unbound	20:31:00	1
1350080	99	83	44,7	cyclictest	1388374	-21	systemd	21:16:11	0
1350082	99	82	75,5	cyclictest	1514344	-21	kworker/u4:4+events_unbound	23:51:53	1
1350082	99	82	66,6	cyclictest	1540485	-21	kworker/u4:1+events_unbound	00:21:58	1
1350080	99	82	44,5	cyclictest	1445837	-21	/usr/sbin/munin	22:20:24	0
1350080	99	82	4,33	cyclictest	1477427	-21	ssh	22:55:40	0
1350080	99	80	44,4	cyclictest	1405363	-21	/usr/sbin/munin	21:35:25	0
1350082	99	79	73,4	cyclictest	1347577	-21	kworker/u4:4+events_unbound	19:10:42	1
1350080	99	78	42,6	cyclictest	1437562	-21	ssh	22:10:43	0
1350080	99	75	47,18	cyclictest	0	-21	swapper/0	19:31:52	0
1350082	99	74	65,7	cyclictest	1370178	-21	kworker/u4:5+events_unbound	21:21:12	1
1350080	99	73	65,6	cyclictest	1512120	-21	tune2fs	23:35:20	0
1350082	99	70	53,7	cyclictest	1356481	-21	kworker/u4:21+events_unbound	19:50:01	1
1350082	99	69	60,5	cyclictest	0	-21	swapper/1	19:31:04	1
1350082	99	67	60,5	cyclictest	1338952	-21	kworker/u4:8-rpciod	19:27:07	1
1350082	99	66	59,5	cyclictest	1447357	-21	kworker/u4:3+events_unbound	23:25:01	1
1350080	99	66	58,6	cyclictest	1406944	-21	kworker/u4:15+events_unbound	22:26:36	0
1350080	99	64	57,5	cyclictest	1397804	-21	kworker/u4:12+events_unbound	21:31:14	0
1350080	99	64	56,6	cyclictest	1375462	-21	kworker/u4:2+events_unbound	20:56:05	0
1350080	99	64	49,7	cyclictest	256	50	irq/23-42890000.ethernet	19:26:54	0
1350080	99	64	39,5	cyclictest	1447357	-21	kworker/u4:3+events_unbound	23:21:43	0
1350082	99	63	54,6	cyclictest	1487436	-21	kworker/u4:12+events_unbound	23:16:42	1
1350082	99	61	53,6	cyclictest	1447357	-21	kworker/u4:3+events_unbound	23:35:01	1
1350082	99	61	51,8	cyclictest	53	-21	kswapd0	22:40:07	1
1350080	99	60	53,4	cyclictest	0	-21	swapper/0	23:55:30	0
1350080	99	60	53,4	cyclictest	0	-21	swapper/0	23:55:30	0
1350082	99	59	51,6	cyclictest	1547934	-21	/usr/sbin/munin	00:15:45	1
1350082	99	59	51,6	cyclictest	1516510	-21	tune2fs	23:40:18	1
1350082	99	59	51,6	cyclictest	1487437	-21	kworker/u4:13+events_unbound	23:11:41	1
1350082	99	58	46,8	cyclictest	1428175	-21	ps	22:00:37	1
1350082	99	57	50,5	cyclictest	1351307	-21	kworker/u4:10+events_unbound	19:25:01	1
1350082	99	57	44,8	cyclictest	0	-21	swapper/1	21:30:41	1
1350082	99	57	38,10	cyclictest	1454848	-21	ssh	22:30:24	1
1350082	99	56	49,5	cyclictest	1402368	-21	kworker/u4:14+events_unbound	21:35:03	1
1350082	99	56	48,5	cyclictest	1375462	-21	kworker/u4:2+events_unbound	20:45:01	1
1350082	99	55	43,9	cyclictest	1556697	-21	ps	00:25:37	1
1350082	99	55	41,10	cyclictest	0	-21	swapper/1	00:30:14	1
1350082	99	55	38,9	cyclictest	0	-21	swapper/1	21:50:12	1
1350080	99	55	48,5	cyclictest	1456515	-21	kworker/u4:12+events_unbound	22:45:08	0
1350082	99	54	47,5	cyclictest	1438251	-21	kworker/u4:2+events_unbound	22:16:34	1
1350080	99	54	46,6	cyclictest	1540485	-21	kworker/u4:1+events_unbound	00:16:59	0
1350080	99	54	46,5	cyclictest	1526022	-21	mailstats	23:50:39	0
1350080	99	54	45,6	cyclictest	1564254	-21	ssh	00:35:00	0
1350082	99	53	46,5	cyclictest	1363756	-21	systemd	19:55:53	1
1350082	99	53	45,6	cyclictest	1396386	-21	/usr/sbin/munin	21:25:24	1
1350080	99	53	29,7	cyclictest	0	-21	swapper/0	20:40:00	0
1350082	99	52	44,6	cyclictest	1449818	-21	/usr/sbin/munin	22:25:16	1
1350082	99	52	43,7	cyclictest	1381825	-21	systemd	21:06:07	1
1350082	99	52	41,7	cyclictest	1365075	-21	modprobe	20:05:00	1
1350080	99	52	47,3	cyclictest	1376732	-21	kworker/u4:4+events_unbound	21:01:07	0
1350080	99	52	47,3	cyclictest	1376732	-21	kworker/u4:4+events_unbound	21:01:07	0
1350080	99	52	44,6	cyclictest	1350014	-21	kworker/u4:7+events_unbound	20:25:58	0
1350082	99	51	44,5	cyclictest	1505370	-21	kworker/u4:9+events_unbound	00:10:03	1
1350082	99	51	42,6	cyclictest	1535235	-21	diskmemload	00:00:55	1
1350082	99	51	32,13	cyclictest	0	-21	swapper/1	20:50:21	1
1350080	99	51	43,6	cyclictest	1551661	-21	sort	00:20:19	0
1350080	99	51	42,6	cyclictest	1352591	-21	kworker/u4:12+events_unbound	19:20:45	0
1350080	99	51	19,26	cyclictest	53	-21	kswapd0	22:40:08	0
1350082	99	50	43,5	cyclictest	1538290	-21	aten_r7power_vo	00:05:18	1
1350082	99	50	38,7	cyclictest	1413831	-21	aten_r7power_cu	21:45:16	1
1350082	99	50	36,8	cyclictest	1485981	-21	sh	23:05:26	1
1350082	99	50	35,10	cyclictest	1432735	-21	find	22:05:42	1
1350080	99	50	5,32	cyclictest	1565253	-21	ssh	00:35:26	0
1350080	99	50	5,32	cyclictest	1565253	-21	ssh	00:35:26	0
1350080	99	50	42,6	cyclictest	1337679	-21	kworker/u4:0+events_unbound	20:05:56	0
1350080	99	50	3,39	cyclictest	1520613	-21	ssh	23:45:16	0
1350080	99	50	31,15	cyclictest	1396730	-21	diskmemload	21:25:41	0
1350082	99	49	39,7	cyclictest	1374068	-21	systemd	20:36:00	1
1350082	99	49	30,15	cyclictest	0	-21	swapper/1	19:40:11	1
1350080	99	49	4,41	cyclictest	0	-21	swapper/0	23:25:15	0
1350080	99	49	43,4	cyclictest	1441053	-21	fschecks_time	22:15:21	0
1350080	99	49	40,7	cyclictest	1447357	-21	kworker/u4:3+events_unbound	22:36:35	0
1350080	99	49	40,7	cyclictest	1447357	-21	kworker/u4:3+events_unbound	22:36:35	0
1350080	99	49	36,9	cyclictest	0	-21	swapper/0	23:00:39	0
1350080	99	49	29,18	cyclictest	1395422	-21	cron	21:25:00	0
1350080	99	49	29,17	cyclictest	0	-21	swapper/0	00:00:41	0
1350082	99	48	7,30	cyclictest	1445955	-21	ssh	22:20:29	1
1350082	99	48	39,6	cyclictest	1423187	-21	gltestperf	21:55:21	1
1350082	99	48	39,5	cyclictest	1369397	-21	fschecks_time	20:20:20	1
1350082	99	48	37,8	cyclictest	1365613	-21	gltestperf	20:05:19	1
1350082	99	48	32,10	cyclictest	0	-21	swapper/1	21:40:15	1
1350080	99	48	41,5	cyclictest	1542258	-21	latency_hist	00:10:01	0
1350080	99	48	40,6	cyclictest	317	-21	systemd-journal	00:26:59	0
1350080	99	48	40,6	cyclictest	1474653	-21	kworker/u4:2+events_unbound	23:06:40	0
1350080	99	48	40,5	cyclictest	0	-21	swapper/0	21:50:33	0
1350080	99	48	39,7	cyclictest	1410988	-21	sshd	21:41:17	0
1350082	99	47	41,4	cyclictest	1447357	-21	kworker/u4:3+events_unbound	22:55:02	1
1350082	99	47	40,5	cyclictest	1455836	-21	kworker/u4:9+events_unbound	22:37:47	1
1350082	99	47	40,5	cyclictest	1455836	-21	kworker/u4:9+events_unbound	22:37:46	1
1350082	99	47	37,7	cyclictest	1467723	-21	aten_r7power_cu	22:45:16	1
1350082	99	47	10,21	cyclictest	1371563	-21	modprobe	20:30:01	1
1350080	99	47	38,6	cyclictest	1368058	-21	fschecks_count	20:15:20	0
1350082	99	46	6,29	cyclictest	1512641	-21	ntp_states	23:35:36	1
1350082	99	46	38,5	cyclictest	1521071	-21	gltestperf	23:45:22	1
1350082	99	46	38,5	cyclictest	1499373	-21	cat	23:20:34	1
1350082	99	46	37,7	cyclictest	1356473	-21	kworker/u4:6+events_unbound	21:17:06	1
1350082	99	46	37,6	cyclictest	1367268	-21	sendmail_mailqu	20:10:37	1
1350080	99	46	39,5	cyclictest	1543860	-21	sed	00:10:44	0
1350080	99	46	39,5	cyclictest	1417948	-21	munin-plugin-st	21:50:01	0
1350080	99	46	39,5	cyclictest	0	-21	swapper/0	22:30:17	0
1350080	99	46	38,6	cyclictest	1366792	-21	fschecks_count	20:10:20	0
1350080	99	46	37,7	cyclictest	1490834	-21	timerandwakeup	23:10:40	0
1350080	99	46	37,7	cyclictest	1377325	-21	gltestperf	20:50:22	0
1350080	99	46	37,6	cyclictest	1370310	-21	latency_hist	20:25:01	0
1350082	99	45	38,5	cyclictest	1351763	-21	grep	19:15:19	1
1350082	99	45	37,5	cyclictest	1382147	-21	rm	21:10:11	1
1350082	99	45	35,8	cyclictest	1358746	-21	latency_hist	19:40:01	1
1350082	99	45	34,8	cyclictest	1436653	-21	gltestperf	22:10:22	1
1350080	99	45	37,5	cyclictest	1381870	-21	diskmemload	23:40:19	0
1350080	99	45	36,6	cyclictest	1507528	-21	aten_r7power_vo	23:30:18	0
1350080	99	45	34,8	cyclictest	1427580	-21	fschecks_count	22:00:19	0
1350082	99	44	36,5	cyclictest	1379318	-21	sendmail	21:00:01	1
1350082	99	44	35,7	cyclictest	317	-21	systemd-journal	00:35:44	1
1350082	99	44	35,7	cyclictest	317	-21	systemd-journal	00:35:44	1
1350082	99	44	34,6	cyclictest	1376602	-21	unixbench-2d	20:45:37	1
1350080	99	44	37,5	cyclictest	1374410	-21	wget	20:40:20	0
1350080	99	44	37,5	cyclictest	1350522	-21	fschecks_count	19:10:22	0
1350080	99	44	24,17	cyclictest	1371540	-21	kworker/u4:12+rpciod	21:10:25	0
1350082	99	43	36,5	cyclictest	1485140	-21	latency_hist	23:05:01	1
1350082	99	43	35,5	cyclictest	1474653	-21	kworker/u4:2-rpciod	22:55:27	1
1350080	99	43	36,5	cyclictest	1360397	-21	fschecks_count	19:45:20	0
1350080	99	43	36,5	cyclictest	1359968	-21	latency_hist	19:45:01	0
1350080	99	43	36,4	cyclictest	1498187	-21	cron	23:20:00	0
1350080	99	43	35,5	cyclictest	1473868	-21	sshd	22:51:23	0
1350080	99	43	33,7	cyclictest	1364349	-21	gltestperf	20:00:20	0
1350082	99	42	35,5	cyclictest	1361406	-21	aten2__	19:50:16	1
1350082	99	42	29,9	cyclictest	1371540	-21	kworker/u4:12-rpciod	21:00:30	1
1350082	99	42	29,9	cyclictest	1371540	-21	kworker/u4:12-rpciod	21:00:30	1
1350080	99	42	34,6	cyclictest	1432963	-21	unixbench-2d	22:05:44	0
1350080	99	42	3,33	cyclictest	1422706	-21	apt	21:55:12	0
1350082	99	41	33,5	cyclictest	0	-21	swapper/1	20:15:22	1
1350080	99	41	34,5	cyclictest	1357528	-21	find	19:35:11	0
1350080	99	41	32,7	cyclictest	1380822	-21	aten_r7power_en	21:05:15	0
1350080	99	41	32,6	cyclictest	1375462	-21	kworker/u4:2+events_unbound	20:46:04	0
1350080	99	41	31,7	cyclictest	1352569	-21	systemd	19:15:43	0
1350080	99	40	34,4	cyclictest	1372838	-21	apt	20:35:00	0
1350080	99	40	30,7	cyclictest	1363803	-21	munin-run	20:00:01	0
1350080	99	38	28,6	cyclictest	0	-21	swapper/0	19:50:38	0
1350080	99	37	13,15	cyclictest	531	-21	in:imuxsock	19:10:00	0
1350082	99	34	25,6	cyclictest	0	-21	swapper/1	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17