OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Fri Nov 21, 2025 00:44:05)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1277963	99	125	117,6	cyclictest	1449396	-21	kworker/u4:5+events_unbound	00:23:18	0
1277963	99	124	114,7	cyclictest	1407761	-21	kworker/u4:4+events_unbound	23:32:22	0
1277963	99	121	114,5	cyclictest	1427076	-21	kworker/u4:3+events_unbound	23:58:15	0
1277963	99	115	106,6	cyclictest	1363093	-21	kworker/u4:7+events_unbound	22:27:58	0
1277963	99	106	98,6	cyclictest	1419228	-21	kworker/u4:12+events_unbound	23:38:13	0
1277963	99	106	91,13	cyclictest	1373700	-21	kworker/u4:11+events_unbound	22:53:01	0
1277963	99	105	98,5	cyclictest	1307760	-21	kworker/u4:6+events_unbound	21:12:04	0
1277963	99	104	98,5	cyclictest	1279193	-21	kworker/u4:10+events_unbound	19:17:25	0
1277963	99	100	84,6	cyclictest	1427077	-21	kworker/u4:4+events_unbound	00:03:17	0
1277963	99	99	91,6	cyclictest	1427076	-21	kworker/u4:3+events_unbound	23:48:15	0
1277963	99	98	90,6	cyclictest	1277888	-21	kworker/u4:0+events_unbound	19:26:47	0
1277963	99	98	64,25	cyclictest	53	-21	kswapd0	22:25:09	0
1277963	99	97	88,7	cyclictest	1431128	-21	kworker/u4:1+events_unbound	23:52:26	0
1277963	99	96	89,5	cyclictest	1348267	-21	kworker/u4:9+events_unbound	22:02:53	0
1277963	99	95	87,6	cyclictest	1286957	-21	kworker/u4:13+events_unbound	20:26:52	0
1277963	99	95	83,6	cyclictest	1302604	-21	kworker/u4:13+events_unbound	20:47:39	0
1277963	99	94	86,6	cyclictest	1348265	-21	kworker/u4:7+events_unbound	22:12:56	0
1277963	99	94	86,6	cyclictest	1289521	-21	kworker/u4:16+events_unbound	20:21:53	0
1277963	99	89	82,5	cyclictest	1326670	-21	kworker/u4:3+events_unbound	21:42:48	0
1277963	99	89	81,6	cyclictest	1301287	-21	kworker/u4:11+events_unbound	20:36:54	0
1277963	99	89	72,5	cyclictest	1283081	-21	kworker/u4:9+events_unbound	19:41:48	0
1277963	99	89	72,5	cyclictest	1283081	-21	kworker/u4:9+events_unbound	19:41:48	0
1277963	99	88	80,6	cyclictest	1326672	-21	kworker/u4:5+events_unbound	21:52:49	0
1277963	99	87	79,6	cyclictest	1315468	-21	kworker/u4:13+events_unbound	21:27:45	0
1277963	99	86	79,6	cyclictest	1268020	-21	kworker/u4:3+events_unbound	20:02:33	0
1277963	99	86	75,9	cyclictest	1309045	-21	kworker/u4:9+events_unbound	21:32:05	0
1277963	99	85	76,6	cyclictest	1315468	-21	kworker/u4:13+events_unbound	21:17:05	0
1277965	99	84	79,3	cyclictest	1351983	-21	kworker/u4:0+events_unbound	22:17:15	1
1277963	99	84	76,6	cyclictest	1456461	-21	kworker/u4:0+events_unbound	00:38:21	0
1277965	99	83	78,3	cyclictest	1283081	-21	kworker/u4:9+events_unbound	19:31:45	1
1277965	99	83	75,6	cyclictest	1351985	-21	kworker/u4:2+events_unbound	22:27:17	1
1277963	99	82	75,5	cyclictest	1407761	-21	kworker/u4:4+events_unbound	23:23:08	0
1277965	99	80	71,7	cyclictest	1431131	-21	kworker/u4:6+events_unbound	23:57:27	1
1277963	99	80	73,5	cyclictest	1415365	-21	kworker/u4:7+events_unbound	23:42:24	0
1277963	99	78	71,5	cyclictest	1264171	-21	kworker/u4:4+events_unbound	19:11:44	0
1277963	99	77	70,5	cyclictest	1268020	-21	kworker/u4:3+events_unbound	19:37:27	0
1277963	99	76	69,5	cyclictest	1348264	-21	kworker/u4:5+events_unbound	22:17:56	0
1277963	99	76	62,6	cyclictest	1396626	-21	kworker/u4:0+events_unbound	23:17:20	0
1277963	99	76	62,5	cyclictest	1438526	-21	kworker/u4:14+events_unbound	00:07:28	0
1277963	99	75	68,5	cyclictest	1373700	-21	kworker/u4:11+events_unbound	22:38:00	0
1277963	99	75	67,6	cyclictest	1377471	-21	kworker/u4:1+events_unbound	23:12:20	0
1277963	99	74	64,7	cyclictest	1392841	-21	kworker/u4:14+events_unbound	23:10:01	0
1277963	99	73	64,7	cyclictest	1438526	-21	kworker/u4:14+events_unbound	00:13:16	0
1277965	99	72	64,6	cyclictest	1315468	-21	kworker/u4:13+events_unbound	21:17:44	1
1277963	99	72	66,5	cyclictest	1269327	-21	kworker/u4:7+events_unbound	20:31:53	0
1277963	99	72	61,7	cyclictest	1344531	-21	kworker/u4:12+events_unbound	22:07:12	0
1277965	99	70	27,38	cyclictest	0	-21	swapper/1	23:15:26	1
1277965	99	70	10,47	cyclictest	1454564	-21	ssh	00:25:15	1
1277965	99	68	64,3	cyclictest	1351985	-21	kworker/u4:2+events_unbound	22:07:14	1
1277965	99	68	63,3	cyclictest	1431129	-21	kworker/u4:2+events_unbound	00:02:28	1
1277965	99	68	35,4	cyclictest	1285872	-21	apt-get	19:40:12	1
1277965	99	68	35,4	cyclictest	1285872	-21	apt-get	19:40:12	1
1277965	99	68	26,16	cyclictest	1408628	-21	ssh	23:23:23	1
1277965	99	68	26,16	cyclictest	1328184	-21	ssh	21:35:12	1
1277965	99	67	27,15	cyclictest	1450625	-21	ssh	00:19:32	1
1277965	99	67	26,15	cyclictest	1317291	-21	ssh	21:20:11	1
1277965	99	66	56,6	cyclictest	1300006	-21	kworker/u4:4+events_unbound	20:40:02	1
1277965	99	66	29,12	cyclictest	1425622	-21	ntpq	23:45:27	1
1277965	99	66	28,13	cyclictest	1369121	-21	ntpq	22:30:35	1
1277965	99	66	27,15	cyclictest	1445566	-21	ssh	00:11:05	1
1277965	99	66	27,14	cyclictest	1396656	-21	ssh	23:07:23	1
1277965	99	66	27,14	cyclictest	1378302	-21	ssh	22:43:21	1
1277965	99	66	27,11	cyclictest	1430458	-21	ssh	23:51:03	1
1277965	99	66	26,16	cyclictest	1312439	-21	ssh	21:13:50	1
1277965	99	66	25,15	cyclictest	1342697	-21	ssh	21:55:11	1
1277963	99	66	60,4	cyclictest	1306457	-21	kworker/u4:3+events_unbound	21:00:01	0
1277963	99	66	56,7	cyclictest	1319310	-21	kworker/u4:5+events_unbound	21:22:43	0
1277965	99	65	27,15	cyclictest	1393190	-21	ssh	23:02:52	1
1277965	99	65	27,14	cyclictest	1442334	-21	ssh	00:06:52	1
1277965	99	65	26,14	cyclictest	1388680	-21	ssh	22:56:28	1
1277965	99	65	25,14	cyclictest	1322498	-21	ssh	21:26:11	1
1277965	99	65	24,15	cyclictest	1460049	-21	ssh	00:31:55	1
1277963	99	65	58,5	cyclictest	1286957	-21	kworker/u4:13+events_unbound	20:12:34	0
1277965	99	64	29,14	cyclictest	1382828	-21	ssh	22:49:54	1
1277965	99	64	29,11	cyclictest	1386374	-21	ssh	22:54:24	1
1277965	99	64	26,12	cyclictest	1420381	-21	ssh	23:39:12	1
1277965	99	64	25,15	cyclictest	1363483	-21	ssh	22:23:11	1
1277965	99	64	25,14	cyclictest	1341266	-21	ssh	21:52:28	1
1277965	99	64	25,14	cyclictest	1337444	-21	ssh	21:47:05	1
1277965	99	64	24,15	cyclictest	1464488	-21	ssh	00:38:49	1
1277963	99	64	56,6	cyclictest	1301287	-21	kworker/u4:11+events_unbound	20:41:53	0
1277965	99	63	25,15	cyclictest	1401151	-21	ssh	23:13:38	1
1277965	99	63	24,16	cyclictest	1412426	-21	ssh	23:28:27	1
1277963	99	63	57,5	cyclictest	1411555	-21	kworker/u4:13+events_unbound	23:30:01	0
1277965	99	62	25,14	cyclictest	1356984	-21	ssh	22:14:49	1
1277965	99	62	24,13	cyclictest	1423213	-21	ssh	23:42:17	1
1277965	99	62	24,13	cyclictest	1331840	-21	ssh	21:40:10	1
1277963	99	62	54,6	cyclictest	1289521	-21	kworker/u4:16+events_unbound	19:57:31	0
1277963	99	62	51,5	cyclictest	1289521	-21	kworker/u4:16+events_unbound	19:55:02	0
1277965	99	61	41,15	cyclictest	1413508	-21	apt-get	23:30:12	1
1277965	99	61	30,10	cyclictest	1374617	-21	ssh	22:38:34	1
1277965	99	61	26,14	cyclictest	1451095	-21	ssh	00:20:09	1
1277965	99	61	24,12	cyclictest	1349043	-21	ssh	22:03:32	1
1277963	99	61	54,5	cyclictest	1363091	-21	kworker/u4:0+events_unbound	22:35:00	0
1277965	99	60	42,14	cyclictest	1284565	-21	apt-get	19:35:13	1
1277965	99	60	24,11	cyclictest	1304669	-21	ntpq	20:50:28	1
1277965	99	60	23,14	cyclictest	1326424	-21	ssh	21:31:52	1
1277965	99	59	43,12	cyclictest	1281998	-21	apt-get	19:25:12	1
1277965	99	59	22,13	cyclictest	1281367	-21	ntp_states	19:20:31	1
1277963	99	59	51,6	cyclictest	1280476	-21	kworker/u4:12+events_unbound	19:21:45	0
1277965	99	58	41,12	cyclictest	1302147	-21	ntpq	20:40:35	1
1277965	99	58	25,11	cyclictest	1278659	-21	ntpq	19:10:25	1
1277965	99	58	23,10	cyclictest	1295539	-21	ntpq	20:15:28	1
1277965	99	58	23,10	cyclictest	1287823	-21	ntpq	19:45:36	1
1277965	99	57	24,7	cyclictest	1291696	-21	ntpq	20:00:32	1
1277965	99	57	21,13	cyclictest	1290384	-21	ld	19:55:34	1
1277963	99	57	49,6	cyclictest	1269327	-21	kworker/u4:7+events_unbound	20:06:50	0
1277965	99	56	22,10	cyclictest	1279962	-21	ntpq	19:15:26	1
1277965	99	56	21,10	cyclictest	1292869	-21	irqstats	20:05:21	1
1277963	99	56	32,9	cyclictest	1330319	-21	kworker/u4:12+events_unbound	21:45:36	0
1277965	99	55	37,13	cyclictest	1297648	-21	apt-get	20:25:13	1
1277965	99	55	21,11	cyclictest	1299472	-21	ntpq	20:30:31	1
1277965	99	55	20,10	cyclictest	1308513	-21	ntpq	21:05:24	1
1277965	99	55	19,12	cyclictest	1294774	-21	sshd	20:14:53	1
1277963	99	55	49,4	cyclictest	1286953	-21	kworker/u4:5+events_unbound	20:16:52	0
1277965	99	54	21,9	cyclictest	1289095	-21	ntp_states	19:50:35	1
1277963	99	54	40,4	cyclictest	1344531	-21	kworker/u4:12+events_unbound	21:59:36	0
1277965	99	53	41,7	cyclictest	1296966	-21	ntpq	20:20:34	1
1277965	99	52	40,9	cyclictest	1305928	-21	ntpq	20:55:31	1
1277963	99	52	45,5	cyclictest	1377472	-21	kworker/u4:2+events_unbound	22:45:04	0
1277963	99	52	40,6	cyclictest	1377471	-21	kworker/u4:1+events_unbound	23:00:01	0
1277963	99	51	44,5	cyclictest	1375930	-21	/usr/sbin/munin	22:40:20	0
1277963	99	51	43,5	cyclictest	1306456	-21	kworker/u4:1+events_unbound	21:07:02	0
1277965	99	50	36,10	cyclictest	1303414	-21	ntpq	20:45:32	1
1277965	99	50	34,13	cyclictest	1307299	-21	/usr/sbin/munin	21:00:30	1
1277963	99	48	41,5	cyclictest	1268020	-21	kworker/u4:3+events_unbound	19:33:38	0
1277963	99	48	30,6	cyclictest	1449393	-21	kworker/u4:1+events_unbound	00:25:54	0
1277963	99	47	40,5	cyclictest	1448646	-21	switchtime	00:15:40	0
1277963	99	47	39,5	cyclictest	1307386	-21	grep	21:00:36	0
1277963	99	45	36,7	cyclictest	1328664	-21	gltestperf	21:35:22	0
1277963	99	44	31,11	cyclictest	1458791	-21	if_eth0	00:30:27	0
1277965	99	43	28,12	cyclictest	1278026	-21	latency_hist	19:10:01	1
1277963	99	43	37,4	cyclictest	1287453	-21	fschecks_time	19:45:20	0
1277963	99	42	36,4	cyclictest	1387200	-21	aten_r7power_vo	22:55:22	0
1277963	99	40	33,5	cyclictest	1305225	-21	basename	20:55:00	0
1277963	99	30	10,13	cyclictest	1277962	-21	cyclictest	19:10:00	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17