OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Thu Sep 03, 2026 00:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1361108	99	118	98,7	cyclictest	1444178	-21	kworker/u4:10+events_unbound	22:11:24	0
1361108	99	106	87,6	cyclictest	1371375	-21	kworker/u4:16+events_unbound	21:11:12	0
1361108	99	104	95,6	cyclictest	1511321	-21	kworker/u4:14+events_unbound	23:36:39	0
1361108	99	100	92,6	cyclictest	1479618	-21	kworker/u4:10+events_unbound	22:51:31	0
1361108	99	98	90,6	cyclictest	1367543	-21	kworker/u4:10+events_unbound	20:05:59	0
1361108	99	97	88,7	cyclictest	1394318	-21	kworker/u4:17+events_unbound	21:21:14	0
1361108	99	96	84,5	cyclictest	1372737	-21	kworker/u4:19+events_unbound	20:51:06	0
1361108	99	84	79,4	cyclictest	1371379	-21	kworker/u4:17+events_unbound	19:55:58	0
1361108	99	83	76,5	cyclictest	1479620	-21	kworker/u4:12+events_unbound	22:56:32	0
1361108	99	83	76,5	cyclictest	1365003	-21	kworker/u4:6+events_unbound	19:35:56	0
1361108	99	83	75,6	cyclictest	1555236	-21	kworker/u4:18+events_unbound	00:18:32	0
1361108	99	80	72,6	cyclictest	1519736	-21	kworker/u4:4+events_unbound	23:41:40	0
1361108	99	78	70,6	cyclictest	1493201	-21	kworker/u4:4+events_unbound	23:21:37	0
1361108	99	77	70,5	cyclictest	1524274	-21	kworker/u4:6+events_unbound	23:46:59	0
1361108	99	75	68,5	cyclictest	1370108	-21	kworker/u4:14+events_unbound	20:11:00	0
1361108	99	75	68,5	cyclictest	1366272	-21	kworker/u4:9+events_unbound	20:25:59	0
1361108	99	74	67,5	cyclictest	1453220	-21	kworker/u4:1+events_unbound	22:36:27	0
1361108	99	73	65,6	cyclictest	1348437	-21	kworker/u4:1+events_unbound	19:15:53	0
1361108	99	72	66,5	cyclictest	1493201	-21	kworker/u4:4+events_unbound	23:06:34	0
1361108	99	71	63,6	cyclictest	1511321	-21	kworker/u4:14+events_unbound	23:26:38	0
1361108	99	71	61,8	cyclictest	1571380	-21	df_abs	00:30:17	0
1361108	99	70	62,6	cyclictest	1484137	-21	kworker/u4:15+events_unbound	23:01:32	0
1361108	99	70	45,4	cyclictest	1412717	-21	kworker/u4:3+events_unbound	21:42:16	0
1361108	99	69	63,4	cyclictest	1453224	-21	kworker/u4:6+events_unbound	22:30:02	0
1361109	99	65	27,12	cyclictest	1446533	-21	apt-get	22:10:20	1
1361108	99	65	57,6	cyclictest	1564383	-21	kworker/u4:1+events_unbound	00:28:40	0
1361108	99	65	54,5	cyclictest	1403511	-21	kworker/u4:1+events_unbound	21:26:16	0
1361108	99	61	54,5	cyclictest	1564383	-21	kworker/u4:1+events_unbound	00:23:37	0
1361108	99	61	54,5	cyclictest	1370107	-21	kworker/u4:13+events_unbound	19:50:58	0
1361109	99	60	50,6	cyclictest	0	-21	swapper/1	23:55:14	1
1361108	99	60	53,5	cyclictest	1367543	-21	kworker/u4:10+events_unbound	20:15:59	0
1361108	99	60	53,5	cyclictest	1367543	-21	kworker/u4:10+events_unbound	20:00:59	0
1361109	99	59	54,3	cyclictest	1370108	-21	kworker/u4:14+events_unbound	21:01:07	1
1361108	99	59	53,4	cyclictest	1358605	-21	kworker/u4:4+events_unbound	19:45:57	0
1361108	99	58	50,6	cyclictest	1358605	-21	kworker/u4:4+events_unbound	19:13:46	0
1361108	99	58	3,45	cyclictest	1554002	-21	ssh	00:10:28	0
1361109	99	57	49,6	cyclictest	1370108	-21	kworker/u4:14+events_unbound	20:21:00	1
1361109	99	57	41,13	cyclictest	1511321	-21	kworker/u4:14+events_unbound	23:35:36	1
1361109	99	57	21,13	cyclictest	1424832	-21	ssh	21:45:32	1
1361109	99	57	21,12	cyclictest	1459807	-21	ssh	22:25:10	1
1361109	99	57	16,14	cyclictest	1577065	-21	ssh	00:36:00	1
1361108	99	57	50,5	cyclictest	1417327	-21	kworker/u4:2+events_unbound	21:40:00	0
1361108	99	57	30,21	cyclictest	1442105	-21	acpi	22:05:14	0
1361109	99	56	47,5	cyclictest	0	-21	swapper/1	21:15:23	1
1361109	99	56	17,12	cyclictest	1417019	-21	ssh	21:36:46	1
1361109	99	56	17,11	cyclictest	1445290	-21	ssh	22:08:37	1
1361108	99	56	43,11	cyclictest	1451238	-21	fschecks_count	22:15:18	0
1361109	99	55	20,13	cyclictest	0	-21	swapper/1	21:20:20	1
1361109	99	54	8,37	cyclictest	1544403	-21	apt-get	00:00:15	1
1361109	99	54	47,5	cyclictest	1549877	-21	ssh	00:05:45	1
1361109	99	54	44,7	cyclictest	1391607	-21	ps	21:05:40	1
1361109	99	54	44,7	cyclictest	1391607	-21	ps	21:05:40	1
1361109	99	54	16,12	cyclictest	1487278	-21	ntpq	22:55:32	1
1361109	99	54	15,14	cyclictest	1570784	-21	ssh	00:29:58	1
1361109	99	54	15,13	cyclictest	1471415	-21	ssh	22:37:49	1
1361109	99	53	7,39	cyclictest	1562248	-21	sh	00:20:12	1
1361109	99	53	46,5	cyclictest	1456601	-21	/usr/sbin/munin	22:20:38	1
1361109	99	53	46,5	cyclictest	1363636	-21	modprobe	19:20:00	1
1361109	99	53	19,12	cyclictest	0	-21	swapper/1	23:10:30	1
1361109	99	53	18,14	cyclictest	1556042	-21	ssh	00:12:54	1
1361109	99	53	17,12	cyclictest	1484486	-21	ssh	22:52:24	1
1361109	99	53	16,11	cyclictest	1559424	-21	ssh	00:16:12	1
1361109	99	53	15,13	cyclictest	1515830	-21	ssh	23:27:36	1
1361109	99	53	15,13	cyclictest	1464333	-21	apt-get	22:30:18	1
1361108	99	53	46,5	cyclictest	1542320	-21	kworker/u4:0+events_unbound	00:03:18	0
1361108	99	53	46,5	cyclictest	1431128	-21	kworker/u4:15+events_unbound	22:00:01	0
1361108	99	53	43,7	cyclictest	0	-21	swapper/0	23:59:57	0
1361108	99	53	40,6	cyclictest	1466101	-21	kworker/u4:7+events_unbound	22:32:45	0
1361109	99	52	46,4	cyclictest	1538417	-21	systemd	23:53:08	1
1361109	99	52	40,9	cyclictest	1375074	-21	timerandwakeup	20:00:39	1
1361109	99	52	19,10	cyclictest	1508053	-21	ssh	23:19:25	1
1361109	99	52	19,10	cyclictest	1508053	-21	ssh	23:19:25	1
1361109	99	52	17,7	cyclictest	1370959	-21	ntpq	19:45:36	1
1361109	99	52	15,13	cyclictest	1572927	-21	ssh	00:31:24	1
1361109	99	52	14,15	cyclictest	1494372	-21	ssh	23:03:56	1
1361109	99	52	14,15	cyclictest	1409030	-21	ssh	21:28:22	1
1361109	99	52	14,14	cyclictest	1392281	-21	ssh	21:10:09	1
1361109	99	52	14,11	cyclictest	1532448	-21	ssh	23:45:44	1
1361109	99	52	14,11	cyclictest	1439195	-21	ssh	22:01:06	1
1361108	99	52	45,6	cyclictest	1435710	-21	kworker/u4:3+events_unbound	22:45:02	0
1361108	99	52	45,5	cyclictest	1380415	-21	kworker/u4:7+events_unbound	20:41:06	0
1361108	99	52	43,7	cyclictest	1528833	-21	kworker/u4:8+events_unbound	23:50:38	0
1361108	99	52	38,8	cyclictest	0	-21	swapper/0	19:30:42	0
1361109	99	51	39,9	cyclictest	1376570	-21	kworker/u4:1-rpciod	20:19:59	1
1361109	99	51	19,11	cyclictest	1480784	-21	ssh	22:48:34	1
1361109	99	51	16,12	cyclictest	0	-21	swapper/1	21:30:40	1
1361109	99	51	15,10	cyclictest	1434946	-21	ssh	21:56:30	1
1361109	99	51	14,14	cyclictest	1421940	-21	ssh	21:42:19	1
1361109	99	51	14,13	cyclictest	1476082	-21	ssh	22:43:08	1
1361109	99	51	14,13	cyclictest	1476082	-21	ssh	22:43:07	1
1361109	99	51	13,14	cyclictest	1452718	-21	ssh	22:16:22	1
1361109	99	51	13,11	cyclictest	1431684	-21	ssh	21:53:26	1
1361108	99	51	44,5	cyclictest	1391303	-21	gltestperf	21:05:24	0
1361108	99	51	44,5	cyclictest	1391303	-21	gltestperf	21:05:23	0
1361108	99	51	44,5	cyclictest	1363917	-21	/usr/sbin/munin	19:20:12	0
1361108	99	51	32,16	cyclictest	1397394	-21	tail	21:15:24	0
1361109	99	50	15,10	cyclictest	1381147	-21	ntpq	20:25:22	1
1361108	99	50	42,6	cyclictest	1412719	-21	kworker/u4:8+events_unbound	22:00:35	0
1361108	99	50	30,18	cyclictest	0	-21	swapper/0	22:20:35	0
1361109	99	49	14,11	cyclictest	1510263	-21	ssh	23:20:53	1
1361109	99	49	12,11	cyclictest	1372297	-21	ntp_states	19:50:35	1
1361109	99	49	10,15	cyclictest	1497014	-21	ssh	23:06:08	1
1361108	99	49	42,5	cyclictest	1550027	-21	/usr/sbin/munin	00:05:46	0
1361108	99	49	42,5	cyclictest	1361106	-21	cyclictest	21:51:44	0
1361108	99	49	37,10	cyclictest	1518008	-21	fschecks_count	23:30:20	0
1361109	99	48	11,10	cyclictest	1519038	-21	users	23:30:41	1
1361108	99	48	38,6	cyclictest	1412717	-21	kworker/u4:3-rpciod	21:45:39	0
1361108	99	48	28,17	cyclictest	0	-21	swapper/0	21:30:39	0
1361109	99	47	37,6	cyclictest	0	-21	swapper/1	19:55:29	1
1361109	99	47	11,14	cyclictest	1529313	-21	ssh	23:42:44	1
1361108	99	47	40,5	cyclictest	1371375	-21	kworker/u4:16+events_unbound	20:36:04	0
1361108	99	47	38,7	cyclictest	1493203	-21	kworker/u4:6+events_unbound	23:16:34	0
1361108	99	47	38,7	cyclictest	1493203	-21	kworker/u4:6+events_unbound	23:16:34	0
1361108	99	46	39,5	cyclictest	1501143	-21	unixbench_multi	23:10:45	0
1361109	99	45	37,6	cyclictest	1368837	-21	cron	19:40:00	1
1361109	99	45	37,6	cyclictest	1073	-21	snmpd	19:20:36	1
1361109	99	45	10,13	cyclictest	1369671	-21	ntpq	19:40:40	1
1361109	99	44	8,12	cyclictest	1366649	-21	awk	19:30:16	1
1361109	99	44	37,5	cyclictest	1388986	-21	sendmail_mailqu	20:55:34	1
1361109	99	44	37,5	cyclictest	1361553	-21	fschecks_time	19:10:21	1
1361109	99	44	29,11	cyclictest	1386322	-21	ntpq	20:45:29	1
1361109	99	44	10,24	cyclictest	1376084	-21	sshd	20:05:31	1
1361108	99	44	37,5	cyclictest	1389366	-21	sendmail	20:59:59	0
1361108	99	44	37,5	cyclictest	1386379	-21	sshd	20:45:34	0
1361108	99	44	34,7	cyclictest	1382140	-21	fschecks_count	20:30:18	0
1361109	99	43	29,5	cyclictest	0	-21	swapper/1	20:40:38	1
1361109	99	43	10,10	cyclictest	1382466	-21	ntpq	20:30:26	1
1361109	99	42	7,12	cyclictest	1365895	-21	ps	19:25:36	1
1361109	99	41	32,6	cyclictest	1384083	-21	unixbench-2d	20:35:38	1
1361109	99	41	12,8	cyclictest	1387558	-21	ntpq	20:50:27	1
1361108	99	41	33,6	cyclictest	1474332	-21	timerwakeupswit	22:40:40	0
1361108	99	41	33,6	cyclictest	1474332	-21	timerwakeupswit	22:40:40	0
1361108	99	41	32,7	cyclictest	1389869	-21	fschecks_time	21:00:20	0
1361108	99	40	32,6	cyclictest	1369946	-21	timerwakeupswit	19:40:45	0
1361109	99	39	10,15	cyclictest	0	-21	swapper/1	20:10:23	1
1361108	99	39	33,4	cyclictest	0	-21	swapper/0	20:20:27	0
1361108	99	39	33,4	cyclictest	0	-21	swapper/0	19:25:19	0
1361108	99	39	30,7	cyclictest	1575521	-21	acpi	00:35:13	0
1361108	99	37	27,6	cyclictest	0	-21	swapper/0	19:10:02	0
1361109	99	30	14,13	cyclictest	1361138	-21	latency_hist	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17