OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #e, slot #6

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackeslot6.osadl.org (updated Tue Apr 29, 2025 00:44:51)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1458508	99	119	111,6	cyclictest	1510373	-21	latency_hist	22:05:01	0
1458508	99	107	93,11	cyclictest	1517766	-21	apt-get	22:35:12	0
1458510	99	98	87,8	cyclictest	1520825	-21	gpgv	22:45:01	1
1458508	99	98	95,2	cyclictest	0	-21	swapper/0	00:22:59	0
1458510	99	94	83,9	cyclictest	1538388	-21	kworker/u8:2+events_unbound	00:00:01	1
1458508	99	91	85,4	cyclictest	1476250	-21	kworker/u8:0+events_unbound	20:20:28	0
1458508	99	91	84,4	cyclictest	1466383	-21	kworker/u8:2+flush-179:0	20:00:01	0
1458510	99	90	81,7	cyclictest	1455353	-21	kworker/u8:1+flush-179:0	19:55:27	1
1458508	99	87	78,7	cyclictest	1466383	-21	kworker/u8:2+flush-179:0	20:20:01	0
1458510	99	86	73,11	cyclictest	1507438	-21	apt-get	21:55:14	1
1458508	99	86	79,5	cyclictest	1544121	-21	kworker/u8:1+flush-179:0	00:35:26	0
1458510	99	85	73,9	cyclictest	1466383	-21	kworker/u8:2+events_unbound	20:00:03	1
1458510	99	84	74,7	cyclictest	1506493	-21	kworker/u8:2+events_unbound	22:05:03	1
1458508	99	84	77,5	cyclictest	1512519	-21	kworker/u8:1+flush-179:0	22:20:00	0
1458510	99	83	71,9	cyclictest	1534764	-21	kworker/u8:0+events_unbound	00:15:00	1
1458512	99	82	79,2	cyclictest	0	-21	swapper/2	00:22:59	2
1458508	99	82	76,5	cyclictest	1455353	-21	kworker/u8:1+flush-179:0	19:45:24	0
1458508	99	82	76,5	cyclictest	1455353	-21	kworker/u8:1+flush-179:0	19:45:23	0
1458510	99	81	71,7	cyclictest	3105085	-21	systemd-journal	20:35:00	1
1458508	99	81	74,5	cyclictest	1455353	-21	kworker/u8:1+flush-179:0	19:55:01	0
1458510	99	79	68,9	cyclictest	1502390	-21	/usr/sbin/munin	21:35:23	1
1458510	99	79	64,11	cyclictest	1515132	-21	kworker/u8:2+flush-179:0	22:25:01	1
1458508	99	78	72,4	cyclictest	1506493	-21	kworker/u8:2+flush-179:0	21:55:26	0
1458508	99	78	68,7	cyclictest	1538388	-21	kworker/u8:2+flush-179:0	00:10:15	0
1458508	99	77	70,6	cyclictest	1529485	-21	kworker/u8:1+flush-179:0	00:05:00	0
1458510	99	76	64,8	cyclictest	3105085	-21	systemd-journal	21:14:55	1
1458508	99	76	69,5	cyclictest	1534764	-21	kworker/u8:0+flush-179:0	00:30:00	0
1458508	99	76	69,5	cyclictest	1529485	-21	kworker/u8:1+flush-179:0	23:30:21	0
1458508	99	76	69,5	cyclictest	1529485	-21	kworker/u8:1+flush-179:0	23:30:21	0
1458510	99	75	64,8	cyclictest	1531573	-21	kworker/u8:3+flush-179:0	23:35:01	1
1458510	99	75	64,8	cyclictest	1531573	-21	kworker/u8:3+flush-179:0	23:35:00	1
1458510	99	75	61,11	cyclictest	1482815	-21	apt-get	20:25:15	1
1458508	99	75	68,5	cyclictest	1471164	-21	kworker/u8:3+flush-179:0	20:05:24	0
1458508	99	75	68,4	cyclictest	1506493	-21	kworker/u8:2+flush-179:0	22:05:03	0
1458510	99	74	63,8	cyclictest	1476250	-21	kworker/u8:0+flush-179:0	20:20:25	1
1458510	99	74	62,5	cyclictest	1512519	-21	kworker/u8:1+events_unbound	22:45:01	1
1458508	99	74	65,6	cyclictest	1529485	-21	kworker/u8:1+flush-179:0	23:50:16	0
1458508	99	74	64,8	cyclictest	1519371	-21	apt-get	22:40:13	0
1458508	99	73	66,5	cyclictest	1526023	-21	kworker/u8:0+flush-179:0	23:20:00	0
1458508	99	73	66,5	cyclictest	1495249	-21	kworker/u8:0+flush-179:0	21:25:01	0
1458508	99	72	65,5	cyclictest	1506493	-21	kworker/u8:2+flush-179:0	21:50:19	0
1458510	99	71	62,7	cyclictest	3105085	-21	systemd-journal	00:04:00	1
1458508	99	70	65,3	cyclictest	1462205	-21	kworker/u8:0+events_unbound	19:30:01	0
1458510	99	69	59,8	cyclictest	3105085	-21	systemd-journal	22:05:00	1
1458508	99	69	63,4	cyclictest	1544121	-21	kworker/u8:1+flush-179:0	00:30:18	0
1458508	99	69	62,5	cyclictest	1519078	-21	kworker/u8:2+flush-179:0	23:20:04	0
1458508	99	69	61,6	cyclictest	1455353	-21	kworker/u8:1+flush-179:0	19:15:26	0
1458508	99	68	57,8	cyclictest	1539754	-21	latency_hist	00:00:02	0
1458510	99	67	57,7	cyclictest	1519078	-21	kworker/u8:2+flush-179:0	22:50:16	1
1458508	99	67	61,4	cyclictest	1484179	-21	kworker/u8:3+flush-179:0	20:35:26	0
1458508	99	67	60,5	cyclictest	1455353	-21	kworker/u8:1+flush-179:0	19:20:27	0
1458510	99	66	55,9	cyclictest	1466606	-21	apt-get	19:35:12	1
1458508	99	66	61,3	cyclictest	1487570	-21	kworker/u8:1+flush-179:0	21:10:17	0
1458508	99	66	60,5	cyclictest	1512519	-21	kworker/u8:1+flush-179:0	22:30:00	0
1458508	99	66	60,4	cyclictest	1487570	-21	kworker/u8:1+flush-179:0	20:55:20	0
1458508	99	66	59,5	cyclictest	1487570	-21	kworker/u8:1+events_unbound	20:50:22	0
1458508	99	66	55,8	cyclictest	1455353	-21	kworker/u8:1+events_unbound	19:35:14	0
1458508	99	66	53,11	cyclictest	1497371	-21	apt-get	21:15:13	0
1458508	99	65	59,4	cyclictest	1500640	-21	kworker/u8:1+flush-179:0	21:40:24	0
1458510	99	64	55,7	cyclictest	1456930	-21	kworker/u8:2+flush-179:0	19:10:22	1
1458510	99	63	50,10	cyclictest	1524658	-21	apt-get	23:00:17	1
1458508	99	63	54,7	cyclictest	1541659	-21	latency_hist	00:10:00	0
1458510	99	62	57,4	cyclictest	1526023	-21	kworker/u8:0+flush-179:0	23:10:00	1
1458508	99	62	50,10	cyclictest	1533378	-21	apt-get	23:35:13	0
1458512	99	61	58,2	cyclictest	0	-21	swapper/2	22:40:59	2
1458508	99	61	53,5	cyclictest	1495249	-21	kworker/u8:0+flush-179:0	21:30:00	0
1458510	99	60	51,7	cyclictest	1526023	-21	kworker/u8:0+flush-179:0	23:10:16	1
1458510	99	60	44,14	cyclictest	1471358	-21	/usr/sbin/munin	19:50:18	1
1458508	99	60	52,6	cyclictest	1455353	-21	kworker/u8:1+events_unbound	20:00:16	0
1458508	99	60	50,7	cyclictest	1456930	-21	kworker/u8:2+events_unbound	19:10:19	0
1458510	99	59	51,6	cyclictest	1487570	-21	kworker/u8:1+flush-179:0	21:00:16	1
1458510	99	59	51,5	cyclictest	1500640	-21	kworker/u8:1+flush-179:0	21:50:21	1
1458510	99	58	50,6	cyclictest	1500640	-21	kworker/u8:1+flush-179:0	21:30:16	1
1458510	99	58	49,6	cyclictest	1529485	-21	kworker/u8:1+flush-179:0	23:50:17	1
1458508	99	58	51,5	cyclictest	1512519	-21	kworker/u8:1+events_unbound	22:45:04	0
1458508	99	58	51,5	cyclictest	1466383	-21	kworker/u8:2+events_unbound	20:30:20	0
1458508	99	58	50,6	cyclictest	1500640	-21	kworker/u8:1+events_unbound	21:40:01	0
1458508	99	58	1,55	cyclictest	1	-21	systemd	23:27:50	0
1458510	99	57	49,6	cyclictest	1466383	-21	kworker/u8:2+events_unbound	20:15:00	1
1458510	99	57	48,7	cyclictest	1534764	-21	kworker/u8:0+flush-179:0	00:15:24	1
1458508	99	57	54,2	cyclictest	0	-21	swapper/0	23:00:59	0
1458508	99	57	52,4	cyclictest	1515132	-21	kworker/u8:2+flush-179:0	22:20:23	0
1458510	99	56	47,7	cyclictest	3105085	-21	systemd-journal	22:58:50	1
1458510	99	56	46,7	cyclictest	1495249	-21	kworker/u8:0+flush-179:0	21:20:24	1
1458508	99	56	50,5	cyclictest	1512519	-21	kworker/u8:1+flush-179:0	22:30:20	0
1458508	99	56	46,8	cyclictest	1484179	-21	kworker/u8:3+flush-179:0	20:45:18	0
1458510	99	55	48,5	cyclictest	1462205	-21	kworker/u8:0+flush-179:0	19:30:00	1
1458510	99	55	46,6	cyclictest	1511146	-21	apt-get	22:10:07	1
1458510	99	55	44,9	cyclictest	1466383	-21	kworker/u8:2+flush-179:0	20:15:19	1
1458508	99	55	51,2	cyclictest	1512519	-21	kworker/u8:1+events_unbound	22:55:18	0
1458508	99	55	47,6	cyclictest	3105085	-21	systemd-journal	23:09:50	0
1458510	99	53	44,7	cyclictest	3105085	-21	systemd-journal	21:20:01	1
1458508	99	53	48,4	cyclictest	1506493	-21	kworker/u8:2+flush-179:0	22:10:13	0
1458510	99	52	47,4	cyclictest	1455353	-21	kworker/u8:1+events_unbound	19:40:26	1
1458508	99	52	44,5	cyclictest	1519078	-21	kworker/u8:2+events_unbound	22:50:10	0
1458510	99	51	41,6	cyclictest	1487570	-21	kworker/u8:1+flush-179:0	20:55:16	1
1458508	99	51	35,6	cyclictest	1487570	-21	kworker/u8:1+flush-179:0	21:00:23	0
1458510	99	50	32,17	cyclictest	0	-21	swapper/1	00:36:59	1
1458508	99	50	44,5	cyclictest	1526023	-21	kworker/u8:0+events_unbound	23:10:17	0
1458508	99	50	43,5	cyclictest	1544121	-21	kworker/u8:1+flush-179:0	00:20:00	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2020-10-04 - 12:21