OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #e, slot #6

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackeslot6.osadl.org (updated Mon Oct 19, 2026 12:44:53)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
480778	99	143	136,5	cyclictest	537720	-21	kworker/u8:0+events_unbound	10:40:00	0
480778	99	142	134,5	cyclictest	553415	-21	kworker/u8:2+events_unbound	11:15:01	0
480781	99	133	122,8	cyclictest	537415	-21	latency_hist	10:05:02	1
480778	99	133	0,131	cyclictest	1	-21	systemd	08:15:01	0
480778	99	130	115,10	cyclictest	510207	-21	kworker/u8:0+flush-179:0	08:45:23	0
480778	99	129	117,9	cyclictest	575159	-21	kworker/u8:1+events_unbound	12:35:00	0
480781	99	128	112,14	cyclictest	504581	-21	kworker/u8:2+flush-179:0	08:50:00	1
480778	99	128	115,4	cyclictest	527320	-21	kworker/u8:0+events_unbound	09:40:23	0
480778	99	124	117,5	cyclictest	563168	-21	kworker/u8:1+events_unbound	11:30:24	0
480778	99	124	115,7	cyclictest	498963	-21	kworker/u8:1+events_unbound	08:20:27	0
480778	99	124	115,6	cyclictest	534254	-21	kworker/u8:2+flush-179:0	09:55:26	0
480781	99	123	112,9	cyclictest	527372	-21	kworker/u8:3+flush-179:0	10:20:26	1
480778	99	123	117,4	cyclictest	544561	-21	kworker/u8:1+events_unbound	11:05:24	0
480778	99	123	113,7	cyclictest	527320	-21	kworker/u8:0+events_unbound	09:35:26	0
480778	99	123	111,9	cyclictest	487017	-21	latency_hist	07:30:02	0
480778	99	123	107,6	cyclictest	527372	-21	kworker/u8:3+events_unbound	10:25:17	0
480778	99	122	111,4	cyclictest	506171	-21	kworker/u8:3+events_unbound	08:35:01	0
480778	99	121	115,4	cyclictest	475835	-21	kworker/u8:0+events_unbound	07:15:25	0
480778	99	119	101,5	cyclictest	537720	-21	kworker/u8:0+events_unbound	11:25:26	0
480778	99	118	112,4	cyclictest	553415	-21	kworker/u8:2+flush-179:0	11:20:21	0
480778	99	118	108,7	cyclictest	504581	-21	kworker/u8:2+events_unbound	09:00:17	0
480781	99	117	108,7	cyclictest	527320	-21	kworker/u8:0+flush-179:0	09:50:01	1
480781	99	116	106,7	cyclictest	575084	-21	kworker/u8:0+flush-179:0	12:00:01	1
480778	99	115	109,4	cyclictest	488591	-21	kworker/u8:3+flush-179:0	07:50:22	0
480778	99	115	107,6	cyclictest	488591	-21	kworker/u8:3+events_unbound	08:05:01	0
480778	99	115	104,8	cyclictest	498963	-21	kworker/u8:1+events_unbound	08:10:00	0
480778	99	114	104,8	cyclictest	475835	-21	kworker/u8:0+events_unbound	07:30:20	0
480781	99	113	102,8	cyclictest	522324	-21	apt-get	09:20:00	1
480778	99	113	106,5	cyclictest	527372	-21	kworker/u8:3+events_unbound	10:15:20	0
480781	99	112	105,5	cyclictest	517265	-21	kworker/u8:1+flush-179:0	09:05:22	1
480778	99	112	104,6	cyclictest	564826	-21	kworker/u8:3+flush-179:0	11:45:16	0
480778	99	112	104,5	cyclictest	575084	-21	kworker/u8:0+flush-179:0	12:10:21	0
480778	99	112	104,5	cyclictest	496558	-21	kworker/u8:0+flush-179:0	08:25:16	0
480778	99	111	102,6	cyclictest	527372	-21	kworker/u8:3+events_unbound	10:20:20	0
480778	99	110	103,5	cyclictest	537720	-21	kworker/u8:0+events_unbound	10:40:14	0
480778	99	110	100,7	cyclictest	488591	-21	kworker/u8:3+flush-179:0	07:45:18	0
480778	99	109	102,5	cyclictest	581719	-21	kworker/u8:2+events_unbound	12:25:14	0
480778	99	108	100,6	cyclictest	532088	-21	kworker/u8:1+events_unbound	09:45:22	0
480778	99	107	97,6	cyclictest	527372	-21	kworker/u8:3+events_unbound	09:50:23	0
480778	99	106	95,8	cyclictest	498963	-21	kworker/u8:1+events_unbound	08:15:15	0
480778	99	106	100,5	cyclictest	517265	-21	kworker/u8:1+flush-179:0	09:30:26	0
480778	99	106	100,4	cyclictest	519105	-21	kworker/u8:3+flush-179:0	09:10:22	0
480778	99	106	100,4	cyclictest	504581	-21	kworker/u8:2+flush-179:0	08:50:25	0
480778	99	105	98,5	cyclictest	291247	-21	kworker/u8:4+flush-179:0	07:10:20	0
480778	99	105	94,4	cyclictest	537720	-21	kworker/u8:0+events_unbound	11:00:18	0
480778	99	105	100,4	cyclictest	575159	-21	kworker/u8:1+flush-179:0	12:20:23	0
480778	99	104	90,5	cyclictest	564826	-21	kworker/u8:3+events_unbound	11:35:14	0
480778	99	103	98,3	cyclictest	575084	-21	kworker/u8:0+flush-179:0	12:00:20	0
480778	99	102	94,5	cyclictest	527372	-21	kworker/u8:3+events_unbound	10:05:14	0
480781	99	101	91,7	cyclictest	576703	-21	latency_hist	12:05:01	1
480778	99	101	94,5	cyclictest	575084	-21	kworker/u8:0+events_unbound	12:05:19	0
480778	99	101	93,6	cyclictest	520699	-21	kworker/u8:0+events_unbound	09:20:20	0
480778	99	101	88,5	cyclictest	488586	-21	kworker/u8:2+events_unbound	07:35:15	0
480778	99	100	95,4	cyclictest	498963	-21	kworker/u8:1+flush-179:0	08:35:23	0
480778	99	100	95,4	cyclictest	475835	-21	kworker/u8:0+flush-179:0	07:20:25	0
480778	99	99	93,4	cyclictest	563168	-21	kworker/u8:1+events_unbound	11:40:16	0
480778	99	99	92,4	cyclictest	537720	-21	kworker/u8:0+events_unbound	11:15:19	0
480781	99	98	90,6	cyclictest	1213033	-21	systemd-journal	12:14:59	1
480778	99	98	88,8	cyclictest	525762	-21	latency_hist	09:30:01	0
480781	99	97	85,9	cyclictest	586495	-21	apt-get	12:35:13	1
480781	99	97	84,11	cyclictest	558161	-21	apt-get	11:10:00	1
480778	99	97	87,8	cyclictest	571446	-21	kworker/u8:2+events_unbound	11:55:02	0
480778	99	96	90,4	cyclictest	537720	-21	kworker/u8:0+events_unbound	10:45:14	0
480778	99	96	89,5	cyclictest	488591	-21	kworker/u8:3+events_unbound	07:55:22	0
480778	99	96	89,5	cyclictest	488591	-21	kworker/u8:3+events_unbound	07:55:21	0
480778	99	96	83,4	cyclictest	504581	-21	kworker/u8:2+events_unbound	08:55:22	0
480778	99	95	89,5	cyclictest	517265	-21	kworker/u8:1+flush-179:0	09:05:26	0
480781	99	94	82,9	cyclictest	575084	-21	kworker/u8:0+events_unbound	12:15:22	1
480778	99	94	81,10	cyclictest	490489	-21	apt-get	07:40:11	0
480778	99	92	86,4	cyclictest	520699	-21	kworker/u8:0+flush-179:0	09:15:19	0
480778	99	92	80,5	cyclictest	564826	-21	kworker/u8:3+events_unbound	11:50:20	0
480781	99	91	84,6	cyclictest	498963	-21	kworker/u8:1+flush-179:0	08:15:01	1
480781	99	91	81,7	cyclictest	575159	-21	kworker/u8:1+flush-179:0	12:30:16	1
480778	99	91	82,5	cyclictest	575084	-21	kworker/u8:0+flush-179:0	12:15:21	0
480781	99	90	82,5	cyclictest	504581	-21	kworker/u8:2+flush-179:0	08:40:19	1
480781	99	89	82,5	cyclictest	563168	-21	kworker/u8:1+events_unbound	11:40:00	1
480778	99	89	81,5	cyclictest	534254	-21	kworker/u8:2+flush-179:0	10:10:13	0
480781	99	88	78,8	cyclictest	488591	-21	kworker/u8:3+events_unbound	07:40:00	1
480781	99	88	76,8	cyclictest	512738	-21	/usr/sbin/munin	08:50:23	1
480781	99	88	75,11	cyclictest	569572	-21	apt-get	11:45:01	1
480778	99	88	83,4	cyclictest	544561	-21	kworker/u8:1+flush-179:0	10:30:19	0
480781	99	87	80,5	cyclictest	504581	-21	kworker/u8:2+flush-179:0	09:00:18	1
480781	99	87	76,9	cyclictest	1213033	-21	systemd-journal	09:44:55	1
480778	99	87	82,4	cyclictest	586217	-21	kworker/u8:0+flush-179:0	12:35:26	0
480781	99	85	82,2	cyclictest	571446	-21	kworker/u8:2+events_unbound	11:50:23	1
480778	99	85	79,5	cyclictest	537720	-21	kworker/u8:0+flush-179:0	10:55:19	0
480778	99	85	79,5	cyclictest	537720	-21	kworker/u8:0+flush-179:0	10:55:18	0
480781	99	84	71,11	cyclictest	1213033	-21	systemd-journal	08:20:00	1
480781	99	83	69,6	cyclictest	527372	-21	kworker/u8:3+flush-179:0	10:25:26	1
480781	99	82	74,6	cyclictest	488591	-21	kworker/u8:3+events_unbound	07:50:27	1
480781	99	82	73,6	cyclictest	498963	-21	kworker/u8:1+events_unbound	08:30:24	1
480778	99	82	77,4	cyclictest	537720	-21	kworker/u8:0+events_unbound	10:50:15	0
480781	99	80	72,6	cyclictest	291247	-21	kworker/u8:4+flush-179:0	07:20:21	1
480781	99	79	67,9	cyclictest	1213033	-21	systemd-journal	11:50:01	1
480781	99	78	69,6	cyclictest	488591	-21	kworker/u8:3+flush-179:0	08:00:18	1
480778	99	78	73,4	cyclictest	504581	-21	kworker/u8:2+events_unbound	08:40:23	0
480781	99	77	68,7	cyclictest	558665	-21	apt-get	11:10:10	1
480781	99	77	66,8	cyclictest	488586	-21	kworker/u8:2+flush-179:0	07:40:21	1
480781	99	77	1,73	cyclictest	1	-21	systemd	08:10:01	1
480781	99	75	65,8	cyclictest	488591	-21	kworker/u8:3+flush-179:0	07:50:00	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2020-10-04 - 12:21