OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #b, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackbslot2.osadl.org (updated Thu Nov 13, 2025 12:44:37)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1714635	2	227	199,18	sleep3	0	-21	swapper/3	07:07:09	3
1714709	2	226	196,20	sleep2	0	-21	swapper/2	07:08:03	2
1714744	2	222	194,18	sleep0	0	-21	swapper/0	07:08:30	0
1714841	2	220	190,21	sleep1	0	-21	swapper/1	07:09:47	1
1715035	99	60	56,2	cyclictest	1902326	-21	ThreadPoolForeg	10:45:01	1
1715033	99	52	49,2	cyclictest	1732220	-21	kworker/u8:2+flush-179:0	08:30:27	0
1715033	99	49	47,1	cyclictest	1953880	-13	Chrome_IOThread	11:45:01	0
1715033	99	49	45,3	cyclictest	1793090	-21	kworker/u8:0+events_unbound	09:20:13	0
1715043	99	48	43,3	cyclictest	1857943	-21	latency_hist	09:55:00	3
1715043	99	48	42,3	cyclictest	1953933	-21	snmp_ryswitch2.	11:45:02	3
1715039	99	48	46,1	cyclictest	1822349	-21	awk	09:10:18	2
1715043	99	47	44,2	cyclictest	1823481	-21	kworker/u8:3+flush-179:0	09:20:15	3
1715033	99	47	42,3	cyclictest	1779895	-21	kworker/u8:1+events_unbound	08:25:17	0
1715043	99	46	43,2	cyclictest	1732220	-21	kworker/u8:2+events_unbound	08:15:00	3
1715043	99	46	42,3	cyclictest	1732220	-21	kworker/u8:2+flush-179:0	08:50:09	3
1715033	99	46	42,3	cyclictest	1941530	-21	kworker/u8:0+events_unbound	11:30:15	0
1715033	99	46	42,3	cyclictest	1732220	-21	kworker/u8:2+flush-179:0	08:15:16	0
1715039	99	45	42,2	cyclictest	1767964	-1	kworker/2:0H+kblockd	10:42:05	2
1715039	99	45	38,5	cyclictest	1776343	-21	/usr/share/muni	08:20:15	2
1715033	99	45	42,2	cyclictest	1823481	-21	kworker/u8:3+events_unbound	10:01:56	0
1715033	99	45	42,2	cyclictest	1793090	-21	kworker/u8:0+events_unbound	09:05:01	0
1715043	99	44	40,3	cyclictest	1793090	-21	kworker/u8:0+flush-179:0	09:00:27	3
1715043	99	44	39,4	cyclictest	47022	-21	systemd-journal	10:01:44	3
1715033	99	44	40,3	cyclictest	1732223	-21	kworker/u8:3+flush-179:0	07:35:24	0
1715043	99	43	40,2	cyclictest	1866182	-21	kworker/u8:1+events_unbound	10:05:15	3
1715043	99	43	39,3	cyclictest	1944910	-21	kworker/u8:3+events_unbound	12:25:15	3
1715043	99	43	39,3	cyclictest	1779895	-21	kworker/u8:1+flush-179:0	08:25:12	3
1715033	99	43	39,3	cyclictest	1866182	-21	kworker/u8:1+flush-179:0	10:15:30	0
1715043	99	41	38,2	cyclictest	1893103	-21	kworker/u8:4+events_unbound	12:00:09	3
1715043	99	41	38,2	cyclictest	1732220	-21	kworker/u8:2+events_unbound	07:50:12	3
1715039	99	41	36,3	cyclictest	1793517	-21	kworker/2:2+pm	10:25:03	2
1715033	99	41	37,3	cyclictest	1740994	-21	kworker/u8:0+flush-179:0	07:50:27	0
1715043	99	40	37,2	cyclictest	1823481	-21	kworker/u8:3+events_unbound	09:30:10	3
1715039	99	40	38,1	cyclictest	1902702	-21	kworker/2:0+pm	11:16:22	2
1715039	99	40	38,1	cyclictest	1902702	-21	kworker/2:0+pm	10:50:05	2
1715039	99	40	38,1	cyclictest	1706072	-21	kworker/2:1+pm	07:20:46	2
1715039	99	40	37,2	cyclictest	1940653	-21	kworker/2:2+pm	12:20:04	2
1715039	99	40	37,2	cyclictest	1902702	-21	kworker/2:0+pm	11:25:42	2
1715039	99	40	37,2	cyclictest	1793517	-21	kworker/2:2+pm	08:50:13	2
1715035	99	40	34,4	cyclictest	1754762	-21	/usr/share/muni	07:55:02	1
1715035	99	40	32,5	cyclictest	1788601	-21	kworker/1:2+pm	09:24:00	1
1715033	99	40	36,3	cyclictest	1944910	-21	kworker/u8:3+flush-179:0	12:30:15	0
1715033	99	40	27,13	cyclictest	1876008	-21	kworker/u8:2+flush-179:0	10:45:17	0
1715043	99	39	36,2	cyclictest	1779895	-21	kworker/u8:1+events_unbound	08:40:00	3
1715039	99	39	37,1	cyclictest	1902702	-21	kworker/2:0+pm	11:00:09	2
1715039	99	39	37,1	cyclictest	1888501	-21	kworker/2:1+pm	10:31:39	2
1715039	99	39	37,1	cyclictest	1706072	-21	kworker/2:1+pm	07:19:22	2
1715039	99	39	36,2	cyclictest	1902702	-21	kworker/2:0+pm	11:05:01	2
1715039	99	39	36,2	cyclictest	1793517	-21	kworker/2:2+pm	09:00:05	2
1715039	99	39	36,2	cyclictest	1762909	-21	kworker/2:0+pm	08:25:15	2
1715039	99	39	36,2	cyclictest	1762909	-21	kworker/2:0+pm	08:15:52	2
1715039	99	39	36,2	cyclictest	1744074	-21	kworker/2:2+pm	08:01:29	2
1715039	99	39	36,1	cyclictest	1888501	-21	kworker/2:1+pm	10:45:51	2
1715039	99	39	35,2	cyclictest	1793517	-21	kworker/2:2+pm	09:50:03	2
1715039	99	39	34,3	cyclictest	1767964	-1	kworker/2:0H+kblockd	08:45:04	2
1715039	99	39	32,5	cyclictest	1789396	-21	/usr/share/muni	08:35:13	2
1715035	99	39	35,2	cyclictest	1587248	-1	kworker/1:0H+kblockd	10:30:04	1
1715043	99	38	36,2	cyclictest	1893103	-21	kworker/u8:4+flush-179:0	11:55:10	3
1715043	99	38	36,1	cyclictest	1931853	-21	kworker/3:1+pm	11:50:26	3
1715043	99	38	35,3	cyclictest	1823481	-21	kworker/u8:3+events_unbound	09:35:06	3
1715043	99	38	35,2	cyclictest	1893103	-21	kworker/u8:4+flush-179:0	11:10:05	3
1715043	99	38	35,2	cyclictest	1823481	-21	kworker/u8:3+flush-179:0	09:15:06	3
1715043	99	38	35,2	cyclictest	1740994	-21	kworker/u8:0+flush-179:0	07:55:15	3
1715043	99	38	34,3	cyclictest	1719231	-21	kworker/u8:1+flush-179:0	07:25:15	3
1715039	99	38	36,1	cyclictest	1940653	-21	kworker/2:2+pm	12:05:58	2
1715039	99	38	36,1	cyclictest	1888501	-21	kworker/2:1+pm	10:35:21	2
1715039	99	38	36,1	cyclictest	1793517	-21	kworker/2:2+pm	10:06:38	2
1715039	99	38	36,1	cyclictest	1793517	-21	kworker/2:2+pm	09:17:02	2
1715039	99	38	35,2	cyclictest	1940653	-21	kworker/2:2+pm	12:35:59	2
1715039	99	38	35,2	cyclictest	1793517	-21	kworker/2:2+pm	09:30:05	2
1715039	99	38	35,2	cyclictest	1793517	-21	kworker/2:2+pm	09:20:46	2
1715039	99	38	35,2	cyclictest	1762909	-21	kworker/2:0+pm	08:30:05	2
1715039	99	38	35,2	cyclictest	1744074	-21	kworker/2:2+pm	07:50:02	2
1715039	99	38	35,2	cyclictest	1706072	-21	kworker/2:1+pm	07:40:17	2
1715039	99	38	32,4	cyclictest	1911306	-21	ntpq	10:55:04	2
1715039	99	38	0,3	cyclictest	1849559	-21	cat	09:45:01	2
1715035	99	38	36,1	cyclictest	1318	-21	snmpd	11:51:21	1
1715033	99	38	35,2	cyclictest	1893103	-21	kworker/u8:4+flush-179:0	11:15:13	0
1715033	99	38	35,2	cyclictest	1643395	-21	kworker/u8:4+events_unbound	07:30:11	0
1715043	99	37	34,2	cyclictest	187494	-1	kworker/3:2H+kblockd	10:30:01	3
1715043	99	37	34,2	cyclictest	187494	-1	kworker/3:2H+kblockd	10:15:10	3
1715039	99	37	35,1	cyclictest	1793517	-21	kworker/2:2+pm	10:15:48	2
1715039	99	37	34,2	cyclictest	1793517	-21	kworker/2:2+pm	10:10:07	2
1715039	99	37	34,2	cyclictest	1793517	-21	kworker/2:2+pm	09:05:04	2
1715039	99	37	34,2	cyclictest	1767964	-1	kworker/2:0H+kblockd	11:24:56	2
1715039	99	37	34,2	cyclictest	1762909	-21	kworker/2:0+pm	08:10:03	2
1715039	99	37	34,2	cyclictest	1762909	-21	kworker/2:0+pm	08:05:03	2
1715039	99	37	32,3	cyclictest	1823481	-21	kworker/u8:3+flush-179:0	10:00:13	2
1715039	99	37	0,2	cyclictest	1836014	-31	munin-graph	09:25:53	2
1715035	99	37	35,1	cyclictest	1788601	-21	kworker/1:2+pm	09:19:05	1
1715035	99	37	34,2	cyclictest	1587248	-1	kworker/1:0H+kblockd	11:25:44	1
1715035	99	37	34,2	cyclictest	1587248	-1	kworker/1:0H+kblockd	10:40:14	1
1715035	99	37	34,2	cyclictest	1587248	-1	kworker/1:0H+kblockd	07:45:40	1
1715035	99	37	34,2	cyclictest	1587248	-1	kworker/1:0H+kblockd	07:10:17	1
1715035	99	37	31,5	cyclictest	1587248	-1	kworker/1:0H+kblockd	08:44:27	1
1715035	99	37	31,4	cyclictest	1789397	-21	/usr/share/muni	08:35:01	1
1715033	99	37	35,2	cyclictest	1793090	-21	kworker/u8:0+flush-179:0	08:45:17	0
1715033	99	37	34,3	cyclictest	1732220	-21	kworker/u8:2+flush-179:0	08:50:12	0
1715033	99	37	34,2	cyclictest	1876008	-21	kworker/u8:2+events_unbound	10:50:14	0
1715033	99	37	34,2	cyclictest	1819093	-21	kworker/u8:1+flush-179:0	09:10:10	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17