OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #b, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackbslot2.osadl.org (updated Tue Oct 21, 2025 12:44:41)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2176554	2	243	189,19	sleep1	0	-21	swapper/1	07:09:05	1
2176344	2	235	205,19	sleep2	0	-21	swapper/2	07:06:21	2
2176572	2	228	198,19	sleep3	0	-21	swapper/3	07:09:20	3
2176337	2	221	191,19	sleep0	0	-21	swapper/0	07:06:16	0
2359826	2	141	0,1	sleep0	2359564	-21	/usr/share/muni	10:40:03	0
2176773	99	73	16,18	cyclictest	2311599	-21	chrome	09:45:00	0
2176773	99	61	58,2	cyclictest	2180882	-21	kworker/u8:2+flush-179:0	07:35:15	0
2176780	99	60	56,3	cyclictest	2320068	-21	kworker/u8:3+events_unbound	09:55:14	3
2176773	99	59	54,4	cyclictest	2261347	-21	apt-get	08:45:09	0
2176780	99	58	56,1	cyclictest	2208454	-13	chrome	07:45:01	3
2176780	99	57	8,30	cyclictest	0	-21	swapper/3	07:35:15	3
2176780	99	56	52,3	cyclictest	2293893	-21	kworker/u8:2+events_unbound	10:10:24	3
2176780	99	56	52,3	cyclictest	2260157	-21	chrome	08:45:00	3
2176773	99	53	49,3	cyclictest	2230183	-21	/usr/share/muni	08:10:14	0
2176773	99	53	47,4	cyclictest	2365596	-21	ThreadPoolForeg	10:45:12	0
2450228	2	52	0,1	chrt	2450227	-21	/usr/sbin/munin	12:25:03	3
2176780	99	51	51,0	cyclictest	2348330	-21	awk	10:25:12	3
2176779	99	50	4,43	cyclictest	2311642	-21	snmp_ryswitch.c	09:45:01	2
2176780	99	49	45,3	cyclictest	2203474	-21	kworker/u8:4+events_unbound	08:35:12	3
2176778	99	48	3,42	cyclictest	2311583	-21	ThreadPoolForeg	09:45:01	1
2176780	99	47	45,2	cyclictest	2397652	-21	kworker/u8:4+events_unbound	12:15:15	3
2176780	99	47	44,2	cyclictest	2393874	-21	kworker/u8:3+events_unbound	11:20:13	3
2176778	99	47	37,8	cyclictest	2201907	-21	awk	07:35:15	1
2176779	99	46	40,4	cyclictest	2298744	-21	/usr/share/muni	09:30:17	2
2176780	99	45	42,2	cyclictest	2203397	-21	kworker/u8:1+events_unbound	07:55:05	3
2176780	99	44	41,2	cyclictest	2320068	-21	kworker/u8:3+events_unbound	10:00:15	3
2176780	99	44	39,3	cyclictest	2311595	-21	ThreadPoolSingl	09:45:00	3
2176780	99	44	37,5	cyclictest	2424170	-21	latency_hist	11:55:00	3
2176773	99	44	31,12	cyclictest	2078280	-1	kworker/0:1H+kblockd	11:30:54	0
2176780	99	42	39,2	cyclictest	2307078	-21	kworker/u8:0+events_unbound	09:40:21	3
2176780	99	42	39,2	cyclictest	2203397	-21	kworker/u8:1+events_unbound	07:40:14	3
2176780	99	42	38,3	cyclictest	2397652	-21	kworker/u8:4+events_unbound	12:35:05	3
2176780	99	42	38,3	cyclictest	2293893	-21	kworker/u8:2+events_unbound	10:40:13	3
2176780	99	42	36,4	cyclictest	2303006	-21	/usr/share/muni	09:35:06	3
2176780	99	42	35,5	cyclictest	2181551	-21	/usr/share/muni	07:15:02	3
2176779	99	42	39,2	cyclictest	2421473	-21	sh	11:50:10	2
2176773	99	42	38,3	cyclictest	2256885	-21	apt-get	08:40:06	0
2176780	99	41	38,2	cyclictest	2276742	-21	kworker/u8:3+flush-179:0	09:20:24	3
2176780	99	41	37,3	cyclictest	2397652	-21	kworker/u8:4+events_unbound	12:35:01	3
2176780	99	41	29,11	cyclictest	2397652	-21	kworker/u8:4+flush-179:0	11:30:11	3
2176779	99	41	33,7	cyclictest	1633581	-1	kworker/2:0H+kblockd	08:05:03	2
2176780	99	40	37,3	cyclictest	2389485	-21	kworker/u8:0+flush-179:0	11:15:16	3
2176780	99	40	37,3	cyclictest	2389485	-21	kworker/u8:0+flush-179:0	11:15:16	3
2176780	99	40	36,3	cyclictest	2428349	-21	kworker/u8:2+flush-179:0	12:20:28	3
2176780	99	40	36,3	cyclictest	2293893	-21	kworker/u8:2+events_unbound	11:10:24	3
2176779	99	40	38,1	cyclictest	2176737	-21	kworker/2:2+pm	07:40:54	2
2176779	99	40	37,2	cyclictest	2355068	-21	kworker/2:3+pm	11:15:04	2
2176779	99	40	37,2	cyclictest	2355068	-21	kworker/2:3+pm	11:15:04	2
2176779	99	40	36,3	cyclictest	2393695	-21	kworker/2:0+pm	11:30:15	2
2176779	99	40	36,3	cyclictest	2176737	-21	kworker/2:2+pm	07:20:47	2
2176779	99	40	35,3	cyclictest	2307078	-21	kworker/u8:0+flush-179:0	09:50:04	2
2176778	99	40	35,3	cyclictest	2238535	-21	latency_hist	08:20:01	1
2176778	99	40	31,7	cyclictest	2089352	-1	kworker/1:1H+kblockd	09:00:01	1
2176780	99	39	37,2	cyclictest	2293893	-21	kworker/u8:2+flush-179:0	11:00:08	3
2176780	99	39	32,5	cyclictest	2441254	-21	cat	12:15:00	3
2176779	99	39	37,1	cyclictest	2176737	-21	kworker/2:2+pm	08:20:13	2
2176779	99	39	37,1	cyclictest	2176737	-21	kworker/2:2+pm	08:00:59	2
2176779	99	39	37,1	cyclictest	2176737	-21	kworker/2:2+pm	07:35:53	2
2176779	99	39	36,2	cyclictest	2453756	-21	kworker/2:0+pm	12:30:09	2
2176779	99	39	36,2	cyclictest	2441236	-21	kworker/2:3+pm	12:25:16	2
2176779	99	39	36,2	cyclictest	2393695	-21	kworker/2:0+pm	11:20:02	2
2176779	99	39	36,2	cyclictest	2254969	-21	kworker/2:2+pm	09:40:11	2
2176779	99	39	36,2	cyclictest	2254969	-21	kworker/2:2+pm	08:40:53	2
2176778	99	39	34,4	cyclictest	2186502	-21	/usr/share/muni	07:20:15	1
2176778	99	39	34,3	cyclictest	2376991	-21	latency_hist	11:00:00	1
2176778	99	39	33,4	cyclictest	2329583	-21	/usr/share/muni	10:05:03	1
2176778	99	39	25,10	cyclictest	2439601	-21	awk	12:10:16	1
2176773	99	39	38,1	cyclictest	2348331	-21	awk	10:25:12	0
2176773	99	39	34,4	cyclictest	2338147	-21	/usr/share/muni	10:15:02	0
2176780	99	38	35,2	cyclictest	2354703	-21	kworker/u8:1+events_unbound	10:55:07	3
2176780	99	38	35,2	cyclictest	2276742	-21	kworker/u8:3+flush-179:0	09:15:26	3
2176780	99	38	34,2	cyclictest	2048028	-1	kworker/3:1H+kblockd	09:50:22	3
2176780	99	38	32,4	cyclictest	2418976	-21	ntpq	11:45:23	3
2176780	99	38	32,1	cyclictest	2048028	-1	kworker/3:1H+kblockd	07:10:26	3
2176779	99	38	37,1	cyclictest	2242839	-21	kworker/2:0+pm	08:31:53	2
2176779	99	38	37,1	cyclictest	2176737	-21	kworker/2:2+pm	07:56:17	2
2176779	99	38	36,1	cyclictest	2393695	-21	kworker/2:0+pm	12:05:01	2
2176779	99	38	36,1	cyclictest	2331265	-21	kworker/2:0+pm	10:21:00	2
2176779	99	38	35,2	cyclictest	2441236	-21	kworker/2:3+pm	12:20:16	2
2176779	99	38	35,2	cyclictest	2254969	-21	kworker/2:2+pm	09:20:07	2
2176779	99	38	35,2	cyclictest	2176737	-21	kworker/2:2+pm	07:30:13	2
2176779	99	38	35,2	cyclictest	2176737	-21	kworker/2:2+pm	07:30:12	2
2176779	99	38	34,3	cyclictest	2254969	-21	kworker/2:2+pm	10:07:12	2
2176773	99	38	36,1	cyclictest	2167944	-21	kworker/0:1+pm	08:35:20	0
2176773	99	38	34,2	cyclictest	2078280	-1	kworker/0:1H+kblockd	12:20:05	0
2176780	99	37	34,2	cyclictest	2048028	-1	kworker/3:1H+kblockd	10:20:03	3
2176780	99	37	33,3	cyclictest	2428349	-21	kworker/u8:2+events_unbound	12:05:12	3
2176780	99	37	30,3	cyclictest	2048028	-1	kworker/3:1H+kblockd	10:45:06	3
2176779	99	37	35,1	cyclictest	2393695	-21	kworker/2:0+pm	12:00:58	2
2176779	99	37	35,1	cyclictest	2393695	-21	kworker/2:0+pm	11:36:04	2
2176779	99	37	35,1	cyclictest	2254969	-21	kworker/2:2+pm	09:00:01	2
2176779	99	37	35,1	cyclictest	2176737	-21	kworker/2:2+pm	08:17:38	2
2176779	99	37	34,3	cyclictest	2176737	-21	kworker/2:2+pm	07:27:23	2
2176779	99	37	34,2	cyclictest	2254969	-21	kworker/2:2+pm	09:10:07	2
2176779	99	37	34,1	cyclictest	1633581	-1	kworker/2:0H+kblockd	09:35:52	2
2176779	99	37	34,1	cyclictest	1633581	-1	kworker/2:0H+kblockd	08:45:59	2
2176779	99	37	33,3	cyclictest	2355068	-21	kworker/2:3+pm	10:53:19	2
2176779	99	37	28,8	cyclictest	2295534	-21	awk	09:25:08	2
2176778	99	37	35,1	cyclictest	2294324	-21	kworker/1:0+pm	10:39:59	1
2176778	99	37	34,2	cyclictest	2089352	-1	kworker/1:1H+kblockd	12:35:00	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17