OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot4s.osadl.org (updated Wed Jun 24, 2026 12:44:15)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2148502	99	69	62,5	cyclictest	2372832	-21	kworker/u8:1+events_unbound	12:30:35	1
2148502	99	67	59,5	cyclictest	2153008	-21	kworker/u8:2+flush-8:0	07:25:35	1
2148502	99	63	54,6	cyclictest	2096357	-21	kworker/u8:1+events_unbound	08:10:33	1
2148502	99	59	52,5	cyclictest	2363986	-21	kworker/u8:0+flush-8:0	11:00:28	1
2148502	99	59	52,5	cyclictest	2363986	-21	kworker/u8:0+flush-8:0	11:00:27	1
2148502	99	56	51,3	cyclictest	2274011	-21	kworker/u8:0+events_unbound	10:15:01	1
2148499	99	56	45,8	cyclictest	2397520	-21	ntpq	11:15:29	0
2352198	2	54	0,5	chrt	0	-21	swapper/1	10:30:26	1
2148502	99	54	49,4	cyclictest	2363986	-21	kworker/u8:0+events_unbound	11:00:00	1
2148502	99	54	49,4	cyclictest	2363986	-21	kworker/u8:0+events_unbound	10:59:59	1
2148502	99	54	49,3	cyclictest	2383834	-21	kworker/u8:3+events_unbound	11:35:34	1
2148502	99	54	44,7	cyclictest	2159284	-21	ntpq	07:15:29	1
2148499	99	54	32,8	cyclictest	2334484	-21	diskstats	10:15:19	0
2148502	99	53	47,4	cyclictest	2096988	-21	kworker/u8:4+events_unbound	07:35:33	1
2148502	99	53	46,5	cyclictest	2096357	-21	kworker/u8:1+events_unbound	08:50:21	1
2268930	2	52	0,3	chrt	0	-21	swapper/2	09:05:35	2
2148502	99	52	45,5	cyclictest	2274011	-21	kworker/u8:0+flush-8:0	09:45:30	1
2148502	99	52	45,5	cyclictest	2096988	-21	kworker/u8:4+flush-8:0	10:20:33	1
2148502	99	51	46,4	cyclictest	2224760	-21	kworker/u8:0+events_unbound	08:35:22	1
2148502	99	51	46,4	cyclictest	2096357	-21	kworker/u8:1+events_unbound	07:20:33	1
2148502	99	51	45,4	cyclictest	2313841	-21	kworker/u8:2+flush-8:0	10:45:21	1
2148502	99	51	45,4	cyclictest	2096357	-21	kworker/u8:1+events_unbound	07:30:28	1
2148502	99	51	45,3	cyclictest	2096357	-21	kworker/u8:1+events_unbound	08:45:00	1
2148502	99	50	45,4	cyclictest	2405505	-21	kworker/u8:0+flush-8:0	12:10:31	1
2148502	99	50	44,4	cyclictest	2467477	-21	kworker/u8:2+flush-8:0	12:35:32	1
2148502	99	50	44,4	cyclictest	2096988	-21	kworker/u8:4+events_unbound	09:40:25	1
2148502	99	49	45,3	cyclictest	2096357	-21	kworker/u8:1+flush-8:0	09:10:32	1
2148502	99	49	44,3	cyclictest	2254591	-21	kworker/u8:2+events_unbound	09:00:21	1
2148502	99	49	42,5	cyclictest	1704890	-21	systemd-journal	12:30:00	1
2148502	99	48	44,3	cyclictest	2372832	-21	kworker/u8:1+events_unbound	11:25:00	1
2148502	99	48	41,5	cyclictest	2344552	-21	kworker/u8:0+events_unbound	10:35:34	1
2148502	99	48	41,5	cyclictest	2274011	-21	kworker/u8:0+events_unbound	09:35:36	1
2148502	99	48	41,5	cyclictest	2153008	-21	kworker/u8:2+flush-8:0	07:55:21	1
2148499	99	48	42,4	cyclictest	2096357	-21	kworker/u8:1+flush-8:0	07:20:00	0
2148502	99	47	41,5	cyclictest	2096988	-21	kworker/u8:4+events_unbound	10:00:35	1
2148502	99	47	41,4	cyclictest	2383834	-21	kworker/u8:3+events_unbound	11:40:33	1
2148502	99	47	41,4	cyclictest	2372832	-21	kworker/u8:1+events_unbound	11:50:32	1
2148502	99	46	41,3	cyclictest	2096988	-21	kworker/u8:4+events_unbound	10:40:22	1
2148502	99	46	39,5	cyclictest	2254591	-21	kworker/u8:2+flush-8:0	09:05:30	1
2148502	99	46	39,5	cyclictest	2096988	-21	kworker/u8:4+events_unbound	09:15:19	1
2148502	99	46	36,8	cyclictest	1704890	-21	systemd-journal	12:07:46	1
2457516	2	45	0,2	sleep0	20	1	rcuc/0	12:15:36	0
2148502	99	45	39,4	cyclictest	2096357	-21	kworker/u8:1+flush-8:0	08:55:20	1
2148502	99	45	37,6	cyclictest	2372832	-21	kworker/u8:1+events_unbound	10:50:32	1
2148502	99	45	36,7	cyclictest	2457156	-21	ntpq	12:15:30	1
2148499	99	45	34,8	cyclictest	2328114	-21	ntpq	10:05:30	0
2148502	99	44	39,3	cyclictest	2153008	-21	kworker/u8:2+events_unbound	07:45:32	1
2148502	99	44	37,5	cyclictest	2383834	-21	kworker/u8:3+flush-8:0	12:00:31	1
2148502	99	43	39,3	cyclictest	2096357	-21	kworker/u8:1+flush-8:0	08:45:21	1
2148502	99	43	37,4	cyclictest	2096988	-21	kworker/u8:4+events_unbound	07:40:21	1
2148502	99	43	35,7	cyclictest	2383834	-21	kworker/u8:3+flush-8:0	11:25:32	1
2148502	99	42	37,3	cyclictest	2293199	-21	ntpq	09:30:28	1
2148502	99	42	36,5	cyclictest	2096357	-21	kworker/u8:1+events_unbound	08:20:30	1
2148502	99	42	36,4	cyclictest	2344552	-21	kworker/u8:0+events_unbound	10:25:33	1
2148502	99	42	36,4	cyclictest	2274011	-21	kworker/u8:0+flush-8:0	10:05:20	1
2148499	99	42	33,6	cyclictest	1704890	-21	systemd-journal	07:15:00	0
2148499	99	42	32,8	cyclictest	2238792	-21	ntpq	08:35:29	0
2148502	99	41	36,3	cyclictest	2304296	-21	kworker/u8:1+events_unbound	09:50:19	1
2148502	99	41	35,4	cyclictest	2313841	-21	kworker/u8:2+events_unbound	11:05:19	1
2148502	99	41	34,5	cyclictest	1704890	-21	systemd-journal	08:17:55	1
2148502	99	40	33,5	cyclictest	2437427	-21	ntpq	11:55:29	1
2148502	99	40	33,5	cyclictest	2383834	-21	kworker/u8:3+flush-8:0	11:45:33	1
2148502	99	40	33,5	cyclictest	2111658	-21	kworker/u8:0+flush-8:0	07:10:21	1
2148502	99	39	34,4	cyclictest	2405505	-21	kworker/u8:0+flush-8:0	11:30:31	1
2148502	99	39	29,8	cyclictest	2228862	-21	ntpq	08:25:30	1
2148502	99	38	33,3	cyclictest	2096988	-21	kworker/u8:4+events_unbound	08:30:21	1
2148502	99	38	30,6	cyclictest	2204986	-21	latency_hist	08:05:01	1
2148499	99	38	26,9	cyclictest	1704890	-21	systemd-journal	11:02:48	0
2148499	99	38	26,9	cyclictest	1704890	-21	systemd-journal	11:02:47	0
2148504	99	37	34,2	cyclictest	2153008	-21	kworker/u8:2+events_unbound	08:05:59	2
2148502	99	37	33,3	cyclictest	2313841	-21	kworker/u8:2+events_unbound	11:15:29	1
2148502	99	37	32,4	cyclictest	2096988	-21	kworker/u8:4+flush-8:0	09:55:36	1
2148502	99	37	32,3	cyclictest	2405505	-21	kworker/u8:0+flush-8:0	12:20:25	1
2148502	99	37	32,3	cyclictest	2274011	-21	kworker/u8:0+events_unbound	10:15:27	1
2148499	99	37	32,4	cyclictest	2096988	-21	kworker/u8:4+flush-8:0	08:55:36	0
2148499	99	37	27,7	cyclictest	1704890	-21	systemd-journal	07:35:00	0
2148502	99	36	32,3	cyclictest	2372832	-21	kworker/u8:1+flush-8:0	11:10:26	1
2148499	99	36	28,5	cyclictest	2185258	-21	latency_hist	07:45:02	0
2148499	99	36	0,30	cyclictest	2138541	-21	kworker/0:1+events	10:55:00	0
2148499	99	35	26,7	cyclictest	2210184	-21	/usr/sbin/munin	08:10:31	0
2148499	99	35	2,31	cyclictest	2138541	-21	kworker/0:1+events	08:18:43	0
2148504	99	34	30,3	cyclictest	2153008	-21	kworker/u8:2+events_unbound	07:10:41	2
2148499	99	34	23,9	cyclictest	2422258	-21	ntpq	11:40:30	0
2234856	2	33	0,2	sleep2	37	1	rcuc/2	08:35:01	2
2148502	99	33	28,4	cyclictest	2096988	-21	kworker/u8:4+flush-8:0	09:20:37	1
2148499	99	33	28,3	cyclictest	2224792	-21	idleruntime-cro	08:24:59	0
2148499	99	33	26,5	cyclictest	2372832	-21	kworker/u8:1+flush-8:0	11:56:19	0
2148499	99	33	26,5	cyclictest	1704890	-21	systemd-journal	11:08:29	0
2148499	99	33	25,6	cyclictest	2096357	-21	kworker/u8:1+flush-8:0	07:20:30	0
2148499	99	33	2,30	cyclictest	2138541	-21	kworker/0:1+events	09:43:19	0
2148499	99	33	2,26	cyclictest	2138541	-21	kworker/0:1+events	10:35:18	0
2395645	2	32	0,5	sleep2	37	1	rcuc/2	11:15:26	2
2148502	99	32	28,3	cyclictest	2153008	-21	kworker/u8:2+events_unbound	08:05:33	1
2148502	99	32	24,6	cyclictest	2289204	-21	latency_hist	09:30:01	1
2148499	99	32	28,3	cyclictest	2206177	-21	kthreadcore	08:05:24	0
2148499	99	32	27,3	cyclictest	2368318	-21	grep	10:45:37	0
2148499	99	32	24,5	cyclictest	2319122	-21	latency_hist	10:00:01	0
2148499	99	32	10,20	cyclictest	2138541	-21	kworker/0:1+events	11:50:20	0
2148504	99	31	25,4	cyclictest	2274011	-21	kworker/u8:0+flush-8:0	10:00:31	2
2148504	99	31	24,4	cyclictest	1704890	-21	systemd-journal	09:54:59	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17