OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot4s.osadl.org (updated Thu Aug 20, 2026 00:45:12)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3122805	2	71	68,2	sleep3	0	-21	swapper/3	19:08:21	9
3123351	99	70	66,3	cyclictest	3195266	-21	kworker/u32:2+events_unbound	21:14:14	1
3123393	99	60	58,1	cyclictest	3195266	-21	kworker/u32:2+flush-259:0	20:35:36	7
3123383	99	60	55,4	cyclictest	3358811	-21	kworker/u32:3+events_unbound	23:03:43	4
3123390	99	52	3,25	cyclictest	1161449	-21	thunderbird	22:34:10	6
3123390	99	52	3,25	cyclictest	1161449	-21	thunderbird	20:44:20	6
3123383	99	48	44,3	cyclictest	3325300	-21	kworker/u32:5+flush-259:0	22:32:33	4
3122865	2	44	41,2	sleep1	0	-21	swapper/1	19:09:08	1
3122836	2	43	41,1	sleep0	0	-21	swapper/0	19:08:51	0
3122601	2	43	41,1	sleep10	0	-21	swapper/10	19:05:49	2
3123378	99	42	22,20	cyclictest	3427881	-21	kworker/10:2+events	00:25:59	2
3123378	99	42	22,20	cyclictest	3427881	-21	kworker/10:2+events	00:25:58	2
3123372	99	40	38,2	cyclictest	3374828	-21	kworker/u32:1+flush-259:0	23:48:05	14
3123351	99	40	39,1	cyclictest	3240381	-21	kworker/u32:0+flush-259:0	21:49:02	1
3122866	2	40	38,1	sleep2	0	-21	swapper/2	19:09:09	8
3123378	99	39	38,1	cyclictest	3374828	-21	kworker/u32:1+flush-259:0	23:45:48	2
3123378	99	39	36,2	cyclictest	3240381	-21	kworker/u32:0+flush-259:0	21:40:18	2
3123378	99	39	36,2	cyclictest	3240381	-21	kworker/u32:0+flush-259:0	21:40:18	2
3123362	99	39	35,4	cyclictest	3374828	-21	kworker/u32:1+flush-259:0	23:44:52	11
3119471	2	39	37,1	sleep13	0	-21	swapper/13	19:05:20	5
3122917	2	38	36,1	sleep14	0	-21	swapper/14	19:09:53	6
3123390	99	37	37,0	cyclictest	0	-21	swapper/14	22:13:03	6
3123380	99	37	35,2	cyclictest	3445548	-21	kworker/u32:3+flush-259:0	00:18:10	3
3123378	99	37	35,2	cyclictest	3333606	-21	kworker/u32:2+events_unbound	23:02:20	2
3123374	99	37	34,2	cyclictest	996627	-21	ThreadPoolForeg	20:44:08	15
3123351	99	37	35,2	cyclictest	3174442	-21	kworker/u32:2+flush-259:0	20:17:19	1
3122830	2	37	35,1	sleep11	0	-21	swapper/11	19:08:46	3
3119473	2	37	35,1	sleep15	0	-21	swapper/15	19:05:22	7
3123390	99	36	11,25	cyclictest	0	-21	swapper/14	00:13:01	6
3123367	99	36	34,2	cyclictest	3157367	-21	kworker/u32:3+flush-259:0	19:59:08	12
3123348	99	36	33,3	cyclictest	3263760	-21	kworker/u32:1+flush-259:0	21:58:05	0
3122727	2	36	34,1	sleep7	0	-21	swapper/7	19:07:22	13
3122631	2	36	33,2	sleep9	0	-21	swapper/9	19:06:04	15
3122603	2	36	32,2	sleep12	0	-21	swapper/12	19:05:51	4
3120878	2	36	34,1	sleep6	0	-21	swapper/6	19:05:29	12
3123393	99	35	32,2	cyclictest	3358811	-21	kworker/u32:3+events_unbound	23:11:22	7
3123380	99	35	34,1	cyclictest	3314331	-21	kworker/u32:4+flush-259:0	22:26:09	3
3123369	99	35	32,2	cyclictest	3429540	-21	kworker/u32:2+events_unbound	00:32:29	13
3123369	99	35	32,2	cyclictest	3429540	-21	kworker/u32:2+events_unbound	00:32:28	13
3123393	99	34	32,2	cyclictest	3275875	-21	kworker/u32:4+flush-259:0	21:54:09	7
3123390	99	34	10,11	cyclictest	0	-21	swapper/14	21:39:15	6
3123390	99	34	10,11	cyclictest	0	-21	swapper/14	21:39:15	6
3123390	99	34	10,11	cyclictest	0	-21	swapper/14	00:02:02	6
3123386	99	34	32,2	cyclictest	3362028	-21	kworker/u32:4+events_unbound	23:19:06	5
3123383	99	34	32,2	cyclictest	3445548	-21	kworker/u32:3+events_unbound	00:35:18	4
3123383	99	34	32,2	cyclictest	3445548	-21	kworker/u32:3+events_unbound	00:35:18	4
3123362	99	34	25,9	cyclictest	0	-21	swapper/5	23:10:15	11
3123360	99	34	33,1	cyclictest	3358811	-21	kworker/u32:3+events_unbound	23:08:51	10
3123360	99	34	33,1	cyclictest	0	-21	swapper/4	22:41:51	10
3123354	99	34	31,3	cyclictest	3578	-21	gnome-shell	23:56:04	8
3123354	99	34	30,4	cyclictest	1774	-21	snmpd	00:17:12	8
3123354	99	34	30,4	cyclictest	1161542	-21	WRRende~ckend#1	20:50:14	8
3123354	99	34	28,3	cyclictest	3470984	-21	sed	00:20:19	8
3123354	99	34	28,3	cyclictest	1161449	-21	thunderbird	20:59:54	8
3123354	99	34	0,31	cyclictest	1161449	-21	thunderbird	21:05:52	8
3123393	99	33	31,2	cyclictest	1161449	-21	thunderbird	20:08:51	7
3123390	99	33	8,25	cyclictest	0	-21	swapper/14	20:00:24	6
3123386	99	33	31,2	cyclictest	3301299	-21	kworker/u32:0+flush-259:0	22:27:19	5
3123383	99	33	32,1	cyclictest	3240381	-21	kworker/u32:0+flush-259:0	21:45:22	4
3123383	99	33	31,2	cyclictest	3301299	-21	kworker/u32:0+events_unbound	22:27:18	4
3123372	99	33	31,2	cyclictest	3116456	-1	kworker/u33:1+i915_flip	19:48:11	14
3123372	99	33	31,2	cyclictest	3097631	-1	kworker/u33:0+i915_flip	22:29:58	14
3123369	99	33	31,2	cyclictest	3459316	-21	kworker/u32:1+flush-259:0	00:16:53	13
3123362	99	33	8,17	cyclictest	661	50	irq/154-i915	20:39:04	11
3119988	2	33	30,2	sleep4	0	-21	swapper/4	19:05:27	10
3119466	2	33	31,1	sleep8	0	-21	swapper/8	19:05:15	14
3119461	2	33	31,1	sleep5	0	-21	swapper/5	19:05:12	11
3123393	99	32	1,2	cyclictest	3578	-21	gnome-shell	20:40:06	7
3123390	99	32	8,11	cyclictest	0	-21	swapper/14	20:22:22	6
3123390	99	32	31,1	cyclictest	3318	-21	Xorg	23:26:27	6
3123383	99	32	29,2	cyclictest	996744	-21	Compositor	22:36:03	4
3123383	99	32	0,29	cyclictest	0	-21	swapper/12	22:45:16	4
3123378	99	32	31,1	cyclictest	3301299	-21	kworker/u32:0+flush-259:0	22:13:59	2
3123378	99	32	30,1	cyclictest	3427881	-21	kworker/10:2+events	00:00:24	2
3123378	99	32	30,1	cyclictest	3300650	-21	kworker/10:1+events	22:15:02	2
3123378	99	32	29,1	cyclictest	3427881	-21	kworker/10:2+events	00:11:22	2
3123378	99	32	29,1	cyclictest	3307824	-21	kworker/10:0+events	22:30:33	2
3123378	99	32	29,1	cyclictest	3157581	-21	kworker/10:1+events	20:32:00	2
3123378	99	32	29,1	cyclictest	3157581	-21	kworker/10:1+events	19:51:02	2
3123372	99	32	31,1	cyclictest	3116456	-1	kworker/u33:1+i915_flip	19:34:20	14
3123372	99	32	30,2	cyclictest	3374828	-21	kworker/u32:1+events_unbound	23:31:28	14
3123367	99	32	31,1	cyclictest	3195266	-21	kworker/u32:2+events_unbound	20:38:47	12
3123362	99	32	25,7	cyclictest	1774	-21	snmpd	20:34:57	11
3123360	99	32	0,29	cyclictest	0	-21	swapper/4	22:30:16	10
3123354	99	32	30,2	cyclictest	0	-21	swapper/2	21:34:31	8
3123354	99	32	28,4	cyclictest	782	-21	systemd-journal	21:17:12	8
3123354	99	32	26,3	cyclictest	3062808	-21	IMAP	19:11:56	8
3123354	99	32	1,3	cyclictest	0	-21	swapper/2	21:11:24	8
3123354	99	32	0,31	cyclictest	1161449	-21	thunderbird	21:20:52	8
3123354	99	32	0,30	cyclictest	1161509	-21	Renderer	20:28:04	8
3123354	99	32	0,2	cyclictest	1161540	-21	WRScene~ilder#1	20:49:17	8
3123354	99	32	0,29	cyclictest	1161523	-21	Compositor	21:40:20	8
3123354	99	32	0,29	cyclictest	1161523	-21	Compositor	21:40:20	8
3123354	99	32	0,29	cyclictest	0	-21	swapper/2	23:39:34	8
3123354	99	32	0,29	cyclictest	0	-21	swapper/2	22:16:58	8
3123354	99	32	0,29	cyclictest	0	-21	swapper/2	22:08:32	8
3123354	99	32	0,29	cyclictest	0	-21	swapper/2	21:29:06	8
3123354	99	32	0,29	cyclictest	0	-21	swapper/2	20:10:18	8
3123348	99	32	30,2	cyclictest	3212107	-21	kworker/u32:3+flush-259:0	21:49:12	0
3123348	99	32	30,1	cyclictest	1774	-21	snmpd	22:01:02	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17