OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot4s.osadl.org (updated Thu Aug 27, 2026 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2502727	2	214	0,2	sleep3	47	1	rcuc/3	00:32:40	3
2320905	2	203	0,3	sleep3	575	-21	kworker/3:2-events	21:27:44	3
2203622	2	159	0,3	sleep3	0	-21	swapper/3	19:32:39	3
2304707	2	139	0,3	chrt	575	-21	kworker/3:2-events	21:12:43	3
2431265	2	62	0,5	sleep1	2431266	-21	unixbench_multi	23:17:50	1
2180968	99	60	53,5	cyclictest	2187929	-21	kworker/u8:1+flush-8:0	19:52:51	1
2180968	99	58	52,4	cyclictest	2471674	-21	kworker/u8:0+events_unbound	00:40:00	1
2180968	99	55	49,4	cyclictest	2161284	-21	kworker/u8:2+events_unbound	19:17:43	1
2180968	99	54	48,5	cyclictest	2212164	-21	kworker/u8:0+flush-8:0	20:12:46	1
2180968	99	53	48,4	cyclictest	2471708	-21	kworker/u8:4+events_unbound	00:17:34	1
2180973	99	52	47,4	cyclictest	2307069	-21	kworker/u8:3+flush-8:0	21:17:48	2
2180968	99	52	45,5	cyclictest	2336454	-21	kworker/u8:3+flush-8:0	21:52:51	1
2180968	99	51	45,5	cyclictest	2386720	-21	kworker/u8:2+flush-8:0	23:02:45	1
2180968	99	51	45,5	cyclictest	2386720	-21	kworker/u8:2+flush-8:0	23:02:45	1
2180968	99	49	44,3	cyclictest	2336454	-21	kworker/u8:3+events_unbound	21:47:36	1
2180968	99	49	43,4	cyclictest	2426448	-21	kworker/u8:2+flush-8:0	23:57:52	1
2180968	99	49	43,4	cyclictest	2406803	-21	kworker/u8:0+events_unbound	23:07:49	1
2180968	99	49	43,4	cyclictest	2406803	-21	kworker/u8:0+events_unbound	23:07:49	1
2180968	99	49	43,4	cyclictest	2312362	-21	kworker/u8:1+flush-8:0	21:37:49	1
2180968	99	49	42,5	cyclictest	2461308	-21	kworker/u8:1+flush-8:0	00:22:35	1
2180968	99	49	40,6	cyclictest	2316822	-21	latency_hist	21:25:01	1
2180963	99	49	39,7	cyclictest	2316819	-21	apt-get	21:25:01	0
2180968	99	48	44,3	cyclictest	2471708	-21	kworker/u8:4+flush-8:0	00:32:52	1
2180968	99	48	42,4	cyclictest	2161284	-21	kworker/u8:2+events_unbound	19:22:34	1
2180963	99	48	40,5	cyclictest	2185829	-21	latency_hist	19:15:01	0
2180963	99	48	3,36	cyclictest	2331893	-21	kworker/0:1+events	22:02:32	0
2180968	99	47	42,4	cyclictest	2366517	-21	kworker/u8:1+flush-8:0	22:57:46	1
2180968	99	47	42,4	cyclictest	2212164	-21	kworker/u8:0+events_unbound	19:42:50	1
2180973	99	46	34,10	cyclictest	2317738	-21	diskstats	21:27:36	2
2180968	99	46	39,5	cyclictest	2406578	-21	latency_hist	22:55:00	1
2180973	99	45	40,4	cyclictest	2212164	-21	kworker/u8:0+flush-8:0	21:47:45	2
2180968	99	45	41,3	cyclictest	2312362	-21	kworker/u8:1+events_unbound	21:32:36	1
2180968	99	45	40,4	cyclictest	2356447	-21	kworker/u8:2+events_unbound	22:12:45	1
2180968	99	45	40,4	cyclictest	2187929	-21	kworker/u8:1+events_unbound	20:22:38	1
2180968	99	45	40,3	cyclictest	2441784	-21	kworker/u8:1+flush-8:0	23:37:53	1
2180968	99	45	40,3	cyclictest	2212164	-21	kworker/u8:0+flush-8:0	22:07:40	1
2180968	99	45	39,5	cyclictest	2271977	-21	kworker/u8:2+events_unbound	21:27:49	1
2180968	99	45	39,5	cyclictest	2237541	-21	kworker/u8:2+flush-8:0	20:07:49	1
2180963	99	45	34,9	cyclictest	2371940	-21	kworker/u8:0+flush-8:0	22:32:47	0
2180973	99	44	38,4	cyclictest	2471708	-21	kworker/u8:4+flush-8:0	00:12:54	2
2180968	99	44	39,4	cyclictest	2371940	-21	kworker/u8:0+events_unbound	22:37:38	1
2180968	99	44	38,5	cyclictest	2336454	-21	kworker/u8:3+flush-8:0	21:57:51	1
2180968	99	44	37,6	cyclictest	2212164	-21	kworker/u8:0+flush-8:0	19:57:34	1
2180963	99	44	33,9	cyclictest	275	-21	systemd-journal	19:30:00	0
2180973	99	43	33,8	cyclictest	2336030	-21	ntpq	21:42:43	2
2180968	99	43	38,4	cyclictest	2187929	-21	kworker/u8:1+events_unbound	20:27:39	1
2180968	99	43	38,3	cyclictest	2212164	-21	kworker/u8:0+events_unbound	21:42:42	1
2180968	99	43	37,5	cyclictest	2202879	-21	kworker/u8:3+flush-8:0	19:32:40	1
2180968	99	43	37,4	cyclictest	2386720	-21	kworker/u8:2+flush-8:0	22:47:37	1
2180968	99	43	37,4	cyclictest	2212164	-21	kworker/u8:0+events_unbound	20:57:39	1
2180968	99	43	36,5	cyclictest	2161284	-21	kworker/u8:2+flush-8:0	19:27:33	1
2180968	99	43	35,6	cyclictest	2396688	-21	latency_hist	22:45:01	1
2180973	99	42	38,3	cyclictest	2271977	-21	kworker/u8:2+flush-8:0	20:52:40	2
2180973	99	42	38,3	cyclictest	2271977	-21	kworker/u8:2+flush-8:0	20:52:40	2
2180968	99	42	38,3	cyclictest	2406803	-21	kworker/u8:0+events_unbound	23:12:40	1
2180968	99	42	37,4	cyclictest	2271977	-21	kworker/u8:2+flush-8:0	21:12:38	1
2180968	99	42	36,5	cyclictest	2217971	-21	kworker/u8:3+flush-8:0	20:37:51	1
2180968	99	42	36,4	cyclictest	2471708	-21	kworker/u8:4+flush-8:0	00:02:40	1
2180968	99	42	36,4	cyclictest	2271977	-21	kworker/u8:2+flush-8:0	20:42:39	1
2180968	99	42	35,5	cyclictest	2471674	-21	kworker/u8:0+flush-8:0	00:07:47	1
2180968	99	42	35,5	cyclictest	2426448	-21	kworker/u8:2+flush-8:0	23:47:51	1
2180968	99	42	35,5	cyclictest	2217971	-21	kworker/u8:3+events_unbound	20:02:49	1
2180963	99	42	32,7	cyclictest	2212511	-21	latency_hist	19:40:01	0
2180968	99	41	35,4	cyclictest	2372155	-21	apt-get	22:22:32	1
2180968	99	41	35,4	cyclictest	2217971	-21	kworker/u8:3+events_unbound	20:17:39	1
2180968	99	41	35,4	cyclictest	2212164	-21	kworker/u8:0+events_unbound	20:47:43	1
2180968	99	41	34,5	cyclictest	2371940	-21	kworker/u8:0+flush-8:0	22:32:46	1
2220837	2	40	0,9	sleep0	14	1	ktimers/0	19:47:49	0
2180973	99	40	35,4	cyclictest	2161284	-21	kworker/u8:2+flush-8:0	19:27:43	2
2180968	99	40	35,4	cyclictest	2336454	-21	kworker/u8:3+events_unbound	22:17:35	1
2180968	99	40	34,4	cyclictest	2336454	-21	kworker/u8:3+flush-8:0	22:02:35	1
2180968	99	40	34,4	cyclictest	2217971	-21	kworker/u8:3+flush-8:0	21:07:46	1
2180968	99	40	34,4	cyclictest	2212164	-21	kworker/u8:0+events_unbound	21:02:42	1
2180968	99	40	34,4	cyclictest	2161284	-21	kworker/u8:2+events_unbound	19:12:37	1
2180963	99	40	30,8	cyclictest	2213221	-21	diskstats	19:42:35	0
2180963	99	40	30,7	cyclictest	2311773	-21	latency_hist	21:20:01	0
2180973	99	39	35,3	cyclictest	2461308	-21	kworker/u8:1+flush-8:0	00:17:47	2
2180973	99	39	30,7	cyclictest	275	-21	systemd-journal	21:59:29	2
2180968	99	39	33,4	cyclictest	2406803	-21	kworker/u8:0+flush-8:0	23:22:47	1
2180968	99	39	33,4	cyclictest	2187929	-21	kworker/u8:1+events_unbound	20:32:51	1
2180963	99	39	3,29	cyclictest	2366520	-21	kworker/0:2+events	22:57:34	0
2180963	99	39	31,5	cyclictest	2361568	-21	latency_hist	22:10:01	0
2180963	99	39	20,14	cyclictest	2471708	-21	kworker/u8:4+flush-8:0	00:17:31	0
2180973	99	38	34,3	cyclictest	2312362	-21	kworker/u8:1+flush-8:0	21:22:52	2
2180968	99	38	32,5	cyclictest	2436733	-21	kworker/u8:3+flush-8:0	23:42:42	1
2180963	99	38	29,7	cyclictest	2262677	-21	/usr/sbin/munin	20:32:50	0
2180963	99	38	1,32	cyclictest	2421691	-21	kworker/0:0+events	00:02:12	0
2176771	2	38	4,10	sleep1	0	-21	swapper/1	19:07:37	1
2180973	99	37	28,7	cyclictest	2376652	-21	turbostat.cron	22:25:00	2
2180968	99	37	32,4	cyclictest	2371940	-21	kworker/u8:0+flush-8:0	22:27:53	1
2180968	99	37	28,6	cyclictest	275	-21	systemd-journal	23:30:00	1
2180968	99	37	28,6	cyclictest	275	-21	systemd-journal	21:18:29	1
2180963	99	37	28,6	cyclictest	275	-21	systemd-journal	22:45:00	0
2180963	99	37	27,7	cyclictest	2381613	-21	latency_hist	22:30:01	0
2180963	99	37	26,9	cyclictest	275	-21	systemd-journal	23:20:01	0
2180973	99	36	32,3	cyclictest	2161284	-21	kworker/u8:2+flush-8:0	19:22:41	2
2180968	99	36	29,5	cyclictest	2271977	-21	kworker/u8:2+flush-8:0	20:52:34	1
2180968	99	36	29,5	cyclictest	2271977	-21	kworker/u8:2+flush-8:0	20:52:34	1
2180963	99	36	27,6	cyclictest	2441486	-21	latency_hist	23:30:01	0
2180963	99	36	26,7	cyclictest	2207597	-21	latency_hist	19:35:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17