OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot4s.osadl.org (updated Mon Aug 03, 2026 00:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
611066	2	206	0,5	sleep3	0	-21	swapper/3	19:25:01	3
883507	2	74	0,2	chrt	575	-21	kworker/3:2-events	23:58:12	3
854739	2	73	0,4	sleep0	20	1	rcuc/0	23:32:53	0
800898	2	63	0,4	sleep2	37	1	rcuc/2	22:37:58	2
593968	99	61	52,6	cyclictest	883671	-21	latency_hist	00:00:01	1
593968	99	55	44,8	cyclictest	275	-21	systemd-journal	21:50:00	1
593965	99	53	47,4	cyclictest	557014	-21	kworker/u8:0+events_unbound	20:05:01	0
593968	99	52	43,6	cyclictest	720310	-21	latency_hist	21:15:01	1
891347	2	50	0,1	sleep0	891353	-21	tr	00:08:00	0
593965	99	50	45,4	cyclictest	557014	-21	kworker/u8:0+events_unbound	20:15:01	0
593965	99	50	38,5	cyclictest	794912	-21	kworker/u8:1+events_unbound	22:33:08	0
709388	2	48	0,3	chrt	709393	-21	needreboot	21:03:03	0
593968	99	48	39,6	cyclictest	779646	-21	latency_hist	22:15:01	1
593965	99	48	43,4	cyclictest	3425444	-21	kworker/u8:3+flush-8:0	19:43:07	0
593965	99	47	36,4	cyclictest	557014	-21	kworker/u8:0+events_unbound	21:17:57	0
593965	99	46	42,3	cyclictest	557014	-21	kworker/u8:0+flush-8:0	19:28:07	0
593965	99	45	41,3	cyclictest	779666	-21	kworker/u8:3+events_unbound	22:48:07	0
593965	99	45	34,4	cyclictest	819458	-21	kworker/u8:1+events_unbound	23:27:55	0
593965	99	45	33,5	cyclictest	557014	-21	kworker/u8:0+events_unbound	23:07:55	0
593968	99	44	38,4	cyclictest	695147	-21	latency_hist	20:50:00	1
593968	99	44	36,5	cyclictest	625954	-21	latency_hist	19:40:00	1
593965	99	44	39,4	cyclictest	819458	-21	kworker/u8:1+flush-8:0	23:03:10	0
593965	99	44	36,3	cyclictest	893657	-21	kworker/u8:1+events_unbound	00:18:06	0
593965	99	44	30,10	cyclictest	275	-21	systemd-journal	00:05:00	0
593972	99	42	36,4	cyclictest	838498	-21	kworker/u8:3+events_unbound	23:37:57	2
593972	99	41	37,3	cyclictest	3425444	-21	kworker/u8:3+events_unbound	19:22:55	2
593965	99	41	37,3	cyclictest	735539	-21	kworker/u8:2+flush-8:0	21:33:12	0
593965	99	41	36,4	cyclictest	680098	-21	kworker/u8:3+events_unbound	21:08:09	0
593965	99	41	34,5	cyclictest	557014	-21	kworker/u8:0+events_unbound	22:08:04	0
593965	99	41	29,4	cyclictest	557014	-21	kworker/u8:0+events_unbound	20:40:03	0
593968	99	40	37,2	cyclictest	557014	-21	kworker/u8:0+flush-8:0	19:52:59	1
593965	99	40	35,4	cyclictest	854282	-21	kworker/u8:0+events_unbound	23:50:00	0
593965	99	40	35,3	cyclictest	893657	-21	kworker/u8:1+events_unbound	00:23:10	0
593972	99	39	34,4	cyclictest	3425444	-21	kworker/u8:3+events_unbound	19:18:10	2
593965	99	39	28,6	cyclictest	803681	-21	kworker/u8:2+flush-8:0	23:13:10	0
593972	99	38	32,4	cyclictest	854282	-21	kworker/u8:0+events_unbound	00:27:56	2
593965	99	38	35,2	cyclictest	557014	-21	kworker/u8:0+events_unbound	22:43:08	0
593965	99	38	34,3	cyclictest	854282	-21	kworker/u8:0+events_unbound	23:57:57	0
593965	99	38	34,3	cyclictest	854282	-21	kworker/u8:0+events_unbound	00:40:00	0
593965	99	38	34,3	cyclictest	750018	-21	kworker/u8:3+flush-8:0	21:58:08	0
593965	99	38	34,3	cyclictest	750018	-21	kworker/u8:3+flush-8:0	21:52:55	0
593965	99	37	33,3	cyclictest	680098	-21	kworker/u8:3+flush-8:0	20:48:09	0
593965	99	37	33,3	cyclictest	557014	-21	kworker/u8:0+flush-8:0	22:27:55	0
593965	99	37	32,3	cyclictest	635832	-21	kworker/u8:2+events_unbound	20:33:12	0
593965	99	37	28,4	cyclictest	883964	-21	kworker/u8:2+events_unbound	00:14:33	0
593968	99	36	29,5	cyclictest	705041	-21	grep	20:58:10	1
593968	99	36	28,6	cyclictest	3425444	-21	kworker/u8:3+flush-8:0	20:12:55	1
593965	99	36	32,3	cyclictest	854282	-21	kworker/u8:0+flush-8:0	23:44:34	0
593965	99	36	31,3	cyclictest	557014	-21	kworker/u8:0+events_unbound	19:55:00	0
593965	99	36	30,4	cyclictest	794912	-21	kworker/u8:1+events_unbound	22:37:52	0
593965	99	36	28,6	cyclictest	3425444	-21	kworker/u8:3+events_unbound	19:32:52	0
593965	99	36	27,4	cyclictest	557014	-21	kworker/u8:0+flush-8:0	20:35:02	0
593972	99	35	31,3	cyclictest	854282	-21	kworker/u8:0+flush-8:0	23:58:11	2
593968	99	35	28,5	cyclictest	557014	-21	kworker/u8:0+flush-8:0	21:18:07	1
593968	99	35	26,6	cyclictest	650626	-21	latency_hist	20:05:01	1
593965	99	35	31,3	cyclictest	635832	-21	kworker/u8:2+events_unbound	20:18:07	0
593965	99	35	30,3	cyclictest	557014	-21	kworker/u8:0+events_unbound	19:12:54	0
593965	99	35	29,4	cyclictest	557014	-21	kworker/u8:0+events_unbound	20:23:04	0
593965	99	35	29,4	cyclictest	557014	-21	kworker/u8:0+events_unbound	19:37:59	0
593965	99	35	29,4	cyclictest	3425444	-21	kworker/u8:3+events_unbound	20:08:13	0
593968	99	34	30,2	cyclictest	671561	-21	irqrtprio	20:27:56	1
593965	99	34	30,3	cyclictest	557014	-21	kworker/u8:0+flush-8:0	21:37:58	0
593965	99	34	30,3	cyclictest	557014	-21	kworker/u8:0+flush-8:0	19:15:09	0
589334	2	34	1,27	sleep0	0	-21	swapper/0	19:07:13	0
593972	99	33	29,3	cyclictest	3425444	-21	kworker/u8:3+flush-8:0	19:32:56	2
593965	99	33	29,3	cyclictest	854282	-21	kworker/u8:0+events_unbound	23:54:08	0
593965	99	33	29,3	cyclictest	680098	-21	kworker/u8:3+events_unbound	20:58:07	0
593965	99	33	29,3	cyclictest	557014	-21	kworker/u8:0+events_unbound	22:23:07	0
593965	99	33	29,3	cyclictest	557014	-21	kworker/u8:0+events_unbound	21:23:04	0
593972	99	32	28,3	cyclictest	854282	-21	kworker/u8:0+flush-8:0	23:52:55	2
593968	99	32	27,3	cyclictest	850189	-21	irqcore	23:27:57	1
593965	99	32	29,2	cyclictest	557014	-21	kworker/u8:0+events_unbound	19:48:05	0
593965	99	32	28,3	cyclictest	665417	-21	kworker/u8:1+events_unbound	21:43:16	0
593965	99	32	28,3	cyclictest	557014	-21	kworker/u8:0+flush-8:0	22:18:43	0
593965	99	32	24,3	cyclictest	557014	-21	kworker/u8:0+events_unbound	19:20:01	0
593787	2	32	4,9	sleep1	0	-21	swapper/1	19:09:47	1
593968	99	31	27,3	cyclictest	557014	-21	kworker/u8:0+flush-8:0	21:38:04	1
593968	99	31	22,6	cyclictest	849140	-21	latency_hist	23:25:01	1
593965	99	31	29,1	cyclictest	665417	-21	kworker/u8:1+events_unbound	22:13:11	0
593965	99	31	27,3	cyclictest	838498	-21	kworker/u8:3+events_unbound	23:23:12	0
593965	99	31	27,3	cyclictest	680098	-21	kworker/u8:3+events_unbound	20:52:56	0
593965	99	31	26,4	cyclictest	635832	-21	kworker/u8:2+flush-8:0	20:28:26	0
593965	99	31	23,3	cyclictest	893657	-21	kworker/u8:1+events_unbound	00:26:28	0
593965	99	31	23,3	cyclictest	750018	-21	kworker/u8:3+events_unbound	21:49:39	0
593736	2	31	4,10	sleep2	0	-21	swapper/2	19:09:08	2
593968	99	30	26,3	cyclictest	557014	-21	kworker/u8:0+flush-8:0	19:15:05	1
593968	99	30	20,8	cyclictest	780087	-21	/usr/sbin/munin	22:18:01	1
593965	99	30	23,5	cyclictest	838498	-21	kworker/u8:3+events_unbound	23:37:51	0
593965	99	30	2,27	cyclictest	700237	-21	kworker/0:1+events	21:13:10	0
593972	99	29	25,3	cyclictest	898602	-21	unixbench_singl	00:13:12	2
593972	99	29	21,6	cyclictest	700064	-21	cron	20:55:00	2
593972	99	29	20,7	cyclictest	809892	-21	aten2_r5power_p	22:47:52	2
593972	99	29	16,3	cyclictest	754406	1	mailstats	21:48:07	2
593968	99	29	24,4	cyclictest	665417	-21	kworker/u8:1+events_unbound	21:28:09	1
593965	99	29	25,3	cyclictest	854282	-21	kworker/u8:0+events_unbound	00:32:34	0
593965	99	29	25,3	cyclictest	803681	-21	kworker/u8:2+events_unbound	23:17:34	0
593965	99	29	25,3	cyclictest	557014	-21	kworker/u8:0+events_unbound	22:53:07	0
857414	2	28	0,6	sleep3	45	1	irq_work/3	23:33:00	3
593972	99	28	7,6	cyclictest	664535	-21	wc	20:18:02	2
593972	99	28	20,7	cyclictest	655335	-21	unixbench_singl	20:08:12	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17