OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot4s.osadl.org (updated Fri May 15, 2026 00:44:15)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
73245	99	75	66,6	cyclictest	298314	-21	kworker/u8:1+events_unbound	23:26:06	1
73241	99	68	34,25	cyclictest	323839	-21	latency_hist	23:20:01	0
73245	99	65	57,6	cyclictest	84093	-21	ntpq	19:16:03	1
73247	99	64	58,4	cyclictest	324084	-21	kworker/u8:0+flush-8:0	23:41:09	2
73245	99	64	56,6	cyclictest	189930	-21	kworker/u8:3+flush-8:0	22:01:08	1
73241	99	64	52,8	cyclictest	268741	-21	latency_hist	22:25:01	0
73241	99	64	40,21	cyclictest	353491	-21	latency_hist	23:50:01	0
73241	99	64	40,21	cyclictest	353491	-21	latency_hist	23:50:01	0
73245	99	63	58,3	cyclictest	194532	-21	kworker/u8:4+events_unbound	22:36:09	1
73245	99	62	57,3	cyclictest	324084	-21	kworker/u8:0+events_unbound	23:35:54	1
73245	99	61	51,7	cyclictest	3440679	-21	kworker/u8:3+flush-8:0	20:06:04	1
73245	99	60	55,3	cyclictest	78300	-21	kworker/u8:1+flush-8:0	19:40:00	1
73245	99	60	53,5	cyclictest	78300	-21	kworker/u8:1+flush-8:0	19:51:05	1
73245	99	60	51,7	cyclictest	3440679	-21	kworker/u8:3+flush-8:0	20:16:08	1
73245	99	59	51,6	cyclictest	193611	-21	apt-get	21:06:09	1
73245	99	58	53,4	cyclictest	67982	-21	kworker/u8:2+events_unbound	20:25:52	1
73245	99	58	52,4	cyclictest	3440679	-21	kworker/u8:3+events_unbound	19:11:07	1
73245	99	58	52,4	cyclictest	189930	-21	kworker/u8:3+events_unbound	22:00:01	1
73245	99	58	49,7	cyclictest	324084	-21	kworker/u8:0+flush-8:0	23:56:05	1
73245	99	57	51,4	cyclictest	67982	-21	kworker/u8:2+flush-8:0	20:46:04	1
73245	99	57	49,7	cyclictest	78300	-21	kworker/u8:1+flush-8:0	20:01:08	1
73241	99	57	51,5	cyclictest	194532	-21	kworker/u8:4+flush-8:0	22:11:05	0
73245	99	56	51,4	cyclictest	189930	-21	kworker/u8:3+events_unbound	23:20:01	1
73245	99	55	50,4	cyclictest	3440679	-21	kworker/u8:3+events_unbound	20:10:57	1
73241	99	55	48,5	cyclictest	338868	-21	kworker/u8:2+flush-8:0	23:51:06	0
73245	99	54	50,3	cyclictest	189930	-21	kworker/u8:3+events_unbound	21:26:08	1
73245	99	54	49,3	cyclictest	3440679	-21	kworker/u8:3+events_unbound	19:26:08	1
73245	99	54	48,4	cyclictest	67982	-21	kworker/u8:2+flush-8:0	19:31:04	1
73245	99	54	48,4	cyclictest	3440679	-21	kworker/u8:3+flush-8:0	19:41:03	1
73245	99	54	47,5	cyclictest	3440679	-21	kworker/u8:3+flush-8:0	19:56:07	1
73245	99	53	45,6	cyclictest	268836	-21	cp	22:25:01	1
73241	99	53	48,3	cyclictest	67982	-21	kworker/u8:2+events_unbound	19:26:10	0
73245	99	52	46,4	cyclictest	67982	-21	kworker/u8:2+events_unbound	20:21:09	1
73241	99	52	30,19	cyclictest	153835	-21	ntpq	20:26:01	0
73245	99	51	45,4	cyclictest	189930	-21	kworker/u8:3+events_unbound	21:21:07	1
73245	99	51	45,4	cyclictest	147066	-21	kworker/u8:0+flush-8:0	22:50:01	1
73245	99	51	42,7	cyclictest	253936	-21	latency_hist	22:10:01	1
73245	99	50	44,4	cyclictest	78300	-21	kworker/u8:1+events_unbound	20:36:04	1
73245	99	50	44,4	cyclictest	67982	-21	kworker/u8:2+flush-8:0	20:56:03	1
73245	99	50	44,4	cyclictest	194532	-21	kworker/u8:4+events_unbound	22:26:03	1
73241	99	50	43,5	cyclictest	284391	-21	apt-get	22:40:51	0
73245	99	49	44,4	cyclictest	194532	-21	kworker/u8:4+events_unbound	21:45:52	1
73245	99	49	44,4	cyclictest	189930	-21	kworker/u8:3+events_unbound	21:31:07	1
73245	99	49	43,5	cyclictest	298314	-21	kworker/u8:1+flush-8:0	23:21:05	1
73245	99	49	42,5	cyclictest	189930	-21	kworker/u8:3+flush-8:0	23:11:04	1
73245	99	49	42,5	cyclictest	147066	-21	kworker/u8:0+flush-8:0	22:56:04	1
73241	99	49	45,3	cyclictest	3440679	-21	kworker/u8:3+events_unbound	19:46:04	0
73241	99	49	40,6	cyclictest	224034	-21	latency_hist	21:40:01	0
73245	99	48	42,4	cyclictest	3440679	-21	kworker/u8:3+events_unbound	19:45:53	1
73245	99	48	41,5	cyclictest	147066	-21	kworker/u8:0+flush-8:0	22:51:12	1
73245	99	48	41,5	cyclictest	147066	-21	kworker/u8:0+events_unbound	20:31:06	1
73241	99	48	45,2	cyclictest	85	50	irq/124-ahci[0000:00:12.0]	22:01:05	0
73241	99	48	41,5	cyclictest	213210	-21	ntpq	21:26:04	0
73247	99	47	41,4	cyclictest	67982	-21	kworker/u8:2+flush-8:0	20:51:03	2
73245	99	47	41,4	cyclictest	147066	-21	kworker/u8:0+events_unbound	20:50:52	1
73245	99	46	40,5	cyclictest	147066	-21	kworker/u8:0+events_unbound	20:41:07	1
73245	99	46	40,4	cyclictest	378762	-21	apt-get	00:15:50	1
73245	99	46	40,4	cyclictest	378762	-21	apt-get	00:15:50	1
73245	99	46	40,4	cyclictest	324084	-21	kworker/u8:0+flush-8:0	00:26:05	1
73245	99	46	39,5	cyclictest	324084	-21	kworker/u8:0+flush-8:0	23:31:04	1
73241	99	46	25,19	cyclictest	104991	-21	latency_hist	19:40:00	0
73245	99	45	39,4	cyclictest	67982	-21	kworker/u8:2+flush-8:0	19:20:58	1
73245	99	45	38,5	cyclictest	303944	-21	kworker/u8:2+flush-8:0	23:06:05	1
73241	99	45	25,16	cyclictest	298768	-21	grep	22:51:11	0
357875	2	45	0,3	chrt	75	-21	kworker/3:1-events	23:51:10	3
73245	99	44	37,5	cyclictest	280	-21	systemd-journal	00:06:35	1
73241	99	44	37,5	cyclictest	388652	-21	/usr/sbin/munin	00:26:02	0
73241	99	44	27,14	cyclictest	198944	-21	grep	21:11:10	0
73241	99	44	24,17	cyclictest	189274	-21	latency_hist	21:05:00	0
73241	99	43	18,22	cyclictest	363363	-21	latency_hist	00:00:01	0
73245	99	42	37,4	cyclictest	194532	-21	kworker/u8:4+events_unbound	22:15:54	1
73245	99	42	35,5	cyclictest	189930	-21	kworker/u8:3+flush-8:0	00:31:06	1
73241	99	42	25,15	cyclictest	308663	-21	grep	23:01:11	0
73241	99	42	22,18	cyclictest	164190	-21	unixbench_multi	20:36:10	0
73241	99	42	22,17	cyclictest	234154	-21	latency_hist	21:50:01	0
73241	99	42	1,11	cyclictest	589	-21	runrttasks	23:06:06	0
73245	99	41	36,3	cyclictest	324084	-21	kworker/u8:0+events_unbound	00:01:03	1
73245	99	41	36,3	cyclictest	147066	-21	kworker/u8:0+events_unbound	21:36:10	1
73245	99	41	33,6	cyclictest	189930	-21	kworker/u8:3+flush-8:0	23:01:04	1
73241	99	41	36,3	cyclictest	67982	-21	kworker/u8:2+flush-8:0	20:21:05	0
73241	99	41	25,14	cyclictest	333398	-21	unixbench_singl	23:26:11	0
73247	99	40	35,4	cyclictest	338868	-21	kworker/u8:2+events_unbound	00:16:07	2
73247	99	40	35,4	cyclictest	338868	-21	kworker/u8:2+events_unbound	00:16:07	2
73245	99	40	35,4	cyclictest	147066	-21	kworker/u8:0+flush-8:0	21:16:09	1
73245	99	40	33,5	cyclictest	338868	-21	kworker/u8:2+flush-8:0	00:21:06	1
73241	99	40	23,14	cyclictest	279145	-21	apt-key	22:35:01	0
73245	99	39	33,4	cyclictest	189930	-21	kworker/u8:3+flush-8:0	21:11:04	1
73245	99	39	32,5	cyclictest	194532	-21	kworker/u8:4+flush-8:0	21:41:05	1
73245	99	39	32,5	cyclictest	194532	-21	kworker/u8:4+flush-8:0	21:41:05	1
73241	99	39	29,8	cyclictest	183411	-21	ntpq	20:56:02	0
73241	99	39	24,13	cyclictest	143846	-21	needreboot	20:16:01	0
73241	99	39	17,19	cyclictest	194303	-21	latency_hist	21:10:01	0
254102	2	39	0,2	sleep3	75	-21	kworker/3:1-events	22:10:01	3
73247	99	38	34,3	cyclictest	194532	-21	kworker/u8:4+events_unbound	22:31:08	2
73247	99	38	34,2	cyclictest	284069	-21	/usr/sbin/munin	22:40:01	2
73247	99	38	32,4	cyclictest	368300	-21	apt-get	00:05:01	2
73245	99	38	33,4	cyclictest	194532	-21	kworker/u8:4+flush-8:0	22:31:03	1
73245	99	38	31,5	cyclictest	353798	-21	apt-get	23:50:49	1
73241	99	38	32,4	cyclictest	324226	-21	grep	23:20:51	0
73241	99	38	31,5	cyclictest	393587	-21	/usr/sbin/munin	00:31:02	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17