OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot4s.osadl.org (updated Tue Nov 25, 2025 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1077441	2	71	0,4	sleep0	1077434	-21	ntpq	20:26:23	0
997285	99	70	64,4	cyclictest	1158320	-21	kworker/u8:2+events_unbound	21:51:27	1
997285	99	67	61,4	cyclictest	1232389	-21	kworker/u8:2+flush-8:0	23:16:24	1
997285	99	67	60,5	cyclictest	1183057	-21	kworker/u8:1+events_unbound	23:26:23	1
997285	99	67	57,7	cyclictest	1075544	-21	apt-get	20:26:19	1
997285	99	63	52,7	cyclictest	1127981	-21	latency_hist	21:20:01	1
997282	99	62	42,17	cyclictest	1138104	-21	latency_hist	21:30:01	0
1272584	2	62	0,3	chrt	586	-21	kworker/3:2-events	23:46:11	3
1272584	2	62	0,3	chrt	586	-21	kworker/3:2-events	23:46:11	3
997285	99	61	56,3	cyclictest	1183057	-21	kworker/u8:1+flush-8:0	22:36:27	1
997285	99	61	55,5	cyclictest	945057	-21	kworker/u8:3+flush-8:0	19:21:22	1
997285	99	60	54,5	cyclictest	160499	-21	kworker/u8:0+flush-8:0	21:31:24	1
997285	99	60	54,4	cyclictest	1158320	-21	kworker/u8:2+events_unbound	22:01:25	1
997285	99	60	52,6	cyclictest	1118315	-21	kworker/u8:3+flush-8:0	21:36:25	1
997285	99	60	50,7	cyclictest	1167987	-21	latency_hist	22:00:01	1
997285	99	58	47,8	cyclictest	1177054	-21	ntpq	22:06:22	1
997285	99	57	52,3	cyclictest	1108430	-21	kworker/u8:1+events_unbound	21:06:23	1
997285	99	57	50,5	cyclictest	1272396	-21	kworker/u8:3+flush-8:0	23:51:24	1
997285	99	56	52,3	cyclictest	1118315	-21	kworker/u8:3+events_unbound	22:51:27	1
997285	99	56	52,3	cyclictest	1118315	-21	kworker/u8:3+events_unbound	22:51:27	1
997285	99	56	51,4	cyclictest	1212844	-21	kworker/u8:0+flush-8:0	23:11:24	1
997285	99	56	51,3	cyclictest	160499	-21	kworker/u8:0+events_unbound	20:01:16	1
997285	99	56	50,4	cyclictest	1183057	-21	kworker/u8:1+flush-8:0	22:56:28	1
1177982	2	56	0,3	sleep0	0	-21	swapper/0	22:10:01	0
997285	99	55	51,3	cyclictest	997417	-21	kworker/u8:1+events_unbound	19:36:27	1
997285	99	55	50,4	cyclictest	945057	-21	kworker/u8:3+events_unbound	20:36:12	1
997285	99	55	49,5	cyclictest	945057	-21	kworker/u8:3+flush-8:0	20:16:25	1
997285	99	55	47,6	cyclictest	1316938	-21	kworker/u8:1+flush-8:0	00:31:26	1
997282	99	55	35,17	cyclictest	1122218	-21	ntpq	21:11:25	0
997282	99	55	31,21	cyclictest	1113731	-21	diskstats	21:06:13	0
1070262	2	55	0,6	sleep3	0	-21	swapper/3	20:21:20	3
997285	99	54	49,4	cyclictest	160499	-21	kworker/u8:0+flush-8:0	20:46:24	1
997285	99	54	49,3	cyclictest	1108430	-21	kworker/u8:1+events_unbound	21:01:20	1
997285	99	54	47,5	cyclictest	160499	-21	kworker/u8:0+flush-8:0	19:51:23	1
997285	99	54	45,7	cyclictest	1158320	-21	kworker/u8:2+flush-8:0	22:11:23	1
997282	99	54	34,18	cyclictest	1032887	-21	ntpq	19:41:24	0
997282	99	54	34,18	cyclictest	1032887	-21	ntpq	19:41:24	0
1183403	2	54	0,3	sleep2	37	1	rcuc/2	22:16:13	2
997285	99	53	48,4	cyclictest	945057	-21	kworker/u8:3+events_unbound	19:56:21	1
997285	99	53	47,5	cyclictest	160499	-21	kworker/u8:0+flush-8:0	20:56:25	1
997285	99	53	47,4	cyclictest	1043835	-21	kworker/u8:2+events_unbound	20:06:21	1
997285	99	52	47,3	cyclictest	1118315	-21	kworker/u8:3+events_unbound	22:41:23	1
997285	99	52	43,7	cyclictest	1183139	-21	/usr/sbin/munin	22:16:22	1
997285	99	52	42,8	cyclictest	1092318	-21	ntpq	20:41:24	1
997285	99	51	46,3	cyclictest	1212844	-21	kworker/u8:0+flush-8:0	23:56:30	1
997285	99	51	46,3	cyclictest	1212844	-21	kworker/u8:0+flush-8:0	23:56:30	1
997285	99	50	46,3	cyclictest	1272396	-21	kworker/u8:3+events_unbound	00:21:25	1
997285	99	50	42,6	cyclictest	1183057	-21	kworker/u8:1+events_unbound	23:31:24	1
997285	99	50	40,8	cyclictest	1023101	-21	ntpq	19:31:26	1
997285	99	49	43,4	cyclictest	1272396	-21	kworker/u8:3+events_unbound	00:26:23	1
997285	99	48	42,5	cyclictest	997417	-21	kworker/u8:1+flush-8:0	19:26:25	1
997285	99	48	42,4	cyclictest	1212844	-21	kworker/u8:0+flush-8:0	00:16:24	1
997285	99	48	41,5	cyclictest	1212844	-21	kworker/u8:0+flush-8:0	23:01:25	1
997285	99	48	41,5	cyclictest	1212844	-21	kworker/u8:0+flush-8:0	00:11:25	1
997285	99	47	43,3	cyclictest	1232389	-21	kworker/u8:2+events_unbound	23:25:00	1
997285	99	47	42,3	cyclictest	160499	-21	kworker/u8:0+events_unbound	21:25:01	1
997285	99	46	41,4	cyclictest	160499	-21	kworker/u8:0+flush-8:0	20:51:22	1
997285	99	46	40,5	cyclictest	1282519	-21	kworker/u8:2+flush-8:0	00:01:23	1
997285	99	46	39,5	cyclictest	1183057	-21	kworker/u8:1+flush-8:0	23:06:24	1
997285	99	46	39,5	cyclictest	1183057	-21	kworker/u8:1+flush-8:0	22:26:24	1
997285	99	45	40,3	cyclictest	1271297	-21	ntpq	23:41:22	1
997285	99	45	40,3	cyclictest	1271297	-21	ntpq	23:41:22	1
997285	99	45	39,5	cyclictest	1043835	-21	kworker/u8:2+flush-8:0	20:21:19	1
997285	99	45	39,4	cyclictest	160499	-21	kworker/u8:0+flush-8:0	19:16:14	1
997285	99	45	38,5	cyclictest	1212844	-21	kworker/u8:0+flush-8:0	23:46:24	1
997285	99	45	38,5	cyclictest	1212844	-21	kworker/u8:0+flush-8:0	23:46:24	1
997282	99	45	35,8	cyclictest	1252948	-21	diskstats	23:26:14	0
997285	99	44	40,3	cyclictest	1118315	-21	kworker/u8:3+events_unbound	22:35:00	1
997285	99	44	38,4	cyclictest	997417	-21	kworker/u8:1+flush-8:0	19:41:25	1
997285	99	44	38,4	cyclictest	997417	-21	kworker/u8:1+flush-8:0	19:41:25	1
997282	99	44	37,5	cyclictest	1157008	-21	ntpq	21:46:24	0
997282	99	44	30,9	cyclictest	282	-21	systemd-journal	00:01:19	0
997282	99	44	26,16	cyclictest	829	-21	mta-sts-daemon	22:35:00	0
997285	99	43	38,4	cyclictest	160499	-21	kworker/u8:0+events_unbound	21:41:17	1
997285	99	43	38,4	cyclictest	1118315	-21	kworker/u8:3+flush-8:0	21:26:28	1
997285	99	43	38,3	cyclictest	1232389	-21	kworker/u8:2+flush-8:0	23:36:20	1
997285	99	43	34,7	cyclictest	997132	-21	latency_hist	19:10:01	1
997282	99	43	33,7	cyclictest	282	-21	systemd-journal	20:24:59	0
997282	99	43	24,16	cyclictest	1163050	-21	latency_hist	21:55:01	0
997287	99	42	35,5	cyclictest	1297217	-21	cat	00:10:01	2
997285	99	42	35,5	cyclictest	160499	-21	kworker/u8:0+events_unbound	21:46:14	1
997282	99	42	33,7	cyclictest	1102997	-21	apt-get	20:55:01	0
997282	99	42	23,17	cyclictest	1312280	-21	munin-plugin-st	00:25:01	0
997282	99	42	23,16	cyclictest	1058416	-21	cron	20:10:00	0
997285	99	41	35,5	cyclictest	997417	-21	kworker/u8:1+flush-8:0	19:11:25	1
997282	99	41	22,17	cyclictest	1043223	-21	unixbench_multi	19:51:31	0
997282	99	41	19,8	cyclictest	1282627	-21	apt-get	23:56:10	0
997282	99	41	19,8	cyclictest	1282627	-21	apt-get	23:56:09	0
997282	99	41	19,3	cyclictest	1128302	-21	latency_hist	21:20:01	0
997285	99	40	36,3	cyclictest	1043835	-21	kworker/u8:2+events_unbound	20:11:24	1
997285	99	40	34,4	cyclictest	1118315	-21	kworker/u8:3+flush-8:0	21:11:19	1
997282	99	40	22,16	cyclictest	1009004	-21	cron	19:20:00	0
997282	99	40	22,16	cyclictest	0	-21	swapper/0	23:31:15	0
997282	99	40	19,3	cyclictest	1083232	-21	idleruntime-cro	20:35:00	0
997282	99	40	18,4	cyclictest	0	-21	swapper/0	21:36:19	0
997282	99	40	17,7	cyclictest	1317201	-21	cron	00:30:01	0
997282	99	40	1,17	cyclictest	587	-21	runrttasks	00:06:11	0
997285	99	39	34,4	cyclictest	1043835	-21	kworker/u8:2+flush-8:0	20:31:28	1
997282	99	39	18,8	cyclictest	1067495	-21	ntpq	20:16:27	0
997287	99	38	30,5	cyclictest	1277126	-21	apt-get	23:50:00	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17