OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack9slot8s.osadl.org (updated Mon Dec 08, 2025 00:44:46)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
818	50	170	0,0	irq/46-4a100000	646	-21	runrttasks	19:08:51	0
822	99	75	50,0	cyclictest	24736	-21	ssh	21:20:51	0
822	99	75	43,0	cyclictest	2109	-21	apt-get	00:00:20	0
822	99	75	38,0	cyclictest	25839	-21	rm	23:41:15	0
822	99	74	59,0	cyclictest	5332	-21	apt-config	19:35:00	0
822	99	74	55,0	cyclictest	13071	-21	latency_hist	22:04:58	0
822	99	74	48,0	cyclictest	1810	-21	ssh	21:40:46	0
822	99	73	54,0	cyclictest	14479	-21	sh	00:25:51	0
822	99	73	45,0	cyclictest	9003	-21	ssh	00:14:29	0
822	99	73	45,0	cyclictest	5157	-21	http	19:34:54	0
822	99	73	41,0	cyclictest	28834	-21	sh	21:29:42	0
822	99	72	50,0	cyclictest	14405	-21	ssh	22:07:51	0
822	99	72	48,0	cyclictest	7566	-21	munin-run	19:49:53	0
822	99	72	47,0	cyclictest	21232	-21	ssh	22:22:22	0
822	99	72	41,0	cyclictest	22830	-21	ssh	23:35:01	0
822	99	72	39,0	cyclictest	989	-21	seq	23:57:34	0
822	99	72	33,0	cyclictest	9136	-21	ssh	23:05:40	0
822	99	71	52,0	cyclictest	17202	-21	ssh	22:13:53	0
822	99	71	46,0	cyclictest	8076	-21	ssh	23:03:33	0
822	99	71	33,0	cyclictest	17598	-21	ssh	00:32:30	0
822	99	70	53,0	cyclictest	20724	-21	ssh	21:12:30	0
822	99	70	48,0	cyclictest	30426	-21	ssh	21:32:58	0
822	99	70	46,0	cyclictest	13632	-21	seq	00:24:12	0
822	99	70	44,0	cyclictest	17764	-21	ssh	23:24:12	0
822	99	70	34,0	cyclictest	9057	-21	ssh	21:56:22	0
822	99	69	47,0	cyclictest	22056	-21	ssh	21:15:13	0
822	99	69	45,0	cyclictest	19444	-21	diskmemload	22:34:38	0
822	99	69	37,0	cyclictest	10931	-21	kworker/u2:1	00:40:01	0
822	99	68	51,0	cyclictest	1683	-21	munin-node	19:14:58	0
822	99	68	48,0	cyclictest	4020	-21	munin-run	22:54:59	0
822	99	68	48,0	cyclictest	27987	-21	sh	23:45:51	0
822	99	68	46,0	cyclictest	10781	-21	sshd	20:11:10	0
822	99	68	43,0	cyclictest	12028	-21	kworker/u2:4	23:19:59	0
822	99	68	42,0	cyclictest	9035	-21	latency_hist	19:59:54	0
822	99	68	37,0	cyclictest	2769	-21	kworker/u2:10	00:20:01	0
822	99	67	48,0	cyclictest	4390	-21	runrttasks	19:29:50	0
822	99	67	47,0	cyclictest	30697	-21	ssh	22:42:41	0
822	99	67	46,0	cyclictest	502	-21	ssh	21:38:22	0
822	99	67	45,0	cyclictest	27280	-21	ssh	22:35:15	0
822	99	67	40,0	cyclictest	6231	-21	sshd	19:40:06	0
822	99	67	40,0	cyclictest	25072	-21	ssh	23:39:50	0
822	99	67	36,0	cyclictest	30165	-21	ssh	23:50:30	0
822	99	67	36,0	cyclictest	12745	-21	modprobe	23:13:32	0
822	99	67	34,0	cyclictest	8003	-21	ssh	21:54:14	0
822	99	67	34,0	cyclictest	22896	-21	ssh	22:25:54	0
822	99	67	31,0	cyclictest	10165	-21	sshd	20:07:07	0
822	99	66	50,0	cyclictest	1556	-21	munin-run	19:14:52	0
822	99	66	45,0	cyclictest	19013	-21	ssh	22:17:43	0
822	99	66	43,0	cyclictest	17527	-21	kworker/u2:0	21:09:55	0
822	99	66	43,0	cyclictest	14609	-21	sshd	20:37:12	0
822	99	66	42,0	cyclictest	32026	-21	ssh	22:45:26	0
822	99	66	42,0	cyclictest	12007	-21	sendmail	20:19:54	0
822	99	66	41,0	cyclictest	5022	-21	ssh	22:57:00	0
822	99	66	33,0	cyclictest	18456	-21	ssh	23:25:30	0
822	99	65	49,0	cyclictest	16781	-21	kworker/u2:6	20:59:53	0
822	99	65	38,0	cyclictest	5730	-21	ssh	00:07:26	0
822	99	65	38,0	cyclictest	4214	-21	ssh	21:45:56	0
822	99	64	40,0	cyclictest	12287	-21	sshd	20:21:10	0
822	99	63	47,0	cyclictest	13632	-21	sshd	20:30:11	0
822	99	63	41,0	cyclictest	18568	-21	sshd	21:03:56	0
822	99	63	27,0	cyclictest	9224	-21	runrttasks	20:00:23	0
822	99	62	48,0	cyclictest	14490	-21	kworker/u2:1	20:48:14	0
822	99	62	45,0	cyclictest	16698	-21	runrttasks	20:50:53	0
822	99	61	48,0	cyclictest	11585	-21	kworker/u2:2	20:25:29	0
822	99	61	40,0	cyclictest	15547	-21	sshd	20:43:29	0
822	99	60	44,0	cyclictest	8323	-21	sed	19:54:53	0
822	99	60	42,0	cyclictest	3439	-21	sshd	19:23:06	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17