OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System (updated Fri Dec 12, 2025 06:41:06)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
947342	99	79	72,3	cyclictest	0	-21	swapper/2	06:10:15	2
947340	99	72	50,19	cyclictest	1621425	-21	sh	06:10:06	0
947340	99	72	50,19	cyclictest	1621425	-21	sh	06:10:06	0
947340	99	72	50,19	cyclictest	1621425	-21	sh	06:10:06	0
947341	99	63	34,21	cyclictest	1194468	-21	wc	05:42:36	1
947341	99	63	34,21	cyclictest	1194468	-21	wc	05:42:36	1
947341	99	61	48,9	cyclictest	1205640	-21	pipe	05:58:49	1
947341	99	61	48,9	cyclictest	1205640	-21	pipe	05:58:49	1
947340	99	58	31,24	cyclictest	1635632	-21	looper	06:12:42	0
947341	99	55	47,5	cyclictest	1617224	-21	tee	06:09:15	1
947341	99	55	47,5	cyclictest	1617224	-21	tee	06:09:15	1
947341	99	55	47,5	cyclictest	1617224	-21	tee	06:09:15	1
947342	99	54	44,4	cyclictest	0	-21	swapper/2	06:04:33	2
947342	99	52	40,5	cyclictest	0	-21	swapper/2	06:09:51	2
947342	99	52	40,5	cyclictest	0	-21	swapper/2	06:09:51	2
947342	99	52	40,5	cyclictest	0	-21	swapper/2	06:09:51	2
947341	99	52	41,6	cyclictest	1165469	-21	tee	05:40:01	1
947341	99	52	41,6	cyclictest	1165469	-21	tee	05:40:01	1
947340	99	52	23,26	cyclictest	1189508	-21	rm	05:41:58	0
947340	99	52	23,26	cyclictest	1189508	-21	rm	05:41:58	0
947341	99	50	36,11	cyclictest	1622103	-21	sh	06:10:17	1
947342	99	49	40,6	cyclictest	1203674	-21	execl	05:50:07	2
947340	99	48	24,22	cyclictest	1338352	-21	spawn	06:03:31	0
947341	99	45	21,21	cyclictest	0	-21	swapper/1	05:50:05	1
947341	99	45	20,22	cyclictest	1342607	-21	spawn	06:04:04	1
947340	99	45	38,4	cyclictest	1165489	-21	sendmail	05:40:01	0
947340	99	45	38,4	cyclictest	1165489	-21	sendmail	05:40:01	0
947340	99	45	18,22	cyclictest	1205589	-21	fstime	05:57:14	0
947340	99	45	18,22	cyclictest	1205589	-21	fstime	05:57:14	0
947340	99	44	29,10	cyclictest	1016956	-21	spawn	05:34:26	0
947342	99	43	34,5	cyclictest	1176398	-21	sh	05:41:00	2
947342	99	43	34,5	cyclictest	1176398	-21	sh	05:41:00	2
947342	99	43	33,6	cyclictest	1165450	-21	cron	05:40:01	2
947342	99	43	33,6	cyclictest	1165450	-21	cron	05:40:01	2
947341	99	43	1,36	cyclictest	1649197	-21	ntpq	06:39:24	1
947342	99	42	35,4	cyclictest	1039873	-21	spawn	05:34:14	2
947341	99	42	1,36	cyclictest	949754	-21	ntpq	05:14:25	1
947342	99	41	32,6	cyclictest	954000	-21	systemd	05:30:02	2
947341	99	41	1,37	cyclictest	1643315	-21	ntpq	06:19:26	1
947341	99	41	1,25	cyclictest	952324	-21	execl	05:21:35	1
947340	99	41	11,2	cyclictest	0	-21	swapper/0	06:29:27	0
947342	99	40	32,5	cyclictest	950315	-21	Run	05:15:01	2
947342	99	40	32,5	cyclictest	1203673	-21	execl	05:50:02	2
947341	99	40	4,31	cyclictest	948327	-21	ntpq	05:09:30	1
947341	99	40	32,5	cyclictest	1203673	-21	execl	05:50:01	1
947341	99	40	1,35	cyclictest	952673	-21	fstime	05:28:27	1
947340	99	40	1,14	cyclictest	948368	-21	ps	05:09:31	0
947342	99	39	31,5	cyclictest	1205671	-21	Run	05:59:06	2
947342	99	39	31,5	cyclictest	1205671	-21	Run	05:59:06	2
947341	99	39	1,34	cyclictest	1647830	-21	ntpq	06:34:27	1
947341	99	39	1,32	cyclictest	1646312	-21	ntpq	06:29:30	1
947340	99	39	11,5	cyclictest	0	-21	swapper/0	05:50:44	0
947340	99	39	10,6	cyclictest	0	-21	swapper/0	05:50:02	0
947342	99	38	28,7	cyclictest	1643948	-21	latency_hist	06:20:02	2
947341	99	37	2,31	cyclictest	1644735	-21	ntpq	06:24:24	1
947341	99	37	2,31	cyclictest	1644735	-21	ntpq	06:24:24	1
947341	99	37	2,28	cyclictest	954213	-21	Run	05:30:37	1
947340	99	37	6,10	cyclictest	955	-21	mta-sts-daemon	06:34:21	0
947340	99	37	13,21	cyclictest	1643812	-21	cron	06:20:00	0
947340	99	37	12,2	cyclictest	0	-21	swapper/0	05:29:21	0
947340	99	37	11,4	cyclictest	949932	-21	sendmail_mailtr	05:14:32	0
947340	99	36	9,6	cyclictest	0	-21	swapper/0	06:25:00	0
947340	99	36	9,6	cyclictest	0	-21	swapper/0	06:25:00	0
947340	99	36	1,12	cyclictest	1649316	-21	ntpq	06:39:30	0
947341	99	35	1,29	cyclictest	951585	-21	processes	05:19:33	1
947342	99	33	25,5	cyclictest	1645889	-21	sort	06:29:20	2
947340	99	33	11,2	cyclictest	0	-21	swapper/0	05:19:19	0
947342	99	32	26,3	cyclictest	0	-21	swapper/2	05:19:38	2
947340	99	32	12,2	cyclictest	0	-21	swapper/0	05:25:01	0
947342	99	31	24,3	cyclictest	0	-21	swapper/2	06:35:01	2
947342	99	31	23,5	cyclictest	957	-21	mta-sts-daemon	05:20:22	2
947341	99	31	1,27	cyclictest	947298	-21	munin-run	05:05:01	1
947342	99	30	21,5	cyclictest	948773	-21	unixbench_singl	05:09:36	2
947342	99	29	20,6	cyclictest	1649867	-21	systemd-run	06:40:02	2
947342	99	26	18,5	cyclictest	830949	-21	cupsd	06:24:26	2
947342	99	26	18,5	cyclictest	830949	-21	cupsd	06:24:26	2
947342	99	20	16,2	cyclictest	0	-21	swapper/2	05:05:01	2
947340	99	20	16,2	cyclictest	0	-21	swapper/0	05:05:02	0
947343	99	17	2,7	cyclictest	0	-21	swapper/3	05:56:11	3
947343	99	17	2,7	cyclictest	0	-21	swapper/3	05:56:11	3
947343	99	16	5,6	cyclictest	0	-21	swapper/3	05:44:40	3
947343	99	16	5,6	cyclictest	0	-21	swapper/3	05:44:40	3
947343	99	16	4,6	cyclictest	0	-21	swapper/3	06:02:19	3
947343	99	16	2,7	cyclictest	0	-21	swapper/3	06:06:23	3
947343	99	16	2,7	cyclictest	0	-21	swapper/3	06:06:23	3
947343	99	16	2,7	cyclictest	0	-21	swapper/3	06:06:23	3
947343	99	15	3,4	cyclictest	0	-21	swapper/3	05:09:25	3
947343	99	15	1,7	cyclictest	0	-21	swapper/3	05:29:22	3
947343	99	14	6,5	cyclictest	0	-21	swapper/3	06:12:24	3
947343	99	14	4,7	cyclictest	0	-21	swapper/3	05:34:23	3
947343	99	13	3,5	cyclictest	0	-21	swapper/3	05:50:14	3
947343	99	13	2,5	cyclictest	0	-21	swapper/3	06:34:27	3
947343	99	13	1,6	cyclictest	0	-21	swapper/3	05:14:23	3
947343	99	12	3,5	cyclictest	0	-21	swapper/3	05:46:14	3
947343	99	12	1,6	cyclictest	0	-21	swapper/3	06:19:21	3
947343	99	11	1,6	cyclictest	0	-21	swapper/3	05:38:39	3
947343	99	11	1,6	cyclictest	0	-21	swapper/3	05:38:39	3
947343	99	10	2,4	cyclictest	0	-21	swapper/3	05:19:18	3
947343	99	10	1,5	cyclictest	0	-21	swapper/3	06:39:24	3
947343	99	9	3,4	cyclictest	0	-21	swapper/3	06:24:24	3
947343	99	9	3,4	cyclictest	0	-21	swapper/3	06:24:24	3
947343	99	9	1,5	cyclictest	0	-21	swapper/3	06:29:27	3
947343	99	9	1,5	cyclictest	0	-21	swapper/3	05:25:01	3
947343	99	9	0,6	cyclictest	43	1	ktimers/3	05:05:01	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17