OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rackfslot4s.osadl.org (updated Sun Jul 12, 2026 12:44:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
31032	2	125	0,3	chrt	31035	-21	sh	11:00:00	0
30253	2	119	0,2	chrt	30227	-21	ntpq	11:46:58	0
5686	2	118	0,2	chrt	5689	-21	missed_timers	10:21:18	0
24902	2	118	0,2	sleep0	24905	-21	aten2.4_rfpower	10:50:38	0
13127	2	118	0,2	chrt	13128	-21	runrttasks	07:11:16	0
29865	2	116	0,2	chrt	29868	-21	fschecks_count	09:21:28	0
12228	2	116	0,2	chrt	12229	-21	ld	08:00:58	0
24509	2	114	0,3	chrt	24510	-21	/usr/sbin/munin	12:27:12	0
18040	2	113	0,3	chrt	17944	-21	apt-get	10:40:26	0
17350	2	112	0,2	chrt	17349	-21	/usr/sbin/munin	09:50:50	0
379	2	111	0,2	chrt	380	-21	latency_hist	12:40:07	0
10948	2	110	0,2	chrt	10949	-21	sleep	12:06:43	0
16408	2	109	0,2	sleep0	16409	-21	chrt	09:49:25	0
1430	2	109	0,1	sleep0	1433	-21	switchtime	11:52:19	0
2353	2	108	0,2	chrt	2354	-21	awk	11:05:34	0
14795	2	108	0,2	chrt	14794	-21	seq	11:24:04	0
30775	2	107	0,3	chrt	30777	-21	sleep	10:10:49	0
27710	2	107	0,2	chrt	27711	-21	sh	08:25:53	0
7065	2	106	0,2	chrt	7069	-21	irqrtprio	12:01:04	0
8664	2	103	0,2	sleep0	8667	-21	grep	09:37:21	0
2940	2	103	0,1	sleep0	2943	-21	grep	10:17:14	0
30006	2	102	0,3	chrt	30007	-21	sh	07:38:39	0
25520	2	97	0,2	sleep0	25524	-21	irqrtprio	07:31:34	0
14664	2	96	0,2	chrt	14665	-21	sleep	08:56:57	0
30007	2	95	0,2	sleep0	30010	-21	head	08:30:26	0
25625	2	95	0,2	sleep0	25626	-21	seq	10:02:37	0
28207	2	93	0,2	sleep0	28209	-21	cut	10:06:52	0
16124	2	90	0,2	sleep0	16126	-21	chrt	09:00:25	0
840	2	89	0,2	sleep0	841	-21	rm	09:26:25	0
25650	2	87	0,1	sleep0	25652	-21	cut	11:40:35	0
24586	2	87	0,2	sleep0	24587	-21	chrt	08:20:50	0
27593	2	82	0,2	sleep0	27595	-21	timerwakeupswit	09:17:30	0
23888	2	79	0,2	sleep0	23889	-21	chrt	11:37:17	0
8790	2	78	8,17	sleep0	8860	-21	aten2.4_rfpower	07:05:23	0
12439	2	78	0,2	sleep0	12427	-21	ntpq	10:31:28	0
19603	2	75	0,2	sleep0	19599	-21	swap	07:21:29	0
32297	2	71	0,2	sleep0	32298	-21	uname	11:01:12	0
5066	2	70	0,2	sleep0	5067	-21	seq	11:57:52	0
18986	2	69	0,2	sleep0	18987	-21	aten2.4_rfpower	11:30:35	0
18657	2	63	0,2	sleep0	18658	-21	seq	08:11:21	0
15513	2	60	0,1	sleep0	15514	-21	chrt	08:06:15	0
6000	2	58	0,1	sleep0	5998	-21	nfs4_client	07:51:42	0
11699	90	58	30,22	cyclictest	6734	-21	ntpq	11:11:33	0
11699	90	57	24,13	cyclictest	21381	-21	ntpq	09:56:20	0
11699	90	56	32,16	cyclictest	19084	-21	runrttasks	09:05:13	0
11699	90	55	34,13	cyclictest	1256	-21	irqrtprio	08:35:44	0
11699	90	55	24,21	cyclictest	14426	-21	ssh	12:12:00	0
16257	2	54	0,2	sleep0	16259	-21	cut	12:15:30	0
11699	90	54	23,22	cyclictest	10008	-21	ssh	11:16:30	0
11699	90	54	23,13	cyclictest	9224	-21	ntpq	10:26:39	0
11699	90	54	23,11	cyclictest	28690	-21	sh	12:33:49	0
11699	90	54	22,13	cyclictest	10526	-21	diskstats	09:40:49	0
11699	90	54	21,23	cyclictest	21600	-21	runrttasks	08:16:04	0
11699	90	54	21,23	cyclictest	15377	-21	apt-get	11:25:10	0
11699	90	54	20,13	cyclictest	16064	-21	ntpq	07:16:01	0
11699	90	53	31,14	cyclictest	5063	-21	ntpq	09:32:08	0
11699	90	53	30,13	cyclictest	15175	-21	df	10:36:01	0
11699	90	53	24,20	cyclictest	7315	-21	runrttasks	08:45:48	0
11699	90	53	22,22	cyclictest	412	-21	snmpd	07:25:44	0
11699	90	53	21,13	cyclictest	8006	-21	apt-get	07:55:54	0
11699	90	53	19,15	cyclictest	22849	-21	hddtemp_smartct	09:10:58	0
11699	90	52	29,16	cyclictest	21719	-21	diskstats	10:45:48	0
11699	90	52	27,15	cyclictest	32060	-21	ntpq	07:41:23	0
11699	90	52	25,18	cyclictest	7315	-21	runrttasks	12:20:16	0
11699	90	51	21,15	cyclictest	4770	-21	ntpq	08:41:10	0
11699	90	51	21,13	cyclictest	9745	-21	apt-get	08:50:19	0
11699	90	51	19,13	cyclictest	2328	-21	memory	07:45:48	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39