OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot4s.osadl.org (updated Wed Apr 29, 2026 12:44:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
15484	2	131	0,3	chrt	15485	-21	sh	11:43:24	0
3323	2	128	0,3	chrt	3314	-21	ssh	11:25:34	0
4413	2	125	0,3	chrt	4408	-21	ntpq	07:16:05	0
10371	2	124	0,3	chrt	10372	-21	date	12:25:05	0
9378	2	120	0,4	chrt	9367	-21	ntp_states	08:16:17	0
31825	2	119	0,2	sleep0	31826	-21	runrttasks	12:07:45	0
17024	2	116	0,2	chrt	17025	-21	runrttasks	10:08:42	0
7478	2	115	0,3	chrt	7477	-21	/usr/sbin/munin	11:31:09	0
2895	2	113	0,4	chrt	2892	-21	irqrtprio	10:36:03	0
26184	2	113	0,2	chrt	26185	-21	/usr/sbin/munin	11:10:57	0
21506	2	113	0,3	chrt	21507	-21	seq	11:03:48	0
28685	2	112	0,1	sleep0	28686	-21	chrt	09:37:21	0
20076	2	112	0,3	chrt	20074	-21	ld	07:41:14	0
16221	2	111	0,1	sleep0	16225	-21	seq	12:33:19	0
12584	2	111	0,3	chrt	12585	-21	seq	11:39:29	0
790	2	110	0,2	sleep0	833	-21	grep	11:21:09	0
32078	2	110	0,3	chrt	32079	-21	chrt	09:42:24	0
8509	2	108	0,2	sleep0	8510	-21	chrt	10:44:52	0
30780	2	108	0,2	sleep0	30784	-21	latency	08:50:47	0
17933	2	108	0,2	sleep0	17936	-21	aten2.4_rfpower	10:10:33	0
24872	2	107	0,2	chrt	24873	-21	seq	11:08:56	0
18774	2	107	0,2	chrt	18775	-21	chrt	09:22:28	0
24027	2	106	0,2	chrt	24028	-21	sleep	07:47:51	0
15797	2	106	0,2	chrt	15798	-21	sh	09:18:14	0
9721	2	105	0,2	chrt	9722	-21	sleep	09:09:41	0
12236	2	103	0,2	chrt	12237	-21	runrttasks	10:50:10	0
11746	2	102	0,3	chrt	11747	-21	sleep	07:28:15	0
27443	2	100	0,2	sleep0	27445	-21	latency	12:01:10	0
12092	2	95	0,2	sleep0	12093	-21	seq	12:26:59	0
23066	2	93	0,2	sleep0	23067	-21	seq	11:55:24	0
21512	2	89	0,2	sleep0	21510	-21	nfs4_client	08:35:49	0
3660	2	88	0,2	sleep0	3661	-21	seq	09:48:45	0
28005	2	88	0,2	sleep0	28006	-21	ld	08:46:12	0
12965	2	88	0,2	sleep0	12966	-21	runrttasks	09:14:27	0
30497	2	86	0,1	sleep0	30498	-21	seq	10:28:53	0
25948	2	86	0,2	sleep0	25949	-21	chrt	10:21:43	0
20423	2	85	0,1	sleep0	20422	-21	ls	12:40:06	0
2233	2	80	0,2	sleep0	2229	-21	diskstats	08:05:31	0
23542	2	79	0,2	sleep0	23543	-21	chrt	09:30:24	0
15760	2	79	0,2	sleep0	15761	-21	chrt	10:55:32	0
24149	2	73	0,2	sleep0	24150	-21	chrt	08:40:37	0
10636	2	71	0,2	sleep0	10637	-21	chrt	09:59:26	0
11381	2	70	0,2	sleep0	11382	-21	/usr/sbin/munin	08:20:23	0
9293	2	69	0,1	sleep0	9294	-21	apt	07:25:01	0
1931	2	69	0,2	sleep0	1919	-21	ntpq	12:11:39	0
29660	2	64	0,2	sleep0	29661	-21	awk	11:16:02	0
3863	2	62	0,2	sleep0	3865	-21	awk	09:00:26	0
32445	90	61	40,13	cyclictest	1209	-21	ssh	10:33:28	0
32445	90	59	41,12	cyclictest	21663	-21	ld	09:26:54	0
32445	90	57	34,14	cyclictest	8588	-21	apt-get	10:46:37	0
32445	90	56	35,14	cyclictest	11329	-21	aten2.4_rfpower	10:00:35	0
23269	2	56	0,2	sleep0	23274	-21	seq	10:17:40	0
572	2	54	0,2	sleep0	624	-21	fschecks_time	07:10:36	0
32445	90	54	36,11	cyclictest	17211	-21	threads	07:36:25	0
32445	90	54	34,13	cyclictest	31566	-21	df_inode	08:00:29	0
32445	90	54	32,14	cyclictest	19865	2	chrt	08:33:45	0
32445	90	53	37,11	cyclictest	5000	-21	ssh	09:50:54	0
32445	90	53	32,14	cyclictest	7315	-21	runrttasks	12:15:37	0
32445	90	53	32,13	cyclictest	2553	-21	sleep	08:57:41	0
32445	90	53	32,12	cyclictest	29066	-21	memory	07:55:48	0
32445	90	52	31,12	cyclictest	20921	-21	ntpq	11:51:23	0
32445	90	51	34,9	cyclictest	11	-21	ksoftirqd/0	08:26:24	0
32445	90	51	34,7	cyclictest	24992	-21	apt-get	07:50:10	0
32445	90	51	33,12	cyclictest	19005	-21	ssh	11:48:53	0
32445	90	50	31,12	cyclictest	412	-21	snmpd	07:30:05	0
32445	90	49	28,13	cyclictest	4970	-21	/usr/sbin/munin	08:10:33	0
29561	2	48	14,19	sleep0	29494	-21	apt-get	07:05:31	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39