OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rackfslot4s.osadl.org (updated Wed Dec 31, 2025 00:44:36)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
12479	2	258	0,3	sleep0	12480	-21	sleep	19:08:35	0
2524	2	127	0,2	chrt	2525	-21	sh	20:35:48	0
21824	2	127	0,3	chrt	21825	-21	aten2.4-expect	20:15:27	0
2771	2	124	0,2	chrt	2772	-21	runrttasks	19:45:18	0
7929	2	122	0,2	sleep0	7930	-21	runrttasks	22:23:38	0
32114	2	120	0,3	sleep0	32113	-21	seq	23:48:33	0
10224	2	119	0,3	chrt	10218	-21	ntpq	19:56:17	0
688	2	118	0,3	chrt	685	-21	ntpq	19:40:56	0
7421	2	117	0,2	sleep0	7423	-21	runrttasks	00:00:30	0
25087	2	116	0,2	chrt	25086	-21	/usr/sbin/munin	20:20:33	0
12941	2	116	0,2	chrt	12940	-21	seq	20:52:38	0
4588	2	114	0,3	chrt	4587	-21	awk	21:30:33	0
32329	2	114	0,2	chrt	32330	-21	/usr/sbin/munin	00:37:17	0
854	2	112	0,2	chrt	855	-21	runrttasks	21:24:56	0
31023	2	112	0,2	chrt	31024	-21	cat	22:10:09	0
20514	2	109	0,2	chrt	20513	-21	seq	21:54:15	0
18445	2	109	0,2	chrt	18446	-21	sh	21:01:21	0
19197	2	106	0,2	chrt	19198	-21	sleep	19:19:57	0
26152	2	105	0,2	sleep0	26153	-21	runrttasks	21:14:14	0
26047	2	104	0,3	chrt	26048	-21	if_err_can0	22:51:01	0
12676	2	103	0,2	chrt	12677	-21	runrttasks	00:07:30	0
29439	2	102	0,2	sleep0	29441	-21	chrt	23:45:01	0
9665	2	101	0,2	chrt	9666	-21	sh	20:47:10	0
26615	2	97	0,2	sleep0	26618	-21	cut	19:30:45	0
13987	2	97	0,2	sleep0	13988	-21	runrttasks	21:44:32	0
20866	2	86	0,2	sleep0	20864	-21	kernelversion	19:21:39	0
24560	2	85	0,1	sleep0	24562	-21	cut	22:00:34	0
23478	2	82	0,2	sleep0	23480	-21	cut	23:35:53	0
14747	2	82	0,2	sleep0	14750	-21	sed	20:55:45	0
3603	2	81	0,3	chrt	3589	-21	ssh	23:54:40	0
17445	2	78	0,2	sleep0	17447	-21	ntp_kernel_pll_	23:26:24	0
4327	2	76	0,2	sleep0	4328	-21	seq	23:06:47	0
8869	2	75	0,2	sleep0	8870	-21	/usr/sbin/munin	21:36:12	0
29580	2	75	0,2	sleep0	29579	-21	/usr/sbin/munin	22:07:22	0
10155	2	73	0,2	sleep0	10156	-21	sh	22:26:43	0
17656	2	71	0,2	sleep0	17657	-21	cut	21:50:05	0
22953	2	69	0,1	sleep0	22954	-21	chrt	00:23:09	0
17438	2	68	0,1	sleep0	17439	-21	runrttasks	22:37:34	0
21805	2	67	0,1	sleep0	21807	-21	tr	23:33:04	0
14461	2	65	0,2	sleep0	14462	-21	chrt	22:33:22	0
3190	2	58	0,1	sleep0	3210	-21	missed_timers	22:16:16	0
23938	2	58	0,1	sleep0	23935	-21	timerandwakeup	22:47:21	0
21048	2	58	0,3	sleep0	21045	-21	ssh	22:43:12	0
19053	2	56	5,40	sleep0	19097	-21	sleep	20:10:41	0
16152	2	56	3,44	sleep0	16179	-21	latency_hist	19:15:03	0
15407	2	54	2,7	sleep0	15393	-21	ssh	00:11:47	0
30145	2	53	3,41	sleep0	7315	-21	runrttasks	22:56:50	0
22194	2	53	3,42	sleep0	22191	-21	memory	21:56:17	0
7168	2	52	3,8	sleep0	7179	-21	open_files	19:51:22	0
29311	2	52	3,41	sleep0	29312	-21	users	00:32:28	0
20212	2	52	2,7	sleep0	20218	-21	apt-get	21:05:13	0
18275	2	51	3,8	sleep0	18297	-21	cron	20:09:59	0
7009	2	50	0,2	sleep0	7074	-21	cut	23:11:05	0
23105	2	50	3,38	sleep0	23111	-21	df_inode	19:25:32	0
31254	2	49	3,39	sleep0	31258	-21	chrt	19:38:19	0
13072	90	48	18,22	cyclictest	0	-21	swapper	21:27:39	0
13072	90	46	17,22	cyclictest	0	-21	swapper	00:17:42	0
32521	2	45	0,3	chrt	32520	-21	seq	23:00:52	0
24121	2	45	0,2	sleep0	24123	-21	cut	00:25:34	0
15288	2	45	2,5	sleep0	15292	-21	ssh	23:23:24	0
9592	2	44	0,4	sleep0	9590	-21	ssh	23:15:28	0
13072	90	44	15,21	cyclictest	0	-21	swapper	21:19:04	0
13072	90	42	6,8	cyclictest	5866	-21	ntpq	20:41:06	0
13072	90	42	5,9	cyclictest	31260	-21	df_inode	20:30:31	0
13072	90	42	4,19	cyclictest	5381	-21	ssh	23:56:45	0
13072	90	41	5,28	cyclictest	29121	-21	ntp_states	20:26:19	0
13072	90	38	11,19	cyclictest	12058	-21	apt-get	20:00:13	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39