OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rackfslot4s.osadl.org (updated Sun Aug 09, 2026 00:44:35)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
30181	2	190	0,2	sleep0	30182	-21	chrt	19:05:13	0
26919	2	123	0,3	chrt	26914	-21	python3	22:22:16	0
18656	2	123	0,2	chrt	18657	-21	/usr/sbin/munin	20:30:38	0
12003	2	122	0,2	chrt	12004	-21	runrttasks	22:49:10	0
12949	2	120	0,4	chrt	12947	-21	users	21:12:46	0
5341	2	118	0,2	chrt	5343	-21	runrttasks	22:39:11	0
13323	2	117	0,3	chrt	13324	-21	chrt	19:30:17	0
20423	2	116	0,3	chrt	20425	-21	runrttasks	23:50:29	0
32476	2	115	0,4	chrt	32477	-21	runrttasks	00:07:47	0
4580	2	114	0,2	chrt	4581	-21	chrt	21:00:16	0
22599	2	114	0,2	chrt	22598	-21	seq	19:45:09	0
17595	2	114	0,3	chrt	17596	-21	modprobe	21:20:06	0
32666	2	113	0,3	chrt	32667	-21	seq	23:20:10	0
323	2	113	0,1	sleep0	325	-21	latency	22:31:10	0
9199	2	111	0,4	chrt	9200	-21	runrttasks	23:33:08	0
27857	2	110	0,2	chrt	27860	-21	chrt	20:45:25	0
23870	2	110	0,3	chrt	23873	-21	cut	23:06:48	0
8827	2	109	0,2	sleep0	8838	-21	ntp_offset	21:06:05	0
26398	2	108	0,3	chrt	26399	-21	sleep	21:32:37	0
13971	2	107	0,3	chrt	13969	-21	ld	22:51:39	0
4818	2	106	0,2	chrt	4817	-21	ssh	21:49:47	0
31917	2	103	0,2	sleep0	31918	-21	seq	20:51:01	0
7517	2	98	0,1	sleep0	7518	-21	chrt	21:53:18	0
6526	2	95	0,2	sleep0	6527	-21	sh	23:29:41	0
20387	2	95	0,2	sleep0	20388	-21	seq	00:38:47	0
25884	2	93	0,2	sleep0	25885	-21	cat	20:41:40	0
12326	2	88	0,2	sleep0	12327	-21	chrt	23:37:55	0
4110	2	87	0,2	sleep0	4111	-21	chrt	00:14:39	0
18445	2	86	0,2	sleep0	18446	-21	ld	23:46:43	0
24117	2	84	0,2	sleep0	24118	-21	chrt	21:30:01	0
13014	2	84	0,2	chrt	12987	-21	ntpq	22:01:21	0
14567	2	82	0,3	chrt	14218	-21	apt-get	21:15:49	0
22508	2	81	0,2	sleep0	22509	-21	if_eth1	22:16:03	0
4058	2	80	0,2	sleep0	4060	-21	chrt	19:15:23	0
5541	2	79	0,1	sleep0	5544	-21	cut	00:16:11	0
3137	2	73	0,2	sleep0	3138	-21	seq	20:56:41	0
30863	2	69	0,2	sleep0	30864	-21	chrt	23:16:53	0
10658	2	65	0,2	sleep0	10659	-21	seq	00:24:16	0
15352	2	64	0,2	sleep0	15354	-21	head	22:05:34	0
28596	2	60	0,2	sleep0	28592	-21	telnet	22:25:34	0
721	90	59	29,23	cyclictest	25780	-21	sh	23:57:42	0
721	90	58	25,23	cyclictest	20539	-21	rm	23:01:29	0
721	90	58	25,23	cyclictest	10444	-21	users	20:16:32	0
15666	2	57	0,1	sleep0	15668	-21	ls	00:31:15	0
721	90	56	23,13	cyclictest	13017	-21	python3	00:27:16	0
721	90	55	26,21	cyclictest	29148	-21	munin-run	23:15:02	0
721	90	55	24,22	cyclictest	9863	-21	ntpq	21:56:44	0
721	90	55	22,22	cyclictest	5694	-21	/usr/sbin/munin	20:10:25	0
721	90	55	22,14	cyclictest	28932	-21	ntpq	21:36:32	0
721	90	54	34,12	cyclictest	28315	-21	ssh	00:01:31	0
721	90	54	31,15	cyclictest	1937	-21	ntpq	19:10:58	0
721	90	54	25,19	cyclictest	31599	-21	seq	21:40:58	0
721	90	54	23,22	cyclictest	13997	-21	telnet	23:40:35	0
721	90	54	22,22	cyclictest	6328	-21	df_inode	22:40:41	0
721	90	54	21,13	cyclictest	32291	-21	df	20:00:30	0
721	90	54	21,13	cyclictest	17694	-21	ntp_states	19:36:17	0
721	90	53	29,15	cyclictest	7090	-21	apt-get	19:20:14	0
721	90	53	21,22	cyclictest	0	-21	swapper	22:10:11	0
721	90	53	20,15	cyclictest	2922	-21	/usr/sbin/munin	20:05:28	0
721	90	52	30,13	cyclictest	22310	-21	ntpq	20:35:57	0
721	90	52	24,11	cyclictest	15868	-21	apt-get	22:55:13	0
721	90	52	23,20	cyclictest	13091	-21	ntpq	20:21:03	0
721	90	52	23,15	cyclictest	22441	-21	apt	19:45:00	0
721	90	52	22,22	cyclictest	30316	-21	python3	19:56:25	0
721	90	52	20,12	cyclictest	26712	-21	memory	19:50:54	0
721	90	51	23,21	cyclictest	10207	-21	apt-get	19:25:17	0
721	90	50	26,14	cyclictest	15040	-21	apt-get	20:25:23	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39