OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rackfslot4s.osadl.org (updated Tue May 19, 2026 00:44:36)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
11557	2	144	0,2	sleep0	11558	-21	chrt	22:44:49	0
15958	2	137	0,2	sleep0	15959	-21	ssh	23:40:11	0
3601	2	130	0,2	chrt	3603	-21	awk	00:10:32	0
10869	2	123	0,3	chrt	10868	-21	/usr/sbin/munin	00:21:02	0
3271	2	121	0,3	chrt	3270	-21	/usr/sbin/munin	22:31:59	0
14264	2	120	0,2	sleep0	14302	-21	sh	22:00:36	0
20534	2	119	0,2	chrt	20528	-21	ntpq	23:46:23	0
12126	2	118	0,3	chrt	12127	-21	seq	20:15:58	0
10596	2	118	0,3	chrt	10594	-21	ntpq	19:21:14	0
26132	2	116	0,3	chrt	26130	-21	ld	19:46:16	0
25003	2	116	0,3	chrt	25006	-21	latency_hist	23:05:04	0
14928	2	116	0,3	chrt	14927	-21	sleep	22:49:57	0
18965	2	115	0,3	chrt	18962	-21	ntp_states	22:06:56	0
8717	2	114	0,4	chrt	8718	-21	/usr/sbin/munin	21:51:38	0
20347	2	114	0,2	chrt	20346	-21	seq	21:20:54	0
22260	2	113	0,2	chrt	22235	-21	ssh	00:37:25	0
4227	2	112	0,1	sleep0	4226	-21	awk	21:45:35	0
15738	2	112	0,2	chrt	15739	-21	chrt	21:14:05	0
29089	2	111	0,2	chrt	29090	-21	runrttasks	21:33:57	0
29699	2	110	0,2	chrt	29700	-21	sleep	22:22:54	0
24148	2	110	0,2	chrt	24141	-21	ps	20:35:44	0
1687	2	110	0,1	sleep0	1688	-21	chrt	23:18:14	0
932	2	109	0,2	chrt	935	-21	awk	21:40:35	0
25980	2	109	0,2	chrt	25981	-21	basename	22:17:23	0
24661	2	107	0,2	chrt	24662	-21	sleep	21:27:01	0
9927	2	105	0,3	chrt	9928	-21	sh	21:05:21	0
13754	2	105	0,4	chrt	13755	-21	sleep	21:59:51	0
15951	2	98	0,2	sleep0	15952	-21	chrt	00:28:33	0
16580	2	96	0,2	sleep0	16581	-21	basename	21:15:36	0
31824	2	91	0,2	sleep0	31825	-21	chrt	00:03:42	0
27630	2	91	0,2	sleep0	27631	-21	seq	23:08:33	0
19536	2	91	0,2	sleep0	19537	-21	chrt	00:33:51	0
21742	2	87	0,2	sleep0	21745	-21	sort	23:00:06	0
23155	2	81	0,2	sleep0	23156	-21	chrt	22:13:19	0
1944	2	81	0,2	sleep0	1945	-21	tail	20:00:24	0
7520	2	79	0,2	sleep0	7522	-21	chrt	22:38:09	0
29772	2	78	0,2	sleep0	29773	-21	chrt	21:35:16	0
10107	2	77	0,1	sleep0	10108	-21	if_eth2	23:31:02	0
2738	90	75	6,11	cyclictest	20344	-21	apt-get	20:30:23	0
2738	90	75	5,58	cyclictest	22633	-21	irqstats	19:40:48	0
2738	90	74	5,59	cyclictest	3066	-21	ssh	23:20:43	0
2738	90	74	5,12	cyclictest	6541	-21	diskstats	19:15:33	0
27953	2	73	0,2	sleep0	27954	-21	chrt	19:50:13	0
2738	90	73	6,11	cyclictest	15767	-21	munin-run	23:40:01	0
2738	90	73	6,10	cyclictest	4454	-21	hddtemp_smartct	20:56:28	0
2738	90	73	5,10	cyclictest	32347	-21	ntp_states	22:27:05	0
2738	90	73	18,45	cyclictest	12916	-21	perl	19:25:35	0
2738	90	73	14,11	cyclictest	6779	-21	/usr/sbin/munin	21:00:44	0
2738	90	72	6,10	cyclictest	16297	-21	sshd	20:22:55	0
2738	90	72	5,57	cyclictest	412	-21	snmpd	20:52:42	0
2738	90	72	5,11	cyclictest	4619	-21	ntp_states	19:12:02	0
2738	90	72	5,11	cyclictest	16671	-21	ntp_states	22:51:52	0
2738	90	72	11,53	cyclictest	32575	-21	apt-get	00:05:19	0
2738	90	71	6,56	cyclictest	31562	-21	kworker/u2:0	23:51:28	0
2738	90	71	6,55	cyclictest	7816	-21	python3	23:27:14	0
2738	90	71	6,12	cyclictest	28072	-21	python3	20:41:26	0
2738	90	71	5,9	cyclictest	18407	-21	ld	20:26:03	0
2738	90	71	5,17	cyclictest	16711	-21	ntpq	19:31:06	0
2738	90	71	5,10	cyclictest	32285	-21	ntp_states	19:56:11	0
2738	90	71	5,10	cyclictest	29073	-21	fw_packets	23:10:54	0
2738	90	71	4,10	cyclictest	6056	-21	ntp_states	20:06:11	0
2738	90	71	3,10	cyclictest	8488	-21	ps	00:17:12	0
2738	90	70	8,9	cyclictest	29672	-21	apt-get	20:45:16	0
2738	90	70	5,57	cyclictest	19615	-21	memory	19:35:54	0
2738	90	70	14,8	cyclictest	27018	-21	memory	23:56:08	0
2738	90	69	6,10	cyclictest	7921	-21	apt-get	20:10:16	0
2738	90	65	9,10	cyclictest	2757	-21	cat	19:10:03	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39