OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rackfslot4s.osadl.org (updated Wed Aug 12, 2026 00:44:35)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
25317	2	118	0,2	chrt	25318	-21	seq	22:05:54	0
22176	2	118	0,3	chrt	22177	-21	sh	00:26:19	0
18333	2	116	0,1	sleep0	18334	-21	seq	22:43:47	0
12027	2	115	0,2	chrt	12026	-21	/usr/sbin/munin	21:46:01	0
9663	2	113	0,2	sleep0	9664	-21	seq	21:42:13	0
7542	2	113	0,2	chrt	7534	-21	python3	22:27:21	0
28738	2	112	0,2	chrt	28737	-21	smartctl	22:11:00	0
15597	2	112	0,2	chrt	15599	-21	cron	19:20:01	0
13146	2	112	0,2	chrt	13147	-21	seq	00:12:50	0
14817	2	111	0,2	chrt	14818	-21	modprobe	23:26:28	0
28609	2	110	0,2	sleep0	28611	-21	tr	23:47:16	0
23040	2	110	0,2	chrt	23041	-21	seq	23:39:30	0
2628	2	108	0,2	chrt	2629	-21	chrt	23:08:49	0
10421	2	108	0,2	chrt	10422	-21	runrttasks	20:55:21	0
7431	2	107	0,2	chrt	7434	-21	modprobe	00:05:00	0
12738	2	107	0,3	chrt	12739	-21	chrt	23:23:39	0
7387	2	105	0,3	chrt	7388	-21	cpuspeed	23:15:57	0
22637	2	104	0,3	chrt	22634	-21	ld	22:01:25	0
2878	2	103	0,3	chrt	2884	-21	irqrtprio	19:50:41	0
12314	2	103	0,2	chrt	12316	-21	sh	20:06:24	0
8562	2	98	0,2	sleep0	8564	-21	cut	00:06:07	0
11774	2	96	0,2	sleep0	11775	-21	seq	22:34:08	0
9301	2	94	0,2	sleep0	9302	-21	seq	20:52:36	0
497	2	93	0,1	sleep0	498	-21	seq	22:16:56	0
28792	2	91	0,2	sleep0	28790	-21	open_inodes	21:22:20	0
23906	2	83	0,2	sleep0	23907	-21	cut	21:15:37	0
31444	2	82	0,2	chrt	31428	-21	ntpq	20:35:54	0
1099	2	82	0,2	sleep0	1100	-21	chrt	20:40:17	0
2758	2	80	0,2	sleep0	2759	-21	seq	23:57:15	0
32748	2	78	0,1	sleep0	32747	-21	ld	19:46:05	0
13957	2	75	0,2	sleep0	13958	-21	chrt	21:00:53	0
32422	2	72	0,2	sleep0	32423	-21	sh	21:27:30	0
14767	2	70	0,2	sleep0	14768	-21	rm	21:50:30	0
5461	2	66	0,2	sleep0	5462	-21	seq	19:55:26	0
21671	2	65	0,2	sleep0	21669	-21	dpkg	21:11:55	0
32367	2	63	0,1	sleep0	32370	-21	latency_hist	23:05:04	0
26249	2	61	3,9	sleep0	26262	-21	users	00:32:22	0
19243	2	60	4,10	sleep0	19247	-21	ntpq	00:22:06	0
23580	2	59	3,7	sleep0	23589	-21	ld	19:31:45	0
21610	2	59	3,16	sleep0	439	-21	sh	19:29:26	0
29514	2	58	3,8	sleep0	29522	-21	ntpq	19:40:54	0
18849	2	57	0,1	sleep0	18848	-21	seq	23:32:24	0
18441	2	57	0,1	sleep0	18444	-21	uniq	20:15:37	0
19962	2	55	2,6	sleep0	20019	-21	timerwakeupswit	21:57:28	0
16487	2	55	4,8	sleep0	16529	-21	cut	19:20:44	0
30900	2	54	0,2	sleep0	30898	-21	if_eth1	23:51:02	0
10849	2	54	3,7	sleep0	7315	-21	runrttasks	19:11:14	0
28721	2	53	4,42	sleep0	28722	-21	ssh	00:36:15	0
17407	2	53	3,9	sleep0	17443	-21	sendmail-msp	00:20:02	0
7526	2	52	10,28	sleep0	7532	-21	ntpq	19:05:47	0
4603	2	52	3,6	sleep0	4608	-21	ssh	22:23:01	0
10721	2	52	3,41	sleep0	10725	-21	sleep	20:03:16	0
3447	2	51	3,9	sleep0	3431	-21	ssh	23:10:30	0
22426	2	51	0,2	sleep0	22429	-21	seq	22:50:17	0
1647	2	51	3,6	sleep0	1620	-21	ssh	21:30:40	0
15213	2	51	0,2	sleep0	15214	-21	chrt	20:10:32	0
17120	2	49	3,7	sleep0	17046	-21	apt-get	21:05:27	0
9454	90	47	18,21	cyclictest	0	-21	swapper	22:48:58	0
6161	2	47	3,7	sleep0	6163	-21	ssh	21:36:58	0
21806	2	46	0,3	chrt	21808	-21	irqrtprio	20:20:43	0
9454	90	45	5,21	cyclictest	27648	-21	diskstats	20:30:32	0
9454	90	45	17,9	cyclictest	25733	-21	/usr/sbin/munin	22:55:38	0
9454	90	45	15,23	cyclictest	0	-21	swapper	23:42:46	0
9454	90	44	13,13	cyclictest	0	-21	swapper	19:39:45	0
9454	90	43	6,10	cyclictest	5447	-21	ntpq	20:46:17	0
9454	90	41	4,18	cyclictest	24720	-21	hddtemp_smartct	20:25:39	0
9454	90	41	16,19	cyclictest	13976	-21	ntpq	22:37:05	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39