OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rackfslot4s.osadl.org (updated Sun Jan 11, 2026 00:44:36)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2026	2	123	0,1	sleep0	2029	-21	runrttasks	00:08:33	0
16354	2	123	0,2	sleep0	16355	-21	chrt	22:52:39	0
30391	2	121	0,2	chrt	30389	-21	grep	21:37:20	0
12809	2	119	0,2	chrt	12810	-21	sleep	00:25:06	0
24729	2	118	0,3	chrt	24727	-21	ld	19:45:54	0
23571	2	118	0,3	chrt	23572	-21	seq	23:03:40	0
10143	2	118	0,2	chrt	10146	-21	wc	21:06:25	0
29838	2	117	0,2	sleep0	29844	-21	gcc	20:46:00	0
29348	2	117	0,3	chrt	29349	-21	sleep	23:12:11	0
12909	2	117	0,2	chrt	12908	-21	seq	19:26:35	0
7121	2	116	0,2	sleep0	7161	-21	cat	23:27:21	0
9815	2	115	0,2	chrt	9814	-21	awk	00:20:34	0
8911	2	113	0,2	chrt	8910	-21	/usr/sbin/munin	22:41:18	0
20298	2	113	0,2	sleep0	20296	-21	sendmail_mailst	23:47:13	0
12594	2	113	0,3	chrt	12595	-21	sleep	22:46:57	0
3507	2	112	0,2	chrt	3506	-21	seq	23:22:04	0
2883	2	112	0,2	sleep0	2884	-21	chrt	22:32:23	0
21814	2	111	0,2	chrt	21811	-21	users	22:12:47	0
16559	2	111	0,2	chrt	16560	-21	sleep	21:16:36	0
32470	2	110	0,3	chrt	32471	-21	ssh	21:40:51	0
21963	2	110	0,3	chrt	21964	-21	sleep	20:34:04	0
5112	2	109	0,3	chrt	5113	-21	sleep	21:47:55	0
25363	2	109	0,2	sleep0	25364	-21	runrttasks	21:30:27	0
19549	2	109	0,2	chrt	19552	-21	cut	21:21:08	0
19493	2	109	0,2	chrt	19494	-21	sed	22:10:04	0
3737	2	107	0,2	chrt	3738	-21	sh	20:56:13	0
16363	2	107	0,2	chrt	16362	-21	awk	00:30:32	0
24988	2	105	0,2	chrt	24991	-21	timerandwakeup	22:17:29	0
22268	2	104	0,2	chrt	22269	-21	runrttasks	00:39:08	0
610	2	103	0,2	chrt	613	-21	aten2.4_rfpower	20:00:24	0
20209	2	102	0,4	chrt	20210	-21	sh	19:39:38	0
28914	2	99	0,2	chrt	28915	-21	sh	19:52:54	0
31353	2	92	0,1	sleep0	31354	-21	grep	19:56:26	0
23334	2	90	0,2	sleep0	23336	-21	irqrtprio	20:35:43	0
16053	2	90	0,2	sleep0	16054	-21	latency_hist	20:25:06	0
5427	2	86	0,2	sleep0	5429	-21	grep	19:15:34	0
5510	2	82	0,2	sleep0	5511	-21	seq	22:36:59	0
14093	2	79	0,1	sleep0	14094	-21	rm	22:01:15	0
7306	2	77	0,2	sleep0	7307	-21	if_can0	20:10:42	0
24681	2	77	0,2	sleep0	24683	-21	grep	23:05:38	0
28784	2	76	0,2	sleep0	28785	-21	chrt	00:00:30	0
25587	2	75	0,1	sleep0	25589	-21	chrt	23:55:45	0
12656	2	75	0,2	sleep0	12657	-21	chrt	21:59:53	0
15852	2	73	0,2	sleep0	15853	-21	sh	23:40:56	0
14513	2	71	0,2	sleep0	14516	-21	rm	23:38:55	0
11861	2	71	0,2	sleep0	11860	-21	seq	21:10:17	0
1578	2	70	0,2	sleep0	1579	-21	chrt	23:19:51	0
9456	2	65	0,2	sleep0	9457	-21	sort	00:20:05	0
9082	2	64	0,1	sleep0	9083	-21	fschecks_count	23:30:51	0
4403	2	64	0,2	sleep0	4404	-21	chrt	00:11:55	0
32628	2	60	0,2	sleep0	32630	-21	cut	20:50:43	0
24955	2	59	4,44	sleep0	24973	-21	apt-get	23:55:00	0
28273	2	57	2,7	sleep0	28286	-21	ntpq	22:22:31	0
17271	2	57	5,8	sleep0	17261	-21	munin-run	19:35:02	0
19203	2	54	3,8	sleep0	19191	-21	ntp_states	22:56:53	0
10523	2	54	0,1	sleep0	10619	-21	cut	20:15:44	0
23532	2	53	0,2	sleep0	23531	-21	ld	21:27:03	0
1371	2	53	9,33	sleep0	1375	-21	sh	19:09:10	0
30200	2	52	2,7	sleep0	30185	-21	ssh	22:25:36	0
16383	2	51	4,36	sleep0	15903	-21	apt-get	20:25:25	0
7146	2	50	0,1	sleep0	7148	-21	irqrtprio	21:51:08	0
2407	2	48	2,38	sleep0	2412	-21	hddtemp_smartct	19:10:38	0
1752	90	45	14,13	cyclictest	0	-21	swapper	19:41:53	0
1752	90	42	5,20	cyclictest	9768	-21	users	19:21:30	0
4533	2	40	0,2	sleep0	4534	-21	kernelversion	20:05:47	0
1752	90	39	7,12	cyclictest	25980	-21	df_inode	20:40:31	0
1752	90	39	4,9	cyclictest	5987	-21	diskstats	21:00:35	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39