OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot4s.osadl.org (updated Tue Jul 14, 2026 00:44:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
18818	2	130	0,2	chrt	18819	-21	sleep	00:14:10	0
9953	2	129	0,2	sleep0	9954	-21	chrt	22:23:44	0
12989	2	123	0,2	chrt	12974	-21	ntp_states	23:16:51	0
9689	2	121	0,2	chrt	9691	-21	grep	21:35:01	0
2069	2	119	0,2	sleep0	2070	-21	fschecks_time	23:00:52	0
18476	2	118	0,4	chrt	18475	-21	sshd	19:15:13	0
17993	2	118	0,2	chrt	17994	-21	/usr/sbin/munin	22:35:57	0
14104	2	117	0,3	chrt	14105	-21	latency_hist	20:00:03	0
11188	2	117	0,2	sleep0	11189	-21	chrt	21:36:30	0
12619	2	115	0,1	sleep0	12620	-21	timerandwakeup	22:27:22	0
8365	2	113	0,3	chrt	8366	-21	sleep	20:41:58	0
3903	2	113	0,2	sleep0	3901	-21	ssh	21:25:59	0
3102	2	113	0,2	chrt	3104	-21	latency_hist	21:25:04	0
14063	2	113	0,3	chrt	14065	-21	irqrtprio	21:41:05	0
30663	2	110	0,2	chrt	30664	-21	sleep	00:31:11	0
4927	2	108	0,3	chrt	4930	-21	cut	22:16:05	0
27401	2	108	0,2	sleep0	27404	-21	tr	21:12:27	0
1074	2	107	0,3	chrt	1075	-21	seq	22:59:30	0
30674	2	106	0,2	sleep0	30680	-21	cut	22:06:05	0
21559	2	103	0,2	chrt	21560	-21	sleep	21:03:12	0
17878	2	101	0,2	chrt	17879	-21	sh	20:56:40	0
28510	2	92	0,2	sleep0	28511	-21	seq	00:28:01	0
5879	2	91	0,2	sleep0	5877	-21	kernelversion	23:06:10	0
21634	2	91	0,1	sleep0	21635	-21	seq	19:20:17	0
24738	2	86	0,2	sleep0	24739	-21	chrt	19:25:18	0
19664	2	86	0,3	chrt	19185	-21	apt-get	00:15:22	0
2411	2	85	0,2	sleep0	2406	-21	open_inodes	22:12:14	0
23615	2	83	0,2	sleep0	23616	-21	chrt	21:55:45	0
5734	2	82	0,2	sleep0	5737	-21	munin-run	23:55:00	0
3672	2	82	0,2	sleep0	3674	-21	wc	00:40:10	0
12259	2	79	8,23	sleep0	12227	-21	apt-get	19:05:18	0
24684	2	77	0,1	sleep0	24685	-21	chrt	23:34:33	0
19689	2	77	0,2	sleep0	19690	-21	chrt	21:50:02	0
32432	2	74	0,2	sleep0	32434	-21	switchtime	19:36:29	0
29188	2	72	0,2	sleep0	29189	-21	chrt	21:15:27	0
16128	2	72	0,1	sleep0	16129	-21	sed	23:21:49	0
31068	2	69	0,1	sleep0	31069	-21	seq	23:43:53	0
15909	2	67	0,2	sleep0	15912	-21	wc	00:10:03	0
3541	2	60	4,7	sleep0	3501	-21	apt-get	20:35:16	0
1118	2	60	5,44	sleep0	7315	-21	runrttasks	23:47:16	0
10477	2	59	3,9	sleep0	10479	-21	irqstats	00:01:12	0
29811	2	58	0,2	sleep0	29813	-21	seq	20:25:19	0
26548	2	58	0,2	sleep0	26549	-21	seq	22:00:17	0
25346	2	58	0,2	sleep0	25347	-21	seq	00:23:23	0
24461	2	58	0,2	sleep0	24463	-21	wc	20:15:49	0
20852	2	55	3,8	sleep0	20857	-21	chrt	23:28:42	0
2606	2	54	4,9	sleep0	2618	-21	ntpq	19:40:53	0
881	2	53	3,40	sleep0	935	-21	tune2fs	20:30:40	0
15475	2	53	2,43	sleep0	15465	-21	ssh	22:31:47	0
17021	2	50	3,38	sleep0	17025	-21	users	19:11:34	0
11283	2	49	0,2	sleep0	11287	-21	chrt	23:15:00	0
7815	2	48	4,34	sleep0	7802	-21	ntpq	23:57:29	0
20493	2	48	3,37	sleep0	0	-21	swapper	20:10:23	0
15225	90	48	20,21	cyclictest	0	-21	swapper	22:47:38	0
17640	2	47	0,2	chrt	17638	-21	/usr/sbin/munin	20:05:29	0
9756	2	46	0,2	sleep0	9757	-21	seq	19:52:26	0
29285	2	46	3,34	sleep0	29290	-21	ntp_states	19:31:49	0
11586	2	45	0,2	sleep0	11588	-21	timerwakeupswit	20:46:31	0
14442	2	44	0,2	sleep0	14444	-21	awk	20:00:26	0
15225	90	43	5,21	cyclictest	25699	-21	perl	23:35:53	0
15225	90	43	4,20	cyclictest	20557	-21	ssh	21:51:01	0
15225	90	42	5,19	cyclictest	21808	-21	memory	22:41:12	0
15225	90	42	14,12	cyclictest	0	-21	swapper	19:47:32	0
15225	90	41	5,12	cyclictest	27953	-21	hddtemp_smartct	22:50:57	0
15225	90	41	4,18	cyclictest	14184	-21	ntpq	20:51:02	0
15225	90	40	4,11	cyclictest	23276	-21	irqstats	21:05:46	0
15225	90	40	4,10	cyclictest	26998	-21	df	20:20:29	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39