OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack1slot6s.osadl.org (updated Fri Dec 26, 2025 00:43:32)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1920	99	104	25,26	cyclictest	32581	-21	grep	23:23:04	3
1920	99	101	3,51	cyclictest	12074	-21	cpuspeed_turbos	21:33:06	3
1920	99	101	3,51	cyclictest	12074	-21	cpuspeed_turbos	21:33:06	3
1916	99	93	3,46	cyclictest	24994	-21	telnet	20:53:04	0
1916	99	93	3,46	cyclictest	24994	-21	telnet	20:53:04	0
1920	99	66	36,14	cyclictest	0	-21	swapper/3	19:38:07	3
1920	99	65	2,54	cyclictest	0	-21	swapper/3	20:28:23	3
1916	99	65	36,13	cyclictest	0	-21	swapper/0	19:38:07	0
1916	99	64	41,8	cyclictest	16221	-21	awk	23:57:45	0
3537	2	63	4,29	sleep0	0	-21	swapper/0	18:58:24	0
1920	99	61	41,7	cyclictest	17724	-21	yum-updatesd-he	20:38:10	3
1920	99	61	37,9	cyclictest	9359	-21	aten2.4-expect	21:28:02	3
1920	99	61	3,49	cyclictest	0	-21	swapper/3	20:18:25	3
1919	99	61	4,50	cyclictest	0	-21	swapper/2	22:44:16	2
16497	2	61	3,10	sleep3	16583	-21	aten_r1power_vo	23:58:00	3
2332	2	60	4,12	sleep2	0	-21	swapper/2	20:03:27	2
1920	99	60	4,49	cyclictest	4751	-21	sendmail_mailqu	22:23:18	3
1920	99	60	2,51	cyclictest	0	-21	swapper/3	19:12:56	3
1918	99	60	4,28	cyclictest	0	-21	swapper/1	00:23:03	1
1918	99	60	21,24	cyclictest	3916	-21	forks	22:23:06	1
1920	99	59	32,12	cyclictest	0	-21	swapper/3	20:23:07	3
1920	99	59	31,13	cyclictest	0	-21	swapper/3	22:53:06	3
1920	99	59	31,13	cyclictest	0	-21	swapper/3	20:08:23	3
1920	99	59	31,13	cyclictest	0	-21	swapper/3	20:08:23	3
1919	99	59	21,13	cyclictest	0	-21	swapper/2	21:38:09	2
1919	99	59	21,13	cyclictest	0	-21	swapper/2	21:38:09	2
1920	99	58	3,48	cyclictest	27224	-21	aten_r1power_cu	23:12:59	3
1919	99	58	5,46	cyclictest	0	-21	swapper/2	20:38:09	2
1919	99	58	4,47	cyclictest	0	-21	swapper/2	21:43:23	2
1919	99	58	4,46	cyclictest	0	-21	swapper/2	23:57:46	2
1919	99	58	2,10	cyclictest	0	-21	swapper/2	20:00:46	2
1918	99	58	4,14	cyclictest	0	-21	swapper/1	21:38:15	1
1918	99	58	4,14	cyclictest	0	-21	swapper/1	21:38:15	1
1918	99	58	4,12	cyclictest	0	-21	swapper/1	23:03:08	1
1918	99	58	4,12	cyclictest	0	-21	swapper/1	23:03:08	1
1916	99	58	30,12	cyclictest	0	-21	swapper/0	22:38:09	0
18448	2	58	2,9	sleep0	0	-21	swapper/0	19:29:23	0
18448	2	58	2,9	sleep0	0	-21	swapper/0	19:29:23	0
1920	99	57	43,8	cyclictest	36	1	ktimersoftd/3	23:33:04	3
1920	99	57	3,47	cyclictest	18733	-21	munin-run	19:32:55	3
1920	99	57	3,47	cyclictest	18733	-21	munin-run	19:32:55	3
1920	99	57	3,47	cyclictest	14609	-21	df_abs	21:38:06	3
1920	99	57	3,47	cyclictest	14609	-21	df_abs	21:38:06	3
1920	99	57	2,49	cyclictest	0	-21	swapper/3	19:33:23	3
1919	99	57	4,46	cyclictest	0	-21	swapper/2	23:18:06	2
1919	99	57	4,46	cyclictest	0	-21	swapper/2	23:08:34	2
1919	99	57	4,28	cyclictest	0	-21	swapper/2	22:38:13	2
1918	99	57	8,25	cyclictest	0	-21	swapper/1	20:13:27	1
1918	99	57	5,13	cyclictest	0	-21	swapper/1	20:25:01	1
1918	99	57	4,15	cyclictest	0	-21	swapper/1	22:38:03	1
1918	99	57	4,13	cyclictest	0	-21	swapper/1	23:53:23	1
1918	99	57	4,12	cyclictest	0	-21	swapper/1	19:03:38	1
1918	99	57	3,14	cyclictest	0	-21	swapper/1	19:18:16	1
1918	99	57	23,14	cyclictest	0	-21	swapper/1	19:53:30	1
1918	99	57	13,21	cyclictest	0	-21	swapper/1	21:28:03	1
15818	2	57	3,8	sleep1	15948	-21	unixbench_singl	19:23:32	1
6066	2	56	3,46	sleep3	0	-21	swapper/3	21:18:24	3
29869	2	56	3,46	sleep1	30024	-21	expr	23:18:04	1
1920	99	56	31,10	cyclictest	0	-21	swapper/3	22:28:08	3
1920	99	56	3,47	cyclictest	13833	-21	awk	23:52:45	3
1920	99	56	3,47	cyclictest	13833	-21	awk	23:52:45	3
1920	99	56	3,46	cyclictest	0	-21	swapper/3	23:38:06	3
1920	99	56	29,12	cyclictest	0	-21	swapper/3	19:53:11	3
1920	99	56	28,13	cyclictest	0	-21	swapper/3	18:57:58	3
1919	99	56	4,40	cyclictest	0	-21	swapper/2	22:22:49	2
1919	99	56	4,26	cyclictest	0	-21	swapper/2	22:53:06	2
1918	99	56	5,24	cyclictest	21351	-21	munin-node	19:38:18	1
1918	99	56	4,13	cyclictest	0	-21	swapper/1	22:33:10	1
1918	99	56	4,13	cyclictest	0	-21	swapper/1	22:05:35	1
1918	99	56	3,14	cyclictest	0	-21	swapper/1	21:33:03	1
1918	99	56	3,14	cyclictest	0	-21	swapper/1	21:33:03	1
1918	99	56	3,14	cyclictest	0	-21	swapper/1	00:18:20	1
1918	99	56	3,13	cyclictest	0	-21	swapper/1	23:13:14	1
1918	99	56	23,15	cyclictest	0	-21	swapper/1	20:28:14	1
1918	99	56	23,15	cyclictest	0	-21	swapper/1	19:28:19	1
1918	99	56	23,15	cyclictest	0	-21	swapper/1	19:28:19	1
1916	99	56	34,10	cyclictest	0	-21	swapper/0	20:18:21	0
1916	99	56	30,12	cyclictest	0	-21	swapper/0	21:32:51	0
1916	99	56	29,12	cyclictest	0	-21	swapper/0	19:22:56	0
4246	2	55	3,8	sleep2	4328	-21	grep	20:08:14	2
4246	2	55	3,8	sleep2	4328	-21	grep	20:08:14	2
1920	99	55	35,13	cyclictest	14366	-21	cpuspeed_turbos	23:53:04	3
1920	99	55	33,8	cyclictest	26683	-21	munin-node	20:53:26	3
1920	99	55	33,8	cyclictest	26683	-21	munin-node	20:53:26	3
1920	99	55	29,11	cyclictest	0	-21	swapper/3	23:47:46	3
1920	99	55	27,13	cyclictest	0	-21	swapper/3	21:57:50	3
1920	99	55	2,47	cyclictest	30528	-21	idleruntime-cro	00:27:44	3
1919	99	55	6,42	cyclictest	0	-21	swapper/2	00:13:03	2
1919	99	55	5,43	cyclictest	0	-21	swapper/2	23:32:59	2
1918	99	55	5,30	cyclictest	0	-21	swapper/1	22:28:01	1
1918	99	55	5,30	cyclictest	0	-21	swapper/1	22:10:17	1
1918	99	55	5,30	cyclictest	0	-21	swapper/1	00:05:36	1
1918	99	55	5,26	cyclictest	0	-21	swapper/1	19:08:22	1
1918	99	55	4,13	cyclictest	0	-21	swapper/1	20:43:31	1
1918	99	55	4,11	cyclictest	25304	-21	tail	00:13:19	1
1918	99	55	3,28	cyclictest	0	-21	swapper/1	23:43:15	1
1918	99	55	3,13	cyclictest	0	-21	swapper/1	22:20:19	1
1918	99	55	3,13	cyclictest	0	-21	swapper/1	20:03:31	1
1918	99	55	18,12	cyclictest	0	-21	swapper/1	21:13:24	1
1916	99	55	34,10	cyclictest	0	-21	swapper/0	23:08:06	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17