OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack4slot1s.osadl.org (updated Fri May 09, 2025 00:44:05)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
7379	2	80	0,3	sleep2	0	-21	swapper/2	21:40:47	2
22892	2	72	0,3	sleep3	0	-21	swapper/3	20:55:50	3
22892	2	72	0,3	sleep3	0	-21	swapper/3	20:55:50	3
10476	2	64	0,3	sleep3	0	-21	swapper/3	21:50:29	3
10476	2	64	0,3	sleep3	0	-21	swapper/3	21:50:29	3
14940	99	63	20,39	cyclictest	0	-21	swapper/0	23:05:42	0
14940	99	63	20,39	cyclictest	0	-21	swapper/0	23:05:42	0
12288	2	62	0,2	sleep0	0	-21	swapper/0	23:20:47	0
24647	2	59	0,3	sleep2	0	-21	swapper/2	21:00:47	2
24647	2	59	0,3	sleep2	0	-21	swapper/2	21:00:47	2
14940	99	59	9,13	cyclictest	18	1	rcu_preempt	20:00:40	0
14940	99	59	9,13	cyclictest	18	1	rcu_preempt	20:00:40	0
2913	2	58	0,3	sleep3	0	-21	swapper/3	22:55:45	3
25698	2	58	0,1	sleep1	25875	-21	head	23:55:46	1
25698	2	58	0,1	sleep1	25875	-21	head	23:55:46	1
12376	2	58	0,2	chrt	0	-21	swapper/1	23:20:47	1
3652	2	57	0,2	sleep1	3772	-21	timerandwakeup	22:55:56	1
14940	99	56	4,9	cyclictest	18	1	rcu_preempt	22:00:44	0
14940	99	56	4,9	cyclictest	18	1	rcu_preempt	22:00:44	0
14940	99	56	4,9	cyclictest	18	1	rcu_preempt	21:00:43	0
14940	99	56	4,9	cyclictest	18	1	rcu_preempt	21:00:43	0
4719	2	54	0,3	sleep1	0	-21	swapper/1	20:05:55	1
20511	2	54	0,2	sleep1	20592	-21	fschecks_count	20:50:42	1
14941	99	54	19,12	cyclictest	27965	-21	apt-get	21:10:43	1
14941	99	54	19,12	cyclictest	27965	-21	apt-get	21:10:43	1
10535	2	53	0,3	sleep3	0	-21	swapper/3	23:15:43	3
29659	2	52	0,2	sleep3	0	-21	swapper/3	21:15:31	3
29659	2	52	0,2	sleep3	0	-21	swapper/3	21:15:31	3
26802	2	52	0,4	sleep3	0	-21	swapper/3	21:05:51	3
26802	2	52	0,4	sleep3	0	-21	swapper/3	21:05:51	3
14941	99	52	19,13	cyclictest	29543	-21	apt-get	22:40:43	1
14941	99	52	19,13	cyclictest	29543	-21	apt-get	22:40:43	1
14940	99	51	3,11	cyclictest	18	1	rcu_preempt	00:00:45	0
14940	99	51	3,11	cyclictest	18	1	rcu_preempt	00:00:45	0
14940	99	50	2,36	cyclictest	6420	-21	taskset	00:30:42	0
14940	99	50	2,36	cyclictest	6420	-21	taskset	00:30:42	0
14940	99	49	3,8	cyclictest	18	1	rcu_preempt	21:10:43	0
14940	99	49	3,8	cyclictest	18	1	rcu_preempt	21:10:43	0
26637	2	48	0,3	sleep3	0	-21	swapper/3	22:30:53	3
21258	2	48	0,3	sleep2	0	-21	swapper/2	23:41:47	2
14941	99	48	38,5	cyclictest	0	-21	swapper/1	23:30:38	1
14941	99	48	14,23	cyclictest	0	-21	swapper/1	20:20:39	1
14941	99	48	14,23	cyclictest	0	-21	swapper/1	20:20:39	1
12903	2	48	0,2	sleep1	12909	-21	cpu	20:30:43	1
12903	2	48	0,2	sleep1	12909	-21	cpu	20:30:43	1
11739	2	48	0,3	sleep3	0	-21	swapper/3	21:50:57	3
14940	99	47	9,27	cyclictest	551	50	irq/47-eth0	22:35:43	0
14940	99	47	9,27	cyclictest	551	50	irq/47-eth0	22:35:43	0
14940	99	46	4,11	cyclictest	18	1	rcu_preempt	22:40:43	0
14940	99	46	4,11	cyclictest	18	1	rcu_preempt	22:40:43	0
14940	99	46	23,17	cyclictest	17	1	ktimers/0	00:05:42	0
14940	99	46	23,17	cyclictest	17	1	ktimers/0	00:05:42	0
7199	2	45	0,2	sleep0	0	-21	swapper/0	20:15:40	0
7199	2	45	0,2	sleep0	0	-21	swapper/0	20:15:40	0
14940	99	45	1,9	cyclictest	18	1	rcu_preempt	21:40:42	0
30187	2	44	0,5	sleep0	30190	-21	cut	21:15:44	0
14941	99	44	4,36	cyclictest	663	-21	runrttasks	20:40:41	1
14941	99	44	4,36	cyclictest	663	-21	runrttasks	20:40:41	1
14940	99	44	1,9	cyclictest	18	1	rcu_preempt	19:35:42	0
14940	99	44	1,9	cyclictest	18	1	rcu_preempt	19:35:42	0
29296	2	43	0,3	sleep1	14939	-21	cyclictest	19:45:53	1
17984	2	43	0,2	sleep1	17985	-21	cut	23:35:39	1
16154	2	43	0,6	chrt	20	1	rcuc/0	23:30:43	0
16154	2	43	0,6	chrt	20	1	rcuc/0	23:30:43	0
14941	99	43	10,27	cyclictest	0	-21	swapper/1	23:45:42	1
14941	99	43	10,27	cyclictest	0	-21	swapper/1	23:45:42	1
14940	99	43	1,36	cyclictest	394	-21	snmpd	21:20:42	0
14940	99	43	1,36	cyclictest	394	-21	snmpd	21:20:42	0
14941	99	42	18,17	cyclictest	28	1	ktimers/1	20:15:40	1
14941	99	42	18,17	cyclictest	28	1	ktimers/1	20:15:40	1
14940	99	42	6,27	cyclictest	551	50	irq/47-eth0	19:55:40	0
14940	99	42	6,27	cyclictest	551	50	irq/47-eth0	19:55:40	0
14940	99	42	28,10	cyclictest	0	-21	swapper/0	19:25:42	0
14940	99	42	28,10	cyclictest	0	-21	swapper/0	19:25:42	0
14940	99	42	2,4	cyclictest	18	1	rcu_preempt	00:20:41	0
14940	99	42	2,4	cyclictest	18	1	rcu_preempt	00:20:41	0
14941	99	41	12,21	cyclictest	0	-21	swapper/1	23:40:42	1
14940	99	41	33,6	cyclictest	17053	-21	netstat	22:05:51	0
14940	99	41	33,6	cyclictest	17053	-21	netstat	22:05:51	0
14940	99	40	2,3	cyclictest	18	1	rcu_preempt	20:45:43	0
14940	99	40	2,3	cyclictest	18	1	rcu_preempt	20:45:43	0
14817	2	40	0,3	sleep3	0	-21	swapper/3	23:25:52	3
14286	2	40	0,1	sleep1	0	-21	swapper/1	22:00:32	1
14286	2	40	0,1	sleep1	0	-21	swapper/1	22:00:32	1
10810	2	40	0,2	sleep1	10973	-21	perl	21:50:48	1
14941	99	39	30,5	cyclictest	20111	-21	apt-get	22:15:43	1
14941	99	39	30,5	cyclictest	20111	-21	apt-get	22:15:43	1
14941	99	38	23,10	cyclictest	29438	-21	apt-get	00:05:42	1
14941	99	38	23,10	cyclictest	29438	-21	apt-get	00:05:42	1
14940	99	38	7,22	cyclictest	551	50	irq/47-eth0	21:35:41	0
14940	99	38	7,22	cyclictest	551	50	irq/47-eth0	21:35:41	0
14940	99	38	25,10	cyclictest	0	-21	swapper/0	22:20:40	0
14940	99	38	25,10	cyclictest	0	-21	swapper/0	22:20:40	0
28473	2	37	0,2	sleep0	28570	-21	fschecks_time	19:45:45	0
14941	99	37	24,10	cyclictest	2662	-21	apt-get	00:20:41	1
14941	99	37	24,10	cyclictest	2662	-21	apt-get	00:20:41	1
14941	99	37	12,11	cyclictest	9533	-21	ntp_kernel_pll_	21:45:50	1
14941	99	37	12,11	cyclictest	9533	-21	ntp_kernel_pll_	21:45:50	1
14941	99	37	12,10	cyclictest	23017	-21	threads	22:20:52	1
14941	99	37	12,10	cyclictest	23017	-21	threads	22:20:52	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17