OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack9slot4s (updated Wed Apr 30, 2025 00:59:02)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
28563	99	1223	1201,19	cyclictest	0	-21	swapper/1	19:30:04	1
28562	99	569	1,564	cyclictest	30908	-21	fschecks_time	19:30:03	0
27400	2	567	519,32	sleep0	0	-21	swapper/0	19:20:25	0
28250	2	462	418,29	sleep1	0	-21	swapper/1	19:22:17	1
6936	2	67	0,6	sleep0	28562	99	cyclictest	21:15:27	0
3655	2	61	0,7	sleep0	28562	99	cyclictest	00:00:15	0
14652	2	54	0,8	sleep1	28563	99	cyclictest	00:30:13	1
26975	2	47	0,8	sleep1	28563	99	cyclictest	23:35:23	1
28563	99	44	7,4	cyclictest	22	-21	ksoftirqd/1	22:23:04	1
28563	99	44	5,4	cyclictest	8	1	rcu_preempt	23:45:26	1
28563	99	44	3,10	cyclictest	0	-21	swapper/1	21:55:20	1
28563	99	43	3,10	cyclictest	0	-21	swapper/1	22:25:29	1
28563	99	43	17,6	cyclictest	22	-21	ksoftirqd/1	23:15:31	1
28563	99	43	14,6	cyclictest	22	-21	ksoftirqd/1	20:36:17	1
28563	99	42	6,6	cyclictest	22	-21	ksoftirqd/1	20:12:09	1
28563	99	42	6,6	cyclictest	22	-21	ksoftirqd/1	20:12:09	1
28563	99	42	2,9	cyclictest	0	-21	swapper/1	19:50:24	1
28563	99	42	16,5	cyclictest	22	-21	ksoftirqd/1	20:40:31	1
28563	99	42	15,6	cyclictest	22	-21	ksoftirqd/1	00:10:32	1
28563	99	42	13,8	cyclictest	22	-21	ksoftirqd/1	22:07:19	1
28563	99	42	13,6	cyclictest	22	-21	ksoftirqd/1	19:55:06	1
28563	99	42	13,5	cyclictest	22	-21	ksoftirqd/1	00:47:37	1
28563	99	42	12,4	cyclictest	22	-21	ksoftirqd/1	19:41:23	1
28563	99	42	10,4	cyclictest	8	1	rcu_preempt	20:59:40	1
28563	99	42	10,4	cyclictest	22	-21	ksoftirqd/1	23:11:27	1
28563	99	42	10,4	cyclictest	22	-21	ksoftirqd/1	22:15:49	1
28563	99	41	9,3	cyclictest	22	-21	ksoftirqd/1	21:28:46	1
28563	99	41	8,5	cyclictest	3020	-21	runrttasks	20:01:55	1
28563	99	41	19,8	cyclictest	22	-21	ksoftirqd/1	23:44:46	1
28563	99	41	19,8	cyclictest	22	-21	ksoftirqd/1	00:37:07	1
28563	99	41	17,5	cyclictest	22	-21	ksoftirqd/1	21:50:17	1
28563	99	41	16,5	cyclictest	22	-21	ksoftirqd/1	23:59:09	1
28563	99	41	15,5	cyclictest	22	-21	ksoftirqd/1	00:09:36	1
28563	99	41	14,6	cyclictest	22	-21	ksoftirqd/1	23:29:27	1
28563	99	41	12,4	cyclictest	22	-21	ksoftirqd/1	00:25:20	1
28563	99	41	11,4	cyclictest	22	-21	ksoftirqd/1	20:50:15	1
28563	99	41	11,4	cyclictest	22	-21	ksoftirqd/1	20:31:03	1
28563	99	41	11,3	cyclictest	22	-21	ksoftirqd/1	21:48:44	1
28563	99	41	10,4	cyclictest	22	-21	ksoftirqd/1	19:48:01	1
28563	99	40	6,6	cyclictest	22	-21	ksoftirqd/1	20:26:41	1
28563	99	40	3,11	cyclictest	0	-21	swapper/1	22:01:25	1
28563	99	40	20,8	cyclictest	22	-21	ksoftirqd/1	00:17:16	1
28563	99	40	15,5	cyclictest	22	-21	ksoftirqd/1	22:45:28	1
28563	99	40	14,6	cyclictest	22	-21	ksoftirqd/1	21:15:13	1
28563	99	40	11,3	cyclictest	22	-21	ksoftirqd/1	23:08:35	1
28563	99	40	11,3	cyclictest	22	-21	ksoftirqd/1	23:08:35	1
28563	99	40	11,3	cyclictest	22	-21	ksoftirqd/1	21:32:18	1
28563	99	40	10,5	cyclictest	22	-21	ksoftirqd/1	00:21:36	1
28563	99	40	10,4	cyclictest	22	-21	ksoftirqd/1	22:50:54	1
28563	99	40	10,4	cyclictest	22	-21	ksoftirqd/1	22:12:37	1
28563	99	39	9,4	cyclictest	22	-21	ksoftirqd/1	22:31:46	1
28563	99	39	5,5	cyclictest	13972	-21	ntpq	23:00:26	1
28563	99	39	5,5	cyclictest	13972	-21	ntpq	23:00:25	1
28563	99	39	22,4	cyclictest	22	-21	ksoftirqd/1	21:20:31	1
28563	99	39	14,6	cyclictest	22	-21	ksoftirqd/1	21:00:54	1
28563	99	39	14,6	cyclictest	22	-21	ksoftirqd/1	19:36:19	1
28563	99	39	14,5	cyclictest	22	-21	ksoftirqd/1	20:16:38	1
28563	99	39	14,5	cyclictest	22	-21	ksoftirqd/1	00:00:20	1
28563	99	39	13,5	cyclictest	22	-21	ksoftirqd/1	21:14:43	1
28563	99	39	12,8	cyclictest	22	-21	ksoftirqd/1	21:05:17	1
28563	99	39	10,9	cyclictest	22	-21	ksoftirqd/1	23:21:26	1
28563	99	39	10,4	cyclictest	22	-21	ksoftirqd/1	22:43:52	1
28563	99	39	10,4	cyclictest	22	-21	ksoftirqd/1	21:36:30	1
28563	99	39	10,4	cyclictest	22	-21	ksoftirqd/1	20:47:22	1
28563	99	38	14,6	cyclictest	22	-21	ksoftirqd/1	20:06:32	1
28563	99	38	13,6	cyclictest	22	-21	ksoftirqd/1	22:35:14	1
28563	99	38	12,5	cyclictest	22	-21	ksoftirqd/1	23:50:50	1
28563	99	37	8,4	cyclictest	8	1	rcu_preempt	21:40:13	1
28563	99	37	23,4	cyclictest	22	-21	ksoftirqd/1	23:33:10	1
28563	99	37	13,6	cyclictest	22	-21	ksoftirqd/1	22:58:28	1
31312	2	36	1,5	sleep0	31325	-21	hddtemp_smartct	20:55:23	0
28563	99	36	18,4	cyclictest	22	-21	ksoftirqd/1	19:26:47	1
28563	99	36	18,4	cyclictest	22	-21	ksoftirqd/1	00:53:56	1
28562	99	36	9,12	cyclictest	6204	-21	gdbus	00:11:07	0
28562	99	36	2,11	cyclictest	8	1	rcu_preempt	19:58:37	0
28563	99	35	2,8	cyclictest	0	-21	swapper/1	20:20:13	1
28563	99	35	11,4	cyclictest	22	-21	ksoftirqd/1	00:41:20	1
21728	2	35	1,30	sleep0	6204	-21	gdbus	00:47:09	0
28562	99	34	10,11	cyclictest	0	-21	swapper/0	00:50:55	0
17680	2	34	1,4	sleep0	17785	-21	wget	20:20:13	0
28562	99	33	7,13	cyclictest	1930	-21	cpuspeed_turbos	22:30:14	0
28562	99	33	1,28	cyclictest	13987	-21	cut	21:35:17	0
17073	2	33	1,9	sleep0	0	-21	swapper/0	21:44:32	0
28562	99	32	6,12	cyclictest	7898	-21	fschecks_count	22:45:18	0
28562	99	32	3,4	cyclictest	8	1	rcu_preempt	23:55:18	0
28562	99	32	1,4	cyclictest	8	1	rcu_preempt	20:37:26	0
28562	99	32	1,4	cyclictest	8	1	rcu_preempt	00:22:17	0
28562	99	32	13,16	cyclictest	20105	-21	sh	00:45:00	0
28562	99	32	1,17	cyclictest	19586	-21	fschecks_time	21:50:17	0
28562	99	32	1,13	cyclictest	0	-21	swapper/0	23:12:32	0
28562	99	32	1,13	cyclictest	0	-21	swapper/0	23:03:10	0
28562	99	32	1,13	cyclictest	0	-21	swapper/0	23:03:10	0
28562	99	31	7,12	cyclictest	12251	-21	irqstats	21:30:23	0
28562	99	31	21,5	cyclictest	32440	-21	wget	22:25:16	0
28562	99	31	1,4	cyclictest	8	1	rcu_preempt	23:49:07	0
28562	99	31	1,4	cyclictest	8	1	rcu_preempt	23:38:03	0
28562	99	31	1,4	cyclictest	8	1	rcu_preempt	23:19:02	0
28562	99	31	1,4	cyclictest	8	1	rcu_preempt	21:29:10	0
28562	99	31	1,4	cyclictest	8	1	rcu_preempt	20:53:57	0
28562	99	31	1,4	cyclictest	8	1	rcu_preempt	20:40:32	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17