OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack4slot1s.osadl.org (updated Tue Jun 23, 2026 12:44:20)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
5791	2	124	0,3	sleep1	27	1	rcuc/1	11:18:24	1
5791	2	124	0,3	sleep1	27	1	rcuc/1	11:18:24	1
5791	2	124	0,3	sleep1	27	1	rcuc/1	11:18:24	1
493	2	123	0,2	sleep1	28	1	ktimers/1	08:13:16	1
493	2	123	0,2	sleep1	28	1	ktimers/1	08:13:16	1
493	2	123	0,2	sleep1	28	1	ktimers/1	08:13:16	1
984	2	120	0,5	sleep1	575	-21	thd	09:40:39	1
984	2	120	0,5	sleep1	575	-21	thd	09:40:39	1
22730	2	118	0,1	sleep1	0	-21	swapper/1	09:13:14	1
30897	2	107	0,3	sleep2	0	-21	swapper/2	08:08:14	2
30897	2	107	0,3	sleep2	0	-21	swapper/2	08:08:14	2
22502	2	102	0,2	chrt	0	-21	swapper/1	10:38:16	1
22502	2	102	0,2	chrt	0	-21	swapper/1	10:38:16	1
4492	2	89	0,3	sleep2	0	-21	swapper/2	09:48:24	2
4492	2	89	0,3	sleep2	0	-21	swapper/2	09:48:24	2
4492	2	89	0,3	sleep2	0	-21	swapper/2	09:48:24	2
27085	2	82	0,12	sleep1	28	1	ktimers/1	09:23:19	1
27085	2	82	0,12	sleep1	28	1	ktimers/1	09:23:19	1
4948	2	60	0,2	chrt	0	-21	swapper/3	08:23:23	3
4948	2	60	0,2	chrt	0	-21	swapper/3	08:23:23	3
19202	2	57	0,3	sleep1	19197	-21	mailstats	10:28:23	1
19202	2	57	0,3	sleep1	19197	-21	mailstats	10:28:23	1
19202	2	57	0,3	sleep1	19197	-21	mailstats	10:28:23	1
31344	2	54	0,2	sleep3	0	-21	swapper/3	08:08:19	3
31344	2	54	0,2	sleep3	0	-21	swapper/3	08:08:19	3
31921	2	52	0,2	sleep2	0	-21	swapper/2	12:28:24	2
31921	2	52	0,2	sleep2	0	-21	swapper/2	12:28:24	2
31921	2	52	0,2	sleep2	0	-21	swapper/2	12:28:24	2
11410	2	52	0,2	sleep1	11413	-21	grep	10:08:17	1
11410	2	52	0,2	sleep1	11413	-21	grep	10:08:17	1
11410	2	52	0,2	sleep1	11413	-21	grep	10:08:17	1
1419	2	51	0,3	sleep1	1526	-21	vmstat	12:33:26	1
1419	2	51	0,3	sleep1	1526	-21	vmstat	12:33:26	1
6414	2	48	0,2	sleep0	0	-21	swapper/0	09:53:25	0
6414	2	48	0,2	sleep0	0	-21	swapper/0	09:53:25	0
29948	2	47	0,2	sleep3	0	-21	swapper/3	10:58:16	3
21427	2	46	0,3	sleep2	0	-21	swapper/2	12:03:11	2
21427	2	46	0,3	sleep2	0	-21	swapper/2	12:03:11	2
30313	2	40	0,3	sleep3	0	-21	swapper/3	08:06:38	3
30313	2	40	0,3	sleep3	0	-21	swapper/3	08:06:38	3
27727	2	38	0,2	sleep1	27731	-21	needreboot	12:18:19	1
27727	2	38	0,2	sleep1	27731	-21	needreboot	12:18:19	1
27727	2	38	0,2	sleep1	27731	-21	needreboot	12:18:19	1
16165	2	38	0,2	sleep3	0	-21	swapper/3	07:28:15	3
16165	2	38	0,2	sleep3	0	-21	swapper/3	07:28:15	3
16165	2	38	0,2	sleep3	0	-21	swapper/3	07:28:15	3
905	2	37	0,3	sleep2	0	-21	swapper/2	11:08:12	2
905	2	37	0,3	sleep2	0	-21	swapper/2	11:08:12	2
905	2	37	0,3	sleep2	0	-21	swapper/2	11:08:12	2
14842	2	36	0,2	chrt	0	-21	swapper/3	10:18:16	3
14842	2	36	0,2	chrt	0	-21	swapper/3	10:18:16	3
10326	99	36	28,6	cyclictest	13483	-21	processes	10:13:22	1
10326	99	36	28,6	cyclictest	13483	-21	processes	10:13:22	1
10326	99	36	28,6	cyclictest	13483	-21	processes	10:13:22	1
11184	2	35	0,2	sleep1	11194	-21	awk	08:43:04	1
11184	2	35	0,2	sleep1	11194	-21	awk	08:43:04	1
11184	2	35	0,2	sleep1	11194	-21	awk	08:43:04	1
10326	99	35	31,3	cyclictest	14521	-21	kernelversion	11:43:16	1
10326	99	35	31,3	cyclictest	14521	-21	kernelversion	11:43:16	1
31971	2	34	0,2	chrt	0	-21	swapper/3	09:38:12	3
31971	2	34	0,2	chrt	0	-21	swapper/3	09:38:12	3
28575	2	34	0,3	chrt	28580	-21	sendmail	08:03:02	0
28575	2	34	0,3	chrt	28580	-21	sendmail	08:03:02	0
10326	99	34	28,5	cyclictest	13124	-21	latency_hist	08:48:09	1
10326	99	34	28,5	cyclictest	13124	-21	latency_hist	08:48:09	1
10326	99	34	28,5	cyclictest	13124	-21	latency_hist	08:48:09	1
10326	99	34	27,5	cyclictest	2962	-21	threads	08:18:24	1
10326	99	34	27,5	cyclictest	2962	-21	threads	08:18:24	1
10319	99	34	27,5	cyclictest	16883	-21	threads	11:48:25	0
10319	99	34	27,5	cyclictest	16883	-21	threads	11:48:25	0
10319	99	34	24,7	cyclictest	25162	-21	needreboot	09:18:19	0
10319	99	34	24,7	cyclictest	25162	-21	needreboot	09:18:19	0
10319	99	34	24,7	cyclictest	25162	-21	needreboot	09:18:19	0
25676	2	33	0,2	sleep1	25678	-21	grep	09:18:24	1
25676	2	33	0,2	sleep1	25678	-21	grep	09:18:24	1
25676	2	33	0,2	sleep1	25678	-21	grep	09:18:24	1
10326	99	33	27,4	cyclictest	21707	-21	switchtime	09:08:21	1
10326	99	33	27,4	cyclictest	21707	-21	switchtime	09:08:21	1
10326	99	33	26,5	cyclictest	27402	-21	kernelversion	07:58:16	1
10326	99	33	26,5	cyclictest	27402	-21	kernelversion	07:58:16	1
10326	99	33	26,5	cyclictest	25285	-21	latency_hist	12:13:14	1
10326	99	33	26,5	cyclictest	25285	-21	latency_hist	12:13:14	1
10326	99	33	26,5	cyclictest	22488	-21	threads	12:03:23	1
10326	99	33	26,5	cyclictest	22488	-21	threads	12:03:23	1
10326	99	33	25,6	cyclictest	7494	-21	latency_hist	08:33:11	1
10326	99	33	25,6	cyclictest	7494	-21	latency_hist	08:33:11	1
10326	99	33	25,6	cyclictest	7494	-21	latency_hist	08:33:11	1
10319	99	33	26,5	cyclictest	32641	-21	needreboot	09:38:19	0
10319	99	33	26,5	cyclictest	32641	-21	needreboot	09:38:19	0
10319	99	33	26,5	cyclictest	20517	-21	latency_hist	09:08:01	0
10319	99	33	26,5	cyclictest	20517	-21	latency_hist	09:08:01	0
10319	99	33	26,5	cyclictest	15747	-21	tail	08:53:18	0
10319	99	33	26,5	cyclictest	15747	-21	tail	08:53:18	0
10319	99	33	26,5	cyclictest	15747	-21	tail	08:53:18	0
11404	2	32	0,2	sleep1	11409	-21	sed	11:33:23	1
11404	2	32	0,2	sleep1	11409	-21	sed	11:33:23	1
10326	99	32	27,3	cyclictest	21100	-21	latency_hist	07:43:01	1
10326	99	32	27,3	cyclictest	21100	-21	latency_hist	07:43:01	1
10326	99	32	25,5	cyclictest	32497	-21	latency_hist	12:33:03	1
10326	99	32	25,5	cyclictest	32497	-21	latency_hist	12:33:03	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17