OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot3s.osadl.org (updated Fri Apr 03, 2026 22:41:28)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
27449	2	157	0,5	sleep0	19278	99	cyclictest	05:48:39	0
27449	2	157	0,5	sleep0	19278	99	cyclictest	05:48:39	0
19278	99	109	7,60	cyclictest	0	-21	swapper/0	05:55:20	0
19278	99	109	4,71	cyclictest	30570	-21	sh	06:00:21	0
19278	99	109	4,71	cyclictest	30570	-21	sh	06:00:21	0
27574	2	106	0,4	sleep3	27546	-21	execl	05:49:47	3
27574	2	106	0,4	sleep3	27546	-21	execl	05:49:47	3
19278	99	106	55,23	cyclictest	9	-21	ksoftirqd/0	05:10:24	0
23552	2	105	0,6	sleep0	23511	-21	sh	05:42:09	0
19278	99	100	3,77	cyclictest	20049	-21	kworker/0:1	05:51:48	0
19294	99	99	2,68	cyclictest	908	-21	runrttasks	05:58:47	3
12345	2	99	0,2	sleep1	0	-21	swapper/1	05:34:25	1
12345	2	99	0,2	sleep1	0	-21	swapper/1	05:34:25	1
18702	2	98	0,3	sleep3	12324	-21	spawn	06:03:15	3
18702	2	98	0,3	sleep3	12324	-21	spawn	06:03:15	3
27499	2	97	0,6	sleep2	27501	-21	latency_hist	05:30:15	2
27499	2	97	0,6	sleep2	27501	-21	latency_hist	05:30:15	2
2616	2	97	0,6	sleep3	2618	-21	sh	05:37:49	3
19283	99	97	16,50	cyclictest	504	-21	in:imklog	05:45:24	1
19283	99	97	16,50	cyclictest	504	-21	in:imklog	05:45:24	1
21870	2	96	0,3	sleep1	22768	-21	spawn	06:02:28	1
21870	2	96	0,3	sleep1	22768	-21	spawn	06:02:28	1
2999	2	95	0,4	sleep1	2997	-21	od	05:42:39	1
19278	99	91	24,11	cyclictest	26458	-21	grep	06:10:24	0
3711	2	90	0,4	sleep1	3720	-21	tee	06:09:11	1
3711	2	90	0,4	sleep1	3720	-21	tee	06:09:11	1
22005	2	90	0,2	sleep2	0	-21	swapper/2	05:10:38	2
19294	99	89	3,68	cyclictest	0	-21	swapper/3	05:44:47	3
22358	2	88	0,3	sleep2	22355	-21	ntp_states	06:15:36	2
7583	2	85	0,4	sleep2	7588	-21	spawn	06:02:45	2
7583	2	85	0,4	sleep2	7588	-21	spawn	06:02:45	2
21868	2	84	0,2	sleep2	0	-21	swapper/2	05:43:21	2
19283	99	84	5,16	cyclictest	77	50	irq/56-dwc_otg	05:58:22	1
23827	2	82	0,2	sleep3	0	-21	swapper/3	06:06:17	3
23827	2	82	0,2	sleep3	0	-21	swapper/3	06:06:17	3
19294	99	80	3,17	cyclictest	28175	-21	fstime	05:53:26	3
7094	2	79	0,2	sleep2	0	-21	swapper/2	05:33:57	2
7094	2	79	0,2	sleep2	0	-21	swapper/2	05:33:57	2
25093	2	78	0,2	sleep2	0	-21	swapper/2	05:21:29	2
19278	99	77	57,5	cyclictest	20555	-21	rm	06:07:19	0
19278	99	77	57,5	cyclictest	20555	-21	rm	06:07:19	0
27451	2	74	0,2	sleep2	27427	-21	execl	05:48:41	2
27451	2	74	0,2	sleep2	27427	-21	execl	05:48:41	2
19283	99	72	7,25	cyclictest	28015	-21	fstime	05:51:49	1
19278	99	68	12,53	cyclictest	10	1	ktimersoftd/0	05:22:16	0
19278	99	68	10,55	cyclictest	10	1	ktimersoftd/0	05:38:54	0
29356	2	62	0,2	sleep2	0	-21	swapper/2	05:37:28	2
19290	99	62	11,22	cyclictest	29	-21	rcuc/2	05:58:18	2
19278	99	62	7,38	cyclictest	0	-21	swapper/0	05:27:43	0
19278	99	62	7,38	cyclictest	0	-21	swapper/0	05:27:43	0
19290	99	61	25,24	cyclictest	32244	-21	grep	06:07:46	2
19290	99	61	25,24	cyclictest	32244	-21	grep	06:07:46	2
19278	99	61	2,4	cyclictest	0	-21	swapper/0	05:05:24	0
19290	99	60	5,40	cyclictest	28257	-21	fstime	05:54:14	2
19294	99	58	4,5	cyclictest	79	50	irq/56-dwc_otg_	06:11:51	3
25099	2	57	0,2	sleep3	0	-21	swapper/3	05:21:34	3
19278	99	57	36,11	cyclictest	0	-21	swapper/0	05:33:22	0
19278	99	57	36,11	cyclictest	0	-21	swapper/0	05:33:22	0
19278	99	54	9,37	cyclictest	25224	-21	savelog	06:25:14	0
19283	99	53	9,10	cyclictest	25410	-21	fstime	05:25:24	1
19283	99	53	9,10	cyclictest	25410	-21	fstime	05:25:24	1
19278	99	53	2,37	cyclictest	0	-21	swapper/0	05:17:27	0
19278	99	53	1,40	cyclictest	0	-21	swapper/0	06:20:14	0
18274	2	52	0,5	sleep2	0	-21	swapper/2	05:00:37	2
19283	99	50	15,21	cyclictest	77	50	irq/56-dwc_otg	06:10:37	1
19283	99	49	23,6	cyclictest	79	50	irq/56-dwc_otg_	05:38:57	1
19283	99	48	12,20	cyclictest	25193	-21	fstime	05:22:38	1
19294	99	47	2,15	cyclictest	0	-21	swapper/3	05:19:59	3
19283	99	44	7,26	cyclictest	0	-21	swapper/1	05:05:26	1
19283	99	44	3,23	cyclictest	21108	-21	/usr/sbin/munin	05:10:37	1
18806	2	44	2,35	sleep0	0	-21	swapper/0	05:02:26	0
19290	99	43	8,14	cyclictest	79	50	irq/56-dwc_otg_	06:10:52	2
19283	99	43	9,4	cyclictest	1	-21	systemd	06:25:15	1
19290	99	39	5,4	cyclictest	19627	-21	grep	05:05:30	2
19294	99	38	7,24	cyclictest	0	-21	swapper/3	06:15:26	3
19294	99	38	1,24	cyclictest	21026	-21	ls	05:10:15	3
19294	99	34	5,7	cyclictest	79	50	irq/56-dwc_otg_	05:35:13	3
19294	99	34	5,7	cyclictest	79	50	irq/56-dwc_otg_	05:35:13	3
19290	99	34	1,22	cyclictest	23847	-21	switchtime	05:15:39	2
18323	2	34	3,18	sleep3	18424	-21	/usr/sbin/munin	05:00:39	3
19294	99	32	2,13	cyclictest	78	50	irq/56-dwc_otg_	05:10:28	3
18744	2	32	3,23	sleep1	0	-21	swapper/1	05:01:39	1
19294	99	31	6,15	cyclictest	0	-21	swapper/3	06:23:32	3
19290	99	31	1,10	cyclictest	77	50	irq/56-dwc_otg	06:20:25	2
19283	99	30	9,6	cyclictest	78	50	irq/56-dwc_otg_	06:15:40	1
19283	99	30	10,9	cyclictest	22691	-21	Run	05:16:34	1
19294	99	29	1,22	cyclictest	25410	-21	fstime	05:25:30	3
19294	99	29	1,22	cyclictest	25410	-21	fstime	05:25:30	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17