OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot4s.osadl.org (updated Wed Jul 22, 2026 00:45:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3212221	2	66	46,1	sleep10	0	-21	swapper/10	19:06:22	2
4189	98	51	0,49	rtkit-daemon	0	-21	swapper/0	19:06:38	0
3213060	99	50	0,25	cyclictest	0	-21	swapper/14	20:45:41	6
3213048	99	50	49,1	cyclictest	3255342	-21	kworker/u32:3+events_unbound	20:05:22	2
3213060	99	48	23,1	cyclictest	618598	-21	thunderbird	00:36:20	6
3213060	99	47	22,25	cyclictest	0	-21	swapper/14	23:08:28	6
3213060	99	42	18,13	cyclictest	3326619	-21	ssh	21:18:38	6
3209015	2	42	39,2	sleep12	0	-21	swapper/12	19:05:04	4
3213060	99	41	3,25	cyclictest	0	-21	swapper/14	22:57:29	6
3212461	2	41	39,1	sleep13	0	-21	swapper/13	19:09:21	5
3213060	99	40	2,25	cyclictest	0	-21	swapper/14	23:41:25	6
3213040	99	40	39,1	cyclictest	3352657	-21	kworker/u32:4+events_unbound	22:00:17	13
3213040	99	40	39,1	cyclictest	3352657	-21	kworker/u32:4+events_unbound	22:00:16	13
3212231	2	40	38,1	sleep3	0	-21	swapper/3	19:06:31	9
3213055	99	39	38,1	cyclictest	3453903	-21	kworker/u32:0+events_unbound	23:10:19	4
3212403	2	39	36,2	sleep9	0	-21	swapper/9	19:08:45	15
3212398	2	39	37,1	sleep4	0	-21	swapper/4	19:08:40	10
3212379	2	39	37,1	sleep5	0	-21	swapper/5	19:08:25	11
3212497	2	38	36,1	sleep1	0	-21	swapper/1	19:09:41	1
3213043	99	37	36,1	cyclictest	3443164	-21	kworker/u32:3+events_unbound	22:50:18	14
3213021	99	37	37,0	cyclictest	3047846	-1	kworker/u33:0+i915_flip	19:28:55	0
3212319	2	37	35,1	sleep6	0	-21	swapper/6	19:07:38	12
3212246	2	37	34,2	sleep15	0	-21	swapper/15	19:06:43	7
3213060	99	36	0,36	cyclictest	618598	-21	thunderbird	22:02:34	6
3213060	99	36	0,36	cyclictest	618598	-21	thunderbird	22:02:34	6
3213048	99	36	34,2	cyclictest	3255342	-21	kworker/u32:3+flush-259:0	20:10:18	2
3213026	99	36	7,28	cyclictest	3221788	-21	kworker/u32:4+flush-259:0	20:00:16	8
3212444	2	36	34,1	sleep7	0	-21	swapper/7	19:09:15	13
3212339	2	36	34,1	sleep8	0	-21	swapper/8	19:07:56	14
3213060	99	35	0,11	cyclictest	618598	-21	thunderbird	19:28:48	6
3213034	99	35	35,0	cyclictest	0	-21	swapper/5	22:30:17	11
3213021	99	35	34,1	cyclictest	3191450	-1	kworker/u33:1+i915_flip	19:20:52	0
3211479	2	35	33,1	sleep14	0	-21	swapper/14	19:05:22	6
3213058	99	34	33,1	cyclictest	3351096	-21	kworker/u32:0+events_unbound	21:45:23	5
3213040	99	34	31,2	cyclictest	3378914	-21	kworker/u32:2+flush-259:0	22:50:11	13
3213032	99	34	34,0	cyclictest	3047846	-1	kworker/u33:0+i915_flip	22:45:19	10
3212242	2	34	32,1	sleep11	0	-21	swapper/11	19:06:39	3
3213060	99	33	9,11	cyclictest	0	-21	swapper/14	20:12:44	6
3213058	99	33	33,0	cyclictest	0	-21	swapper/13	21:17:28	5
3213058	99	33	32,1	cyclictest	3492563	-21	kworker/u32:3+events_unbound	23:40:40	5
3213043	99	33	32,1	cyclictest	3272280	-21	kworker/u32:2+events_unbound	21:20:16	14
3213043	99	33	31,2	cyclictest	3471808	-21	kworker/u32:1+events_unbound	23:55:05	14
3213034	99	33	32,1	cyclictest	3443164	-21	kworker/u32:3+events_unbound	23:00:18	11
3213026	99	33	28,4	cyclictest	1774	-21	snmpd	20:49:52	8
3213021	99	33	30,2	cyclictest	3475537	-21	kworker/u32:4+flush-259:0	23:20:20	0
3212294	2	33	31,1	sleep2	0	-21	swapper/2	19:07:18	8
3213064	99	32	0,31	cyclictest	0	-21	swapper/15	20:40:17	7
3213058	99	32	31,1	cyclictest	3475537	-21	kworker/u32:4+writeback	00:32:17	5
3213058	99	32	31,1	cyclictest	3339589	-21	kworker/u32:1+flush-259:0	21:35:24	5
3213058	99	32	30,1	cyclictest	0	-21	swapper/13	22:47:04	5
3213028	99	32	0,31	cyclictest	618698	-21	WRScene~ilder#1	19:42:27	9
3213026	99	32	29,3	cyclictest	3287393	-21	mii-tool	20:35:13	8
3213026	99	32	0,0	cyclictest	0	-21	swapper/2	21:10:17	8
3213021	99	32	30,2	cyclictest	3174675	-21	kworker/u32:2+flush-259:0	19:15:01	0
3213021	99	32	30,2	cyclictest	3174675	-21	kworker/u32:2+flush-259:0	19:15:01	0
3213058	99	31	31,0	cyclictest	0	-21	swapper/13	19:34:34	5
3213058	99	31	30,1	cyclictest	140	1	rcuc/13	22:30:37	5
3213058	99	31	0,31	cyclictest	618598	-21	thunderbird	22:53:59	5
3213058	99	31	0,2	cyclictest	618700	-21	WRRende~ckend#1	23:34:33	5
3213055	99	31	30,1	cyclictest	1774	-21	snmpd	21:28:14	4
3213055	99	31	0,30	cyclictest	0	-21	swapper/12	19:39:45	4
3213048	99	31	30,1	cyclictest	3468204	-21	kworker/10:2+events	23:58:46	2
3213048	99	31	30,1	cyclictest	3468204	-21	kworker/10:2+events	23:41:02	2
3213048	99	31	30,1	cyclictest	3468204	-21	kworker/10:2+events	00:30:42	2
3213048	99	31	30,1	cyclictest	3468204	-21	kworker/10:2+events	00:26:44	2
3213048	99	31	30,1	cyclictest	3468204	-21	kworker/10:2+events	00:04:30	2
3213048	99	31	30,1	cyclictest	3409850	-21	kworker/10:2+events	22:53:58	2
3213048	99	31	30,1	cyclictest	3409850	-21	kworker/10:2+events	22:46:50	2
3213048	99	31	30,1	cyclictest	3314418	-21	kworker/10:0+events	21:32:05	2
3213048	99	31	30,1	cyclictest	3314418	-21	kworker/10:0+events	21:18:42	2
3213048	99	31	29,2	cyclictest	3314418	-21	kworker/10:0+events	21:21:08	2
3213046	99	31	30,1	cyclictest	1774	-21	snmpd	23:23:27	15
3213046	99	31	0,30	cyclictest	0	-21	swapper/9	20:33:37	15
3213043	99	31	31,0	cyclictest	0	-21	swapper/8	23:00:24	14
3213043	99	31	31,0	cyclictest	0	-21	swapper/8	21:56:34	14
3213043	99	31	31,0	cyclictest	0	-21	swapper/8	21:48:34	14
3213043	99	31	31,0	cyclictest	0	-21	swapper/8	00:30:35	14
3213043	99	31	31,0	cyclictest	0	-21	swapper/8	00:14:51	14
3213043	99	31	31,0	cyclictest	0	-21	swapper/8	00:00:19	14
3213043	99	31	30,1	cyclictest	1774	-21	snmpd	19:59:00	14
3213043	99	31	29,2	cyclictest	3272280	-21	kworker/u32:2+events_unbound	20:55:14	14
3213040	99	31	30,1	cyclictest	3570542	-21	kworker/u32:2+events_unbound	00:31:04	13
3213040	99	31	30,1	cyclictest	3387792	-21	mii-tool	22:05:19	13
3213040	99	31	30,1	cyclictest	3387792	-21	mii-tool	22:05:18	13
3213034	99	31	21,10	cyclictest	0	-21	swapper/5	20:15:14	11
3213032	99	31	29,2	cyclictest	3570542	-21	kworker/u32:2+events_unbound	00:38:52	10
3213032	99	31	0,28	cyclictest	0	-21	swapper/4	23:55:16	10
3213028	99	31	30,1	cyclictest	1774	-21	snmpd	20:34:49	9
3213023	99	31	0,1	cyclictest	0	-21	swapper/1	19:58:45	1
3213064	99	30	29,1	cyclictest	0	-21	swapper/15	20:56:52	7
3213064	99	30	29,1	cyclictest	0	-21	swapper/15	20:13:40	7
3213064	99	30	0,1	cyclictest	0	-21	swapper/15	23:12:37	7
3213064	99	30	0,1	cyclictest	0	-21	swapper/15	22:55:19	7
3213064	99	30	0,1	cyclictest	0	-21	swapper/15	22:50:14	7
3213060	99	30	29,1	cyclictest	1774	-21	snmpd	23:30:32	6
3213060	99	30	26,4	cyclictest	1774	-21	snmpd	22:15:12	6
3213060	99	30	0,30	cyclictest	0	-21	swapper/14	22:24:37	6
3213058	99	30	29,1	cyclictest	618698	-21	WRScene~ilder#1	21:59:46	5
3213058	99	30	29,1	cyclictest	3475537	-21	kworker/u32:4+events_unbound	23:18:40	5
3213058	99	30	29,1	cyclictest	1774	-21	snmpd	23:01:32	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17