OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #f, slot #7

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7.osadl.org (updated Sun Aug 09, 2026 00:46:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3447963	99	83	23,59	cyclictest	0	-21	swapper/6	22:33:05	6
3447963	99	83	23,59	cyclictest	0	-21	swapper/6	22:33:05	6
3447963	99	78	37,38	cyclictest	78	50	ktimers/6	23:30:21	6
3447963	99	73	13,21	cyclictest	3542203	-21	unin-run	22:00:01	6
3447963	99	72	15,38	cyclictest	3525623	-21	munin-run	21:30:01	6
3447963	99	71	33,19	cyclictest	78	1	ktimers/6	22:57:18	6
3447963	99	71	32,39	cyclictest	4162500	-21	gmain	00:04:20	6
3447963	99	71	30,18	cyclictest	362	-21	jbd2/sda2-8	19:55:17	6
3447963	99	70	10,39	cyclictest	3621420	-21	taskset	00:20:45	6
3447963	99	68	10,39	cyclictest	0	-21	swapper/6	21:47:27	6
3447963	99	67	28,18	cyclictest	0	-21	swapper/6	21:15:25	6
3447963	99	66	7,0	cyclictest	0	-21	swapper/6	20:20:21	6
3447963	99	65	7,39	cyclictest	3537749	-21	lpstat	21:50:15	6
3447963	99	65	27,18	cyclictest	0	-21	swapper/6	21:31:52	6
3447957	99	65	47,18	cyclictest	17	1	ktimers/0	21:00:17	0
3447963	99	64	25,39	cyclictest	0	-21	swapper/6	20:54:57	6
3447959	99	64	26,19	cyclictest	0	-21	swapper/2	20:30:17	2
3447963	99	63	3,39	cyclictest	3461588	-21	taskset	19:32:49	6
3447963	99	63	24,18	cyclictest	0	-21	swapper/6	23:05:33	6
3447963	99	63	23,39	cyclictest	78	50	ktimers/6	20:25:29	6
3447963	99	63	23,39	cyclictest	0	-21	swapper/6	22:36:29	6
3447963	99	63	23,39	cyclictest	0	-21	swapper/6	22:04:17	6
3447963	99	63	23,19	cyclictest	0	-21	swapper/6	23:49:21	6
3447963	99	63	23,19	cyclictest	0	-21	swapper/6	20:44:49	6
3447963	99	63	23,19	cyclictest	0	-21	swapper/6	19:45:05	6
3447963	99	63	23,19	cyclictest	0	-21	swapper/6	00:38:41	6
3447963	99	63	2,19	cyclictest	0	-21	swapper/6	20:56:57	6
3447963	99	62	3,19	cyclictest	0	-21	swapper/6	23:28:45	6
3447963	99	62	23,39	cyclictest	0	-21	swapper/6	23:24:41	6
3447963	99	62	22,39	cyclictest	0	-21	swapper/6	23:54:21	6
3447963	99	62	22,19	cyclictest	0	-21	swapper/6	20:17:05	6
3447963	99	62	22,0	cyclictest	0	-21	swapper/6	00:34:05	6
3447963	99	61	22,18	cyclictest	0	-21	swapper/6	23:57:09	6
3447963	99	61	22,18	cyclictest	0	-21	swapper/6	20:01:25	6
3447963	99	61	22,0	cyclictest	0	-21	swapper/6	23:18:37	6
3447963	99	61	21,19	cyclictest	0	-21	swapper/6	21:21:01	6
3447963	99	60	22,18	cyclictest	0	-21	swapper/6	00:16:01	6
3447963	99	60	21,39	cyclictest	0	-21	swapper/6	23:37:09	6
3447963	99	60	21,39	cyclictest	0	-21	swapper/6	20:14:01	6
3447963	99	60	21,19	cyclictest	0	-21	swapper/6	19:52:41	6
3447963	99	60	21,0	cyclictest	0	-21	swapper/6	19:17:45	6
3447963	99	59	20,38	cyclictest	3566559	-21	taskset	22:41:29	6
3447963	99	59	18,19	cyclictest	3497571	-21	munin-run	20:40:01	6
3447963	99	58	17,19	cyclictest	3503019	-21	munin-run	20:50:00	6
3447963	99	57	38,19	cyclictest	78	1	ktimers/6	22:10:17	6
3447963	99	57	38,19	cyclictest	0	-21	swapper/6	00:10:19	6
3447963	99	55	16,19	cyclictest	3515905	-21	ntp_states	21:10:21	6
3447963	99	54	15,39	cyclictest	0	-21	swapper/6	20:31:07	6
3447963	99	54	15,38	cyclictest	3577946	-21	munin-run	23:05:01	6
3447963	99	54	14,39	cyclictest	78	1	ktimers/6	22:05:09	6
3447963	99	54	13,19	cyclictest	3551927	-21	memory	22:15:19	6
3447958	99	54	14,19	cyclictest	0	-21	swapper/1	23:45:20	1
3447963	99	53	14,39	cyclictest	0	-21	swapper/6	22:22:25	6
3447963	99	53	13,19	cyclictest	0	-21	swapper/6	21:06:53	6
3447962	99	53	15,19	cyclictest	0	-21	swapper/5	00:05:19	5
3447959	99	53	14,39	cyclictest	0	-21	swapper/2	19:40:16	2
3447963	99	52	14,19	cyclictest	3463404	-21	ntpq	19:35:21	6
3447963	99	52	14,19	cyclictest	0	-21	swapper/6	19:10:18	6
3447963	99	51	12,39	cyclictest	0	-21	swapper/6	23:40:51	6
3447963	99	51	12,39	cyclictest	0	-21	swapper/6	21:43:15	6
3447963	99	51	12,0	cyclictest	0	-21	swapper/6	20:07:53	6
3447963	99	51	11,39	cyclictest	0	-21	swapper/6	21:02:23	6
3447963	99	51	11,0	cyclictest	0	-21	swapper/6	22:48:01	6
3447962	99	51	13,19	cyclictest	0	-21	swapper/5	22:05:15	5
3447960	99	51	13,38	cyclictest	0	-21	swapper/3	19:15:16	3
3447959	99	51	13,19	cyclictest	0	-21	swapper/2	19:50:17	2
3447963	99	50	11,39	cyclictest	0	-21	swapper/6	19:43:03	6
3447959	99	50	12,19	cyclictest	0	-21	swapper/2	19:55:16	2
3447964	99	49	31,0	cyclictest	0	-21	swapper/7	22:50:16	7
3447963	99	49	9,39	cyclictest	0	-21	swapper/6	19:22:31	6
3447963	99	49	11,19	cyclictest	0	-21	swapper/6	00:26:19	6
3447963	99	49	10,39	cyclictest	0	-21	swapper/6	23:10:27	6
3447963	99	49	10,39	cyclictest	0	-21	swapper/6	22:51:11	6
3447963	99	49	10,39	cyclictest	0	-21	swapper/6	21:35:51	6
3447957	99	49	11,38	cyclictest	0	-21	swapper/0	22:20:17	0
3447961	99	48	11,18	cyclictest	0	-21	swapper/4	21:10:17	4
3447958	99	48	28,20	cyclictest	3584829	-21	ntpq	23:15:19	1
3447958	99	48	10,38	cyclictest	32	1	rcuc/1	21:45:12	1
3447957	99	48	9,19	cyclictest	3594057	-21	kworker/0:0+ice	00:35:17	0
3447957	99	48	10,19	cyclictest	0	-21	swapper/0	20:45:17	0
3447963	99	47	8,19	cyclictest	0	-21	swapper/6	00:05:19	6
3447962	99	47	9,19	cyclictest	0	-21	swapper/5	23:25:15	5
3447959	99	47	9,19	cyclictest	0	-21	swapper/2	22:45:16	2
3447959	99	46	28,18	cyclictest	0	-21	swapper/2	20:35:16	2
3447964	99	44	25,0	cyclictest	876	-21	mta-sts-daemon	20:55:16	7
3447958	99	44	26,0	cyclictest	0	-21	swapper/1	21:10:16	1
3447962	99	42	4,19	cyclictest	0	-21	swapper/5	21:45:15	5
3447963	99	41	2,19	cyclictest	0	-21	swapper/6	22:25:25	6
3447957	99	41	22,19	cyclictest	0	-21	swapper/0	19:30:15	0
3447962	99	40	2,19	cyclictest	0	-21	swapper/5	19:30:15	5
3447960	99	39	0,20	cyclictest	0	-21	swapper/3	21:25:17	3
3447958	99	39	21,18	cyclictest	0	-21	swapper/1	22:21:14	1
3447957	99	39	1,19	cyclictest	0	-21	swapper/0	22:25:16	0
3447964	99	38	0,19	cyclictest	0	-21	swapper/7	23:50:15	7
3447961	99	38	19,19	cyclictest	0	-21	swapper/4	21:55:17	4
3447961	99	38	0,38	cyclictest	0	-21	swapper/4	00:05:19	4
3447960	99	38	0,19	cyclictest	0	-21	swapper/3	21:05:16	3
3447959	99	38	0,38	cyclictest	0	-21	swapper/2	21:30:16	2
3447964	99	37	0,18	cyclictest	0	-21	swapper/7	22:00:16	7
3447962	99	37	13,23	cyclictest	0	-21	swapper/5	21:20:17	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00