OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #6

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack3slot6.osadl.org (updated Wed Dec 10, 2025 00:45:03)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2742	99	117	87,17	cyclictest	26	-21	ksoftirqd/1	19:20:13	1
2735	99	111	12,33	cyclictest	0	-21	swapper/0	00:30:13	0
2742	99	103	77,16	cyclictest	26	-21	ksoftirqd/1	20:25:17	1
2742	99	103	70,23	cyclictest	26	-21	ksoftirqd/1	19:50:15	1
2742	99	102	63,24	cyclictest	26	-21	ksoftirqd/1	00:15:11	1
2742	99	102	27,64	cyclictest	2728	-21	cyclictest	20:10:16	1
2742	99	98	62,25	cyclictest	26	-21	ksoftirqd/1	21:20:14	1
2742	99	98	62,25	cyclictest	26	-21	ksoftirqd/1	21:20:13	1
2742	99	97	62,25	cyclictest	26	-21	ksoftirqd/1	23:25:14	1
2742	99	96	63,20	cyclictest	26	-21	ksoftirqd/1	21:45:12	1
2742	99	96	61,23	cyclictest	26	-21	ksoftirqd/1	20:05:14	1
2742	99	95	63,21	cyclictest	26	-21	ksoftirqd/1	20:20:14	1
2742	99	95	61,23	cyclictest	26	-21	ksoftirqd/1	22:40:14	1
2742	99	95	60,24	cyclictest	26	-21	ksoftirqd/1	23:20:14	1
2742	99	95	56,25	cyclictest	26	-21	ksoftirqd/1	20:40:15	1
2742	99	95	55,27	cyclictest	26	-21	ksoftirqd/1	21:10:14	1
2742	99	94	57,25	cyclictest	26	-21	ksoftirqd/1	19:35:14	1
2742	99	94	52,29	cyclictest	26	-21	ksoftirqd/1	23:10:17	1
2742	99	93	52,27	cyclictest	26	-21	ksoftirqd/1	19:15:16	1
2742	99	92	51,29	cyclictest	26	-21	ksoftirqd/1	23:05:14	1
2742	99	91	54,26	cyclictest	26	-21	ksoftirqd/1	22:15:13	1
2742	99	90	52,28	cyclictest	26	-21	ksoftirqd/1	23:30:13	1
2184	2	90	27,50	sleep1	0	-21	swapper/1	19:06:03	1
2742	99	89	53,24	cyclictest	26	-21	ksoftirqd/1	00:20:14	1
2742	99	89	48,30	cyclictest	26	-21	ksoftirqd/1	21:25:17	1
2742	99	89	46,31	cyclictest	26	-21	ksoftirqd/1	22:05:15	1
2742	99	89	46,31	cyclictest	26	-21	ksoftirqd/1	20:45:15	1
2742	99	89	30,45	cyclictest	553	-21	runrttasks	22:25:13	1
2742	99	88	11,66	cyclictest	0	-21	swapper/1	22:45:14	1
2735	99	88	13,26	cyclictest	0	-21	swapper/0	20:15:16	0
2742	99	87	7,64	cyclictest	8584	-21	taskset	19:25:12	1
2742	99	87	49,28	cyclictest	26	-21	ksoftirqd/1	20:00:14	1
2742	99	86	45,29	cyclictest	26	-21	ksoftirqd/1	00:25:18	1
2742	99	86	30,44	cyclictest	26	-21	ksoftirqd/1	21:35:15	1
2742	99	85	8,62	cyclictest	6881	-21	seq	23:55:16	1
2742	99	85	44,30	cyclictest	26	-21	ksoftirqd/1	22:00:15	1
2742	99	85	43,31	cyclictest	26	-21	ksoftirqd/1	22:35:16	1
2742	99	85	43,31	cyclictest	26	-21	ksoftirqd/1	22:35:15	1
2742	99	85	11,61	cyclictest	0	-21	swapper/1	23:50:13	1
2742	99	83	8,61	cyclictest	31662	-21	runrttasks	20:30:12	1
2742	99	83	6,62	cyclictest	12200	-21	runrttasks	00:10:13	1
2742	99	83	40,32	cyclictest	26	-21	ksoftirqd/1	22:55:16	1
2742	99	82	8,61	cyclictest	29355	-21	seq	21:55:15	1
2742	99	82	32,34	cyclictest	26	-21	ksoftirqd/1	20:35:13	1
2742	99	82	13,30	cyclictest	0	-21	swapper/1	22:50:11	1
2742	99	82	11,60	cyclictest	0	-21	swapper/1	19:45:12	1
2561	2	81	22,49	sleep0	0	-21	swapper/0	19:09:35	0
2742	99	80	8,58	cyclictest	15047	-21	runrttasks	21:15:17	1
2742	99	80	33,35	cyclictest	26	-21	ksoftirqd/1	21:05:12	1
2742	99	80	21,47	cyclictest	26	-21	ksoftirqd/1	23:00:13	1
2742	99	78	7,58	cyclictest	0	-21	swapper/1	20:15:20	1
2742	99	78	38,29	cyclictest	0	-21	swapper/1	22:30:15	1
2742	99	78	14,52	cyclictest	26	-21	ksoftirqd/1	00:00:14	1
2742	99	77	13,53	cyclictest	0	-21	swapper/1	22:20:13	1
2742	99	76	2,55	cyclictest	0	-21	swapper/1	23:15:12	1
2742	99	76	18,43	cyclictest	26	-21	ksoftirqd/1	23:45:14	1
2742	99	76	13,50	cyclictest	0	-21	swapper/1	19:40:12	1
2742	99	75	36,28	cyclictest	0	-21	swapper/1	21:30:15	1
2742	99	75	36,28	cyclictest	0	-21	swapper/1	19:30:14	1
2742	99	75	27,30	cyclictest	0	-21	swapper/1	21:50:22	1
2742	99	74	4,56	cyclictest	0	-21	swapper/1	23:40:15	1
2742	99	74	4,56	cyclictest	0	-21	swapper/1	23:40:14	1
2742	99	74	35,28	cyclictest	0	-21	swapper/1	21:00:15	1
2742	99	73	31,31	cyclictest	0	-21	swapper/1	19:10:16	1
2742	99	72	31,30	cyclictest	0	-21	swapper/1	00:05:19	1
2742	99	72	25,35	cyclictest	0	-21	swapper/1	20:50:17	1
2742	99	71	23,29	cyclictest	0	-21	swapper/1	21:40:11	1
2742	99	71	23,29	cyclictest	0	-21	swapper/1	21:40:10	1
2742	99	70	22,29	cyclictest	0	-21	swapper/1	23:35:15	1
2742	99	69	28,30	cyclictest	0	-21	swapper/1	22:10:15	1
2742	99	69	24,28	cyclictest	0	-21	swapper/1	19:55:14	1
2735	99	69	8,38	cyclictest	12750	2	sleep0	22:40:11	0
2742	99	68	25,30	cyclictest	0	-21	swapper/1	00:35:16	1
2742	99	68	13,38	cyclictest	0	-21	swapper/1	20:55:15	1
2735	99	67	9,49	cyclictest	19084	-21	apt-get	19:55:13	0
2735	99	67	37,24	cyclictest	14	-21	ksoftirqd/0	19:20:37	0
2735	99	66	9,50	cyclictest	19716	-21	apt-get	23:00:13	0
2742	99	65	12,32	cyclictest	0	-21	swapper/1	00:30:13	1
2735	99	65	25,22	cyclictest	14	-21	ksoftirqd/0	22:04:02	0
2735	99	63	5,40	cyclictest	0	-21	swapper/0	19:29:52	0
2735	99	63	42,14	cyclictest	13932	-21	apt-get	00:15:12	0
2735	99	63	22,28	cyclictest	14	-21	ksoftirqd/0	21:25:31	0
2735	99	63	18,38	cyclictest	21873	-21	/usr/sbin/munin	00:35:38	0
2735	99	63	12,34	cyclictest	15	1	rcu_preempt	23:24:36	0
2735	99	62	13,30	cyclictest	0	-21	swapper/0	23:50:15	0
2735	99	61	37,18	cyclictest	14	-21	ksoftirqd/0	20:35:15	0
2735	99	61	26,20	cyclictest	14	-21	ksoftirqd/0	22:25:35	0
2735	99	60	9,31	cyclictest	27610	-21	apt-get	21:50:15	0
2735	99	60	39,15	cyclictest	2036	-21	munin-run	22:10:00	0
2735	99	60	23,31	cyclictest	12260	-21	aten2.4-expect	00:10:16	0
2735	99	60	17,35	cyclictest	31996	-21	aten2.4-expect	23:35:16	0
2735	99	59	39,13	cyclictest	14	-21	ksoftirqd/0	23:45:01	0
2735	99	59	39,13	cyclictest	14	-21	ksoftirqd/0	23:45:00	0
2735	99	59	35,18	cyclictest	14	-21	ksoftirqd/0	19:45:43	0
2735	99	58	40,10	cyclictest	14	-21	ksoftirqd/0	22:45:16	0
2735	99	58	39,11	cyclictest	14	-21	ksoftirqd/0	23:20:01	0
2735	99	58	35,17	cyclictest	14	-21	ksoftirqd/0	00:20:18	0
2735	99	58	3,47	cyclictest	31754	-21	aten2.4-expect	20:30:15	0
2735	99	58	21,31	cyclictest	17500	-21	aten2.4-expect	00:25:19	0
2735	99	58	17,15	cyclictest	4658	-21	aten2.4-expect	20:45:18	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17