OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Wed Sep 02, 2026 12:43:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1350391	2	57	22,30	sleep7	0	-21	swapper/7	07:05:11	7
1350662	2	51	41,7	sleep4	0	-21	swapper/4	07:07:49	4
1351093	99	48	43,4	cyclictest	1637313	-21	latency_hist	09:29:33	7
1351093	99	46	40,5	cyclictest	1500624	-21	latency_hist	08:24:32	7
1351093	99	33	32,0	cyclictest	0	-21	swapper/7	10:44:34	7
1351093	99	33	31,1	cyclictest	0	-21	swapper/7	10:49:53	7
1351093	99	32	30,1	cyclictest	2005483	-21	ssh	11:58:18	7
1351093	99	32	30,1	cyclictest	1588099	-21	diskmemload	11:59:44	7
1350663	2	32	21,8	sleep5	0	-21	swapper/5	07:07:50	5
1350612	2	32	7,8	sleep6	0	-21	swapper/6	07:07:10	6
1351093	99	31	30,0	cyclictest	0	-21	swapper/7	09:54:27	7
1351093	99	31	0,29	cyclictest	1955038	-21	ssh	11:35:54	7
1351091	99	30	25,2	cyclictest	1707839	-21	kworker/u16:4+events_unbound	09:59:45	6
1351093	99	29	27,1	cyclictest	2041970	-21	ssh	12:12:42	7
1351093	99	29	26,1	cyclictest	0	-21	swapper/7	08:44:33	7
1351093	99	28	26,1	cyclictest	0	-21	swapper/7	09:38:54	7
1351093	99	27	26,0	cyclictest	0	-21	swapper/7	12:34:33	7
1351093	99	27	26,0	cyclictest	0	-21	swapper/7	11:14:30	7
1351093	99	26	25,0	cyclictest	0	-21	swapper/7	10:24:42	7
1351093	99	26	25,0	cyclictest	0	-21	swapper/7	09:59:33	7
1351090	99	25	23,2	cyclictest	1646299	-21	kworker/u16:1+events_unbound	10:41:46	5
1351090	99	25	23,2	cyclictest	1276903	-21	kworker/u16:1+events_unbound	07:45:02	5
1351093	99	24	19,4	cyclictest	1748140	-21	latency_hist	10:14:33	7
1351091	99	24	22,2	cyclictest	1646299	-21	kworker/u16:1+events_unbound	10:09:43	6
1351091	99	24	22,2	cyclictest	1558924	-21	kworker/u16:2+flush-8:0	09:49:57	6
1351091	99	24	22,2	cyclictest	1558924	-21	kworker/u16:2+events_unbound	09:25:15	6
1351090	99	24	22,2	cyclictest	1785170	-21	kworker/u16:2+events_unbound	10:49:46	5
1351090	99	24	22,2	cyclictest	1597227	-21	kworker/u16:3+events_unbound	10:16:06	5
1351093	99	23	22,0	cyclictest	0	-21	swapper/7	11:19:57	7
1351093	99	23	22,0	cyclictest	0	-21	swapper/7	10:22:13	7
1351091	99	23	21,2	cyclictest	1920340	-21	kworker/u16:5+events_unbound	11:54:45	6
1351090	99	23	21,2	cyclictest	1920340	-21	kworker/u16:5+events_unbound	12:05:46	5
1351090	99	23	21,2	cyclictest	1920340	-21	kworker/u16:5+events_unbound	12:01:14	5
1351090	99	23	21,2	cyclictest	1920340	-21	kworker/u16:5+events_unbound	11:46:33	5
1351090	99	23	21,2	cyclictest	1785170	-21	kworker/u16:2+events_unbound	10:47:26	5
1351090	99	23	21,2	cyclictest	1558924	-21	kworker/u16:2+events_unbound	09:45:42	5
1351090	99	23	20,2	cyclictest	1858860	-21	kworker/u16:3+events_unbound	11:53:29	5
1351093	99	22	21,0	cyclictest	0	-21	swapper/7	11:25:25	7
1351093	99	22	21,0	cyclictest	0	-21	swapper/7	10:14:40	7
1351093	99	22	20,1	cyclictest	1724695	-21	ssh	10:04:46	7
1351093	99	22	0,20	cyclictest	1871109	-21	latency_hist	11:04:32	7
1351091	99	22	20,2	cyclictest	1858860	-21	kworker/u16:3+flush-8:0	11:50:01	6
1351091	99	22	19,2	cyclictest	1858860	-21	kworker/u16:3+events_unbound	11:39:40	6
1351090	99	22	20,2	cyclictest	1920340	-21	kworker/u16:5+events_unbound	12:14:41	5
1351090	99	22	20,2	cyclictest	1920340	-21	kworker/u16:5+events_unbound	11:35:26	5
1351090	99	22	20,2	cyclictest	1920255	-21	kworker/u16:2+events_unbound	11:31:22	5
1351090	99	22	20,2	cyclictest	1597227	-21	kworker/u16:3+events_unbound	09:22:21	5
1351093	99	21	20,0	cyclictest	0	-21	swapper/7	10:56:45	7
1351093	99	21	19,1	cyclictest	1969761	-21	ssh	11:44:37	7
1351093	99	21	18,2	cyclictest	1648869	-21	ssh	09:33:18	7
1351093	99	21	0,19	cyclictest	1161	-21	lldpd	10:41:10	7
1351091	99	21	19,2	cyclictest	1451071	-21	kworker/u16:0+events_unbound	08:18:35	6
1351091	99	21	18,2	cyclictest	1558924	-21	kworker/u16:2+flush-8:0	09:09:49	6
1351090	99	21	19,2	cyclictest	1858860	-21	kworker/u16:3+events_unbound	11:59:25	5
1351090	99	21	19,2	cyclictest	1785170	-21	kworker/u16:2+events_unbound	11:01:49	5
1351090	99	21	19,2	cyclictest	1785170	-21	kworker/u16:2+events_unbound	10:34:10	5
1351090	99	21	19,2	cyclictest	1707839	-21	kworker/u16:4+events_unbound	10:26:41	5
1351090	99	21	19,2	cyclictest	1646299	-21	kworker/u16:1+events_unbound	10:12:46	5
1351090	99	21	19,2	cyclictest	1597227	-21	kworker/u16:3+events_unbound	09:39:29	5
1351090	99	21	19,2	cyclictest	1578528	-21	kworker/u16:4+events_unbound	09:11:26	5
1351090	99	21	19,2	cyclictest	1509385	-21	kworker/u16:3+events_unbound	08:56:35	5
1351090	99	21	16,2	cyclictest	1858860	-21	kworker/u16:3+events_unbound	12:20:31	5
1351093	99	20	19,0	cyclictest	0	-21	swapper/7	12:23:41	7
1351093	99	20	19,0	cyclictest	0	-21	swapper/7	07:44:28	7
1351091	99	20	18,2	cyclictest	1707839	-21	kworker/u16:4+events_unbound	10:58:26	6
1351091	99	20	18,2	cyclictest	1509385	-21	kworker/u16:3+events_unbound	08:59:33	6
1351091	99	20	18,2	cyclictest	1276903	-21	kworker/u16:1+flush-8:0	07:34:48	6
1351090	99	20	18,2	cyclictest	1707839	-21	kworker/u16:4+events_unbound	10:35:58	5
1351090	99	20	18,2	cyclictest	1646299	-21	kworker/u16:1+events_unbound	09:44:05	5
1351090	99	20	18,2	cyclictest	1597227	-21	kworker/u16:3+events_unbound	10:01:09	5
1351090	99	20	18,2	cyclictest	1276903	-21	kworker/u16:1+events_unbound	07:15:02	5
1351090	99	20	17,2	cyclictest	1785170	-21	kworker/u16:2+events_unbound	11:14:37	5
1351093	99	19	18,0	cyclictest	0	-21	swapper/7	11:15:29	7
1351093	99	19	18,0	cyclictest	0	-21	swapper/7	09:10:30	7
1351091	99	19	17,2	cyclictest	1785170	-21	kworker/u16:2+events_unbound	11:04:14	6
1351091	99	19	17,2	cyclictest	1597227	-21	kworker/u16:3+events_unbound	09:39:43	6
1351091	99	19	17,2	cyclictest	1509385	-21	kworker/u16:3+flush-8:0	09:04:56	6
1351091	99	19	17,2	cyclictest	1509385	-21	kworker/u16:3+flush-8:0	09:04:56	6
1351091	99	19	17,2	cyclictest	1276903	-21	kworker/u16:1+flush-8:0	07:44:57	6
1351090	99	19	17,2	cyclictest	2055354	-21	kworker/u16:4+events_unbound	12:26:13	5
1351090	99	19	17,2	cyclictest	2018524	-21	kworker/u16:1+events_unbound	12:12:26	5
1351090	99	19	17,2	cyclictest	1920340	-21	kworker/u16:5+events_unbound	11:41:06	5
1351090	99	19	17,2	cyclictest	1707839	-21	kworker/u16:4+events_unbound	10:05:58	5
1351090	99	19	17,2	cyclictest	1451071	-21	kworker/u16:0+events_unbound	08:18:11	5
1351090	99	19	16,2	cyclictest	1597227	-21	kworker/u16:3+events_unbound	09:29:35	5
1351093	99	18	17,0	cyclictest	0	-21	swapper/7	12:33:46	7
1351093	99	18	17,0	cyclictest	0	-21	swapper/7	12:33:46	7
1351093	99	18	17,0	cyclictest	0	-21	swapper/7	12:05:23	7
1351093	99	18	17,0	cyclictest	0	-21	swapper/7	10:35:50	7
1351093	99	18	14,3	cyclictest	1624751	-21	seq	09:24:05	7
1351093	99	18	14,3	cyclictest	1277	-21	snmpd	07:25:20	7
1351091	99	18	16,2	cyclictest	1509385	-21	kworker/u16:3+events_unbound	08:58:56	6
1351091	99	18	16,2	cyclictest	1341069	-21	kworker/u16:3+flush-8:0	07:49:53	6
1351091	99	18	16,2	cyclictest	1341069	-21	kworker/u16:3+events_unbound	07:39:47	6
1351091	99	18	16,2	cyclictest	1287124	-21	kworker/u16:0+events_unbound	07:16:02	6
1351091	99	18	16,2	cyclictest	1276903	-21	kworker/u16:1+events_unbound	08:46:39	6
1351091	99	18	15,2	cyclictest	1276903	-21	kworker/u16:1+flush-8:0	08:24:58	6
1351090	99	18	16,2	cyclictest	1858787	-21	kworker/u16:1+events_unbound	11:21:42	5
1351090	99	18	16,2	cyclictest	1785170	-21	kworker/u16:2+events_unbound	11:11:32	5
1351090	99	18	16,2	cyclictest	1646299	-21	kworker/u16:1+events_unbound	10:22:05	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17