OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Thu Jan 15, 2026 00:43:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1073148	2	58	48,7	sleep5	0	-21	swapper/5	19:07:04	5
1072907	2	53	19,30	sleep7	0	-21	swapper/7	19:03:37	7
1072943	2	51	40,8	sleep6	0	-21	swapper/6	19:04:08	6
1073501	99	39	37,2	cyclictest	1310218	-21	kworker/u16:4+events_unbound	21:40:50	6
1073501	99	39	37,2	cyclictest	1194159	-21	kworker/u16:1+events_unbound	21:12:18	6
1073501	99	38	36,2	cyclictest	1685970	-21	kworker/u16:1+flush-8:0	23:44:41	6
1073501	99	38	36,2	cyclictest	1464618	-21	kworker/u16:3+events_unbound	22:14:41	6
1073501	99	38	36,2	cyclictest	1457069	-21	kworker/u16:0+flush-8:0	23:12:26	6
1073501	99	37	35,2	cyclictest	1457069	-21	kworker/u16:0+events_unbound	22:47:17	6
1073501	99	36	34,2	cyclictest	1555611	-21	kworker/u16:1+events_unbound	23:05:57	6
1073501	99	36	34,2	cyclictest	1442301	-21	kworker/u16:2+events_unbound	22:12:18	6
1073501	99	36	34,2	cyclictest	1408254	-21	kworker/u16:6+events_unbound	23:37:17	6
1073501	99	36	34,2	cyclictest	1408254	-21	kworker/u16:6+events_unbound	23:37:17	6
1073501	99	36	34,2	cyclictest	1332154	-21	kworker/u16:2+events_unbound	21:15:34	6
1073501	99	35	33,2	cyclictest	1761902	-21	kworker/u16:0+events_unbound	00:35:21	6
1073501	99	35	33,2	cyclictest	1457069	-21	kworker/u16:0+events_unbound	23:29:02	6
1073501	99	35	33,2	cyclictest	1457069	-21	kworker/u16:0+events_unbound	22:49:10	6
1073501	99	35	33,2	cyclictest	1408254	-21	kworker/u16:6+flush-8:0	22:06:49	6
1073501	99	35	32,2	cyclictest	1685970	-21	kworker/u16:1+flush-8:0	23:52:52	6
1073046	2	35	25,7	sleep4	0	-21	swapper/4	19:05:34	4
1073507	99	34	28,5	cyclictest	1371220	-21	latency_hist	21:32:43	7
1073507	99	34	28,5	cyclictest	1371220	-21	latency_hist	21:32:43	7
1073507	99	34	26,7	cyclictest	1773560	-21	latency_hist	00:17:43	7
1073507	99	34	26,7	cyclictest	1773560	-21	latency_hist	00:17:43	7
1073501	99	34	32,2	cyclictest	1712653	-21	kworker/u16:3+events_unbound	00:31:09	6
1073501	99	34	32,2	cyclictest	1457069	-21	kworker/u16:0+events_unbound	23:38:29	6
1073501	99	34	32,2	cyclictest	1457069	-21	kworker/u16:0+events_unbound	23:38:29	6
1073501	99	34	32,2	cyclictest	1442301	-21	kworker/u16:2+events_unbound	22:20:17	6
1073501	99	34	32,2	cyclictest	1442301	-21	kworker/u16:2+events_unbound	21:59:01	6
1073501	99	34	32,2	cyclictest	1408254	-21	kworker/u16:6+events_unbound	22:29:22	6
1073501	99	34	32,2	cyclictest	1359048	-21	kworker/u16:1+events_unbound	21:56:05	6
1073501	99	33	31,2	cyclictest	1725563	-21	kworker/u16:4+events_unbound	00:03:57	6
1073501	99	33	31,2	cyclictest	1685970	-21	kworker/u16:1+flush-8:0	00:08:21	6
1073501	99	33	31,2	cyclictest	1310217	-21	kworker/u16:3+events_unbound	21:27:21	6
1073501	99	32	30,2	cyclictest	1761902	-21	kworker/u16:0+events_unbound	00:17:32	6
1073501	99	32	30,2	cyclictest	1761902	-21	kworker/u16:0+events_unbound	00:17:32	6
1073501	99	32	30,2	cyclictest	1457069	-21	kworker/u16:0+flush-8:0	22:24:14	6
1073501	99	32	30,2	cyclictest	1457069	-21	kworker/u16:0+events_unbound	23:26:53	6
1073501	99	32	30,2	cyclictest	1457069	-21	kworker/u16:0+events_unbound	22:41:17	6
1073501	99	32	30,2	cyclictest	1408254	-21	kworker/u16:6+flush-8:0	22:33:25	6
1073501	99	32	30,2	cyclictest	1243529	-21	kworker/u16:3+flush-8:0	20:45:30	6
1073501	99	31	29,2	cyclictest	388904	-21	kworker/u16:5+flush-8:0	19:53:10	6
1073501	99	31	29,2	cyclictest	1555611	-21	kworker/u16:1+events_unbound	22:59:24	6
1073501	99	31	29,2	cyclictest	1310218	-21	kworker/u16:4+events_unbound	21:34:21	6
1073501	99	31	29,2	cyclictest	1310217	-21	kworker/u16:3+events_unbound	21:20:17	6
1073501	99	30	28,2	cyclictest	1761902	-21	kworker/u16:0+events_unbound	00:27:36	6
1073501	99	30	28,2	cyclictest	1685970	-21	kworker/u16:1+flush-8:0	23:50:09	6
1073501	99	30	28,2	cyclictest	1590914	-21	kworker/u16:3+flush-8:0	23:14:29	6
1073501	99	30	28,2	cyclictest	1457069	-21	kworker/u16:0+flush-8:0	22:53:25	6
1073501	99	30	28,2	cyclictest	1457069	-21	kworker/u16:0+flush-8:0	22:53:25	6
1073501	99	30	28,2	cyclictest	1408254	-21	kworker/u16:6+events_unbound	23:21:00	6
1073501	99	30	28,2	cyclictest	1194159	-21	kworker/u16:1+events_unbound	21:04:53	6
1073496	99	30	28,2	cyclictest	1457069	-21	kworker/u16:0+events_unbound	23:02:55	4
1073501	99	29	27,2	cyclictest	388904	-21	kworker/u16:5+events_unbound	19:18:22	6
1073501	99	29	27,2	cyclictest	388904	-21	kworker/u16:5+events_unbound	19:18:22	6
1073501	99	29	27,2	cyclictest	1725563	-21	kworker/u16:4+events_unbound	00:19:16	6
1073501	99	29	27,2	cyclictest	1725245	-21	kworker/u16:2+flush-8:0	23:58:41	6
1073501	99	29	27,2	cyclictest	1395684	-21	kworker/u16:5+events_unbound	21:49:24	6
1073501	99	29	27,2	cyclictest	1290007	-21	kworker/u16:0+events_unbound	20:53:54	6
1073501	99	29	26,2	cyclictest	1243529	-21	kworker/u16:3+events_unbound	20:47:45	6
1073501	99	29	26,2	cyclictest	1243529	-21	kworker/u16:3+events_unbound	20:37:54	6
1073496	99	29	27,2	cyclictest	1555611	-21	kworker/u16:1+events_unbound	22:52:55	4
1073496	99	29	27,2	cyclictest	1555611	-21	kworker/u16:1+events_unbound	22:52:55	4
1073496	99	29	27,2	cyclictest	1243529	-21	kworker/u16:3+flush-8:0	20:43:06	4
1073501	99	28	26,2	cyclictest	1290007	-21	kworker/u16:0+events_unbound	20:59:54	6
1073501	99	28	26,2	cyclictest	1194159	-21	kworker/u16:1+events_unbound	20:36:54	6
1073496	99	28	26,2	cyclictest	1725563	-21	kworker/u16:4+flush-8:0	00:18:06	4
1073496	99	28	26,2	cyclictest	1590914	-21	kworker/u16:3+events_unbound	23:34:48	4
1073496	99	28	26,2	cyclictest	1590914	-21	kworker/u16:3+events_unbound	23:34:48	4
1073507	99	27	0,25	cyclictest	650	-21	systemd-journal	19:12:44	7
1073501	99	27	25,2	cyclictest	1310218	-21	kworker/u16:4+events_unbound	21:31:12	6
1073501	99	27	25,2	cyclictest	1310218	-21	kworker/u16:4+events_unbound	21:31:12	6
1073496	99	27	25,2	cyclictest	1359048	-21	kworker/u16:1+events_unbound	21:50:01	4
1073496	99	27	25,2	cyclictest	1194159	-21	kworker/u16:1+events_unbound	20:32:59	4
1073501	99	26	24,2	cyclictest	1212882	-21	kworker/u16:0+flush-8:0	20:21:47	6
1073501	99	26	24,2	cyclictest	1115199	-21	kworker/u16:2+flush-8:0	19:29:03	6
1663132	2	25	0,1	chrt	1663133	-21	sh	23:31:24	7
1073507	99	25	20,4	cyclictest	1505484	-21	latency_hist	22:27:43	7
1073507	99	25	19,5	cyclictest	1615222	-21	latency_hist	23:12:43	7
1073501	99	25	23,2	cyclictest	1232980	-21	kworker/u16:2+events_unbound	20:31:06	6
1073501	99	25	23,2	cyclictest	1115199	-21	kworker/u16:2+events_unbound	19:38:51	6
1073501	99	25	23,2	cyclictest	1072271	-21	kworker/u16:1+events_unbound	19:34:55	6
1073496	99	25	23,2	cyclictest	1590914	-21	kworker/u16:3+events_unbound	23:11:56	4
1073496	99	25	23,2	cyclictest	1115199	-21	kworker/u16:2+events_unbound	19:59:21	4
1073501	99	24	22,2	cyclictest	388904	-21	kworker/u16:5+events_unbound	20:17:43	6
1073501	99	24	22,2	cyclictest	1115199	-21	kworker/u16:2+events_unbound	20:09:58	6
1073501	99	24	22,2	cyclictest	1072271	-21	kworker/u16:1+events_unbound	19:48:38	6
1073496	99	24	22,2	cyclictest	388904	-21	kworker/u16:5+flush-8:0	19:13:22	4
1073496	99	24	22,2	cyclictest	1457069	-21	kworker/u16:0+events_unbound	23:29:51	4
1073496	99	24	22,2	cyclictest	1442301	-21	kworker/u16:2+events_unbound	22:09:59	4
1073501	99	23	21,2	cyclictest	1194159	-21	kworker/u16:1+events_unbound	20:25:46	6
1073496	99	23	21,2	cyclictest	1457069	-21	kworker/u16:0+events_unbound	22:23:09	4
1073496	99	23	21,2	cyclictest	1072271	-21	kworker/u16:1+events_unbound	19:34:06	4
1073501	99	22	20,2	cyclictest	388904	-21	kworker/u16:5+flush-8:0	20:02:40	6
1073501	99	22	20,2	cyclictest	388904	-21	kworker/u16:5+flush-8:0	19:23:35	6
1073496	99	22	20,2	cyclictest	1212882	-21	kworker/u16:0+flush-8:0	20:22:58	4
1073496	99	22	20,2	cyclictest	1194159	-21	kworker/u16:1+events_unbound	20:16:25	4
1073507	99	21	16,4	cyclictest	650	-21	systemd-journal	20:02:44	7
1073507	99	21	16,4	cyclictest	650	-21	systemd-journal	20:02:44	7
1073501	99	21	19,2	cyclictest	1072271	-21	kworker/u16:1+events_unbound	19:09:19	6
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17