OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Fri May 08, 2026 12:43:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1476862	2	100	0,1	sleep7	1476861	-21	rm	09:44:39	7
1705585	2	95	0,1	sleep6	0	-21	swapper/6	11:18:47	6
1705585	2	95	0,1	sleep6	0	-21	swapper/6	11:18:47	6
1145938	99	61	58,2	cyclictest	1293794	-21	kworker/u16:0+events_unbound	08:48:40	5
1145938	99	60	57,2	cyclictest	1293794	-21	kworker/u16:0+events_unbound	08:33:41	5
1145938	99	60	57,2	cyclictest	1293794	-21	kworker/u16:0+events_unbound	08:33:41	5
1145938	99	56	53,2	cyclictest	1513715	-21	kworker/u16:1+events_unbound	10:38:56	5
1145938	99	56	53,2	cyclictest	1478994	-21	kworker/u16:2+events_unbound	10:48:40	5
1145938	99	54	52,2	cyclictest	1293794	-21	kworker/u16:0+events_unbound	08:38:54	5
1145534	2	53	43,7	sleep4	0	-21	swapper/4	07:06:59	4
1145938	99	52	50,2	cyclictest	1371136	-21	kworker/u16:2+events_unbound	09:08:40	5
1145938	99	49	47,2	cyclictest	1216834	-21	kworker/u16:1+events_unbound	08:23:55	5
1145938	99	47	45,2	cyclictest	1712407	-21	kworker/u16:5+events_unbound	12:08:48	5
1145938	99	47	44,2	cyclictest	1216834	-21	kworker/u16:1+flush-8:0	07:43:39	5
1145933	99	46	44,2	cyclictest	1293794	-21	kworker/u16:0+flush-8:0	08:33:56	4
1145933	99	46	44,2	cyclictest	1293794	-21	kworker/u16:0+flush-8:0	08:33:56	4
1145938	99	45	42,2	cyclictest	1478994	-21	kworker/u16:2+events_unbound	09:53:39	5
1145938	99	45	42,2	cyclictest	1478994	-21	kworker/u16:2+events_unbound	09:53:39	5
1145938	99	44	42,2	cyclictest	1734383	-21	kworker/u16:1+flush-8:0	11:58:58	5
1145938	99	44	42,2	cyclictest	1734383	-21	kworker/u16:1+flush-8:0	11:58:58	5
1145933	99	43	40,2	cyclictest	1513715	-21	kworker/u16:1+flush-8:0	10:08:25	4
1145933	99	43	40,2	cyclictest	1226980	-21	kworker/u16:0+flush-8:0	07:53:52	4
1145938	99	42	40,2	cyclictest	1712407	-21	kworker/u16:5+events_unbound	11:33:51	5
1145933	99	41	37,3	cyclictest	1216834	-21	kworker/u16:1+flush-8:0	07:58:52	4
1137197	2	41	3,31	sleep7	0	-21	swapper/7	07:03:42	7
1145942	99	39	37,2	cyclictest	1405761	-21	kworker/u16:2+flush-8:0	09:28:51	6
1145938	99	39	37,2	cyclictest	1734383	-21	kworker/u16:1+events_unbound	12:18:12	5
1145938	99	38	36,2	cyclictest	1513715	-21	kworker/u16:1+events_unbound	10:37:41	5
1145938	99	38	36,2	cyclictest	1513715	-21	kworker/u16:1+events_unbound	10:27:53	5
1145938	99	38	36,2	cyclictest	1465884	-21	kworker/u16:0+flush-8:0	09:48:50	5
1145942	99	37	35,2	cyclictest	1322662	-21	kworker/u16:3+flush-8:0	09:59:33	6
1145938	99	37	35,2	cyclictest	1663291	-21	kworker/u16:4+events_unbound	12:07:16	5
1145938	99	37	35,2	cyclictest	1663291	-21	kworker/u16:4+events_unbound	12:07:16	5
1145938	99	37	35,2	cyclictest	1663291	-21	kworker/u16:4+events_unbound	11:43:53	5
1145938	99	37	35,2	cyclictest	1513715	-21	kworker/u16:1+events_unbound	10:47:20	5
1145938	99	37	35,2	cyclictest	1478994	-21	kworker/u16:2+events_unbound	10:12:17	5
1145938	99	37	35,2	cyclictest	1351934	-21	kworker/u16:4+events_unbound	09:18:54	5
1145938	99	37	34,2	cyclictest	1712407	-21	kworker/u16:5+flush-8:0	11:56:03	5
1145582	2	37	27,7	sleep5	0	-21	swapper/5	07:07:41	5
1145938	99	36	34,2	cyclictest	1696857	-21	kworker/u16:2+flush-8:0	11:23:56	5
1145938	99	36	34,2	cyclictest	1322662	-21	kworker/u16:3+flush-8:0	09:03:50	5
1145938	99	36	34,2	cyclictest	1322662	-21	kworker/u16:3+events_unbound	09:17:28	5
1145938	99	36	34,2	cyclictest	1322662	-21	kworker/u16:3+events_unbound	09:17:28	5
1145938	99	36	34,2	cyclictest	1168969	-21	kworker/u16:5+flush-8:0	07:33:54	5
1145942	99	35	30,5	cyclictest	1322662	-21	kworker/u16:3+flush-8:0	08:38:51	6
1145938	99	35	33,2	cyclictest	1734383	-21	kworker/u16:1+events_unbound	11:49:56	5
1145938	99	35	33,2	cyclictest	1712407	-21	kworker/u16:5+events_unbound	12:21:00	5
1145938	99	35	33,2	cyclictest	1478994	-21	kworker/u16:2+flush-8:0	10:58:53	5
1145938	99	35	33,2	cyclictest	1478994	-21	kworker/u16:2+events_unbound	10:02:41	5
1145938	99	35	33,2	cyclictest	1427373	-21	kworker/u16:0+events_unbound	09:26:04	5
1145938	99	35	33,2	cyclictest	1322662	-21	kworker/u16:3+events_unbound	09:31:17	5
1145938	99	35	33,2	cyclictest	1246085	-21	kworker/u16:3+events_unbound	08:14:25	5
1145938	99	34	32,2	cyclictest	1844756	-21	kworker/u16:0+events_unbound	12:29:48	5
1145938	99	34	32,2	cyclictest	1663291	-21	kworker/u16:4+events_unbound	11:11:12	5
1145938	99	34	32,2	cyclictest	1663291	-21	kworker/u16:4+events_unbound	11:07:12	5
1145938	99	34	32,2	cyclictest	1513715	-21	kworker/u16:1+events_unbound	10:17:16	5
1145938	99	34	32,2	cyclictest	1226980	-21	kworker/u16:0+flush-8:0	07:58:53	5
1145933	99	34	32,2	cyclictest	1147372	-21	kworker/u16:3+flush-8:0	07:13:57	4
1145938	99	33	31,2	cyclictest	1696857	-21	kworker/u16:2+events_unbound	11:14:36	5
1145938	99	33	31,2	cyclictest	1663291	-21	kworker/u16:4+flush-8:0	11:18:56	5
1145938	99	33	31,2	cyclictest	1663291	-21	kworker/u16:4+flush-8:0	11:18:56	5
1145938	99	33	31,2	cyclictest	1322662	-21	kworker/u16:3+events_unbound	10:04:16	5
1145938	99	33	31,2	cyclictest	1274615	-21	kworker/u16:2+events_unbound	08:22:41	5
1145938	99	33	30,2	cyclictest	1226980	-21	kworker/u16:0+flush-8:0	07:53:41	5
1145933	99	33	31,2	cyclictest	1293794	-21	kworker/u16:0+flush-8:0	08:33:26	4
1145938	99	32	30,2	cyclictest	1712407	-21	kworker/u16:5+flush-8:0	12:23:53	5
1145938	99	32	30,2	cyclictest	1626376	-21	kworker/u16:0+events_unbound	10:54:04	5
1145938	99	32	30,2	cyclictest	1478994	-21	kworker/u16:2+events_unbound	10:30:33	5
1145938	99	32	30,2	cyclictest	1405761	-21	kworker/u16:2+flush-8:0	09:35:16	5
1145933	99	32	30,2	cyclictest	1612597	-21	kworker/u16:3+events_unbound	10:48:56	4
1145545	2	32	22,7	sleep6	0	-21	swapper/6	07:07:09	6
1145938	99	31	29,2	cyclictest	1322662	-21	kworker/u16:3+flush-8:0	09:01:44	5
1145938	99	31	29,2	cyclictest	1216834	-21	kworker/u16:1+events_unbound	08:03:55	5
1145938	99	31	29,2	cyclictest	1126884	-21	kworker/u16:0+flush-8:0	07:28:53	5
1145938	99	30	28,2	cyclictest	1322662	-21	kworker/u16:3+events_unbound	09:44:20	5
1145938	99	30	28,2	cyclictest	1246085	-21	kworker/u16:3+events_unbound	08:11:42	5
1145938	99	30	28,2	cyclictest	1126884	-21	kworker/u16:0+events_unbound	07:28:25	5
1145933	99	30	28,2	cyclictest	1478994	-21	kworker/u16:2+flush-8:0	09:59:33	4
1145933	99	30	28,2	cyclictest	1322662	-21	kworker/u16:3+flush-8:0	09:23:54	4
1145938	99	29	27,2	cyclictest	1712407	-21	kworker/u16:5+events_unbound	11:31:20	5
1145938	99	29	27,2	cyclictest	1478994	-21	kworker/u16:2+events_unbound	10:18:54	5
1145938	99	29	27,2	cyclictest	1147372	-21	kworker/u16:3+events_unbound	07:13:38	5
1145938	99	29	26,2	cyclictest	1226980	-21	kworker/u16:0+events_unbound	07:48:27	5
1145938	99	29	26,2	cyclictest	1226980	-21	kworker/u16:0+events_unbound	07:48:27	5
1145933	99	29	26,3	cyclictest	1216834	-21	kworker/u16:1+flush-8:0	08:03:43	4
1145933	99	29	26,2	cyclictest	1746697	-21	kworker/u16:0+flush-8:0	11:38:31	4
1145933	99	28	25,2	cyclictest	1513715	-21	kworker/u16:1+flush-8:0	10:58:32	4
1145948	99	27	22,4	cyclictest	1675528	-21	latency_hist	11:08:26	7
1145938	99	27	25,2	cyclictest	1880915	-21	kworker/u16:2+events_unbound	12:36:23	5
1145938	99	27	25,2	cyclictest	1274615	-21	kworker/u16:2+flush-8:0	08:48:25	5
1145938	99	27	25,2	cyclictest	1216834	-21	kworker/u16:1+flush-8:0	07:42:33	5
1145933	99	27	23,3	cyclictest	1082755	-21	kworker/u16:2+flush-8:0	07:18:57	4
1145938	99	26	24,2	cyclictest	1293794	-21	kworker/u16:0+flush-8:0	08:28:44	5
1145933	99	26	24,2	cyclictest	1513715	-21	kworker/u16:1+flush-8:0	11:13:30	4
1145938	99	25	23,2	cyclictest	1734383	-21	kworker/u16:1+flush-8:0	11:38:55	5
1145938	99	25	23,2	cyclictest	1442132	-21	kworker/u16:1+events_unbound	09:41:07	5
1145933	99	25	23,2	cyclictest	1126884	-21	kworker/u16:0+flush-8:0	07:28:58	4
1145938	99	24	22,2	cyclictest	1293794	-21	kworker/u16:0+flush-8:0	08:53:48	5
1145933	99	24	22,2	cyclictest	1478994	-21	kworker/u16:2+events_unbound	10:18:44	4
1145938	99	23	21,2	cyclictest	1147372	-21	kworker/u16:3+flush-8:0	07:09:26	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17