OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Sun Mar 22, 2026 00:43:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
468614	2	58	48,7	sleep4	0	-21	swapper/4	18:58:28	4
478012	99	48	42,5	cyclictest	1031885	-21	latency_hist	23:18:20	7
478011	99	46	44,2	cyclictest	1124618	-21	kworker/u16:5+flush-8:0	00:08:20	6
477405	2	43	6,32	sleep7	0	-21	swapper/7	18:59:03	7
478011	99	42	40,2	cyclictest	974207	-21	kworker/u16:3+events_unbound	23:01:19	6
478011	99	42	40,2	cyclictest	770316	-21	kworker/u16:1+events_unbound	21:35:14	6
478011	99	42	40,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	22:12:47	6
478011	99	41	39,2	cyclictest	671776	-21	kworker/u16:3+events_unbound	21:10:54	6
478011	99	41	39,2	cyclictest	671776	-21	kworker/u16:3+events_unbound	21:10:54	6
477576	2	41	31,7	sleep6	0	-21	swapper/6	19:01:27	6
478011	99	40	38,2	cyclictest	889638	-21	kworker/u16:2+events_unbound	22:34:11	6
478011	99	39	37,2	cyclictest	839595	-21	kworker/u16:4+events_unbound	22:16:46	6
478011	99	39	37,2	cyclictest	818222	-21	kworker/u16:1+events_unbound	23:51:15	6
478011	99	39	37,2	cyclictest	818222	-21	kworker/u16:1+events_unbound	23:51:15	6
478011	99	39	37,2	cyclictest	818222	-21	kworker/u16:1+events_unbound	22:58:19	6
478011	99	39	37,2	cyclictest	818222	-21	kworker/u16:1+events_unbound	22:47:07	6
478011	99	39	37,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	21:47:11	6
478011	99	39	37,2	cyclictest	1138904	-21	kworker/u16:1+events_unbound	00:12:10	6
478011	99	39	36,2	cyclictest	449309	-21	kworker/u16:1+events_unbound	19:03:23	6
478002	99	39	37,2	cyclictest	1124618	-21	kworker/u16:5+flush-8:0	00:33:19	4
478002	99	39	37,2	cyclictest	1124618	-21	kworker/u16:5+flush-8:0	00:33:19	4
478012	99	38	33,4	cyclictest	710719	-21	latency_hist	21:03:20	7
478011	99	38	36,2	cyclictest	974207	-21	kworker/u16:3+events_unbound	23:40:46	6
478011	99	38	36,2	cyclictest	889638	-21	kworker/u16:2+events_unbound	22:18:45	6
478011	99	38	36,2	cyclictest	839595	-21	kworker/u16:4+events_unbound	22:01:10	6
478011	99	38	36,2	cyclictest	818222	-21	kworker/u16:1+events_unbound	21:54:45	6
478011	99	38	36,2	cyclictest	770316	-21	kworker/u16:1+events_unbound	21:30:15	6
478011	99	38	36,2	cyclictest	722391	-21	kworker/u16:2+events_unbound	21:39:26	6
478011	99	38	36,2	cyclictest	1138904	-21	kworker/u16:1+events_unbound	00:15:58	6
478011	99	38	36,2	cyclictest	1115477	-21	kworker/u16:4+events_unbound	00:02:10	6
478011	99	37	35,2	cyclictest	818222	-21	kworker/u16:1+events_unbound	22:51:58	6
478011	99	37	35,2	cyclictest	653437	-21	kworker/u16:1+events_unbound	21:05:43	6
478011	99	37	35,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	22:25:55	6
478011	99	37	35,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	22:08:06	6
478011	99	37	35,2	cyclictest	1138904	-21	kworker/u16:1+events_unbound	00:31:03	6
478011	99	37	35,2	cyclictest	1138904	-21	kworker/u16:1+events_unbound	00:31:03	6
478011	99	37	35,2	cyclictest	1067531	-21	kworker/u16:0+events_unbound	23:56:02	6
478011	99	36	34,2	cyclictest	974207	-21	kworker/u16:3+events_unbound	23:44:38	6
478011	99	36	34,2	cyclictest	974207	-21	kworker/u16:3+events_unbound	23:20:54	6
478011	99	36	34,2	cyclictest	818222	-21	kworker/u16:1+flush-8:0	22:28:50	6
478011	99	36	34,2	cyclictest	818222	-21	kworker/u16:1+flush-8:0	22:28:50	6
478011	99	36	34,2	cyclictest	818222	-21	kworker/u16:1+events_unbound	23:12:39	6
478011	99	36	34,2	cyclictest	818222	-21	kworker/u16:1+events_unbound	23:12:39	6
478011	99	36	34,2	cyclictest	818222	-21	kworker/u16:1+events_unbound	23:06:26	6
478011	99	36	34,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	21:25:43	6
478011	99	36	34,2	cyclictest	1138904	-21	kworker/u16:1+events_unbound	00:18:29	6
478011	99	36	34,2	cyclictest	1044150	-21	kworker/u16:2+events_unbound	23:30:30	6
478011	99	36	34,2	cyclictest	1044150	-21	kworker/u16:2+events_unbound	23:25:37	6
478011	99	35	33,2	cyclictest	722391	-21	kworker/u16:2+events_unbound	21:52:47	6
478011	99	35	33,2	cyclictest	722391	-21	kworker/u16:2+events_unbound	21:52:47	6
478011	99	35	33,2	cyclictest	1184783	-21	kworker/u16:2+events_unbound	00:24:42	6
478007	99	35	33,2	cyclictest	1138904	-21	kworker/u16:1+events_unbound	00:08:50	5
478007	99	35	31,3	cyclictest	818222	-21	kworker/u16:1+events_unbound	23:53:38	5
478012	99	34	0,32	cyclictest	1190980	-21	grep	00:23:38	7
478011	99	34	32,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	21:15:59	6
478011	99	34	32,2	cyclictest	1020436	-21	kworker/u16:0+events_unbound	23:16:34	6
478007	99	34	31,2	cyclictest	818222	-21	kworker/u16:1+flush-8:0	22:28:36	5
478007	99	34	31,2	cyclictest	818222	-21	kworker/u16:1+flush-8:0	22:28:36	5
478011	99	33	31,2	cyclictest	722391	-21	kworker/u16:2+events_unbound	21:20:42	6
478011	99	33	31,2	cyclictest	1067531	-21	kworker/u16:0+events_unbound	23:35:31	6
478007	99	33	31,2	cyclictest	925144	-21	kworker/u16:5+events_unbound	22:33:38	5
478007	99	33	31,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	21:18:43	5
478007	99	33	31,2	cyclictest	1067531	-21	kworker/u16:0+events_unbound	00:18:33	5
477537	2	33	23,7	sleep5	0	-21	swapper/5	19:00:54	5
478012	99	32	27,4	cyclictest	605726	-21	latency_hist	20:08:21	7
478011	99	32	30,2	cyclictest	818222	-21	kworker/u16:1+events_unbound	22:42:06	6
478012	99	31	28,2	cyclictest	910611	-21	ssh	22:23:49	7
478011	99	31	29,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	20:23:15	6
478011	99	31	29,2	cyclictest	3225660	-21	kworker/u16:4+events_unbound	19:38:51	6
478011	99	31	29,2	cyclictest	3225660	-21	kworker/u16:4+events_unbound	19:33:19	6
478007	99	31	29,2	cyclictest	1138904	-21	kworker/u16:1+events_unbound	00:28:50	5
478007	99	31	29,2	cyclictest	1138904	-21	kworker/u16:1+events_unbound	00:28:50	5
478007	99	31	29,2	cyclictest	1067531	-21	kworker/u16:0+events_unbound	23:38:33	5
478012	99	30	28,1	cyclictest	886868	-21	ssh	22:13:50	7
478007	99	30	28,2	cyclictest	1044150	-21	kworker/u16:2+events_unbound	23:23:42	5
478011	99	29	27,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	20:48:18	6
478011	99	29	27,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	19:34:30	6
478011	99	29	27,2	cyclictest	3225660	-21	kworker/u16:4+events_unbound	19:10:19	6
478007	99	29	27,2	cyclictest	1138904	-21	kworker/u16:1+flush-8:0	00:24:17	5
478012	99	28	27,0	cyclictest	0	-21	swapper/7	23:33:48	7
478011	99	28	26,2	cyclictest	605920	-21	kworker/u16:1+events_unbound	20:11:18	6
478011	99	28	26,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	20:00:43	6
478011	99	27	25,2	cyclictest	431094	-21	kworker/u16:2+flush-8:0	19:15:19	6
478011	99	27	25,2	cyclictest	3225660	-21	kworker/u16:4+events_unbound	19:25:26	6
733503	2	26	0,1	chrt	733501	-21	ssh	21:11:15	7
733503	2	26	0,1	chrt	733501	-21	ssh	21:11:15	7
478012	99	26	26,0	cyclictest	0	-21	swapper/7	21:52:52	7
478012	99	26	26,0	cyclictest	0	-21	swapper/7	21:52:52	7
478012	99	26	0,13	cyclictest	0	-21	swapper/7	22:38:42	7
478011	99	26	24,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	20:53:19	6
478007	99	26	24,2	cyclictest	722391	-21	kworker/u16:2+events_unbound	21:53:50	5
478012	99	25	23,1	cyclictest	970244	-21	ssh	22:48:57	7
478012	99	24	0,23	cyclictest	691642	-21	munin-plugin-st	20:53:21	7
478011	99	24	22,2	cyclictest	501120	-21	kworker/u16:0+flush-8:0	20:23:47	6
478007	99	24	22,2	cyclictest	501120	-21	kworker/u16:0+flush-8:0	21:13:53	5
478012	99	23	22,1	cyclictest	710720	-21	diskmemload	22:45:30	7
478011	99	23	21,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	20:53:35	6
478011	99	23	21,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	19:46:31	6
478011	99	23	21,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	19:46:31	6
478011	99	23	21,2	cyclictest	501120	-21	kworker/u16:0+events_unbound	19:21:18	6
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17