OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Tue Mar 17, 2026 12:43:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
845026	2	59	48,7	sleep6	0	-21	swapper/6	07:00:42	6
845523	99	53	51,2	cyclictest	1321146	-21	kworker/u16:4+events_unbound	11:13:39	5
845536	99	50	44,5	cyclictest	887382	-21	latency_hist	07:23:39	7
845519	99	50	46,3	cyclictest	1415128	-21	kworker/u16:3+flush-8:0	11:43:38	4
845536	99	48	42,5	cyclictest	954297	-21	latency_hist	07:58:38	7
845214	2	47	37,7	sleep5	0	-21	swapper/5	07:03:22	5
845528	99	45	43,2	cyclictest	762722	-21	kworker/u16:2+flush-8:0	07:43:39	6
845528	99	45	43,2	cyclictest	1440001	-21	kworker/u16:1+events_unbound	11:33:13	6
845202	2	45	35,7	sleep4	0	-21	swapper/4	07:03:13	4
845528	99	44	42,2	cyclictest	1475411	-21	kworker/u16:1+events_unbound	12:05:11	6
845528	99	44	42,2	cyclictest	1475411	-21	kworker/u16:1+events_unbound	12:05:11	6
845536	99	43	41,1	cyclictest	1078773	-21	diskmemload	09:14:16	7
845523	99	43	41,2	cyclictest	1452971	-21	kworker/u16:2+events_unbound	12:16:01	5
845523	99	43	41,2	cyclictest	1415128	-21	kworker/u16:3+events_unbound	11:30:00	5
845523	99	43	41,2	cyclictest	1342347	-21	kworker/u16:5+events_unbound	11:02:40	5
845523	99	43	41,2	cyclictest	1321146	-21	kworker/u16:4+flush-8:0	10:54:05	5
845523	99	43	41,2	cyclictest	1031293	-21	kworker/u16:0+events_unbound	09:21:32	5
845528	99	42	40,2	cyclictest	1296090	-21	kworker/u16:2+events_unbound	10:35:01	6
845528	99	42	40,2	cyclictest	1126116	-21	kworker/u16:2+events_unbound	09:31:32	6
845528	99	42	40,2	cyclictest	1011445	-21	kworker/u16:1+events_unbound	09:12:33	6
845523	99	42	40,2	cyclictest	1200044	-21	kworker/u16:0+events_unbound	10:28:03	5
845523	99	42	40,2	cyclictest	1200044	-21	kworker/u16:0+events_unbound	09:59:56	5
845523	99	42	40,2	cyclictest	1163462	-21	kworker/u16:2+events_unbound	09:52:48	5
845523	99	42	40,2	cyclictest	1151115	-21	kworker/u16:1+events_unbound	09:54:36	5
845519	99	42	39,2	cyclictest	1499618	-21	kworker/u16:4+events_unbound	12:18:55	4
845536	99	41	40,0	cyclictest	0	-21	swapper/7	11:32:19	7
845536	99	41	40,0	cyclictest	0	-21	swapper/7	10:59:48	7
845536	99	41	36,4	cyclictest	1021300	-21	latency_hist	08:33:38	7
845528	99	41	39,2	cyclictest	1440001	-21	kworker/u16:1+events_unbound	11:36:48	6
845528	99	41	39,2	cyclictest	1296090	-21	kworker/u16:2+events_unbound	11:08:28	6
845528	99	41	39,2	cyclictest	1163462	-21	kworker/u16:2+events_unbound	10:25:01	6
845523	99	41	39,2	cyclictest	1415128	-21	kworker/u16:3+events_unbound	11:34:12	5
845523	99	41	39,2	cyclictest	1296090	-21	kworker/u16:2+events_unbound	10:35:44	5
845523	99	41	39,2	cyclictest	1151115	-21	kworker/u16:1+events_unbound	09:47:12	5
845523	99	41	39,2	cyclictest	1011445	-21	kworker/u16:1+events_unbound	09:17:44	5
845536	99	40	38,1	cyclictest	1537787	-21	ssh	12:13:00	7
845536	99	40	38,1	cyclictest	1078773	-21	diskmemload	10:54:36	7
845536	99	40	35,4	cyclictest	1381265	-21	latency_hist	11:08:38	7
845528	99	40	38,2	cyclictest	1151115	-21	kworker/u16:1+events_unbound	10:20:29	6
845528	99	40	38,2	cyclictest	1151115	-21	kworker/u16:1+events_unbound	09:51:15	6
845523	99	40	38,2	cyclictest	1415128	-21	kworker/u16:3+events_unbound	11:42:03	5
845523	99	40	38,2	cyclictest	1296090	-21	kworker/u16:2+events_unbound	11:10:16	5
845536	99	39	37,1	cyclictest	1404664	-21	ssh	11:17:16	7
845536	99	39	37,1	cyclictest	1186876	-21	ssh	09:47:08	7
845528	99	39	37,2	cyclictest	1452971	-21	kworker/u16:2+events_unbound	11:40:00	6
845528	99	39	37,2	cyclictest	1163462	-21	kworker/u16:2+events_unbound	09:44:32	6
845528	99	39	37,2	cyclictest	1151115	-21	kworker/u16:1+events_unbound	09:37:32	6
845528	99	39	37,2	cyclictest	1031293	-21	kworker/u16:0+events_unbound	09:20:32	6
845523	99	39	37,2	cyclictest	1499618	-21	kworker/u16:4+events_unbound	12:07:59	5
845523	99	39	37,2	cyclictest	1499618	-21	kworker/u16:4+events_unbound	12:07:59	5
845523	99	39	37,2	cyclictest	1499618	-21	kworker/u16:4+events_unbound	12:01:59	5
845523	99	39	37,2	cyclictest	1475411	-21	kworker/u16:1+events_unbound	12:25:32	5
845523	99	39	37,2	cyclictest	1475411	-21	kworker/u16:1+events_unbound	12:22:52	5
845523	99	39	37,2	cyclictest	1452971	-21	kworker/u16:2+events_unbound	11:45:15	5
845523	99	39	37,2	cyclictest	1296090	-21	kworker/u16:2+flush-8:0	11:19:19	5
845523	99	39	37,2	cyclictest	1296090	-21	kworker/u16:2+events_unbound	11:07:24	5
845523	99	39	37,2	cyclictest	1296090	-21	kworker/u16:2+events_unbound	10:48:20	5
845523	99	39	37,2	cyclictest	1296090	-21	kworker/u16:2+events_unbound	10:48:20	5
845523	99	39	37,2	cyclictest	1031293	-21	kworker/u16:0+events_unbound	09:10:08	5
845523	99	39	36,2	cyclictest	1138093	-21	kworker/u16:3+events_unbound	10:03:41	5
845523	99	39	36,2	cyclictest	1138093	-21	kworker/u16:3+events_unbound	10:03:41	5
845536	99	38	37,0	cyclictest	0	-21	swapper/7	12:05:03	7
845536	99	38	37,0	cyclictest	0	-21	swapper/7	12:05:03	7
845536	99	38	37,0	cyclictest	0	-21	swapper/7	10:05:40	7
845536	99	38	37,0	cyclictest	0	-21	swapper/7	10:05:40	7
845536	99	38	36,1	cyclictest	1391746	-21	ssh	11:10:43	7
845536	99	38	36,1	cyclictest	1163816	-21	ssh	09:38:40	7
845536	99	38	36,1	cyclictest	1138002	-21	ssh	09:26:21	7
845528	99	38	36,2	cyclictest	1321146	-21	kworker/u16:4+events_unbound	10:47:51	6
845528	99	38	36,2	cyclictest	1321146	-21	kworker/u16:4+events_unbound	10:47:51	6
845528	99	38	36,2	cyclictest	1308738	-21	kworker/u16:0+events_unbound	10:59:52	6
845528	99	38	36,2	cyclictest	1151115	-21	kworker/u16:1+events_unbound	10:14:20	6
845523	99	38	36,2	cyclictest	1475411	-21	kworker/u16:1+events_unbound	11:50:00	5
845523	99	38	36,2	cyclictest	1296090	-21	kworker/u16:2+events_unbound	10:50:47	5
845523	99	38	36,2	cyclictest	1283760	-21	kworker/u16:3+events_unbound	10:40:08	5
845523	99	38	36,2	cyclictest	1200044	-21	kworker/u16:0+events_unbound	10:10:00	5
845523	99	38	36,2	cyclictest	1126116	-21	kworker/u16:2+events_unbound	09:31:36	5
845523	99	38	36,2	cyclictest	1031293	-21	kworker/u16:0+events_unbound	09:06:00	5
845523	99	38	36,2	cyclictest	1011445	-21	kworker/u16:1+events_unbound	09:25:13	5
836135	2	38	4,29	sleep7	0	-21	swapper/7	06:58:42	7
845536	99	37	36,0	cyclictest	0	-21	swapper/7	10:37:28	7
845536	99	37	36,0	cyclictest	0	-21	swapper/7	09:31:28	7
845536	99	37	35,1	cyclictest	1078773	-21	diskmemload	11:41:20	7
845536	99	37	34,2	cyclictest	1453196	-21	ssh	11:37:49	7
845528	99	37	35,2	cyclictest	1475411	-21	kworker/u16:1+flush-8:0	12:29:07	6
845528	99	37	35,2	cyclictest	1452971	-21	kworker/u16:2+events_unbound	11:52:34	6
845528	99	37	35,2	cyclictest	1163462	-21	kworker/u16:2+events_unbound	09:56:51	6
845523	99	37	35,2	cyclictest	1283760	-21	kworker/u16:3+events_unbound	10:31:20	5
845523	99	37	35,2	cyclictest	1163462	-21	kworker/u16:2+events_unbound	10:15:44	5
845523	99	37	35,2	cyclictest	1151115	-21	kworker/u16:1+events_unbound	09:37:24	5
845523	99	37	34,2	cyclictest	1200044	-21	kworker/u16:0+flush-8:0	10:18:43	5
845536	99	36	36,0	cyclictest	0	-21	swapper/7	09:23:04	7
845536	99	36	35,0	cyclictest	0	-21	swapper/7	11:20:33	7
845536	99	36	34,1	cyclictest	1513305	-21	ssh	12:02:19	7
845536	99	36	33,2	cyclictest	1283327	-21	ssh	10:26:29	7
845528	99	36	34,2	cyclictest	1499618	-21	kworker/u16:4+events_unbound	12:11:14	6
845528	99	36	34,2	cyclictest	1475411	-21	kworker/u16:1+events_unbound	12:25:16	6
845528	99	36	34,2	cyclictest	1475411	-21	kworker/u16:1+events_unbound	11:48:34	6
845528	99	36	34,2	cyclictest	1452971	-21	kworker/u16:2+events_unbound	12:15:52	6
845528	99	36	34,2	cyclictest	1321146	-21	kworker/u16:4+events_unbound	10:53:47	6
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17