OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Sat Feb 28, 2026 00:43:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1106588	2	68	40,8	sleep5	0	-21	swapper/5	19:04:13	5
1106948	99	49	42,5	cyclictest	1167908	-21	latency_hist	19:34:49	7
1106938	99	49	46,2	cyclictest	1542901	-21	kworker/u16:4+events_unbound	22:34:50	4
1106938	99	47	44,2	cyclictest	1578445	-21	kworker/u16:1+events_unbound	22:59:45	4
1106942	99	46	43,2	cyclictest	1195323	-21	kworker/u16:0+events_unbound	20:45:12	5
6265	89	45	0,38	rtkit-daemon	0	-21	swapper/6	19:00:03	6
1106938	99	45	43,2	cyclictest	1411256	-21	kworker/u16:1+events_unbound	21:34:50	4
1106938	99	44	42,2	cyclictest	1661960	-21	kworker/u16:4+events_unbound	00:25:11	4
1106942	99	43	41,2	cyclictest	1746925	-21	kworker/u16:3+events_unbound	00:07:30	5
1106938	99	43	41,2	cyclictest	1432783	-21	kworker/u16:2+flush-8:0	21:46:54	4
1106948	99	42	38,3	cyclictest	1542392	-21	ssh	22:29:39	7
1106944	99	42	40,2	cyclictest	1746925	-21	kworker/u16:3+events_unbound	00:21:38	6
1106938	99	42	40,2	cyclictest	1746925	-21	kworker/u16:3+events_unbound	00:12:17	4
1106938	99	42	40,2	cyclictest	1661960	-21	kworker/u16:4+events_unbound	00:17:34	4
1106513	2	42	15,9	sleep4	0	-21	swapper/4	19:03:08	4
1106948	99	41	39,1	cyclictest	0	-21	swapper/7	00:23:14	7
1106944	99	41	39,2	cyclictest	1458130	-21	kworker/u16:4+events_unbound	22:03:09	6
1106938	99	41	39,2	cyclictest	1578445	-21	kworker/u16:1+events_unbound	23:34:30	4
1106938	99	41	39,2	cyclictest	1519040	-21	kworker/u16:3+events_unbound	22:21:46	4
1106356	2	41	5,31	sleep7	0	-21	swapper/7	19:00:54	7
1106944	99	40	38,2	cyclictest	1746925	-21	kworker/u16:3+events_unbound	00:33:28	6
1106944	99	40	38,2	cyclictest	1588165	-21	kworker/u16:2+events_unbound	23:19:02	6
1106944	99	40	38,2	cyclictest	1578445	-21	kworker/u16:1+events_unbound	23:21:54	6
1106944	99	40	38,2	cyclictest	1578445	-21	kworker/u16:1+events_unbound	22:48:45	6
1106944	99	40	38,2	cyclictest	1542901	-21	kworker/u16:4+events_unbound	22:40:58	6
1106942	99	40	38,2	cyclictest	1697782	-21	kworker/u16:0+events_unbound	23:59:45	5
1106942	99	40	38,2	cyclictest	1661960	-21	kworker/u16:4+flush-8:0	00:25:13	5
1106942	99	40	38,2	cyclictest	1661960	-21	kworker/u16:4+events_unbound	00:34:44	5
1106942	99	40	38,2	cyclictest	1578445	-21	kworker/u16:1+events_unbound	22:51:42	5
1106938	99	40	38,2	cyclictest	1661960	-21	kworker/u16:4+events_unbound	00:29:57	4
1106938	99	40	38,2	cyclictest	1578445	-21	kworker/u16:1+events_unbound	23:29:18	4
1106938	99	40	38,2	cyclictest	1506825	-21	kworker/u16:2+events_unbound	22:26:26	4
1106938	99	40	38,2	cyclictest	1348758	-21	kworker/u16:1+events_unbound	21:18:14	4
1106948	99	39	36,2	cyclictest	1339667	-21	diskmemload	22:21:41	7
1106944	99	39	37,2	cyclictest	1746925	-21	kworker/u16:3+events_unbound	00:08:17	6
1106944	99	39	37,2	cyclictest	1661960	-21	kworker/u16:4+events_unbound	23:47:54	6
1106944	99	39	37,2	cyclictest	1650045	-21	kworker/u16:3+events_unbound	23:38:29	6
1106944	99	39	37,2	cyclictest	1650045	-21	kworker/u16:3+events_unbound	23:33:02	6
1106944	99	39	37,2	cyclictest	1588165	-21	kworker/u16:2+events_unbound	23:12:39	6
1106944	99	39	37,2	cyclictest	1330461	-21	kworker/u16:2+events_unbound	21:25:49	6
1106944	99	39	37,2	cyclictest	1195323	-21	kworker/u16:0+events_unbound	21:43:30	6
1106942	99	39	37,2	cyclictest	3866410	-21	kworker/u16:3+events_unbound	19:20:13	5
1106942	99	39	37,2	cyclictest	1661960	-21	kworker/u16:4+events_unbound	23:30:34	5
1106942	99	39	37,2	cyclictest	1492777	-21	kworker/u16:0+events_unbound	22:43:01	5
1106942	99	39	37,2	cyclictest	1492777	-21	kworker/u16:0+events_unbound	22:12:57	5
1106942	99	39	37,2	cyclictest	1446878	-21	kworker/u16:3+events_unbound	21:59:30	5
1106938	99	39	37,2	cyclictest	1745651	-21	kworker/u16:2+events_unbound	00:09:29	4
1106938	99	39	37,2	cyclictest	1697782	-21	kworker/u16:0+events_unbound	23:36:14	4
1106938	99	39	37,2	cyclictest	1578445	-21	kworker/u16:1+events_unbound	23:23:10	4
1106938	99	39	37,2	cyclictest	1506825	-21	kworker/u16:2+flush-8:0	22:19:48	4
1106938	99	39	37,2	cyclictest	1458130	-21	kworker/u16:4+events_unbound	22:03:05	4
1106938	99	39	37,2	cyclictest	1432783	-21	kworker/u16:2+events_unbound	21:51:11	4
1106938	99	39	36,2	cyclictest	1458130	-21	kworker/u16:4+events_unbound	22:04:58	4
1106948	99	38	37,0	cyclictest	0	-21	swapper/7	23:27:50	7
1106948	99	38	36,1	cyclictest	1408335	-21	ssh	21:30:13	7
1106948	99	38	36,1	cyclictest	1408335	-21	ssh	21:30:13	7
1106944	99	38	36,2	cyclictest	1661960	-21	kworker/u16:4+events_unbound	23:42:53	6
1106944	99	38	36,2	cyclictest	1661960	-21	kworker/u16:4+events_unbound	00:11:50	6
1106944	99	38	36,2	cyclictest	1588165	-21	kworker/u16:2+events_unbound	23:06:02	6
1106944	99	38	36,2	cyclictest	1578445	-21	kworker/u16:1+events_unbound	23:27:22	6
1106944	99	38	36,2	cyclictest	1542901	-21	kworker/u16:4+events_unbound	22:52:37	6
1106944	99	38	36,2	cyclictest	1506825	-21	kworker/u16:2+events_unbound	22:27:54	6
1106944	99	38	36,2	cyclictest	1446878	-21	kworker/u16:3+events_unbound	21:58:25	6
1106944	99	38	36,2	cyclictest	1432783	-21	kworker/u16:2+events_unbound	21:51:54	6
1106944	99	38	36,2	cyclictest	1330461	-21	kworker/u16:2+events_unbound	21:06:26	6
1106944	99	38	36,2	cyclictest	1234917	-21	kworker/u16:3+events_unbound	21:23:09	6
1106944	99	38	36,2	cyclictest	1195323	-21	kworker/u16:0+events_unbound	21:37:29	6
1106944	99	38	36,2	cyclictest	1195323	-21	kworker/u16:0+events_unbound	20:45:18	6
1106942	99	38	36,2	cyclictest	1661960	-21	kworker/u16:4+events_unbound	23:25:45	5
1106942	99	38	36,2	cyclictest	1588165	-21	kworker/u16:2+events_unbound	23:06:49	5
1106942	99	38	36,2	cyclictest	1578445	-21	kworker/u16:1+events_unbound	22:58:54	5
1106942	99	38	36,2	cyclictest	1411256	-21	kworker/u16:1+events_unbound	21:42:06	5
1106942	99	38	36,2	cyclictest	1195323	-21	kworker/u16:0+events_unbound	21:23:42	5
1106938	99	38	36,2	cyclictest	1745651	-21	kworker/u16:2+events_unbound	23:58:17	4
1106938	99	38	36,2	cyclictest	1588165	-21	kworker/u16:2+events_unbound	22:48:50	4
1106938	99	38	36,2	cyclictest	1446878	-21	kworker/u16:3+events_unbound	21:57:54	4
1106938	99	38	35,2	cyclictest	1330461	-21	kworker/u16:2+events_unbound	21:33:38	4
1106938	99	38	35,2	cyclictest	1330461	-21	kworker/u16:2+events_unbound	21:33:38	4
1106944	99	37	35,2	cyclictest	1731346	-21	kworker/u16:1+events_unbound	23:50:49	6
1106944	99	37	35,2	cyclictest	1542901	-21	kworker/u16:4+events_unbound	22:39:22	6
1106944	99	37	35,2	cyclictest	1542901	-21	kworker/u16:4+events_unbound	22:32:06	6
1106944	99	37	35,2	cyclictest	1519040	-21	kworker/u16:3+events_unbound	22:24:25	6
1106944	99	37	35,2	cyclictest	1492777	-21	kworker/u16:0+events_unbound	22:17:25	6
1106944	99	37	35,2	cyclictest	1195323	-21	kworker/u16:0+events_unbound	21:12:22	6
1106944	99	37	34,2	cyclictest	1234917	-21	kworker/u16:3+flush-8:0	21:04:48	6
1106942	99	37	35,2	cyclictest	1661960	-21	kworker/u16:4+events_unbound	23:42:21	5
1106942	99	37	35,2	cyclictest	1578445	-21	kworker/u16:1+events_unbound	23:18:41	5
1106942	99	37	35,2	cyclictest	1411256	-21	kworker/u16:1+events_unbound	22:19:02	5
1106938	99	37	35,2	cyclictest	1746925	-21	kworker/u16:3+events_unbound	00:20:53	4
1106938	99	37	35,2	cyclictest	1731346	-21	kworker/u16:1+flush-8:0	23:50:21	4
1106938	99	37	35,2	cyclictest	1661960	-21	kworker/u16:4+events_unbound	23:49:23	4
1106938	99	37	35,2	cyclictest	1588165	-21	kworker/u16:2+events_unbound	23:07:30	4
1106938	99	37	35,2	cyclictest	1578445	-21	kworker/u16:1+events_unbound	23:02:57	4
1106938	99	37	35,2	cyclictest	1519040	-21	kworker/u16:3+events_unbound	22:31:46	4
1106938	99	37	35,2	cyclictest	1234917	-21	kworker/u16:3+flush-8:0	20:40:14	4
1106938	99	37	35,2	cyclictest	1195323	-21	kworker/u16:0+events_unbound	21:23:46	4
1106948	99	36	35,0	cyclictest	0	-21	swapper/7	23:49:49	7
1106948	99	36	35,0	cyclictest	0	-21	swapper/7	23:10:50	7
1106948	99	36	35,0	cyclictest	0	-21	swapper/7	22:53:55	7
1106948	99	36	35,0	cyclictest	0	-21	swapper/7	22:30:58	7
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17