OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Thu Apr 23, 2026 00:43:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4106959	2	58	47,8	sleep4	0	-21	swapper/4	19:07:27	4
4098501	2	41	3,31	sleep7	0	-21	swapper/7	19:04:41	7
4107399	99	40	37,2	cyclictest	462467	-21	kworker/u16:1+events_unbound	23:59:29	4
4107403	99	39	37,2	cyclictest	548762	-21	kworker/u16:3+events_unbound	00:29:21	5
4107403	99	39	37,2	cyclictest	160462	-21	kworker/u16:1+events_unbound	21:37:18	5
4107408	99	38	35,2	cyclictest	138069	-21	kworker/u16:3+events_unbound	21:04:30	6
4107403	99	38	36,2	cyclictest	326993	-21	kworker/u16:2+events_unbound	22:52:25	5
4107403	99	38	36,2	cyclictest	326993	-21	kworker/u16:2+events_unbound	22:52:25	5
4107399	99	38	36,2	cyclictest	326993	-21	kworker/u16:2+events_unbound	22:41:01	4
4107399	99	38	36,2	cyclictest	231239	-21	kworker/u16:0+events_unbound	21:56:27	4
4107403	99	37	35,2	cyclictest	435929	-21	kworker/u16:0+events_unbound	23:16:50	5
4107403	99	37	35,2	cyclictest	435929	-21	kworker/u16:0+events_unbound	23:10:57	5
4107403	99	37	35,2	cyclictest	253525	-21	kworker/u16:3+events_unbound	22:43:49	5
4107403	99	37	34,2	cyclictest	462467	-21	kworker/u16:1+events_unbound	23:46:58	5
4107399	99	37	35,2	cyclictest	548762	-21	kworker/u16:3+events_unbound	00:32:22	4
4107403	99	36	34,2	cyclictest	462467	-21	kworker/u16:1+events_unbound	23:38:26	5
4107403	99	36	34,2	cyclictest	253525	-21	kworker/u16:3+events_unbound	22:26:15	5
4107403	99	36	34,2	cyclictest	160462	-21	kworker/u16:1+events_unbound	21:30:51	5
4107399	99	36	34,2	cyclictest	498774	-21	kworker/u16:2+events_unbound	00:10:58	4
4107399	99	36	34,2	cyclictest	484279	-21	kworker/u16:3+events_unbound	23:34:26	4
4107399	99	36	34,2	cyclictest	484279	-21	kworker/u16:3+events_unbound	23:34:26	4
4107399	99	36	34,2	cyclictest	484279	-21	kworker/u16:3+events_unbound	23:25:46	4
4107399	99	36	34,2	cyclictest	414543	-21	kworker/u16:4+events_unbound	23:42:42	4
4107399	99	36	34,2	cyclictest	3623	-21	kworker/u16:0+events_unbound	21:12:49	4
4107399	99	36	34,2	cyclictest	231239	-21	kworker/u16:0+events_unbound	22:03:51	4
4107399	99	36	34,2	cyclictest	160462	-21	kworker/u16:1+events_unbound	21:49:11	4
4107410	99	35	34,0	cyclictest	0	-21	swapper/7	21:32:41	7
4107408	99	35	33,2	cyclictest	548762	-21	kworker/u16:3+events_unbound	00:35:38	6
4107403	99	35	33,2	cyclictest	462467	-21	kworker/u16:1+events_unbound	23:22:17	5
4107403	99	35	33,2	cyclictest	253525	-21	kworker/u16:3+events_unbound	22:18:17	5
4107399	99	35	33,2	cyclictest	631921	-21	kworker/u16:2+events_unbound	00:35:22	4
4107399	99	35	33,2	cyclictest	535439	-21	kworker/u16:0+events_unbound	00:08:30	4
4107399	99	35	33,2	cyclictest	253525	-21	kworker/u16:3+events_unbound	22:36:49	4
4107399	99	35	33,2	cyclictest	148082	-21	kworker/u16:4+events_unbound	22:06:27	4
4107399	99	35	33,2	cyclictest	148082	-21	kworker/u16:4+events_unbound	21:27:42	4
4107399	99	35	33,2	cyclictest	148082	-21	kworker/u16:4+events_unbound	21:27:42	4
4107410	99	34	33,0	cyclictest	0	-21	swapper/7	00:05:09	7
4107410	99	34	32,1	cyclictest	0	-21	swapper/7	00:27:00	7
4107410	99	34	28,5	cyclictest	377744	-21	latency_hist	22:44:27	7
4107408	99	34	32,2	cyclictest	498774	-21	kworker/u16:2+events_unbound	00:15:50	6
4107408	99	34	32,2	cyclictest	3372762	-21	kworker/u16:1+events_unbound	19:24:50	6
4107408	99	34	31,2	cyclictest	435929	-21	kworker/u16:0+events_unbound	23:07:22	6
4107403	99	34	32,2	cyclictest	631921	-21	kworker/u16:2+events_unbound	00:36:03	5
4107403	99	34	32,2	cyclictest	618494	-21	kworker/u16:4+events_unbound	00:23:17	5
4107403	99	34	32,2	cyclictest	535439	-21	kworker/u16:0+events_unbound	00:30:29	5
4107403	99	34	32,2	cyclictest	535439	-21	kworker/u16:0+events_unbound	00:10:29	5
4107403	99	34	32,2	cyclictest	535439	-21	kworker/u16:0+events_unbound	00:09:09	5
4107403	99	34	32,2	cyclictest	435929	-21	kworker/u16:0+events_unbound	23:05:50	5
4107403	99	34	32,2	cyclictest	414543	-21	kworker/u16:4+events_unbound	23:31:47	5
4107403	99	34	32,2	cyclictest	414543	-21	kworker/u16:4+events_unbound	23:31:47	5
4107403	99	34	32,2	cyclictest	253525	-21	kworker/u16:3+events_unbound	22:39:02	5
4107403	99	34	32,2	cyclictest	231239	-21	kworker/u16:0+events_unbound	21:57:18	5
4107403	99	34	32,2	cyclictest	160462	-21	kworker/u16:1+events_unbound	21:42:54	5
4107399	99	34	32,2	cyclictest	618494	-21	kworker/u16:4+events_unbound	00:27:02	4
4107399	99	34	32,2	cyclictest	462467	-21	kworker/u16:1+events_unbound	23:59:13	4
4107399	99	34	32,2	cyclictest	414543	-21	kworker/u16:4+events_unbound	23:49:17	4
4107399	99	34	32,2	cyclictest	281067	-21	kworker/u16:1+events_unbound	22:16:06	4
4107399	99	34	32,2	cyclictest	231239	-21	kworker/u16:0+events_unbound	22:11:18	4
4106894	2	34	23,8	sleep5	0	-21	swapper/5	19:06:32	5
4107410	99	33	32,0	cyclictest	0	-21	swapper/7	23:26:54	7
4107410	99	33	26,5	cyclictest	635	-21	systemd-journal	19:19:28	7
4107408	99	33	31,2	cyclictest	548762	-21	kworker/u16:3+events_unbound	00:28:38	6
4107408	99	33	31,2	cyclictest	535439	-21	kworker/u16:0+events_unbound	00:32:42	6
4107408	99	33	31,2	cyclictest	253525	-21	kworker/u16:3+events_unbound	21:58:30	6
4107403	99	33	31,2	cyclictest	535439	-21	kworker/u16:0+events_unbound	23:56:41	5
4107403	99	33	31,2	cyclictest	535439	-21	kworker/u16:0+events_unbound	23:53:29	5
4107403	99	33	31,2	cyclictest	414543	-21	kworker/u16:4+events_unbound	23:25:09	5
4107403	99	33	31,2	cyclictest	253525	-21	kworker/u16:3+events_unbound	22:33:02	5
4107403	99	33	31,2	cyclictest	253525	-21	kworker/u16:3+events_unbound	22:22:25	5
4107403	99	33	31,2	cyclictest	253525	-21	kworker/u16:3+events_unbound	22:08:34	5
4107403	99	33	31,2	cyclictest	253525	-21	kworker/u16:3+events_unbound	22:01:18	5
4107403	99	33	31,2	cyclictest	253525	-21	kworker/u16:3+events_unbound	21:52:27	5
4107403	99	33	31,2	cyclictest	231239	-21	kworker/u16:0+events_unbound	22:11:01	5
4107403	99	33	31,2	cyclictest	231239	-21	kworker/u16:0+events_unbound	21:45:54	5
4107399	99	33	31,2	cyclictest	498774	-21	kworker/u16:2+flush-8:0	00:20:18	4
4107399	99	33	31,2	cyclictest	462467	-21	kworker/u16:1+flush-8:0	23:50:09	4
4107399	99	33	31,2	cyclictest	435929	-21	kworker/u16:0+events_unbound	23:17:22	4
4107399	99	33	31,2	cyclictest	414543	-21	kworker/u16:4+events_unbound	23:20:49	4
4107399	99	33	31,2	cyclictest	414543	-21	kworker/u16:4+events_unbound	23:00:49	4
4107399	99	33	31,2	cyclictest	253525	-21	kworker/u16:3+events_unbound	22:50:53	4
4107399	99	33	31,2	cyclictest	253525	-21	kworker/u16:3+events_unbound	22:50:53	4
4107399	99	33	31,2	cyclictest	160462	-21	kworker/u16:1+events_unbound	21:17:14	4
4107399	99	33	31,2	cyclictest	148082	-21	kworker/u16:4+events_unbound	21:30:34	4
4107399	99	33	30,2	cyclictest	435929	-21	kworker/u16:0+events_unbound	23:09:11	4
4107410	99	32	31,0	cyclictest	0	-21	swapper/7	23:12:42	7
4107410	99	32	31,0	cyclictest	0	-21	swapper/7	22:31:34	7
4107408	99	32	30,2	cyclictest	41552	-21	kworker/u16:1+events_unbound	20:42:49	6
4107408	99	32	30,2	cyclictest	253525	-21	kworker/u16:3+events_unbound	22:32:42	6
4107408	99	32	30,2	cyclictest	148082	-21	kworker/u16:4+flush-8:0	22:04:37	6
4107408	99	32	30,2	cyclictest	148082	-21	kworker/u16:4+events_unbound	21:10:10	6
4107408	99	32	29,2	cyclictest	4159167	-21	kworker/u16:3+flush-8:0	19:49:28	6
4107403	99	32	30,2	cyclictest	484279	-21	kworker/u16:3+events_unbound	23:40:23	5
4107403	99	32	30,2	cyclictest	3623	-21	kworker/u16:0+events_unbound	21:26:43	5
4107403	99	32	30,2	cyclictest	3623	-21	kworker/u16:0+events_unbound	21:26:43	5
4107403	99	32	30,2	cyclictest	281067	-21	kworker/u16:1+events_unbound	23:04:02	5
4107403	99	32	30,2	cyclictest	148082	-21	kworker/u16:4+events_unbound	21:15:33	5
4107399	99	32	30,2	cyclictest	484279	-21	kworker/u16:3+events_unbound	23:37:53	4
4107399	99	32	30,2	cyclictest	435929	-21	kworker/u16:0+events_unbound	23:11:26	4
4107399	99	32	30,2	cyclictest	326993	-21	kworker/u16:2+events_unbound	22:55:46	4
4107399	99	32	30,2	cyclictest	326993	-21	kworker/u16:2+events_unbound	22:30:06	4
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17