OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Tue Mar 03, 2026 00:43:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
623116	2	56	31,7	sleep5	0	-21	swapper/5	19:01:26	5
623638	99	55	49,5	cyclictest	1208711	-21	latency_hist	23:29:36	7
623184	2	51	41,7	sleep6	0	-21	swapper/6	19:02:24	6
623638	99	49	42,6	cyclictest	771393	-21	latency_hist	20:19:36	7
623638	99	47	42,4	cyclictest	1148295	-21	latency_hist	23:04:36	7
623638	99	47	42,4	cyclictest	1148295	-21	latency_hist	23:04:36	7
623629	99	45	43,2	cyclictest	1027598	-21	kworker/u16:0+events_unbound	22:40:04	5
623624	99	44	42,2	cyclictest	1027598	-21	kworker/u16:0+flush-8:0	22:45:00	4
623200	2	44	33,8	sleep4	0	-21	swapper/4	19:02:38	4
623629	99	42	40,2	cyclictest	1098851	-21	kworker/u16:2+events_unbound	22:51:38	5
623629	99	40	38,2	cyclictest	801957	-21	kworker/u16:4+flush-8:0	20:45:00	5
622403	2	40	3,31	sleep7	0	-21	swapper/7	19:00:08	7
623634	99	39	37,2	cyclictest	801957	-21	kworker/u16:4+events_unbound	20:45:02	6
623629	99	39	37,2	cyclictest	1338673	-21	kworker/u16:2+events_unbound	00:34:18	5
623629	99	39	37,2	cyclictest	1158259	-21	kworker/u16:5+events_unbound	23:43:10	5
623629	99	39	37,2	cyclictest	1112054	-21	kworker/u16:4+events_unbound	23:06:19	5
623629	99	39	37,2	cyclictest	1112054	-21	kworker/u16:4+events_unbound	23:06:19	5
623624	99	39	37,2	cyclictest	1027598	-21	kworker/u16:0+events_unbound	22:16:47	4
623634	99	38	36,2	cyclictest	1170758	-21	kworker/u16:0+events_unbound	23:19:15	6
623634	99	38	36,2	cyclictest	1012704	-21	kworker/u16:3+events_unbound	22:51:50	6
623629	99	38	36,2	cyclictest	858405	-21	kworker/u16:1+events_unbound	21:26:39	5
623629	99	38	36,2	cyclictest	838760	-21	kworker/u16:0+events_unbound	21:17:03	5
623629	99	38	36,2	cyclictest	1292679	-21	kworker/u16:0+events_unbound	00:17:47	5
623629	99	38	36,2	cyclictest	1197046	-21	kworker/u16:1+events_unbound	23:47:06	5
623629	99	38	35,2	cyclictest	1170758	-21	kworker/u16:0+events_unbound	23:19:19	5
623624	99	38	36,2	cyclictest	952231	-21	kworker/u16:2+events_unbound	21:57:42	4
623624	99	38	36,2	cyclictest	1305739	-21	kworker/u16:1+events_unbound	00:23:58	4
623624	99	38	36,2	cyclictest	1305739	-21	kworker/u16:1+events_unbound	00:23:58	4
623624	99	38	36,2	cyclictest	1269682	-21	kworker/u16:3+events_unbound	00:01:46	4
623624	99	38	36,2	cyclictest	1158259	-21	kworker/u16:5+events_unbound	00:06:11	4
623624	99	38	36,2	cyclictest	1112054	-21	kworker/u16:4+events_unbound	23:48:11	4
623624	99	38	36,2	cyclictest	1112054	-21	kworker/u16:4+events_unbound	22:59:35	4
623624	99	38	36,2	cyclictest	1012704	-21	kworker/u16:3+events_unbound	22:34:26	4
623634	99	37	35,2	cyclictest	1051442	-21	kworker/u16:1+events_unbound	22:41:03	6
623629	99	37	35,2	cyclictest	952231	-21	kworker/u16:2+events_unbound	22:07:50	5
623629	99	37	35,2	cyclictest	918495	-21	kworker/u16:0+events_unbound	21:55:58	5
623629	99	37	35,2	cyclictest	894192	-21	kworker/u16:3+events_unbound	21:22:23	5
623629	99	37	35,2	cyclictest	1158259	-21	kworker/u16:5+events_unbound	23:58:38	5
623629	99	37	35,2	cyclictest	1158259	-21	kworker/u16:5+events_unbound	00:09:11	5
623629	99	37	35,2	cyclictest	1112054	-21	kworker/u16:4+events_unbound	23:22:19	5
623629	99	37	35,2	cyclictest	1112054	-21	kworker/u16:4+events_unbound	22:59:15	5
623629	99	37	35,2	cyclictest	1098851	-21	kworker/u16:2+events_unbound	23:04:07	5
623629	99	37	35,2	cyclictest	1098851	-21	kworker/u16:2+events_unbound	23:04:07	5
623629	99	37	35,2	cyclictest	1027598	-21	kworker/u16:0+flush-8:0	22:29:46	5
623624	99	37	35,2	cyclictest	918495	-21	kworker/u16:0+events_unbound	22:00:38	4
623624	99	37	35,2	cyclictest	838760	-21	kworker/u16:0+events_unbound	21:06:22	4
623624	99	37	35,2	cyclictest	1305739	-21	kworker/u16:1+events_unbound	00:28:18	4
623624	99	37	35,2	cyclictest	1158259	-21	kworker/u16:5+events_unbound	23:36:51	4
623624	99	37	35,2	cyclictest	1027598	-21	kworker/u16:0+events_unbound	23:00:35	4
623624	99	37	35,2	cyclictest	1027598	-21	kworker/u16:0+events_unbound	23:00:35	4
623624	99	37	34,2	cyclictest	858405	-21	kworker/u16:1+events_unbound	21:29:31	4
623624	99	37	34,2	cyclictest	1027598	-21	kworker/u16:0+events_unbound	22:24:44	4
623634	99	36	34,2	cyclictest	1269682	-21	kworker/u16:3+events_unbound	23:55:34	6
623634	99	36	34,2	cyclictest	1170758	-21	kworker/u16:0+events_unbound	23:20:14	6
623634	99	36	34,2	cyclictest	1158259	-21	kworker/u16:5+events_unbound	23:39:15	6
623634	99	36	34,2	cyclictest	1012704	-21	kworker/u16:3+events_unbound	22:06:55	6
623629	99	36	34,2	cyclictest	1338673	-21	kworker/u16:2+events_unbound	00:22:19	5
623629	99	36	34,2	cyclictest	1338673	-21	kworker/u16:2+events_unbound	00:22:19	5
623629	99	36	34,2	cyclictest	1267850	-21	kworker/u16:2+events_unbound	23:52:42	5
623629	99	36	34,2	cyclictest	1112054	-21	kworker/u16:4+events_unbound	00:03:23	5
623629	99	36	34,2	cyclictest	1098851	-21	kworker/u16:2+events_unbound	22:48:15	5
623629	99	36	34,2	cyclictest	1027598	-21	kworker/u16:0+events_unbound	22:28:11	5
623629	99	36	34,2	cyclictest	1027598	-21	kworker/u16:0+events_unbound	22:18:03	5
623624	99	36	34,2	cyclictest	858405	-21	kworker/u16:1+events_unbound	21:17:46	4
623624	99	36	34,2	cyclictest	858405	-21	kworker/u16:1+events_unbound	21:12:39	4
623624	99	36	34,2	cyclictest	1292679	-21	kworker/u16:0+events_unbound	00:14:06	4
623624	99	36	34,2	cyclictest	1267850	-21	kworker/u16:2+events_unbound	23:52:38	4
623624	99	36	34,2	cyclictest	1158259	-21	kworker/u16:5+events_unbound	23:10:18	4
623624	99	36	34,2	cyclictest	1112054	-21	kworker/u16:4+events_unbound	23:05:46	4
623624	99	36	34,2	cyclictest	1112054	-21	kworker/u16:4+events_unbound	23:05:46	4
623624	99	36	34,2	cyclictest	1027598	-21	kworker/u16:0+events_unbound	22:53:39	4
623634	99	35	33,2	cyclictest	1051442	-21	kworker/u16:1+events_unbound	22:32:58	6
623629	99	35	33,2	cyclictest	1051442	-21	kworker/u16:1+events_unbound	22:36:31	5
623624	99	35	33,2	cyclictest	977851	-21	kworker/u16:5+events_unbound	22:06:22	4
623624	99	35	33,2	cyclictest	918495	-21	kworker/u16:0+events_unbound	21:51:32	4
623624	99	35	33,2	cyclictest	894192	-21	kworker/u16:3+events_unbound	21:42:27	4
623624	99	35	33,2	cyclictest	894192	-21	kworker/u16:3+events_unbound	21:42:27	4
623624	99	35	33,2	cyclictest	1269682	-21	kworker/u16:3+events_unbound	23:55:11	4
623624	99	35	33,2	cyclictest	1170758	-21	kworker/u16:0+events_unbound	23:17:47	4
623624	99	35	33,2	cyclictest	1112054	-21	kworker/u16:4+events_unbound	23:44:06	4
623624	99	35	33,2	cyclictest	1027598	-21	kworker/u16:0+events_unbound	22:21:03	4
623634	99	34	32,2	cyclictest	1098851	-21	kworker/u16:2+events_unbound	23:00:18	6
623634	99	34	32,2	cyclictest	1098851	-21	kworker/u16:2+events_unbound	23:00:18	6
623629	99	34	32,2	cyclictest	977851	-21	kworker/u16:5+events_unbound	21:53:59	5
623629	99	34	32,2	cyclictest	952231	-21	kworker/u16:2+events_unbound	22:21:11	5
623629	99	34	32,2	cyclictest	952231	-21	kworker/u16:2+events_unbound	22:12:06	5
623629	99	34	32,2	cyclictest	894192	-21	kworker/u16:3+events_unbound	21:42:19	5
623629	99	34	32,2	cyclictest	894192	-21	kworker/u16:3+events_unbound	21:42:19	5
623629	99	34	32,2	cyclictest	828793	-21	kworker/u16:2+events_unbound	21:31:11	5
623629	99	34	32,2	cyclictest	1170758	-21	kworker/u16:0+events_unbound	23:14:03	5
623624	99	34	32,2	cyclictest	952231	-21	kworker/u16:2+events_unbound	21:46:10	4
623624	99	34	32,2	cyclictest	918495	-21	kworker/u16:0+events_unbound	21:39:06	4
623624	99	34	32,2	cyclictest	1158259	-21	kworker/u16:5+events_unbound	00:32:15	4
623624	99	34	32,2	cyclictest	1051442	-21	kworker/u16:1+events_unbound	22:36:35	4
623634	99	33	31,2	cyclictest	1305739	-21	kworker/u16:1+events_unbound	00:14:16	6
623634	99	33	31,2	cyclictest	1267850	-21	kworker/u16:2+events_unbound	23:52:40	6
623634	99	33	31,2	cyclictest	1158259	-21	kworker/u16:5+events_unbound	23:06:08	6
623634	99	33	31,2	cyclictest	1158259	-21	kworker/u16:5+events_unbound	23:06:08	6
623629	99	33	31,2	cyclictest	918495	-21	kworker/u16:0+events_unbound	22:02:06	5
623629	99	33	31,2	cyclictest	918495	-21	kworker/u16:0+events_unbound	21:37:28	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17