OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Sun Jan 18, 2026 12:43:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3809580	2	54	19,30	sleep7	0	-21	swapper/7	07:03:45	7
3809580	2	54	19,30	sleep7	0	-21	swapper/7	07:03:45	7
3800598	2	53	42,7	sleep4	0	-21	swapper/4	07:02:38	4
3800598	2	53	42,7	sleep4	0	-21	swapper/4	07:02:38	4
3810140	99	51	49,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	11:37:29	6
3810145	99	50	45,4	cyclictest	4191580	-21	latency_hist	10:17:29	7
281008	2	48	0,0	sleep7	281006	-21	ssh	12:12:37	7
3810136	99	45	43,2	cyclictest	219149	-21	kworker/u16:4+events_unbound	11:56:19	5
3810128	99	45	43,2	cyclictest	4008828	-21	kworker/u16:4+events_unbound	10:11:40	4
3810136	99	42	40,2	cyclictest	4154740	-21	kworker/u16:3+events_unbound	10:51:16	5
3810136	99	42	40,2	cyclictest	4056379	-21	kworker/u16:0+events_unbound	09:56:08	5
3810128	99	42	40,2	cyclictest	304118	-21	kworker/u16:1+events_unbound	12:30:05	4
3810136	99	41	39,2	cyclictest	4008828	-21	kworker/u16:4+events_unbound	09:25:17	5
3810136	99	41	39,2	cyclictest	118888	-21	kworker/u16:2+events_unbound	11:45:44	5
3810128	99	41	39,2	cyclictest	4008828	-21	kworker/u16:4+events_unbound	10:04:40	4
3810128	99	41	39,2	cyclictest	4008828	-21	kworker/u16:4+events_unbound	09:53:16	4
3810128	99	41	39,2	cyclictest	118888	-21	kworker/u16:2+events_unbound	11:11:45	4
3809805	2	41	31,7	sleep6	0	-21	swapper/6	07:06:57	6
3809805	2	41	31,7	sleep6	0	-21	swapper/6	07:06:57	6
3810136	99	40	38,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	11:24:20	5
3810136	99	40	38,2	cyclictest	57033	-21	kworker/u16:0+events_unbound	11:13:09	5
3810136	99	40	38,2	cyclictest	4179345	-21	kworker/u16:0+events_unbound	10:13:21	5
3810136	99	40	38,2	cyclictest	3988713	-21	kworker/u16:2+events_unbound	10:24:45	5
3810136	99	40	38,2	cyclictest	304118	-21	kworker/u16:1+flush-8:0	12:33:04	5
3810136	99	40	38,2	cyclictest	304118	-21	kworker/u16:1+events_unbound	12:26:40	5
3810136	99	40	38,2	cyclictest	219149	-21	kworker/u16:4+events_unbound	12:04:37	5
3810136	99	40	38,2	cyclictest	219149	-21	kworker/u16:4+events_unbound	11:50:04	5
3810128	99	40	38,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	11:55:44	4
3810128	99	40	38,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	11:35:16	4
3810128	99	40	38,2	cyclictest	4008828	-21	kworker/u16:4+events_unbound	09:35:17	4
3810128	99	40	38,2	cyclictest	4008828	-21	kworker/u16:4+events_unbound	09:18:52	4
3810140	99	39	37,2	cyclictest	4008828	-21	kworker/u16:4+events_unbound	09:27:49	6
3810136	99	39	37,2	cyclictest	4154740	-21	kworker/u16:3+events_unbound	10:57:29	5
3810136	99	39	37,2	cyclictest	4056379	-21	kworker/u16:0+events_unbound	10:01:16	5
3810136	99	39	37,2	cyclictest	4008828	-21	kworker/u16:4+events_unbound	10:10:20	5
3810136	99	39	37,2	cyclictest	304118	-21	kworker/u16:1+events_unbound	12:20:47	5
3810128	99	39	37,2	cyclictest	4056379	-21	kworker/u16:0+events_unbound	09:51:44	4
3810128	99	39	37,2	cyclictest	4000275	-21	kworker/u16:1+events_unbound	09:10:32	4
3810128	99	39	37,2	cyclictest	3988713	-21	kworker/u16:2+flush-8:0	09:57:52	4
3810128	99	39	37,2	cyclictest	3988713	-21	kworker/u16:2+events_unbound	10:26:21	4
3810128	99	39	37,2	cyclictest	256082	-21	kworker/u16:0+events_unbound	12:14:35	4
3810128	99	39	36,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	10:57:33	4
3810128	99	39	36,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	10:57:33	4
3810128	99	39	36,2	cyclictest	4008828	-21	kworker/u16:4+flush-8:0	09:39:28	4
3810128	99	39	36,2	cyclictest	4008828	-21	kworker/u16:4+flush-8:0	09:39:28	4
3810136	99	38	36,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	11:30:00	5
3810136	99	38	36,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	11:20:17	5
3810136	99	38	36,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	11:04:20	5
3810136	99	38	36,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	11:04:20	5
3810136	99	38	36,2	cyclictest	4154740	-21	kworker/u16:3+events_unbound	10:41:44	5
3810136	99	38	36,2	cyclictest	4008828	-21	kworker/u16:4+events_unbound	09:35:56	5
3810136	99	38	36,2	cyclictest	4008828	-21	kworker/u16:4+events_unbound	09:20:16	5
3810136	99	38	36,2	cyclictest	3988713	-21	kworker/u16:2+events_unbound	10:21:12	5
3810136	99	38	36,2	cyclictest	3988713	-21	kworker/u16:2+events_unbound	09:42:33	5
3810128	99	38	36,2	cyclictest	4154740	-21	kworker/u16:3+events_unbound	10:55:40	4
3810128	99	38	36,2	cyclictest	4154740	-21	kworker/u16:3+events_unbound	10:49:01	4
3810128	99	38	36,2	cyclictest	4154740	-21	kworker/u16:3+events_unbound	10:18:32	4
3810128	99	38	36,2	cyclictest	3988713	-21	kworker/u16:2+flush-8:0	10:16:20	4
3810128	99	38	36,2	cyclictest	219149	-21	kworker/u16:4+events_unbound	11:48:44	4
3810128	99	38	36,2	cyclictest	118888	-21	kworker/u16:2+events_unbound	11:41:53	4
3810128	99	38	35,2	cyclictest	326419	-21	kworker/u16:3+events_unbound	12:35:24	4
3809578	2	38	28,7	sleep5	0	-21	swapper/5	07:03:43	5
3809578	2	38	28,7	sleep5	0	-21	swapper/5	07:03:43	5
3810136	99	37	35,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	12:00:31	5
3810136	99	37	35,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	11:41:16	5
3810136	99	37	35,2	cyclictest	3988713	-21	kworker/u16:2+flush-8:0	09:09:16	5
3810136	99	37	35,2	cyclictest	3988713	-21	kworker/u16:2+events_unbound	10:35:52	5
3810128	99	37	35,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	11:46:40	4
3810128	99	37	35,2	cyclictest	57033	-21	kworker/u16:0+events_unbound	11:13:56	4
3810128	99	37	35,2	cyclictest	4008828	-21	kworker/u16:4+events_unbound	09:14:28	4
3810128	99	37	35,2	cyclictest	3756228	-21	kworker/u16:3+events_unbound	07:07:56	4
3810140	99	36	34,2	cyclictest	4008828	-21	kworker/u16:4+flush-8:0	09:47:29	6
3810140	99	36	34,2	cyclictest	304118	-21	kworker/u16:1+flush-8:0	12:22:56	6
3810136	99	36	34,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	10:59:48	5
3810136	99	36	34,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	10:59:48	5
3810136	99	36	34,2	cyclictest	3809902	-21	kworker/u16:0+events_unbound	07:14:40	5
3810136	99	36	34,2	cyclictest	219149	-21	kworker/u16:4+events_unbound	12:16:15	5
3810136	99	36	34,2	cyclictest	10380	-21	kworker/u16:1+events_unbound	10:29:13	5
3810128	99	36	34,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	11:58:08	4
3810128	99	36	34,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	11:18:44	4
3810128	99	36	34,2	cyclictest	276943	-21	kworker/u16:2+events_unbound	12:09:44	4
3810128	99	36	34,2	cyclictest	256082	-21	kworker/u16:0+events_unbound	12:18:36	4
3810128	99	36	34,2	cyclictest	10380	-21	kworker/u16:1+events_unbound	10:29:21	4
3810128	99	36	33,2	cyclictest	4154740	-21	kworker/u16:3+events_unbound	10:44:12	4
3810128	99	36	33,2	cyclictest	276943	-21	kworker/u16:2+flush-8:0	12:24:19	4
3810136	99	35	33,2	cyclictest	95804	-21	kworker/u16:1+events_unbound	12:09:36	5
3810136	99	35	33,2	cyclictest	4056379	-21	kworker/u16:0+events_unbound	09:30:41	5
3810136	99	35	33,2	cyclictest	4008828	-21	kworker/u16:4+events_unbound	09:13:37	5
3810136	99	35	32,2	cyclictest	4056379	-21	kworker/u16:0+flush-8:0	09:48:16	5
3810128	99	35	33,2	cyclictest	57033	-21	kworker/u16:0+events_unbound	11:29:07	4
3810128	99	35	33,2	cyclictest	3988713	-21	kworker/u16:2+events_unbound	09:30:33	4
3810140	99	34	32,2	cyclictest	3809902	-21	kworker/u16:0+flush-8:0	07:27:29	6
3810136	99	34	32,2	cyclictest	57033	-21	kworker/u16:0+events_unbound	11:11:04	5
3810136	99	34	32,2	cyclictest	326419	-21	kworker/u16:3+events_unbound	12:28:08	5
3810136	99	34	31,2	cyclictest	3756228	-21	kworker/u16:3+events_unbound	07:37:32	5
3810128	99	34	32,2	cyclictest	4154740	-21	kworker/u16:3+events_unbound	10:35:01	4
3810128	99	34	32,2	cyclictest	4056379	-21	kworker/u16:0+events_unbound	09:26:33	4
3810136	99	33	31,2	cyclictest	57033	-21	kworker/u16:0+events_unbound	10:43:43	5
3810136	99	33	31,2	cyclictest	4008828	-21	kworker/u16:4+flush-8:0	10:03:07	5
3810136	99	33	31,2	cyclictest	3959607	-21	kworker/u16:3+events_unbound	08:34:40	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17