OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Sun Jul 05, 2026 00:43:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3516812	2	58	21,31	sleep7	0	-21	swapper/7	19:07:59	7
3516741	2	51	41,7	sleep4	0	-21	swapper/4	19:07:00	4
3517187	99	49	48,0	cyclictest	0	-21	swapper/7	21:14:20	7
3517180	99	41	38,2	cyclictest	3745129	-21	kworker/u16:2+events_unbound	22:18:50	5
3517180	99	40	38,2	cyclictest	4169748	-21	kworker/u16:4+events_unbound	00:06:39	5
3517180	99	40	38,2	cyclictest	3745129	-21	kworker/u16:2+events_unbound	21:51:44	5
3517180	99	39	37,2	cyclictest	3745129	-21	kworker/u16:2+events_unbound	23:08:20	5
3516668	2	39	29,7	sleep5	0	-21	swapper/5	19:05:57	5
3517187	99	38	36,1	cyclictest	106	-21	kcompactd0	00:24:35	7
3517180	99	38	36,2	cyclictest	3745129	-21	kworker/u16:2+events_unbound	23:13:19	5
3517180	99	38	36,2	cyclictest	3745129	-21	kworker/u16:2+events_unbound	21:44:16	5
3517187	99	37	36,0	cyclictest	0	-21	swapper/7	21:36:47	7
3517180	99	37	35,2	cyclictest	4116902	-21	kworker/u16:1+events_unbound	23:46:39	5
3517180	99	37	35,2	cyclictest	3802909	-21	kworker/u16:3+events_unbound	22:36:19	5
3517180	99	37	35,2	cyclictest	3745129	-21	kworker/u16:2+events_unbound	22:10:55	5
3517180	99	37	35,2	cyclictest	22897	-21	kworker/u16:2+events_unbound	00:22:15	5
4020877	2	36	0,0	sleep7	4020878	-21	ssh	22:57:00	7
3517180	99	36	34,2	cyclictest	4116902	-21	kworker/u16:1+events_unbound	23:53:11	5
3517180	99	36	34,2	cyclictest	4058682	-21	kworker/u16:3+events_unbound	23:42:36	5
3517180	99	36	34,2	cyclictest	3982876	-21	kworker/u16:6+events_unbound	22:57:43	5
3517180	99	36	34,2	cyclictest	3802909	-21	kworker/u16:3+events_unbound	21:59:47	5
3517180	99	36	34,2	cyclictest	3745129	-21	kworker/u16:2+events_unbound	23:00:18	5
3517180	99	36	34,2	cyclictest	3745129	-21	kworker/u16:2+events_unbound	21:26:47	5
3517180	99	36	34,2	cyclictest	3725641	-21	kworker/u16:0+events_unbound	21:17:03	5
3517187	99	35	0,34	cyclictest	3656970	-21	latency_hist	20:18:49	7
3517180	99	35	33,2	cyclictest	4169747	-21	kworker/u16:0+events_unbound	00:15:20	5
3517180	99	35	33,2	cyclictest	39691	-21	kworker/u16:0+events_unbound	00:29:50	5
3517180	99	35	33,2	cyclictest	3802909	-21	kworker/u16:3+events_unbound	22:49:39	5
3517180	99	35	33,2	cyclictest	3802909	-21	kworker/u16:3+events_unbound	22:15:44	5
3517180	99	35	33,2	cyclictest	3802909	-21	kworker/u16:3+events_unbound	21:42:15	5
3517180	99	35	33,2	cyclictest	3725641	-21	kworker/u16:0+events_unbound	21:20:24	5
3516601	2	35	23,8	sleep6	0	-21	swapper/6	19:05:01	6
3517180	99	34	32,2	cyclictest	4116902	-21	kworker/u16:1+events_unbound	23:35:03	5
3517180	99	34	32,2	cyclictest	4058682	-21	kworker/u16:3+flush-8:0	00:26:23	5
3517180	99	34	32,2	cyclictest	4058682	-21	kworker/u16:3+events_unbound	23:56:39	5
3517180	99	34	32,2	cyclictest	4009787	-21	kworker/u16:0+events_unbound	23:30:43	5
3517180	99	34	32,2	cyclictest	3982876	-21	kworker/u16:6+events_unbound	23:17:35	5
3517180	99	34	32,2	cyclictest	3802909	-21	kworker/u16:3+events_unbound	22:07:08	5
3517180	99	34	32,2	cyclictest	3761058	-21	kworker/u16:1+events_unbound	21:33:12	5
3517180	99	34	32,2	cyclictest	3745129	-21	kworker/u16:2+events_unbound	22:43:14	5
3517180	99	34	32,2	cyclictest	3745129	-21	kworker/u16:2+events_unbound	22:43:14	5
3517180	99	34	32,2	cyclictest	3745129	-21	kworker/u16:2+events_unbound	22:31:07	5
3517187	99	33	31,1	cyclictest	3754493	-21	diskmemload	22:07:22	7
3517180	99	33	31,2	cyclictest	4058682	-21	kworker/u16:3+events_unbound	23:23:35	5
3517180	99	33	31,2	cyclictest	4058682	-21	kworker/u16:3+events_unbound	23:23:35	5
3517180	99	33	31,2	cyclictest	4058682	-21	kworker/u16:3+events_unbound	00:38:42	5
3517180	99	33	31,2	cyclictest	4058682	-21	kworker/u16:3+events_unbound	00:13:31	5
3517180	99	33	31,2	cyclictest	4058682	-21	kworker/u16:3+events_unbound	00:03:07	5
3517180	99	33	31,2	cyclictest	3802909	-21	kworker/u16:3+events_unbound	21:36:39	5
3517180	99	33	31,2	cyclictest	3745129	-21	kworker/u16:2+events_unbound	22:44:59	5
3517180	99	33	31,2	cyclictest	3745129	-21	kworker/u16:2+events_unbound	22:25:03	5
3517180	99	33	30,2	cyclictest	3524475	-21	kworker/u16:4+events_unbound	19:13:51	5
3517187	99	32	31,0	cyclictest	0	-21	swapper/7	20:43:51	7
3517187	99	32	30,1	cyclictest	3924336	-21	ssh	22:18:46	7
3517182	99	32	30,2	cyclictest	3627519	-21	kworker/u16:2+events_unbound	20:29:12	6
3517182	99	32	28,3	cyclictest	4058682	-21	kworker/u16:3+events_unbound	00:04:10	6
3517180	99	32	30,2	cyclictest	3815578	-21	kworker/u16:0+events_unbound	21:55:07	5
3517180	99	31	29,2	cyclictest	3676830	-21	kworker/u16:4+flush-8:0	20:59:12	5
3517180	99	31	29,2	cyclictest	2800150	-21	kworker/u16:3+events_unbound	19:44:09	5
3517180	99	31	29,2	cyclictest	2800150	-21	kworker/u16:3+events_unbound	19:44:09	5
3517180	99	31	28,3	cyclictest	3524475	-21	kworker/u16:4+events_unbound	19:09:16	5
3517187	99	30	29,0	cyclictest	0	-21	swapper/7	21:56:02	7
3517180	99	30	28,2	cyclictest	3761058	-21	kworker/u16:1+events_unbound	21:10:51	5
3517180	99	30	28,2	cyclictest	3745129	-21	kworker/u16:2+events_unbound	23:24:55	5
3517182	99	29	27,2	cyclictest	3982876	-21	kworker/u16:6+events_unbound	22:49:15	6
3517182	99	29	27,2	cyclictest	2800150	-21	kworker/u16:3+flush-8:0	19:29:19	6
3517187	99	28	27,0	cyclictest	0	-21	swapper/7	23:50:06	7
3517187	99	28	27,0	cyclictest	0	-21	swapper/7	22:41:52	7
3517187	99	28	27,0	cyclictest	0	-21	swapper/7	22:41:52	7
3517187	99	27	26,0	cyclictest	0	-21	swapper/7	23:29:56	7
3517187	99	27	26,0	cyclictest	0	-21	swapper/7	22:46:08	7
3517187	99	27	26,0	cyclictest	0	-21	swapper/7	21:29:31	7
3517187	99	27	26,0	cyclictest	0	-21	swapper/7	20:13:12	7
3517187	99	27	26,0	cyclictest	0	-21	swapper/7	00:17:29	7
3517187	99	27	26,0	cyclictest	0	-21	swapper/7	00:09:29	7
3517187	99	27	26,0	cyclictest	0	-21	swapper/7	00:01:20	7
3517187	99	27	24,2	cyclictest	3838704	-21	ssh	21:42:29	7
3517187	99	27	23,3	cyclictest	3948195	-21	sh	22:27:57	7
3517174	99	27	23,3	cyclictest	46047	-21	kworker/u16:1+flush-8:0	00:29:06	4
3517187	99	26	25,0	cyclictest	0	-21	swapper/7	23:46:09	7
3517187	99	26	25,0	cyclictest	0	-21	swapper/7	23:24:35	7
3517187	99	26	25,0	cyclictest	0	-21	swapper/7	23:09:20	7
3517187	99	26	25,0	cyclictest	0	-21	swapper/7	23:05:09	7
3517187	99	26	25,0	cyclictest	0	-21	swapper/7	20:03:12	7
3517187	99	26	25,0	cyclictest	0	-21	swapper/7	19:44:16	7
3517187	99	26	25,0	cyclictest	0	-21	swapper/7	19:44:16	7
3517187	99	26	25,0	cyclictest	0	-21	swapper/7	00:19:14	7
3517187	99	26	24,1	cyclictest	3936244	-21	ssh	22:23:20	7
3517182	99	26	24,2	cyclictest	4058682	-21	kworker/u16:3+events_unbound	00:14:10	6
3517182	99	26	24,2	cyclictest	3745129	-21	kworker/u16:2+events_unbound	22:18:44	6
3517180	99	26	24,2	cyclictest	3657347	-21	kworker/u16:3+events_unbound	20:49:59	5
3517180	99	26	24,2	cyclictest	3558971	-21	kworker/u16:0+events_unbound	19:38:00	5
3517187	99	25	24,0	cyclictest	0	-21	swapper/7	23:16:09	7
3517187	99	25	24,0	cyclictest	0	-21	swapper/7	20:07:11	7
3517187	99	25	24,0	cyclictest	0	-21	swapper/7	00:30:49	7
3517187	99	25	23,1	cyclictest	0	-21	swapper/7	21:47:32	7
3517180	99	25	23,2	cyclictest	3598844	-21	kworker/u16:1+events_unbound	19:50:59	5
3517180	99	25	23,2	cyclictest	3558971	-21	kworker/u16:0+events_unbound	19:32:59	5
3517187	99	24	23,0	cyclictest	0	-21	swapper/7	22:00:24	7
3517187	99	24	22,1	cyclictest	0	-21	swapper/7	00:36:33	7
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17