OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #b, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rackbslot1.osadl.org (updated Fri Oct 24, 2025 12:44:28)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3514160	2	212	167,33	sleep3	0	-21	swapper/3	07:08:56	3
3513999	2	208	181,17	sleep2	0	-21	swapper/2	07:06:59	2
3514027	2	202	173,19	sleep0	0	-21	swapper/0	07:07:22	0
3514049	2	201	173,18	sleep1	0	-21	swapper/1	07:07:39	1
3723322	2	128	0,1	sleep1	3723324	-21	grep	10:30:09	1
3514438	99	79	74,3	cyclictest	247557	-21	chrome	10:45:02	3
3514435	99	78	73,3	cyclictest	3727416	-21	kworker/u8:3+flush-179:0	11:00:01	2
3514435	99	78	73,3	cyclictest	3727416	-21	kworker/u8:3+flush-179:0	11:00:01	2
3514438	99	77	73,2	cyclictest	3551466	-21	apache_processe	07:45:02	3
3514429	99	68	52,14	cyclictest	3675647	-21	exe	09:45:02	1
3514435	99	65	60,4	cyclictest	3727416	-21	kworker/u8:3+flush-179:0	10:55:01	2
3514435	99	64	60,3	cyclictest	3830514	-21	kworker/u8:4+events_unbound	12:20:02	2
3514426	99	61	58,2	cyclictest	3607839	-21	kworker/u8:0+flush-179:0	09:35:19	0
3514435	99	58	55,2	cyclictest	3525469	-21	kworker/u8:1+events_unbound	07:25:20	2
3514426	99	58	44,13	cyclictest	3607839	-21	kworker/u8:0+flush-179:0	08:40:29	0
3514426	99	55	51,3	cyclictest	3830514	-21	kworker/u8:4+flush-179:0	12:20:22	0
3514426	99	55	50,3	cyclictest	3830822	-21	/usr/share/muni	12:15:15	0
3514435	99	54	47,4	cyclictest	3525469	-21	kworker/u8:1+events_unbound	08:20:10	2
3514429	99	54	49,3	cyclictest	3608222	-21	/usr/share/muni	08:40:02	1
3514426	99	54	49,4	cyclictest	3664670	-21	kworker/u8:2+flush-179:0	10:00:37	0
3514435	99	53	47,2	cyclictest	3733233	-21	kworker/u8:2+flush-179:0	10:40:20	2
3514435	99	52	48,3	cyclictest	3810628	-21	kworker/u8:3+flush-179:0	12:00:39	2
3514426	99	52	48,3	cyclictest	3525469	-21	kworker/u8:1+flush-179:0	08:15:29	0
3514426	99	52	46,4	cyclictest	3717230	-21	kworker/u8:1+flush-179:0	11:05:09	0
3514435	99	51	45,4	cyclictest	3551399	-21	ThreadPoolForeg	07:45:15	2
3514429	99	51	46,4	cyclictest	3532199	-21	ntpq	07:25:14	1
3514426	99	51	47,3	cyclictest	3525469	-21	kworker/u8:1+flush-179:0	07:50:21	0
3514435	99	50	45,4	cyclictest	3752926	-21	kworker/u8:0+events_unbound	11:15:19	2
3514435	99	50	43,3	cyclictest	3830514	-21	kworker/u8:4+flush-179:0	12:26:00	2
3514426	99	50	46,3	cyclictest	3773427	-21	kworker/u8:3+flush-179:0	11:35:24	0
3514426	99	50	46,3	cyclictest	3525469	-21	kworker/u8:1+flush-179:0	07:40:23	0
3514435	99	49	46,2	cyclictest	3525469	-21	kworker/u8:1+flush-179:0	09:20:52	2
3514435	99	49	45,3	cyclictest	3752926	-21	kworker/u8:0+flush-179:0	12:10:33	2
3514426	99	49	46,2	cyclictest	3576476	-21	kworker/u8:3+flush-179:0	09:25:30	0
3514438	99	48	34,1	cyclictest	3332397	-1	kworker/3:2H+kblockd	07:38:24	3
3514435	99	48	46,2	cyclictest	3540098	-21	kworker/u8:0+flush-179:0	07:50:25	2
3514435	99	48	44,3	cyclictest	3623407	-21	kworker/u8:2+events_unbound	08:55:24	2
3514435	99	48	44,3	cyclictest	3576476	-21	kworker/u8:3+flush-179:0	09:45:26	2
3514435	99	48	44,3	cyclictest	3519281	-21	kworker/u8:3+flush-179:0	07:17:02	2
3514426	99	48	44,3	cyclictest	3768237	-21	kworker/u8:2+flush-179:0	11:30:32	0
3514426	99	48	44,3	cyclictest	3576476	-21	kworker/u8:3+flush-179:0	09:58:55	0
3514426	99	48	44,3	cyclictest	3525469	-21	kworker/u8:1+events_unbound	08:00:00	0
3514426	99	48	44,3	cyclictest	3519281	-21	kworker/u8:3+flush-179:0	07:20:27	0
3514438	99	47	43,3	cyclictest	3815531	-21	/usr/share/muni	12:00:09	3
3514438	99	47	37,9	cyclictest	3729179	-21	apt-get	10:35:17	3
3514438	99	47	36,9	cyclictest	3629563	-21	kworker/3:2+pm	11:16:33	3
3514435	99	47	43,3	cyclictest	3810628	-21	kworker/u8:3+flush-179:0	12:06:53	2
3514435	99	47	43,3	cyclictest	3721791	-31	munin-html	10:25:36	2
3514435	99	47	43,3	cyclictest	3721791	-31	munin-html	10:25:36	2
3514435	99	47	43,3	cyclictest	3691208	-21	kworker/u8:1+flush-179:0	10:10:29	2
3514435	99	47	43,3	cyclictest	3607839	-21	kworker/u8:0+flush-179:0	09:55:03	2
3514435	99	47	43,3	cyclictest	3519281	-21	kworker/u8:3+flush-179:0	07:25:01	2
3514435	99	47	42,3	cyclictest	3717230	-21	kworker/u8:1+flush-179:0	10:45:15	2
3514435	99	47	33,13	cyclictest	3752926	-21	kworker/u8:0+flush-179:0	11:05:18	2
3514435	99	47	27,2	cyclictest	3586736	-21	kworker/u8:0+events_unbound	08:17:20	2
3514426	99	47	43,3	cyclictest	3781197	-21	kworker/u8:4+flush-179:0	11:25:27	0
3514426	99	47	43,3	cyclictest	3664670	-21	kworker/u8:2+flush-179:0	10:15:26	0
3514426	99	47	43,3	cyclictest	3623407	-21	kworker/u8:2+flush-179:0	08:55:32	0
3514426	99	47	43,3	cyclictest	3566506	-21	kworker/u8:4+events_unbound	08:05:00	0
3514438	99	46	37,8	cyclictest	3363100	-21	kworker/3:0+pm	07:58:33	3
3514435	99	46	44,1	cyclictest	3483043	-21	kworker/2:1+pm	07:12:24	2
3514435	99	46	43,2	cyclictest	3519281	-21	kworker/u8:3+flush-179:0	07:30:15	2
3514435	99	46	42,3	cyclictest	3781197	-21	kworker/u8:4+events_unbound	11:45:19	2
3514435	99	46	42,3	cyclictest	3752926	-21	kworker/u8:0+flush-179:0	11:40:22	2
3514435	99	46	42,3	cyclictest	3717230	-21	kworker/u8:1+flush-179:0	10:30:21	2
3514429	99	46	42,3	cyclictest	3649747	-21	/usr/share/muni	09:20:12	1
3514426	99	46	43,3	cyclictest	3752926	-21	kworker/u8:0+flush-179:0	11:50:09	0
3514426	99	46	42,3	cyclictest	3607839	-21	kworker/u8:0+flush-179:0	09:15:30	0
3514426	99	46	42,3	cyclictest	3607839	-21	kworker/u8:0+flush-179:0	09:15:30	0
3514426	99	46	41,3	cyclictest	3525469	-21	kworker/u8:1+flush-179:0	08:10:16	0
3514438	99	45	30,14	cyclictest	3332397	-1	kworker/3:2H+kblockd	08:00:05	3
3514435	99	45	42,2	cyclictest	3810628	-21	kworker/u8:3+events_unbound	12:15:09	2
3514435	99	45	42,2	cyclictest	3576476	-21	kworker/u8:3+events_unbound	08:50:10	2
3514435	99	45	41,3	cyclictest	3644018	-21	kworker/u8:2+events_unbound	09:15:02	2
3514435	99	45	41,3	cyclictest	3644018	-21	kworker/u8:2+events_unbound	09:15:01	2
3514429	99	45	40,4	cyclictest	3721722	-31	munin-html	10:25:35	1
3514429	99	45	40,4	cyclictest	3721722	-31	munin-html	10:25:35	1
3514426	99	45	42,2	cyclictest	3701372	-21	kworker/u8:0+events_unbound	10:20:33	0
3514426	99	45	42,2	cyclictest	3519281	-21	kworker/u8:3+flush-179:0	07:30:30	0
3514438	99	44	37,5	cyclictest	247515	-21	ThreadPoolForeg	11:25:29	3
3514438	99	44	33,3	cyclictest	3332397	-1	kworker/3:2H+kblockd	10:11:02	3
3514435	99	44	41,2	cyclictest	3752926	-21	kworker/u8:0+flush-179:0	12:35:16	2
3514435	99	44	41,2	cyclictest	3602462	-21	kworker/u8:4+events_unbound	08:35:36	2
3514435	99	44	41,2	cyclictest	3576476	-21	kworker/u8:3+flush-179:0	09:25:33	2
3514435	99	44	41,2	cyclictest	3576476	-21	kworker/u8:3+events_unbound	08:10:09	2
3514435	99	44	40,3	cyclictest	3596954	-21	kworker/u8:0+flush-179:0	08:29:40	2
3514435	99	44	40,3	cyclictest	3540098	-21	kworker/u8:0+flush-179:0	08:05:19	2
3514429	99	44	38,4	cyclictest	3825724	-21	/usr/share/muni	12:10:03	1
3514426	99	44	40,3	cyclictest	3717230	-21	kworker/u8:1+flush-179:0	11:20:13	0
3514426	99	44	40,3	cyclictest	3596954	-21	kworker/u8:0+flush-179:0	08:30:16	0
3514426	99	44	40,3	cyclictest	3493154	-21	kworker/u8:1+flush-179:0	07:10:30	0
3514426	99	44	39,4	cyclictest	3664670	-21	kworker/u8:2+flush-179:0	10:05:27	0
3514438	99	43	41,1	cyclictest	3332397	-1	kworker/3:2H+kblockd	07:42:27	3
3514438	99	43	28,14	cyclictest	3332397	-1	kworker/3:2H+kblockd	09:26:23	3
3514435	99	43	41,2	cyclictest	3717230	-21	kworker/u8:1+flush-179:0	11:00:17	2
3514435	99	43	40,3	cyclictest	3781197	-21	kworker/u8:4+flush-179:0	11:35:08	2
3514435	99	43	39,3	cyclictest	3752926	-21	kworker/u8:0+flush-179:0	11:50:21	2
3514435	99	43	39,3	cyclictest	3727416	-21	kworker/u8:3+events_unbound	11:10:13	2
3514429	99	43	37,5	cyclictest	247561	-21	ThreadPoolForeg	09:30:29	1
3514426	99	43	39,3	cyclictest	3810628	-21	kworker/u8:3+flush-179:0	12:25:04	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17