OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #b, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rackbslot1.osadl.org (updated Fri Jul 11, 2025 12:44:37)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2573835	2	229	200,19	sleep1	0	-21	swapper/1	07:08:10	1
2573796	2	213	185,18	sleep0	0	-21	swapper/0	07:07:39	0
2573822	2	205	176,19	sleep3	0	-21	swapper/3	07:07:58	3
2573756	2	205	182,13	sleep2	0	-21	swapper/2	07:07:09	2
2849025	2	64	0,1	chrt	2849020	-21	/usr/share/muni	11:35:02	2
2574178	99	63	10,52	cyclictest	2683774	-21	kworker/u8:0+efi_rts_wq	09:00:02	2
2574178	99	62	0,2	cyclictest	2673975	-21	/usr/share/muni	08:45:02	2
2574175	99	62	4,57	cyclictest	2683774	-21	kworker/u8:0+efi_rts_wq	09:00:03	0
2574178	99	61	38,2	cyclictest	2735886	-21	chrome	09:45:02	2
2574176	99	59	56,2	cyclictest	2714091	-21	kworker/u8:2+events_unbound	11:15:29	1
2574176	99	59	56,2	cyclictest	2674007	-21	snmp_ryswitch.c	08:45:01	1
2574176	99	56	48,3	cyclictest	2836861	-21	kworker/u8:1+events_unbound	11:30:30	1
2574175	99	52	49,3	cyclictest	2642400	-21	kworker/u8:1+flush-179:0	08:45:15	0
2574175	99	52	49,2	cyclictest	2683774	-21	kworker/u8:0+events_unbound	08:55:09	0
2574175	99	52	49,2	cyclictest	2611572	-21	/usr/share/muni	07:45:01	0
2574176	99	51	47,3	cyclictest	2836861	-21	kworker/u8:1+events_unbound	11:55:00	1
2574181	99	50	4,45	cyclictest	2683774	-21	kworker/u8:0+efi_rts_wq	09:00:03	3
2574181	99	49	34,14	cyclictest	2859748	-21	awk	11:45:01	3
2574176	99	49	43,4	cyclictest	2813148	-21	/usr/share/muni	11:00:10	1
2574175	99	49	43,5	cyclictest	2756248	-21	latency_hist	10:05:00	0
2574175	99	48	1,45	cyclictest	40654	-21	chrome	12:00:01	0
2574178	99	47	35,11	cyclictest	2553425	-21	kworker/2:1+pm	07:54:12	2
2574175	99	47	43,3	cyclictest	2836861	-21	kworker/u8:1+flush-179:0	11:45:31	0
2574176	99	46	43,2	cyclictest	2657674	-21	kworker/u8:4+events_unbound	10:45:20	1
2611757	2	45	0,1	sleep1	2611724	-21	snmp_wlanswitch	07:45:04	1
2574175	99	45	41,3	cyclictest	2836861	-21	kworker/u8:1+flush-179:0	11:40:26	0
2574175	99	45	41,3	cyclictest	2636720	-21	kworker/u8:3+flush-179:0	08:15:15	0
2574175	99	45	40,4	cyclictest	2657674	-21	kworker/u8:4+flush-179:0	09:15:06	0
2574181	99	44	30,13	cyclictest	2558937	-1	kworker/3:1H+kblockd	07:27:56	3
2574176	99	44	41,2	cyclictest	2714091	-21	kworker/u8:2+events_unbound	11:00:01	1
2574175	99	44	41,2	cyclictest	2720398	-21	kworker/u8:1+flush-179:0	09:45:32	0
2574175	99	44	40,3	cyclictest	2714091	-21	kworker/u8:2+flush-179:0	10:20:29	0
2574178	99	43	41,1	cyclictest	1412658	-1	kworker/2:0H+kblockd	11:07:52	2
2574178	99	43	41,1	cyclictest	1412658	-1	kworker/2:0H+kblockd	10:21:34	2
2574178	99	43	40,2	cyclictest	1412658	-1	kworker/2:0H+kblockd	11:21:25	2
2574176	99	43	40,2	cyclictest	2621738	-21	kworker/u8:2+events_unbound	08:10:13	1
2574175	99	43	40,2	cyclictest	2797609	-21	chrome	10:45:01	0
2574175	99	43	40,2	cyclictest	2584958	-21	kworker/u8:0+flush-179:0	07:30:10	0
2574175	99	43	39,3	cyclictest	2836862	-21	kworker/u8:3+events_unbound	11:30:00	0
2574178	99	42	35,1	cyclictest	2553425	-21	kworker/2:1+pm	08:18:42	2
2574178	99	42	33,8	cyclictest	2703864	-21	kworker/2:2+pm	09:25:15	2
2574178	99	42	33,8	cyclictest	2703864	-21	kworker/2:2+pm	09:25:15	2
2574176	99	42	40,2	cyclictest	2657674	-21	kworker/u8:4+events_unbound	09:55:31	1
2574176	99	42	38,3	cyclictest	2874982	-21	kworker/u8:2+flush-179:0	12:00:08	1
2574176	99	42	38,3	cyclictest	2863997	-21	kworker/u8:3+events_unbound	12:28:22	1
2574175	99	42	36,4	cyclictest	2616677	-21	/usr/share/muni	07:50:10	0
2574181	99	41	34,4	cyclictest	2558937	-1	kworker/3:1H+kblockd	11:15:32	3
2574178	99	41	39,1	cyclictest	2668217	-21	kworker/2:0+pm	08:51:05	2
2574178	99	41	37,3	cyclictest	2843846	-21	/usr/share/muni	11:30:16	2
2574178	99	41	1,15	cyclictest	40654	-21	chrome	09:50:55	2
2574176	99	41	39,1	cyclictest	2755955	-1	kworker/1:2H+kblockd	11:11:11	1
2574176	99	41	38,2	cyclictest	2836862	-21	kworker/u8:3+events_unbound	11:28:23	1
2574176	99	41	27,13	cyclictest	2657674	-21	kworker/u8:4+events_unbound	10:24:58	1
2574175	99	41	39,2	cyclictest	2657674	-21	kworker/u8:4+events_unbound	10:40:14	0
2574175	99	41	39,2	cyclictest	2657674	-21	kworker/u8:4+events_unbound	10:40:14	0
2574175	99	41	38,2	cyclictest	2584958	-21	kworker/u8:0+events_unbound	07:25:10	0
2574181	99	40	37,2	cyclictest	2802724	-21	kworker/3:1+pm	10:54:55	3
2574181	99	40	37,2	cyclictest	2558937	-1	kworker/3:1H+kblockd	07:47:51	3
2574178	99	40	36,2	cyclictest	2885247	-21	kworker/2:0+pm	12:19:16	2
2574178	99	40	35,3	cyclictest	40654	-21	chrome	11:01:22	2
2574176	99	40	37,2	cyclictest	2836862	-21	kworker/u8:3+events_unbound	11:37:54	1
2574176	99	40	37,2	cyclictest	2568149	-21	kworker/u8:3+flush-179:0	07:20:01	1
2574176	99	40	32,2	cyclictest	2548618	-1	kworker/1:1H+kblockd	09:46:33	1
2574175	99	40	36,3	cyclictest	2714091	-21	kworker/u8:2+flush-179:0	11:15:20	0
2574175	99	40	34,2	cyclictest	2827908	-21	kworker/u8:4+flush-179:0	11:20:08	0
2574181	99	39	34,3	cyclictest	2797606	-21	CacheThread_Blo	10:45:01	3
2574181	99	39	34,3	cyclictest	2797606	-21	CacheThread_Blo	10:45:01	3
2574178	99	39	37,1	cyclictest	2885247	-21	kworker/2:0+pm	12:23:26	2
2574178	99	39	37,1	cyclictest	2755931	-21	kworker/2:1+pm	10:56:31	2
2574178	99	39	37,1	cyclictest	2703864	-21	kworker/2:2+pm	10:03:42	2
2574178	99	39	37,1	cyclictest	2668217	-21	kworker/2:0+pm	09:05:59	2
2574178	99	39	37,1	cyclictest	2668217	-21	kworker/2:0+pm	08:42:37	2
2574178	99	39	37,1	cyclictest	2668217	-21	kworker/2:0+pm	08:42:37	2
2574178	99	39	36,2	cyclictest	2838307	-21	kworker/2:2+pm	11:25:40	2
2574178	99	39	36,2	cyclictest	2755931	-21	kworker/2:1+pm	10:51:10	2
2574178	99	39	36,2	cyclictest	2703864	-21	kworker/2:2+pm	09:47:17	2
2574178	99	39	36,1	cyclictest	2755931	-21	kworker/2:1+pm	10:19:12	2
2574178	99	39	35,3	cyclictest	2685561	-21	ntpq	08:55:12	2
2574178	99	39	33,1	cyclictest	1412658	-1	kworker/2:0H+kblockd	08:30:56	2
2574178	99	39	1,12	cyclictest	35	1	rcuc/2	09:16:06	2
2574176	99	39	37,2	cyclictest	2657674	-21	kworker/u8:4+events_unbound	09:17:01	1
2574176	99	39	36,2	cyclictest	2657674	-21	kworker/u8:4+events_unbound	09:42:18	1
2574176	99	39	35,3	cyclictest	2896020	-21	/usr/share/muni	12:20:15	1
2574175	99	39	36,2	cyclictest	2714091	-21	kworker/u8:2+events_unbound	10:35:28	0
2574175	99	39	35,2	cyclictest	105470	-21	isc-net-0000	08:30:55	0
2574175	99	39	34,3	cyclictest	2668270	-21	kworker/u8:2+events_unbound	08:40:33	0
2574175	99	39	34,3	cyclictest	2668270	-21	kworker/u8:2+events_unbound	08:40:33	0
2574175	99	39	0,38	cyclictest	40654	-21	chrome	08:25:08	0
2574181	99	38	36,1	cyclictest	2730167	-21	kworker/3:0+pm	10:37:16	3
2574181	99	38	34,3	cyclictest	2558937	-1	kworker/3:1H+kblockd	08:30:27	3
2574181	99	38	30,7	cyclictest	2558937	-1	kworker/3:1H+kblockd	11:10:30	3
2574181	99	38	30,7	cyclictest	1260	-21	snmpd	09:10:20	3
2574178	99	38	37,1	cyclictest	2755931	-21	kworker/2:1+pm	10:36:18	2
2574178	99	38	37,1	cyclictest	2703864	-21	kworker/2:2+pm	09:56:14	2
2574178	99	38	36,1	cyclictest	2838307	-21	kworker/2:2+pm	12:09:49	2
2574178	99	38	36,1	cyclictest	2838307	-21	kworker/2:2+pm	11:46:29	2
2574178	99	38	36,1	cyclictest	2827537	-21	kworker/2:0+pm	11:17:14	2
2574178	99	38	36,1	cyclictest	2827537	-21	kworker/2:0+pm	11:12:22	2
2574178	99	38	36,1	cyclictest	2755931	-21	kworker/2:1+pm	10:45:32	2
2574178	99	38	36,1	cyclictest	2755931	-21	kworker/2:1+pm	10:05:22	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17