OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #8

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot8.osadl.org (updated Mon Sep 15, 2025 12:45:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4156580	99	413	410,2	cyclictest	0	-21	swapper/7	09:41:19	13
4156580	99	411	408,2	cyclictest	210081	-21	kworker/u64:4+events_unbound	11:35:28	13
4156580	99	410	407,2	cyclictest	155179	-21	kworker/u64:2+events_unbound	11:28:19	13
4156580	99	410	407,2	cyclictest	103221	-21	kworker/u64:1+events_unbound	10:07:48	13
4156580	99	407	404,2	cyclictest	223207	-21	kworker/u64:1+events_unbound	11:47:49	13
4156585	99	406	404,1	cyclictest	0	-21	swapper/11	11:53:24	3
4156582	99	406	401,4	cyclictest	0	-21	swapper/9	09:41:19	15
4156582	99	398	395,2	cyclictest	7010	-21	kworker/u64:3+events_unbound	09:54:09	15
4156585	99	395	390,3	cyclictest	103221	-21	kworker/u64:1+events_unbound	09:41:19	3
4156585	99	391	388,2	cyclictest	62588	-21	kworker/u64:0+events_unbound	10:05:36	3
4156585	99	390	390,0	cyclictest	0	-21	swapper/11	10:16:19	3
4156585	99	387	387,0	cyclictest	0	-21	swapper/11	07:57:46	3
4156585	99	387	387,0	cyclictest	0	-21	swapper/11	07:57:45	3
4156585	99	386	386,0	cyclictest	0	-21	swapper/11	09:33:59	3
4156589	99	382	380,1	cyclictest	0	-21	swapper/13	09:41:19	5
4156591	99	378	377,0	cyclictest	0	-21	swapper/15	11:48:08	7
4156572	99	374	371,2	cyclictest	0	-21	swapper/0	11:48:08	0
4156589	99	368	365,2	cyclictest	62588	-21	kworker/u64:0+events_unbound	10:29:42	5
4156589	99	368	365,2	cyclictest	62588	-21	kworker/u64:0+events_unbound	10:29:41	5
4156575	99	366	363,2	cyclictest	1857870	-21	kworker/u64:2+events_unbound	08:26:26	8
4156575	99	366	362,3	cyclictest	530	-1	kworker/2:1H+kblockd	09:41:18	8
4156575	99	365	361,3	cyclictest	155179	-21	kworker/u64:2+events_unbound	10:48:06	8
4156589	99	364	363,1	cyclictest	0	-21	swapper/13	10:16:20	5
4156575	99	364	359,3	cyclictest	1857870	-21	kworker/u64:2+events_unbound	08:58:00	8
4156575	99	359	358,1	cyclictest	0	-21	swapper/2	07:53:16	8
4156575	99	359	358,1	cyclictest	0	-21	swapper/2	07:53:16	8
4156579	99	358	356,1	cyclictest	1924	-21	snmpd	11:48:07	12
4156591	99	356	355,0	cyclictest	0	-21	swapper/15	10:07:56	7
4156578	99	356	351,4	cyclictest	0	-21	swapper/5	09:41:19	11
4156591	99	353	352,0	cyclictest	0	-21	swapper/15	08:26:27	7
4156591	99	352	351,0	cyclictest	0	-21	swapper/15	10:12:12	7
4156591	99	351	351,0	cyclictest	0	-21	swapper/15	12:13:20	7
4156591	99	351	350,0	cyclictest	0	-21	swapper/15	10:48:06	7
4156591	99	351	348,2	cyclictest	0	-21	swapper/15	09:41:18	7
4156572	99	351	348,2	cyclictest	0	-21	swapper/0	10:07:57	0
4156591	99	350	350,0	cyclictest	0	-21	swapper/15	12:28:44	7
4156591	99	350	349,0	cyclictest	0	-21	swapper/15	11:35:28	7
4156578	99	350	347,2	cyclictest	117798	-21	kworker/u64:5+events_unbound	10:16:20	11
4156591	99	349	349,0	cyclictest	0	-21	swapper/15	07:36:22	7
4156591	99	349	348,0	cyclictest	0	-21	swapper/15	11:28:18	7
4156591	99	349	348,0	cyclictest	0	-21	swapper/15	09:34:00	7
4156591	99	349	348,0	cyclictest	0	-21	swapper/15	07:57:46	7
4156591	99	349	348,0	cyclictest	0	-21	swapper/15	07:57:46	7
4156591	99	349	347,1	cyclictest	0	-21	swapper/15	08:24:06	7
4156578	99	349	349,0	cyclictest	0	-21	swapper/5	10:29:42	11
4156578	99	349	349,0	cyclictest	0	-21	swapper/5	10:29:42	11
4156572	99	349	346,3	cyclictest	0	-21	swapper/0	08:26:27	0
4156572	99	349	344,4	cyclictest	62588	-21	kworker/u64:0+events_unbound	10:12:11	0
4156572	99	349	344,4	cyclictest	233941	-21	kworker/u64:6+events_unbound	12:28:44	0
4156572	99	349	344,4	cyclictest	223207	-21	kworker/u64:1+events_unbound	12:13:20	0
4156572	99	349	342,5	cyclictest	4156904	-21	kworker/u64:3+events_unbound	07:36:23	0
4156591	99	348	348,0	cyclictest	0	-21	swapper/15	08:58:00	7
4156591	99	348	347,0	cyclictest	0	-21	swapper/15	09:47:39	7
4156591	99	348	347,0	cyclictest	0	-21	swapper/15	07:53:16	7
4156591	99	348	347,0	cyclictest	0	-21	swapper/15	07:53:16	7
4156572	99	347	341,5	cyclictest	7010	-21	kworker/u64:3+events_unbound	09:41:19	0
4156572	99	346	343,3	cyclictest	0	-21	swapper/0	10:48:06	0
4156572	99	346	341,4	cyclictest	1857870	-21	kworker/u64:2+events_unbound	08:24:06	0
4156572	99	345	342,2	cyclictest	0	-21	swapper/0	11:28:19	0
4156572	99	345	342,2	cyclictest	0	-21	swapper/0	07:57:46	0
4156572	99	345	342,2	cyclictest	0	-21	swapper/0	07:57:45	0
4156572	99	345	341,4	cyclictest	0	-21	swapper/0	07:53:16	0
4156572	99	345	341,4	cyclictest	0	-21	swapper/0	07:53:15	0
4156572	99	344	342,2	cyclictest	0	-21	swapper/0	11:35:28	0
4156572	99	344	341,3	cyclictest	0	-21	swapper/0	08:58:00	0
4156572	99	343	340,3	cyclictest	0	-21	swapper/0	09:33:58	0
4156572	99	343	340,2	cyclictest	0	-21	swapper/0	09:47:39	0
4156581	99	339	336,2	cyclictest	172497	-21	kworker/u64:3+events_unbound	11:48:07	14
4156577	99	330	325,3	cyclictest	0	-21	swapper/4	09:41:19	10
4156577	99	325	323,1	cyclictest	0	-21	swapper/4	10:24:32	10
4156577	99	325	323,1	cyclictest	0	-21	swapper/4	10:24:31	10
4156577	99	323	322,1	cyclictest	564	50	usb-storage	09:54:10	10
4156577	99	323	322,1	cyclictest	0	-21	swapper/4	09:47:39	10
4156577	99	323	322,1	cyclictest	0	-21	swapper/4	09:33:59	10
4156579	99	319	314,4	cyclictest	5394	-21	Xorg	10:05:13	12
4156581	99	316	314,1	cyclictest	285	50	irq/127-xhci_hcd	10:07:57	14
4156579	99	315	313,1	cyclictest	0	-21	swapper/6	09:41:19	12
4156581	99	313	311,1	cyclictest	285	50	irq/127-xhci_hcd	08:26:27	14
4156581	99	312	310,1	cyclictest	285	50	irq/127-xhci_hcd	12:13:19	14
4156581	99	312	309,2	cyclictest	285	50	irq/127-xhci_hcd	10:48:05	14
4156584	99	311	308,2	cyclictest	0	-21	swapper/10	09:41:19	2
4156581	99	311	310,1	cyclictest	285	50	irq/127-xhci_hcd	10:12:12	14
4156581	99	310	309,1	cyclictest	285	50	irq/127-xhci_hcd	12:28:44	14
4156581	99	310	308,1	cyclictest	285	50	irq/127-xhci_hcd	11:35:27	14
4156581	99	310	308,1	cyclictest	285	50	irq/127-xhci_hcd	07:36:23	14
4156584	99	309	309,0	cyclictest	0	-21	swapper/10	08:26:27	2
4156581	99	309	308,1	cyclictest	285	50	irq/127-xhci_hcd	07:57:46	14
4156581	99	309	308,1	cyclictest	285	50	irq/127-xhci_hcd	07:57:46	14
4156581	99	309	307,1	cyclictest	285	50	irq/127-xhci_hcd	11:28:19	14
4156581	99	309	307,1	cyclictest	285	50	irq/127-xhci_hcd	08:58:00	14
4156581	99	309	307,1	cyclictest	0	-21	swapper/8	09:41:19	14
4156581	99	309	306,1	cyclictest	285	50	irq/127-xhci_hcd	07:53:16	14
4156581	99	309	306,1	cyclictest	285	50	irq/127-xhci_hcd	07:53:15	14
4156584	99	308	307,0	cyclictest	0	-21	swapper/10	10:48:06	2
4156581	99	308	308,0	cyclictest	0	-21	swapper/8	08:24:05	14
4156581	99	308	306,1	cyclictest	285	50	irq/127-xhci_hcd	09:33:59	14
4156587	99	307	303,3	cyclictest	0	-21	swapper/12	09:41:19	4
4156584	99	307	304,2	cyclictest	4181477	-21	kworker/u64:6+events_unbound	07:53:16	2
4156584	99	307	304,2	cyclictest	4181477	-21	kworker/u64:6+events_unbound	07:53:16	2
4156581	99	307	306,1	cyclictest	285	50	irq/127-xhci_hcd	09:47:39	14
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17