OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #8

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot8.osadl.org (updated Sat Oct 18, 2025 12:45:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1049486	99	436	0,435	cyclictest	107	-21	ksoftirqd/8	11:52:10	14
1049478	99	429	0,3	cyclictest	1180285	-21	kworker/1:2-mm_percpu_wq	11:52:10	1
1049488	99	427	424,2	cyclictest	1281727	-21	kworker/u64:5+events_unbound	11:43:47	2
1049488	99	425	422,2	cyclictest	1281727	-21	kworker/u64:5+events_unbound	12:14:54	2
1049484	99	424	421,2	cyclictest	1296820	-21	kworker/u64:4+events_unbound	12:05:37	12
1049486	99	422	421,1	cyclictest	285	50	irq/127-xhci_hcd	08:53:39	14
1049478	99	422	419,2	cyclictest	1082399	-21	kworker/u64:4+events_unbound	09:58:21	1
1049488	99	421	420,1	cyclictest	0	-21	swapper/10	12:04:27	2
1049486	99	420	419,1	cyclictest	285	50	irq/127-xhci_hcd	07:15:25	14
1049477	99	419	413,5	cyclictest	1249185	-21	kworker/0:1+events	11:52:09	0
1049486	99	417	416,1	cyclictest	285	50	irq/127-xhci_hcd	12:00:18	14
1049486	99	416	414,1	cyclictest	285	50	irq/127-xhci_hcd	12:14:54	14
1049486	99	415	414,1	cyclictest	285	50	irq/127-xhci_hcd	12:07:35	14
1049486	99	415	414,1	cyclictest	285	50	irq/127-xhci_hcd	11:55:07	14
1049486	99	415	414,1	cyclictest	285	50	irq/127-xhci_hcd	11:47:52	14
1049478	99	415	414,1	cyclictest	0	-21	swapper/1	12:01:21	1
1049486	99	413	412,1	cyclictest	285	50	irq/127-xhci_hcd	10:16:17	14
1049484	99	412	409,2	cyclictest	1281727	-21	kworker/u64:5+events_unbound	12:00:19	12
1049486	99	411	410,1	cyclictest	285	50	irq/127-xhci_hcd	09:10:12	14
1049477	99	411	406,4	cyclictest	0	-21	swapper/0	11:55:32	0
1049486	99	410	409,1	cyclictest	285	50	irq/127-xhci_hcd	11:43:48	14
1049484	99	410	407,2	cyclictest	1309586	-21	kworker/u64:0+events_unbound	11:55:07	12
1049484	99	410	407,2	cyclictest	1208410	-21	kworker/u64:3+events_unbound	11:47:52	12
1049477	99	409	404,4	cyclictest	0	-21	swapper/0	09:51:30	0
1049495	99	408	407,0	cyclictest	0	-21	swapper/15	10:06:24	7
1049484	99	407	404,2	cyclictest	1281727	-21	kworker/u64:5+events_unbound	12:10:42	12
1049484	99	406	405,1	cyclictest	270	50	irq/126-ahci[0000:00:17.0]	11:52:02	12
1049477	99	406	402,4	cyclictest	0	-21	swapper/0	12:01:22	0
1049484	99	405	402,2	cyclictest	1142130	-21	kworker/u64:1+events_unbound	09:10:11	12
1049477	99	405	401,3	cyclictest	0	-21	swapper/0	11:47:54	0
1049477	99	405	401,3	cyclictest	0	-21	swapper/0	08:52:09	0
1049477	99	403	399,3	cyclictest	0	-21	swapper/0	11:43:48	0
1049477	99	399	394,5	cyclictest	0	-21	swapper/0	07:25:18	0
1049490	99	397	396,1	cyclictest	711	50	usb-storage	12:05:38	4
1049477	99	397	393,4	cyclictest	0	-21	swapper/0	07:15:26	0
1049495	99	396	395,0	cyclictest	0	-21	swapper/15	11:52:09	7
1049477	99	395	392,3	cyclictest	0	-21	swapper/0	09:02:01	0
1049477	99	393	387,5	cyclictest	1208410	-21	kworker/u64:3+events_unbound	10:16:16	0
1049477	99	392	388,4	cyclictest	12278	-21	thunderbird	12:07:34	0
1049477	99	392	387,4	cyclictest	0	-21	swapper/0	12:13:52	0
1049495	99	390	389,0	cyclictest	0	-21	swapper/15	11:55:33	7
1049490	99	390	389,1	cyclictest	0	-21	swapper/12	11:43:49	4
1049495	99	388	387,0	cyclictest	0	-21	swapper/15	09:51:31	7
1049490	99	388	385,2	cyclictest	1208410	-21	kworker/u64:3+events_unbound	11:54:59	4
1049477	99	387	384,3	cyclictest	0	-21	swapper/0	09:10:11	0
1049495	99	386	384,1	cyclictest	0	-21	swapper/15	08:52:10	7
1049483	99	386	383,2	cyclictest	1198555	-21	kworker/u64:1+events_unbound	09:51:30	11
1049495	99	385	385,0	cyclictest	0	-21	swapper/15	12:01:21	7
1049483	99	385	383,1	cyclictest	711	50	usb-storage	08:53:29	11
1049495	99	384	383,0	cyclictest	0	-21	swapper/15	11:47:55	7
1049495	99	384	382,1	cyclictest	0	-21	swapper/15	11:43:48	7
1049483	99	384	380,3	cyclictest	1296820	-21	kworker/u64:4+events_unbound	12:01:22	11
1049493	99	382	381,0	cyclictest	0	-21	swapper/14	10:06:24	6
1049490	99	380	377,2	cyclictest	1281727	-21	kworker/u64:5+events_unbound	11:57:11	4
1049490	99	380	377,2	cyclictest	1029851	-21	kworker/u64:2+events_unbound	07:46:43	4
1049495	99	378	377,0	cyclictest	0	-21	swapper/15	07:25:18	7
1049495	99	378	376,0	cyclictest	0	-21	swapper/15	07:15:25	7
1049495	99	375	374,0	cyclictest	0	-21	swapper/15	09:02:02	7
1049495	99	373	371,1	cyclictest	0	-21	swapper/15	12:07:34	7
1049483	99	373	371,1	cyclictest	0	-21	swapper/5	07:15:26	11
1049495	99	372	371,0	cyclictest	0	-21	swapper/15	12:14:55	7
1049483	99	371	370,1	cyclictest	0	-21	swapper/5	09:57:59	11
1049495	99	370	369,0	cyclictest	0	-21	swapper/15	10:16:16	7
1049495	99	369	0,368	cyclictest	0	-21	swapper/15	08:05:14	7
1049493	99	369	369,0	cyclictest	0	-21	swapper/14	11:52:09	6
1049495	99	368	367,0	cyclictest	0	-21	swapper/15	09:10:11	7
1049491	99	367	0,365	cyclictest	1340701	-21	meminfo	12:20:22	5
1049483	99	366	366,0	cyclictest	0	-21	swapper/5	12:08:37	11
1049493	99	364	363,0	cyclictest	0	-21	swapper/14	11:55:33	6
1049493	99	362	361,0	cyclictest	0	-21	swapper/14	09:51:31	6
1049493	99	362	0,361	cyclictest	0	-21	swapper/14	12:05:20	6
1049483	99	361	360,1	cyclictest	0	-21	swapper/5	11:55:07	11
1049493	99	360	359,0	cyclictest	0	-21	swapper/14	12:01:21	6
1049493	99	359	358,0	cyclictest	0	-21	swapper/14	08:52:10	6
1049493	99	358	357,0	cyclictest	0	-21	swapper/14	11:47:54	6
1049493	99	357	356,0	cyclictest	0	-21	swapper/14	11:43:48	6
1049493	99	352	351,0	cyclictest	0	-21	swapper/14	07:25:17	6
1049493	99	351	350,0	cyclictest	0	-21	swapper/14	07:15:25	6
1049493	99	349	349,0	cyclictest	0	-21	swapper/14	09:02:02	6
1049493	99	345	345,0	cyclictest	0	-21	swapper/14	12:14:54	6
1049493	99	344	343,0	cyclictest	0	-21	swapper/14	10:16:17	6
1049489	99	343	342,1	cyclictest	1924	-21	snmpd	10:06:24	3
1049493	99	342	341,0	cyclictest	0	-21	swapper/14	09:10:11	6
1049485	99	340	337,2	cyclictest	1142130	-21	kworker/u64:1+events_unbound	08:53:29	13
1049485	99	339	336,2	cyclictest	1296820	-21	kworker/u64:4+events_unbound	11:53:55	13
1049485	99	329	325,3	cyclictest	1161860	-21	kworker/u64:2+events_unbound	11:59:16	13
1049485	99	329	325,3	cyclictest	1087422	-21	kworker/u64:0+events_unbound	08:05:14	13
1049485	99	327	324,2	cyclictest	1319212	-21	kworker/u64:1+events_unbound	12:07:35	13
1049485	99	327	324,2	cyclictest	1309586	-21	kworker/u64:0+events_unbound	12:00:18	13
1049485	99	326	323,2	cyclictest	1309586	-21	kworker/u64:0+events_unbound	12:13:51	13
1049479	99	320	316,3	cyclictest	1309586	-21	kworker/u64:0+events_unbound	11:55:33	8
1049482	99	318	317,1	cyclictest	0	-21	swapper/4	12:05:37	10
1049480	99	318	317,1	cyclictest	0	-21	swapper/3	10:06:25	9
1049487	99	314	311,2	cyclictest	1281727	-21	kworker/u64:5+events_unbound	11:52:09	15
1049482	99	313	310,2	cyclictest	1296820	-21	kworker/u64:4+events_unbound	11:43:48	10
1049482	99	308	307,1	cyclictest	0	-21	swapper/4	11:54:58	10
1049479	99	306	0,305	cyclictest	0	-21	swapper/2	07:11:00	8
1049489	99	305	303,1	cyclictest	0	-21	swapper/11	11:50:02	3
1049479	99	305	303,1	cyclictest	2167393	-21	firefox	07:36:09	8
1049479	99	305	303,1	cyclictest	0	-21	swapper/2	12:12:10	8
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17