OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Wed Sep 02, 2026 00:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
39558	99	116	97,8	cyclictest	82061	-21	kworker/u4:20+events_unbound	21:21:49	0
39559	99	103	89,5	cyclictest	226230	-21	kworker/u4:1+events_unbound	00:17:14	1
39559	99	102	94,5	cyclictest	100428	-21	kworker/u4:7+events_unbound	21:51:53	1
39559	99	100	92,6	cyclictest	29707	-21	kworker/u4:11+events_unbound	19:41:32	1
39558	99	100	81,7	cyclictest	172393	-21	kworker/u4:3+events_unbound	23:12:04	0
39559	99	99	92,5	cyclictest	65500	-21	kworker/u4:14+events_unbound	21:31:48	1
39558	99	98	86,7	cyclictest	122881	-21	kworker/u4:8+events_unbound	22:06:54	0
39559	99	97	89,6	cyclictest	149554	-21	kworker/u4:2+events_unbound	23:02:03	1
39558	99	96	84,4	cyclictest	136590	-21	kworker/u4:6+events_unbound	22:26:57	0
39559	99	93	87,4	cyclictest	47433	-21	kworker/u4:0+events_unbound	19:51:35	1
39559	99	93	85,6	cyclictest	40790	-21	kworker/u4:12+events_unbound	20:26:37	1
39559	99	92	85,5	cyclictest	78125	-21	kworker/u4:17+events_unbound	22:16:55	1
39558	99	92	85,5	cyclictest	15	1	ktimers/0	21:31:49	0
39558	99	91	77,6	cyclictest	190611	-21	kworker/u4:11+events_unbound	23:32:05	0
39559	99	90	74,6	cyclictest	212585	-21	kworker/u4:7+events_unbound	23:52:11	1
39559	99	89	82,5	cyclictest	189937	-21	kworker/u4:10+events_unbound	23:22:03	1
39559	99	89	81,6	cyclictest	132011	-21	kworker/u4:1+events_unbound	22:57:03	1
39559	99	88	79,6	cyclictest	62937	-21	kworker/u4:11+events_unbound	21:01:43	1
39559	99	86	80,4	cyclictest	53922	-21	kworker/u4:8+events_unbound	20:41:39	1
39559	99	86	78,6	cyclictest	28434	-21	kworker/u4:4+events_unbound	19:11:26	1
39559	99	86	77,7	cyclictest	65500	-21	kworker/u4:14+events_unbound	21:06:44	1
39559	99	86	73,6	cyclictest	40789	-21	kworker/u4:10+events_unbound	20:36:42	1
39559	99	86	72,6	cyclictest	56552	-21	kworker/u4:4+events_unbound	20:16:37	1
39559	99	85	77,6	cyclictest	61657	-21	kworker/u4:4+events_unbound	20:31:39	1
39559	99	79	72,5	cyclictest	42155	-21	kworker/u4:0+events_unbound	19:21:31	1
39558	99	79	69,8	cyclictest	149554	-21	kworker/u4:2+events_unbound	22:36:58	0
39559	99	77	69,6	cyclictest	50077	-21	kworker/u4:9+events_unbound	20:21:37	1
39559	99	77	69,6	cyclictest	40789	-21	kworker/u4:10+events_unbound	19:26:29	1
39559	99	76	67,6	cyclictest	37059	-21	kworker/u4:3+events_unbound	19:36:33	1
39558	99	76	68,6	cyclictest	40790	-21	kworker/u4:12+events_unbound	21:26:47	0
39558	99	76	68,6	cyclictest	226232	-21	kworker/u4:6+events_unbound	00:07:14	0
39558	99	76	18,45	cyclictest	39557	-21	idleruntime-cro	19:09:59	0
39558	99	75	68,5	cyclictest	252907	-21	kworker/u4:7+events_unbound	00:37:16	0
39558	99	75	64,5	cyclictest	252904	-21	kworker/u4:3+events_unbound	00:32:18	0
39559	99	73	65,6	cyclictest	43455	-21	kworker/u4:8+events_unbound	19:46:34	1
39558	99	73	66,5	cyclictest	65501	-21	kworker/u4:15+events_unbound	20:50:01	0
39558	99	73	66,5	cyclictest	65501	-21	kworker/u4:15+events_unbound	20:50:00	0
39558	99	73	64,7	cyclictest	50077	-21	kworker/u4:9+events_unbound	20:06:34	0
39558	99	73	2,56	cyclictest	170929	-21	ssh	23:00:26	0
39558	99	69	61,6	cyclictest	114281	-21	kworker/u4:3+events_unbound	22:01:53	0
39559	99	68	56,7	cyclictest	37	-21	kcompactd0	21:59:59	1
39558	99	68	61,5	cyclictest	212587	-21	kworker/u4:10+events_unbound	23:47:09	0
39558	99	68	55,8	cyclictest	97752	-21	ssh	21:40:01	0
39559	99	66	49,7	cyclictest	118936	-21	kworker/u4:5+events_unbound	22:13:46	1
39558	99	65	58,5	cyclictest	78125	-21	kworker/u4:17+events_unbound	22:21:57	0
39558	99	63	54,6	cyclictest	53	-21	kswapd0	22:00:00	0
39559	99	62	53,7	cyclictest	400	-21	systemd-logind	00:22:15	1
39559	99	61	52,6	cyclictest	210472	-21	apt-get	23:45:23	1
39558	99	61	54,5	cyclictest	48731	-21	kworker/u4:6+events_unbound	20:20:02	0
39559	99	60	50,8	cyclictest	53	-21	kswapd0	23:40:01	1
39559	99	60	50,8	cyclictest	53	-21	kswapd0	23:40:01	1
39558	99	60	54,4	cyclictest	15	1	ktimers/0	21:52:18	0
39558	99	59	42,7	cyclictest	172393	-21	kworker/u4:3+events_unbound	23:20:03	0
39558	99	58	50,6	cyclictest	40790	-21	kworker/u4:12+events_unbound	19:31:32	0
39558	99	58	50,6	cyclictest	234701	-21	kworker/u4:13+events_unbound	00:13:46	0
39558	99	58	50,6	cyclictest	234701	-21	kworker/u4:13+events_unbound	00:13:45	0
39558	99	58	48,7	cyclictest	201471	-21	ssh	23:35:12	0
39558	99	58	48,7	cyclictest	201471	-21	ssh	23:35:11	0
39559	99	57	48,7	cyclictest	141134	-21	kworker/u4:4+events_unbound	22:35:45	1
39559	99	57	47,7	cyclictest	135315	-21	processes	22:20:39	1
39558	99	57	50,5	cyclictest	114280	-21	kworker/u4:0+events_unbound	22:10:03	0
39558	99	57	49,6	cyclictest	61295	-21	/usr/sbin/munin	20:30:39	0
39558	99	57	45,6	cyclictest	221667	-21	kworker/u4:11+events_unbound	00:17:02	0
39558	99	57	27,22	cyclictest	256	50	irq/23-42890000.ethernet	22:50:10	0
39559	99	55	43,8	cyclictest	53	-21	kswapd0	22:10:00	1
39558	99	55	49,4	cyclictest	256	50	irq/23-42890000.ethernet	21:45:35	0
39559	99	54	43,7	cyclictest	0	-21	swapper/1	21:20:33	1
39559	99	54	31,6	cyclictest	212586	-21	kworker/u4:9+events_unbound	00:00:43	1
39558	99	54	46,6	cyclictest	65501	-21	kworker/u4:15+events_unbound	20:51:43	0
39558	99	54	46,6	cyclictest	61668	-21	kworker/u4:9+events_unbound	20:40:02	0
39558	99	54	41,11	cyclictest	15	1	ktimers/0	19:40:32	0
39558	99	53	47,4	cyclictest	212586	-21	kworker/u4:9+events_unbound	00:01:16	0
39558	99	53	46,5	cyclictest	65501	-21	kworker/u4:15+events_unbound	20:55:29	0
39559	99	52	45,5	cyclictest	219696	-21	fschecks_count	23:55:19	1
39558	99	52	45,5	cyclictest	59025	-21	unixbench_multi	20:20:39	0
39558	99	52	41,9	cyclictest	134064	-21	idleruntime-cro	22:20:01	0
39559	99	51	44,5	cyclictest	247089	-21	ld	00:25:30	1
39559	99	51	43,6	cyclictest	65500	-21	kworker/u4:14+events_unbound	21:12:25	1
39559	99	51	43,6	cyclictest	48731	-21	kworker/u4:6+events_unbound	20:06:37	1
39559	99	51	42,6	cyclictest	0	-21	swapper/1	22:04:47	1
39559	99	51	40,9	cyclictest	193798	-21	unixbench-2d	23:25:43	1
39558	99	51	44,5	cyclictest	75989	-21	gltestperf	21:15:25	0
39558	99	51	44,5	cyclictest	75989	-21	gltestperf	21:15:24	0
39558	99	51	43,6	cyclictest	50077	-21	kworker/u4:9+events_unbound	20:01:35	0
39558	99	51	43,6	cyclictest	183603	-21	/usr/sbin/munin	23:15:11	0
39558	99	51	41,8	cyclictest	174971	-21	/usr/sbin/munin	23:05:19	0
39558	99	51	41,4	cyclictest	186034	-21	kworker/u4:5+events_unbound	23:29:45	0
39558	99	51	35,5	cyclictest	29707	-21	kworker/u4:11+events_unbound	19:16:28	0
39559	99	50	43,5	cyclictest	195098	-21	kworker/u4:1+events_unbound	23:30:20	1
39559	99	50	43,5	cyclictest	163940	-21	kworker/u4:13+events_unbound	23:07:14	1
39559	99	50	43,5	cyclictest	141136	-21	kworker/u4:9+events_unbound	22:41:58	1
39558	99	50	44,4	cyclictest	56550	-21	kworker/u4:1+events_unbound	21:05:46	0
39558	99	50	41,5	cyclictest	215033	-21	/usr/sbin/munin	23:50:19	0
39559	99	49	39,7	cyclictest	251535	-21	diskmemload	00:30:33	1
39559	99	49	38,9	cyclictest	233794	-21	/usr/sbin/munin	00:10:39	1
39559	99	49	38,9	cyclictest	233794	-21	/usr/sbin/munin	00:10:38	1
39558	99	49	29,6	cyclictest	226231	-21	kworker/u4:3+events_unbound	00:26:18	0
39558	99	49	26,19	cyclictest	46617	-21	fschecks_count	19:35:22	0
39559	99	48	40,5	cyclictest	0	-21	swapper/1	19:31:31	1
39559	99	48	39,7	cyclictest	230688	-21	systemd	00:07:12	1
39559	99	48	39,6	cyclictest	0	-21	swapper/1	23:15:44	1
39559	99	48	39,5	cyclictest	103303	-21	sshd	21:45:25	1
39559	99	48	38,7	cyclictest	0	-21	swapper/1	22:46:59	1
39559	99	48	35,8	cyclictest	37	-21	kcompactd0	23:40:13	1
39559	99	48	27,7	cyclictest	141139	-21	kworker/u4:12+events_unbound	22:27:49	1
39558	99	48	41,5	cyclictest	98124	-21	basename	21:40:14	0
39558	99	48	41,5	cyclictest	161045	-21	awk	22:50:01	0
39558	99	48	38,7	cyclictest	144546	-21	/usr/sbin/munin	22:30:41	0
39559	99	47	39,6	cyclictest	65501	-21	kworker/u4:15+events_unbound	20:49:28	1
39559	99	47	39,6	cyclictest	65501	-21	kworker/u4:15+events_unbound	20:49:28	1
39559	99	47	39,5	cyclictest	76814	-21	unixbench_singl	21:15:45	1
39559	99	47	39,5	cyclictest	76814	-21	unixbench_singl	21:15:44	1
39559	99	47	20,16	cyclictest	27	1	ktimers/1	23:10:34	1
39558	99	47	40,5	cyclictest	190611	-21	kworker/u4:11+events_unbound	23:41:45	0
39558	99	47	37,7	cyclictest	40273	-21	ntp_kernel_pll_	19:10:27	0
39559	99	46	38,5	cyclictest	51844	-21	fschecks_time	19:55:22	1
39559	99	46	37,7	cyclictest	93589	-21	/usr/sbin/munin	21:35:15	1
39559	99	46	35,9	cyclictest	0	-21	swapper/1	00:35:13	1
39559	99	46	34,9	cyclictest	0	-21	swapper/1	22:50:39	1
39558	99	46	39,5	cyclictest	242722	-21	ssh	00:20:34	0
39558	99	46	36,7	cyclictest	42658	-21	fschecks_count	19:20:20	0
39558	99	46	35,8	cyclictest	71417	-21	/usr/sbin/munin	21:10:21	0
39559	99	45	38,5	cyclictest	67798	-21	switchtime	20:55:40	1
39559	99	45	38,5	cyclictest	56552	-21	kworker/u4:4+events_unbound	20:13:25	1
39559	99	45	36,6	cyclictest	0	-21	swapper/1	20:00:36	1
39558	99	45	37,5	cyclictest	50078	-21	kworker/u4:13+events_unbound	20:00:01	0
39558	99	45	25,17	cyclictest	0	-21	swapper/0	22:55:17	0
39559	99	44	30,12	cyclictest	41900	-21	switchtime	19:15:45	1
39558	99	44	35,7	cyclictest	152621	-21	fschecks_count	22:40:18	0
39559	99	43	35,5	cyclictest	40790	-21	kworker/u4:12-nfsiod	21:25:25	1
39559	99	43	28,12	cyclictest	27	1	ktimers/1	21:40:15	1
39558	99	43	36,5	cyclictest	51195	-21	timerwakeupswit	19:50:38	0
39558	99	43	36,5	cyclictest	219786	-21	gltestperf	23:55:19	0
39558	99	43	33,7	cyclictest	68549	-21	fschecks_count	21:00:19	0
39558	99	42	35,5	cyclictest	49331	-21	fschecks_time	19:45:27	0
39558	99	42	35,5	cyclictest	40789	-21	kworker/u4:10+events_unbound	20:15:01	0
39559	99	41	27,11	cyclictest	0	-21	swapper/1	20:50:38	1
39559	99	40	31,6	cyclictest	0	-21	swapper/1	22:30:20	1
39558	99	40	32,5	cyclictest	62172	-21	fschecks_time	20:35:18	0
39558	99	40	31,7	cyclictest	59355	-21	aten_r7power_cu	20:25:17	0
39558	99	40	29,7	cyclictest	0	-21	swapper/0	19:25:26	0
39559	99	33	25,6	cyclictest	28434	-21	kworker/u4:4-rpciod	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17