OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Fri Mar 20, 2026 12:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
726503	99	105	93,5	cyclictest	800861	-21	kworker/u4:37+events_unbound	10:19:59	0
726504	99	102	95,5	cyclictest	836198	-21	kworker/u4:3+events_unbound	10:40:06	1
726504	99	99	91,6	cyclictest	813731	-21	kworker/u4:4+events_unbound	10:14:57	1
726503	99	96	91,4	cyclictest	53	-21	kswapd0	11:00:09	0
726503	99	96	79,15	cyclictest	755938	-21	kworker/u4:14+events_unbound	09:19:46	0
726503	99	91	78,6	cyclictest	800852	-21	kworker/u4:28+events_unbound	10:04:56	0
726504	99	90	83,5	cyclictest	730305	-21	kworker/u4:16+events_unbound	07:24:32	1
726504	99	89	81,6	cyclictest	730303	-21	kworker/u4:13+events_unbound	08:19:39	1
726504	99	89	81,6	cyclictest	730303	-21	kworker/u4:13+events_unbound	08:19:38	1
726504	99	87	80,5	cyclictest	736682	-21	kworker/u4:8+events_unbound	08:04:37	1
726503	99	87	75,10	cyclictest	858089	-21	kworker/u4:8+events_unbound	11:05:09	0
726503	99	87	75,10	cyclictest	858089	-21	kworker/u4:8+events_unbound	11:05:09	0
726504	99	86	78,6	cyclictest	736683	-21	kworker/u4:9+events_unbound	08:39:42	1
726504	99	85	78,5	cyclictest	727726	-21	kworker/u4:5+events_unbound	07:14:32	1
726503	99	84	77,5	cyclictest	818237	-21	kworker/u4:1+events_unbound	10:45:08	0
726503	99	80	71,7	cyclictest	906043	-21	kworker/u4:4+events_unbound	12:10:21	0
726503	99	79	70,7	cyclictest	53	-21	kswapd0	10:20:09	0
726503	99	75	67,6	cyclictest	777933	-21	kworker/u4:5+events_unbound	09:44:52	0
726503	99	75	59,5	cyclictest	768755	-21	kworker/u4:19+events_unbound	09:24:48	0
726503	99	75	59,5	cyclictest	768754	-21	kworker/u4:18+events_unbound	09:30:02	0
726503	99	74	68,4	cyclictest	53	-21	kswapd0	12:00:19	0
726503	99	74	54,10	cyclictest	0	-21	swapper/0	08:30:11	0
726504	99	71	61,8	cyclictest	789679	-21	perl	09:45:18	1
726504	99	71	59,5	cyclictest	507599	-21	kworker/u4:2+events_unbound	07:17:02	1
726503	99	71	64,5	cyclictest	777934	-21	kworker/u4:6+events_unbound	09:35:13	0
726504	99	70	64,4	cyclictest	730302	-21	kworker/u4:10+events_unbound	07:35:00	1
726504	99	69	62,5	cyclictest	27	1	ktimers/1	09:31:54	1
726504	99	67	55,9	cyclictest	884289	-21	kworker/u4:19+events_unbound	12:00:19	1
726504	99	65	54,7	cyclictest	917605	-21	ssh	12:10:16	1
726503	99	65	58,5	cyclictest	902213	-21	kworker/u4:2+events_unbound	11:55:16	0
726503	99	65	57,6	cyclictest	736682	-21	kworker/u4:8+events_unbound	08:09:39	0
726504	99	64	57,5	cyclictest	855850	-21	ssh	11:00:06	1
726504	99	63	55,5	cyclictest	27	1	ktimers/1	10:16:57	1
726503	99	63	56,5	cyclictest	744337	-21	kworker/u4:3+events_unbound	08:20:01	0
726503	99	63	56,5	cyclictest	744337	-21	kworker/u4:3+events_unbound	08:20:00	0
726503	99	63	54,6	cyclictest	928484	-21	kworker/u4:5+events_unbound	12:25:21	0
726504	99	62	53,6	cyclictest	0	-21	swapper/1	12:15:24	1
726504	99	62	53,6	cyclictest	0	-21	swapper/1	12:15:23	1
726503	99	62	56,4	cyclictest	736678	-21	kworker/u4:6+events_unbound	08:15:00	0
726503	99	62	50,8	cyclictest	37	-21	kcompactd0	12:20:18	0
726504	99	61	52,7	cyclictest	842589	-21	sshd	10:45:13	1
726504	99	61	45,6	cyclictest	734112	-21	kworker/u4:5+events_unbound	07:47:03	1
726503	99	61	54,5	cyclictest	735411	-21	kworker/u4:3+events_unbound	07:59:35	0
726504	99	59	52,5	cyclictest	896292	-21	sshd	11:45:25	1
726504	99	59	51,6	cyclictest	53	-21	kswapd0	12:30:33	1
726503	99	59	51,6	cyclictest	53	-21	kswapd0	09:55:00	0
726504	99	58	46,8	cyclictest	0	-21	swapper/1	11:05:31	1
726504	99	58	46,8	cyclictest	0	-21	swapper/1	11:05:31	1
726504	99	58	35,16	cyclictest	0	-21	swapper/1	11:50:12	1
726503	99	58	51,5	cyclictest	800858	-21	kworker/u4:34+events_unbound	10:30:03	0
726504	99	57	38,16	cyclictest	0	-21	swapper/1	11:15:14	1
726504	99	57	38,16	cyclictest	0	-21	swapper/1	11:15:14	1
726503	99	57	50,5	cyclictest	822729	-21	kworker/u4:7+events_unbound	10:35:03	0
726503	99	57	46,8	cyclictest	932968	-21	kworker/u4:11+events_unbound	12:30:13	0
726503	99	57	38,7	cyclictest	884289	-21	kworker/u4:19+events_unbound	12:07:00	0
726503	99	57	38,7	cyclictest	884289	-21	kworker/u4:19+events_unbound	12:07:00	0
726503	99	57	36,16	cyclictest	875958	-21	kworker/u4:12+xprtiod	11:25:12	0
726504	99	56	50,4	cyclictest	744337	-21	kworker/u4:3+events_unbound	08:40:02	1
726503	99	56	49,5	cyclictest	730303	-21	kworker/u4:13+events_unbound	07:44:36	0
726503	99	56	48,5	cyclictest	0	-21	swapper/0	09:45:33	0
726503	99	56	38,6	cyclictest	871453	-21	kworker/u4:5+events_unbound	11:47:59	0
726503	99	56	37,7	cyclictest	813731	-21	kworker/u4:4+events_unbound	11:14:02	0
726503	99	55	48,5	cyclictest	753371	-21	kworker/u4:3+events_unbound	09:25:34	0
726504	99	54	41,9	cyclictest	811409	-21	cat	10:10:02	1
726503	99	54	37,7	cyclictest	749526	-21	kworker/u4:2+events_unbound	08:48:01	0
726503	99	53	35,6	cyclictest	796292	-21	kworker/u4:1+events_unbound	09:56:27	0
726504	99	52	45,5	cyclictest	851806	-21	fschecks_time	10:55:18	1
726504	99	52	43,7	cyclictest	735420	-21	systemd	07:44:33	1
726503	99	52	44,6	cyclictest	755938	-21	kworker/u4:14+events_unbound	09:04:45	0
726503	99	52	44,6	cyclictest	730302	-21	kworker/u4:10+events_unbound	07:34:35	0
726503	99	52	41,7	cyclictest	754660	-21	cron	09:00:01	0
726503	99	52	3,29	cyclictest	940428	-21	ssh	12:35:29	0
726503	99	52	29,20	cyclictest	748750	-21	fschecks_time	08:35:19	0
726504	99	51	40,8	cyclictest	879794	-21	kworker/u4:17-rpciod	11:30:12	1
726503	99	51	43,5	cyclictest	870124	-21	mailstats	11:15:40	0
726503	99	51	43,5	cyclictest	870124	-21	mailstats	11:15:39	0
726503	99	51	40,7	cyclictest	0	-21	swapper/0	11:52:21	0
726503	99	51	33,6	cyclictest	875958	-21	kworker/u4:12+events_unbound	11:35:12	0
726504	99	50	43,5	cyclictest	736682	-21	kworker/u4:8+events_unbound	08:10:04	1
726504	99	50	40,8	cyclictest	837906	-21	latency_hist	10:40:02	1
726504	99	50	39,7	cyclictest	0	-21	swapper/1	12:20:36	1
726504	99	50	38,9	cyclictest	738856	-21	proc_pri	07:55:34	1
726504	99	50	34,11	cyclictest	0	-21	swapper/1	09:20:26	1
726504	99	50	1,43	cyclictest	865332	-21	ssh	11:10:24	1
726503	99	50	45,4	cyclictest	730303	-21	kworker/u4:13+events_unbound	08:30:02	0
726503	99	50	43,5	cyclictest	922552	-21	/usr/sbin/munin	12:15:21	0
726503	99	50	43,5	cyclictest	922552	-21	/usr/sbin/munin	12:15:21	0
726503	99	50	43,5	cyclictest	875957	-21	kworker/u4:3+events_unbound	11:33:00	0
726503	99	50	43,5	cyclictest	858087	-21	kworker/u4:6+events_unbound	11:40:59	0
726503	99	50	43,5	cyclictest	808296	-21	/usr/sbin/munin	10:05:41	0
726503	99	50	43,5	cyclictest	736678	-21	kworker/u4:6+events_unbound	07:49:36	0
726504	99	49	42,5	cyclictest	800852	-21	kworker/u4:28+events_unbound	10:03:42	1
726504	99	49	41,6	cyclictest	813731	-21	kworker/u4:4+events_unbound	10:53:01	1
726504	99	49	39,8	cyclictest	761949	-21	latency_hist	09:15:01	1
726504	99	49	38,9	cyclictest	798256	-21	sh	09:55:12	1
726504	99	49	38,8	cyclictest	825293	-21	fschecks_time	10:25:17	1
726504	99	49	37,9	cyclictest	906043	-21	kworker/u4:4-rpciod	12:25:30	1
726504	99	49	34,10	cyclictest	0	-21	swapper/1	11:20:31	1
726503	99	49	41,6	cyclictest	818236	-21	kworker/u4:0+events_unbound	10:29:00	0
726503	99	49	39,7	cyclictest	741785	-21	kworker/u4:16+rpciod	09:10:40	0
726504	99	48	38,8	cyclictest	824649	-21	latency_hist	10:25:01	1
726504	99	48	38,7	cyclictest	939949	-21	fschecks_count	12:35:19	1
726503	99	48	42,5	cyclictest	836198	-21	kworker/u4:3+events_unbound	10:40:59	0
726503	99	48	38,8	cyclictest	847374	-21	fschecks_time	10:50:18	0
726504	99	47	5,21	cyclictest	794520	-21	ssh	09:50:28	1
726504	99	47	40,5	cyclictest	771608	-21	fschecks_time	09:25:19	1
726504	99	47	32,7	cyclictest	730303	-21	kworker/u4:13+events_unbound	08:27:58	1
726504	99	47	31,9	cyclictest	0	-21	swapper/1	09:40:37	1
726503	99	47	39,6	cyclictest	874765	-21	/usr/sbin/munin	11:20:41	0
726503	99	47	38,6	cyclictest	739501	-21	aten_r7power_cu	08:00:16	0
726504	99	46	38,6	cyclictest	895303	-21	kworker/u4:1	11:45:01	1
726504	99	46	35,7	cyclictest	911169	-21	kworker/u4:1-rpciod	12:05:30	1
726504	99	46	35,7	cyclictest	911169	-21	kworker/u4:1-rpciod	12:05:29	1
726503	99	46	40,4	cyclictest	812619	-21	mailstats	10:10:37	0
726503	99	46	39,5	cyclictest	1062	-21	lldpd	07:18:57	0
726503	99	46	37,7	cyclictest	851778	-21	fschecks_time	10:55:18	0
726504	99	45	38,5	cyclictest	750828	-21	kworker/u4:12+events_unbound	09:00:42	1
726504	99	45	38,5	cyclictest	746898	-21	kworker/u4:4+events_unbound	08:34:01	1
726504	99	45	34,7	cyclictest	897782	-21	kworker/u4:0-rpciod	11:55:37	1
726504	99	45	33,5	cyclictest	736682	-21	kworker/u4:8+events_unbound	07:51:43	1
726504	99	45	30,7	cyclictest	730303	-21	kworker/u4:13+events_unbound	07:26:41	1
726504	99	45	25,12	cyclictest	753398	-21	modprobe	08:55:00	1
726503	99	45	38,5	cyclictest	750830	-21	kworker/u4:15+events_unbound	08:54:46	0
726503	99	45	38,5	cyclictest	737954	-21	kworker/u4:11+events_unbound	07:54:37	0
726503	99	45	36,7	cyclictest	744925	-21	gltestperf	08:20:18	0
726503	99	45	36,6	cyclictest	750077	-21	fschecks_time	08:40:18	0
726504	99	44	37,5	cyclictest	766375	-21	idleruntime-cro	09:20:01	1
726504	99	44	37,5	cyclictest	756565	-21	fschecks_time	09:05:24	1
726504	99	44	36,5	cyclictest	0	-21	swapper/1	11:25:27	1
726504	99	44	33,6	cyclictest	754643	-21	kworker/u4:10+events_unbound	08:58:02	1
726503	99	44	26,6	cyclictest	755938	-21	kworker/u4:14+events_unbound	09:07:05	0
726504	99	43	36,5	cyclictest	875957	-21	kworker/u4:3+events_unbound	11:35:01	1
726504	99	43	36,5	cyclictest	730303	-21	kworker/u4:13+events_unbound	08:50:00	1
726504	99	43	35,6	cyclictest	734122	-21	systemd	07:39:33	1
726504	99	42	35,5	cyclictest	741130	-21	gltestperf	08:05:19	1
726504	99	42	12,19	cyclictest	829500	-21	sh	10:30:15	1
726503	99	42	34,6	cyclictest	731535	-21	unixbench_singl	07:25:39	0
726503	99	42	24,15	cyclictest	725227	-21	kworker/u4:6-rpciod	07:24:59	0
726504	99	41	6,29	cyclictest	781007	-21	ssh	09:35:30	1
726503	99	40	31,6	cyclictest	726714	-21	aten_r7power_en	07:10:15	0
726504	99	37	26,7	cyclictest	0	-21	swapper/1	08:20:22	1
726503	99	37	29,6	cyclictest	733845	-21	switchtime	07:35:37	0
726503	99	35	25,6	cyclictest	0	-21	swapper/0	07:10:01	0
726504	99	29	6,4	cyclictest	27	1	ktimers/1	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17