OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Thu Oct 16, 2025 00:44:06)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
878981	99	135	123,8	cyclictest	958993	-21	kworker/u4:7+events_unbound	22:17:29	0
878981	99	134	120,12	cyclictest	947863	-21	kworker/u4:2+events_unbound	22:02:26	0
878981	99	131	124,5	cyclictest	929875	-21	kworker/u4:0+events_unbound	21:47:24	0
878981	99	97	89,5	cyclictest	1054595	-21	kworker/u4:10+events_unbound	00:33:25	0
878981	99	96	87,7	cyclictest	981107	-21	kworker/u4:14+events_unbound	22:57:38	0
878981	99	96	87,7	cyclictest	981107	-21	kworker/u4:14+events_unbound	22:57:38	0
878981	99	93	85,6	cyclictest	937332	-21	kworker/u4:12+events_unbound	22:07:28	0
878981	99	90	81,7	cyclictest	1034291	-21	kworker/u4:16+events_unbound	23:58:09	0
878981	99	89	82,5	cyclictest	1003658	-21	kworker/u4:5+events_unbound	23:37:45	0
878981	99	89	81,5	cyclictest	973652	-21	kworker/u4:1+events_unbound	23:07:40	0
878981	99	89	80,7	cyclictest	910887	-21	kworker/u4:9+events_unbound	21:12:14	0
878981	99	89	79,7	cyclictest	1015518	-21	kworker/u4:3+events_unbound	23:32:43	0
878981	99	85	77,6	cyclictest	948392	-21	kworker/u4:10+events_unbound	22:12:29	0
878981	99	84	76,6	cyclictest	1003659	-21	kworker/u4:7+events_unbound	23:27:44	0
878981	99	84	75,6	cyclictest	940965	-21	kworker/u4:6+events_unbound	21:52:25	0
878982	99	81	29,29	cyclictest	0	-21	swapper/1	23:30:28	1
878981	99	80	71,6	cyclictest	977365	-21	kworker/u4:8+events_unbound	22:47:35	0
878981	99	78	66,10	cyclictest	53	-21	kswapd0	00:00:13	0
878981	99	76	66,6	cyclictest	962769	-21	kworker/u4:2+events_unbound	22:27:33	0
878982	99	75	18,34	cyclictest	952329	-21	ssh	22:08:13	1
878981	99	73	64,6	cyclictest	966396	-21	kworker/u4:0+events_unbound	22:32:33	0
878981	99	73	64,5	cyclictest	929877	-21	kworker/u4:5+events_unbound	22:37:34	0
878981	99	72	62,7	cyclictest	1051567	-21	kworker/u4:8+events_unbound	00:23:21	0
878982	99	69	38,28	cyclictest	1061385	-21	sendmail	00:40:01	1
878982	99	68	38,28	cyclictest	1021282	-21	basename	23:40:18	1
878982	99	68	38,28	cyclictest	1021282	-21	basename	23:40:18	1
878981	99	68	60,5	cyclictest	929877	-21	kworker/u4:5+events_unbound	21:37:23	0
878981	99	68	59,7	cyclictest	880215	-21	kworker/u4:16+events_unbound	19:57:02	0
878982	99	67	56,9	cyclictest	894421	-21	kworker/u4:3+events_unbound	20:27:08	1
878982	99	67	37,28	cyclictest	895745	-21	munin-plugin-st	20:15:01	1
878982	99	67	32,32	cyclictest	995468	-21	unixbench_singl	23:05:46	1
878981	99	67	58,6	cyclictest	984997	-21	kworker/u4:3+events_unbound	22:52:37	0
878981	99	67	56,6	cyclictest	973653	-21	kworker/u4:4+events_unbound	22:42:36	0
878982	99	66	61,3	cyclictest	911452	-21	kworker/u4:16+events_unbound	21:22:18	1
878982	99	66	32,31	cyclictest	1026221	-21	ssh	23:45:40	1
878981	99	66	58,6	cyclictest	999806	-21	kworker/u4:6+events_unbound	23:12:39	0
878982	99	64	5,53	cyclictest	968713	-21	ntpq	22:30:29	1
878982	99	64	32,29	cyclictest	0	-21	swapper/1	23:20:26	1
878981	99	64	53,9	cyclictest	881504	-21	kworker/u4:17+events_unbound	20:47:09	0
878982	99	63	35,26	cyclictest	905979	-21	systemd	20:52:10	1
878982	99	63	2,6	cyclictest	1039671	-21	ssh	00:05:16	1
878981	99	63	56,5	cyclictest	875240	-21	kworker/u4:1+events_unbound	19:16:52	0
878981	99	63	38,7	cyclictest	902589	-21	fschecks_count	20:40:22	0
878982	99	62	5,10	cyclictest	932393	-21	ssh	21:40:32	1
878982	99	62	3,20	cyclictest	975997	-21	ntpq	22:40:32	1
878981	99	62	55,5	cyclictest	977365	-21	kworker/u4:8+events_unbound	23:02:39	0
878981	99	62	53,6	cyclictest	933614	-21	kworker/u4:7+events_unbound	22:00:00	0
878982	99	61	1,17	cyclictest	1047069	-21	ssh	00:15:35	1
878982	99	60	52,6	cyclictest	880215	-21	kworker/u4:16+events_unbound	20:57:13	1
878982	99	60	3,12	cyclictest	1043699	-21	ssh	00:10:33	1
878982	99	60	3,11	cyclictest	1050281	-21	ssh	00:20:28	1
878982	99	60	27,30	cyclictest	0	-21	swapper/1	00:25:39	1
878981	99	60	50,8	cyclictest	880202	-21	systemd	19:11:51	0
878981	99	60	37,18	cyclictest	0	-21	swapper/0	19:55:10	0
878982	99	59	34,22	cyclictest	886525	-21	unixbench_multi	19:35:40	1
878982	99	59	30,26	cyclictest	0	-21	swapper/1	22:45:28	1
878982	99	59	27,29	cyclictest	0	-21	swapper/1	21:50:34	1
878982	99	59	2,6	cyclictest	946194	-21	apt-get	22:00:14	1
878982	99	59	26,30	cyclictest	0	-21	swapper/1	21:55:32	1
878982	99	59	2,15	cyclictest	1010091	-21	ssh	23:25:30	1
878982	99	58	53,4	cyclictest	910892	-21	kworker/u4:15+events_unbound	21:17:00	1
878982	99	58	4,7	cyclictest	887406	-21	ntpq	19:40:27	1
878982	99	58	3,7	cyclictest	896500	-21	ntpq	20:15:30	1
878982	99	58	3,19	cyclictest	990364	-21	apt-get	23:00:14	1
878982	99	58	3,14	cyclictest	954399	-21	ssh	22:10:40	1
878982	99	58	27,28	cyclictest	0	-21	swapper/1	23:50:32	1
878982	99	58	26,29	cyclictest	983769	-21	threads	22:50:40	1
878982	99	58	26,28	cyclictest	0	-21	swapper/1	23:35:27	1
878982	99	58	23,32	cyclictest	901472	-21	gltestperf	20:35:17	1
878982	99	58	2,13	cyclictest	890015	-21	ntpq	19:50:31	1
878982	99	58	16,34	cyclictest	1019476	-21	kworker/u4:9-rpciod	23:55:02	1
878982	99	58	1,14	cyclictest	883595	-21	ntpq	19:25:28	1
878981	99	58	51,5	cyclictest	1019476	-21	kworker/u4:9+events_unbound	23:52:58	0
878981	99	58	37,18	cyclictest	961987	-21	timerwakeupswit	22:20:40	0
878982	99	57	3,5	cyclictest	891322	-21	ntpq	19:55:30	1
878982	99	57	3,12	cyclictest	997873	-21	apt-get	23:10:16	1
878982	99	57	27,27	cyclictest	0	-21	swapper/1	23:15:37	1
878982	99	57	2,5	cyclictest	909063	-21	ssh	21:10:04	1
878982	99	57	25,30	cyclictest	924609	-21	fschecks_count	21:30:21	1
878982	99	57	1,13	cyclictest	957948	-21	ntpq	22:15:34	1
878981	99	57	45,7	cyclictest	0	-21	swapper/0	21:20:00	0
878982	99	56	46,7	cyclictest	903417	-21	kworker/u4:7+events_unbound	20:42:10	1
878982	99	56	4,12	cyclictest	892807	-21	ps	20:00:38	1
878982	99	56	3,6	cyclictest	879702	-21	ntpq	19:10:26	1
878982	99	56	27,26	cyclictest	0	-21	swapper/1	19:30:39	1
878982	99	56	23,31	cyclictest	907801	-21	aten_r7power_vo	21:05:14	1
878981	99	56	48,6	cyclictest	878912	-21	kworker/u4:9+events_unbound	19:36:56	0
878981	99	56	48,6	cyclictest	1023429	-21	kworker/u4:4+events_unbound	23:46:09	0
878981	99	56	3,15	cyclictest	1051564	-21	kworker/u4:2+nfsiod	00:25:14	0
878982	99	55	4,18	cyclictest	882302	-21	ntpq	19:20:26	1
878982	99	55	28,24	cyclictest	0	-21	swapper/1	21:38:20	1
878982	99	55	26,26	cyclictest	0	-21	swapper/1	22:35:22	1
878982	99	55	24,28	cyclictest	0	-21	swapper/1	20:20:17	1
878981	99	55	44,8	cyclictest	898292	-21	systemd	20:22:05	0
878981	99	55	34,19	cyclictest	1024793	-21	latency_hist	23:45:02	0
878981	99	55	34,19	cyclictest	1024793	-21	latency_hist	23:45:01	0
878982	99	54	7,6	cyclictest	0	-21	swapper/1	22:20:16	1
878982	99	54	6,6	cyclictest	1056537	-21	ssh	00:30:37	1
878982	99	54	43,8	cyclictest	966401	-21	kworker/u4:9+events_unbound	22:27:30	1
878982	99	54	3,6	cyclictest	936345	-21	ssh	21:45:37	1
878982	99	54	34,18	cyclictest	881486	-21	systemd	19:16:52	1
878982	99	54	2,12	cyclictest	989340	-21	ssh	22:58:36	1
878982	99	54	2,12	cyclictest	989340	-21	ssh	22:58:36	1
878982	99	54	1,13	cyclictest	921212	-21	ntpq	21:25:26	1
878981	99	54	44,7	cyclictest	908746	-21	kworker/u4:0-rpciod	21:25:18	0
878982	99	53	4,6	cyclictest	1037828	-21	ntpq	00:02:24	1
878982	99	53	2,7	cyclictest	894014	-21	ntpq	20:05:35	1
878982	99	53	2,5	cyclictest	904173	-21	ntpq	20:45:23	1
878982	99	53	25,25	cyclictest	0	-21	swapper/1	19:45:16	1
878981	99	53	44,7	cyclictest	1059131	-21	fschecks_time	00:35:18	0
878981	99	52	42,7	cyclictest	996025	-21	kworker/u4:2-rpciod	23:15:16	0
878982	99	51	1,14	cyclictest	900323	-21	ntpq	20:30:26	1
878981	99	51	5,31	cyclictest	1006234	-21	ssh	23:20:29	0
878981	99	51	41,6	cyclictest	917529	-21	ld	21:20:28	0
878981	99	50	40,7	cyclictest	886996	-21	aten_r7power_vo	19:40:20	0
878981	99	50	10,6	cyclictest	17	1	rcu_preempt	21:40:37	0
878981	99	48	41,5	cyclictest	924534	-21	sed	21:30:20	0
878981	99	48	30,16	cyclictest	0	-21	swapper/0	00:10:29	0
878981	99	48	27,18	cyclictest	0	-21	swapper/0	19:20:34	0
878982	99	47	1,12	cyclictest	1060	-21	snmpd	21:05:00	1
878981	99	47	41,4	cyclictest	1046762	-21	if_eth0	00:15:19	0
878981	99	47	38,7	cyclictest	883696	-21	grep	19:25:36	0
878981	99	46	35,7	cyclictest	900866	-21	modprobe	20:35:01	0
878981	99	45	36,6	cyclictest	897004	-21	kworker/u4:11-rpciod	20:55:36	0
878981	99	44	35,6	cyclictest	907749	-21	aten_r7power_en	21:05:13	0
878981	99	44	34,8	cyclictest	894756	-21	aten_r7power_vo	20:10:17	0
878981	99	44	3,31	cyclictest	894452	-21	modprobe	20:10:00	0
878982	99	43	2,15	cyclictest	878959	-21	munin-run	19:10:01	1
878981	99	43	37,4	cyclictest	898820	-21	fschecks_time	20:25:17	0
878981	99	43	36,5	cyclictest	889269	-21	grep	19:50:00	0
878981	99	43	35,6	cyclictest	1039751	-21	aten_r7power_en	00:05:21	0
878981	99	43	35,5	cyclictest	893122	-21	unixbench_singl	20:00:40	0
878981	99	41	5,15	cyclictest	878977	-21	cyclictest	19:10:01	0
878981	99	41	31,7	cyclictest	0	-21	swapper/0	19:30:21	0
878981	99	38	29,6	cyclictest	0	-21	swapper/0	20:15:17	0
878981	99	38	28,7	cyclictest	0	-21	swapper/0	20:50:20	0
878981	99	38	28,6	cyclictest	0	-21	swapper/0	20:35:31	0
878981	99	31	21,7	cyclictest	889216	-21	kworker/u4:1-rpciod	21:05:00	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17