OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Fri Apr 10, 2026 00:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3739289	99	102	94,6	cyclictest	3909837	-21	kworker/u4:8+events_unbound	00:08:41	0
3739289	99	94	84,7	cyclictest	3760963	-21	kworker/u4:19+events_unbound	20:33:01	0
3739289	99	92	85,5	cyclictest	3854810	-21	kworker/u4:9+events_unbound	22:48:30	0
3739289	99	92	82,7	cyclictest	3740511	-21	kworker/u4:3+events_unbound	20:12:56	0
3739289	99	90	82,6	cyclictest	3931478	-21	kworker/u4:5+events_unbound	00:38:49	0
3739289	99	90	77,8	cyclictest	0	-21	swapper/0	23:00:33	0
3739289	99	89	81,6	cyclictest	3807504	-21	kworker/u4:9+events_unbound	21:53:20	0
3739289	99	89	81,6	cyclictest	3772717	-21	kworker/u4:5+events_unbound	21:23:12	0
3739289	99	88	80,6	cyclictest	3875837	-21	kworker/u4:10+events_unbound	23:13:31	0
3739289	99	88	78,7	cyclictest	3811895	-21	kworker/u4:2+events_unbound	21:58:19	0
3739289	99	85	78,5	cyclictest	3931475	-21	kworker/u4:1+events_unbound	00:33:49	0
3739289	99	85	41,7	cyclictest	256	50	irq/23-42890000.ethernet	19:09:59	0
3739289	99	83	74,7	cyclictest	3909833	-21	kworker/u4:3+events_unbound	23:53:38	0
3739290	99	82	76,4	cyclictest	3729537	-21	kworker/u4:5+events_unbound	20:07:56	1
3739289	99	80	70,7	cyclictest	3828762	-21	kworker/u4:8+events_unbound	22:18:22	0
3739290	99	79	38,38	cyclictest	0	-21	swapper/1	22:45:15	1
3739289	99	79	71,5	cyclictest	0	-21	swapper/0	22:50:29	0
3739289	99	76	7,60	cyclictest	3818268	-21	ssh	22:05:12	0
3739289	99	74	61,6	cyclictest	3901792	-21	kworker/u4:0+events_unbound	23:43:36	0
3739290	99	73	4,25	cyclictest	3917237	-21	ssh	00:00:35	1
3739290	99	73	4,25	cyclictest	3917237	-21	ssh	00:00:35	1
3739289	99	73	63,7	cyclictest	3931479	-21	kworker/u4:6+events_unbound	00:18:45	0
3739289	99	72	61,6	cyclictest	3798778	-21	kworker/u4:17+events_unbound	21:45:01	0
3739289	99	71	57,6	cyclictest	3803124	-21	kworker/u4:1+events_unbound	22:00:14	0
3739290	99	69	40,27	cyclictest	3929499	-21	fschecks_time	00:15:20	1
3739289	99	69	61,6	cyclictest	3811898	-21	kworker/u4:5+events_unbound	22:13:22	0
3739290	99	67	59,5	cyclictest	3740511	-21	kworker/u4:3+events_unbound	19:35:01	1
3739290	99	67	36,28	cyclictest	3750963	-21	aten2__	19:55:16	1
3739290	99	67	28,37	cyclictest	3856873	-21	aten_r7power_vo	22:50:17	1
3739290	99	66	31,33	cyclictest	3814319	-21	fschecks_count	22:00:24	1
3739289	99	66	58,6	cyclictest	3740511	-21	kworker/u4:3+events_unbound	20:22:59	0
3739289	99	66	57,6	cyclictest	3755844	-21	kworker/u4:4+events_unbound	20:30:01	0
3739290	99	65	56,6	cyclictest	3794384	-21	kworker/u4:14+events_unbound	21:38:15	1
3739290	99	65	4,19	cyclictest	3839663	-21	ssh	22:30:12	1
3739290	99	65	35,27	cyclictest	3844295	-21	tune2fs	22:35:20	1
3739290	99	65	30,33	cyclictest	3810767	-21	timerwakeupswit	21:55:41	1
3739290	99	65	28,34	cyclictest	0	-21	swapper/1	00:10:30	1
3739290	99	65	20,6	cyclictest	0	-21	swapper/1	21:20:28	1
3739289	99	65	39,23	cyclictest	3739286	-21	cyclictest	00:10:12	0
3739290	99	64	54,7	cyclictest	378	-21	dbus-daemon	21:13:09	1
3739290	99	64	34,28	cyclictest	3775260	-21	gltestperf	21:15:22	1
3739290	99	64	32,29	cyclictest	0	-21	swapper/1	23:25:32	1
3739290	99	64	28,32	cyclictest	0	-21	swapper/1	22:55:29	1
3739289	99	64	57,5	cyclictest	3729535	-21	kworker/u4:0+events_unbound	19:57:06	0
3739290	99	63	37,24	cyclictest	3758198	-21	threads	20:20:36	1
3739290	99	63	34,26	cyclictest	3789954	-21	kworker/u4:2-xprtiod	21:50:32	1
3739290	99	63	28,32	cyclictest	0	-21	swapper/1	22:30:02	1
3739289	99	63	54,7	cyclictest	3736776	-21	kworker/u4:2+events_unbound	19:37:50	0
3739290	99	62	35,25	cyclictest	3740953	-21	fschecks_count	19:15:19	1
3739290	99	62	33,27	cyclictest	3878419	-21	fschecks_time	23:15:22	1
3739290	99	62	30,29	cyclictest	3854812	-21	kworker/u4:13-rpciod	23:05:37	1
3739290	99	62	29,30	cyclictest	0	-21	swapper/1	22:10:14	1
3739290	99	62	28,31	cyclictest	0	-21	swapper/1	23:10:26	1
3739290	99	62	28,31	cyclictest	0	-21	swapper/1	22:40:39	1
3739290	99	62	26,33	cyclictest	0	-21	swapper/1	23:30:39	1
3739290	99	62	26,33	cyclictest	0	-21	swapper/1	00:05:22	1
3739289	99	62	34,20	cyclictest	53	-21	kswapd0	21:35:23	0
3739290	99	61	51,8	cyclictest	3746899	-21	systemd	19:37:49	1
3739290	99	61	4,24	cyclictest	3933444	-21	ssh	00:20:14	1
3739290	99	61	27,31	cyclictest	3761518	-21	fschecks_count	20:35:23	1
3739290	99	61	27,31	cyclictest	0	-21	swapper/1	23:45:34	1
3739290	99	61	27,31	cyclictest	0	-21	swapper/1	22:15:21	1
3739290	99	61	25,34	cyclictest	3761043	-21	dpkg	20:35:01	1
3739290	99	61	22,7	cyclictest	0	-21	swapper/1	00:35:20	1
3739289	99	61	56,4	cyclictest	3730833	-21	kworker/u4:8+events_unbound	19:27:47	0
3739289	99	61	48,8	cyclictest	3763247	-21	proc_pri	20:40:34	0
3739290	99	60	25,32	cyclictest	0	-21	swapper/1	23:55:17	1
3739290	99	60	24,33	cyclictest	0	-21	swapper/1	23:35:20	1
3739290	99	60	21,4	cyclictest	0	-21	swapper/1	19:40:23	1
3739289	99	60	54,4	cyclictest	3762317	-21	kworker/u4:20+events_unbound	21:00:01	0
3739289	99	60	54,4	cyclictest	3762317	-21	kworker/u4:20+events_unbound	21:00:00	0
3739289	99	60	53,5	cyclictest	3918499	-21	kworker/u4:5+events_unbound	00:03:40	0
3739289	99	60	53,5	cyclictest	3918499	-21	kworker/u4:5+events_unbound	00:03:39	0
3739290	99	59	32,25	cyclictest	3901792	-21	kworker/u4:0-xprtiod	23:50:34	1
3739290	99	59	27,29	cyclictest	0	-21	swapper/1	21:30:01	1
3739290	99	59	26,29	cyclictest	0	-21	swapper/1	21:40:42	1
3739290	99	59	26,28	cyclictest	0	-21	swapper/1	19:45:17	1
3739290	99	59	25,31	cyclictest	0	-21	swapper/1	23:20:32	1
3739290	99	59	25,31	cyclictest	0	-21	swapper/1	22:20:21	1
3739290	99	59	25,31	cyclictest	0	-21	swapper/1	00:30:25	1
3739290	99	59	22,6	cyclictest	0	-21	swapper/1	22:05:36	1
3739290	99	59	21,5	cyclictest	0	-21	swapper/1	20:55:16	1
3739290	99	59	21,5	cyclictest	0	-21	swapper/1	20:55:16	1
3739289	99	59	52,5	cyclictest	3892516	-21	kworker/u4:3+events_unbound	23:38:36	0
3739289	99	59	50,7	cyclictest	3758422	-21	kworker/u4:7+events_unbound	20:40:01	0
3739290	99	58	27,28	cyclictest	0	-21	swapper/1	21:30:35	1
3739290	99	58	23,6	cyclictest	0	-21	swapper/1	23:40:33	1
3739290	99	58	23,5	cyclictest	0	-21	swapper/1	19:10:34	1
3739290	99	57	21,34	cyclictest	3756624	-21	ntp_kernel_pll_	20:15:26	1
3739289	99	57	36,19	cyclictest	3770830	-21	gltestperf	21:10:22	0
3739290	99	56	3,20	cyclictest	3937701	-21	ssh	00:25:11	1
3739290	99	56	21,4	cyclictest	0	-21	swapper/1	20:10:34	1
3739290	99	56	20,4	cyclictest	0	-21	swapper/1	19:20:22	1
3739290	99	55	46,7	cyclictest	3750738	-21	systemd	19:52:52	1
3739290	99	55	26,27	cyclictest	0	-21	swapper/1	23:00:37	1
3739290	99	55	23,3	cyclictest	0	-21	swapper/1	21:45:40	1
3739289	99	55	49,4	cyclictest	3893142	-21	kworker/u4:9+events_unbound	23:33:36	0
3739289	99	55	48,5	cyclictest	3833152	-21	kworker/u4:16+events_unbound	22:23:59	0
3739289	99	55	47,6	cyclictest	3850493	-21	kworker/u4:2+events_unbound	22:43:29	0
3739290	99	54	24,4	cyclictest	0	-21	swapper/1	20:25:17	1
3739290	99	54	23,29	cyclictest	0	-21	swapper/1	21:00:22	1
3739290	99	53	21,4	cyclictest	0	-21	swapper/1	20:40:14	1
3739290	99	53	20,8	cyclictest	0	-21	swapper/1	20:50:27	1
3739289	99	53	6,12	cyclictest	3869519	-21	apt-get	23:05:11	0
3739290	99	52	43,5	cyclictest	3730833	-21	kworker/u4:8+events_unbound	21:10:02	1
3739289	99	52	6,41	cyclictest	3839692	-21	ssh	22:30:13	0
3739289	99	52	43,7	cyclictest	53	-21	kswapd0	21:30:20	0
3739289	99	52	43,6	cyclictest	3844242	-21	/usr/sbin/munin	22:35:19	0
3739290	99	51	22,5	cyclictest	0	-21	swapper/1	20:00:27	1
3739290	99	51	20,5	cyclictest	0	-21	swapper/1	20:45:20	1
3739289	99	51	44,5	cyclictest	3875835	-21	kworker/u4:8+events_unbound	23:15:02	0
3739289	99	50	43,5	cyclictest	3884499	-21	kworker/u4:7+events_unbound	23:28:35	0
3739289	99	50	40,7	cyclictest	3757166	-21	idleruntime-cro	20:20:00	0
3739289	99	49	42,5	cyclictest	3861604	-21	/usr/sbin/munin	22:55:22	0
3739289	99	49	41,6	cyclictest	3880168	-21	kworker/u4:4+events_unbound	23:22:00	0
3739289	99	49	29,14	cyclictest	3786503	-21	sshd	21:28:12	0
3739289	99	48	42,4	cyclictest	3750735	-21	kworker/u4:18+events_unbound	20:50:00	0
3739289	99	48	41,5	cyclictest	3768569	-21	cat	21:00:38	0
3739289	99	48	18,23	cyclictest	3916149	-21	latency_hist	00:00:01	0
3739289	99	48	1,42	cyclictest	3775613	-21	ssh	21:15:35	0
3739289	99	47	40,5	cyclictest	3801762	-21	ntpq	21:45:32	0
3739289	99	47	37,7	cyclictest	3941772	-21	latency_hist	00:30:02	0
3739289	99	46	39,5	cyclictest	3933568	-21	aten_r7power_en	00:20:18	0
3739289	99	46	37,7	cyclictest	3747413	-21	fschecks_count	19:40:17	0
3739289	99	46	32,6	cyclictest	3893143	-21	kworker/u4:10+events_unbound	23:45:35	0
3739289	99	46	27,17	cyclictest	3835953	-21	sh	22:25:24	0
3739289	99	44	37,4	cyclictest	0	-21	swapper/0	19:50:34	0
3739289	99	43	36,5	cyclictest	3740441	-21	unixbench_multi	19:10:37	0
3739289	99	43	33,8	cyclictest	3740773	-21	aten_r7power_en	19:15:16	0
3739290	99	42	34,6	cyclictest	3744093	-21	switchtime	19:25:36	1
3739289	99	42	33,7	cyclictest	3753551	-21	aten_r7power_cu	20:05:13	0
3739289	99	41	33,6	cyclictest	3752255	-21	aten2__	20:00:15	0
3739289	99	41	32,7	cyclictest	3765150	-21	aten_r7power_en	20:50:16	0
3739289	99	40	34,4	cyclictest	0	-21	swapper/0	21:05:28	0
3739289	99	40	31,7	cyclictest	3742518	-21	kernelversion	19:20:21	0
3739289	99	38	29,6	cyclictest	3744826	-21	fschecks_count	19:30:20	0
3739289	99	37	27,7	cyclictest	0	-21	swapper/0	19:50:01	0
3739290	99	33	24,7	cyclictest	0	-21	swapper/1	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17