OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Thu Jul 10, 2025 00:46:54)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3764123	2	2362	2337,8	sleep0	3763218	-21	kworker/0:2+events@ dbs_work_handler	19:06:04	0
3764100	2	808	785,14	sleep4	0	-21	swapper/4	19:05:50	4
3764570	99	138	1,107	cyclictest	3997516	-21	latency_hist	23:45:02	0
3764570	99	117	1,70	cyclictest	3810414	-21	kworker/u12:1+rpciod@ rpc_async_schedule	21:20:12	0
3764570	99	116	1,75	cyclictest	3842889	-21	kworker/u12:1+rpciod@ rpc_async_schedule	21:42:01	0
3764579	99	115	102,6	cyclictest	3917091	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:51:36	2
3764584	99	114	94,8	cyclictest	3842889	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:46:23	3
3764570	99	113	27,55	cyclictest	644	50	irq/529-eth0-Tx	22:20:32	0
3764570	99	113	27,55	cyclictest	644	50	irq/529-eth0-Tx	22:20:31	0
3764570	99	113	27,55	cyclictest	644	50	irq/529-eth0-Tx	22:20:31	0
3764570	99	113	1,95	cyclictest	0	-21	swapper/0	20:10:16	0
3764570	99	112	46,47	cyclictest	0	-21	swapper/0	22:29:03	0
3764570	99	112	46,47	cyclictest	0	-21	swapper/0	22:29:02	0
3764570	99	111	55,41	cyclictest	0	-21	swapper/0	20:05:51	0
3764570	99	111	55,41	cyclictest	0	-21	swapper/0	20:05:51	0
3764570	99	111	29,58	cyclictest	643	50	irq/528-eth0-Tx	22:50:23	0
3764570	99	110	1,91	cyclictest	3919152	-21	ssh	22:40:26	0
3764570	99	110	1,91	cyclictest	3919152	-21	ssh	22:40:25	0
3764584	99	108	94,7	cyclictest	3786380	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:06:04	3
3764584	99	108	94,7	cyclictest	3786380	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:06:04	3
3764570	99	108	1,94	cyclictest	0	-21	swapper/0	20:40:12	0
3764584	99	107	93,7	cyclictest	4005742	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:57:43	3
3764570	99	107	1,73	cyclictest	0	-21	swapper/0	21:55:03	0
3764570	99	107	1,73	cyclictest	0	-21	swapper/0	21:55:03	0
3764570	99	107	12,79	cyclictest	644	50	irq/529-eth0-Tx	23:15:17	0
3764570	99	106	2,80	cyclictest	0	-21	swapper/0	22:02:11	0
3764570	99	106	1,76	cyclictest	0	-21	swapper/0	21:10:21	0
3764570	99	106	1,3	cyclictest	0	-21	swapper/0	20:35:14	0
3764570	99	105	5,78	cyclictest	0	-21	swapper/0	22:38:29	0
3764570	99	105	1,91	cyclictest	0	-21	swapper/0	00:33:03	0
3764570	99	105	1,91	cyclictest	0	-21	swapper/0	00:33:03	0
3764570	99	105	1,90	cyclictest	0	-21	swapper/0	20:25:15	0
3764570	99	105	1,90	cyclictest	0	-21	swapper/0	20:25:15	0
3764570	99	105	1,89	cyclictest	0	-21	swapper/0	21:06:39	0
3764595	99	104	98,3	cyclictest	0	-21	swapper/5	23:06:42	5
3764579	99	104	91,6	cyclictest	3782187	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	19:51:03	2
3764570	99	104	9,72	cyclictest	645	50	irq/530-eth0-Tx	00:25:21	0
3764570	99	104	80,16	cyclictest	3761147	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	19:20:58	0
3764570	99	104	23,43	cyclictest	0	-21	swapper/0	22:46:33	0
3764570	99	104	23,43	cyclictest	0	-21	swapper/0	22:46:33	0
3764570	99	104	1,83	cyclictest	0	-21	swapper/0	21:45:33	0
3764570	99	104	10,79	cyclictest	642	50	irq/527-eth0-Tx	22:34:43	0
3764570	99	103	2,87	cyclictest	0	-21	swapper/0	19:40:13	0
3764570	99	102	2,81	cyclictest	0	-21	swapper/0	19:39:13	0
3764570	99	102	1,66	cyclictest	0	-21	swapper/0	00:10:25	0
3764570	99	102	1,66	cyclictest	0	-21	swapper/0	00:10:25	0
3764570	99	102	1,64	cyclictest	0	-21	swapper/0	21:32:23	0
3764570	99	101	4,34	cyclictest	644	50	irq/529-eth0-Tx	21:25:18	0
3764570	99	101	42,42	cyclictest	0	-21	swapper/0	19:15:51	0
3764570	99	101	2,30	cyclictest	4058546	-21	kworker/u12:4+rpciod@ rpc_async_schedule	00:37:54	0
3764570	99	101	2,30	cyclictest	4058546	-21	kworker/u12:4+rpciod@ rpc_async_schedule	00:37:54	0
3764570	99	101	1,87	cyclictest	0	-21	swapper/0	22:55:59	0
3764584	99	100	88,6	cyclictest	3978307	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:36:46	3
3764570	99	100	66,22	cyclictest	642	50	irq/527-eth0-Tx	19:45:57	0
3764570	99	100	22,4	cyclictest	0	-21	swapper/0	00:23:19	0
3764570	99	100	1,85	cyclictest	0	-21	swapper/0	19:10:13	0
3764584	99	99	85,7	cyclictest	4005742	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:52:37	3
3764570	99	99	80,16	cyclictest	3877166	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:06:28	0
3764570	99	99	67,20	cyclictest	643	50	irq/528-eth0-Tx	22:13:44	0
3764570	99	99	1,77	cyclictest	3821555	-21	ssh	21:19:05	0
3764570	99	99	1,77	cyclictest	3821555	-21	ssh	21:19:04	0
3764570	99	99	1,75	cyclictest	0	-21	swapper/0	00:02:11	0
3764570	99	99	1,75	cyclictest	0	-21	swapper/0	00:02:10	0
3764570	99	98	1,78	cyclictest	0	-21	swapper/0	20:50:02	0
3764570	99	98	1,63	cyclictest	3892408	-21	ssh	22:18:33	0
3764570	99	97	52,23	cyclictest	0	-21	swapper/0	20:30:13	0
3764570	99	97	43,42	cyclictest	643	50	irq/528-eth0-Tx	23:52:34	0
3764570	99	97	1,76	cyclictest	0	-21	swapper/0	21:55:18	0
3764570	99	97	1,74	cyclictest	0	-21	swapper/0	21:00:30	0
3764570	99	97	1,74	cyclictest	0	-21	swapper/0	21:00:29	0
3764570	99	97	1,73	cyclictest	0	-21	swapper/0	20:23:50	0
3764570	99	97	1,73	cyclictest	0	-21	swapper/0	20:23:49	0
3764570	99	96	9,7	cyclictest	4033161	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:15:33	0
3764570	99	96	5,58	cyclictest	3926229	-1	kworker/0:2H+kblockd@ blk_mq_run_work_fn	23:45:05	0
3764570	99	95	60,22	cyclictest	0	-21	swapper/0	20:55:34	0
3764570	99	95	1,78	cyclictest	0	-21	swapper/0	20:00:16	0
3764570	99	95	1,78	cyclictest	0	-21	swapper/0	20:00:15	0
3764584	99	94	80,7	cyclictest	3917091	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:41:36	3
3764584	99	94	80,7	cyclictest	3917091	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:41:35	3
3764570	99	94	61,21	cyclictest	0	-21	swapper/0	19:59:27	0
3764570	99	94	2,6	cyclictest	3967516	-21	/usr/sbin/munin	23:20:19	0
3764570	99	94	2,6	cyclictest	3967516	-21	/usr/sbin/munin	23:20:19	0
3764570	99	94	1,85	cyclictest	1165	-21	runrttasks	19:33:37	0
3764570	99	93	1,77	cyclictest	0	-21	swapper/0	00:05:43	0
3764570	99	93	1,77	cyclictest	0	-21	swapper/0	00:05:43	0
3764584	99	92	79,7	cyclictest	4047674	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:38:59	3
3764584	99	92	79,7	cyclictest	4047674	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:38:59	3
3764584	99	92	77,8	cyclictest	3978307	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:30:56	3
3764584	99	92	77,8	cyclictest	3978307	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:30:56	3
3764570	99	92	2,63	cyclictest	0	-21	swapper/0	23:25:29	0
3764570	99	92	2,63	cyclictest	0	-21	swapper/0	23:25:28	0
3764584	99	91	77,7	cyclictest	3877166	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:16:30	3
3764570	99	91	1,70	cyclictest	0	-21	swapper/0	20:47:51	0
3764570	99	91	1,3	cyclictest	0	-21	swapper/0	23:14:07	0
3764570	99	91	1,3	cyclictest	0	-21	swapper/0	23:14:07	0
3764589	99	90	85,2	cyclictest	0	-21	swapper/4	23:11:42	4
3764589	99	90	85,2	cyclictest	0	-21	swapper/4	23:11:42	4
3764570	99	90	55,24	cyclictest	0	-21	swapper/0	19:27:55	0
3764570	99	90	2,5	cyclictest	4011627	-21	timerwakeupswit	23:55:43	0
3764570	99	90	25,48	cyclictest	645	50	irq/530-eth0-Tx	21:40:00	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17