OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Tue May 19, 2026 12:46:40)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2748114	99	141	129,6	cyclictest	2792311	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:19:08	3
2748114	99	141	129,6	cyclictest	2792311	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:19:08	3
2748097	99	129	117,6	cyclictest	2891854	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:04:21	0
2748097	99	129	117,6	cyclictest	2891854	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:04:21	0
2748097	99	109	71,31	cyclictest	2772100	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:10:14	0
2748123	99	107	101,3	cyclictest	0	-21	swapper/5	09:55:14	5
2748097	99	105	65,33	cyclictest	2741827	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:15:36	0
2748097	99	104	65,32	cyclictest	2824825	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:45:30	0
2748097	99	104	65,32	cyclictest	2824825	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:45:30	0
2748114	99	102	90,6	cyclictest	3018729	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:29:27	3
2748114	99	102	90,6	cyclictest	3018729	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:29:26	3
2748097	99	102	79,7	cyclictest	2880567	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:17:44	0
2748097	99	102	46,30	cyclictest	2976588	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:45:32	0
2748097	99	102	41,29	cyclictest	2864303	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:27:16	0
2748097	99	102	41,29	cyclictest	2864303	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:27:16	0
2748097	99	100	24,47	cyclictest	2930537	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:35:18	0
2748097	99	100	24,47	cyclictest	2930537	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:35:18	0
2748123	99	99	93,3	cyclictest	0	-21	swapper/5	07:23:53	5
2748114	99	99	88,5	cyclictest	2901220	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	10:54:21	3
2748097	99	98	1,84	cyclictest	0	-21	swapper/0	07:10:40	0
2748118	99	97	91,3	cyclictest	0	-21	swapper/4	09:55:14	4
2748114	99	97	85,6	cyclictest	2762575	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:53:57	3
2748097	99	97	64,17	cyclictest	0	-21	swapper/0	10:41:45	0
2748123	99	96	90,3	cyclictest	0	-21	swapper/5	09:04:04	5
2748097	99	96	83,7	cyclictest	2844200	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:59:12	0
2748109	99	94	80,7	cyclictest	2851540	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:09:13	2
2748109	99	94	80,7	cyclictest	2824825	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:39:09	2
2748097	99	94	72,11	cyclictest	2844200	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:13:35	0
2748102	99	92	78,7	cyclictest	3051743	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:34:29	1
2748097	99	92	70,4	cyclictest	689	50	irq/527-eth0-Tx	08:20:16	0
2748097	99	91	79,6	cyclictest	2780174	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:29:35	0
2748097	99	91	79,6	cyclictest	2780174	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:29:34	0
2748114	99	89	77,6	cyclictest	2891854	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:21:34	3
2748097	99	89	75,7	cyclictest	3018729	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:36:57	0
2748118	99	88	83,3	cyclictest	0	-21	swapper/4	07:23:54	4
2748114	99	88	77,5	cyclictest	2976588	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:45:17	3
2748114	99	88	76,6	cyclictest	2988417	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:01:15	3
2748114	99	88	62,7	cyclictest	3018729	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:07:55	3
2748109	99	88	55,8	cyclictest	2955864	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:20:37	2
2748097	99	88	40,28	cyclictest	2995052	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:59:35	0
2748114	99	87	75,6	cyclictest	2955864	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:33:33	3
2748114	99	87	75,6	cyclictest	2930537	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:29:25	3
2748114	99	87	75,6	cyclictest	2901220	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	10:57:11	3
2748097	99	87	69,5	cyclictest	2996653	-21	apt-get	11:50:10	0
2748097	99	87	65,7	cyclictest	2930537	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:25:28	0
2748123	99	86	80,3	cyclictest	0	-21	swapper/5	07:58:59	5
2748114	99	86	56,7	cyclictest	2790254	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:55:42	3
2748114	99	86	56,7	cyclictest	2790254	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:55:41	3
2748097	99	86	48,31	cyclictest	2945246	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:10:21	0
2748097	99	86	38,3	cyclictest	0	-21	swapper/0	12:15:31	0
2748097	99	86	1,73	cyclictest	0	-21	swapper/0	11:40:35	0
2748097	99	86	1,73	cyclictest	0	-21	swapper/0	11:40:34	0
2748118	99	85	80,3	cyclictest	0	-21	swapper/4	09:04:04	4
2748114	99	85	74,5	cyclictest	2976588	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:35:12	3
2748114	99	85	66,8	cyclictest	2891854	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:34:02	3
2748114	99	85	66,8	cyclictest	2891854	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:34:02	3
2748109	99	85	71,7	cyclictest	2755978	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:48:57	2
2748109	99	85	71,7	cyclictest	2755978	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:48:56	2
2748097	99	85	72,7	cyclictest	2762575	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:50:29	0
2748097	99	85	72,4	cyclictest	690	50	irq/528-eth0-Tx	07:35:29	0
2748123	99	84	79,2	cyclictest	0	-21	swapper/5	08:32:34	5
2748123	99	84	78,3	cyclictest	0	-21	swapper/5	11:15:59	5
2748114	99	84	72,6	cyclictest	2741827	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:16:08	3
2748097	99	84	72,6	cyclictest	2891854	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:32:11	0
2748097	99	84	72,6	cyclictest	2891854	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:32:11	0
2748097	99	84	71,7	cyclictest	2891854	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:55:13	0
2748123	99	83	77,3	cyclictest	0	-21	swapper/5	10:20:11	5
2748123	99	83	76,3	cyclictest	0	-21	swapper/5	08:19:01	5
2748123	99	83	75,4	cyclictest	0	-21	swapper/5	12:39:10	5
2748118	99	83	70,7	cyclictest	2826301	-21	ssh	09:34:48	4
2748114	99	83	71,6	cyclictest	2955864	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:18:24	3
2748114	99	83	71,6	cyclictest	2824825	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:46:25	3
2748114	99	83	71,6	cyclictest	2824825	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:46:25	3
2748114	99	83	71,6	cyclictest	2784124	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	08:49:03	3
2748097	99	83	61,4	cyclictest	691	50	irq/529-eth0-Tx	12:14:22	0
2748097	99	83	44,31	cyclictest	2864303	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:20:39	0
2748123	99	82	77,2	cyclictest	0	-21	swapper/5	10:08:34	5
2748123	99	82	75,3	cyclictest	0	-21	swapper/5	10:10:02	5
2748123	99	82	75,3	cyclictest	0	-21	swapper/5	10:02:34	5
2748114	99	82	71,5	cyclictest	2784124	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	08:43:15	3
2748114	99	82	71,5	cyclictest	2784124	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	08:43:15	3
2748114	99	82	70,6	cyclictest	2776055	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:27:37	3
2748114	99	82	70,6	cyclictest	2776055	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:27:37	3
2748114	99	82	70,6	cyclictest	2767842	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:56:09	3
2748109	99	82	70,6	cyclictest	2976588	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:09:25	2
2748097	99	82	68,7	cyclictest	3018729	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:33:11	0
2748097	99	82	6,66	cyclictest	48	-21	rcuop/4	09:42:37	0
2748097	99	82	51,21	cyclictest	2851540	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:02:34	0
2748097	99	82	43,7	cyclictest	2974883	-21	ssh	11:32:10	0
2748123	99	81	75,2	cyclictest	0	-21	swapper/5	07:25:17	5
2748114	99	81	61,7	cyclictest	3018729	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:33:54	3
2748114	99	81	52,7	cyclictest	2844200	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:52:22	3
2748097	99	81	69,6	cyclictest	2753743	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	07:23:53	0
2748097	99	81	66,7	cyclictest	2772100	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:41:56	0
2748097	99	81	66,7	cyclictest	2772100	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:41:56	0
2748123	99	80	74,3	cyclictest	0	-21	swapper/5	12:10:14	5
2748123	99	80	74,3	cyclictest	0	-21	swapper/5	10:41:55	5
2748118	99	80	68,7	cyclictest	2954844	-21	ssh	11:15:59	4
2748114	99	80	68,6	cyclictest	3018729	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:19:25	3
2748114	99	80	68,6	cyclictest	2780174	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:33:30	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17