OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Sat Jun 13, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4543	99	108	92	cyclictest	0	-21	swapper/3	05:13:11	3
4543	99	105	104	cyclictest	25755	-21	sed	07:48:17	3
4541	99	103	102	cyclictest	0	-21	swapper/1	09:50:31	1
4543	99	93	92	cyclictest	0	-21	swapper/3	07:58:13	3
4543	99	93	92	cyclictest	0	-21	swapper/3	05:23:11	3
4543	99	93	92	cyclictest	0	-21	swapper/3	04:48:16	3
4543	99	93	92	cyclictest	0	-21	swapper/3	04:48:16	3
4541	99	92	73	cyclictest	22264	-21	tune2fs	05:13:11	1
4543	99	91	71	cyclictest	0	-21	swapper/3	09:13:05	3
4543	99	89	82	cyclictest	0	-21	swapper/3	09:08:13	3
4543	99	89	72	cyclictest	0	-21	swapper/3	09:23:02	3
4543	99	89	72	cyclictest	0	-21	swapper/3	08:38:04	3
4543	99	89	72	cyclictest	0	-21	swapper/3	07:42:53	3
4543	99	89	72	cyclictest	0	-21	swapper/3	06:58:09	3
4543	99	89	72	cyclictest	0	-21	swapper/3	06:13:08	3
4543	99	89	72	cyclictest	0	-21	swapper/3	04:33:22	3
4541	99	89	82	cyclictest	9859	-21	tune2fs	08:28:05	1
4541	99	89	82	cyclictest	28909	-21	tune2fs	06:43:09	1
4541	99	89	82	cyclictest	28909	-21	tune2fs	06:43:09	1
4543	99	88	72	cyclictest	0	-21	swapper/3	09:58:00	3
4543	99	88	72	cyclictest	0	-21	swapper/3	09:38:00	3
4543	99	88	72	cyclictest	0	-21	swapper/3	09:28:09	3
4543	99	88	72	cyclictest	0	-21	swapper/3	08:46:33	3
4543	99	88	72	cyclictest	0	-21	swapper/3	08:28:11	3
4543	99	88	72	cyclictest	0	-21	swapper/3	08:27:51	3
4543	99	88	72	cyclictest	0	-21	swapper/3	08:18:08	3
4543	99	88	72	cyclictest	0	-21	swapper/3	08:08:03	3
4543	99	88	72	cyclictest	0	-21	swapper/3	07:53:05	3
4543	99	88	72	cyclictest	0	-21	swapper/3	07:43:10	3
4543	99	88	72	cyclictest	0	-21	swapper/3	07:28:08	3
4543	99	88	72	cyclictest	0	-21	swapper/3	07:13:13	3
4543	99	88	72	cyclictest	0	-21	swapper/3	07:03:13	3
4543	99	88	72	cyclictest	0	-21	swapper/3	06:48:08	3
4543	99	88	72	cyclictest	0	-21	swapper/3	06:38:08	3
4543	99	88	72	cyclictest	0	-21	swapper/3	06:33:10	3
4543	99	88	72	cyclictest	0	-21	swapper/3	06:23:09	3
4543	99	88	72	cyclictest	0	-21	swapper/3	05:53:13	3
4543	99	88	72	cyclictest	0	-21	swapper/3	05:33:16	3
4543	99	88	72	cyclictest	0	-21	swapper/3	05:32:58	3
4543	99	88	72	cyclictest	0	-21	swapper/3	04:58:13	3
4543	99	88	72	cyclictest	0	-21	swapper/3	04:43:21	3
4543	99	88	72	cyclictest	0	-21	swapper/3	04:38:14	3
4541	99	88	82	cyclictest	0	-21	swapper/1	08:53:01	1
4541	99	88	82	cyclictest	0	-21	swapper/1	05:43:20	1
4541	99	88	81	cyclictest	7530	-21	tune2fs	07:08:08	1
4541	99	88	81	cyclictest	13327	-21	aten2.4-expect	04:53:11	1
4543	99	87	72	cyclictest	0	-21	swapper/3	07:08:05	3
4543	99	87	72	cyclictest	0	-21	swapper/3	06:02:57	3
4543	99	87	72	cyclictest	0	-21	swapper/3	05:18:17	3
4543	99	87	72	cyclictest	0	-21	swapper/3	05:03:14	3
4543	99	87	71	cyclictest	0	-21	swapper/3	09:47:48	3
4543	99	87	71	cyclictest	0	-21	swapper/3	08:58:07	3
4543	99	87	71	cyclictest	0	-21	swapper/3	08:53:03	3
4543	99	87	71	cyclictest	0	-21	swapper/3	08:33:13	3
4543	99	87	71	cyclictest	0	-21	swapper/3	08:03:13	3
4543	99	87	71	cyclictest	0	-21	swapper/3	07:33:09	3
4543	99	87	71	cyclictest	0	-21	swapper/3	06:43:09	3
4543	99	87	71	cyclictest	0	-21	swapper/3	06:43:09	3
4543	99	87	71	cyclictest	0	-21	swapper/3	05:58:08	3
4543	99	87	71	cyclictest	0	-21	swapper/3	05:43:11	3
4543	99	87	71	cyclictest	0	-21	swapper/3	05:08:14	3
4541	99	87	82	cyclictest	0	-21	swapper/1	09:45:11	1
4541	99	87	82	cyclictest	0	-21	swapper/1	08:13:12	1
4541	99	87	82	cyclictest	0	-21	swapper/1	06:18:17	1
4541	99	87	81	cyclictest	9359	-21	tune2fs	04:43:13	1
4543	99	86	81	cyclictest	0	-21	swapper/3	09:48:02	3
4543	99	86	81	cyclictest	0	-21	swapper/3	04:53:11	3
4543	99	86	71	cyclictest	0	-21	swapper/3	08:48:11	3
4543	99	86	71	cyclictest	0	-21	swapper/3	07:18:13	3
4543	99	86	71	cyclictest	0	-21	swapper/3	06:08:17	3
4541	99	86	82	cyclictest	0	-21	swapper/1	09:18:09	1
4541	99	86	82	cyclictest	0	-21	swapper/1	09:13:08	1
4541	99	86	82	cyclictest	0	-21	swapper/1	06:58:15	1
4543	99	85	71	cyclictest	0	-21	swapper/3	09:18:04	3
4543	99	83	82	cyclictest	0	-21	swapper/3	09:36:20	3
4543	99	83	82	cyclictest	0	-21	swapper/3	09:06:14	3
4543	99	83	82	cyclictest	0	-21	swapper/3	08:13:06	3
4543	99	83	82	cyclictest	0	-21	swapper/3	06:30:51	3
4541	99	83	82	cyclictest	0	-21	swapper/1	09:58:09	1
4541	99	83	82	cyclictest	0	-21	swapper/1	09:56:22	1
4541	99	83	82	cyclictest	0	-21	swapper/1	09:27:59	1
4541	99	83	82	cyclictest	0	-21	swapper/1	08:33:11	1
4541	99	83	82	cyclictest	0	-21	swapper/1	08:03:09	1
4541	99	83	82	cyclictest	0	-21	swapper/1	07:48:14	1
4541	99	83	82	cyclictest	0	-21	swapper/1	07:23:15	1
4541	99	83	82	cyclictest	0	-21	swapper/1	06:55:56	1
4541	99	83	82	cyclictest	0	-21	swapper/1	06:28:17	1
4541	99	83	82	cyclictest	0	-21	swapper/1	05:53:17	1
4541	99	83	82	cyclictest	0	-21	swapper/1	05:18:20	1
4541	99	83	82	cyclictest	0	-21	swapper/1	05:08:02	1
4541	99	83	82	cyclictest	0	-21	swapper/1	05:02:58	1
4541	99	83	82	cyclictest	0	-21	swapper/1	04:48:16	1
4541	99	83	82	cyclictest	0	-21	swapper/1	04:48:16	1
4541	99	83	82	cyclictest	0	-21	swapper/1	04:38:21	1
4541	99	83	81	cyclictest	7796	-21	tune2fs	09:38:02	1
4541	99	83	81	cyclictest	26346	-21	aten2.4-expect	06:38:06	1
4541	99	83	81	cyclictest	16145	-21	tune2fs	06:13:08	1
4541	99	83	81	cyclictest	16142	-21	tune2fs	08:43:03	1
4541	99	82	81	cyclictest	26732	-21	tune2fs	05:23:13	1
4541	99	82	81	cyclictest	0	-21	swapper/1	07:53:14	1
4541	99	76	71	cyclictest	0	-21	swapper/1	09:08:13	1
4543	99	75	71	cyclictest	0	-21	swapper/3	09:53:09	3
4543	99	75	71	cyclictest	0	-21	swapper/3	07:23:12	3
4543	99	75	71	cyclictest	0	-21	swapper/3	06:53:15	3
4543	99	75	61	cyclictest	0	-21	swapper/3	06:18:17	3
4541	99	74	51	cyclictest	13938	-21	tune2fs	06:08:11	1
4543	99	73	72	cyclictest	0	-21	swapper/3	05:51:42	3
4543	99	73	72	cyclictest	0	-21	swapper/3	05:40:44	3
4541	99	73	72	cyclictest	0	-21	swapper/1	09:03:02	1
4541	99	73	72	cyclictest	0	-21	swapper/1	08:18:13	1
4541	99	73	72	cyclictest	0	-21	swapper/1	08:01:06	1
4541	99	73	72	cyclictest	0	-21	swapper/1	05:35:43	1
4541	99	73	71	cyclictest	18390	-21	tune2fs	07:33:07	1
4541	99	72	71	cyclictest	0	-21	swapper/1	06:33:06	1
4541	99	70	69	cyclictest	0	-21	swapper/1	08:25:36	1
4541	99	68	67	cyclictest	0	-21	swapper/1	06:48:26	1
4541	99	67	65	cyclictest	456	-21	aten2.4-expect	08:08:03	1
4540	99	67	49	cyclictest	1286	50	irq/46-eth0	05:13:09	0
4541	99	66	64	cyclictest	699	-21	tune2fs	05:38:11	1
4541	99	64	62	cyclictest	0	-21	swapper/1	07:41:03	1
4542	99	63	61	cyclictest	7082	-21	telnet	07:08:06	2
4541	99	63	62	cyclictest	0	-21	swapper/1	09:32:49	1
4541	99	63	62	cyclictest	0	-21	swapper/1	09:22:59	1
4541	99	63	62	cyclictest	0	-21	swapper/1	08:57:50	1
4541	99	63	62	cyclictest	0	-21	swapper/1	08:48:04	1
4541	99	63	62	cyclictest	0	-21	swapper/1	08:38:02	1
4541	99	63	62	cyclictest	0	-21	swapper/1	07:43:08	1
4541	99	63	62	cyclictest	0	-21	swapper/1	07:28:05	1
4541	99	63	62	cyclictest	0	-21	swapper/1	07:18:03	1
4541	99	63	62	cyclictest	0	-21	swapper/1	07:13:04	1
4541	99	63	62	cyclictest	0	-21	swapper/1	07:03:06	1
4541	99	63	62	cyclictest	0	-21	swapper/1	06:23:02	1
4541	99	63	62	cyclictest	0	-21	swapper/1	06:02:56	1
4541	99	63	62	cyclictest	0	-21	swapper/1	05:58:08	1
4541	99	63	62	cyclictest	0	-21	swapper/1	05:48:09	1
4541	99	63	62	cyclictest	0	-21	swapper/1	05:28:08	1
4541	99	63	62	cyclictest	0	-21	swapper/1	05:03:13	1
4541	99	63	62	cyclictest	0	-21	swapper/1	04:33:00	1
4540	99	62	61	cyclictest	0	-21	swapper/0	08:50:10	0
4540	99	57	41	cyclictest	0	-21	swapper/0	10:00:05	0
4542	99	56	55	cyclictest	0	-21	swapper/2	07:33:05	2
4542	99	56	41	cyclictest	23243	-21	processes	06:28:16	2
4542	99	56	41	cyclictest	0	-21	swapper/2	09:23:09	2
4542	99	55	54	cyclictest	9806	-21	iostat	04:43:15	2
4542	99	55	54	cyclictest	5663	-21	munin-node	07:03:10	2
4542	99	55	54	cyclictest	5587	-21	iostat	05:48:13	2
4542	99	55	54	cyclictest	3937	-21	munin-node	06:58:14	2
4542	99	55	54	cyclictest	17824	-21	latency_hist	08:47:50	2
4542	99	55	54	cyclictest	16787	-21	munin-node	07:28:13	2
4542	99	55	54	cyclictest	16753	-21	munin-node	09:58:03	2
4542	99	55	54	cyclictest	14466	-21	munin-node	06:08:15	2
4542	99	55	54	cyclictest	13852	-21	munin-node	08:38:03	2
4542	99	55	53	cyclictest	18	1	ksoftirqd/2	05:28:51	2
4542	99	55	52	cyclictest	0	-21	swapper/2	05:14:54	2
4542	99	55	51	cyclictest	278	-21	usb-storage	05:36:57	2
4542	99	55	51	cyclictest	0	-21	swapper/2	07:26:28	2
4542	99	55	41	cyclictest	0	-21	swapper/2	08:23:07	2
4540	99	55	48	cyclictest	0	-21	swapper/0	08:13:29	0
4542	99	54	53	cyclictest	31618	-21	munin-node	08:03:08	2
4542	99	54	53	cyclictest	30623	-21	sshd	09:17:21	2
4542	99	54	53	cyclictest	30615	-21	latency_hist	08:02:52	2
4542	99	54	53	cyclictest	28778	-21	munin-node	06:43:09	2
4542	99	54	53	cyclictest	28778	-21	munin-node	06:43:09	2
4542	99	54	53	cyclictest	26423	-21	aten2.4_r3power	07:53:03	2
4542	99	54	53	cyclictest	25575	-21	munin-node	06:33:18	2
4542	99	54	53	cyclictest	22500	-21	munin-node	08:58:03	2
4542	99	54	53	cyclictest	21235	-21	munin-node	07:38:12	2
4542	99	54	53	cyclictest	18860	-21	munin-node	05:03:20	2
4542	99	54	53	cyclictest	15066	-21	kworker/2:2	08:14:37	2
4542	99	54	53	cyclictest	12382	-21	iostat	09:48:03	2
4542	99	54	53	cyclictest	12109	-21	munin-node	07:18:08	2
4542	99	54	53	cyclictest	0	-21	swapper/2	08:54:03	2
4542	99	54	52	cyclictest	50	50	irq/44-ahci	06:22:49	2
4542	99	54	51	cyclictest	0	-21	swapper/2	06:52:00	2
4542	99	54	51	cyclictest	0	-21	swapper/2	05:53:16	2
4542	99	54	51	cyclictest	0	-21	swapper/2	05:09:18	2
4540	99	54	47	cyclictest	0	-21	swapper/0	07:07:11	0
4540	99	54	47	cyclictest	0	-21	swapper/0	06:21:31	0
4540	99	54	42	cyclictest	760	50	irq/18-parport0	05:27:43	0
4540	99	54	38	cyclictest	0	-21	swapper/0	05:52:38	0
4542	99	53	52	cyclictest	30834	-21	telnet	09:17:59	2
4542	99	53	52	cyclictest	27826	-21	kworker/2:0	05:38:10	2
4542	99	53	52	cyclictest	26886	-21	fschecks_count	09:08:03	2
4542	99	53	52	cyclictest	21169	-21	munin-node	06:23:17	2
4542	99	53	52	cyclictest	14558	-21	munin-node	04:53:20	2
4542	99	53	52	cyclictest	11872	-21	munin-node	04:48:15	2
4542	99	53	52	cyclictest	11872	-21	munin-node	04:48:15	2
4542	99	53	52	cyclictest	11178	-21	munin-node	06:03:10	2
4542	99	53	52	cyclictest	0	-21	swapper/2	09:53:00	2
4542	99	53	52	cyclictest	0	-21	swapper/2	09:38:00	2
4542	99	53	52	cyclictest	0	-21	swapper/2	08:09:17	2
4542	99	53	52	cyclictest	0	-21	swapper/2	06:13:05	2
4542	99	53	52	cyclictest	0	-21	swapper/2	05:18:09	2
4542	99	53	52	cyclictest	0	-21	swapper/2	04:38:12	2
4542	99	53	51	cyclictest	50	50	irq/44-ahci	08:18:03	2
4542	99	53	51	cyclictest	50	50	irq/44-ahci	06:01:26	2
4542	99	53	51	cyclictest	27544	-21	processes	06:38:14	2
4542	99	53	51	cyclictest	11181	-21	latency_hist	07:17:53	2
4542	99	53	51	cyclictest	0	-21	swapper/2	07:48:05	2
4542	99	53	41	cyclictest	278	-21	usb-storage	06:57:21	2
4542	99	53	41	cyclictest	278	-21	usb-storage	04:36:21	2
4542	99	53	41	cyclictest	26307	-21	cpu	05:23:11	2
4542	99	53	41	cyclictest	0	-21	swapper/2	09:44:49	2
4542	99	53	41	cyclictest	0	-21	swapper/2	09:27:59	2
4542	99	53	41	cyclictest	0	-21	swapper/2	09:03:01	2
4542	99	53	41	cyclictest	0	-21	swapper/2	08:49:23	2
4542	99	53	41	cyclictest	0	-21	swapper/2	08:33:22	2
4542	99	53	41	cyclictest	0	-21	swapper/2	08:28:04	2
4542	99	53	41	cyclictest	0	-21	swapper/2	07:44:10	2
4542	99	53	41	cyclictest	0	-21	swapper/2	05:44:06	2
4542	99	53	41	cyclictest	0	-21	swapper/2	04:59:36	2
4540	99	53	52	cyclictest	0	-21	swapper/0	09:53:00	0
4540	99	53	52	cyclictest	0	-21	swapper/0	07:33:56	0
4540	99	53	52	cyclictest	0	-21	swapper/0	06:53:06	0
4540	99	53	52	cyclictest	0	-21	swapper/0	05:38:08	0
4540	99	53	52	cyclictest	0	-21	swapper/0	04:38:11	0
4540	99	53	41	cyclictest	760	50	irq/18-parport0	09:19:40	0
4540	99	53	41	cyclictest	760	50	irq/18-parport0	05:53:54	0
4540	99	53	41	cyclictest	0	-21	swapper/0	06:14:25	0
4542	99	52	51	cyclictest	15066	-21	kworker/2:2	09:32:54	2
4540	99	52	51	cyclictest	0	-21	swapper/0	09:48:47	0
4540	99	52	51	cyclictest	0	-21	swapper/0	09:42:59	0
4540	99	52	51	cyclictest	0	-21	swapper/0	09:39:31	0
4540	99	52	51	cyclictest	0	-21	swapper/0	09:37:05	0
4540	99	52	51	cyclictest	0	-21	swapper/0	09:17:16	0
4540	99	52	51	cyclictest	0	-21	swapper/0	08:20:38	0
4540	99	52	51	cyclictest	0	-21	swapper/0	08:03:15	0
4540	99	52	51	cyclictest	0	-21	swapper/0	07:56:21	0
4540	99	52	51	cyclictest	0	-21	swapper/0	07:51:35	0
4540	99	52	51	cyclictest	0	-21	swapper/0	07:47:44	0
4540	99	52	51	cyclictest	0	-21	swapper/0	07:28:01	0
4540	99	52	51	cyclictest	0	-21	swapper/0	06:39:38	0
4540	99	52	51	cyclictest	0	-21	swapper/0	06:33:07	0
4540	99	52	51	cyclictest	0	-21	swapper/0	06:23:49	0
4540	99	52	51	cyclictest	0	-21	swapper/0	06:03:00	0
4540	99	52	51	cyclictest	0	-21	swapper/0	05:43:40	0
4540	99	52	51	cyclictest	0	-21	swapper/0	05:21:49	0
4540	99	52	51	cyclictest	0	-21	swapper/0	05:07:46	0
4540	99	52	51	cyclictest	0	-21	swapper/0	05:00:04	0
4540	99	52	51	cyclictest	0	-21	swapper/0	04:34:09	0
4540	99	52	41	cyclictest	0	-21	swapper/0	08:53:01	0
4540	99	52	41	cyclictest	0	-21	swapper/0	05:08:11	0
4540	99	52	32	cyclictest	0	-21	swapper/0	05:29:25	0
4540	99	51	50	cyclictest	0	-21	swapper/0	09:27:59	0
4540	99	51	50	cyclictest	0	-21	swapper/0	09:11:24	0
4540	99	51	50	cyclictest	0	-21	swapper/0	09:03:01	0
4540	99	51	50	cyclictest	0	-21	swapper/0	08:43:21	0
4540	99	51	50	cyclictest	0	-21	swapper/0	08:42:32	0
4540	99	51	50	cyclictest	0	-21	swapper/0	08:33:22	0
4540	99	51	50	cyclictest	0	-21	swapper/0	08:25:14	0
4540	99	51	50	cyclictest	0	-21	swapper/0	08:01:33	0
4540	99	51	50	cyclictest	0	-21	swapper/0	07:23:38	0
4540	99	51	50	cyclictest	0	-21	swapper/0	07:08:23	0
4540	99	51	50	cyclictest	0	-21	swapper/0	06:01:59	0
4540	99	50	49	cyclictest	0	-21	swapper/0	09:24:02	0
4540	99	50	49	cyclictest	0	-21	swapper/0	08:31:12	0
4540	99	50	49	cyclictest	0	-21	swapper/0	06:59:29	0
4540	99	50	49	cyclictest	0	-21	swapper/0	06:44:14	0
4540	99	50	49	cyclictest	0	-21	swapper/0	06:44:14	0
4540	99	50	49	cyclictest	0	-21	swapper/0	05:35:15	0
4540	99	50	49	cyclictest	0	-21	swapper/0	04:57:52	0
4540	99	50	49	cyclictest	0	-21	swapper/0	04:48:42	0
4540	99	50	49	cyclictest	0	-21	swapper/0	04:48:42	0
4540	99	49	48	cyclictest	0	-21	swapper/0	07:41:48	0
4540	99	49	48	cyclictest	0	-21	swapper/0	04:44:20	0
4540	99	48	47	cyclictest	0	-21	swapper/0	07:18:25	0
4540	99	48	47	cyclictest	0	-21	swapper/0	07:14:17	0
4540	99	48	47	cyclictest	0	-21	swapper/0	06:28:37	0
4540	99	48	47	cyclictest	0	-21	swapper/0	06:09:29	0
4540	99	48	30	cyclictest	1876	-21	hald-addon-stor	09:00:51	0
4540	99	47	46	cyclictest	0	-21	swapper/0	08:08:33	0
4540	99	46	45	cyclictest	0	-21	swapper/0	06:48:56	0
23	1	11	0	ksoftirqd/3	0	-21	swapper/3	04:31:44	3
10	99	11	0	migration/1	2824	-21	fschecks_count	04:28:14	1
18	1	10	0	ksoftirqd/2	0	-21	swapper/2	04:31:56	2
1286	50	10	0	irq/46-eth0	0	-21	swapper/0	04:29:30	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17