OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 376 highest latencies:

System rack3slot1.osadl.org (updated Thu Sep 12, 2024 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
20809	99	103	102	cyclictest	32257	-21	tune2fs	06:39:25	1
20809	99	103	102	cyclictest	0	-21	swapper/1	05:59:35	1
20809	99	102	101	cyclictest	0	-21	swapper/1	08:49:24	1
20831	99	93	92	cyclictest	0	-21	swapper/3	06:14:25	3
20809	99	84	83	cyclictest	21396	-21	tune2fs	06:14:25	1
20809	99	84	82	cyclictest	27925	-21	tune2fs	06:29:24	1
20809	99	84	72	cyclictest	25718	-21	tune2fs	03:54:31	1
20809	99	84	72	cyclictest	0	-21	swapper/1	04:24:29	1
20831	99	83	82	cyclictest	0	-21	swapper/3	09:09:21	3
20831	99	83	82	cyclictest	0	-21	swapper/3	08:47:44	3
20831	99	83	82	cyclictest	0	-21	swapper/3	08:24:06	3
20831	99	83	82	cyclictest	0	-21	swapper/3	08:17:40	3
20831	99	83	82	cyclictest	0	-21	swapper/3	07:34:25	3
20831	99	83	82	cyclictest	0	-21	swapper/3	07:27:34	3
20831	99	83	82	cyclictest	0	-21	swapper/3	06:44:24	3
20831	99	83	82	cyclictest	0	-21	swapper/3	06:34:35	3
20831	99	83	82	cyclictest	0	-21	swapper/3	06:22:26	3
20831	99	83	82	cyclictest	0	-21	swapper/3	06:22:26	3
20831	99	83	82	cyclictest	0	-21	swapper/3	06:04:31	3
20831	99	83	82	cyclictest	0	-21	swapper/3	06:04:12	3
20831	99	83	82	cyclictest	0	-21	swapper/3	05:54:12	3
20831	99	83	82	cyclictest	0	-21	swapper/3	05:47:21	3
20831	99	83	82	cyclictest	0	-21	swapper/3	05:42:20	3
20831	99	83	82	cyclictest	0	-21	swapper/3	05:34:12	3
20831	99	83	82	cyclictest	0	-21	swapper/3	05:04:14	3
20831	99	83	82	cyclictest	0	-21	swapper/3	04:52:38	3
20831	99	83	82	cyclictest	0	-21	swapper/3	04:44:29	3
20831	99	83	82	cyclictest	0	-21	swapper/3	04:44:29	3
20831	99	83	82	cyclictest	0	-21	swapper/3	04:44:15	3
20831	99	83	82	cyclictest	0	-21	swapper/3	04:27:00	3
20831	99	83	82	cyclictest	0	-21	swapper/3	03:54:17	3
20831	99	83	82	cyclictest	0	-21	swapper/3	03:46:53	3
20809	99	83	82	cyclictest	0	-21	swapper/1	09:07:46	1
20809	99	83	82	cyclictest	0	-21	swapper/1	08:57:45	1
20809	99	83	82	cyclictest	0	-21	swapper/1	08:44:24	1
20809	99	83	82	cyclictest	0	-21	swapper/1	08:39:29	1
20809	99	83	82	cyclictest	0	-21	swapper/1	08:29:27	1
20809	99	83	82	cyclictest	0	-21	swapper/1	08:09:30	1
20809	99	83	82	cyclictest	0	-21	swapper/1	07:59:29	1
20809	99	83	82	cyclictest	0	-21	swapper/1	07:57:38	1
20809	99	83	82	cyclictest	0	-21	swapper/1	07:44:30	1
20809	99	83	82	cyclictest	0	-21	swapper/1	07:34:25	1
20809	99	83	82	cyclictest	0	-21	swapper/1	07:19:23	1
20809	99	83	82	cyclictest	0	-21	swapper/1	07:07:32	1
20809	99	83	82	cyclictest	0	-21	swapper/1	06:59:28	1
20809	99	83	82	cyclictest	0	-21	swapper/1	06:54:31	1
20809	99	83	82	cyclictest	0	-21	swapper/1	06:49:31	1
20809	99	83	82	cyclictest	0	-21	swapper/1	06:44:24	1
20809	99	83	82	cyclictest	0	-21	swapper/1	06:24:35	1
20809	99	83	82	cyclictest	0	-21	swapper/1	06:09:33	1
20809	99	83	82	cyclictest	0	-21	swapper/1	06:04:31	1
20809	99	83	82	cyclictest	0	-21	swapper/1	05:54:12	1
20809	99	83	82	cyclictest	0	-21	swapper/1	05:44:37	1
20809	99	83	82	cyclictest	0	-21	swapper/1	05:24:33	1
20809	99	83	82	cyclictest	0	-21	swapper/1	05:19:36	1
20809	99	83	82	cyclictest	0	-21	swapper/1	05:09:34	1
20809	99	83	82	cyclictest	0	-21	swapper/1	05:04:36	1
20809	99	83	82	cyclictest	0	-21	swapper/1	05:02:10	1
20809	99	83	82	cyclictest	0	-21	swapper/1	04:54:14	1
20809	99	83	82	cyclictest	0	-21	swapper/1	04:39:35	1
20809	99	83	82	cyclictest	0	-21	swapper/1	04:29:36	1
20809	99	83	82	cyclictest	0	-21	swapper/1	03:49:38	1
20809	99	83	81	cyclictest	30026	-21	tune2fs	04:04:31	1
20809	99	83	81	cyclictest	29747	-21	aten2.4-expect	06:34:23	1
20809	99	83	81	cyclictest	27993	-21	tune2fs	05:14:28	1
20809	99	83	81	cyclictest	21499	-21	tune2fs	07:29:20	1
20809	99	83	81	cyclictest	17327	-21	tune2fs	08:34:21	1
20809	99	83	81	cyclictest	10741	-21	tune2fs	04:34:29	1
20831	99	82	81	cyclictest	17485	-21	tune2fs	07:19:23	3
20831	99	82	81	cyclictest	0	-21	swapper/3	08:39:22	3
20831	99	82	81	cyclictest	0	-21	swapper/3	07:49:21	3
20831	99	82	81	cyclictest	0	-21	swapper/3	07:49:21	3
20831	99	82	81	cyclictest	0	-21	swapper/3	07:29:20	3
20831	99	82	81	cyclictest	0	-21	swapper/3	06:39:25	3
20831	99	82	81	cyclictest	0	-21	swapper/3	06:29:24	3
20831	99	82	81	cyclictest	0	-21	swapper/3	05:54:25	3
20831	99	82	81	cyclictest	0	-21	swapper/3	05:14:28	3
20831	99	82	81	cyclictest	0	-21	swapper/3	04:29:29	3
20831	99	82	81	cyclictest	0	-21	swapper/3	04:19:29	3
20831	99	82	81	cyclictest	0	-21	swapper/3	03:54:31	3
20809	99	82	81	cyclictest	15060	-21	tune2fs	04:44:29	1
20809	99	82	81	cyclictest	15060	-21	tune2fs	04:44:29	1
20809	99	82	81	cyclictest	13006	-21	tune2fs	05:54:25	1
20809	99	82	71	cyclictest	0	-21	swapper/1	08:24:06	1
20831	99	73	72	cyclictest	0	-21	swapper/3	08:49:17	3
20831	99	73	72	cyclictest	0	-21	swapper/3	08:29:27	3
20831	99	73	72	cyclictest	0	-21	swapper/3	08:09:30	3
20831	99	73	72	cyclictest	0	-21	swapper/3	07:59:29	3
20831	99	73	72	cyclictest	0	-21	swapper/3	07:44:30	3
20831	99	73	72	cyclictest	0	-21	swapper/3	06:59:28	3
20831	99	73	72	cyclictest	0	-21	swapper/3	06:09:33	3
20831	99	73	72	cyclictest	0	-21	swapper/3	05:09:34	3
20809	99	73	72	cyclictest	0	-21	swapper/1	08:14:19	1
20809	99	73	72	cyclictest	0	-21	swapper/1	07:27:34	1
20809	99	73	72	cyclictest	0	-21	swapper/1	03:46:53	1
20831	99	72	71	cyclictest	0	-21	swapper/3	08:59:27	3
20831	99	72	71	cyclictest	0	-21	swapper/3	07:54:19	3
20831	99	72	71	cyclictest	0	-21	swapper/3	07:42:36	3
20831	99	72	71	cyclictest	0	-21	swapper/3	07:04:31	3
20831	99	72	71	cyclictest	0	-21	swapper/3	06:49:22	3
20831	99	72	71	cyclictest	0	-21	swapper/3	04:54:29	3
20831	99	72	71	cyclictest	0	-21	swapper/3	04:11:57	3
20809	99	72	71	cyclictest	30220	-21	tune2fs	07:49:21	1
20809	99	72	71	cyclictest	30220	-21	tune2fs	07:49:21	1
20809	99	72	71	cyclictest	12535	-21	aten2.4-expect	07:09:23	1
20809	99	72	71	cyclictest	0	-21	swapper/1	06:22:26	1
20809	99	72	71	cyclictest	0	-21	swapper/1	06:22:26	1
20809	99	72	71	cyclictest	0	-21	swapper/1	05:42:20	1
20831	99	69	68	cyclictest	0	-21	swapper/3	08:34:21	3
20809	99	69	68	cyclictest	0	-21	swapper/1	05:29:25	1
20809	99	69	68	cyclictest	0	-21	swapper/1	04:14:25	1
20809	99	67	66	cyclictest	0	-21	swapper/1	09:09:17	1
20831	99	66	64	cyclictest	1721	-21	munin-node	04:14:27	3
20831	99	64	63	cyclictest	0	-21	swapper/3	09:04:27	3
20831	99	64	63	cyclictest	0	-21	swapper/3	07:14:30	3
20831	99	64	62	cyclictest	0	-21	swapper/3	03:59:38	3
20809	99	64	62	cyclictest	0	-21	swapper/1	08:59:20	1
20831	99	63	62	cyclictest	0	-21	swapper/3	08:54:19	3
20831	99	63	62	cyclictest	0	-21	swapper/3	08:24:20	3
20831	99	63	62	cyclictest	0	-21	swapper/3	08:04:20	3
20831	99	63	62	cyclictest	0	-21	swapper/3	07:09:09	3
20831	99	63	62	cyclictest	0	-21	swapper/3	06:54:21	3
20831	99	63	62	cyclictest	0	-21	swapper/3	06:24:24	3
20831	99	63	62	cyclictest	0	-21	swapper/3	05:34:26	3
20831	99	63	62	cyclictest	0	-21	swapper/3	05:24:23	3
20831	99	63	62	cyclictest	0	-21	swapper/3	05:19:26	3
20831	99	63	62	cyclictest	0	-21	swapper/3	05:04:25	3
20831	99	63	62	cyclictest	0	-21	swapper/3	04:34:29	3
20831	99	63	62	cyclictest	0	-21	swapper/3	04:04:28	3
20809	99	63	62	cyclictest	0	-21	swapper/1	08:24:20	1
20809	99	63	62	cyclictest	0	-21	swapper/1	07:39:09	1
20809	99	63	62	cyclictest	0	-21	swapper/1	07:14:21	1
20809	99	63	62	cyclictest	0	-21	swapper/1	05:34:16	1
20809	99	63	62	cyclictest	0	-21	swapper/1	04:54:27	1
20809	99	63	62	cyclictest	0	-21	swapper/1	04:19:16	1
20809	99	63	62	cyclictest	0	-21	swapper/1	04:09:16	1
20809	99	63	62	cyclictest	0	-21	swapper/1	03:59:16	1
20809	99	63	62	cyclictest	0	-21	swapper/1	03:44:17	1
20809	99	63	51	cyclictest	0	-21	swapper/1	08:04:20	1
20801	99	62	61	cyclictest	0	-21	swapper/0	06:35:34	0
20821	99	58	57	cyclictest	0	-21	swapper/2	06:49:22	2
20801	99	57	50	cyclictest	0	-21	swapper/0	05:46:34	0
20821	99	54	52	cyclictest	50	50	irq/44-ahci	08:23:24	2
20821	99	54	52	cyclictest	50	50	irq/44-ahci	07:34:08	2
20821	99	54	51	cyclictest	0	-21	swapper/2	08:44:41	2
20821	99	54	41	cyclictest	0	-21	swapper/2	07:15:43	2
20821	99	54	41	cyclictest	0	-21	swapper/2	04:33:53	2
20801	99	54	53	cyclictest	0	-21	swapper/0	08:54:41	0
20831	99	53	52	cyclictest	0	-21	swapper/3	03:44:17	3
20821	99	53	52	cyclictest	275	-21	usb-storage	07:44:05	2
20821	99	53	52	cyclictest	275	-21	usb-storage	07:19:42	2
20821	99	53	52	cyclictest	275	-21	usb-storage	05:32:54	2
20821	99	53	52	cyclictest	0	-21	swapper/2	08:59:18	2
20821	99	53	52	cyclictest	0	-21	swapper/2	08:56:05	2
20821	99	53	52	cyclictest	0	-21	swapper/2	08:36:51	2
20821	99	53	52	cyclictest	0	-21	swapper/2	07:50:05	2
20821	99	53	52	cyclictest	0	-21	swapper/2	07:50:05	2
20821	99	53	52	cyclictest	0	-21	swapper/2	06:59:19	2
20821	99	53	52	cyclictest	0	-21	swapper/2	06:55:37	2
20821	99	53	52	cyclictest	0	-21	swapper/2	06:14:23	2
20821	99	53	52	cyclictest	0	-21	swapper/2	05:24:23	2
20821	99	53	51	cyclictest	5940	-21	telnet	05:39:24	2
20821	99	53	51	cyclictest	50	50	irq/44-ahci	08:16:00	2
20821	99	53	51	cyclictest	50	50	irq/44-ahci	05:35:22	2
20821	99	53	51	cyclictest	50	50	irq/44-ahci	03:45:04	2
20821	99	53	51	cyclictest	3681	-21	telnet	04:19:26	2
20821	99	53	51	cyclictest	31990	-21	telnet	06:39:24	2
20821	99	53	51	cyclictest	31735	-21	telnet	04:09:29	2
20821	99	53	51	cyclictest	27600	-21	telnet	06:29:22	2
20821	99	53	51	cyclictest	275	-21	usb-storage	06:36:18	2
20821	99	53	51	cyclictest	275	-21	usb-storage	06:19:31	2
20821	99	53	51	cyclictest	275	-21	usb-storage	06:19:31	2
20821	99	53	51	cyclictest	275	-21	usb-storage	06:11:03	2
20821	99	53	51	cyclictest	275	-21	usb-storage	05:44:50	2
20821	99	53	51	cyclictest	27474	-21	telnet	03:59:29	2
20821	99	53	51	cyclictest	26834	-21	kworker/2:2	04:08:54	2
20821	99	53	51	cyclictest	25428	-21	telnet	06:24:24	2
20821	99	53	51	cyclictest	18929	-21	telnet	04:54:27	2
20821	99	53	51	cyclictest	16812	-21	telnet	06:04:25	2
20821	99	53	51	cyclictest	1586	-21	telnet	06:44:22	2
20821	99	53	51	cyclictest	12455	-21	telnet	05:54:21	2
20821	99	53	51	cyclictest	10214	-21	telnet	04:34:26	2
20821	99	53	51	cyclictest	0	-21	swapper/2	08:09:14	2
20821	99	53	41	cyclictest	0	-21	swapper/2	09:09:17	2
20821	99	53	41	cyclictest	0	-21	swapper/2	09:04:18	2
20821	99	53	41	cyclictest	0	-21	swapper/2	08:49:16	2
20821	99	53	41	cyclictest	0	-21	swapper/2	08:29:17	2
20821	99	53	41	cyclictest	0	-21	swapper/2	08:24:17	2
20821	99	53	41	cyclictest	0	-21	swapper/2	07:44:19	2
20821	99	53	41	cyclictest	0	-21	swapper/2	07:24:22	2
20821	99	53	41	cyclictest	0	-21	swapper/2	07:04:27	2
20821	99	53	41	cyclictest	0	-21	swapper/2	05:09:26	2
20821	99	53	41	cyclictest	0	-21	swapper/2	05:04:26	2
20821	99	53	41	cyclictest	0	-21	swapper/2	04:44:26	2
20821	99	53	41	cyclictest	0	-21	swapper/2	04:44:26	2
20801	99	53	52	cyclictest	745	50	irq/18-parport0	05:26:55	0
20801	99	53	52	cyclictest	0	-21	swapper/0	07:39:20	0
20801	99	53	52	cyclictest	0	-21	swapper/0	03:59:28	0
20821	99	52	51	cyclictest	50	50	irq/44-ahci	07:34:26	2
20821	99	52	51	cyclictest	29689	-21	telnet	05:19:26	2
20821	99	52	51	cyclictest	275	-21	usb-storage	06:00:29	2
20821	99	52	51	cyclictest	1705	-21	telnet	07:59:20	2
20821	99	52	51	cyclictest	0	-21	swapper/2	08:40:15	2
20821	99	52	51	cyclictest	0	-21	swapper/2	08:05:25	2
20821	99	52	51	cyclictest	0	-21	swapper/2	07:58:21	2
20821	99	52	51	cyclictest	0	-21	swapper/2	07:10:13	2
20821	99	52	51	cyclictest	0	-21	swapper/2	05:50:46	2
20821	99	52	51	cyclictest	0	-21	swapper/2	05:14:48	2
20821	99	52	51	cyclictest	0	-21	swapper/2	05:00:54	2
20821	99	52	51	cyclictest	0	-21	swapper/2	04:50:00	2
20821	99	52	51	cyclictest	0	-21	swapper/2	04:39:16	2
20821	99	52	51	cyclictest	0	-21	swapper/2	04:25:19	2
20821	99	52	51	cyclictest	0	-21	swapper/2	04:14:17	2
20821	99	52	51	cyclictest	0	-21	swapper/2	03:55:14	2
20821	99	52	51	cyclictest	0	-21	swapper/2	03:49:50	2
20801	99	52	51	cyclictest	1290	50	irq/46-eth0	07:24:21	0
20801	99	52	51	cyclictest	0	-21	swapper/0	09:10:14	0
20801	99	52	51	cyclictest	0	-21	swapper/0	09:04:30	0
20801	99	52	51	cyclictest	0	-21	swapper/0	08:48:23	0
20801	99	52	51	cyclictest	0	-21	swapper/0	08:34:54	0
20801	99	52	51	cyclictest	0	-21	swapper/0	08:29:17	0
20801	99	52	51	cyclictest	0	-21	swapper/0	08:24:54	0
20801	99	52	51	cyclictest	0	-21	swapper/0	08:19:12	0
20801	99	52	51	cyclictest	0	-21	swapper/0	08:17:12	0
20801	99	52	51	cyclictest	0	-21	swapper/0	08:12:25	0
20801	99	52	51	cyclictest	0	-21	swapper/0	08:06:03	0
20801	99	52	51	cyclictest	0	-21	swapper/0	07:59:15	0
20801	99	52	51	cyclictest	0	-21	swapper/0	07:56:29	0
20801	99	52	51	cyclictest	0	-21	swapper/0	07:49:19	0
20801	99	52	51	cyclictest	0	-21	swapper/0	07:49:19	0
20801	99	52	51	cyclictest	0	-21	swapper/0	07:36:52	0
20801	99	52	51	cyclictest	0	-21	swapper/0	07:32:23	0
20801	99	52	51	cyclictest	0	-21	swapper/0	07:19:22	0
20801	99	52	51	cyclictest	0	-21	swapper/0	07:14:37	0
20801	99	52	51	cyclictest	0	-21	swapper/0	07:10:59	0
20801	99	52	51	cyclictest	0	-21	swapper/0	07:05:45	0
20801	99	52	51	cyclictest	0	-21	swapper/0	07:02:47	0
20801	99	52	51	cyclictest	0	-21	swapper/0	06:55:07	0
20801	99	52	51	cyclictest	0	-21	swapper/0	06:50:49	0
20801	99	52	51	cyclictest	0	-21	swapper/0	06:44:48	0
20801	99	52	51	cyclictest	0	-21	swapper/0	06:39:28	0
20801	99	52	51	cyclictest	0	-21	swapper/0	06:27:34	0
20801	99	52	51	cyclictest	0	-21	swapper/0	06:19:55	0
20801	99	52	51	cyclictest	0	-21	swapper/0	06:19:55	0
20801	99	52	51	cyclictest	0	-21	swapper/0	06:14:57	0
20801	99	52	51	cyclictest	0	-21	swapper/0	06:14:01	0
20801	99	52	51	cyclictest	0	-21	swapper/0	06:04:49	0
20801	99	52	51	cyclictest	0	-21	swapper/0	05:59:49	0
20801	99	52	51	cyclictest	0	-21	swapper/0	05:54:46	0
20801	99	52	51	cyclictest	0	-21	swapper/0	05:49:38	0
20801	99	52	51	cyclictest	0	-21	swapper/0	05:43:48	0
20801	99	52	51	cyclictest	0	-21	swapper/0	05:37:22	0
20801	99	52	51	cyclictest	0	-21	swapper/0	05:30:00	0
20801	99	52	51	cyclictest	0	-21	swapper/0	05:20:09	0
20801	99	52	51	cyclictest	0	-21	swapper/0	05:15:37	0
20801	99	52	51	cyclictest	0	-21	swapper/0	05:11:49	0
20801	99	52	51	cyclictest	0	-21	swapper/0	05:05:14	0
20801	99	52	51	cyclictest	0	-21	swapper/0	04:54:36	0
20801	99	52	51	cyclictest	0	-21	swapper/0	04:50:04	0
20801	99	52	51	cyclictest	0	-21	swapper/0	04:48:38	0
20801	99	52	51	cyclictest	0	-21	swapper/0	04:48:38	0
20801	99	52	51	cyclictest	0	-21	swapper/0	04:40:54	0
20801	99	52	51	cyclictest	0	-21	swapper/0	04:36:01	0
20801	99	52	51	cyclictest	0	-21	swapper/0	04:29:43	0
20801	99	52	51	cyclictest	0	-21	swapper/0	04:25:21	0
20801	99	52	51	cyclictest	0	-21	swapper/0	04:19:31	0
20801	99	52	51	cyclictest	0	-21	swapper/0	04:09:54	0
20801	99	52	51	cyclictest	0	-21	swapper/0	04:05:08	0
20801	99	52	51	cyclictest	0	-21	swapper/0	03:54:56	0
20801	99	52	51	cyclictest	0	-21	swapper/0	03:52:32	0
20801	99	52	51	cyclictest	0	-21	swapper/0	03:44:28	0
20801	99	52	31	cyclictest	0	-21	swapper/0	04:18:01	0
20801	99	51	50	cyclictest	0	-21	swapper/0	06:31:00	0
20801	99	50	48	cyclictest	0	-21	swapper/0	08:39:41	0
20801	99	49	48	cyclictest	0	-21	swapper/0	08:51:49	0
20801	99	48	41	cyclictest	0	-21	swapper/0	09:00:15	0
20801	99	44	26	cyclictest	0	-21	swapper/0	05:00:42	0
20801	99	42	41	cyclictest	0	-21	swapper/0	07:44:19	0
20821	99	32	31	cyclictest	0	-21	swapper/2	03:44:17	2
20801	99	32	31	cyclictest	0	-21	swapper/0	03:44:17	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17