OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 376 highest latencies:

System rack3slot1.osadl.org (updated Sat May 09, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
19742	99	114	92	cyclictest	26950	-21	fschecks_time	06:34:51	3
19742	99	106	102	cyclictest	0	-21	swapper/3	09:19:53	3
19742	99	105	102	cyclictest	0	-21	swapper/3	09:04:51	3
19723	99	103	102	cyclictest	0	-21	swapper/1	08:44:54	1
19742	99	97	82	cyclictest	0	-21	swapper/3	08:24:45	3
19742	99	97	82	cyclictest	0	-21	swapper/3	06:14:51	3
19742	99	96	92	cyclictest	0	-21	swapper/3	06:44:52	3
19742	99	96	82	cyclictest	0	-21	swapper/3	07:52:36	3
19742	99	93	92	cyclictest	0	-21	swapper/3	09:44:46	3
19742	99	93	92	cyclictest	0	-21	swapper/3	07:39:49	3
19742	99	93	92	cyclictest	0	-21	swapper/3	07:29:51	3
19742	99	89	72	cyclictest	0	-21	swapper/3	10:19:44	3
19742	99	89	72	cyclictest	0	-21	swapper/3	07:44:48	3
19742	99	88	72	cyclictest	0	-21	swapper/3	10:14:40	3
19742	99	88	72	cyclictest	0	-21	swapper/3	09:24:50	3
19742	99	88	72	cyclictest	0	-21	swapper/3	08:39:46	3
19742	99	88	72	cyclictest	0	-21	swapper/3	06:54:51	3
19742	99	87	82	cyclictest	0	-21	swapper/3	08:54:46	3
19742	99	87	82	cyclictest	0	-21	swapper/3	08:19:50	3
19742	99	87	82	cyclictest	0	-21	swapper/3	08:12:54	3
19742	99	87	82	cyclictest	0	-21	swapper/3	07:34:52	3
19742	99	87	82	cyclictest	0	-21	swapper/3	07:14:51	3
19742	99	87	82	cyclictest	0	-21	swapper/3	07:04:51	3
19742	99	87	82	cyclictest	0	-21	swapper/3	06:39:51	3
19742	99	87	82	cyclictest	0	-21	swapper/3	06:24:53	3
19742	99	87	82	cyclictest	0	-21	swapper/3	05:49:40	3
19742	99	87	82	cyclictest	0	-21	swapper/3	05:20:04	3
19742	99	87	82	cyclictest	0	-21	swapper/3	05:14:55	3
19742	99	87	82	cyclictest	0	-21	swapper/3	05:14:55	3
19742	99	87	82	cyclictest	0	-21	swapper/3	05:04:55	3
19742	99	87	71	cyclictest	0	-21	swapper/3	07:24:49	3
19742	99	87	71	cyclictest	0	-21	swapper/3	05:29:54	3
19742	99	86	82	cyclictest	0	-21	swapper/3	10:24:42	3
19742	99	86	82	cyclictest	0	-21	swapper/3	10:09:44	3
19742	99	86	82	cyclictest	0	-21	swapper/3	09:55:30	3
19742	99	86	82	cyclictest	0	-21	swapper/3	09:09:45	3
19742	99	86	82	cyclictest	0	-21	swapper/3	08:49:46	3
19742	99	86	82	cyclictest	0	-21	swapper/3	07:59:49	3
19742	99	86	82	cyclictest	0	-21	swapper/3	07:54:51	3
19742	99	86	82	cyclictest	0	-21	swapper/3	07:10:00	3
19742	99	86	82	cyclictest	0	-21	swapper/3	06:30:02	3
19742	99	86	82	cyclictest	0	-21	swapper/3	06:04:50	3
19742	99	86	82	cyclictest	0	-21	swapper/3	06:00:04	3
19742	99	86	82	cyclictest	0	-21	swapper/3	05:54:56	3
19742	99	86	82	cyclictest	0	-21	swapper/3	05:49:40	3
19742	99	86	82	cyclictest	0	-21	swapper/3	05:24:59	3
19742	99	86	81	cyclictest	478	-21	kjournald	10:34:29	3
19742	99	86	81	cyclictest	0	-21	swapper/3	09:59:45	3
19742	99	86	71	cyclictest	0	-21	swapper/3	10:04:47	3
19742	99	86	71	cyclictest	0	-21	swapper/3	09:39:49	3
19742	99	86	71	cyclictest	0	-21	swapper/3	09:34:48	3
19742	99	86	71	cyclictest	0	-21	swapper/3	09:14:47	3
19742	99	85	82	cyclictest	0	-21	swapper/3	09:49:44	3
19742	99	85	82	cyclictest	0	-21	swapper/3	09:29:51	3
19742	99	85	82	cyclictest	0	-21	swapper/3	08:59:52	3
19742	99	85	82	cyclictest	0	-21	swapper/3	08:44:45	3
19742	99	85	82	cyclictest	0	-21	swapper/3	08:34:47	3
19742	99	85	82	cyclictest	0	-21	swapper/3	08:14:49	3
19742	99	85	82	cyclictest	0	-21	swapper/3	08:04:49	3
19742	99	85	82	cyclictest	0	-21	swapper/3	07:19:53	3
19742	99	85	82	cyclictest	0	-21	swapper/3	06:49:49	3
19742	99	85	82	cyclictest	0	-21	swapper/3	06:19:53	3
19742	99	85	82	cyclictest	0	-21	swapper/3	06:12:22	3
19742	99	85	82	cyclictest	0	-21	swapper/3	05:42:05	3
19742	99	83	82	cyclictest	0	-21	swapper/3	05:12:12	3
19742	99	83	61	cyclictest	0	-21	swapper/3	06:59:50	3
19723	99	83	82	cyclictest	0	-21	swapper/1	10:34:29	1
19723	99	83	82	cyclictest	0	-21	swapper/1	10:24:46	1
19723	99	83	82	cyclictest	0	-21	swapper/1	10:14:47	1
19723	99	83	82	cyclictest	0	-21	swapper/1	10:04:47	1
19723	99	83	82	cyclictest	0	-21	swapper/1	09:59:52	1
19723	99	83	82	cyclictest	0	-21	swapper/1	09:49:51	1
19723	99	83	82	cyclictest	0	-21	swapper/1	09:44:46	1
19723	99	83	82	cyclictest	0	-21	swapper/1	09:39:51	1
19723	99	83	82	cyclictest	0	-21	swapper/1	09:34:43	1
19723	99	83	82	cyclictest	0	-21	swapper/1	09:24:52	1
19723	99	83	82	cyclictest	0	-21	swapper/1	09:14:52	1
19723	99	83	82	cyclictest	0	-21	swapper/1	09:09:53	1
19723	99	83	82	cyclictest	0	-21	swapper/1	08:19:56	1
19723	99	83	82	cyclictest	0	-21	swapper/1	08:04:57	1
19723	99	83	82	cyclictest	0	-21	swapper/1	07:54:44	1
19723	99	83	82	cyclictest	0	-21	swapper/1	07:47:36	1
19723	99	83	82	cyclictest	0	-21	swapper/1	07:39:56	1
19723	99	83	82	cyclictest	0	-21	swapper/1	07:19:48	1
19723	99	83	82	cyclictest	0	-21	swapper/1	07:14:37	1
19723	99	83	82	cyclictest	0	-21	swapper/1	06:59:59	1
19723	99	83	82	cyclictest	0	-21	swapper/1	06:34:58	1
19723	99	83	82	cyclictest	0	-21	swapper/1	05:59:55	1
19723	99	83	82	cyclictest	0	-21	swapper/1	05:54:54	1
19723	99	83	82	cyclictest	0	-21	swapper/1	05:30:01	1
19723	99	83	82	cyclictest	0	-21	swapper/1	05:24:59	1
19723	99	83	82	cyclictest	0	-21	swapper/1	05:05:02	1
19723	99	83	81	cyclictest	9789	-21	tune2fs	08:24:47	1
19723	99	83	81	cyclictest	3364	-21	tune2fs	05:39:54	1
19723	99	83	81	cyclictest	31572	-21	tune2fs	07:59:49	1
19723	99	83	81	cyclictest	3149	-21	tune2fs	06:54:51	1
19723	99	83	81	cyclictest	27428	-21	tune2fs	10:19:45	1
19723	99	83	81	cyclictest	26912	-21	tune2fs	07:49:50	1
19723	99	83	81	cyclictest	22560	-21	tune2fs	05:09:55	1
19723	99	83	81	cyclictest	22539	-21	aten2.4-expect	10:09:40	1
19723	99	83	81	cyclictest	15814	-21	aten2.4-expect	07:24:48	1
19723	99	83	71	cyclictest	18584	-21	tune2fs	07:29:51	1
19723	99	81	80	cyclictest	0	-21	swapper/1	08:19:15	1
19742	99	77	61	cyclictest	0	-21	swapper/3	08:29:56	3
19742	99	77	61	cyclictest	0	-21	swapper/3	05:34:53	3
19723	99	75	73	cyclictest	22689	-21	tune2fs	06:24:52	1
19723	99	75	73	cyclictest	18259	-21	tune2fs	06:14:53	1
19723	99	74	73	cyclictest	0	-21	swapper/1	07:15:32	1
19723	99	73	72	cyclictest	0	-21	swapper/1	09:19:51	1
19723	99	73	72	cyclictest	0	-21	swapper/1	09:04:46	1
19723	99	73	72	cyclictest	0	-21	swapper/1	09:00:32	1
19723	99	73	72	cyclictest	0	-21	swapper/1	08:57:44	1
19723	99	73	72	cyclictest	0	-21	swapper/1	08:35:45	1
19723	99	73	72	cyclictest	0	-21	swapper/1	08:29:51	1
19723	99	73	72	cyclictest	0	-21	swapper/1	07:36:05	1
19723	99	73	72	cyclictest	0	-21	swapper/1	07:08:24	1
19723	99	73	72	cyclictest	0	-21	swapper/1	06:49:48	1
19723	99	73	72	cyclictest	0	-21	swapper/1	06:44:56	1
19723	99	73	72	cyclictest	0	-21	swapper/1	06:39:51	1
19723	99	73	72	cyclictest	0	-21	swapper/1	06:32:25	1
19723	99	73	72	cyclictest	0	-21	swapper/1	06:04:57	1
19723	99	73	72	cyclictest	0	-21	swapper/1	05:53:18	1
19723	99	73	72	cyclictest	0	-21	swapper/1	05:38:15	1
19723	99	73	72	cyclictest	0	-21	swapper/1	05:23:03	1
19723	99	73	72	cyclictest	0	-21	swapper/1	05:16:06	1
19723	99	73	72	cyclictest	0	-21	swapper/1	05:16:06	1
19723	99	73	71	cyclictest	20050	-21	aten2.4-expect	06:19:52	1
19723	99	72	71	cyclictest	0	-21	swapper/1	05:45:01	1
19723	99	66	62	cyclictest	0	-21	swapper/1	09:54:44	1
19733	99	65	60	cyclictest	0	-21	swapper/2	10:32:47	2
19733	99	65	60	cyclictest	0	-21	swapper/2	10:27:02	2
19723	99	65	64	cyclictest	0	-21	swapper/1	09:34:31	1
19723	99	65	62	cyclictest	0	-21	swapper/1	08:39:52	1
19733	99	64	60	cyclictest	0	-21	swapper/2	09:04:35	2
19733	99	64	60	cyclictest	0	-21	swapper/2	07:17:09	2
19733	99	64	60	cyclictest	0	-21	swapper/2	06:32:26	2
19733	99	64	60	cyclictest	0	-21	swapper/2	05:08:14	2
19723	99	63	62	cyclictest	0	-21	swapper/1	08:49:44	1
19723	99	63	62	cyclictest	0	-21	swapper/1	08:09:38	1
19723	99	63	62	cyclictest	0	-21	swapper/1	06:09:51	1
19723	99	63	62	cyclictest	0	-21	swapper/1	05:04:42	1
19733	99	61	54	cyclictest	18	1	ksoftirqd/2	07:44:09	2
19733	99	61	53	cyclictest	18	1	ksoftirqd/2	06:19:24	2
19733	99	60	59	cyclictest	0	-21	swapper/2	09:30:34	2
19733	99	60	52	cyclictest	0	-21	swapper/2	05:36:12	2
19733	99	60	51	cyclictest	18	1	ksoftirqd/2	05:30:02	2
19733	99	60	51	cyclictest	15698	-21	munin-node	07:24:59	2
19714	99	60	41	cyclictest	0	-21	swapper/0	07:12:56	0
19733	99	59	58	cyclictest	0	-21	swapper/2	08:52:06	2
19733	99	59	53	cyclictest	582	-21	telnet	08:04:48	2
19733	99	59	53	cyclictest	26015	-21	kworker/2:0	08:46:54	2
19733	99	59	53	cyclictest	2302	-21	lldpd	05:28:38	2
19733	99	59	53	cyclictest	21987	-21	munin-node	05:09:52	2
19733	99	59	53	cyclictest	18	1	ksoftirqd/2	09:52:48	2
19733	99	59	53	cyclictest	18	1	ksoftirqd/2	09:36:21	2
19733	99	59	53	cyclictest	18	1	ksoftirqd/2	07:02:46	2
19733	99	59	51	cyclictest	21871	-21	runrttasks	06:23:38	2
19733	99	59	43	cyclictest	0	-21	swapper/2	07:34:48	2
19733	99	59	41	cyclictest	0	-21	swapper/2	05:22:46	2
19714	99	59	52	cyclictest	0	-21	swapper/0	08:33:33	0
19733	99	58	56	cyclictest	28929	-21	telnet	09:09:44	2
19733	99	58	53	cyclictest	7209	-21	telnet	08:19:47	2
19733	99	58	53	cyclictest	30873	-21	munin-node	07:59:51	2
19733	99	58	53	cyclictest	18	1	ksoftirqd/2	07:05:21	2
19733	99	58	53	cyclictest	18	1	ksoftirqd/2	05:51:03	2
19733	99	58	53	cyclictest	15612	-21	kworker/2:2	09:00:36	2
19733	99	58	53	cyclictest	13442	-21	munin-node	06:04:58	2
19733	99	58	53	cyclictest	0	-21	swapper/2	09:16:05	2
19733	99	58	52	cyclictest	50	50	irq/44-ahci	08:56:06	2
19733	99	58	52	cyclictest	50	50	irq/44-ahci	06:41:03	2
19733	99	58	52	cyclictest	478	-21	kjournald	09:27:59	2
19733	99	58	52	cyclictest	15767	-21	telnet	06:09:51	2
19733	99	58	52	cyclictest	0	-21	swapper/2	08:34:19	2
19733	99	58	51	cyclictest	18	1	ksoftirqd/2	06:37:49	2
19733	99	58	51	cyclictest	18	1	ksoftirqd/2	05:43:21	2
19733	99	58	51	cyclictest	0	-21	swapper/2	10:04:55	2
19733	99	58	51	cyclictest	0	-21	swapper/2	07:14:26	2
19733	99	58	41	cyclictest	0	-21	swapper/2	08:42:36	2
19733	99	58	41	cyclictest	0	-21	swapper/2	08:09:46	2
19714	99	58	51	cyclictest	0	-21	swapper/0	09:01:24	0
19714	99	58	51	cyclictest	0	-21	swapper/0	07:39:39	0
19742	99	57	41	cyclictest	19819	-21	latency_hist	05:04:42	3
19733	99	57	52	cyclictest	9445	-21	telnet	08:24:45	2
19733	99	57	52	cyclictest	9109	-21	munin-node	05:54:55	2
19733	99	57	52	cyclictest	18	1	ksoftirqd/2	10:19:51	2
19733	99	57	52	cyclictest	18	1	ksoftirqd/2	07:45:05	2
19733	99	57	52	cyclictest	18	1	ksoftirqd/2	06:46:03	2
19733	99	57	52	cyclictest	0	-21	swapper/2	09:59:40	2
19733	99	57	52	cyclictest	0	-21	swapper/2	09:44:43	2
19733	99	57	52	cyclictest	0	-21	swapper/2	06:49:48	2
19733	99	57	52	cyclictest	0	-21	swapper/2	06:24:49	2
19733	99	57	52	cyclictest	0	-21	swapper/2	05:44:52	2
19733	99	57	52	cyclictest	0	-21	swapper/2	05:14:49	2
19733	99	57	52	cyclictest	0	-21	swapper/2	05:14:49	2
19733	99	57	51	cyclictest	675	-21	munin-node	09:19:44	2
19733	99	57	51	cyclictest	5056	-21	telnet	08:14:45	2
19733	99	57	51	cyclictest	50	50	irq/44-ahci	07:55:26	2
19733	99	57	51	cyclictest	2873	-21	telnet	06:54:49	2
19733	99	57	51	cyclictest	18002	-21	telnet	07:29:48	2
19733	99	57	51	cyclictest	15938	-21	munin-node	09:54:48	2
19733	99	57	51	cyclictest	13828	-21	telnet	08:34:44	2
19733	99	57	51	cyclictest	13587	-21	telnet	07:19:48	2
19733	99	57	51	cyclictest	11399	-21	telnet	05:59:53	2
19733	99	57	41	cyclictest	24753	-21	telnet	10:14:38	2
19733	99	57	41	cyclictest	0	-21	swapper/2	07:49:48	2
19714	99	57	49	cyclictest	0	-21	swapper/0	05:39:19	0
19733	99	56	51	cyclictest	9477	-21	munin-node	09:39:44	2
19733	99	56	51	cyclictest	22453	-21	munin-node	10:09:40	2
19714	99	56	49	cyclictest	0	-21	swapper/0	09:08:08	0
19714	99	54	51	cyclictest	0	-21	swapper/0	08:40:09	0
19714	99	53	52	cyclictest	760	50	irq/18-parport0	10:01:48	0
19714	99	53	52	cyclictest	760	50	irq/18-parport0	09:54:46	0
19714	99	53	52	cyclictest	760	50	irq/18-parport0	09:28:25	0
19714	99	53	52	cyclictest	760	50	irq/18-parport0	06:12:54	0
19714	99	53	52	cyclictest	760	50	irq/18-parport0	06:08:12	0
19714	99	53	52	cyclictest	0	-21	swapper/0	08:59:06	0
19714	99	53	52	cyclictest	0	-21	swapper/0	05:59:03	0
19714	99	53	51	cyclictest	50	50	irq/44-ahci	05:20:10	0
19714	99	53	41	cyclictest	0	-21	swapper/0	10:28:11	0
19714	99	53	41	cyclictest	0	-21	swapper/0	10:19:09	0
19714	99	53	41	cyclictest	0	-21	swapper/0	09:46:38	0
19714	99	53	41	cyclictest	0	-21	swapper/0	09:36:03	0
19714	99	53	41	cyclictest	0	-21	swapper/0	08:18:18	0
19714	99	53	41	cyclictest	0	-21	swapper/0	08:09:46	0
19714	99	53	41	cyclictest	0	-21	swapper/0	07:58:50	0
19714	99	53	41	cyclictest	0	-21	swapper/0	07:50:13	0
19714	99	53	41	cyclictest	0	-21	swapper/0	06:46:53	0
19714	99	53	41	cyclictest	0	-21	swapper/0	06:41:03	0
19714	99	52	51	cyclictest	760	50	irq/18-parport0	06:14:40	0
19714	99	52	51	cyclictest	760	50	irq/18-parport0	05:24:50	0
19714	99	52	51	cyclictest	1876	-21	hald-addon-stor	06:00:43	0
19714	99	52	51	cyclictest	0	-21	swapper/0	10:31:04	0
19714	99	52	51	cyclictest	0	-21	swapper/0	10:19:40	0
19714	99	52	51	cyclictest	0	-21	swapper/0	10:09:41	0
19714	99	52	51	cyclictest	0	-21	swapper/0	09:49:40	0
19714	99	52	51	cyclictest	0	-21	swapper/0	09:42:27	0
19714	99	52	51	cyclictest	0	-21	swapper/0	09:30:36	0
19714	99	52	51	cyclictest	0	-21	swapper/0	09:22:47	0
19714	99	52	51	cyclictest	0	-21	swapper/0	09:09:36	0
19714	99	52	51	cyclictest	0	-21	swapper/0	08:34:37	0
19714	99	52	51	cyclictest	0	-21	swapper/0	08:28:37	0
19714	99	52	51	cyclictest	0	-21	swapper/0	08:19:48	0
19714	99	52	51	cyclictest	0	-21	swapper/0	08:05:02	0
19714	99	52	51	cyclictest	0	-21	swapper/0	07:59:36	0
19714	99	52	51	cyclictest	0	-21	swapper/0	07:46:45	0
19714	99	52	51	cyclictest	0	-21	swapper/0	07:35:09	0
19714	99	52	51	cyclictest	0	-21	swapper/0	07:30:17	0
19714	99	52	51	cyclictest	0	-21	swapper/0	07:26:00	0
19714	99	52	51	cyclictest	0	-21	swapper/0	07:21:44	0
19714	99	52	51	cyclictest	0	-21	swapper/0	07:05:18	0
19714	99	52	51	cyclictest	0	-21	swapper/0	07:00:15	0
19714	99	52	51	cyclictest	0	-21	swapper/0	06:56:15	0
19714	99	52	51	cyclictest	0	-21	swapper/0	06:51:49	0
19714	99	52	51	cyclictest	0	-21	swapper/0	06:34:49	0
19714	99	52	51	cyclictest	0	-21	swapper/0	06:32:08	0
19714	99	52	51	cyclictest	0	-21	swapper/0	06:25:09	0
19714	99	52	51	cyclictest	0	-21	swapper/0	05:51:11	0
19714	99	52	51	cyclictest	0	-21	swapper/0	05:41:47	0
19714	99	52	51	cyclictest	0	-21	swapper/0	05:30:54	0
19714	99	52	51	cyclictest	0	-21	swapper/0	05:15:10	0
19714	99	52	51	cyclictest	0	-21	swapper/0	05:15:10	0
19714	99	52	51	cyclictest	0	-21	swapper/0	05:11:39	0
19714	99	52	51	cyclictest	0	-21	swapper/0	05:06:45	0
19714	99	52	41	cyclictest	0	-21	swapper/0	10:04:41	0
19714	99	51	50	cyclictest	0	-21	swapper/0	09:17:35	0
19714	99	51	50	cyclictest	0	-21	swapper/0	08:49:42	0
19714	99	51	50	cyclictest	0	-21	swapper/0	07:14:41	0
19714	99	51	50	cyclictest	0	-21	swapper/0	06:23:43	0
19714	99	51	50	cyclictest	0	-21	swapper/0	05:48:17	0
19714	99	50	49	cyclictest	0	-21	swapper/0	08:44:35	0
19733	99	46	41	cyclictest	0	-21	swapper/2	05:04:42	2
19714	99	42	41	cyclictest	0	-21	swapper/0	05:04:42	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17