OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Tue Sep 22, 2026 12:44:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1798363	99	101	94,5	cyclictest	1947301	-21	kworker/u4:4+events_unbound	11:30:03	0
1798363	99	96	86,7	cyclictest	1836013	-21	kworker/u4:18+events_unbound	09:19:40	0
1798363	99	87	75,9	cyclictest	53	-21	kswapd0	11:55:07	0
1798363	99	84	75,6	cyclictest	15	1	ktimers/0	10:46:47	0
1798364	99	83	77,3	cyclictest	1938243	-21	kworker/u4:12+events_unbound	11:25:02	1
1798363	99	82	65,13	cyclictest	53	-21	kswapd0	11:00:11	0
1798363	99	81	72,6	cyclictest	1840637	-21	kworker/u4:9+events_unbound	09:34:42	0
1798363	99	81	69,7	cyclictest	256	50	irq/23-42890000.ethernet	10:30:38	0
1798363	99	79	69,6	cyclictest	0	-21	swapper/0	09:45:10	0
1798363	99	74	57,15	cyclictest	1925406	-21	kworker/u4:10+events_unbound	10:59:56	0
1798364	99	72	30,38	cyclictest	0	-21	swapper/1	09:15:44	1
1798363	99	71	7,24	cyclictest	1963965	-21	ssh	11:40:28	0
1798364	99	70	37,31	cyclictest	1909587	-21	latency_hist	10:40:02	1
1798364	99	67	36,29	cyclictest	1893160	-21	mailstats	10:20:39	1
1798364	99	67	30,34	cyclictest	0	-21	swapper/1	10:05:28	1
1798364	99	67	27,37	cyclictest	1807969	-21	kernelversion	07:45:23	1
1798364	99	66	53,10	cyclictest	1829090	-21	diskmemload	09:45:08	1
1798364	99	66	36,27	cyclictest	1856273	-21	idleruntime-cro	09:40:01	1
1798364	99	66	32,32	cyclictest	1941310	-21	fschecks_time	11:15:19	1
1798364	99	66	31,31	cyclictest	0	-21	swapper/1	11:05:35	1
1798363	99	66	59,5	cyclictest	1817571	-21	kworker/u4:7+events_unbound	08:49:37	0
1798363	99	66	55,8	cyclictest	53	-21	kswapd0	11:55:01	0
1798363	99	66	55,8	cyclictest	53	-21	kswapd0	11:55:00	0
1798363	99	66	47,16	cyclictest	1934405	-21	kworker/u4:7+events_unbound	11:15:00	0
1798363	99	66	47,16	cyclictest	1934405	-21	kworker/u4:7+events_unbound	11:14:59	0
1798364	99	65	33,29	cyclictest	2013530	-21	/usr/sbin/munin	12:35:41	1
1798364	99	65	33,28	cyclictest	0	-21	swapper/1	09:55:20	1
1798364	99	65	30,31	cyclictest	0	-21	swapper/1	11:10:16	1
1798364	99	65	30,31	cyclictest	0	-21	swapper/1	11:10:16	1
1798364	99	65	29,32	cyclictest	0	-21	swapper/1	10:10:42	1
1798363	99	65	56,6	cyclictest	15	1	ktimers/0	12:27:00	0
1798363	99	65	48,6	cyclictest	1803428	-21	kworker/u4:10+events_unbound	08:39:35	0
1798363	99	65	47,10	cyclictest	1817592	-21	modprobe	08:25:01	0
1798364	99	64	37,25	cyclictest	1815891	-21	ps	08:15:36	1
1798364	99	64	33,28	cyclictest	0	-21	swapper/1	11:55:44	1
1798364	99	64	30,31	cyclictest	1990234	-21	fschecks_time	12:10:20	1
1798363	99	64	56,6	cyclictest	1827777	-21	kworker/u4:6+events_unbound	09:15:00	0
1798363	99	64	50,6	cyclictest	1849840	-21	kworker/u4:7+events_unbound	10:04:48	0
1798364	99	63	30,29	cyclictest	0	-21	swapper/1	09:40:19	1
1798364	99	63	26,34	cyclictest	0	-21	swapper/1	11:00:43	1
1798364	99	63	21,7	cyclictest	0	-21	swapper/1	08:35:37	1
1798363	99	63	55,6	cyclictest	1803428	-21	kworker/u4:10+events_unbound	07:29:14	0
1798363	99	63	52,6	cyclictest	2005673	-21	kworker/u4:1+events_unbound	12:30:15	0
1798364	99	62	34,26	cyclictest	1805979	-21	systemd	07:39:16	1
1798364	99	62	28,5	cyclictest	1995035	-21	ntp_kernel_err	12:15:26	1
1798364	99	62	24,6	cyclictest	0	-21	swapper/1	12:05:40	1
1798363	99	62	55,5	cyclictest	1804699	-21	kworker/u4:13+events_unbound	08:05:15	0
1798363	99	62	5,49	cyclictest	1892861	-21	ssh	10:20:28	0
1798363	99	62	47,10	cyclictest	1999244	-21	fschecks_time	12:20:18	0
1798364	99	61	27,31	cyclictest	0	-21	swapper/1	10:50:01	1
1798364	99	61	25,4	cyclictest	0	-21	swapper/1	12:00:24	1
1798364	99	60	26,6	cyclictest	0	-21	swapper/1	09:50:39	1
1798364	99	60	26,5	cyclictest	0	-21	swapper/1	11:30:31	1
1798364	99	60	26,31	cyclictest	0	-21	swapper/1	10:00:31	1
1798363	99	60	48,8	cyclictest	1839518	-21	/usr/sbin/munin	09:20:41	0
1798364	99	59	28,28	cyclictest	0	-21	swapper/1	10:30:37	1
1798364	99	59	27,28	cyclictest	0	-21	swapper/1	12:20:31	1
1798364	99	59	26,29	cyclictest	0	-21	swapper/1	12:30:22	1
1798364	99	59	26,28	cyclictest	0	-21	swapper/1	10:40:30	1
1798364	99	59	25,6	cyclictest	0	-21	swapper/1	11:40:17	1
1798364	99	59	25,6	cyclictest	0	-21	swapper/1	11:25:39	1
1798364	99	59	24,7	cyclictest	0	-21	swapper/1	09:30:02	1
1798364	99	59	24,6	cyclictest	0	-21	swapper/1	11:45:21	1
1798364	99	59	24,6	cyclictest	0	-21	swapper/1	09:10:19	1
1798363	99	59	51,6	cyclictest	1951826	-21	kworker/u4:15+events_unbound	11:35:03	0
1798364	99	58	3,20	cyclictest	1847565	-21	ssh	09:30:17	1
1798364	99	58	26,6	cyclictest	0	-21	swapper/1	07:25:20	1
1798364	99	58	26,4	cyclictest	0	-21	swapper/1	08:25:26	1
1798364	99	58	24,5	cyclictest	0	-21	swapper/1	11:54:38	1
1798364	99	58	24,5	cyclictest	0	-21	swapper/1	11:54:38	1
1798364	99	58	23,6	cyclictest	0	-21	swapper/1	11:35:39	1
1798364	99	58	21,9	cyclictest	0	-21	swapper/1	09:05:37	1
1798363	99	58	40,11	cyclictest	1859036	-21	kworker/u4:12-rpciod	10:10:02	0
1798364	99	57	4,16	cyclictest	1839137	-21	ssh	09:20:27	1
1798364	99	57	26,4	cyclictest	0	-21	swapper/1	12:25:34	1
1798364	99	57	25,4	cyclictest	0	-21	swapper/1	08:10:19	1
1798363	99	57	52,4	cyclictest	1794476	-21	kworker/u4:2+events_unbound	08:14:29	0
1798363	99	57	50,5	cyclictest	1885433	-21	kworker/u4:0+events_unbound	10:39:52	0
1798363	99	57	49,6	cyclictest	1946540	-21	timerandwakeup	11:20:43	0
1798364	99	56	27,26	cyclictest	0	-21	swapper/1	07:40:11	1
1798364	99	56	24,6	cyclictest	0	-21	swapper/1	10:55:40	1
1798364	99	56	23,5	cyclictest	0	-21	swapper/1	10:50:28	1
1798364	99	55	26,4	cyclictest	0	-21	swapper/1	08:50:37	1
1798364	99	55	24,5	cyclictest	0	-21	swapper/1	09:00:16	1
1798364	99	55	23,6	cyclictest	0	-21	swapper/1	07:20:20	1
1798364	99	55	22,6	cyclictest	0	-21	swapper/1	08:25:02	1
1798364	99	55	20,9	cyclictest	0	-21	swapper/1	07:15:39	1
1798363	99	55	34,18	cyclictest	1938242	-21	kworker/u4:11-rpciod	11:20:00	0
1798364	99	54	22,6	cyclictest	0	-21	swapper/1	08:35:00	1
1798364	99	54	22,5	cyclictest	0	-21	swapper/1	07:55:22	1
1798364	99	54	18,7	cyclictest	1822832	-21	latency_hist	08:45:02	1
1798363	99	54	45,7	cyclictest	1800869	-21	systemd	07:19:09	0
1798363	99	54	42,9	cyclictest	0	-21	swapper/0	09:40:19	0
1798363	99	53	9,36	cyclictest	256	50	irq/23-42890000.ethernet	10:25:33	0
1798363	99	51	43,6	cyclictest	1852466	-21	/usr/sbin/munin	09:35:21	0
1798363	99	51	39,8	cyclictest	0	-21	swapper/0	09:55:28	0
1798363	99	51	33,16	cyclictest	0	-21	swapper/0	12:15:28	0
1798364	99	50	36,9	cyclictest	0	-21	swapper/1	10:15:25	1
1798363	99	50	42,6	cyclictest	1849840	-21	kworker/u4:7+events_unbound	10:10:03	0
1798363	99	50	41,5	cyclictest	1866072	-21	/usr/sbin/munin	09:50:25	0
1798363	99	50	40,8	cyclictest	1987989	-21	kworker/u4:6+events_unbound	12:10:03	0
1798363	99	50	35,10	cyclictest	1809826	-21	modprobe	07:55:01	0
1798363	99	49	43,4	cyclictest	1971959	-21	latency_hist	11:50:02	0
1798363	99	49	26,8	cyclictest	1953953	-21	cron	11:30:00	0
1798363	99	49	26,20	cyclictest	1810297	-21	fschecks_time	07:55:20	0
1798364	99	48	39,6	cyclictest	1896821	-21	df_abs	10:25:17	1
1798364	99	48	20,4	cyclictest	1802158	-21	kworker/u4:9-rpciod	08:45:15	1
1798363	99	48	39,6	cyclictest	1845228	-21	kworker/u4:4-rpciod	09:30:01	0
1798363	99	48	31,15	cyclictest	1786877	-21	kworker/u4:12+events_unbound	09:00:00	0
1798363	99	47	39,5	cyclictest	1805260	-21	gltestperf	07:35:21	0
1798363	99	47	1,4	cyclictest	53	-21	kswapd0	10:50:16	0
1798364	99	46	37,6	cyclictest	1813066	-21	gltestperf	08:05:25	1
1798363	99	46	4,33	cyclictest	1888622	-21	ssh	10:15:39	0
1798363	99	46	39,5	cyclictest	2013688	-21	unixbench_multi	12:35:41	0
1798363	99	46	39,5	cyclictest	1981678	-21	/usr/sbin/munin	12:00:24	0
1798363	99	46	39,5	cyclictest	1811620	-21	fschecks_time	08:00:21	0
1798363	99	46	24,14	cyclictest	256	50	irq/23-42890000.ethernet	11:05:15	0
1798363	99	44	36,4	cyclictest	0	-21	swapper/0	07:20:38	0
1798363	99	44	35,6	cyclictest	1807565	-21	aten_r7power_po	07:45:18	0
1798363	99	44	35,6	cyclictest	1802158	-21	kworker/u4:9-rpciod	08:20:01	0
1798363	99	44	34,7	cyclictest	1828273	-21	fschecks_time	09:05:19	0
1798363	99	44	2,32	cyclictest	1910753	-21	ps	10:40:34	0
1798364	99	43	38,3	cyclictest	1809804	-21	kworker/u4:11+events_unbound	07:54:21	1
1798364	99	43	34,7	cyclictest	1804709	-21	systemd	07:34:14	1
1798364	99	42	34,5	cyclictest	1811999	-21	proc_pri	08:00:36	1
1798363	99	42	32,7	cyclictest	0	-21	swapper/0	12:05:29	0
1798363	99	42	32,6	cyclictest	1797002	-21	kworker/u4:3-rpciod	07:40:35	0
1798363	99	42	30,7	cyclictest	0	-21	swapper/0	08:40:39	0
1798364	99	41	33,6	cyclictest	1798827	-21	fschecks_time	07:10:20	1
1798363	99	41	32,7	cyclictest	1827808	-21	cron	09:05:00	0
1798363	99	41	18,21	cyclictest	1798577	-21	aten_r7power_en	07:10:15	0
1798363	99	40	29,7	cyclictest	0	-21	swapper/0	08:25:15	0
1798363	99	40	16,20	cyclictest	1819363	-21	fschecks_time	08:30:20	0
1798364	99	39	31,5	cyclictest	0	-21	swapper/1	08:55:25	1
1798363	99	39	31,5	cyclictest	1803429	-21	kworker/u4:11-rpciod	07:30:39	0
1798363	99	37	28,7	cyclictest	1825075	-21	sed	08:50:39	0
1798364	99	34	25,7	cyclictest	0	-21	swapper/1	07:10:01	1
1798363	99	32	23,7	cyclictest	0	-21	swapper/0	07:10:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17