OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Thu Aug 13, 2026 00:44:07)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2413192	99	101	88,10	cyclictest	53	-21	kswapd0	23:05:11	0
2413192	99	97	88,6	cyclictest	2478265	-21	kworker/u4:7+events_unbound	22:05:33	0
2413192	99	96	82,10	cyclictest	2473666	-21	kworker/u4:5+events_unbound	21:45:30	0
2413192	99	96	82,10	cyclictest	2473666	-21	kworker/u4:5+events_unbound	21:45:29	0
2413192	99	91	73,6	cyclictest	2594624	-21	kworker/u4:9+events_unbound	23:57:36	0
2413192	99	90	74,12	cyclictest	53	-21	kswapd0	23:35:10	0
2413192	99	87	80,5	cyclictest	2518850	-21	kworker/u4:6+events_unbound	22:35:35	0
2413192	99	81	73,6	cyclictest	2590070	-21	kworker/u4:2+events_unbound	23:52:29	0
2413192	99	76	68,6	cyclictest	2617373	-21	kworker/u4:15+events_unbound	00:23:35	0
2413192	99	75	63,8	cyclictest	2540089	-21	unixbench_multi	22:55:40	0
2413192	99	74	66,6	cyclictest	2446731	-21	kworker/u4:3+events_unbound	21:35:24	0
2413192	99	73	65,6	cyclictest	2563451	-21	kworker/u4:11+events_unbound	23:40:47	0
2413192	99	70	63,5	cyclictest	2523380	-21	kworker/u4:0+events_unbound	23:30:46	0
2413193	99	69	30,18	cyclictest	2615758	-21	ntpq	00:20:41	1
2413193	99	68	31,15	cyclictest	2568273	-21	ssh	23:27:46	1
2413193	99	68	29,14	cyclictest	2482911	-21	ssh	21:52:15	1
2413193	99	68	28,13	cyclictest	2466343	-21	ssh	21:34:32	1
2413193	99	68	27,15	cyclictest	2496799	-21	ssh	22:07:39	1
2413193	99	67	29,11	cyclictest	2489529	-21	ssh	22:00:07	1
2413193	99	67	28,16	cyclictest	2506028	-21	ssh	22:18:03	1
2413193	99	67	28,14	cyclictest	2450399	-21	ssh	21:15:59	1
2413193	99	67	28,13	cyclictest	2562618	-21	ssh	23:20:59	1
2413193	99	67	28,11	cyclictest	2532402	-21	ssh	22:47:24	1
2413193	99	67	28,11	cyclictest	2519258	-21	ssh	22:32:46	1
2413193	99	67	28,11	cyclictest	2489032	-21	ssh	21:59:37	1
2413192	99	67	59,6	cyclictest	2492143	-21	kworker/u4:8+events_unbound	22:05:01	0
2413193	99	66	54,10	cyclictest	2538528	-21	modprobe	22:55:01	1
2413193	99	66	28,14	cyclictest	2479487	-21	ssh	21:48:55	1
2413193	99	66	28,14	cyclictest	2479487	-21	ssh	21:48:54	1
2413193	99	66	28,11	cyclictest	2581750	-21	ssh	23:42:49	1
2413193	99	66	28,10	cyclictest	2469892	-21	ssh	21:38:04	1
2413193	99	66	27,15	cyclictest	2589620	-21	ssh	23:51:12	1
2413193	99	66	27,14	cyclictest	2473061	-21	ssh	21:41:01	1
2413193	99	66	26,15	cyclictest	2586051	-21	ssh	23:47:34	1
2413193	99	66	26,14	cyclictest	2520915	-21	ssh	22:35:06	1
2413193	99	66	26,14	cyclictest	2500667	-21	ssh	22:11:39	1
2413193	99	66	25,15	cyclictest	2545754	-21	ssh	23:02:26	1
2413193	99	66	25,15	cyclictest	2514421	-21	ssh	22:27:11	1
2413192	99	66	60,4	cyclictest	2536317	-21	kworker/u4:4+events_unbound	23:00:41	0
2413193	99	65	32,10	cyclictest	2604547	-21	ssh	00:08:28	1
2413193	99	65	31,10	cyclictest	2438471	-21	ntpq	20:45:33	1
2413193	99	65	27,15	cyclictest	2623401	-21	ssh	00:29:59	1
2413193	99	65	27,11	cyclictest	2560107	-21	ssh	23:19:02	1
2413193	99	65	26,14	cyclictest	2594284	-21	ssh	23:56:30	1
2413193	99	65	26,12	cyclictest	2447656	-21	ssh	21:13:41	1
2413193	99	64	27,11	cyclictest	2630530	-21	ssh	00:37:12	1
2413193	99	64	26,13	cyclictest	2625285	-21	ssh	00:30:59	1
2413193	99	64	26,13	cyclictest	2608145	-21	ssh	00:12:08	1
2413193	99	64	26,11	cyclictest	2434511	-21	ntpq	20:30:30	1
2413193	99	64	25,14	cyclictest	2540299	-21	ssh	22:55:53	1
2413193	99	64	25,14	cyclictest	2460541	-21	ssh	21:27:37	1
2413193	99	64	24,14	cyclictest	2549948	-21	ssh	23:07:10	1
2413193	99	63	27,11	cyclictest	2527980	-21	ssh	22:42:25	1
2413193	99	63	26,15	cyclictest	2509562	-21	ssh	22:21:34	1
2413193	99	63	26,14	cyclictest	2611906	-21	ssh	00:16:02	1
2413193	99	63	26,10	cyclictest	2572224	-21	ssh	23:31:58	1
2413192	99	63	52,7	cyclictest	2413189	-21	cyclictest	20:25:01	0
2413193	99	62	26,13	cyclictest	2455624	-21	ssh	21:22:03	1
2413193	99	62	24,11	cyclictest	2420474	-21	ntpq	19:35:33	1
2413192	99	62	45,6	cyclictest	2581022	-21	kworker/u4:15+events_unbound	23:46:56	0
2413193	99	61	41,15	cyclictest	2421717	-21	ntpq	19:40:32	1
2413193	99	61	26,11	cyclictest	2555173	-21	ssh	23:13:19	1
2413192	99	61	6,53	cyclictest	0	-21	swapper/0	21:20:32	0
2413192	99	61	51,7	cyclictest	2478266	-21	kworker/u4:8+events_unbound	21:50:28	0
2413192	99	60	50,7	cyclictest	2462774	-21	cut	21:30:20	0
2413193	99	59	23,12	cyclictest	2601001	-21	ssh	00:04:52	1
2413193	99	59	23,10	cyclictest	2429389	-21	ntpq	20:10:29	1
2413192	99	59	49,8	cyclictest	2526509	-21	mailstats	22:40:37	0
2413192	99	59	27,22	cyclictest	256	50	irq/23-42890000.ethernet	19:15:13	0
2413193	99	58	24,14	cyclictest	2433330	-21	ntp_states	20:25:31	1
2413192	99	58	51,5	cyclictest	2523380	-21	kworker/u4:0+events_unbound	23:25:44	0
2413192	99	58	50,6	cyclictest	2554330	-21	kworker/u4:6+events_unbound	23:20:01	0
2413192	99	58	49,7	cyclictest	2455953	-21	kworker/u4:6+events_unbound	21:25:06	0
2413192	99	58	34,18	cyclictest	256	50	irq/23-42890000.ethernet	22:10:12	0
2413193	99	57	42,11	cyclictest	2428094	-21	ntpq	20:05:29	1
2413193	99	57	24,9	cyclictest	2577252	-21	ssh	23:37:50	1
2413193	99	56	43,9	cyclictest	2440928	-21	ntpq	20:55:27	1
2413193	99	56	42,10	cyclictest	2423087	-21	ps	19:45:38	1
2413193	99	56	38,15	cyclictest	2424313	-21	ntpq	19:50:33	1
2413193	99	56	23,11	cyclictest	2417262	-21	/usr/sbin/munin	19:25:18	1
2413192	99	56	49,5	cyclictest	2455274	-21	kworker/u4:2+events_unbound	21:40:02	0
2413192	99	56	43,7	cyclictest	256	50	irq/23-42890000.ethernet	22:52:42	0
2413193	99	55	40,11	cyclictest	2442211	-21	ntpq	21:00:25	1
2413193	99	55	22,10	cyclictest	2415263	-21	ntpq	19:15:30	1
2413192	99	55	47,6	cyclictest	2414425	-21	sshd	19:14:57	0
2413192	99	55	42,9	cyclictest	2511785	-21	ssh	22:24:59	0
2413193	99	54	39,11	cyclictest	2435814	-21	ntpq	20:35:27	1
2413193	99	54	21,10	cyclictest	2431423	-21	apt-get	20:20:19	1
2413192	99	54	44,7	cyclictest	2419628	-21	kthreadd	19:34:47	0
2413193	99	53	41,8	cyclictest	37	-21	kcompactd0	20:04:48	1
2413193	99	53	40,10	cyclictest	2419101	-21	ntpq	19:30:25	1
2413193	99	53	39,10	cyclictest	2413343	-21	apt-get	19:10:14	1
2413193	99	53	24,9	cyclictest	2424927	-21	apt-get	19:55:11	1
2413192	99	53	45,6	cyclictest	2482879	-21	kworker/u4:1+events_unbound	22:25:04	0
2413192	99	53	45,6	cyclictest	2413189	-21	cyclictest	22:34:26	0
2413193	99	52	39,9	cyclictest	2430672	-21	ntpq	20:15:36	1
2413193	99	52	39,10	cyclictest	2416554	-21	ntpq	19:20:23	1
2413192	99	52	45,5	cyclictest	2442720	-21	kworker/u4:12+events_unbound	21:20:00	0
2413192	99	52	44,6	cyclictest	2598607	-21	kworker/u4:3+events_unbound	00:08:30	0
2413192	99	52	44,5	cyclictest	15	1	ktimers/0	00:36:53	0
2413192	99	51	44,5	cyclictest	2561562	-21	gltestperf	23:20:20	0
2413192	99	51	43,6	cyclictest	2413121	-21	kworker/u4:1+events_unbound	20:15:08	0
2413192	99	50	42,6	cyclictest	2439216	-21	grep	20:50:15	0
2413193	99	49	37,10	cyclictest	2443509	-21	ntpq	21:05:28	1
2413193	99	49	36,9	cyclictest	2437086	-21	ntpq	20:40:23	1
2413192	99	49	43,5	cyclictest	2429828	-21	kworker/u4:0+events_unbound	20:25:09	0
2413192	99	49	42,5	cyclictest	2504264	-21	timerandwakeup	22:15:38	0
2413192	99	49	42,5	cyclictest	2422181	-21	kworker/u4:0+events_unbound	19:45:04	0
2413192	99	49	37,7	cyclictest	0	-21	swapper/0	00:16:41	0
2413193	99	48	37,9	cyclictest	2413189	-21	cyclictest	20:50:16	1
2413192	99	48	42,4	cyclictest	2422230	-21	idleruntime-cro	19:45:00	0
2413192	99	48	41,5	cyclictest	2518851	-21	kworker/u4:7+events_unbound	22:45:04	0
2413192	99	48	41,5	cyclictest	2448549	-21	basename	21:14:59	0
2413192	99	48	40,6	cyclictest	2418021	-21	sendmail_mailqu	19:25:36	0
2413192	99	47	40,4	cyclictest	2423918	-21	fschecks_count	19:50:18	0
2413192	99	47	38,7	cyclictest	2426357	-21	aten_r7power_vo	20:00:16	0
2413192	99	47	26,18	cyclictest	0	-21	swapper/0	23:10:29	0
2413192	99	46	39,5	cyclictest	2601197	-21	latency_hist	00:05:02	0
2413192	99	46	38,5	cyclictest	2612807	-21	kworker/u4:11+events_unbound	00:27:44	0
2413192	99	46	37,7	cyclictest	2436067	-21	switchtime	20:35:37	0
2413192	99	46	30,4	cyclictest	2523380	-21	kworker/u4:0+events_unbound	00:12:05	0
2413192	99	45	36,7	cyclictest	2420106	-21	fschecks_count	19:35:18	0
2413192	99	44	4,25	cyclictest	2485830	-21	sshd	21:55:30	0
2413192	99	44	39,3	cyclictest	2435043	-21	kworker/u4:16+events_unbound	21:00:19	0
2413192	99	43	36,4	cyclictest	2598609	-21	kworker/u4:6-rpciod	00:30:17	0
2413192	99	43	34,7	cyclictest	2429084	-21	fschecks_time	20:10:17	0
2413192	99	43	33,7	cyclictest	2436669	-21	aten_r7power_vo	20:40:14	0
2413192	99	42	36,4	cyclictest	2425118	-21	df_abs	19:55:16	0
2413192	99	41	33,6	cyclictest	2441456	-21	apt	20:59:59	0
2413192	99	40	31,7	cyclictest	2434239	-21	fschecks_count	20:30:22	0
2413192	99	40	28,6	cyclictest	2429828	-21	kworker/u4:0+events_unbound	20:45:17	0
2413193	99	39	26,10	cyclictest	2413251	-21	latency_hist	19:10:01	1
2413192	99	39	32,5	cyclictest	2416785	-21	cat	19:20:34	0
2413192	99	39	32,5	cyclictest	0	-21	swapper/0	20:05:18	0
2413192	99	38	30,6	cyclictest	2442948	-21	aten_r7power_cu	21:05:15	0
2413192	99	35	10,15	cyclictest	2413189	-21	cyclictest	19:09:59	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17