OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Sat Jan 17, 2026 12:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2476557	99	112	104,5	cyclictest	2499325	-21	kworker/u4:7+events_unbound	09:25:45	1
2476557	99	102	95,5	cyclictest	2616517	-21	kworker/u4:4+events_unbound	12:36:19	1
2476557	99	102	94,6	cyclictest	2560872	-21	kworker/u4:2+events_unbound	10:20:53	1
2476557	99	99	92,5	cyclictest	2535346	-21	kworker/u4:8+events_unbound	09:55:51	1
2476557	99	95	89,4	cyclictest	2484089	-21	kworker/u4:13+events_unbound	08:20:23	1
2476557	99	95	88,5	cyclictest	2485372	-21	kworker/u4:16+events_unbound	07:45:10	1
2476557	99	95	87,6	cyclictest	2560871	-21	kworker/u4:0+events_unbound	10:35:54	1
2476557	99	95	86,6	cyclictest	2647865	-21	apt-get	11:55:08	1
2476557	99	93	86,5	cyclictest	2535344	-21	kworker/u4:5+events_unbound	09:45:49	1
2476557	99	93	84,7	cyclictest	2565222	-21	kworker/u4:19+events_unbound	10:25:54	1
2476556	99	88	68,15	cyclictest	54	-21	kswapd0	09:50:08	0
2476557	99	85	76,7	cyclictest	2493012	-21	kworker/u4:10+events_unbound	08:35:33	1
2476557	99	85	72,5	cyclictest	2667469	-21	kworker/u4:6+events_unbound	12:21:16	1
2476557	99	82	76,4	cyclictest	2560880	-21	kworker/u4:14+events_unbound	10:15:52	1
2476556	99	82	36,44	cyclictest	2529188	-21	fschecks_count	09:35:19	0
2476556	99	82	36,44	cyclictest	2529188	-21	fschecks_count	09:35:19	0
2476557	99	80	73,5	cyclictest	2503117	-21	kworker/u4:14+events_unbound	09:00:40	1
2476557	99	80	70,7	cyclictest	2499324	-21	kworker/u4:3+events_unbound	08:45:38	1
2476557	99	77	70,6	cyclictest	2490503	-21	kworker/u4:9+events_unbound	09:15:43	1
2476557	99	76	69,5	cyclictest	2658294	-21	kworker/u4:10+events_unbound	12:06:13	1
2476556	99	76	39,34	cyclictest	255	50	irq/23-42890000.ethernet	10:10:34	0
2476556	99	72	1,9	cyclictest	2563161	-21	apt-get	10:15:12	0
2476557	99	71	64,5	cyclictest	2526574	-21	kworker/u4:11+events_unbound	09:35:01	1
2476557	99	71	64,5	cyclictest	2526574	-21	kworker/u4:11+events_unbound	09:35:01	1
2476557	99	71	61,8	cyclictest	2522178	-21	kworker/u4:10+events_unbound	09:40:48	1
2476556	99	71	24,30	cyclictest	2511695	-21	aten_r7power_en	09:15:17	0
2476557	99	70	62,6	cyclictest	2490503	-21	kworker/u4:9+events_unbound	08:40:35	1
2476556	99	70	37,30	cyclictest	2615089	-21	ntp_states	11:15:32	0
2476556	99	70	37,30	cyclictest	2615089	-21	ntp_states	11:15:32	0
2476556	99	69	41,21	cyclictest	54	-21	kswapd0	11:55:10	0
2476556	99	69	33,33	cyclictest	2481837	-21	aten_r7power_en	07:30:15	0
2476556	99	69	2,19	cyclictest	2516793	-21	ps	09:20:35	0
2476557	99	68	60,6	cyclictest	2480323	-21	kworker/u4:6+events_unbound	08:35:00	1
2476556	99	68	33,33	cyclictest	2546383	-21	ssh	09:55:20	0
2476556	99	68	33,32	cyclictest	0	-21	swapper/0	12:25:32	0
2476556	99	68	31,33	cyclictest	0	-21	swapper/0	11:45:25	0
2476557	99	67	7,42	cyclictest	2593073	-21	ssh	10:50:15	1
2476556	99	67	34,28	cyclictest	2500990	-21	df_abs	08:45:16	0
2476556	99	67	18,46	cyclictest	2576552	-21	/usr/sbin/munin	10:30:23	0
2476557	99	66	49,5	cyclictest	2544094	-21	kworker/u4:6+events_unbound	09:54:42	1
2476556	99	66	4,9	cyclictest	2593043	-21	apt-get	10:50:13	0
2476556	99	66	33,31	cyclictest	2525689	-21	timerwakeupswit	09:30:39	0
2476556	99	66	33,31	cyclictest	2525689	-21	timerwakeupswit	09:30:39	0
2476556	99	66	31,31	cyclictest	0	-21	swapper/0	08:10:40	0
2476556	99	65	31,31	cyclictest	2537717	-21	cpu	09:45:18	0
2476556	99	65	30,32	cyclictest	0	-21	swapper/0	10:25:31	0
2476556	99	65	1,8	cyclictest	2660590	-21	ssh	12:10:00	0
2476557	99	64	57,5	cyclictest	2499326	-21	kworker/u4:8+events_unbound	08:55:01	1
2476556	99	64	30,31	cyclictest	2520351	-21	aten_r7power_en	09:25:17	0
2476556	99	63	3,11	cyclictest	2551197	-21	ssh	10:00:33	0
2476556	99	63	30,29	cyclictest	0	-21	swapper/0	12:35:26	0
2476556	99	63	27,32	cyclictest	0	-21	swapper/0	11:35:27	0
2476556	99	63	26,35	cyclictest	2489565	-21	aten_r7power_vo	08:00:14	0
2476556	99	62	31,29	cyclictest	2610425	-21	fschecks_time	11:10:19	0
2476556	99	62	28,30	cyclictest	0	-21	swapper/0	11:05:26	0
2476556	99	62	24,35	cyclictest	0	-21	swapper/0	07:25:01	0
2476556	99	62	2,11	cyclictest	2597582	-21	ssh	10:55:19	0
2476556	99	62	1,11	cyclictest	2485401	-21	munin-plugin-st	07:45:00	0
2476556	99	61	52,7	cyclictest	2612188	-21	kworker/u4:1+events_unbound	11:26:06	0
2476556	99	61	4,54	cyclictest	2580932	-21	ntpq	10:35:25	0
2476556	99	61	4,15	cyclictest	2487629	-21	ps	07:50:52	0
2476556	99	61	4,15	cyclictest	2487629	-21	ps	07:50:52	0
2476556	99	61	3,14	cyclictest	2636137	-21	ssh	11:40:26	0
2476556	99	61	30,28	cyclictest	0	-21	swapper/0	12:10:19	0
2476556	99	61	28,30	cyclictest	0	-21	swapper/0	08:50:36	0
2476556	99	61	28,29	cyclictest	0	-21	swapper/0	09:10:34	0
2476556	99	61	22,35	cyclictest	2622534	-21	latency_hist	11:25:01	0
2476556	99	61	2,20	cyclictest	2498896	-21	ntpq	08:35:33	0
2476556	99	61	2,16	cyclictest	2643894	-21	apt-get	11:50:14	0
2476557	99	60	51,7	cyclictest	2499325	-21	kworker/u4:7+events_unbound	09:25:01	1
2476556	99	60	6,14	cyclictest	2652989	-21	/usr/sbin/munin	12:00:21	0
2476556	99	60	3,8	cyclictest	2483611	-21	ntpq	07:35:27	0
2476556	99	60	30,28	cyclictest	2590078	-21	unixbench_singl	10:45:43	0
2476556	99	60	26,31	cyclictest	2628212	-21	diskmemload	11:30:40	0
2476556	99	60	23,33	cyclictest	0	-21	swapper/0	12:30:30	0
2476556	99	60	1,13	cyclictest	2486211	-21	ntpq	07:45:29	0
2476556	99	59	2,8	cyclictest	2601979	-21	ssh	11:00:20	0
2476557	99	58	50,6	cyclictest	2652647	-21	/usr/sbin/munin	12:00:16	1
2476556	99	58	3,20	cyclictest	2670213	-21	ssh	12:20:32	0
2476556	99	58	3,14	cyclictest	2497652	-21	ntpq	08:30:32	0
2476556	99	58	3,14	cyclictest	2496397	-21	ntpq	08:25:39	0
2476556	99	58	3,13	cyclictest	2493825	-21	ntpq	08:15:32	0
2476556	99	58	28,27	cyclictest	0	-21	swapper/0	10:05:25	0
2476556	99	58	27,29	cyclictest	0	-21	swapper/0	12:15:20	0
2476556	99	58	22,33	cyclictest	0	-21	swapper/0	07:55:19	0
2476556	99	58	2,14	cyclictest	2505147	-21	ntpq	09:00:26	0
2476556	99	58	2,12	cyclictest	2568779	-21	ssh	10:20:39	0
2476556	99	58	16,40	cyclictest	2506986	-21	sed	09:10:01	0
2476557	99	57	50,5	cyclictest	2573950	-21	kworker/u4:1+events_unbound	10:30:53	1
2476557	99	57	50,5	cyclictest	2479026	-21	kworker/u4:11+events_unbound	07:30:08	1
2476556	99	57	4,7	cyclictest	2585182	-21	ntpq	10:40:24	0
2476556	99	57	26,28	cyclictest	2498068	-21	kworker/u4:0-rpciod	09:40:16	0
2476556	99	57	2,10	cyclictest	2499785	-21	cut	08:40:19	0
2476557	99	56	50,5	cyclictest	2612188	-21	kworker/u4:1+events_unbound	11:31:44	1
2476556	99	56	2,17	cyclictest	2495116	-21	ntpq	08:20:29	0
2476557	99	55	48,5	cyclictest	2480323	-21	kworker/u4:6+events_unbound	07:35:08	1
2476556	99	55	3,9	cyclictest	2491267	-21	ntpq	08:05:27	0
2476556	99	55	14,13	cyclictest	2478087	-21	cut	07:15:16	0
2476557	99	54	48,4	cyclictest	2612188	-21	kworker/u4:1+events_unbound	11:20:01	1
2476557	99	54	48,4	cyclictest	2612188	-21	kworker/u4:1+events_unbound	11:20:01	1
2476557	99	54	47,5	cyclictest	2530055	-21	unixbench-2d	09:35:38	1
2476557	99	54	47,5	cyclictest	2530055	-21	unixbench-2d	09:35:38	1
2476557	99	54	46,5	cyclictest	2616517	-21	kworker/u4:4+events_unbound	11:39:00	1
2476556	99	54	2,12	cyclictest	2477165	-21	/usr/sbin/munin	07:10:20	0
2476556	99	54	1,11	cyclictest	2481086	-21	/usr/sbin/munin	07:25:24	0
2476557	99	53	45,5	cyclictest	2673984	-21	sh	12:25:22	1
2476556	99	53	2,9	cyclictest	2476553	-21	cyclictest	07:10:01	0
2476557	99	52	44,6	cyclictest	2499326	-21	kworker/u4:8+events_unbound	09:05:41	1
2476557	99	52	42,5	cyclictest	0	-21	swapper/1	11:40:19	1
2476557	99	51	45,4	cyclictest	2492035	-21	aten_r7power_en	08:10:19	1
2476557	99	51	41,7	cyclictest	2669179	-21	latency_hist	12:20:02	1
2476557	99	51	41,7	cyclictest	2611309	-21	vmstat	11:10:38	1
2476556	99	51	2,11	cyclictest	2503907	-21	ntpq	08:55:27	0
2476557	99	50	8,27	cyclictest	2551124	-21	ssh	10:00:30	1
2476557	99	50	43,5	cyclictest	2623225	-21	gltestperf	11:25:21	1
2476557	99	50	43,5	cyclictest	2582552	-21	kworker/u4:7+events_unbound	10:43:59	1
2476557	99	50	42,5	cyclictest	2479528	-21	grep	07:20:18	1
2476557	99	50	35,5	cyclictest	2612188	-21	kworker/u4:1+events_unbound	11:21:40	1
2476557	99	49	42,5	cyclictest	2616517	-21	kworker/u4:4+events_unbound	11:49:59	1
2476557	99	49	42,5	cyclictest	2606446	-21	ntpq	11:05:24	1
2476557	99	49	40,6	cyclictest	0	-21	swapper/1	10:55:12	1
2476557	99	49	38,5	cyclictest	2586899	-21	kworker/u4:10+events_unbound	10:46:59	1
2476557	99	48	41,5	cyclictest	2477438	-21	sendmail_mailqu	07:10:34	1
2476557	99	48	40,5	cyclictest	2650305	-21	kworker/u4:9+events_unbound	12:12:59	1
2476557	99	48	40,5	cyclictest	2487635	-21	sendmail_mailqu	07:50:52	1
2476557	99	48	40,5	cyclictest	2487635	-21	sendmail_mailqu	07:50:52	1
2476557	99	48	2,34	cyclictest	2508016	-21	ssh	09:10:30	1
2476557	99	47	37,7	cyclictest	0	-21	swapper/1	11:50:14	1
2476557	99	47	35,9	cyclictest	0	-21	swapper/1	12:30:29	1
2476557	99	46	38,5	cyclictest	2488974	-21	switchtime	07:55:35	1
2476557	99	46	36,8	cyclictest	2555208	-21	kernelversion	10:05:22	1
2476557	99	46	34,9	cyclictest	2481359	-21	timerandwakeup	07:25:34	1
2476557	99	45	37,6	cyclictest	2491858	-21	latency_hist	08:10:01	1
2476557	99	44	38,4	cyclictest	2586898	-21	kworker/u4:9+events_unbound	11:00:17	1
2476557	99	44	37,5	cyclictest	2559359	-21	gltestperf	10:10:21	1
2476557	99	43	33,8	cyclictest	2480325	-21	kworker/u4:8-rpciod	07:40:38	1
2476557	99	42	35,4	cyclictest	0	-21	swapper/1	08:15:23	1
2476557	99	42	34,6	cyclictest	2495998	-21	fschecks_count	08:25:27	1
2476557	99	42	34,6	cyclictest	2477948	-21	systemd	07:15:04	1
2476557	99	39	31,6	cyclictest	2487967	-21	kworker/u4:18+events_unbound	08:00:13	1
2476557	99	38	30,6	cyclictest	0	-21	swapper/1	08:55:32	1
2476557	99	31	23,6	cyclictest	0	-21	swapper/1	07:10:02	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17