OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Tue Mar 17, 2026 00:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
32396	99	111	105,5	cyclictest	34888	-21	kworker/u4:11+events_unbound	19:37:15	0
32397	99	100	83,11	cyclictest	53	-21	kswapd0	00:05:30	1
32396	99	99	91,6	cyclictest	56891	-21	kworker/u4:12+events_unbound	20:47:25	0
32396	99	96	89,5	cyclictest	42582	-21	kworker/u4:7+events_unbound	20:32:24	0
32397	99	89	82,5	cyclictest	177595	-21	kworker/u4:3+events_unbound	23:27:52	1
32397	99	89	82,5	cyclictest	177595	-21	kworker/u4:3+events_unbound	23:27:52	1
32396	99	88	82,5	cyclictest	177595	-21	kworker/u4:3+events_unbound	23:17:48	0
32396	99	85	73,8	cyclictest	63568	-21	diskmemload	00:15:12	0
32396	99	84	72,9	cyclictest	53	-21	kswapd0	22:05:10	0
32396	99	82	75,5	cyclictest	136687	-21	kworker/u4:6+events_unbound	23:02:46	0
32397	99	81	72,6	cyclictest	217758	-21	kworker/u4:1+events_unbound	00:38:03	1
32396	99	75	68,5	cyclictest	51625	-21	kworker/u4:15+events_unbound	21:07:27	0
32396	99	75	68,5	cyclictest	177595	-21	kworker/u4:3+events_unbound	23:30:17	0
32396	99	75	60,9	cyclictest	53	-21	kswapd0	22:55:07	0
32396	99	74	68,5	cyclictest	173072	-21	kworker/u4:7+events_unbound	23:20:21	0
32397	99	73	38,31	cyclictest	0	-21	swapper/1	22:45:37	1
32397	99	73	35,33	cyclictest	0	-21	swapper/1	23:20:31	1
32397	99	73	11,21	cyclictest	144763	-21	ssh	22:40:31	1
32397	99	71	30,36	cyclictest	0	-21	swapper/1	22:15:33	1
32397	99	71	30,36	cyclictest	0	-21	swapper/1	22:15:33	1
32397	99	69	31,35	cyclictest	50082	-21	threads	20:15:40	1
32396	99	69	62,5	cyclictest	34910	-21	kworker/u4:16+events_unbound	19:25:02	0
32396	99	69	62,5	cyclictest	111030	-21	kworker/u4:2+events_unbound	22:05:00	0
32397	99	68	61,5	cyclictest	173072	-21	kworker/u4:7+events_unbound	23:12:47	1
32397	99	68	30,35	cyclictest	203254	-21	timerwakeupswit	23:45:39	1
32397	99	67	35,29	cyclictest	0	-21	swapper/1	20:50:17	1
32397	99	67	33,31	cyclictest	225276	-21	/usr/sbin/munin	00:10:37	1
32397	99	67	30,5	cyclictest	113365	-21	gltestperf	22:05:24	1
32397	99	67	27,5	cyclictest	0	-21	swapper/1	22:20:29	1
32396	99	67	49,8	cyclictest	46676	-21	find	20:05:12	0
32397	99	66	36,28	cyclictest	47887	-21	cat	20:10:02	1
32397	99	66	32,31	cyclictest	29888	-21	kworker/u4:0-rpciod	19:20:01	1
32397	99	66	30,33	cyclictest	0	-21	swapper/1	00:20:24	1
32397	99	66	29,34	cyclictest	0	-21	swapper/1	22:00:32	1
32397	99	66	25,8	cyclictest	0	-21	swapper/1	23:00:34	1
32396	99	66	58,6	cyclictest	51622	-21	kworker/u4:3+events_unbound	21:02:27	0
32397	99	65	4,26	cyclictest	73811	-21	ssh	21:20:37	1
32397	99	65	35,28	cyclictest	193595	-21	grep	23:35:21	1
32397	99	65	32,31	cyclictest	99329	-21	ls	21:50:00	1
32397	99	65	32,31	cyclictest	0	-21	swapper/1	00:00:24	1
32397	99	65	31,30	cyclictest	0	-21	swapper/1	22:10:36	1
32397	99	64	55,7	cyclictest	177595	-21	kworker/u4:3+events_unbound	23:40:13	1
32397	99	64	31,30	cyclictest	0	-21	swapper/1	21:55:29	1
32397	99	64	29,33	cyclictest	139637	-21	aten_r7power_en	22:35:19	1
32397	99	63	56,5	cyclictest	51623	-21	kworker/u4:5+events_unbound	21:12:28	1
32397	99	63	32,29	cyclictest	238638	-21	switchtime	00:25:39	1
32397	99	63	30,30	cyclictest	38471	-21	switchtime	19:30:37	1
32397	99	63	29,4	cyclictest	0	-21	swapper/1	21:50:24	1
32397	99	63	29,4	cyclictest	0	-21	swapper/1	00:15:35	1
32397	99	63	28,7	cyclictest	0	-21	swapper/1	23:55:28	1
32397	99	63	26,6	cyclictest	0	-21	swapper/1	21:35:34	1
32397	99	63	26,6	cyclictest	0	-21	swapper/1	21:35:33	1
32397	99	63	24,8	cyclictest	0	-21	swapper/1	20:45:23	1
32396	99	63	56,5	cyclictest	99336	-21	basename	21:49:59	0
32396	99	63	56,5	cyclictest	53	-21	kswapd0	22:50:00	0
32396	99	63	3,58	cyclictest	0	-21	swapper/0	21:15:33	0
32397	99	62	32,5	cyclictest	170217	-21	sshd	23:09:32	1
32397	99	62	29,4	cyclictest	69002	-21	ntpq	21:15:24	1
32397	99	62	27,5	cyclictest	0	-21	swapper/1	20:35:32	1
32397	99	62	24,6	cyclictest	0	-21	swapper/1	21:45:00	1
32396	99	62	55,4	cyclictest	53	-21	kswapd0	23:55:20	0
32397	99	61	33,25	cyclictest	0	-21	swapper/1	21:25:31	1
32397	99	61	30,28	cyclictest	0	-21	swapper/1	00:30:27	1
32397	99	61	27,4	cyclictest	0	-21	swapper/1	20:00:27	1
32397	99	61	25,6	cyclictest	0	-21	swapper/1	23:50:32	1
32397	99	61	25,6	cyclictest	0	-21	swapper/1	20:10:35	1
32397	99	60	30,4	cyclictest	168519	-21	kworker/u4:1-nfsiod	23:15:37	1
32397	99	60	27,4	cyclictest	0	-21	swapper/1	19:25:36	1
32397	99	60	26,6	cyclictest	0	-21	swapper/1	20:30:00	1
32396	99	60	2,20	cyclictest	99616	-21	munin-node	21:50:11	0
32397	99	59	23,8	cyclictest	0	-21	swapper/1	22:50:12	1
32397	99	58	25,7	cyclictest	131749	-21	unixbench-2d	22:25:38	1
32397	99	58	22,9	cyclictest	0	-21	swapper/1	23:30:25	1
32396	99	58	52,4	cyclictest	53	-21	kswapd0	23:50:19	0
32396	99	58	43,10	cyclictest	246669	-21	fschecks_count	00:35:20	0
32397	99	57	22,9	cyclictest	0	-21	swapper/1	21:00:30	1
32397	99	57	22,7	cyclictest	0	-21	swapper/1	22:30:26	1
32396	99	56	50,4	cyclictest	53	-21	kswapd0	23:10:12	0
32396	99	56	49,5	cyclictest	41310	-21	kworker/u4:3+events_unbound	20:00:01	0
32396	99	56	47,6	cyclictest	53	-21	kswapd0	00:35:01	0
32396	99	55	28,23	cyclictest	256	50	irq/23-42890000.ethernet	20:55:12	0
32397	99	54	49,3	cyclictest	42582	-21	kworker/u4:7+events_unbound	20:57:26	1
32396	99	54	48,5	cyclictest	191204	-21	kworker/u4:11+events_unbound	23:36:41	0
32396	99	54	47,5	cyclictest	51623	-21	kworker/u4:5+events_unbound	20:36:02	0
32396	99	54	46,6	cyclictest	41311	-21	kworker/u4:4+events_unbound	19:50:03	0
32396	99	54	44,8	cyclictest	90533	-21	latency_hist	21:40:02	0
32396	99	54	44,8	cyclictest	90533	-21	latency_hist	21:40:01	0
32396	99	54	33,19	cyclictest	139898	-21	fschecks_time	22:35:23	0
32396	99	53	46,5	cyclictest	43854	-21	kworker/u4:14+events_unbound	20:15:02	0
32396	99	53	45,6	cyclictest	137360	-21	kworker/u4:12+events_unbound	22:34:59	0
32396	99	53	45,5	cyclictest	53	-21	kswapd0	00:10:12	0
32396	99	53	43,8	cyclictest	53	-21	kswapd0	21:45:01	0
32396	99	53	17,11	cyclictest	17	1	rcu_preempt	22:18:45	0
32396	99	53	17,11	cyclictest	17	1	rcu_preempt	22:18:45	0
32397	99	52	44,5	cyclictest	56891	-21	kworker/u4:12+events_unbound	21:10:02	1
32397	99	51	46,3	cyclictest	33615	-21	kworker/u4:1+events_unbound	19:52:17	1
32396	99	51	45,4	cyclictest	198248	-21	/usr/sbin/munin	23:40:23	0
32396	99	51	44,5	cyclictest	73342	-21	gltestperf	21:20:19	0
32396	99	50	44,5	cyclictest	34888	-21	kworker/u4:11+events_unbound	19:55:03	0
32396	99	50	43,5	cyclictest	104308	-21	fschecks_count	21:55:18	0
32396	99	49	43,5	cyclictest	47775	-21	kworker/u4:8+events_unbound	20:10:03	0
32396	99	49	41,5	cyclictest	81591	-21	latency_hist	21:30:02	0
32396	99	49	40,7	cyclictest	224180	-21	latency_hist	00:10:02	0
32396	99	49	40,5	cyclictest	0	-21	swapper/0	23:10:00	0
32396	99	48	41,5	cyclictest	56891	-21	kworker/u4:12+events_unbound	20:55:01	0
32396	99	48	41,5	cyclictest	202941	-21	ntpq	23:45:34	0
32396	99	48	40,6	cyclictest	110370	-21	kworker/u4:1+events_unbound	22:14:59	0
32396	99	48	40,4	cyclictest	37695	-21	aten2__	19:30:16	0
32396	99	47	40,5	cyclictest	145112	-21	switchtime	22:40:40	0
32396	99	47	31,14	cyclictest	237672	-21	aten_r7power_en	00:25:16	0
32396	99	47	28,17	cyclictest	0	-21	swapper/0	22:25:00	0
32396	99	47	26,19	cyclictest	40473	-21	fschecks_count	19:40:19	0
32396	99	46	15,9	cyclictest	17	1	rcu_preempt	22:28:32	0
32397	99	45	37,6	cyclictest	315	-21	systemd-journal	21:32:31	1
32396	99	45	38,5	cyclictest	188415	-21	ssh	23:30:01	0
32396	99	45	38,5	cyclictest	188415	-21	ssh	23:30:01	0
32396	99	45	37,6	cyclictest	51622	-21	kworker/u4:3+events_unbound	20:45:00	0
32396	99	45	36,7	cyclictest	215828	-21	fschecks_time	00:00:20	0
32397	99	44	35,6	cyclictest	0	-21	swapper/1	20:30:41	1
32396	99	44	37,4	cyclictest	0	-21	swapper/0	21:10:33	0
32396	99	44	36,6	cyclictest	32944	-21	gltestperf	19:10:20	0
32396	99	44	30,11	cyclictest	0	-21	swapper/0	20:25:12	0
32396	99	44	21,20	cyclictest	34888	-21	kworker/u4:11-xprtiod	19:25:01	0
32396	99	44	21,20	cyclictest	34888	-21	kworker/u4:11-xprtiod	19:25:00	0
32396	99	43	30,6	cyclictest	42582	-21	kworker/u4:7+events_unbound	20:20:41	0
32396	99	42	32,8	cyclictest	157258	-21	awk	22:55:02	0
32396	99	42	23,17	cyclictest	81969	-21	grep	21:30:18	0
32396	99	42	22,10	cyclictest	17	1	rcu_preempt	00:24:06	0
32397	99	41	34,5	cyclictest	39763	-21	switchtime	19:35:39	1
32397	99	41	34,4	cyclictest	34910	-21	kworker/u4:16-rpciod	20:20:21	1
32397	99	41	34,4	cyclictest	0	-21	swapper/1	19:55:21	1
32396	99	41	32,7	cyclictest	41611	-21	aten_r7power_po	19:45:16	0
32397	99	40	33,5	cyclictest	36240	-21	munin-plugin-st	19:25:00	1
32397	99	40	33,5	cyclictest	36240	-21	munin-plugin-st	19:24:59	1
32397	99	40	32,6	cyclictest	0	-21	swapper/1	22:55:39	1
32397	99	39	30,6	cyclictest	0	-21	swapper/1	19:10:01	1
32397	99	38	30,6	cyclictest	56062	-21	fschecks_count	20:40:18	1
32397	99	38	30,6	cyclictest	40526	-21	fschecks_time	19:40:20	1
32396	99	37	27,7	cyclictest	0	-21	swapper/0	19:15:39	0
32397	99	36	27,6	cyclictest	32860	-21	fschecks_time	19:10:19	1
32397	99	36	23,9	cyclictest	0	-21	swapper/1	19:45:22	1
32396	99	28	3,3	cyclictest	15	1	ktimers/0	19:09:59	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17