OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Sat Feb 07, 2026 00:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1519388	99	82	74,6	cyclictest	1509628	-21	kworker/u4:11+events_unbound	20:06:09	1
1519388	99	81	76,3	cyclictest	1521867	-21	kworker/u4:12+events_unbound	19:26:00	1
1519387	99	81	72,7	cyclictest	1712433	-21	kworker/u4:4+events_unbound	00:28:41	0
1519388	99	80	6,7	cyclictest	17	1	rcu_preempt	23:20:14	1
1519387	99	79	66,8	cyclictest	1591340	-21	kworker/u4:8+events_unbound	22:11:48	0
1519387	99	75	35,36	cyclictest	1533565	-21	aten_r7power_cu	20:05:14	0
1519388	99	74	67,5	cyclictest	1539724	-21	kworker/u4:0+events_unbound	20:45:01	1
1519388	99	72	7,14	cyclictest	1562969	-21	ssh	21:25:01	1
1519388	99	72	41,28	cyclictest	1691386	-21	aten_r7power_cu	23:55:14	1
1519387	99	72	52,8	cyclictest	1507115	-21	kworker/u4:4+events_unbound	19:15:00	0
1519388	99	71	66,3	cyclictest	1667753	-21	kworker/u4:0+events_unbound	23:53:12	1
1519388	99	71	62,6	cyclictest	1582559	-21	kworker/u4:7+events_unbound	21:56:45	1
1519387	99	71	67,3	cyclictest	1655674	-21	kworker/u4:1+events_unbound	00:03:21	0
1519387	99	71	26,6	cyclictest	0	-21	swapper/0	00:10:29	0
1519388	99	70	36,32	cyclictest	1554468	-21	/usr/sbin/munin	21:15:12	1
1519387	99	70	34,5	cyclictest	1524544	-21	latency_hist	19:30:01	0
1519388	99	69	35,32	cyclictest	1654002	-21	fschecks_count	23:10:19	1
1519388	99	69	34,4	cyclictest	1580734	-21	sh	21:45:18	1
1519388	99	69	32,4	cyclictest	0	-21	swapper/1	23:30:31	1
1519388	99	69	29,5	cyclictest	0	-21	swapper/1	22:15:32	1
1519387	99	69	36,30	cyclictest	1700270	-21	fschecks_time	00:05:20	0
1519387	99	69	33,7	cyclictest	1619885	-21	netstat	22:30:24	0
1519387	99	69	32,9	cyclictest	1542749	-21	fschecks_count	20:40:19	0
1519387	99	69	32,33	cyclictest	0	-21	swapper/0	23:25:20	0
1519388	99	68	60,6	cyclictest	1719332	-21	kworker/u4:8+events_unbound	00:29:44	1
1519388	99	68	36,5	cyclictest	1702869	-21	systemd	00:08:22	1
1519388	99	68	36,5	cyclictest	1537252	-21	sendmail	20:20:00	1
1519388	99	68	35,4	cyclictest	0	-21	swapper/1	22:01:46	1
1519387	99	68	33,6	cyclictest	1667757	-21	kworker/u4:9-rpciod	23:30:36	0
1519388	99	67	62,3	cyclictest	1565031	-21	kworker/u4:2+events_unbound	21:36:34	1
1519388	99	67	58,6	cyclictest	1507118	-21	kworker/u4:7+events_unbound	19:21:01	1
1519388	99	67	33,5	cyclictest	0	-21	swapper/1	21:25:31	1
1519388	99	67	32,6	cyclictest	0	-21	swapper/1	22:35:26	1
1519388	99	67	30,4	cyclictest	0	-21	swapper/1	23:00:28	1
1519387	99	67	29,7	cyclictest	1531806	-21	switchtime	19:55:34	0
1519387	99	67	27,8	cyclictest	1713771	-21	mailstats	00:20:39	0
1519387	99	67	27,8	cyclictest	1713771	-21	mailstats	00:20:39	0
1519387	99	67	25,39	cyclictest	0	-21	swapper/0	23:35:35	0
1519388	99	66	56,7	cyclictest	1595729	-21	kworker/u4:12+events_unbound	23:07:01	1
1519387	99	66	5,18	cyclictest	1562995	-21	latency_hist	21:25:01	0
1519387	99	66	33,4	cyclictest	0	-21	swapper/0	23:10:24	0
1519387	99	66	31,5	cyclictest	0	-21	swapper/0	23:45:24	0
1519388	99	65	60,3	cyclictest	1532048	-21	kworker/u4:15+events_unbound	20:01:09	1
1519388	99	65	37,5	cyclictest	1571481	-21	munin-plugin-st	21:35:00	1
1519387	99	65	56,7	cyclictest	1582557	-21	kworker/u4:5+events_unbound	22:01:48	0
1519387	99	65	56,7	cyclictest	1507117	-21	kworker/u4:6+events_unbound	19:16:00	0
1519387	99	65	33,4	cyclictest	0	-21	swapper/0	21:55:29	0
1519387	99	65	29,4	cyclictest	1629012	-21	ssh	22:40:38	0
1519387	99	64	33,28	cyclictest	0	-21	swapper/0	22:35:27	0
1519387	99	64	30,4	cyclictest	0	-21	swapper/0	22:05:20	0
1519388	99	63	55,6	cyclictest	1539730	-21	kworker/u4:8+events_unbound	21:11:27	1
1519388	99	63	31,5	cyclictest	0	-21	swapper/1	19:10:21	1
1519387	99	63	54,7	cyclictest	388	-21	dbus-daemon	00:33:43	0
1519388	99	62	27,6	cyclictest	0	-21	swapper/1	23:25:18	1
1519387	99	62	28,5	cyclictest	0	-21	swapper/0	22:55:20	0
1519387	99	61	28,5	cyclictest	1672120	-21	kworker/u4:3-rpciod	23:55:33	0
1519387	99	61	28,5	cyclictest	0	-21	swapper/0	23:00:20	0
1519388	99	60	29,4	cyclictest	1591342	-21	kworker/u4:10-xprtiod	22:25:01	1
1519387	99	59	40,16	cyclictest	1530815	-21	munin-plugin-st	19:54:59	0
1519387	99	59	26,5	cyclictest	0	-21	swapper/0	22:50:17	0
1519388	99	58	50,6	cyclictest	1604435	-21	kworker/u4:5+events_unbound	22:15:00	1
1519388	99	57	46,7	cyclictest	1634447	-21	kworker/u4:0+events_unbound	22:56:59	1
1519387	99	57	46,8	cyclictest	388	-21	dbus-daemon	22:16:49	0
1519387	99	56	47,7	cyclictest	1580642	-21	/usr/sbin/munin	21:45:15	0
1519387	99	56	47,5	cyclictest	1611207	-21	kernelversion	22:20:23	0
1519388	99	54	44,8	cyclictest	388	-21	dbus-daemon	23:46:54	1
1519387	99	54	45,7	cyclictest	1634449	-21	kworker/u4:7+events_unbound	22:49:59	0
1519388	99	53	45,6	cyclictest	1537188	-21	kworker/u4:2+events_unbound	21:10:00	1
1519388	99	52	42,7	cyclictest	1524404	-21	kworker/u4:16+events_unbound	20:26:16	1
1519387	99	52	45,5	cyclictest	1546065	-21	munin-plugin-st	20:55:00	0
1519388	99	51	46,3	cyclictest	1537188	-21	kworker/u4:2+events_unbound	20:56:23	1
1519388	99	51	45,4	cyclictest	1586939	-21	kworker/u4:2+events_unbound	22:09:43	1
1519388	99	51	40,8	cyclictest	0	-21	swapper/1	22:25:15	1
1519387	99	51	39,9	cyclictest	1528577	-21	aten_r7power_po	19:45:17	0
1519387	99	51	32,17	cyclictest	1604435	-21	kworker/u4:5-rpciod	22:30:01	0
1519388	99	50	44,4	cyclictest	1698559	-21	systemd	00:03:20	1
1519388	99	50	43,5	cyclictest	1585746	-21	mailstats	21:50:37	1
1519388	99	50	42,5	cyclictest	1722517	-21	sh	00:30:38	1
1519387	99	50	43,5	cyclictest	1687855	-21	/usr/sbin/munin	23:50:31	0
1519387	99	50	39,9	cyclictest	1538709	-21	aten_r7power_cu	20:25:14	0
1519387	99	50	39,8	cyclictest	1575954	-21	latency_hist	21:40:02	0
1519387	99	50	30,17	cyclictest	1571491	-21	awk	21:35:01	0
1519388	99	49	41,5	cyclictest	1637028	-21	irqstats	22:50:22	1
1519388	99	49	40,7	cyclictest	1540987	-21	kworker/u4:10+events_unbound	20:46:20	1
1519387	99	49	42,5	cyclictest	1558543	-21	latency_hist	21:20:01	0
1519387	99	49	41,5	cyclictest	1708560	-21	cut	00:15:15	0
1519387	99	49	41,5	cyclictest	1538471	-21	kworker/u4:6+events_unbound	20:25:01	0
1519387	99	49	40,7	cyclictest	1585179	-21	fschecks_time	21:50:21	0
1519387	99	49	40,7	cyclictest	1577995	-21	systemd	21:41:33	0
1519387	99	49	39,7	cyclictest	1647564	-21	kworker/u4:14+events_unbound	23:05:34	0
1519388	99	48	43,3	cyclictest	1525746	-21	kworker/u4:18+events_unbound	19:41:05	1
1519387	99	48	40,5	cyclictest	1661551	-21	fschecks_count	23:20:18	0
1519387	99	48	38,7	cyclictest	1539729	-21	kworker/u4:7+events_unbound	21:01:22	0
1519387	99	48	37,8	cyclictest	1551201	-21	mailstats	21:10:46	0
1519387	99	48	36,10	cyclictest	1567239	-21	latency_hist	21:30:02	0
1519388	99	47	41,4	cyclictest	1541037	-21	latency_hist	20:35:01	1
1519388	99	47	41,4	cyclictest	1541037	-21	latency_hist	20:35:00	1
1519388	99	47	38,6	cyclictest	1726047	-21	gltestperf	00:35:21	1
1519388	99	47	36,8	cyclictest	1678587	-21	aten_r7power_po	23:40:15	1
1519387	99	47	37,8	cyclictest	1543719	-21	aten2__	20:45:15	0
1519388	99	46	39,5	cyclictest	1519385	-21	cyclictest	22:45:31	1
1519388	99	46	39,5	cyclictest	0	-21	swapper/1	23:35:29	1
1519388	99	46	38,5	cyclictest	1531707	-21	sendmail_mailqu	19:55:34	1
1519388	99	46	37,6	cyclictest	1627937	-21	aten2__	22:40:15	1
1519388	99	46	36,7	cyclictest	1577023	-21	proc_pri	21:40:34	1
1519387	99	46	34,10	cyclictest	1546362	-21	aten_r7power_vo	20:55:16	0
1519387	99	46	27,16	cyclictest	1679741	-21	unixbench_singl	23:40:37	0
1519388	99	45	36,7	cyclictest	1521675	-21	timerwakeupswit	19:15:34	1
1519387	99	45	38,5	cyclictest	1525995	-21	aten_r7power_cu	19:35:15	0
1519387	99	45	37,6	cyclictest	1532612	-21	fschecks_time	20:00:20	0
1519387	99	45	36,7	cyclictest	1725684	-21	cut	00:35:17	0
1519388	99	44	35,5	cyclictest	0	-21	swapper/1	20:20:30	1
1519388	99	44	33,9	cyclictest	1529838	-21	aten_r7power_po	19:50:13	1
1519387	99	44	36,6	cyclictest	1660988	-21	munin-run	23:20:00	0
1519388	99	43	36,5	cyclictest	1545256	-21	fschecks_count	20:50:17	1
1519387	99	43	20,20	cyclictest	1535973	-21	grep	20:15:01	0
1519388	99	42	36,4	cyclictest	1708479	-21	aten2__	00:15:14	1
1519388	99	42	35,4	cyclictest	0	-21	swapper/1	19:35:29	1
1519388	99	42	34,4	cyclictest	0	-21	swapper/1	22:30:32	1
1519387	99	42	34,6	cyclictest	1541249	-21	aten_r7power_en	20:35:17	0
1519387	99	42	27,13	cyclictest	1525418	-21	sendmail_mailst	19:30:38	0
1519387	99	42	19,20	cyclictest	0	-21	swapper/0	19:40:37	0
1519388	99	41	34,5	cyclictest	1655674	-21	kworker/u4:1-rpciod	23:20:00	1
1519388	99	41	33,6	cyclictest	1516918	-21	kworker/u4:10+events_unbound	19:31:02	1
1519388	99	41	32,7	cyclictest	1542344	-21	latency_hist	20:40:01	1
1519388	99	41	29,9	cyclictest	1528666	-21	df	19:45:17	1
1519388	99	41	29,9	cyclictest	0	-21	swapper/1	21:00:36	1
1519387	99	41	29,9	cyclictest	1536123	-21	aten2__	20:15:15	0
1519388	99	40	30,8	cyclictest	1713143	-21	fschecks_time	00:20:22	1
1519388	99	40	30,8	cyclictest	1713143	-21	fschecks_time	00:20:22	1
1519388	99	40	29,8	cyclictest	1704212	-21	cut	00:10:15	1
1519388	99	39	31,6	cyclictest	0	-21	swapper/1	20:15:00	1
1519388	99	39	28,7	cyclictest	1507117	-21	kworker/u4:6-rpciod	19:10:01	1
1519387	99	39	29,7	cyclictest	1549106	-21	fschecks_time	21:05:20	0
1519387	99	39	28,9	cyclictest	1540852	-21	unixbench-2d	20:30:35	0
1519387	99	39	28,9	cyclictest	1540852	-21	unixbench-2d	20:30:35	0
1519387	99	39	24,13	cyclictest	0	-21	swapper/0	19:25:00	0
1519387	99	33	25,6	cyclictest	0	-21	swapper/0	19:10:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17