OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackbslot5s.osadl.org (updated Sat Dec 20, 2025 00:44:47)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1767886	99	53	41,8	cyclictest	31	1	ktimers/2	21:10:12	2
1767886	99	53	38,11	cyclictest	31	1	ktimers/2	20:05:14	2
1767886	99	50	35,11	cyclictest	31	1	ktimers/2	20:35:14	2
1767882	99	50	38,7	cyclictest	1875788	-21	grep	00:15:25	1
1767886	99	48	36,8	cyclictest	1831291	-21	idleruntime-cro	22:10:00	2
1767886	99	48	35,10	cyclictest	31	1	ktimers/2	19:35:15	2
1767891	99	47	37,7	cyclictest	1858806	-21	grep	23:25:27	3
1767882	99	47	37,6	cyclictest	1806140	-21	grep	20:55:27	1
1767886	99	43	33,6	cyclictest	1858808	-21	unixbench_singl	23:25:26	2
1767886	99	43	30,10	cyclictest	31	1	ktimers/2	21:30:14	2
1767891	99	42	32,7	cyclictest	1773752	-21	auditctl	19:25:00	3
1767882	99	42	33,5	cyclictest	208	-21	systemd-logind	20:21:09	1
1767882	99	42	30,9	cyclictest	438	-21	cron	00:25:00	1
1767886	99	41	33,4	cyclictest	1874548	-21	cron	00:15:00	2
1767882	99	41	32,4	cyclictest	0	-21	swapper/1	23:35:17	1
1767882	99	41	32,4	cyclictest	0	-21	swapper/1	23:35:16	1
1767879	99	41	34,4	cyclictest	1879664	-21	cron	00:30:00	0
1767891	99	40	33,4	cyclictest	1802724	-21	grep	20:45:25	3
1767891	99	40	33,4	cyclictest	1802724	-21	grep	20:45:25	3
1767886	99	40	32,4	cyclictest	0	-21	swapper/2	19:20:01	2
1767886	99	40	29,7	cyclictest	1883090	-21	idleruntime-cro	00:40:00	2
1767886	99	40	2,6	cyclictest	13	1	rcu_preempt	23:20:11	2
1767886	99	39	31,5	cyclictest	31	1	ktimers/2	21:40:11	2
1767886	99	39	29,6	cyclictest	0	-21	swapper/2	19:25:00	2
1767886	99	39	28,7	cyclictest	0	-21	swapper/2	00:00:01	2
1767882	99	39	29,7	cyclictest	0	-21	swapper/1	20:00:00	1
1767891	99	38	5,6	cyclictest	13	1	rcu_preempt	23:00:14	3
1767886	99	38	28,5	cyclictest	1827661	-21	apt	22:00:01	2
1767882	99	38	28,7	cyclictest	0	-21	swapper/1	22:00:00	1
1767882	99	38	28,6	cyclictest	0	-21	swapper/1	19:25:17	1
1767891	99	37	27,6	cyclictest	0	-21	swapper/3	22:45:00	3
1767886	99	37	26,7	cyclictest	1853605	-21	grep	23:10:26	2
1767891	99	36	5,4	cyclictest	13	1	rcu_preempt	22:55:14	3
1767891	99	36	3,6	cyclictest	13	1	rcu_preempt	19:15:14	3
1767891	99	36	29,4	cyclictest	1777158	-21	idleruntime-cro	19:35:01	3
1767891	99	36	28,4	cyclictest	0	-21	swapper/3	22:00:14	3
1767891	99	36	28,4	cyclictest	0	-21	swapper/3	22:00:14	3
1767886	99	36	30,4	cyclictest	1845111	-21	kworker/u8:2+events_unbound	23:01:44	2
1767886	99	36	25,8	cyclictest	31	1	ktimers/2	21:50:13	2
1767879	99	36	29,4	cyclictest	135	50	irq/42-30be0000.ethernet	22:50:10	0
1767879	99	36	29,4	cyclictest	135	50	irq/42-30be0000.ethernet	22:50:10	0
1767891	99	35	26,5	cyclictest	0	-21	swapper/3	23:45:26	3
1767886	99	35	24,7	cyclictest	1875829	-21	grep	00:15:25	2
1767882	99	35	26,4	cyclictest	0	-21	swapper/1	00:25:16	1
1767879	99	35	28,4	cyclictest	0	-21	swapper/0	20:55:01	0
1767879	99	35	28,4	cyclictest	0	-21	swapper/0	20:55:00	0
1767891	99	34	21,8	cyclictest	1813153	-21	grep	21:15:27	3
1767886	99	34	24,7	cyclictest	1813606	-21	munin-run	21:20:00	2
1767886	99	34	24,6	cyclictest	0	-21	swapper/2	20:00:01	2
1767886	99	34	21,9	cyclictest	31	1	ktimers/2	23:05:13	2
1767882	99	34	26,4	cyclictest	0	-21	swapper/1	23:10:16	1
1767882	99	34	24,7	cyclictest	1825317	-21	grep	21:50:25	1
1767882	99	34	24,7	cyclictest	0	-21	swapper/1	19:20:01	1
1767879	99	34	26,4	cyclictest	0	-21	swapper/0	20:26:11	0
1767879	99	34	25,7	cyclictest	1780561	-21	cron	19:45:00	0
1767879	99	34	24,6	cyclictest	0	-21	swapper/0	22:40:01	0
1767891	99	33	25,4	cyclictest	0	-21	swapper/3	23:10:16	3
1767891	99	33	24,5	cyclictest	0	-21	swapper/3	00:15:00	3
1767886	99	33	25,4	cyclictest	0	-21	swapper/2	20:20:17	2
1767886	99	33	24,4	cyclictest	0	-21	swapper/2	19:50:15	2
1767882	99	33	23,6	cyclictest	0	-21	swapper/1	23:45:00	1
1767882	99	33	22,7	cyclictest	1848311	-21	grep	22:55:26	1
1767879	99	33	27,3	cyclictest	0	-21	swapper/0	21:30:00	0
1767879	99	33	26,4	cyclictest	0	-21	swapper/0	23:39:59	0
1767879	99	33	26,4	cyclictest	0	-21	swapper/0	23:39:59	0
1767879	99	33	25,4	cyclictest	1857961	-21	fschecks_time	23:25:18	0
1767879	99	33	22,7	cyclictest	0	-21	swapper/0	21:05:00	0
1767891	99	32	25,4	cyclictest	1806563	-21	cron	21:00:00	3
1767891	99	32	24,5	cyclictest	0	-21	swapper/3	19:45:00	3
1767891	99	32	24,4	cyclictest	0	-21	swapper/3	22:55:00	3
1767891	99	32	24,4	cyclictest	0	-21	swapper/3	22:55:00	3
1767891	99	32	24,4	cyclictest	0	-21	swapper/3	21:30:25	3
1767891	99	32	23,6	cyclictest	0	-21	swapper/3	23:50:24	3
1767891	99	32	23,6	cyclictest	0	-21	swapper/3	22:24:59	3
1767886	99	32	26,3	cyclictest	1877977	-21	cron	00:25:00	2
1767886	99	32	24,4	cyclictest	0	-21	swapper/2	20:25:25	2
1767886	99	32	19,9	cyclictest	204	-21	dbus-daemon	22:21:36	2
1767882	99	32	24,4	cyclictest	0	-21	swapper/1	22:35:26	1
1767882	99	32	22,6	cyclictest	1867269	-21	grep	23:50:23	1
1767879	99	32	25,4	cyclictest	1778857	-21	cron	19:40:00	0
1767879	99	32	24,5	cyclictest	0	-21	swapper/0	00:10:00	0
1767879	99	32	22,6	cyclictest	0	-21	swapper/0	20:05:26	0
1767879	99	32	19,9	cyclictest	12	1	ktimers/0	20:30:14	0
1767891	99	31	23,4	cyclictest	0	-21	swapper/3	22:15:22	3
1767891	99	31	23,4	cyclictest	0	-21	swapper/3	20:10:00	3
1767886	99	31	25,3	cyclictest	0	-21	swapper/2	19:45:01	2
1767886	99	31	22,5	cyclictest	1819963	-21	tail	21:35:26	2
1767882	99	31	22,5	cyclictest	1769712	-21	grep	19:15:01	1
1767882	99	31	22,4	cyclictest	0	-21	swapper/1	00:40:01	1
1767882	99	31	17,3	cyclictest	13	1	rcu_preempt	19:30:13	1
1767879	99	31	17,11	cyclictest	0	-21	swapper/0	21:50:02	0
1767891	99	30	2,4	cyclictest	13	1	rcu_preempt	20:20:13	3
1767891	99	30	21,6	cyclictest	0	-21	swapper/3	20:40:23	3
1767886	99	30	24,4	cyclictest	1829217	-21	kworker/u8:3+events_unbound	22:46:42	2
1767886	99	30	22,4	cyclictest	0	-21	swapper/2	21:05:16	2
1767886	99	30	21,6	cyclictest	0	-21	swapper/2	22:50:24	2
1767886	99	30	21,6	cyclictest	0	-21	swapper/2	22:50:23	2
1767886	99	30	20,6	cyclictest	0	-21	swapper/2	19:25:25	2
1767882	99	30	23,4	cyclictest	1846445	-21	unixbench_singl	22:50:24	1
1767882	99	30	23,4	cyclictest	1846445	-21	unixbench_singl	22:50:24	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17