OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 50 highest latencies:

System (updated Thu Mar 26, 2026 12:44:06)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2136209	99	42	39,2	cyclictest	2359167	-21	kworker/u8:2+events_unbound	10:50:15	3
2136209	99	35	32,2	cyclictest	2416302	-21	kworker/u8:1+flush-259:0	11:50:23	3
2136209	99	35	32,2	cyclictest	2416302	-21	kworker/u8:1+flush-259:0	11:50:23	3
2136209	99	35	32,2	cyclictest	2255355	-21	kworker/u8:4+events_unbound	10:40:14	3
2136205	99	34	28,4	cyclictest	252	-21	systemd-journal	10:04:29	2
2136205	99	33	29,3	cyclictest	3282653	-21	kworker/u8:1+flush-259:0	07:45:01	2
2136209	99	31	28,2	cyclictest	2229545	-21	kworker/u8:1+events_unbound	08:50:24	3
2136199	99	31	28,2	cyclictest	2328220	-21	kworker/u8:1+events_unbound	10:25:15	0
2136209	99	30	27,2	cyclictest	3282653	-21	kworker/u8:1+events_unbound	07:25:20	3
2136209	99	30	27,2	cyclictest	2245024	-21	kworker/u8:0+events_unbound	09:25:19	3
2136209	99	30	26,3	cyclictest	2131239	-21	kworker/u8:0+events_unbound	07:35:21	3
2136209	99	29	25,2	cyclictest	2198633	-21	kworker/u8:3+events_unbound	09:05:17	3
2136209	99	28	25,2	cyclictest	2287044	-21	kworker/u8:3+events_unbound	09:40:22	3
2136209	99	28	25,2	cyclictest	2198633	-21	kworker/u8:3+flush-259:0	08:20:23	3
2136205	99	28	23,3	cyclictest	2229758	-21	/usr/sbin/munin	08:40:13	2
2136201	99	28	22,4	cyclictest	2281639	-21	latency_hist	09:30:00	1
2136205	99	27	23,3	cyclictest	2287044	-21	kworker/u8:3+flush-259:0	09:45:17	2
2136201	99	27	23,3	cyclictest	2375319	-21	apt-get	11:00:11	1
2136209	99	26	24,2	cyclictest	2296724	-21	kworker/u8:0+flush-259:0	10:15:24	3
2136209	99	26	23,2	cyclictest	2436789	-21	kworker/u8:0+events_unbound	12:35:15	3
2136209	99	26	23,2	cyclictest	2401065	-21	kworker/u8:0+events_unbound	11:45:15	3
2136209	99	26	23,2	cyclictest	2385393	-21	kworker/u8:3+flush-259:0	11:40:24	3
2136209	99	26	22,3	cyclictest	2426611	-21	kworker/u8:2+events_unbound	12:25:22	3
2136209	99	26	22,3	cyclictest	2131239	-21	kworker/u8:0+flush-259:0	07:55:14	3
2136209	99	26	22,2	cyclictest	2436789	-21	kworker/u8:0+events_unbound	12:05:14	3
2136199	99	26	23,2	cyclictest	2131239	-21	kworker/u8:0+events_unbound	08:04:28	0
2136199	99	26	22,3	cyclictest	2136404	-21	apt-get	07:10:11	0
2136199	99	26	20,5	cyclictest	2337573	-21	ntpq	10:20:21	0
2136209	99	25	22,2	cyclictest	2255355	-21	kworker/u8:4+events_unbound	09:20:22	3
2136205	99	25	22,2	cyclictest	2328220	-21	kworker/u8:1+flush-259:0	11:10:13	2
2136205	99	25	21,3	cyclictest	2255354	-21	kworker/u8:2+flush-259:0	09:05:00	2
2136205	99	25	18,5	cyclictest	2349612	-21	diskstats	10:35:13	2
2136199	99	25	22,2	cyclictest	2198633	-21	kworker/u8:3+flush-259:0	08:35:24	0
2136205	99	24	18,4	cyclictest	2323045	-21	latency_hist	10:10:01	2
2136201	99	24	19,4	cyclictest	2265712	-21	apt-get	09:15:00	1
2136199	99	24	21,2	cyclictest	2287044	-21	kworker/u8:3+flush-259:0	10:00:15	0
2136209	99	23	20,2	cyclictest	2436789	-21	kworker/u8:0+flush-259:0	12:25:00	3
2136209	99	23	20,2	cyclictest	2401065	-21	kworker/u8:0+events_unbound	11:27:07	3
2136209	99	23	20,2	cyclictest	2395676	-21	kworker/u8:2+events_unbound	11:20:21	3
2136209	99	23	20,2	cyclictest	2328220	-21	kworker/u8:1+events_unbound	10:30:28	3
2136209	99	23	20,2	cyclictest	2296724	-21	kworker/u8:0+events_unbound	09:55:15	3
2136205	99	23	19,3	cyclictest	2198633	-21	kworker/u8:3+flush-259:0	08:55:18	2
2136201	99	23	17,4	cyclictest	2426587	-21	latency_hist	11:50:00	1
2136199	99	23	19,3	cyclictest	2229545	-21	kworker/u8:1+events_unbound	09:00:15	0
2136209	99	22	19,2	cyclictest	2426611	-21	kworker/u8:2+events_unbound	12:10:19	3
2136209	99	22	19,2	cyclictest	2198633	-21	kworker/u8:3+events_unbound	08:25:16	3
2136209	99	22	19,2	cyclictest	1415264	-21	kworker/u8:2+events_unbound	07:15:15	3
2136209	99	22	18,3	cyclictest	2281656	-21	kworker/u8:1+events_unbound	09:30:15	3
2136209	99	22	18,3	cyclictest	2281656	-21	kworker/u8:1+events_unbound	09:30:15	3
2136201	99	22	18,2	cyclictest	0	-21	swapper/1	09:10:00	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2021-09-01 - 00:34