OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot4s.osadl.org (updated Fri Dec 19, 2025 00:44:15)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
800990	2	89	0,2	chrt	575	-21	kworker/3:2+events	20:20:00	3
881256	2	77	0,4	sleep3	0	-21	swapper/3	21:40:01	3
949881	2	67	0,3	sleep0	0	-21	swapper/0	22:49:15	0
791324	2	62	0,2	sleep3	48	1	ktimers/3	20:10:01	3
729906	99	55	43,9	cyclictest	697861	-21	munin-node	19:15:01	1
729901	99	54	43,8	cyclictest	278	-21	systemd-journal	20:35:01	0
729901	99	50	36,3	cyclictest	826045	-21	kworker/u8:3+events_unbound	20:45:38	0
729901	99	50	36,3	cyclictest	826045	-21	kworker/u8:3+events_unbound	20:45:37	0
729910	99	49	38,9	cyclictest	850663	-21	cp	21:10:01	2
729906	99	48	43,4	cyclictest	761298	-21	kworker/u8:2+flush-8:0	19:54:02	1
729901	99	45	39,4	cyclictest	736949	-21	kworker/u8:0+flush-8:0	19:34:12	0
729901	99	45	36,7	cyclictest	945218	-21	latency_hist	22:45:01	0
729910	99	44	35,7	cyclictest	896179	-21	cat	21:55:00	2
729901	99	44	39,4	cyclictest	875893	-21	kworker/u8:3+flush-8:0	23:29:13	0
729901	99	44	39,4	cyclictest	826045	-21	kworker/u8:3+flush-8:0	20:59:10	0
729901	99	44	39,4	cyclictest	761298	-21	kworker/u8:2+flush-8:0	19:54:17	0
729901	99	44	0,42	cyclictest	825840	-21	munin-run	20:45:00	0
774072	2	43	0,4	sleep2	0	-21	swapper/2	19:54:07	2
729901	99	43	37,4	cyclictest	736949	-21	kworker/u8:0+events_unbound	19:40:00	0
729901	99	42	37,4	cyclictest	881352	-21	kworker/u8:0+flush-8:0	21:49:14	0
729901	99	42	37,3	cyclictest	970269	-21	kworker/u8:1+events_unbound	23:39:04	0
729901	99	42	37,3	cyclictest	950356	-21	kworker/u8:2+events_unbound	23:09:03	0
729901	99	42	36,4	cyclictest	875893	-21	kworker/u8:3+events_unbound	22:20:01	0
729901	99	41	36,3	cyclictest	980146	-21	kworker/u8:2+flush-8:0	23:49:12	0
729901	99	40	36,3	cyclictest	980146	-21	kworker/u8:2+flush-8:0	23:34:15	0
729906	99	39	35,3	cyclictest	806119	-21	kworker/u8:0+flush-8:0	20:29:00	1
729906	99	39	34,4	cyclictest	781513	-21	kworker/u8:3+flush-8:0	20:24:16	1
729906	99	39	34,3	cyclictest	881352	-21	kworker/u8:0+flush-8:0	21:49:14	1
729906	99	38	33,4	cyclictest	950356	-21	kworker/u8:2+events_unbound	22:54:02	1
729906	99	38	33,4	cyclictest	875893	-21	kworker/u8:3+flush-8:0	22:09:14	1
729901	99	38	33,4	cyclictest	781513	-21	kworker/u8:3+flush-8:0	20:04:08	0
729901	99	38	32,4	cyclictest	736949	-21	kworker/u8:0+flush-8:0	19:29:19	0
725258	2	38	4,10	sleep1	0	-21	swapper/1	19:06:16	1
729901	99	37	33,3	cyclictest	720298	-21	kworker/u8:1+events_unbound	19:15:06	0
729901	99	37	32,4	cyclictest	915721	-21	kworker/u8:1+events_unbound	22:39:09	0
729906	99	36	31,4	cyclictest	881352	-21	kworker/u8:0+flush-8:0	21:54:15	1
729906	99	36	27,7	cyclictest	278	-21	systemd-journal	20:04:04	1
729906	99	36	27,7	cyclictest	1000413	-21	apt-get	23:43:55	1
729901	99	36	31,3	cyclictest	970269	-21	kworker/u8:1+events_unbound	23:19:15	0
729901	99	36	30,5	cyclictest	736949	-21	kworker/u8:0+events_unbound	19:44:11	0
729901	99	36	30,4	cyclictest	761298	-21	kworker/u8:2+events_unbound	19:58:58	0
729901	99	36	27,7	cyclictest	875893	-21	kworker/u8:3+events_unbound	23:23:59	0
729901	99	36	26,8	cyclictest	1038580	-21	ntpq	00:19:08	0
729910	99	35	28,5	cyclictest	881118	-21	cat	21:40:01	2
729901	99	35	31,3	cyclictest	826045	-21	kworker/u8:3+events_unbound	21:24:20	0
729901	99	35	30,3	cyclictest	875893	-21	kworker/u8:3+events_unbound	22:24:03	0
729901	99	35	29,4	cyclictest	835680	-21	kworker/u8:0+events_unbound	21:19:03	0
729901	99	35	24,8	cyclictest	970569	-21	/usr/sbin/munin	23:14:08	0
729906	99	34	29,4	cyclictest	781513	-21	kworker/u8:3+flush-8:0	20:09:00	1
729906	99	34	27,5	cyclictest	278	-21	systemd-journal	22:30:00	1
729906	99	34	24,8	cyclictest	860561	-21	apt-get	21:20:00	1
729906	99	34	23,8	cyclictest	999613	-21	latency_hist	23:40:01	1
729901	99	34	29,3	cyclictest	881352	-21	kworker/u8:0+events_unbound	21:55:00	0
729901	99	34	28,4	cyclictest	786770	-21	apt-get	20:08:55	0
729901	99	34	23,7	cyclictest	950356	-21	kworker/u8:2+events_unbound	22:53:56	0
729901	99	34	20,5	cyclictest	875893	-21	kworker/u8:3+events_unbound	22:09:10	0
729910	99	33	24,7	cyclictest	278	-21	systemd-journal	21:10:07	2
729906	99	33	29,3	cyclictest	875893	-21	kworker/u8:3+flush-8:0	22:34:13	1
729906	99	33	28,4	cyclictest	875893	-21	kworker/u8:3+flush-8:0	22:44:12	1
729906	99	33	28,4	cyclictest	826045	-21	kworker/u8:3+flush-8:0	20:54:15	1
729906	99	33	28,3	cyclictest	735569	-21	kthreadcore	19:15:04	1
729906	99	33	27,5	cyclictest	835680	-21	kworker/u8:0+events_unbound	21:20:03	1
729906	99	33	26,5	cyclictest	915721	-21	kworker/u8:1+flush-8:0	22:39:11	1
729901	99	33	27,4	cyclictest	970269	-21	kworker/u8:1+flush-8:0	23:44:00	0
729901	99	33	27,4	cyclictest	881352	-21	kworker/u8:0+events_unbound	23:04:08	0
729901	99	33	27,4	cyclictest	881352	-21	kworker/u8:0+events_unbound	23:04:08	0
729901	99	33	27,4	cyclictest	866216	-21	kworker/u8:1+flush-8:0	21:39:06	0
729901	99	33	27,4	cyclictest	1010091	-21	kworker/u8:0+events_unbound	23:55:00	0
729901	99	33	26,5	cyclictest	751531	-21	kworker/u8:1+events_unbound	20:40:00	0
729901	99	33	26,4	cyclictest	1029341	-21	kworker/u8:3+events_unbound	00:35:08	0
729901	99	33	24,7	cyclictest	929915	-21	ntpq	22:29:11	0
729901	99	33	23,8	cyclictest	800964	-21	latency_hist	20:20:01	0
729901	99	33	0,30	cyclictest	835679	-21	true	20:55:00	0
725269	2	33	4,9	sleep2	0	-21	swapper/2	19:06:25	2
729910	99	32	25,5	cyclictest	278	-21	systemd-journal	22:21:37	2
729906	99	32	26,4	cyclictest	881352	-21	kworker/u8:0+events_unbound	22:05:00	1
729901	99	32	27,4	cyclictest	736949	-21	kworker/u8:0+flush-8:0	19:24:10	0
729901	99	32	27,3	cyclictest	720298	-21	kworker/u8:1+events_unbound	19:14:02	0
729901	99	32	25,5	cyclictest	980146	-21	kworker/u8:2+events_unbound	00:33:56	0
729901	99	32	25,5	cyclictest	826045	-21	kworker/u8:3+flush-8:0	21:09:05	0
729901	99	32	25,5	cyclictest	766844	-21	/usr/sbin/munin	19:49:07	0
729901	99	32	25,5	cyclictest	766844	-21	/usr/sbin/munin	19:49:07	0
879585	2	31	0,5	sleep1	0	-21	swapper/1	21:39:06	1
729910	99	31	27,3	cyclictest	970269	-21	kworker/u8:1+events_unbound	23:39:08	2
729910	99	31	26,3	cyclictest	741476	-21	unixbench_multi	19:19:14	2
729906	99	31	25,4	cyclictest	761298	-21	kworker/u8:2+flush-8:0	19:49:06	1
729906	99	31	25,4	cyclictest	761298	-21	kworker/u8:2+flush-8:0	19:49:05	1
729901	99	31	27,3	cyclictest	1010091	-21	kworker/u8:0+events_unbound	00:25:09	0
729901	99	31	19,4	cyclictest	835680	-21	kworker/u8:0+events_unbound	21:30:38	0
729906	99	30	25,4	cyclictest	866216	-21	kworker/u8:1+flush-8:0	21:34:02	1
729906	99	30	25,4	cyclictest	826045	-21	kworker/u8:3+events_unbound	21:09:04	1
729906	99	30	24,5	cyclictest	875893	-21	kworker/u8:3+events_unbound	23:28:59	1
729906	99	30	24,4	cyclictest	751531	-21	kworker/u8:1+events_unbound	20:30:02	1
729906	99	30	21,7	cyclictest	750893	-21	ntpq	19:29:10	1
729901	99	30	26,3	cyclictest	980146	-21	kworker/u8:2+flush-8:0	00:05:00	0
729901	99	30	26,3	cyclictest	751531	-21	kworker/u8:1+flush-8:0	20:14:14	0
729901	99	30	26,3	cyclictest	411	-21	dbus-daemon	22:15:02	0
729901	99	30	21,6	cyclictest	855622	-21	latency_hist	21:15:01	0
729910	99	29	23,4	cyclictest	800837	-21	unixbench_singl	20:19:16	2
729906	99	29	23,5	cyclictest	761298	-21	kworker/u8:2+flush-8:0	21:44:17	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17