OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot4s.osadl.org (updated Wed Aug 12, 2026 12:44:14)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
48685	99	204	199,3	cyclictest	213225	-21	strings	09:52:55	2
48685	99	193	183,7	cyclictest	291675	-21	cut	11:12:52	2
48682	99	155	151,2	cyclictest	0	-21	swapper/1	09:52:55	1
48680	99	145	128,15	cyclictest	0	-21	swapper/0	09:52:55	0
48682	99	138	132,3	cyclictest	291676	-21	tr	11:12:52	1
48680	99	130	112,16	cyclictest	0	-21	swapper/0	11:12:52	0
276829	2	100	0,6	chrt	0	-21	swapper/2	10:57:53	2
48682	99	57	52,4	cyclictest	249004	-21	kworker/u8:0+flush-8:0	10:43:00	1
48682	99	56	51,3	cyclictest	4194100	-21	kworker/u8:1+events_unbound	07:27:47	1
48682	99	55	49,4	cyclictest	268996	-21	kworker/u8:3+events_unbound	12:17:51	1
48682	99	54	48,4	cyclictest	298917	-21	kworker/u8:1+events_unbound	11:58:03	1
48682	99	53	48,4	cyclictest	298917	-21	kworker/u8:1+events_unbound	12:02:58	1
48682	99	52	48,2	cyclictest	174743	-21	kworker/u8:0+events_unbound	09:22:48	1
48682	99	52	46,5	cyclictest	114716	-21	kworker/u8:0+flush-8:0	08:22:48	1
48682	99	52	46,4	cyclictest	4194100	-21	kworker/u8:1+flush-8:0	07:15:05	1
48682	99	52	43,6	cyclictest	174494	-21	latency_hist	09:15:01	1
48682	99	51	45,4	cyclictest	298917	-21	kworker/u8:1+flush-8:0	12:08:02	1
48680	99	51	44,5	cyclictest	367874	-21	latency_hist	12:30:01	0
48682	99	49	44,4	cyclictest	234101	-21	kworker/u8:2+flush-8:0	11:38:00	1
48682	99	49	43,5	cyclictest	85220	-21	kworker/u8:0+events_unbound	07:58:01	1
48680	99	49	39,8	cyclictest	275	-21	systemd-journal	09:25:01	0
48685	99	48	40,6	cyclictest	275	-21	systemd-journal	12:10:00	2
48682	99	48	43,4	cyclictest	234101	-21	kworker/u8:2+events_unbound	10:32:47	1
48682	99	47	43,3	cyclictest	268996	-21	kworker/u8:3+flush-8:0	11:05:16	1
48682	99	47	42,4	cyclictest	114716	-21	kworker/u8:0+events_unbound	08:17:50	1
48682	99	47	42,3	cyclictest	75530	-21	kworker/u8:3+events_unbound	08:27:46	1
48682	99	47	41,5	cyclictest	125044	-21	kworker/u8:1+flush-8:0	09:17:50	1
48682	99	47	39,6	cyclictest	308990	-21	/usr/sbin/munin	11:33:01	1
48682	99	47	38,7	cyclictest	3447475	-21	kworker/u8:0+flush-8:0	07:33:02	1
48682	99	47	37,7	cyclictest	248262	-21	ntpq	10:27:58	1
48682	99	46	42,3	cyclictest	298917	-21	kworker/u8:1+events_unbound	11:47:46	1
48682	99	46	40,5	cyclictest	125044	-21	kworker/u8:1+flush-8:0	09:57:56	1
48682	99	46	40,4	cyclictest	174743	-21	kworker/u8:0+flush-8:0	09:48:00	1
48682	99	46	35,9	cyclictest	249004	-21	kworker/u8:0+events_unbound	10:47:49	1
48682	99	45	40,4	cyclictest	239122	-21	kworker/u8:1+events_unbound	10:22:56	1
48682	99	45	40,4	cyclictest	239122	-21	kworker/u8:1+events_unbound	10:22:56	1
48680	99	45	39,4	cyclictest	85220	-21	kworker/u8:0+flush-8:0	07:55:16	0
48680	99	45	35,8	cyclictest	125736	-21	diskstats	08:27:48	0
48680	99	45	34,9	cyclictest	149047	-21	ntpq	08:47:56	0
48682	99	44	38,5	cyclictest	239122	-21	kworker/u8:1+flush-8:0	10:52:57	1
48682	99	44	38,5	cyclictest	184355	-21	kworker/u8:2+events_unbound	09:37:47	1
48682	99	44	38,4	cyclictest	3447475	-21	kworker/u8:0+events_unbound	07:23:01	1
48682	99	44	38,4	cyclictest	125044	-21	kworker/u8:1+flush-8:0	10:07:48	1
48682	99	44	37,5	cyclictest	249004	-21	kworker/u8:0+flush-8:0	10:37:54	1
48682	99	43	39,3	cyclictest	234101	-21	kworker/u8:2+events_unbound	11:15:51	1
48682	99	43	38,4	cyclictest	298917	-21	kworker/u8:1+events_unbound	12:37:56	1
48682	99	43	37,4	cyclictest	75530	-21	kworker/u8:3+events_unbound	07:42:45	1
48682	99	43	37,4	cyclictest	125044	-21	kworker/u8:1+events_unbound	08:57:45	1
48685	99	42	12,13	cyclictest	348569	-21	apt-get	12:12:49	2
48685	99	42	12,13	cyclictest	348569	-21	apt-get	12:12:48	2
48682	99	42	37,4	cyclictest	268996	-21	kworker/u8:3+flush-8:0	10:57:51	1
48682	99	42	37,3	cyclictest	75530	-21	kworker/u8:3+flush-8:0	07:37:51	1
48682	99	42	37,3	cyclictest	174743	-21	kworker/u8:0+events_unbound	09:27:47	1
48682	99	42	35,5	cyclictest	85220	-21	kworker/u8:0+flush-8:0	07:47:55	1
48682	99	41	36,4	cyclictest	125044	-21	kworker/u8:1+flush-8:0	10:02:47	1
48682	99	41	36,4	cyclictest	125044	-21	kworker/u8:1+flush-8:0	09:07:50	1
48682	99	40	36,3	cyclictest	75530	-21	kworker/u8:3+events_unbound	08:13:02	1
48682	99	40	35,4	cyclictest	298917	-21	kworker/u8:1+events_unbound	12:27:55	1
48682	99	40	35,3	cyclictest	174743	-21	kworker/u8:0+events_unbound	09:32:51	1
48682	99	40	33,5	cyclictest	114716	-21	kworker/u8:0+flush-8:0	08:32:57	1
48682	99	40	30,7	cyclictest	275	-21	systemd-journal	09:05:00	1
48682	99	40	30,7	cyclictest	105395	-21	/usr/sbin/munin	08:08:01	1
48680	99	40	32,6	cyclictest	288779	-21	latency_hist	11:10:01	0
48680	99	40	31,7	cyclictest	189755	-21	/usr/sbin/munin	09:32:54	0
48680	99	40	29,8	cyclictest	243815	-21	apt	10:25:00	0
48680	99	40	29,8	cyclictest	243815	-21	apt	10:25:00	0
48380	2	40	27,9	sleep2	0	-21	swapper/2	07:08:40	2
48682	99	39	33,5	cyclictest	323410	-21	kworker/u8:0+flush-8:0	11:53:03	1
48682	99	39	33,4	cyclictest	298917	-21	kworker/u8:1+flush-8:0	12:22:50	1
207149	2	39	0,6	sleep2	0	-21	swapper/2	09:47:51	2
48680	99	38	33,3	cyclictest	174743	-21	kworker/u8:0+flush-8:0	09:27:51	0
48456	2	38	4,9	sleep1	0	-21	swapper/1	07:09:38	1
48682	99	37	33,3	cyclictest	145101	-21	kworker/u8:3+flush-8:0	08:53:02	1
48680	99	37	33,3	cyclictest	114716	-21	kworker/u8:0+events_unbound	08:33:00	0
87424	2	36	0,2	sleep3	47	1	rcuc/3	07:47:51	3
48682	99	36	30,5	cyclictest	234101	-21	kworker/u8:2+flush-8:0	11:03:03	1
48682	99	36	30,4	cyclictest	4194100	-21	kworker/u8:1+events_unbound	07:52:59	1
48682	99	36	29,5	cyclictest	114716	-21	kworker/u8:0+events_unbound	08:37:46	1
48680	99	36	32,3	cyclictest	4194100	-21	kworker/u8:1+flush-8:0	08:08:04	0
48680	99	36	30,4	cyclictest	298917	-21	kworker/u8:1+flush-8:0	12:32:49	0
48680	99	36	29,6	cyclictest	85220	-21	kworker/u8:0+flush-8:0	08:02:59	0
48680	99	36	28,6	cyclictest	275	-21	systemd-journal	07:20:01	0
48682	99	35	30,3	cyclictest	298917	-21	kworker/u8:1+flush-8:0	11:27:57	1
48682	99	35	29,5	cyclictest	85220	-21	kworker/u8:0+events_unbound	08:02:56	1
48682	99	35	29,4	cyclictest	234101	-21	kworker/u8:2+flush-8:0	10:17:49	1
48682	99	35	29,4	cyclictest	234101	-21	kworker/u8:2+flush-8:0	10:17:49	1
48680	99	35	29,4	cyclictest	199194	-21	latency_hist	09:40:01	0
48680	99	35	26,7	cyclictest	275	-21	systemd-journal	12:40:00	0
48680	99	34	30,3	cyclictest	4194100	-21	kworker/u8:1+flush-8:0	07:47:59	0
48680	99	34	30,3	cyclictest	120078	-21	latency_hist	08:20:01	0
48680	99	34	29,4	cyclictest	75530	-21	kworker/u8:3+flush-8:0	07:35:31	0
48680	99	34	25,7	cyclictest	304054	-21	/usr/sbin/munin	11:28:00	0
48680	99	34	24,7	cyclictest	238839	-21	latency_hist	10:20:00	0
48680	99	34	24,7	cyclictest	238839	-21	latency_hist	10:20:00	0
48685	99	33	25,6	cyclictest	275	-21	systemd-journal	09:45:00	2
48685	99	33	23,8	cyclictest	288776	-21	turbostat.cron	11:10:00	2
48685	99	33	18,9	cyclictest	219479	-21	apt-get	10:02:43	2
48682	99	33	29,3	cyclictest	268996	-21	kworker/u8:3+flush-8:0	11:42:57	1
48682	99	33	28,4	cyclictest	125044	-21	kworker/u8:1+events_unbound	08:47:48	1
48682	99	33	27,5	cyclictest	228955	-21	kworker/u8:0+events_unbound	10:15:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17