OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot4s.osadl.org (updated Wed Jul 15, 2026 12:44:14)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3653108	2	174	0,2	sleep3	584	-21	kworker/3:2+events	09:17:31	3
3526041	99	65	56,7	cyclictest	3672127	-21	kworker/u8:3+events_unbound	09:42:42	0
3526041	99	64	57,6	cyclictest	3657044	-21	kworker/u8:0+events_unbound	09:25:00	0
3526041	99	62	55,5	cyclictest	3785476	-21	kworker/u8:1+events_unbound	11:30:00	0
3526045	99	60	54,5	cyclictest	3691500	-21	kworker/u8:3+events_unbound	11:32:41	1
3526041	99	59	53,4	cyclictest	3547698	-21	kworker/u8:3+events_unbound	08:40:00	0
3526041	99	58	53,4	cyclictest	3801312	-21	kworker/u8:1+flush-8:0	12:32:43	0
3526041	99	58	52,4	cyclictest	3553012	-21	kworker/u8:0+events_unbound	07:45:00	0
3526041	99	58	52,4	cyclictest	3553012	-21	kworker/u8:0+events_unbound	07:45:00	0
3526045	99	57	53,3	cyclictest	3716521	-21	kworker/u8:4+events_unbound	10:25:00	1
3531947	2	56	0,5	sleep3	48	1	ktimers/3	07:15:02	3
3526045	99	53	45,6	cyclictest	3855710	-21	latency_hist	12:40:01	1
3526041	99	53	49,3	cyclictest	3701395	-21	kworker/u8:0+events_unbound	10:17:43	0
3526041	99	53	47,5	cyclictest	3691500	-21	kworker/u8:3+events_unbound	11:20:01	0
3526041	99	53	47,4	cyclictest	3691500	-21	kworker/u8:3+flush-8:0	12:07:33	0
3526041	99	53	47,4	cyclictest	3691500	-21	kworker/u8:3+flush-8:0	12:07:33	0
3526041	99	53	41,4	cyclictest	3647130	-21	kworker/u8:1+events_unbound	09:52:29	0
3526041	99	52	47,4	cyclictest	3751727	-21	kworker/u8:4+flush-8:0	11:02:44	0
3526041	99	52	46,4	cyclictest	3511205	-21	kworker/u8:2+events_unbound	07:27:42	0
3526041	99	52	45,6	cyclictest	3791095	-21	kworker/u8:0+flush-8:0	11:42:45	0
3526041	99	50	45,3	cyclictest	3641975	-21	kworker/u8:2+events_unbound	09:32:27	0
3526041	99	50	45,3	cyclictest	3562613	-21	kworker/u8:1+events_unbound	08:27:43	0
3526041	99	50	43,6	cyclictest	3751727	-21	kworker/u8:4+flush-8:0	11:22:44	0
3655550	2	49	0,2	chrt	37	1	rcuc/2	09:17:34	2
3526041	99	48	43,3	cyclictest	3547698	-21	kworker/u8:3+events_unbound	07:32:32	0
3526041	99	48	43,3	cyclictest	3511205	-21	kworker/u8:2+flush-8:0	07:22:35	0
3526045	99	47	42,4	cyclictest	3511205	-21	kworker/u8:2+flush-8:0	07:27:29	1
3526041	99	47	41,5	cyclictest	3791095	-21	kworker/u8:0+events_unbound	11:55:00	0
3526041	99	47	39,6	cyclictest	3637646	-21	/usr/sbin/munin	09:02:44	0
3526041	99	46	42,3	cyclictest	3547698	-21	kworker/u8:3+events_unbound	07:47:42	0
3526041	99	46	37,7	cyclictest	3622184	-21	latency_hist	08:45:01	0
3526041	99	46	37,3	cyclictest	3547698	-21	kworker/u8:3+events_unbound	08:34:53	0
3719469	2	45	0,4	sleep3	584	-21	kworker/3:2-events	10:22:35	3
3526045	99	45	40,4	cyclictest	3612041	-21	kworker/u8:0+flush-8:0	08:37:39	1
3526045	99	45	40,4	cyclictest	3612041	-21	kworker/u8:0+events_unbound	09:07:26	1
3526045	99	45	39,5	cyclictest	3647130	-21	kworker/u8:1+flush-8:0	09:17:29	1
3526041	99	45	42,2	cyclictest	3572506	-21	kworker/u8:2+events_unbound	08:45:53	0
3526041	99	45	40,4	cyclictest	3657044	-21	kworker/u8:0+flush-8:0	09:37:28	0
3526041	99	45	40,3	cyclictest	3691500	-21	kworker/u8:3+events_unbound	11:37:29	0
3526041	99	45	35,5	cyclictest	3278130	-21	kworker/u8:1+events_unbound	07:12:43	0
3526041	99	44	40,3	cyclictest	3801312	-21	kworker/u8:1+flush-8:0	12:25:03	0
3526041	99	44	40,3	cyclictest	3647130	-21	kworker/u8:1+flush-8:0	09:27:44	0
3526041	99	44	40,3	cyclictest	3572506	-21	kworker/u8:2+events_unbound	08:15:02	0
3526041	99	44	40,3	cyclictest	3562613	-21	kworker/u8:1+events_unbound	08:07:31	0
3526041	99	44	39,3	cyclictest	3791095	-21	kworker/u8:0+events_unbound	11:47:32	0
3526041	99	44	38,4	cyclictest	3612041	-21	kworker/u8:0+events_unbound	09:00:00	0
3526041	99	44	37,5	cyclictest	3801312	-21	kworker/u8:1+events_unbound	12:37:39	0
3526041	99	44	35,3	cyclictest	3691500	-21	kworker/u8:3+events_unbound	11:06:23	0
3526041	99	43	39,3	cyclictest	3731470	-21	kworker/u8:1+events_unbound	10:37:25	0
3526041	99	43	39,3	cyclictest	3572506	-21	kworker/u8:2+events_unbound	08:12:28	0
3526041	99	43	38,3	cyclictest	3641975	-21	kworker/u8:2+events_unbound	09:07:31	0
3526045	99	42	37,4	cyclictest	3547698	-21	kworker/u8:3+flush-8:0	08:57:31	1
3526041	99	42	37,4	cyclictest	3716521	-21	kworker/u8:4+flush-8:0	10:32:44	0
3526041	99	42	36,4	cyclictest	3691500	-21	kworker/u8:3+events_unbound	12:02:31	0
3526041	99	42	36,4	cyclictest	3562613	-21	kworker/u8:1+events_unbound	07:52:41	0
3526041	99	42	33,3	cyclictest	3691500	-21	kworker/u8:3+events_unbound	11:57:35	0
3526041	99	42	32,3	cyclictest	3681609	-21	kworker/u8:2+events_unbound	10:02:32	0
3526041	99	42	31,4	cyclictest	3681609	-21	kworker/u8:2+events_unbound	09:47:38	0
3526050	99	41	35,4	cyclictest	3647130	-21	kworker/u8:1+flush-8:0	09:12:37	2
3526045	99	41	37,3	cyclictest	3691500	-21	kworker/u8:3+flush-8:0	11:12:35	1
3526045	99	41	37,3	cyclictest	3691500	-21	kworker/u8:3+flush-8:0	11:12:35	1
3526045	99	41	34,5	cyclictest	3657460	-21	apt-get	09:22:24	1
3526045	99	41	33,6	cyclictest	3548079	-21	/usr/sbin/munin	07:32:42	1
3526045	99	41	33,4	cyclictest	3691500	-21	kworker/u8:3+events_unbound	10:07:29	1
3526041	99	41	37,3	cyclictest	3766353	-21	kworker/u8:1+flush-8:0	11:12:47	0
3526041	99	41	37,3	cyclictest	3766353	-21	kworker/u8:1+flush-8:0	11:12:47	0
3526041	99	41	37,3	cyclictest	3681609	-21	kworker/u8:2+flush-8:0	10:07:44	0
3526041	99	41	37,3	cyclictest	3547698	-21	kworker/u8:3+events_unbound	07:36:54	0
3526041	99	41	36,3	cyclictest	3647130	-21	kworker/u8:1+events_unbound	09:17:27	0
3526041	99	41	29,4	cyclictest	3547698	-21	kworker/u8:3+events_unbound	08:22:00	0
3526041	99	40	36,3	cyclictest	3826359	-21	kworker/u8:2+flush-8:0	12:12:30	0
3526041	99	40	36,3	cyclictest	3751727	-21	kworker/u8:4+flush-8:0	10:57:45	0
3526041	99	40	35,4	cyclictest	3547698	-21	kworker/u8:3+flush-8:0	08:02:39	0
3526041	99	40	34,5	cyclictest	3835144	-21	kworker/u8:0+events_unbound	12:22:41	0
3526041	99	40	31,3	cyclictest	3716521	-21	kworker/u8:4+events_unbound	10:22:42	0
3526045	99	39	34,4	cyclictest	3612041	-21	kworker/u8:0+flush-8:0	08:52:30	1
3526045	99	39	31,5	cyclictest	281	-21	systemd-journal	08:47:52	1
3526041	99	39	35,3	cyclictest	3731470	-21	kworker/u8:1+events_unbound	10:42:52	0
3526041	99	39	33,4	cyclictest	3612041	-21	kworker/u8:0+events_unbound	08:54:53	0
3526045	99	38	31,5	cyclictest	281	-21	systemd-journal	10:57:52	1
3526045	99	38	30,6	cyclictest	3716521	-21	kworker/u8:4+events_unbound	10:32:39	1
3526041	99	38	34,3	cyclictest	3731470	-21	kworker/u8:1+flush-8:0	10:52:53	0
3526041	99	38	33,4	cyclictest	3681609	-21	kworker/u8:2+flush-8:0	10:12:44	0
3526041	99	38	28,4	cyclictest	3701395	-21	kworker/u8:0+events_unbound	10:27:35	0
3526050	99	37	29,6	cyclictest	281	-21	systemd-journal	10:21:51	2
3526050	99	37	28,7	cyclictest	281	-21	systemd-journal	09:40:01	2
3526045	99	37	33,3	cyclictest	3647130	-21	kworker/u8:1+events_unbound	09:57:33	1
3526045	99	37	33,3	cyclictest	3547698	-21	kworker/u8:3+flush-8:0	09:02:29	1
3526045	99	37	26,9	cyclictest	3587333	-21	apt-get	08:10:01	1
3526041	99	37	32,3	cyclictest	3511205	-21	kworker/u8:2+events_unbound	07:17:37	0
3526041	99	37	28,6	cyclictest	3731470	-21	kworker/u8:1+events_unbound	10:47:28	0
3526045	99	36	32,3	cyclictest	3278130	-21	kworker/u8:1+events_unbound	07:15:01	1
3526045	99	35	31,3	cyclictest	3553012	-21	kworker/u8:0+flush-8:0	07:37:45	1
3526045	99	35	30,4	cyclictest	3791095	-21	kworker/u8:0+events_unbound	11:47:28	1
3526045	99	35	30,4	cyclictest	3511205	-21	kworker/u8:2+flush-8:0	07:17:39	1
3526045	99	35	28,5	cyclictest	3672127	-21	kworker/u8:3+flush-8:0	09:42:44	1
3526050	99	34	25,7	cyclictest	281	-21	systemd-journal	08:25:00	2
3526045	99	34	28,4	cyclictest	3836308	-21	apt-get	12:22:25	1
3526045	99	34	27,5	cyclictest	3647130	-21	kworker/u8:1+events_unbound	09:52:33	1
3526045	99	34	26,6	cyclictest	3761818	-21	/usr/sbin/munin	11:07:35	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17