OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackbslot5s.osadl.org (updated Sun Feb 01, 2026 12:44:52)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3627161	99	50	4,30	cyclictest	0	-21	swapper/3	09:30:13	3
3627148	99	48	38,6	cyclictest	3737835	-21	unixbench_singl	12:25:24	0
3627148	99	48	20,3	cyclictest	0	-21	swapper/0	10:30:25	0
3627156	99	47	35,8	cyclictest	31	1	ktimers/2	08:05:11	2
3627161	99	46	38,6	cyclictest	3708791	-21	kworker/u8:2+events_unbound	11:09:33	3
3627156	99	46	34,6	cyclictest	3740556	-21	fschecks_count	12:35:20	2
3627156	99	46	33,9	cyclictest	31	1	ktimers/2	07:30:14	2
3627148	99	46	17,3	cyclictest	0	-21	swapper/0	07:20:17	0
3627148	99	46	17,3	cyclictest	0	-21	swapper/0	07:20:16	0
3627161	99	45	31,10	cyclictest	39	1	ktimers/3	08:55:12	3
3627148	99	45	38,4	cyclictest	3700618	-21	sendmail	10:40:00	0
3627148	99	45	18,7	cyclictest	3661020	-21	tune2fs	08:45:15	0
3627148	99	45	18,3	cyclictest	3686695	-21	cron	10:00:00	0
3627148	99	45	17,3	cyclictest	3645226	-21	sendmail	08:00:01	0
3627148	99	45	17,3	cyclictest	3645226	-21	sendmail	08:00:01	0
3627161	99	44	29,5	cyclictest	3657076	-21	kworker/u8:3+events_unbound	08:43:58	3
3627153	99	44	38,4	cyclictest	3632045	-21	kworker/u8:1+events_unbound	08:28:56	1
3627153	99	44	34,6	cyclictest	3698889	-21	sh	10:35:00	1
3627161	99	43	37,4	cyclictest	3657076	-21	kworker/u8:3+events_unbound	08:33:55	3
3627161	99	42	34,6	cyclictest	3688351	-21	kworker/u8:3+events_unbound	10:49:29	3
3627161	99	42	26,13	cyclictest	39	1	ktimers/3	07:15:14	3
3627156	99	42	29,9	cyclictest	3631352	-21	sendmail	07:20:00	2
3627153	99	42	33,7	cyclictest	3735034	-21	kworker/u8:0+events_unbound	12:24:46	1
3627161	99	41	28,7	cyclictest	3681245	-21	kworker/u8:0+events_unbound	09:54:20	3
3627161	99	41	28,7	cyclictest	3681245	-21	kworker/u8:0+events_unbound	09:54:20	3
3627161	99	41	25,5	cyclictest	3655227	-21	kworker/u8:0+events_unbound	08:36:41	3
3627156	99	41	32,6	cyclictest	3672816	-21	sh	09:20:00	2
3627148	99	41	30,8	cyclictest	3643106	-21	grep	07:50:24	0
3627148	99	41	30,8	cyclictest	3643106	-21	grep	07:50:24	0
3627161	99	40	29,7	cyclictest	3737799	-21	grep	12:25:24	3
3627156	99	40	32,5	cyclictest	3649897	-21	runrttasks	08:10:26	2
3627156	99	40	27,9	cyclictest	3707448	-21	idleruntime-cro	11:00:00	2
3627153	99	40	26,11	cyclictest	23	1	ktimers/1	07:50:12	1
3627153	99	40	26,11	cyclictest	23	1	ktimers/1	07:50:12	1
3627161	99	39	28,7	cyclictest	0	-21	swapper/3	07:30:00	3
3627161	99	39	26,8	cyclictest	3682827	-21	grep	09:45:25	3
3627161	99	39	26,8	cyclictest	3682827	-21	grep	09:45:24	3
3627156	99	39	29,7	cyclictest	3629141	-21	latency_hist	07:15:01	2
3627153	99	39	31,4	cyclictest	3645228	-21	kthreadd	08:00:00	1
3627153	99	39	31,4	cyclictest	3645228	-21	kthreadd	08:00:00	1
3627153	99	39	18,11	cyclictest	13	1	rcu_preempt	07:15:18	1
3627161	99	38	29,6	cyclictest	3676452	-21	apt-key	09:30:01	3
3627153	99	38	30,4	cyclictest	0	-21	swapper/1	08:20:00	1
3627148	99	38	28,6	cyclictest	0	-21	swapper/0	11:20:26	0
3627148	99	38	28,6	cyclictest	0	-21	swapper/0	11:20:25	0
3627148	99	38	28,5	cyclictest	0	-21	swapper/0	11:40:00	0
3627161	99	37	31,4	cyclictest	3632045	-21	kworker/u8:1+events_unbound	07:48:46	3
3627161	99	37	26,7	cyclictest	3717230	-21	grep	11:25:25	3
3627161	99	37	26,7	cyclictest	3681111	-21	grep	09:40:27	3
3627156	99	37	25,7	cyclictest	3646546	-21	grep	08:00:26	2
3627156	99	37	25,7	cyclictest	3646546	-21	grep	08:00:26	2
3627161	99	36	27,5	cyclictest	3705309	-21	head	10:50:26	3
3627161	99	36	27,4	cyclictest	0	-21	swapper/3	11:20:00	3
3627161	99	36	27,4	cyclictest	0	-21	swapper/3	11:19:59	3
3627156	99	36	26,5	cyclictest	0	-21	swapper/2	10:40:01	2
3627156	99	36	25,6	cyclictest	208	-21	systemd-logind	09:08:59	2
3627153	99	36	30,4	cyclictest	3719271	-21	kworker/u8:3+events_unbound	12:14:44	1
3627153	99	36	30,4	cyclictest	3693417	-21	kworker/u8:1+events_unbound	10:29:26	1
3627153	99	36	30,4	cyclictest	3688351	-21	kworker/u8:3+events_unbound	11:24:36	1
3627153	99	36	30,4	cyclictest	3688351	-21	kworker/u8:3+events_unbound	11:24:36	1
3627153	99	36	28,5	cyclictest	0	-21	swapper/1	10:04:59	1
3627153	99	36	24,7	cyclictest	3686246	-21	unixbench_multi	09:55:26	1
3627148	99	36	28,4	cyclictest	0	-21	swapper/0	07:40:01	0
3627148	99	36	27,6	cyclictest	3636676	-21	idleruntime-cro	07:35:00	0
3627148	99	36	22,10	cyclictest	12	1	ktimers/0	08:10:14	0
3627161	99	35	29,4	cyclictest	3674183	-21	kworker/u8:1+events_unbound	09:24:16	3
3627161	99	35	27,6	cyclictest	3691514	-21	kworker/u8:2+events_unbound	10:14:22	3
3627156	99	35	27,4	cyclictest	0	-21	swapper/2	11:15:01	2
3627153	99	35	27,4	cyclictest	0	-21	swapper/1	09:45:14	1
3627153	99	35	27,4	cyclictest	0	-21	swapper/1	09:45:14	1
3627153	99	35	24,7	cyclictest	3674135	-21	grep	09:20:25	1
3627148	99	35	27,4	cyclictest	0	-21	swapper/0	09:40:28	0
3627161	99	34	28,4	cyclictest	3662309	-21	kworker/u8:2+events_unbound	09:08:59	3
3627161	99	34	26,5	cyclictest	0	-21	swapper/3	11:45:01	3
3627161	99	34	26,4	cyclictest	0	-21	swapper/3	10:30:01	3
3627161	99	34	26,4	cyclictest	0	-21	swapper/3	10:00:28	3
3627161	99	34	25,6	cyclictest	3698891	-21	cron	10:35:01	3
3627161	99	34	25,4	cyclictest	0	-21	swapper/3	10:25:00	3
3627156	99	34	26,4	cyclictest	0	-21	swapper/2	12:00:01	2
3627156	99	34	24,6	cyclictest	3710388	-21	grep	11:05:26	2
3627156	99	34	20,9	cyclictest	3722400	-21	grep	11:40:24	2
3627153	99	34	9,15	cyclictest	24	-21	ksoftirqd/1	09:35:19	1
3627153	99	34	26,4	cyclictest	0	-21	swapper/1	11:05:16	1
3627153	99	34	24,6	cyclictest	3629108	-21	mkdir	07:15:02	1
3627153	99	34	16,3	cyclictest	13	1	rcu_preempt	12:30:14	1
3627153	99	34	11,12	cyclictest	24	-21	ksoftirqd/1	11:15:20	1
3627153	99	34	11,12	cyclictest	24	-21	ksoftirqd/1	11:15:19	1
3627153	99	34	11,12	cyclictest	13	1	rcu_preempt	07:30:21	1
3627153	99	34	0,21	cyclictest	0	-21	swapper/1	11:55:13	1
3627161	99	33	23,6	cyclictest	0	-21	swapper/3	07:40:26	3
3627161	99	33	22,6	cyclictest	0	-21	swapper/3	11:35:24	3
3627161	99	33	17,6	cyclictest	199	-21	systemd-network	11:00:17	3
3627156	99	33	19,9	cyclictest	3693539	-21	cron	10:20:00	2
3627153	99	33	27,4	cyclictest	3669400	-21	cron	09:10:01	1
3627153	99	33	1,8	cyclictest	0	-21	swapper/1	12:00:12	1
3627148	99	33	26,4	cyclictest	0	-21	swapper/0	11:15:25	0
3627148	99	33	26,4	cyclictest	0	-21	swapper/0	11:15:24	0
3627148	99	33	25,4	cyclictest	0	-21	swapper/0	09:20:24	0
3627161	99	32	25,4	cyclictest	0	-21	swapper/3	12:20:24	3
3627161	99	32	22,7	cyclictest	3661005	-21	fschecks_count	08:45:15	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17