OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #b, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackbslot2.osadl.org (updated Mon Dec 01, 2025 12:44:40)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3287499	2	229	200,19	sleep1	0	-21	swapper/1	07:08:31	1
3287359	2	228	199,19	sleep2	0	-21	swapper/2	07:06:44	2
3287542	2	225	196,19	sleep3	0	-21	swapper/3	07:09:06	3
3287544	2	220	191,19	sleep0	0	-21	swapper/0	07:09:06	0
3374465	2	148	0,0	sleep1	3374463	-21	ntpq	08:45:25	1
3287785	99	73	6,66	cyclictest	3466201	-21	kworker/u8:1+efi_rts_wq	11:36:07	0
3287795	99	62	1,60	cyclictest	3513887	-21	kworker/u8:0+efi_rts_wq	11:36:08	3
3287792	99	57	49,3	cyclictest	3513887	-21	kworker/u8:0+flush-179:0	11:35:15	2
3287792	99	57	49,3	cyclictest	3431867	-21	kworker/u8:2+events_unbound	10:00:14	2
3287788	99	57	51,4	cyclictest	3383888	-21	latency_hist	09:00:01	1
3287785	99	55	50,4	cyclictest	3475362	-21	snmp_wanpowerct	10:45:02	0
3287792	99	53	53,0	cyclictest	3332923	-21	awk	08:00:07	2
3287792	99	53	50,2	cyclictest	3466201	-21	kworker/u8:1+events_unbound	10:45:00	2
3287792	99	53	50,2	cyclictest	3296736	-21	kworker/u8:3+flush-179:0	07:35:15	2
3287788	99	53	0,6	cyclictest	0	-21	swapper/1	08:00:16	1
3287795	99	51	50,0	cyclictest	3332922	-21	awk	08:00:07	3
3287785	99	50	48,2	cyclictest	3309502	-21	kworker/u8:2+flush-179:0	07:45:26	0
3287785	99	49	43,5	cyclictest	3546449	-21	apt-get	12:05:14	0
3287795	99	48	45,2	cyclictest	3284290	-21	kworker/u8:2+flush-179:0	07:15:16	3
3287792	99	48	45,2	cyclictest	3296736	-21	kworker/u8:3+events_unbound	07:20:06	2
3287792	99	47	43,3	cyclictest	3478313	-21	kworker/u8:2+events_unbound	10:55:13	2
3287792	99	47	43,3	cyclictest	3478313	-21	kworker/u8:2+events_unbound	10:55:13	2
3287792	99	46	42,3	cyclictest	3505607	-21	kworker/u8:2+events_unbound	11:40:12	2
3287795	99	45	42,2	cyclictest	3478313	-21	kworker/u8:2+events_unbound	11:05:13	3
3287795	99	45	42,2	cyclictest	3422746	-21	kworker/u8:1+events_unbound	09:55:16	3
3287795	99	45	34,10	cyclictest	3501149	-21	kworker/u8:3+flush-179:0	11:20:27	3
3287792	99	45	42,2	cyclictest	3379241	-21	kworker/u8:3+flush-179:0	09:15:16	2
3287792	99	45	39,3	cyclictest	3457043	-21	kworker/u8:3+flush-179:0	10:35:16	2
3287795	99	44	41,2	cyclictest	3353050	-21	kworker/u8:2+flush-179:0	08:25:16	3
3287795	99	44	40,3	cyclictest	3278803	-21	kworker/u8:1+flush-179:0	07:20:16	3
3287792	99	44	40,3	cyclictest	3409745	-21	kworker/u8:3+events_unbound	09:45:01	2
3287788	99	44	41,2	cyclictest	3309743	-21	gpgv	07:35:01	1
3287785	99	44	38,4	cyclictest	3292202	-21	/usr/share/muni	07:15:01	0
3287795	99	43	39,3	cyclictest	3457043	-21	kworker/u8:3+events_unbound	11:00:14	3
3287792	99	43	40,2	cyclictest	3353050	-21	kworker/u8:2+events_unbound	08:40:14	2
3568388	2	42	0,1	sleep2	0	-21	swapper/2	12:30:15	2
3287795	99	42	39,2	cyclictest	3466201	-21	kworker/u8:1+flush-179:0	11:30:14	3
3287795	99	42	38,3	cyclictest	3335000	-21	kworker/u8:0+flush-179:0	08:20:27	3
3287792	99	42	39,2	cyclictest	3457043	-21	kworker/u8:3+flush-179:0	10:25:17	2
3287792	99	42	38,3	cyclictest	3466201	-21	kworker/u8:1+flush-179:0	11:05:16	2
3287785	99	42	39,2	cyclictest	3488063	-21	gpgv	11:00:00	0
3287785	99	42	39,2	cyclictest	3488063	-21	gpgv	11:00:00	0
3287795	99	41	37,3	cyclictest	3557499	-21	latency_hist	12:20:01	3
3287792	99	41	38,2	cyclictest	3278803	-21	kworker/u8:1+events_unbound	07:25:02	2
3287792	99	41	37,3	cyclictest	3326944	-21	kworker/2:1+pm	08:15:08	2
3287792	99	41	35,2	cyclictest	3466201	-21	kworker/u8:1+flush-179:0	11:30:16	2
3287788	99	41	37,3	cyclictest	3483989	-21	/usr/share/muni	10:55:13	1
3287788	99	41	37,3	cyclictest	3483989	-21	/usr/share/muni	10:55:12	1
3287795	99	40	37,2	cyclictest	3505607	-21	kworker/u8:2+flush-179:0	11:25:12	3
3287795	99	40	37,2	cyclictest	3466201	-21	kworker/u8:1+events_unbound	11:50:30	3
3287795	99	40	37,2	cyclictest	3422746	-21	kworker/u8:1+flush-179:0	09:50:22	3
3287792	99	40	38,1	cyclictest	3513931	-21	kworker/2:0+pm	12:00:56	2
3287792	99	40	38,1	cyclictest	3403447	-21	kworker/2:0+pm	09:36:25	2
3287792	99	40	38,1	cyclictest	3380150	-21	kworker/2:1+pm	09:00:17	2
3287792	99	40	38,1	cyclictest	3318900	-21	ThreadPoolForeg	07:45:00	2
3287792	99	40	37,2	cyclictest	3403447	-21	kworker/2:0+pm	09:45:18	2
3287792	99	40	37,2	cyclictest	3335000	-21	kworker/u8:0+flush-179:0	08:30:06	2
3287792	99	40	36,3	cyclictest	3284290	-21	kworker/u8:2+events_unbound	07:15:06	2
3287792	99	40	34,3	cyclictest	3522699	-21	kworker/u8:3+events_unbound	12:25:15	2
3287788	99	40	35,3	cyclictest	3425588	-21	ntpq	09:45:15	1
3287788	99	40	27,4	cyclictest	3418612	-21	cp	09:40:00	1
3287795	99	39	36,2	cyclictest	3296736	-21	kworker/u8:3+events_unbound	07:50:15	3
3287795	99	39	34,4	cyclictest	3544434	-21	/usr/share/muni	12:05:13	3
3287795	99	39	33,4	cyclictest	3301397	-21	/usr/share/muni	07:25:13	3
3287792	99	39	37,1	cyclictest	3496778	-21	kworker/2:2+pm	11:11:03	2
3287792	99	39	37,1	cyclictest	3326944	-21	kworker/2:1+pm	08:45:13	2
3287792	99	39	37,1	cyclictest	3248443	-21	kworker/2:0+pm	07:30:13	2
3287792	99	39	36,2	cyclictest	3353050	-21	kworker/u8:2+flush-179:0	09:30:25	2
3287792	99	39	36,2	cyclictest	3326944	-21	kworker/2:1+pm	07:55:44	2
3287792	99	39	35,2	cyclictest	3513931	-21	kworker/2:0+pm	12:05:04	2
3287792	99	39	34,4	cyclictest	3570527	-21	/usr/share/muni	12:35:08	2
3287792	99	39	33,3	cyclictest	3387886	-21	kworker/u8:0+events_unbound	09:55:10	2
3287788	99	39	32,5	cyclictest	3445581	-21	ntpq	10:10:04	1
3287788	99	39	29,3	cyclictest	3465868	-31	munin-html	10:30:29	1
3287785	99	39	36,2	cyclictest	3488307	-21	kworker/0:1+pm	11:05:01	0
3287785	99	39	36,2	cyclictest	3392929	-21	/usr/share/muni	09:10:03	0
3287785	99	39	36,2	cyclictest	3392929	-21	/usr/share/muni	09:10:02	0
3287785	99	39	35,3	cyclictest	3379241	-21	kworker/u8:3+flush-179:0	09:20:06	0
3287785	99	39	35,3	cyclictest	2902133	-1	kworker/0:1H+kblockd	09:25:02	0
3287785	99	39	31,6	cyclictest	3336120	-21	/usr/share/muni	08:05:03	0
3287795	99	38	32,5	cyclictest	3446433	-21	apt-get	10:10:08	3
3287792	99	38	36,1	cyclictest	3513931	-21	kworker/2:0+pm	12:11:18	2
3287792	99	38	36,1	cyclictest	3449863	-21	kworker/2:2+pm	10:30:07	2
3287792	99	38	36,1	cyclictest	3380150	-21	kworker/2:1+pm	09:06:02	2
3287792	99	38	36,1	cyclictest	3380150	-21	kworker/2:1+pm	09:06:02	2
3287792	99	38	36,1	cyclictest	3326944	-21	kworker/2:1+pm	08:36:09	2
3287792	99	38	36,1	cyclictest	3326944	-21	kworker/2:1+pm	08:21:19	2
3287792	99	38	35,2	cyclictest	3496778	-21	kworker/2:2+pm	11:15:04	2
3287792	99	38	35,2	cyclictest	3470657	-21	kworker/2:1+pm	10:50:04	2
3287792	99	38	35,2	cyclictest	3422746	-21	kworker/u8:1+events_unbound	10:15:15	2
3287792	99	38	35,2	cyclictest	3248443	-21	kworker/2:0+pm	07:40:14	2
3287792	99	38	34,3	cyclictest	3380150	-21	kworker/2:1+pm	09:10:05	2
3287792	99	38	33,3	cyclictest	3375599	-21	/usr/share/muni	08:50:10	2
3287788	99	38	36,1	cyclictest	3220529	-21	kworker/1:2+pm	07:22:12	1
3287788	99	38	35,2	cyclictest	3449217	-21	kworker/1:2+pm	10:27:54	1
3287788	99	38	31,5	cyclictest	2919607	-21	apache2	07:25:16	1
3287785	99	38	35,2	cyclictest	2902133	-1	kworker/0:1H+kblockd	11:34:10	0
3287785	99	38	34,2	cyclictest	2902133	-1	kworker/0:1H+kblockd	08:17:02	0
3287795	99	37	36,1	cyclictest	3253216	-21	kworker/3:2+pm	09:10:28	3
3287795	99	37	35,1	cyclictest	3021962	-1	kworker/3:0H+kblockd	08:35:05	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17