OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #f, slot #7

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7.osadl.org (updated Tue Jun 23, 2026 00:46:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2496466	99	58	58,0	cyclictest	0	-21	swapper/6	20:08:51	6
2496466	99	58	37,21	cyclictest	2671754	-21	grep	00:25:23	6
2496466	99	58	17,40	cyclictest	2512586	-21	taskset	19:38:23	6
2496466	99	57	38,19	cyclictest	78	50	ktimers/6	20:21:47	6
2496466	99	57	38,19	cyclictest	0	-21	swapper/6	23:05:39	6
2496466	99	56	38,18	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	23:02:47	6
2496466	99	56	38,18	cyclictest	0	-21	swapper/6	00:38:31	6
2496466	99	56	37,19	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	23:38:19	6
2496466	99	56	37,19	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	22:25:47	6
2496466	99	56	37,19	cyclictest	2490470	-21	kworker/6:0-mm_percpu_wq	19:13:59	6
2496466	99	56	37,0	cyclictest	0	-21	swapper/6	23:49:19	6
2496466	99	56	18,38	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	22:36:55	6
2496466	99	56	18,38	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	20:36:47	6
2496466	99	56	18,38	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	20:36:47	6
2496466	99	56	18,38	cyclictest	0	-21	swapper/6	22:59:39	6
2496466	99	56	18,38	cyclictest	0	-21	swapper/6	20:57:23	6
2496466	99	56	18,38	cyclictest	0	-21	swapper/6	00:22:07	6
2496466	99	56	18,19	cyclictest	2572278	-21	ntpq	21:25:19	6
2496466	99	56	18,19	cyclictest	2542036	-21	ntpq	20:30:21	6
2496466	99	56	17,39	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	19:29:03	6
2496466	99	56	17,39	cyclictest	2490470	-21	kworker/6:0-events	23:44:42	6
2496466	99	56	16,39	cyclictest	79	-21	ksoftirqd/6	20:45:17	6
2496466	99	56	0,37	cyclictest	2579192	-21	kworker/u32:3+events_unbound	22:05:11	6
2496466	99	55	37,18	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	20:27:11	6
2496466	99	55	36,19	cyclictest	2658256	-21	kworker/6:2+mm_percpu_wq	00:18:47	6
2496466	99	55	36,19	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	23:14:07	6
2496466	99	55	36,19	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	22:19:23	6
2496466	99	55	19,36	cyclictest	0	-21	swapper/6	21:23:41	6
2496466	99	55	17,38	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	21:52:51	6
2496466	99	55	17,38	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	21:42:55	6
2496466	99	55	17,19	cyclictest	19	1	rcu_preempt	21:14:07	6
2496466	99	55	16,39	cyclictest	2658256	-21	kworker/6:2+mm_percpu_wq	00:33:27	6
2496466	99	55	16,39	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	23:17:51	6
2496466	99	55	15,39	cyclictest	2652480	-21	sed	23:50:23	6
2496466	99	55	0,36	cyclictest	2595344	-21	kworker/u32:0+events_unbound	22:34:35	6
2496466	99	54	36,18	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	21:38:31	6
2496466	99	54	36,18	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	20:51:27	6
2496466	99	54	36,18	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	20:18:31	6
2496466	99	54	35,19	cyclictest	781	-21	mta-sts-daemon	21:59:07	6
2496466	99	54	19,15	cyclictest	0	-21	swapper/6	19:17:25	6
2496466	99	54	16,38	cyclictest	2490470	-21	kworker/6:0+mm_percpu_wq	23:23:19	6
2496466	99	54	16,19	cyclictest	2659855	-21	irqstats	00:05:17	6
2496466	99	54	0,35	cyclictest	2631562	-21	kworker/u32:1+events_unbound	00:02:47	6
2496466	99	54	0,35	cyclictest	2518623	-21	kworker/u32:0+events_unbound	19:59:11	6
2496467	99	53	14,38	cyclictest	0	-21	swapper/7	20:05:16	7
2496466	99	53	53,0	cyclictest	78	1	ktimers/6	22:25:00	6
2496466	99	53	19,15	cyclictest	0	-21	swapper/6	21:05:51	6
2496466	99	53	14,39	cyclictest	0	-21	swapper/6	22:53:13	6
2496466	99	53	14,39	cyclictest	0	-21	swapper/6	22:11:41	6
2496466	99	53	14,39	cyclictest	0	-21	swapper/6	21:15:07	6
2496466	99	53	14,39	cyclictest	0	-21	swapper/6	21:02:29	6
2496466	99	53	14,39	cyclictest	0	-21	swapper/6	19:42:17	6
2496467	99	52	12,1	cyclictest	0	-21	swapper/7	20:10:17	7
2496466	99	52	33,19	cyclictest	0	-21	swapper/6	23:27:19	6
2496466	99	52	33,19	cyclictest	0	-21	swapper/6	20:40:21	6
2496466	99	52	33,19	cyclictest	0	-21	swapper/6	20:40:21	6
2496466	99	52	33,19	cyclictest	0	-21	swapper/6	19:46:51	6
2496466	99	52	18,14	cyclictest	0	-21	swapper/6	21:31:35	6
2496466	99	52	14,19	cyclictest	2508964	-21	awk	19:30:19	6
2496466	99	52	13,39	cyclictest	0	-21	swapper/6	23:59:41	6
2496466	99	52	13,39	cyclictest	0	-21	swapper/6	23:31:13	6
2496464	99	52	13,19	cyclictest	0	-21	swapper/4	20:30:16	4
2496466	99	51	32,19	cyclictest	0	-21	swapper/6	22:44:59	6
2496466	99	51	32,19	cyclictest	0	-21	swapper/6	00:14:35	6
2496466	99	51	12,39	cyclictest	0	-21	swapper/6	20:14:19	6
2496466	99	50	32,18	cyclictest	0	-21	swapper/6	21:45:58	6
2496466	99	49	31,18	cyclictest	0	-21	swapper/6	19:54:31	6
2496466	99	49	30,19	cyclictest	0	-21	swapper/6	22:04:43	6
2496466	99	48	30,18	cyclictest	0	-21	swapper/6	22:48:38	6
2496466	99	48	29,19	cyclictest	0	-21	swapper/6	20:00:21	6
2496464	99	48	11,18	cyclictest	0	-21	swapper/4	22:30:16	4
2496466	99	47	8,39	cyclictest	0	-21	swapper/6	19:22:06	6
2496463	99	47	9,19	cyclictest	0	-21	swapper/3	21:05:18	3
2496460	99	47	9,19	cyclictest	0	-21	swapper/0	19:50:16	0
2496467	99	46	7,39	cyclictest	0	-21	swapper/7	00:05:15	7
2496464	99	45	7,19	cyclictest	0	-21	swapper/4	19:25:15	4
2496467	99	44	4,39	cyclictest	0	-21	swapper/7	22:35:17	7
2496467	99	43	4,19	cyclictest	0	-21	swapper/7	23:50:16	7
2496467	99	42	4,19	cyclictest	0	-21	swapper/7	22:00:16	7
2496464	99	41	3,19	cyclictest	0	-21	swapper/4	23:45:15	4
2496464	99	40	2,19	cyclictest	0	-21	swapper/4	21:10:17	4
2496464	99	40	2,19	cyclictest	0	-21	swapper/4	19:55:16	4
2496463	99	39	1,19	cyclictest	0	-21	swapper/3	22:25:13	3
2496463	99	39	0,34	cyclictest	0	-21	swapper/3	22:10:17	3
2496460	99	39	0,39	cyclictest	0	-21	swapper/0	00:25:22	0
2496467	99	37	0,18	cyclictest	0	-21	swapper/7	23:10:16	7
2496467	99	37	0,18	cyclictest	0	-21	swapper/7	23:00:17	7
2496460	99	37	18,19	cyclictest	17	1	ktimers/0	21:05:18	0
2496467	99	36	0,17	cyclictest	0	-21	swapper/7	22:40:15	7
2496467	99	36	0,17	cyclictest	0	-21	swapper/7	20:35:15	7
2496467	99	36	0,17	cyclictest	0	-21	swapper/7	20:35:15	7
2496460	99	36	18,0	cyclictest	0	-21	swapper/0	22:45:16	0
2496460	99	36	0,36	cyclictest	2656037	-21	latency_hist	00:00:01	0
2496460	99	36	0,17	cyclictest	0	-21	swapper/0	21:30:16	0
2496467	99	35	0,16	cyclictest	0	-21	swapper/7	20:40:15	7
2496467	99	35	0,16	cyclictest	0	-21	swapper/7	20:40:15	7
2496467	99	35	0,15	cyclictest	0	-21	swapper/7	23:25:15	7
2496464	99	35	0,16	cyclictest	0	-21	swapper/4	22:45:16	4
2496462	99	35	0,15	cyclictest	0	-21	swapper/2	00:25:16	2
2496460	99	35	0,35	cyclictest	0	-21	swapper/0	22:30:15	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00