OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #5

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot5.osadl.org (updated Wed Jun 10, 2026 00:43:46)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3899575	99	563	0,42	cyclictest	0	-21	swapper/11	21:13:25	3
3899570	99	556	20,535	cyclictest	0	-21	swapper/10	23:05:24	2
3899570	99	556	20,535	cyclictest	0	-21	swapper/10	23:05:24	2
3899575	99	554	32,521	cyclictest	0	-21	swapper/11	21:26:25	3
3899565	99	546	24,521	cyclictest	0	-21	swapper/9	20:23:25	15
3899570	99	526	5,519	cyclictest	0	-21	swapper/10	23:46:24	2
3899575	99	525	34,490	cyclictest	0	-21	swapper/11	00:13:24	3
3899570	99	516	0,515	cyclictest	0	-21	swapper/10	23:38:24	2
3899559	99	515	514,1	cyclictest	4009214	-21	kworker/7:2+i915-unordered	21:33:25	13
3899565	99	508	508,0	cyclictest	0	-21	swapper/9	19:30:25	15
3899539	99	506	15,490	cyclictest	0	-21	swapper/2	21:53:25	8
3899575	99	503	1,498	cyclictest	0	-21	swapper/11	21:06:25	3
3899588	99	493	18,0	cyclictest	0	-21	swapper/14	20:54:25	6
3899570	99	489	14,59	cyclictest	0	-21	swapper/10	00:02:20	2
3899559	99	489	486,1	cyclictest	0	-21	swapper/7	20:54:25	13
3899588	99	486	30,454	cyclictest	0	-21	swapper/14	23:38:24	6
3899593	99	485	484,1	cyclictest	0	-21	swapper/15	21:44:25	7
3899588	99	485	6,0	cyclictest	0	-21	swapper/14	22:35:25	6
3899575	99	480	9,59	cyclictest	0	-21	swapper/11	21:08:25	3
3899570	99	477	475,2	cyclictest	4049409	-21	kworker/10:2+i915-unordered	22:35:25	2
3899546	99	471	22,28	cyclictest	0	-21	swapper/4	20:32:08	10
3899546	99	471	20,30	cyclictest	0	-21	swapper/4	22:06:47	10
3899565	99	469	24,29	cyclictest	4120678	-21	ntp_states	23:37:46	15
3899539	99	467	18,30	cyclictest	0	-21	swapper/2	22:47:45	8
3899546	99	466	19,29	cyclictest	0	-21	swapper/4	22:48:47	10
3899543	99	463	13,30	cyclictest	0	-21	swapper/3	22:15:09	9
3899543	99	463	13,29	cyclictest	0	-21	swapper/3	00:25:48	9
3899546	99	460	459,1	cyclictest	1818	-21	snmpd	19:37:59	10
3899570	99	459	20,29	cyclictest	0	-21	swapper/10	23:26:24	2
3899588	99	458	0,457	cyclictest	0	-21	swapper/14	21:53:25	6
3899539	99	458	457,1	cyclictest	4114470	-21	kworker/2:1+i915-unordered	23:38:24	8
3899588	99	457	10,30	cyclictest	0	-21	swapper/14	22:19:47	6
3899570	99	456	5,450	cyclictest	0	-21	swapper/10	20:34:25	2
3899588	99	453	5,30	cyclictest	0	-21	swapper/14	21:22:08	6
3899575	99	452	6,443	cyclictest	4084452	-21	ntpq	22:52:46	3
3899570	99	452	6,28	cyclictest	0	-21	swapper/10	22:59:08	2
3899570	99	452	6,28	cyclictest	0	-21	swapper/10	22:59:08	2
3899543	99	451	449,2	cyclictest	3801901	-21	kworker/3:2+i915-unordered	21:13:25	9
3899575	99	449	7,30	cyclictest	0	-21	swapper/11	20:52:20	3
3899536	99	448	446,1	cyclictest	4065243	-21	kworker/1:0+i915-unordered	22:31:25	1
3899570	99	447	2,29	cyclictest	0	-21	swapper/10	23:32:46	2
3899555	99	446	445,1	cyclictest	697	50	irq/159-i915	23:38:24	12
3899536	99	445	25,419	cyclictest	0	-21	swapper/1	21:04:10	1
3899536	99	445	24,420	cyclictest	0	-21	swapper/1	23:47:46	1
3899536	99	445	24,420	cyclictest	0	-21	swapper/1	23:04:46	1
3899536	99	445	24,420	cyclictest	0	-21	swapper/1	23:04:46	1
3899536	99	445	24,420	cyclictest	0	-21	swapper/1	19:51:47	1
3899593	99	444	441,1	cyclictest	3984863	-21	kworker/15:2+i915-unordered	20:54:25	7
3899555	99	444	443,1	cyclictest	697	50	irq/159-i915	19:18:25	12
3899546	99	444	0,443	cyclictest	0	-21	swapper/4	22:21:25	10
3899539	99	444	442,2	cyclictest	3928504	-21	kworker/2:0+pm	20:28:36	8
3899536	99	444	23,420	cyclictest	0	-21	swapper/1	22:34:48	1
3899536	99	444	23,420	cyclictest	0	-21	swapper/1	00:24:47	1
3899536	99	444	22,421	cyclictest	0	-21	swapper/1	19:43:47	1
3899536	99	444	21,422	cyclictest	0	-21	swapper/1	20:44:46	1
3899593	99	443	440,2	cyclictest	0	-21	swapper/15	21:33:25	7
3899562	99	443	441,2	cyclictest	1818	-21	snmpd	00:17:57	14
3899543	99	443	22,420	cyclictest	0	-21	swapper/3	21:38:46	9
3899536	99	443	22,420	cyclictest	0	-21	swapper/1	21:26:10	1
3899536	99	443	21,421	cyclictest	0	-21	swapper/1	22:51:45	1
3899532	99	443	442,1	cyclictest	0	-21	swapper/0	00:17:57	0
3899565	99	442	442,0	cyclictest	0	-21	swapper/9	23:12:07	15
3899551	99	442	442,0	cyclictest	0	-21	swapper/5	21:56:25	11
3899543	99	442	25,416	cyclictest	0	-21	swapper/3	00:05:24	9
3899543	99	442	20,419	cyclictest	0	-21	swapper/3	19:46:46	9
3899539	99	442	25,416	cyclictest	4040335	-21	ps	21:57:46	8
3899536	99	442	23,418	cyclictest	0	-21	swapper/1	21:38:10	1
3899536	99	442	21,420	cyclictest	0	-21	swapper/1	20:22:09	1
3899536	99	442	21,420	cyclictest	0	-21	swapper/1	20:22:09	1
3899536	99	442	21,420	cyclictest	0	-21	swapper/1	19:28:47	1
3899575	99	441	438,2	cyclictest	3920558	-21	kworker/11:0+i915-unordered	19:50:25	3
3899575	99	441	22,418	cyclictest	0	-21	swapper/11	23:12:47	3
3899570	99	441	441,0	cyclictest	0	-21	swapper/10	23:12:07	2
3899536	99	441	20,420	cyclictest	0	-21	swapper/1	22:38:47	1
3899536	99	441	20,420	cyclictest	0	-21	swapper/1	22:20:09	1
3899565	99	440	437,3	cyclictest	3976768	-21	kworker/u64:7+events_unbound	21:14:25	15
3899551	99	440	20,419	cyclictest	0	-21	swapper/5	21:28:11	11
3899543	99	440	439,1	cyclictest	3873562	-21	kworker/3:5+i915-unordered	21:26:25	9
3899536	99	440	21,419	cyclictest	0	-21	swapper/1	20:08:09	1
3899536	99	440	20,419	cyclictest	0	-21	swapper/1	21:51:10	1
3899536	99	440	18,421	cyclictest	0	-21	swapper/1	21:37:10	1
3899584	99	439	19,419	cyclictest	0	-21	swapper/13	23:25:08	5
3899575	99	439	23,415	cyclictest	0	-21	swapper/11	20:33:25	3
3899570	99	439	21,417	cyclictest	0	-21	swapper/10	20:14:10	2
3899570	99	439	21,417	cyclictest	0	-21	swapper/10	20:14:10	2
3899543	99	439	23,416	cyclictest	0	-21	swapper/3	22:24:24	9
3899539	99	439	438,1	cyclictest	4109554	-21	kworker/2:0+i915-unordered	23:46:24	8
3899536	99	439	18,420	cyclictest	0	-21	swapper/1	21:20:47	1
3899536	99	439	16,422	cyclictest	0	-21	swapper/1	19:41:47	1
3899588	99	438	437,1	cyclictest	3908631	-21	kworker/14:2+i915-unordered	19:18:25	6
3899559	99	438	15,422	cyclictest	0	-21	swapper/7	20:50:46	13
3899551	99	438	17,420	cyclictest	0	-21	swapper/5	00:29:46	11
3899539	99	438	437,1	cyclictest	4085591	-21	kworker/2:1+i915-unordered	23:05:24	8
3899539	99	438	437,1	cyclictest	4085591	-21	kworker/2:1+i915-unordered	23:05:24	8
3899536	99	438	17,420	cyclictest	0	-21	swapper/1	22:53:47	1
3899551	99	437	18,418	cyclictest	0	-21	swapper/5	23:15:10	11
3899551	99	437	17,419	cyclictest	0	-21	swapper/5	19:24:46	11
3899551	99	437	17,419	cyclictest	0	-21	swapper/5	00:33:47	11
3899551	99	437	16,420	cyclictest	0	-21	swapper/5	20:57:07	11
3899551	99	437	16,420	cyclictest	0	-21	swapper/5	00:10:09	11
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17