OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Sat May 23, 2026 00:43:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1327485	2	59	48,7	sleep5	0	-21	swapper/5	19:02:35	5
1336917	99	57	54,2	cyclictest	1435640	-21	ntpq	19:52:51	7
1336619	2	47	37,7	sleep4	0	-21	swapper/4	19:07:16	4
1336912	99	45	43,2	cyclictest	1919338	-21	kworker/u16:0+flush-8:0	00:07:52	5
1336538	2	43	2,36	sleep7	0	-21	swapper/7	19:06:06	7
6280	89	40	0,33	rtkit-daemon	0	-21	swapper/6	19:03:25	6
1336910	99	40	38,2	cyclictest	1666027	-21	kworker/u16:0+events_unbound	22:11:45	4
1336917	99	39	34,4	cyclictest	1861533	-21	latency_hist	23:07:28	7
1336917	99	38	36,1	cyclictest	2053856	-21	sh	00:25:39	7
1336917	99	38	36,1	cyclictest	1763033	-21	ssh	22:24:24	7
1336917	99	37	36,0	cyclictest	0	-21	swapper/7	23:08:24	7
1336910	99	37	34,2	cyclictest	1666027	-21	kworker/u16:0+flush-8:0	21:57:39	4
1336917	99	36	34,1	cyclictest	1801585	-21	ssh	22:42:36	7
1336917	99	36	34,1	cyclictest	1571062	-21	diskmemload	23:15:45	7
1336910	99	36	34,2	cyclictest	1726103	-21	kworker/u16:1+events_unbound	22:30:19	4
1336917	99	35	34,0	cyclictest	0	-21	swapper/7	23:19:11	7
1336917	99	35	33,1	cyclictest	1920289	-21	ssh	23:29:15	7
1336916	99	35	33,2	cyclictest	1883364	-21	kworker/u16:1+events_unbound	00:17:11	6
1336910	99	35	33,2	cyclictest	1919338	-21	kworker/u16:0+events_unbound	00:02:24	4
1336917	99	34	33,0	cyclictest	0	-21	swapper/7	23:41:35	7
1336917	99	34	33,0	cyclictest	0	-21	swapper/7	21:18:24	7
1336917	99	34	33,0	cyclictest	0	-21	swapper/7	00:20:11	7
1336917	99	34	29,4	cyclictest	1970308	-21	latency_hist	23:52:27	7
1336910	99	34	32,2	cyclictest	1919338	-21	kworker/u16:0+events_unbound	23:41:27	4
1336910	99	34	32,2	cyclictest	1919338	-21	kworker/u16:0+events_unbound	00:10:52	4
1336910	99	34	32,2	cyclictest	1919338	-21	kworker/u16:0+events_unbound	00:06:36	4
1336910	99	34	32,2	cyclictest	1883364	-21	kworker/u16:1+events_unbound	23:55:55	4
1336910	99	34	32,2	cyclictest	1883364	-21	kworker/u16:1+events_unbound	23:55:55	4
1336910	99	34	32,2	cyclictest	1740112	-21	kworker/u16:2+flush-8:0	22:33:15	4
1336910	99	34	32,2	cyclictest	1740112	-21	kworker/u16:2+events_unbound	22:50:39	4
1336917	99	33	32,0	cyclictest	0	-21	swapper/7	23:25:47	7
1336917	99	33	32,0	cyclictest	0	-21	swapper/7	21:08:36	7
1336917	99	33	32,0	cyclictest	0	-21	swapper/7	00:33:44	7
1336917	99	33	32,0	cyclictest	0	-21	swapper/7	00:02:11	7
1336916	99	33	31,2	cyclictest	1317902	-21	kworker/u16:3+flush-8:0	20:02:28	6
1336912	99	33	31,2	cyclictest	1883364	-21	kworker/u16:1+flush-8:0	23:57:11	5
1336912	99	33	31,2	cyclictest	1883364	-21	kworker/u16:1+flush-8:0	23:57:11	5
1336912	99	33	31,2	cyclictest	1834978	-21	kworker/u16:3+events_unbound	22:57:23	5
1336912	99	33	31,2	cyclictest	1740112	-21	kworker/u16:2+flush-8:0	22:27:59	5
1336910	99	33	32,1	cyclictest	1619346	-21	kworker/u16:6+events_unbound	21:40:04	4
1336917	99	32	31,0	cyclictest	0	-21	swapper/7	23:44:09	7
1336917	99	32	31,0	cyclictest	0	-21	swapper/7	22:18:28	7
1336917	99	32	31,0	cyclictest	0	-21	swapper/7	21:55:40	7
1336917	99	32	31,0	cyclictest	0	-21	swapper/7	21:35:36	7
1336917	99	32	31,0	cyclictest	0	-21	swapper/7	21:29:44	7
1336917	99	32	30,1	cyclictest	1571062	-21	diskmemload	22:31:03	7
1336917	99	32	29,2	cyclictest	1666926	-21	ssh	21:46:00	7
1336912	99	32	30,2	cyclictest	1666027	-21	kworker/u16:0+events_unbound	22:04:39	5
1336910	99	32	30,2	cyclictest	1883364	-21	kworker/u16:1+flush-8:0	00:22:59	4
1336910	99	32	30,2	cyclictest	1446246	-21	kworker/u16:1+flush-8:0	20:52:23	4
1336917	99	31	30,0	cyclictest	0	-21	swapper/7	21:49:40	7
1336917	99	31	30,0	cyclictest	0	-21	swapper/7	00:11:13	7
1336917	99	31	30,0	cyclictest	0	-21	swapper/7	00:03:15	7
1336917	99	31	29,1	cyclictest	1702680	-21	ssh	22:00:04	7
1336917	99	31	28,2	cyclictest	1847679	-21	rm	22:59:11	7
1336912	99	31	29,2	cyclictest	1899557	-21	kworker/u16:2+events_unbound	23:48:00	5
1336912	99	31	29,2	cyclictest	1446246	-21	kworker/u16:1+flush-8:0	21:07:51	5
1336910	99	31	29,2	cyclictest	1899557	-21	kworker/u16:2+events_unbound	23:43:28	4
1336910	99	31	29,2	cyclictest	1726103	-21	kworker/u16:1+events_unbound	23:00:37	4
1336917	99	30	29,0	cyclictest	0	-21	swapper/7	22:04:29	7
1336912	99	30	28,2	cyclictest	2078051	-21	kworker/u16:1+events_unbound	00:37:23	5
1336912	99	30	28,2	cyclictest	1883364	-21	kworker/u16:1+events_unbound	00:21:51	5
1336912	99	30	28,2	cyclictest	1666027	-21	kworker/u16:0+events_unbound	23:10:23	5
1336910	99	30	29,1	cyclictest	1532950	-21	kworker/u16:3+events_unbound	21:26:52	4
1336910	99	30	28,2	cyclictest	1883364	-21	kworker/u16:1+events_unbound	23:15:59	4
1336910	99	30	28,2	cyclictest	1834978	-21	kworker/u16:3+events_unbound	22:53:27	4
1336910	99	30	28,2	cyclictest	1726103	-21	kworker/u16:1+events_unbound	23:04:23	4
1336910	99	30	28,2	cyclictest	1666027	-21	kworker/u16:0+events_unbound	23:20:15	4
1336910	99	30	28,2	cyclictest	1465673	-21	kworker/u16:2+flush-8:0	21:56:55	4
1336910	99	30	28,2	cyclictest	1465673	-21	kworker/u16:2+flush-8:0	21:28:32	4
1336917	99	29	28,0	cyclictest	0	-21	swapper/7	22:35:45	7
1336917	99	29	28,0	cyclictest	0	-21	swapper/7	21:38:08	7
1336917	99	29	27,1	cyclictest	1025	-21	runrttasks	22:39:03	7
1336916	99	29	27,2	cyclictest	1883364	-21	kworker/u16:1+flush-8:0	00:23:15	6
1336912	99	29	27,2	cyclictest	1532950	-21	kworker/u16:3+events_unbound	21:34:29	5
1336912	99	29	26,2	cyclictest	1446246	-21	kworker/u16:1+events_unbound	21:42:40	5
1336910	99	29	27,2	cyclictest	1883364	-21	kworker/u16:1+flush-8:0	00:18:12	4
1336910	99	29	27,2	cyclictest	1532950	-21	kworker/u16:3+events_unbound	21:18:28	4
1336910	99	29	27,2	cyclictest	1532950	-21	kworker/u16:3+events_unbound	21:11:36	4
1336910	99	29	27,2	cyclictest	1465673	-21	kworker/u16:2+flush-8:0	21:44:24	4
1336910	99	29	27,2	cyclictest	1446246	-21	kworker/u16:1+flush-8:0	20:57:12	4
1336917	99	28	27,0	cyclictest	0	-21	swapper/7	23:36:28	7
1336917	99	28	27,0	cyclictest	0	-21	swapper/7	22:14:33	7
1336917	99	28	26,1	cyclictest	0	-21	swapper/7	21:24:40	7
1336917	99	28	25,2	cyclictest	2029008	-21	ssh	00:14:21	7
1336912	99	28	26,2	cyclictest	1883364	-21	kworker/u16:1+events_unbound	23:21:37	5
1336912	99	28	26,2	cyclictest	1666027	-21	kworker/u16:0+events_unbound	21:58:32	5
1336912	99	28	26,2	cyclictest	1619346	-21	kworker/u16:6+events_unbound	21:38:49	5
1336910	99	28	26,2	cyclictest	1899557	-21	kworker/u16:2+events_unbound	23:49:36	4
1336910	99	28	26,2	cyclictest	1883364	-21	kworker/u16:1+events_unbound	00:27:31	4
1336910	99	28	26,2	cyclictest	1789022	-21	kworker/u16:3+flush-8:0	22:43:07	4
1336910	99	28	26,2	cyclictest	1740112	-21	kworker/u16:2+events_unbound	22:26:23	4
1336910	99	28	26,2	cyclictest	1740112	-21	kworker/u16:2+events_unbound	22:16:56	4
1336910	99	28	26,2	cyclictest	1726103	-21	kworker/u16:1+events_unbound	22:20:43	4
1336910	99	28	26,2	cyclictest	1666027	-21	kworker/u16:0+events_unbound	21:49:38	4
1336917	99	27	26,0	cyclictest	0	-21	swapper/7	23:55:51	7
1336917	99	27	26,0	cyclictest	0	-21	swapper/7	23:55:51	7
1336917	99	27	26,0	cyclictest	0	-21	swapper/7	22:08:59	7
1336917	99	27	26,0	cyclictest	0	-21	swapper/7	19:21:37	7
1336917	99	27	26,0	cyclictest	0	-21	swapper/7	00:31:00	7
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17