OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Thu Feb 12, 2026 00:43:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1059227	2	58	48,7	sleep5	0	-21	swapper/5	19:02:45	5
1059197	2	58	48,7	sleep4	0	-21	swapper/4	19:02:20	4
1050054	2	55	19,30	sleep7	0	-21	swapper/7	19:00:54	7
1059737	99	51	46,4	cyclictest	1732196	-21	latency_hist	00:05:51	7
1059730	99	45	41,3	cyclictest	1150604	-21	kworker/u16:0+flush-8:0	20:56:18	5
1059726	99	43	40,2	cyclictest	1150604	-21	kworker/u16:0+flush-8:0	20:00:52	4
1059726	99	42	39,2	cyclictest	1440878	-21	kworker/u16:2+flush-8:0	22:20:52	4
1059154	2	41	31,7	sleep6	0	-21	swapper/6	19:01:41	6
1059730	99	40	37,2	cyclictest	1780383	-21	kworker/u16:0+flush-8:0	00:26:20	5
1059737	99	39	38,0	cyclictest	0	-21	swapper/7	00:10:27	7
1059730	99	38	36,2	cyclictest	1477686	-21	kworker/u16:3+flush-8:0	22:30:47	5
1059737	99	37	35,1	cyclictest	0	-21	swapper/7	23:34:51	7
1059730	99	37	34,2	cyclictest	996250	-21	kworker/u16:2+flush-8:0	19:20:52	5
1059733	99	35	33,2	cyclictest	1756564	-21	kworker/u16:1+flush-8:0	00:26:07	6
1059737	99	34	33,0	cyclictest	0	-21	swapper/7	00:26:02	7
1059737	99	34	29,4	cyclictest	1610891	-21	latency_hist	23:15:51	7
1059733	99	34	31,3	cyclictest	1610414	-21	kworker/u16:1+events_unbound	23:36:07	6
1059726	99	34	32,2	cyclictest	1792542	-21	kworker/u16:2+events_unbound	00:35:47	4
1059730	99	33	31,2	cyclictest	1756564	-21	kworker/u16:1+flush-8:0	00:21:10	5
1059730	99	33	29,3	cyclictest	1731760	-21	kworker/u16:2+flush-8:0	00:15:51	5
1059737	99	31	30,0	cyclictest	0	-21	swapper/7	23:30:02	7
1059730	99	31	29,2	cyclictest	1717622	-21	kworker/u16:6+events_unbound	00:06:15	5
1059730	99	31	29,2	cyclictest	1550316	-21	kworker/u16:3+events_unbound	23:21:18	5
1059730	99	31	29,2	cyclictest	1550316	-21	kworker/u16:3+events_unbound	23:21:18	5
1059726	99	31	28,2	cyclictest	1415353	-21	kworker/u16:1+events_unbound	22:11:10	4
1059737	99	30	25,4	cyclictest	1440836	-21	latency_hist	22:05:52	7
1059737	99	30	25,4	cyclictest	1440836	-21	latency_hist	22:05:52	7
1059737	99	30	0,28	cyclictest	1622473	-21	sh	23:19:50	7
1059726	99	30	28,2	cyclictest	1658608	-21	kworker/u16:2+events_unbound	23:40:52	4
1059726	99	30	27,2	cyclictest	1295538	-21	kworker/u16:3+flush-8:0	21:25:58	4
1059737	99	29	28,0	cyclictest	0	-21	swapper/7	21:27:39	7
1059737	99	29	0,28	cyclictest	1462919	-21	ssh	22:11:47	7
1059733	99	29	26,2	cyclictest	1343797	-21	kworker/u16:4+events_unbound	21:41:08	6
1059730	99	29	27,2	cyclictest	1658608	-21	kworker/u16:2+flush-8:0	23:51:17	5
1059730	99	29	27,2	cyclictest	1550316	-21	kworker/u16:3+flush-8:0	22:57:22	5
1059726	99	29	27,2	cyclictest	1731760	-21	kworker/u16:2+flush-8:0	00:21:12	4
1059737	99	28	28,0	cyclictest	0	-21	swapper/7	21:06:58	7
1059730	99	28	25,2	cyclictest	1523714	-21	kworker/u16:0+flush-8:0	22:55:52	5
1059737	99	27	27,0	cyclictest	0	-21	swapper/7	21:25:23	7
1059737	99	27	25,1	cyclictest	1718111	-21	ssh	23:57:15	7
1059737	99	27	0,26	cyclictest	5747	-21	gnome-shell	21:44:02	7
1059730	99	27	25,2	cyclictest	1343797	-21	kworker/u16:4+flush-8:0	22:05:47	5
1059730	99	27	25,2	cyclictest	1343797	-21	kworker/u16:4+flush-8:0	22:05:47	5
1059726	99	27	25,2	cyclictest	1658608	-21	kworker/u16:2+events_unbound	23:45:47	4
1059726	99	27	25,2	cyclictest	1523714	-21	kworker/u16:0+events_unbound	23:01:12	4
1059737	99	26	26,0	cyclictest	0	-21	swapper/7	23:53:07	7
1059737	99	26	26,0	cyclictest	0	-21	swapper/7	23:39:46	7
1059726	99	26	24,2	cyclictest	1523714	-21	kworker/u16:0+events_unbound	23:11:12	4
1059737	99	25	25,0	cyclictest	0	-21	swapper/7	22:17:18	7
1059737	99	25	19,5	cyclictest	1121526	-21	latency_hist	19:35:53	7
1059733	99	25	23,2	cyclictest	996250	-21	kworker/u16:2+events_unbound	20:01:07	6
1059730	99	25	23,2	cyclictest	1732619	-21	kworker/u16:3+flush-8:0	00:16:12	5
1059726	99	25	22,2	cyclictest	342684	-21	kworker/u16:1+flush-8:0	19:26:18	4
1059737	99	24	24,0	cyclictest	0	-21	swapper/7	22:55:03	7
1059737	99	24	24,0	cyclictest	0	-21	swapper/7	21:20:39	7
1059737	99	24	22,1	cyclictest	1694088	-21	ssh	23:47:51	7
1059733	99	24	21,3	cyclictest	1550316	-21	kworker/u16:3+events_unbound	23:06:17	6
1059730	99	24	22,2	cyclictest	1295538	-21	kworker/u16:3+flush-8:0	21:46:56	5
1059726	99	24	21,2	cyclictest	1295538	-21	kworker/u16:3+events_unbound	21:31:10	4
1059737	99	23	23,0	cyclictest	0	-21	swapper/7	22:46:31	7
1059737	99	23	23,0	cyclictest	0	-21	swapper/7	22:22:11	7
1059737	99	23	23,0	cyclictest	0	-21	swapper/7	21:32:19	7
1059737	99	23	19,3	cyclictest	1525244	-21	ssh	22:39:32	7
1059730	99	23	20,2	cyclictest	1732619	-21	kworker/u16:3+events_unbound	00:31:14	5
1059726	99	23	21,2	cyclictest	1498491	-21	kworker/u16:6+events_unbound	22:36:13	4
1059726	99	23	20,2	cyclictest	996250	-21	kworker/u16:2+flush-8:0	20:51:10	4
1059737	99	22	22,0	cyclictest	0	-21	swapper/7	22:34:26	7
1059737	99	22	20,1	cyclictest	1295070	-21	diskmemload	21:37:35	7
1059737	99	22	19,2	cyclictest	1682670	-21	ssh	23:44:14	7
1059737	99	22	16,5	cyclictest	1428673	-21	latency_hist	22:00:52	7
1059726	99	22	20,2	cyclictest	1343797	-21	kworker/u16:4+events_unbound	21:57:43	4
1059737	99	21	21,0	cyclictest	0	-21	swapper/7	00:20:23	7
1059737	99	21	0,20	cyclictest	1754730	-21	ssh	00:12:38	7
1059733	99	21	18,2	cyclictest	342684	-21	kworker/u16:1+flush-8:0	20:06:14	6
1059733	99	21	18,2	cyclictest	1087579	-21	kworker/u16:0+flush-8:0	19:21:23	6
1059733	99	21	17,3	cyclictest	1523714	-21	kworker/u16:0+flush-8:0	23:11:08	6
1059730	99	21	19,2	cyclictest	1658608	-21	kworker/u16:2+flush-8:0	23:46:12	5
1059730	99	21	19,2	cyclictest	1281661	-21	kworker/u16:1+events_unbound	21:06:21	5
1059730	99	21	19,2	cyclictest	1189327	-21	kworker/u16:3+events_unbound	20:16:14	5
1059726	99	21	19,2	cyclictest	1550316	-21	kworker/u16:3+events_unbound	23:21:12	4
1059726	99	21	19,2	cyclictest	1550316	-21	kworker/u16:3+events_unbound	23:21:12	4
1059726	99	21	18,3	cyclictest	1550316	-21	kworker/u16:3+flush-8:0	23:31:07	4
1059726	99	21	18,2	cyclictest	996250	-21	kworker/u16:2+events_unbound	21:01:09	4
1059726	99	21	18,2	cyclictest	342684	-21	kworker/u16:1+flush-8:0	20:06:12	4
1271058	2	20	0,0	sleep7	1271060	-21	kthreadcore	20:51:11	7
1059737	99	20	20,0	cyclictest	0	-21	swapper/7	22:59:03	7
1059737	99	20	20,0	cyclictest	0	-21	swapper/7	21:52:50	7
1059733	99	20	18,2	cyclictest	1717622	-21	kworker/u16:6+flush-8:0	00:01:11	6
1059733	99	20	18,2	cyclictest	1498491	-21	kworker/u16:6+events_unbound	22:51:06	6
1059730	99	20	18,2	cyclictest	342684	-21	kworker/u16:1+flush-8:0	19:36:08	5
1059730	99	20	18,2	cyclictest	1658608	-21	kworker/u16:2+events_unbound	23:41:10	5
1059730	99	20	18,2	cyclictest	1610414	-21	kworker/u16:1+flush-8:0	23:16:18	5
1059730	99	20	18,2	cyclictest	1415353	-21	kworker/u16:1+events_unbound	22:06:09	5
1059737	99	19	18,0	cyclictest	0	-21	swapper/7	00:21:53	7
1059730	99	19	17,2	cyclictest	996250	-21	kworker/u16:2+flush-8:0	20:01:15	5
1059730	99	19	17,2	cyclictest	996250	-21	kworker/u16:2+events_unbound	21:01:18	5
1059730	99	19	17,2	cyclictest	996250	-21	kworker/u16:2+events_unbound	19:21:21	5
1059730	99	19	17,2	cyclictest	996250	-21	kworker/u16:2+events_unbound	19:11:15	5
1059730	99	19	17,2	cyclictest	1150604	-21	kworker/u16:0+flush-8:0	19:57:03	5
1059726	99	19	18,1	cyclictest	1343797	-21	kworker/u16:4+events_unbound	21:41:16	4
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17