OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #b, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rackbslot1.osadl.org (updated Mon Dec 01, 2025 12:44:43)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1350426	2	218	175,32	sleep0	0	-21	swapper/0	07:09:07	0
1350481	2	216	189,17	sleep3	0	-21	swapper/3	07:09:43	3
1350201	2	207	183,15	sleep1	0	-21	swapper/1	07:06:20	1
1350192	2	193	169,14	sleep2	0	-21	swapper/2	07:06:13	2
1439107	2	111	0,1	sleep0	1439109	-21	cron	08:35:00	0
1350708	99	64	58,5	cyclictest	1648311	-21	/usr/share/muni	11:55:12	2
1350705	99	61	47,13	cyclictest	1486307	-21	kworker/u8:2+flush-179:0	10:05:37	1
1350705	99	61	47,13	cyclictest	1486307	-21	kworker/u8:2+flush-179:0	10:05:37	1
1350705	99	60	56,3	cyclictest	1423558	-21	kworker/u8:1+flush-179:0	08:45:26	1
1350705	99	59	56,2	cyclictest	1637551	-21	kworker/u8:2+events_unbound	11:50:39	1
1350713	99	58	52,5	cyclictest	76405	-21	systemd-journal	08:00:00	3
1350708	99	58	54,3	cyclictest	1595671	-21	kworker/u8:4+flush-179:0	11:35:32	2
1350705	99	58	52,2	cyclictest	1595671	-21	kworker/u8:4+events_unbound	11:10:30	1
1350708	99	57	52,4	cyclictest	1689634	-21	/usr/share/muni	12:35:09	2
1350708	99	57	49,2	cyclictest	1595671	-21	kworker/u8:4+flush-179:0	11:15:22	2
1350708	99	56	53,2	cyclictest	1486307	-21	kworker/u8:2+events_unbound	10:08:20	2
1350708	99	56	53,2	cyclictest	1486307	-21	kworker/u8:2+events_unbound	10:08:20	2
1350708	99	56	53,2	cyclictest	1339674	-21	kworker/u8:5+flush-179:0	09:30:12	2
1350713	99	55	9,45	cyclictest	1528119	-21	kworker/u8:1+efi_rts_wq	10:08:22	3
1350713	99	55	9,45	cyclictest	1528119	-21	kworker/u8:1+efi_rts_wq	10:08:22	3
1350713	99	55	51,3	cyclictest	1324357	-21	kworker/u8:2+flush-179:0	07:35:21	3
1350705	99	55	52,2	cyclictest	1372227	-21	kworker/u8:0+flush-179:0	08:10:27	1
1350713	99	54	49,4	cyclictest	1448998	-31	munin-html	08:40:35	3
1350708	99	54	50,3	cyclictest	1528119	-21	kworker/u8:1+events_unbound	10:40:39	2
1350708	99	54	48,2	cyclictest	1408057	-21	kworker/u8:6+flush-179:0	08:10:21	2
1350708	99	53	50,2	cyclictest	1367057	-21	kworker/u8:3+flush-179:0	07:25:37	2
1350705	99	53	50,2	cyclictest	1637551	-21	kworker/u8:2+events_unbound	12:00:11	1
1350705	99	53	48,4	cyclictest	1539223	-21	/usr/share/muni	10:10:04	1
1350703	99	53	50,2	cyclictest	1595671	-21	kworker/u8:4+flush-179:0	11:35:15	0
1350703	99	53	49,3	cyclictest	1454674	-21	kworker/u8:0+events_unbound	10:30:33	0
1350708	99	52	49,2	cyclictest	1621635	-21	kworker/u8:0+flush-179:0	11:45:30	2
1350705	99	52	49,2	cyclictest	1498944	-21	kworker/u8:3+flush-179:0	10:15:30	1
1350705	99	52	48,3	cyclictest	1605812	-21	kworker/u8:2+flush-179:0	11:20:19	1
1350713	99	51	46,3	cyclictest	1528424	-21	munin-update	10:00:15	3
1350708	99	51	49,2	cyclictest	1339674	-21	kworker/u8:5+flush-179:0	08:30:27	2
1350708	99	51	48,2	cyclictest	1423558	-21	kworker/u8:1+events_unbound	08:35:24	2
1350705	99	51	48,2	cyclictest	1528119	-21	kworker/u8:1+flush-179:0	10:25:30	1
1350703	99	51	47,3	cyclictest	1454674	-21	kworker/u8:0+flush-179:0	09:50:00	0
1350713	99	50	44,4	cyclictest	1580862	-21	/usr/share/muni	10:50:16	3
1350708	99	50	47,2	cyclictest	1528119	-21	kworker/u8:1+events_unbound	10:35:31	2
1350708	99	50	47,2	cyclictest	1528119	-21	kworker/u8:1+events_unbound	10:35:31	2
1350708	99	50	47,2	cyclictest	1465854	-21	kworker/u8:1+flush-179:0	09:25:15	2
1350708	99	50	46,3	cyclictest	1339674	-21	kworker/u8:5+flush-179:0	07:55:21	2
1350708	99	49	45,3	cyclictest	1454674	-21	kworker/u8:0+flush-179:0	10:15:10	2
1350705	99	49	46,2	cyclictest	1595671	-21	kworker/u8:4+events_unbound	11:45:34	1
1350703	99	49	45,3	cyclictest	1362233	-21	latency_hist	07:20:01	0
1350708	99	48	45,2	cyclictest	1498944	-21	kworker/u8:3+flush-179:0	09:52:04	2
1350708	99	48	45,2	cyclictest	1339674	-21	kworker/u8:5+flush-179:0	07:42:26	2
1350708	99	48	44,3	cyclictest	1498944	-21	kworker/u8:3+flush-179:0	09:35:02	2
1350708	99	48	44,3	cyclictest	1372227	-21	kworker/u8:0+flush-179:0	07:35:28	2
1350708	99	48	43,4	cyclictest	247560	-21	ThreadPoolForeg	09:05:09	2
1350705	99	48	44,3	cyclictest	1518463	-21	/usr/share/muni	09:50:19	1
1350705	99	48	33,14	cyclictest	1339674	-21	kworker/u8:5+events_unbound	09:03:19	1
1350703	99	48	44,3	cyclictest	1605812	-21	kworker/u8:2+flush-179:0	11:25:06	0
1350713	99	47	43,3	cyclictest	1528119	-21	kworker/u8:1+flush-179:0	10:30:29	3
1350708	99	47	43,3	cyclictest	1454674	-21	kworker/u8:0+flush-179:0	09:55:02	2
1350708	99	47	42,4	cyclictest	1324357	-21	kworker/u8:2+flush-179:0	07:20:31	2
1350708	99	47	33,14	cyclictest	1486307	-21	kworker/u8:2+flush-179:0	09:40:30	2
1350705	99	47	45,2	cyclictest	1339674	-21	kworker/u8:5+events_unbound	07:45:32	1
1350705	99	47	44,2	cyclictest	1454674	-21	kworker/u8:0+events_unbound	09:20:29	1
1350703	99	47	44,2	cyclictest	1595671	-21	kworker/u8:4+flush-179:0	11:15:29	0
1350703	99	47	43,3	cyclictest	1339674	-21	kworker/u8:5+flush-179:0	08:05:20	0
1350713	99	46	41,3	cyclictest	1454674	-21	kworker/u8:0+flush-179:0	09:05:15	3
1350713	99	46	40,4	cyclictest	1632667	-21	/usr/share/muni	11:40:17	3
1350713	99	46	40,4	cyclictest	1439649	-21	/usr/share/muni	08:35:04	3
1350708	99	46	43,2	cyclictest	1652765	-21	kworker/u8:1+events_unbound	12:15:00	2
1350708	99	46	43,2	cyclictest	1486307	-21	kworker/u8:2+events_unbound	10:25:16	2
1350708	99	46	43,2	cyclictest	1324357	-21	kworker/u8:2+flush-179:0	07:15:33	2
1350708	99	46	42,3	cyclictest	1444316	-21	kworker/u8:3+flush-179:0	08:45:00	2
1350705	99	46	44,1	cyclictest	592034	-1	kworker/1:0H+kblockd	10:41:44	1
1350705	99	46	43,2	cyclictest	592034	-1	kworker/1:0H+kblockd	12:18:54	1
1350705	99	46	43,2	cyclictest	1423558	-21	kworker/u8:1+flush-179:0	08:40:01	1
1350705	99	46	40,4	cyclictest	1569913	-21	cp	10:40:01	1
1350705	99	46	40,4	cyclictest	1569913	-21	cp	10:40:01	1
1350713	99	45	41,3	cyclictest	1454674	-21	kworker/u8:0+flush-179:0	09:20:15	3
1350713	99	45	40,3	cyclictest	1423558	-21	kworker/u8:1+events_unbound	08:25:20	3
1350708	99	45	43,1	cyclictest	1538516	-21	kworker/2:2+pm	10:45:02	2
1350708	99	45	42,2	cyclictest	1637551	-21	kworker/u8:2+flush-179:0	11:51:12	2
1350708	99	45	39,5	cyclictest	247560	-21	ThreadPoolForeg	10:00:40	2
1350705	99	45	43,2	cyclictest	1423558	-21	kworker/u8:1+flush-179:0	08:40:30	1
1350705	99	45	42,2	cyclictest	1652765	-21	kworker/u8:1+events_unbound	12:39:04	1
1350705	99	45	42,2	cyclictest	1465854	-21	kworker/u8:1+events_unbound	09:25:16	1
1350705	99	45	41,3	cyclictest	1595671	-21	kworker/u8:4+events_unbound	11:25:11	1
1350705	99	45	41,3	cyclictest	1575065	-21	kworker/u8:0+flush-179:0	10:55:28	1
1350705	99	45	38,3	cyclictest	1372227	-21	kworker/u8:0+flush-179:0	08:20:17	1
1350703	99	45	43,2	cyclictest	1423558	-21	kworker/u8:1+flush-179:0	08:40:11	0
1350703	99	45	1,42	cyclictest	3125648	-13	Chrome_IOThread	11:30:23	0
1350713	99	44	38,4	cyclictest	1523575	-21	/usr/share/muni	09:55:10	3
1350708	99	44	41,2	cyclictest	1621635	-21	kworker/u8:0+flush-179:0	11:30:31	2
1350708	99	44	40,3	cyclictest	1595671	-21	kworker/u8:4+flush-179:0	12:20:28	2
1350705	99	44	41,2	cyclictest	1673611	-21	kworker/u8:6+flush-179:0	12:30:31	1
1350705	99	44	41,2	cyclictest	1454674	-21	kworker/u8:0+events_unbound	09:55:18	1
1350705	99	44	40,3	cyclictest	1673611	-21	kworker/u8:6+flush-179:0	12:26:04	1
1350705	99	44	40,3	cyclictest	1324357	-21	kworker/u8:2+events_unbound	07:50:31	1
1350713	99	43	38,3	cyclictest	76405	-21	systemd-journal	11:45:08	3
1350708	99	43	40,2	cyclictest	1324357	-21	kworker/u8:2+events_unbound	07:10:22	2
1350708	99	43	39,3	cyclictest	1528119	-21	kworker/u8:1+flush-179:0	10:50:19	2
1350708	99	43	26,15	cyclictest	1339674	-21	kworker/u8:5+flush-179:0	08:15:11	2
1350705	99	43	39,3	cyclictest	1621635	-21	kworker/u8:0+flush-179:0	11:55:35	1
1350705	99	43	38,4	cyclictest	1339674	-21	kworker/u8:5+flush-179:0	09:40:13	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17