OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackeslot3s.osadl.org (updated Thu May 07, 2026 00:45:31)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2264448	99	87	1,46	cyclictest	2296742	-21	ssh	22:04:20	1
2264448	99	85	2,43	cyclictest	2285936	-21	ssh	21:41:40	1
2264448	99	84	2,41	cyclictest	2317497	-21	ssh	22:47:11	1
2264448	99	80	2,40	cyclictest	2329536	-21	ssh	23:12:14	1
2264448	99	79	1,46	cyclictest	2270614	-21	diskmemload	21:18:45	1
2264448	99	79	1,41	cyclictest	2292047	-21	ssh	21:54:39	1
2264448	99	79	1,41	cyclictest	0	-21	swapper/1	23:30:17	1
2264448	99	79	1,41	cyclictest	0	-21	swapper/1	23:30:16	1
2264448	99	79	1,39	cyclictest	2266976	-21	munin-run	20:00:00	1
2264448	99	78	1,44	cyclictest	2348212	-21	ssh	23:50:56	1
2264448	99	78	1,44	cyclictest	2348212	-21	ssh	23:50:56	1
2264448	99	78	1,44	cyclictest	2307740	-21	ssh	22:26:49	1
2264448	99	78	1,43	cyclictest	2277410	-21	ssh	21:24:10	1
2264448	99	77	1,41	cyclictest	2364139	-21	ssh	00:24:13	1
2264448	99	76	1,41	cyclictest	0	-21	swapper/1	22:41:15	1
2264448	99	76	1,41	cyclictest	0	-21	swapper/1	21:12:53	1
2264448	99	75	1,39	cyclictest	2320938	-21	ssh	22:54:32	1
2264448	99	75	1,39	cyclictest	2269158	-21	cut	20:40:02	1
2264448	99	73	1,39	cyclictest	2282562	-21	ssh	21:34:57	1
2264448	99	73	1,38	cyclictest	2288277	-21	ssh	21:46:25	1
2264452	99	71	42,12	cyclictest	2255000	-21	kworker/2:0	19:30:03	2
2264448	99	71	2,64	cyclictest	2300094	-21	ssh	22:10:57	1
2264448	99	71	2,37	cyclictest	2365687	-21	ssh	00:27:06	1
2264448	99	71	15,33	cyclictest	2325264	-1	kworker/u9:1	23:48:02	1
2264448	99	71	1,42	cyclictest	2333797	-21	diskmemload	23:20:57	1
2264452	99	69	44,9	cyclictest	2255000	-21	kworker/2:0	22:01:53	2
2264448	99	69	29,36	cyclictest	2310561	-21	sh	22:32:46	1
2264445	99	69	22,26	cyclictest	168	50	irq/134-8000000	21:40:03	0
2264448	99	68	2,62	cyclictest	2324815	-21	ssh	23:02:20	1
2264448	99	68	1,63	cyclictest	2298077	-21	ssh	22:06:58	1
2264448	99	68	1,61	cyclictest	2270329	-21	sshd	21:00:51	1
2264448	99	68	1,43	cyclictest	0	-21	swapper/1	23:39:40	1
2264452	99	67	42,9	cyclictest	2270137	-21	kworker/2:3	23:34:51	2
2264452	99	67	42,9	cyclictest	2270137	-21	kworker/2:3	23:34:51	2
2264452	99	67	42,9	cyclictest	2270137	-21	kworker/2:3	23:00:28	2
2264448	99	67	29,34	cyclictest	2368230	-21	sh	00:32:27	1
2264448	99	67	1,62	cyclictest	2352922	-21	ssh	00:00:35	1
2264448	99	67	1,39	cyclictest	0	-21	swapper/1	22:15:25	1
2264448	99	66	1,61	cyclictest	2323384	-21	ssh	22:59:43	1
2264448	99	66	1,61	cyclictest	2282837	-21	ssh	21:35:03	1
2264448	99	66	1,39	cyclictest	2355354	-21	ssh	00:05:37	1
2264448	99	66	1,39	cyclictest	2355354	-21	ssh	00:05:36	1
2264448	99	66	1,38	cyclictest	0	-21	swapper/1	21:55:26	1
2264448	99	66	1,38	cyclictest	0	-21	swapper/1	21:55:26	1
2264445	99	66	31,17	cyclictest	2314343	-21	ssh	22:40:26	0
2264448	99	65	1,60	cyclictest	2336828	-21	ssh	23:27:18	1
2264448	99	65	1,60	cyclictest	2328143	-21	ssh	23:09:28	1
2264448	99	65	1,60	cyclictest	2312881	-21	ssh	22:37:34	1
2264448	99	65	1,60	cyclictest	2306684	-21	ssh	22:24:57	1
2264448	99	65	1,60	cyclictest	2278233	-21	ssh	21:25:35	1
2264448	99	65	1,34	cyclictest	2331479	-21	ssh	23:16:10	1
2264445	99	65	28,16	cyclictest	2290169	-21	ssh	21:50:17	0
2264448	99	64	2,57	cyclictest	2267978	-21	cron	20:17:00	1
2264448	99	64	2,57	cyclictest	2267978	-21	cron	20:16:59	1
2264448	99	64	1,60	cyclictest	2358976	-21	ssh	00:13:31	1
2264448	99	64	1,59	cyclictest	2370472	-21	ssh	00:37:12	1
2264448	99	64	1,59	cyclictest	2370472	-21	ssh	00:37:12	1
2264448	99	64	1,59	cyclictest	2360033	-21	ssh	00:15:28	1
2264448	99	64	1,59	cyclictest	2360033	-21	ssh	00:15:27	1
2264448	99	64	1,59	cyclictest	2351034	-21	ssh	23:56:51	1
2264448	99	64	1,59	cyclictest	2351034	-21	ssh	23:56:50	1
2264448	99	64	1,59	cyclictest	2343267	-21	ssh	23:40:34	1
2264448	99	64	1,59	cyclictest	2343267	-21	ssh	23:40:34	1
2264448	99	64	1,59	cyclictest	2270123	-21	munin-run	21:00:01	1
2264448	99	64	1,58	cyclictest	2266680	-21	sshd	19:50:37	1
2264448	99	61	1,54	cyclictest	48	-21	kcompactd0	19:13:40	1
2264448	99	61	1,54	cyclictest	48	-21	kcompactd0	19:13:40	1
2264448	99	60	2,54	cyclictest	2267843	-21	cat	20:15:02	1
2264448	99	60	2,53	cyclictest	2266426	-21	sshd	19:45:35	1
2264448	99	60	1,55	cyclictest	2267477	-21	sshd	20:08:48	1
2264448	99	60	1,55	cyclictest	2267477	-21	sshd	20:08:47	1
2264448	99	60	1,55	cyclictest	2265141	-21	sshd	19:20:48	1
2264448	99	60	1,54	cyclictest	48	-21	kcompactd0	20:33:34	1
2264445	99	60	29,15	cyclictest	2281462	-21	ssh	21:32:21	0
2264455	99	59	17,6	cyclictest	37	-21	ksoftirqd/3	23:35:02	3
2264455	99	59	17,6	cyclictest	37	-21	ksoftirqd/3	23:35:01	3
2264448	99	59	2,53	cyclictest	2265680	-21	munin-run	19:35:00	1
2264448	99	59	1,53	cyclictest	364	-21	snmpd	21:08:45	1
2264448	99	59	1,52	cyclictest	364	-21	snmpd	19:41:26	1
2264445	99	59	37,17	cyclictest	2362073	-21	ssh	00:20:00	0
2264445	99	59	37,17	cyclictest	2362073	-21	ssh	00:20:00	0
2264448	99	58	2,51	cyclictest	2264935	-21	munin-run	19:20:00	1
2264448	99	58	1,52	cyclictest	2268509	-21	sshd	20:25:48	1
2264452	99	57	49,5	cyclictest	2342854	-21	kworker/2:1	00:40:01	2
2264452	99	57	49,5	cyclictest	2342854	-21	kworker/2:1	00:40:01	2
2264448	99	57	1,52	cyclictest	364	-21	snmpd	20:54:39	1
2264448	99	57	1,51	cyclictest	48	-21	kcompactd0	20:24:41	1
2264445	99	57	27,14	cyclictest	2353416	-21	ssh	00:01:47	0
2264445	99	57	26,15	cyclictest	2271372	-21	ssh	21:11:22	0
2264445	99	57	21,32	cyclictest	12	-21	ksoftirqd/0	21:29:35	0
2264455	99	56	46,7	cyclictest	37	-21	ksoftirqd/3	00:20:01	3
2264455	99	56	46,7	cyclictest	37	-21	ksoftirqd/3	00:20:01	3
2264452	99	56	46,6	cyclictest	2342854	-21	kworker/2:1	00:00:03	2
2264452	99	56	44,6	cyclictest	2270137	-21	kworker/2:3	21:45:00	2
2264452	99	56	42,11	cyclictest	30	-21	ksoftirqd/2	22:00:02	2
2264452	99	56	42,11	cyclictest	30	-21	ksoftirqd/2	22:00:01	2
2264448	99	56	1,51	cyclictest	2269540	-21	sshd	20:45:48	1
2264448	99	56	1,50	cyclictest	364	-21	snmpd	20:43:29	1
2264455	99	55	37,14	cyclictest	1	-21	systemd	21:50:01	3
2264452	99	55	46,6	cyclictest	2255000	-21	kworker/2:0	22:26:53	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2021-09-01 - 00:33