OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackeslot5s.osadl.org (updated Sat Dec 06, 2025 00:44:22)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
31841	99	24	21,2	cyclictest	13206	-21	munin-run	20:44:59	3
31837	99	24	21,2	cyclictest	21499	-21	sh	00:20:00	2
31837	99	24	0,1	cyclictest	313	-21	systemd-journal	22:40:00	2
31833	99	24	22,1	cyclictest	19728	-21	cron	23:10:00	1
31841	99	23	23,0	cyclictest	7812	-21	apt-get	22:48:24	3
31841	99	23	0,22	cyclictest	593	-21	dbus-daemon	00:40:00	3
31841	99	23	0,22	cyclictest	17908	-21	apt-get	22:00:02	3
31837	99	23	21,1	cyclictest	24568	-21	sendmail-msp	23:20:00	2
31833	99	23	21,1	cyclictest	25885	-21	perf	20:05:00	1
31833	99	23	0,2	cyclictest	20413	-21	munin-plugin-st	21:00:00	1
31833	99	23	0,22	cyclictest	1089	-21	awk	20:20:00	1
31828	99	23	3,1	cyclictest	26967	-21	cpuspeed_turbos	20:08:21	0
31828	99	23	21,1	cyclictest	17287	-21	sendmail-msp	22:00:00	0
31828	99	23	0,22	cyclictest	4855	-21	cron	22:40:00	0
31828	99	23	0,22	cyclictest	13900	-21	cron	00:05:00	0
31828	99	23	0,1	cyclictest	313	-21	systemd-journal	22:25:00	0
31828	99	23	0,1	cyclictest	0	-21	swapper/0	23:48:22	0
31841	99	22	20,1	cyclictest	25082	-21	apt-get	23:23:22	3
31841	99	22	20,1	cyclictest	2093	-21	ls	22:35:00	3
31841	99	22	20,0	cyclictest	0	-21	swapper/3	23:53:24	3
31841	99	22	19,2	cyclictest	17347	-21	grep	23:05:00	3
31841	99	22	0,21	cyclictest	25388	-21	apt-get	22:18:21	3
31841	99	22	0,21	cyclictest	11412	-21	cron	00:00:00	3
31841	99	22	0,21	cyclictest	10659	-21	apt-get	22:53:25	3
31841	99	22	0,21	cyclictest	0	-21	swapper/3	00:23:21	3
31837	99	22	20,1	cyclictest	0	-21	swapper/2	00:35:01	2
31837	99	22	19,2	cyclictest	11426	-40	mandb	00:00:00	2
31837	99	22	0,21	cyclictest	7092	-21	apt-get	23:53:24	2
31837	99	22	0,21	cyclictest	5908	-21	cron	20:30:00	2
31837	99	22	0,21	cyclictest	15604	-21	basename	20:50:00	2
31837	99	22	0,21	cyclictest	14883	-21	awk	21:55:00	2
31837	99	22	0,21	cyclictest	0	-21	swapper/2	23:03:22	2
31837	99	22	0,21	cyclictest	0	-21	swapper/2	19:45:00	2
31837	99	22	0,1	cyclictest	0	-21	swapper/2	23:34:59	2
31833	99	22	22,0	cyclictest	0	-21	swapper/1	21:53:21	1
31833	99	22	21,0	cyclictest	0	-21	swapper/1	23:33:21	1
31833	99	22	0,21	cyclictest	17306	-21	awk	22:00:00	1
31833	99	22	0,21	cyclictest	0	-21	swapper/1	22:53:24	1
31833	99	22	0,21	cyclictest	0	-21	swapper/1	20:48:21	1
31833	99	22	0,21	cyclictest	0	-21	swapper/1	20:30:01	1
31833	99	22	0,21	cyclictest	0	-21	swapper/1	19:53:21	1
31828	99	22	20,1	cyclictest	0	-21	swapper/0	00:25:00	0
31828	99	22	0,21	cyclictest	4042	-21	apt-get	20:28:20	0
31828	99	22	0,21	cyclictest	21539	-21	sleep	00:20:00	0
31828	99	22	0,21	cyclictest	18508	-21	apt-get	20:58:23	0
31841	99	21	21,0	cyclictest	27479	-21	apt-get	23:28:23	3
31841	99	21	21,0	cyclictest	25873	-21	apt-get	20:05:02	3
31841	99	21	20,1	cyclictest	23994	-21	apt-get	20:03:21	3
31841	99	21	20,1	cyclictest	13708	-21	apt-get	20:48:20	3
31841	99	21	18,2	cyclictest	6619	-21	munin-run	19:25:00	3
31841	99	21	0,20	cyclictest	31777	-21	munin-run	23:35:00	3
31841	99	21	0,20	cyclictest	30201	-21	apt-get	22:28:21	3
31841	99	21	0,20	cyclictest	2929	-21	apt-get	21:33:22	3
31841	99	21	0,20	cyclictest	17280	-21	apt-get	22:00:00	3
31841	99	21	0,20	cyclictest	0	-21	swapper/3	23:43:20	3
31841	99	21	0,20	cyclictest	0	-21	swapper/3	20:23:21	3
31841	99	21	0,20	cyclictest	0	-21	swapper/3	19:48:20	3
31841	99	21	0,20	cyclictest	0	-21	swapper/3	00:03:22	3
31841	99	21	0,1	cyclictest	0	-21	swapper/3	23:40:00	3
31841	99	21	0,1	cyclictest	0	-21	swapper/3	21:18:19	3
31841	99	21	0,0	cyclictest	0	-21	swapper/3	22:43:22	3
31841	99	21	0,0	cyclictest	0	-21	swapper/3	00:13:22	3
31837	99	21	21,0	cyclictest	0	-21	swapper/2	22:13:19	2
31837	99	21	19,1	cyclictest	4691	-21	apt-get	23:48:22	2
31837	99	21	0,20	cyclictest	20268	-21	apt-get	23:13:24	2
31837	99	21	0,20	cyclictest	11966	-21	apt-get	19:38:20	2
31837	99	21	0,20	cyclictest	10194	-21	apt-get	21:48:22	2
31837	99	21	0,20	cyclictest	0	-21	swapper/2	19:33:21	2
31837	99	21	0,0	cyclictest	0	-21	swapper/2	22:18:21	2
31837	99	21	0,0	cyclictest	0	-21	swapper/2	22:08:21	2
31837	99	21	0,0	cyclictest	0	-21	swapper/2	21:03:23	2
31833	99	21	21,0	cyclictest	0	-21	swapper/1	20:23:20	1
31833	99	21	21,0	cyclictest	0	-21	swapper/1	00:15:02	1
31833	99	21	20,1	cyclictest	9542	-21	apt-get	23:58:24	1
31833	99	21	18,2	cyclictest	23916	-21	cron	00:25:00	1
31833	99	21	0,21	cyclictest	0	-21	swapper/1	22:58:25	1
31833	99	21	0,20	cyclictest	5415	-21	apt-get	22:43:23	1
31833	99	21	0,20	cyclictest	0	-21	swapper/1	21:48:23	1
31833	99	21	0,20	cyclictest	0	-21	swapper/1	20:38:20	1
31833	99	21	0,20	cyclictest	0	-21	swapper/1	19:18:21	1
31833	99	21	0,0	cyclictest	5324	-21	apt-get	21:38:23	1
31833	99	21	0,0	cyclictest	0	-21	swapper/1	22:33:22	1
31833	99	21	0,0	cyclictest	0	-21	swapper/1	22:28:21	1
31833	99	21	0,0	cyclictest	0	-21	swapper/1	19:13:20	1
31828	99	21	20,1	cyclictest	29183	-21	apt-get	20:13:21	0
31828	99	21	19,1	cyclictest	476	-21	apt-get	21:28:22	0
31828	99	21	0,21	cyclictest	0	-21	swapper/0	21:23:23	0
31828	99	21	0,20	cyclictest	32279	-21	apt-get	23:38:22	0
31828	99	21	0,20	cyclictest	0	-21	swapper/0	19:33:20	0
31828	99	21	0,0	cyclictest	17280	-21	apt-get	22:00:01	0
31828	99	21	0,0	cyclictest	0	-21	swapper/0	19:48:21	0
31828	99	21	0,0	cyclictest	0	-21	swapper/0	00:08:22	0
31841	99	20	20,0	cyclictest	30534	-21	apt-get	21:23:22	3
31841	99	20	20,0	cyclictest	21576	-21	apt-get	19:58:20	3
31841	99	20	20,0	cyclictest	0	-21	swapper/3	21:03:24	3
31841	99	20	20,0	cyclictest	0	-21	swapper/3	20:58:23	3
31841	99	20	20,0	cyclictest	0	-21	swapper/3	20:18:21	3
31841	99	20	19,0	cyclictest	23318	-21	apt-get	21:08:21	3
31841	99	20	0,20	cyclictest	0	-21	swapper/3	00:08:22	3
31841	99	20	0,0	cyclictest	0	-21	swapper/3	23:18:21	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2020-09-17 - 11:29