OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot4s.osadl.org (updated Sun Aug 16, 2026 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1254211	99	62	52,7	cyclictest	1524360	-21	latency_hist	23:40:01	0
1254211	99	54	45,6	cyclictest	1549189	-21	latency_hist	00:05:01	0
1254211	99	52	45,5	cyclictest	1569076	-21	latency_hist	00:25:01	0
1254219	99	51	43,6	cyclictest	1276098	-21	apt-get	19:30:00	2
1254215	99	50	44,4	cyclictest	1239316	-21	kworker/u8:1+flush-8:0	19:27:58	1
1254211	99	49	44,3	cyclictest	1350808	-21	kworker/u8:0+events_unbound	21:18:00	0
1254211	99	49	44,3	cyclictest	1350808	-21	kworker/u8:0+events_unbound	21:18:00	0
1254211	99	49	43,4	cyclictest	1326044	-21	kworker/u8:3+events_unbound	20:35:01	0
1254215	99	48	42,5	cyclictest	1554486	-21	kworker/u8:1+events_unbound	00:37:54	1
1254211	99	48	42,4	cyclictest	1306346	-21	kworker/u8:2+flush-8:0	20:12:47	0
1254215	99	46	38,6	cyclictest	1415513	-21	/usr/sbin/munin	21:52:57	1
1254211	99	46	38,6	cyclictest	1534717	-21	/usr/sbin/munin	23:52:57	0
1254211	99	46	38,6	cyclictest	1266404	-21	/usr/sbin/munin	19:22:59	0
1254211	99	46	37,6	cyclictest	1315892	-21	latency_hist	20:10:00	0
1404746	2	45	0,10	sleep0	1404749	-21	awk	21:37:58	0
1254219	99	45	34,8	cyclictest	1306125	-21	cat	20:00:00	2
1254215	99	45	40,4	cyclictest	1525202	-21	kworker/u8:2+flush-8:0	23:50:00	1
1254215	99	44	38,4	cyclictest	1350808	-21	kworker/u8:0+flush-8:0	21:12:54	1
1254215	99	44	37,5	cyclictest	1350808	-21	kworker/u8:0+flush-8:0	22:43:00	1
1254215	99	44	37,5	cyclictest	1350808	-21	kworker/u8:0+flush-8:0	22:42:59	1
1254215	99	44	34,7	cyclictest	1320832	-21	latency_hist	20:15:01	1
1254219	99	43	36,5	cyclictest	1424906	-21	journal-offline	21:59:19	2
1254215	99	43	38,4	cyclictest	1350808	-21	kworker/u8:0+flush-8:0	21:42:50	1
1254211	99	43	38,4	cyclictest	1461212	-21	kworker/u8:1+flush-8:0	23:07:47	0
1254211	99	43	34,7	cyclictest	275	-21	systemd-journal	00:32:50	0
1254215	99	42	35,5	cyclictest	275	-21	systemd-journal	23:08:35	1
1254211	99	42	37,3	cyclictest	1461212	-21	kworker/u8:1+flush-8:0	23:17:47	0
1254211	99	42	36,4	cyclictest	1365384	-21	kworker/u8:1+flush-8:0	21:27:55	0
1254219	99	41	30,8	cyclictest	1544917	-21	diskstats	00:02:44	2
1254215	99	41	36,3	cyclictest	1306346	-21	kworker/u8:2+flush-8:0	20:17:59	1
1254215	99	41	35,4	cyclictest	1461212	-21	kworker/u8:1+events_unbound	23:12:58	1
1254215	99	40	35,4	cyclictest	1350808	-21	kworker/u8:0+flush-8:0	22:37:59	1
1254211	99	40	36,3	cyclictest	1525202	-21	kworker/u8:2+events_unbound	00:07:49	0
1254211	99	40	36,3	cyclictest	1259085	-21	cron	19:15:00	0
1254215	99	39	35,3	cyclictest	1461212	-21	kworker/u8:1+flush-8:0	23:23:02	1
1254215	99	39	34,4	cyclictest	1409468	-21	kworker/u8:3+flush-8:0	21:57:49	1
1254215	99	39	34,4	cyclictest	1221985	-21	kworker/u8:2+flush-8:0	19:47:54	1
1254215	99	39	34,3	cyclictest	1261218	-21	kworker/u8:3+events_unbound	19:45:00	1
1254211	99	39	35,3	cyclictest	1221985	-21	kworker/u8:2+flush-8:0	19:48:00	0
1254211	99	39	33,4	cyclictest	1365384	-21	kworker/u8:1+flush-8:0	22:28:00	0
1254219	99	38	29,7	cyclictest	1335653	-21	cat	20:30:00	2
1254215	99	38	32,4	cyclictest	1461212	-21	kworker/u8:1+flush-8:0	23:38:00	1
1254215	99	38	31,5	cyclictest	1499861	-21	apt-get	23:17:39	1
1254211	99	38	34,2	cyclictest	1564118	-21	sh	00:20:01	0
1254211	99	38	29,7	cyclictest	1459596	-21	latency_hist	22:35:01	0
1254215	99	37	32,4	cyclictest	1350808	-21	kworker/u8:0+flush-8:0	22:15:31	1
1254211	99	37	31,4	cyclictest	1350808	-21	kworker/u8:0+flush-8:0	21:42:51	0
1254211	99	37	27,8	cyclictest	275	-21	systemd-journal	19:45:00	0
1254211	99	37	0,35	cyclictest	1	-21	systemd	21:32:57	0
1254211	99	36	33,2	cyclictest	1464533	-21	latency_hist	22:40:00	0
1254215	99	35	31,2	cyclictest	1350808	-21	kworker/u8:0+flush-8:0	21:27:45	1
1254215	99	35	29,5	cyclictest	1469194	-21	kworker/u8:3+events_unbound	22:47:54	1
1254215	99	35	29,5	cyclictest	1469194	-21	kworker/u8:3+events_unbound	22:47:54	1
1254211	99	35	27,6	cyclictest	1355931	-21	/usr/sbin/munin	20:53:00	0
1254211	99	35	24,9	cyclictest	275	-21	systemd-journal	00:00:00	0
1249416	2	35	4,10	sleep1	0	-21	swapper/1	19:05:48	1
1254219	99	34	11,5	cyclictest	1568385	-21	ntpq	00:22:55	2
1254219	99	34	11,13	cyclictest	0	-21	swapper/2	00:37:59	2
1254215	99	34	30,3	cyclictest	1306346	-21	kworker/u8:2+events_unbound	20:10:01	1
1254215	99	34	29,4	cyclictest	1554486	-21	kworker/u8:1+events_unbound	00:27:56	1
1254215	99	34	28,4	cyclictest	1365384	-21	kworker/u8:1+flush-8:0	21:22:57	1
1254211	99	34	30,3	cyclictest	1296319	-21	kworker/u8:1+flush-8:0	19:53:00	0
1254211	99	34	29,4	cyclictest	1469194	-21	kworker/u8:3+events_unbound	22:47:56	0
1254211	99	34	29,4	cyclictest	1469194	-21	kworker/u8:3+events_unbound	22:47:56	0
1254211	99	34	29,4	cyclictest	1326044	-21	kworker/u8:3+flush-8:0	20:37:53	0
1254211	99	34	24,8	cyclictest	275	-21	systemd-journal	19:40:00	0
1254211	99	34	1,30	cyclictest	1580469	-21	sshd	00:37:50	0
1254219	99	33	9,13	cyclictest	1316345	-21	apt-get	20:12:40	2
1254219	99	33	9,11	cyclictest	1261463	-21	apt-get	19:17:42	2
1254219	99	33	18,10	cyclictest	1350998	-21	apt-get	20:47:40	2
1254215	99	33	29,3	cyclictest	1489783	-21	kworker/u8:0+flush-8:0	00:18:02	1
1254215	99	33	26,5	cyclictest	1261018	-21	irqcore	19:15:05	1
1254211	99	33	28,4	cyclictest	455829	-21	kworker/u8:0+events_unbound	19:15:01	0
1254211	99	33	27,4	cyclictest	1350808	-21	kworker/u8:0+events_unbound	20:47:55	0
1254211	99	33	26,5	cyclictest	1291153	-21	kworker/u8:0+flush-8:0	20:27:56	0
1254219	99	32	25,5	cyclictest	1474532	-21	cp	22:50:00	2
1254219	99	32	25,5	cyclictest	1474532	-21	cp	22:50:00	2
1254219	99	32	1,14	cyclictest	1445204	-21	apt-get	22:22:41	2
1254219	99	32	10,11	cyclictest	1543461	-21	ntpq	23:57:54	2
1254215	99	32	27,4	cyclictest	1499636	-21	kworker/u8:4+events_unbound	00:02:53	1
1254215	99	32	26,5	cyclictest	1409468	-21	kworker/u8:3+flush-8:0	21:47:52	1
1254211	99	32	29,2	cyclictest	1479627	-21	cron	22:55:00	0
1254211	99	32	27,4	cyclictest	1306346	-21	kworker/u8:2+events_unbound	20:57:55	0
1254211	99	32	27,4	cyclictest	1261218	-21	kworker/u8:3+events_unbound	20:00:07	0
1254211	99	32	27,4	cyclictest	1261218	-21	kworker/u8:3+events_unbound	20:00:07	0
1254211	99	32	25,5	cyclictest	1271867	-21	diskstats	19:27:43	0
1254219	99	31	26,3	cyclictest	1563852	-21	unixbench_multi	00:18:02	2
1254219	99	31	26,3	cyclictest	1366165	-21	fschecks_time	21:02:43	2
1254219	99	31	22,4	cyclictest	1375713	-21	apt-get	21:12:40	2
1254219	99	31	11,4	cyclictest	1558396	-21	ntpq	00:12:55	2
1254219	99	31	11,4	cyclictest	1558396	-21	ntpq	00:12:55	2
1254215	99	31	27,3	cyclictest	1307184	-21	irqrtprio	20:02:48	1
1254215	99	31	27,3	cyclictest	1307184	-21	irqrtprio	20:02:48	1
1254215	99	31	25,5	cyclictest	1221985	-21	kworker/u8:2+flush-8:0	19:37:54	1
1254215	99	31	24,5	cyclictest	1365384	-21	kworker/u8:1+flush-8:0	21:10:00	1
1254211	99	31	27,3	cyclictest	1365384	-21	kworker/u8:1+events_unbound	22:02:44	0
1254211	99	31	26,3	cyclictest	1554486	-21	kworker/u8:1+events_unbound	00:27:46	0
1254211	99	31	0,29	cyclictest	1375286	-21	munin-run	21:10:00	0
1254219	99	30	9,11	cyclictest	1498703	-21	ntpq	23:12:55	2
1254219	99	30	18,9	cyclictest	1494458	-21	awk	23:10:01	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17