OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot4s.osadl.org (updated Fri Jul 31, 2026 00:44:12)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1450771	2	183	0,2	sleep3	575	-21	kworker/3:2+events	22:33:03	3
1278627	2	81	0,2	sleep3	575	-21	kworker/3:2+events	19:38:06	3
1354486	2	76	0,6	chrt	45	1	irq_work/3	20:57:54	3
1458907	2	65	0,4	sleep1	0	-21	swapper/1	22:42:56	1
1336350	2	57	0,2	chrt	575	-21	kworker/3:2+events	20:38:00	3
1491254	2	55	0,4	sleep1	0	-21	swapper/1	23:13:06	1
1247889	99	55	44,8	cyclictest	1363714	-21	latency_hist	21:05:01	0
1247889	99	50	42,6	cyclictest	1279463	-21	latency_hist	19:40:01	0
1247892	99	48	37,9	cyclictest	275	-21	systemd-journal	21:35:00	1
1247892	99	46	37,6	cyclictest	1543077	-21	apt-get	00:07:53	1
1247889	99	46	38,6	cyclictest	1304841	-21	apt-get	20:07:52	0
1252920	2	45	0,4	sleep0	0	-21	swapper/0	19:15:01	0
1247892	99	45	37,6	cyclictest	1537576	-21	latency_hist	00:00:01	1
1247892	99	44	39,4	cyclictest	161772	-21	kworker/u8:0+flush-8:0	19:15:06	1
1247892	99	44	39,3	cyclictest	1329317	-21	kworker/u8:0+events_unbound	20:57:56	1
1247892	99	44	37,5	cyclictest	1324150	-21	kworker/u8:3+events_unbound	20:37:55	1
1247892	99	41	37,3	cyclictest	1324150	-21	kworker/u8:3+events_unbound	21:03:01	1
1247892	99	41	36,4	cyclictest	1388457	-21	kworker/u8:0+events_unbound	22:27:54	1
1247892	99	41	36,4	cyclictest	1388457	-21	kworker/u8:0+events_unbound	22:27:54	1
1247892	99	41	34,5	cyclictest	1538075	-21	apt-get	00:02:53	1
1247892	99	41	34,5	cyclictest	1512724	-21	kworker/u8:3+flush-8:0	23:37:58	1
1247892	99	40	36,3	cyclictest	1453078	-21	kworker/u8:2+flush-8:0	23:23:11	1
1247892	99	40	31,7	cyclictest	275	-21	systemd-journal	20:55:00	1
1247889	99	40	34,4	cyclictest	1324150	-21	kworker/u8:3+flush-8:0	20:33:09	0
1247892	99	39	34,3	cyclictest	1101863	-21	kworker/u8:1+flush-8:0	19:28:00	1
1247892	99	38	34,3	cyclictest	1216255	-21	kworker/u8:3+flush-8:0	19:43:07	1
1247889	99	38	32,4	cyclictest	1285128	-21	apt-get	19:47:51	0
1247892	99	37	32,4	cyclictest	1270024	-21	kworker/u8:2+events_unbound	19:57:55	1
1247892	99	37	25,9	cyclictest	275	-21	systemd-journal	22:08:54	1
1247892	99	36	32,3	cyclictest	1453078	-21	kworker/u8:2+events_unbound	23:16:53	1
1247892	99	36	32,3	cyclictest	1388457	-21	kworker/u8:0+events_unbound	22:03:07	1
1247892	99	36	30,4	cyclictest	1423302	-21	kworker/u8:3+events_unbound	22:33:03	1
1247892	99	36	30,4	cyclictest	1349118	-21	kworker/u8:2+events_unbound	21:07:58	1
1247892	99	36	30,4	cyclictest	1324150	-21	kworker/u8:3+events_unbound	20:33:10	1
1247892	99	36	23,6	cyclictest	1507734	-21	kworker/u8:0+events_unbound	23:48:04	1
1243102	2	36	3,9	sleep1	0	-21	swapper/1	19:06:12	1
1247892	99	35	31,3	cyclictest	1507734	-21	kworker/u8:0+flush-8:0	23:43:10	1
1247892	99	35	31,3	cyclictest	1388457	-21	kworker/u8:0+flush-8:0	22:13:11	1
1247889	99	35	0,33	cyclictest	1423309	-21	munin-run	22:05:00	0
1247892	99	34	30,3	cyclictest	1270024	-21	kworker/u8:2+events_unbound	20:02:58	1
1247892	99	34	29,4	cyclictest	1537846	-21	kworker/u8:2+flush-8:0	00:13:03	1
1247892	99	34	29,3	cyclictest	1467578	-21	kworker/u8:3+flush-8:0	23:08:06	1
1247892	99	34	29,3	cyclictest	1276554	-21	kthreadcore	19:38:04	1
1247889	99	34	29,4	cyclictest	1512724	-21	kworker/u8:3+flush-8:0	23:42:58	0
1247892	99	33	29,3	cyclictest	1270024	-21	kworker/u8:2+events_unbound	20:05:07	1
1247892	99	33	28,4	cyclictest	1324150	-21	kworker/u8:3+events_unbound	21:28:11	1
1247892	99	33	27,5	cyclictest	1388457	-21	kworker/u8:0+events_unbound	21:52:59	1
1247892	99	33	26,5	cyclictest	1368675	-21	kworker/u8:1+events_unbound	22:23:00	1
1247889	99	33	29,3	cyclictest	1270024	-21	kworker/u8:2+flush-8:0	19:52:57	0
1247892	99	32	26,5	cyclictest	1216255	-21	kworker/u8:3+events_unbound	19:13:06	1
1247895	99	31	26,4	cyclictest	1537853	-21	kworker/u8:4+flush-8:0	00:37:59	2
1247892	99	31	27,2	cyclictest	1329089	-21	apt	20:30:00	1
1247892	99	31	27,2	cyclictest	1329089	-21	apt	20:30:00	1
1247892	99	31	26,4	cyclictest	1388457	-21	kworker/u8:0+events_unbound	22:18:09	1
1247892	99	31	26,3	cyclictest	1532646	-21	cron	23:55:00	1
1247889	99	31	24,5	cyclictest	1348871	-21	latency_hist	20:50:01	0
1247889	99	31	23,6	cyclictest	1314040	-21	grep	20:13:13	0
1247889	99	31	23,3	cyclictest	1403608	-21	latency_hist	21:45:02	0
1247889	99	31	18,10	cyclictest	275	-21	systemd-journal	19:17:52	0
1247895	99	30	26,3	cyclictest	1269524	-21	cron	19:29:59	2
1247895	99	30	24,4	cyclictest	1552281	-21	unixbench_multi	00:13:15	2
1247895	99	30	22,6	cyclictest	1378554	-21	awk	21:20:01	2
1247895	99	30	22,6	cyclictest	1334021	-21	turbostat.cron	20:35:00	2
1247892	99	30	26,3	cyclictest	1467578	-21	kworker/u8:3+flush-8:0	23:27:58	1
1247892	99	30	26,3	cyclictest	1368675	-21	kworker/u8:1+flush-8:0	21:38:16	1
1247892	99	30	25,4	cyclictest	1453078	-21	kworker/u8:2+events_unbound	22:58:06	1
1247892	99	30	25,3	cyclictest	1418329	-21	cron	22:00:00	1
1247892	99	30	25,3	cyclictest	1348888	-21	true	20:50:00	1
1278328	2	29	0,5	sleep2	0	-21	swapper/2	19:38:05	2
1247895	99	29	24,3	cyclictest	1428735	-21	aten2_r5power_c	22:12:55	2
1247895	99	29	1,26	cyclictest	1419344	-21	irqcore	22:03:00	2
1247892	99	29	25,3	cyclictest	1453078	-21	kworker/u8:2+flush-8:0	22:38:06	1
1247892	99	29	24,4	cyclictest	1537846	-21	kworker/u8:2+flush-8:0	00:18:00	1
1247889	99	29	24,4	cyclictest	1216255	-21	kworker/u8:3+flush-8:0	19:42:57	0
1247889	99	29	23,4	cyclictest	1512614	-21	grep	23:33:14	0
1247889	99	29	19,8	cyclictest	1438106	-21	apt-get	22:20:00	0
1247889	99	29	19,8	cyclictest	1408814	-21	sshd	21:51:53	0
1411820	2	28	0,5	sleep3	575	-21	kworker/3:2+mm_percpu_wq	21:53:03	3
1247895	99	28	25,2	cyclictest	1433954	-21	fschecks_time	22:17:57	2
1247895	99	28	24,3	cyclictest	1408257	-21	unixbench_singl	21:48:14	2
1247895	99	28	24,3	cyclictest	1	-21	systemd	00:00:00	2
1247895	99	28	24,2	cyclictest	1264622	-21	sh	19:25:00	2
1247895	99	28	23,4	cyclictest	1368675	-21	kworker/u8:1+flush-8:0	21:53:13	2
1247895	99	28	23,3	cyclictest	1388233	-21	unixbench_singl	21:28:13	2
1247892	99	28	24,3	cyclictest	1368675	-21	kworker/u8:1+events_unbound	21:48:31	1
1247892	99	28	24,3	cyclictest	1270024	-21	kworker/u8:2+events_unbound	20:20:32	1
1247892	99	28	23,4	cyclictest	1453078	-21	kworker/u8:2+flush-8:0	23:33:02	1
1247892	99	28	23,4	cyclictest	1270024	-21	kworker/u8:2+events_unbound	19:47:54	1
1247892	99	28	23,3	cyclictest	1329317	-21	kworker/u8:0+flush-8:0	20:43:27	1
1247892	99	28	23,3	cyclictest	1270024	-21	kworker/u8:2+events_unbound	19:33:07	1
1247892	99	28	18,8	cyclictest	1472251	-21	ntpq	22:53:06	1
1247889	99	28	24,3	cyclictest	1427459	-21	needreboot	22:08:06	0
1247889	99	28	23,3	cyclictest	0	-21	swapper/0	00:00:00	0
1247889	99	28	22,4	cyclictest	1507702	-21	unixbench_singl	23:28:12	0
1247889	99	28	22,4	cyclictest	1358557	-21	unixbench_singl	20:58:12	0
1247889	99	28	17,9	cyclictest	275	-21	systemd-journal	21:30:49	0
1247895	99	27	24,2	cyclictest	1453897	-21	cpuspeed_turbos	22:37:56	2
1247895	99	27	22,3	cyclictest	1304360	-21	cron	20:05:00	2
1247892	99	27	23,3	cyclictest	1507734	-21	kworker/u8:0+flush-8:0	00:23:11	1
1247892	99	27	23,3	cyclictest	1388457	-21	kworker/u8:0+flush-8:0	22:48:11	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17