OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot4s.osadl.org (updated Sat May 30, 2026 00:44:15)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1497873	2	174	0,3	sleep3	75	-21	kworker/3:1+events	23:55:46	3
1211039	99	85	77,5	cyclictest	1307385	-21	apt-get	20:45:04	2
1211039	99	85	77,5	cyclictest	1307385	-21	apt-get	20:45:03	2
1538419	2	74	0,2	sleep3	48	1	ktimers/3	00:35:47	3
1310046	2	68	0,1	sleep1	1310051	-21	cut	20:45:48	1
1310046	2	68	0,1	sleep1	1310051	-21	cut	20:45:47	1
1211036	99	58	52,4	cyclictest	1247651	-21	apt-get	19:45:02	1
1211031	99	57	47,7	cyclictest	1362463	-21	latency_hist	21:40:01	0
1211036	99	55	48,5	cyclictest	1227838	-21	kworker/u8:2+flush-8:0	20:00:54	1
1211039	99	52	48,3	cyclictest	119521	-21	kworker/u8:1+events_unbound	21:15:57	2
1211039	99	52	47,4	cyclictest	1200942	-21	kworker/u8:0+events_unbound	19:15:41	2
1211031	99	51	45,5	cyclictest	119521	-21	kworker/u8:1+events_unbound	20:20:46	0
1211031	99	51	41,8	cyclictest	1337260	-21	latency_hist	21:15:01	0
1211031	99	49	38,8	cyclictest	1262660	-21	apt-get	20:00:01	0
1211039	99	47	43,2	cyclictest	1470966	-21	kworker/u8:2+events_unbound	23:30:50	2
1211036	99	47	40,6	cyclictest	1392287	-21	kworker/u8:0+flush-8:0	22:15:56	1
1211036	99	45	35,8	cyclictest	1526580	-21	/usr/sbin/munin	00:25:53	1
1211036	99	45	32,10	cyclictest	1515932	-21	apt-get	00:14:59	1
1211039	99	44	39,4	cyclictest	1476069	-21	kworker/u8:0+events_unbound	23:35:49	2
1211036	99	44	40,3	cyclictest	1392287	-21	kworker/u8:0+events_unbound	23:15:50	1
1439719	2	43	0,3	sleep0	0	-21	swapper/0	22:55:48	0
1211036	99	43	36,5	cyclictest	1501039	-21	cp	23:59:59	1
1211036	99	43	35,6	cyclictest	1200942	-21	kworker/u8:0+flush-8:0	19:10:41	1
1211031	99	43	34,7	cyclictest	1491657	-21	diskstats	23:50:40	0
1211039	99	42	33,3	cyclictest	1401990	-21	kworker/u8:1+events_unbound	23:05:54	2
1211036	99	42	34,5	cyclictest	1525173	-21	ntpq	00:20:49	1
1211036	99	42	32,8	cyclictest	1261841	-21	ntpq	19:55:53	1
1211036	99	42	31,9	cyclictest	1416577	-21	kworker/u8:3+flush-8:0	00:00:54	1
1211031	99	42	36,4	cyclictest	1227838	-21	kworker/u8:2+flush-8:0	19:40:42	0
1211031	99	42	32,8	cyclictest	1426957	-21	/usr/sbin/munin	22:45:48	0
1211036	99	41	32,7	cyclictest	1241840	-21	ntpq	19:35:52	1
1211039	99	40	36,3	cyclictest	1367413	-21	kworker/u8:2+flush-8:0	22:10:59	2
1211036	99	40	31,6	cyclictest	1337264	-21	apt-get	21:15:01	1
1211036	99	40	30,7	cyclictest	1306499	-21	ntpq	20:40:51	1
1211039	99	39	31,6	cyclictest	1377269	-21	/usr/sbin/munin	21:54:59	2
1211036	99	39	32,6	cyclictest	1401990	-21	kworker/u8:1+flush-8:0	22:50:55	1
1211031	99	39	29,8	cyclictest	1276854	-21	ntpq	20:10:54	0
1211031	99	39	29,7	cyclictest	1272804	-21	latency_hist	20:10:01	0
1211031	99	39	2,32	cyclictest	1332322	-21	kworker/0:0+events	23:45:33	0
1211039	99	38	34,3	cyclictest	1401990	-21	kworker/u8:1+events_unbound	23:25:48	2
1211031	99	38	27,2	cyclictest	1704890	-21	systemd-journal	21:50:48	0
1211031	99	38	2,31	cyclictest	1222895	-21	kworker/0:2+events	19:25:30	0
1289250	2	37	0,5	sleep3	45	1	irq_work/3	20:25:47	3
1211036	99	37	33,3	cyclictest	1297217	-21	kworker/u8:3+events_unbound	21:20:51	1
1211036	99	37	32,3	cyclictest	1392287	-21	kworker/u8:0+events_unbound	22:20:45	1
1211036	99	37	32,3	cyclictest	1392287	-21	kworker/u8:0+events_unbound	22:20:44	1
1211036	99	37	31,4	cyclictest	1506382	-21	apt-get	00:05:39	1
1211036	99	37	30,5	cyclictest	1282961	-21	apt-get	20:20:38	1
1211036	99	37	27,7	cyclictest	1416577	-21	kworker/u8:3+flush-8:0	22:45:51	1
1211031	99	37	2,30	cyclictest	1332322	-21	kworker/0:0+events	23:15:03	0
1211031	99	37	2,30	cyclictest	1332322	-21	kworker/0:0+events	00:15:31	0
1211031	99	37	2,30	cyclictest	1332322	-21	kworker/0:0+events	00:15:31	0
1211039	99	36	31,4	cyclictest	1297217	-21	kworker/u8:3+events_unbound	21:25:00	2
1211039	99	36	30,5	cyclictest	1297217	-21	kworker/u8:3+events_unbound	21:26:16	2
1211036	99	36	30,4	cyclictest	1200942	-21	kworker/u8:0+events_unbound	19:15:56	1
1211036	99	36	25,9	cyclictest	1361602	-21	ntpq	21:35:50	1
1211036	99	36	23,9	cyclictest	1704890	-21	systemd-journal	22:39:49	1
1211031	99	36	30,4	cyclictest	119521	-21	kworker/u8:1+flush-8:0	21:00:43	0
1211031	99	36	28,6	cyclictest	1177269	-21	kworker/u8:3+flush-8:0	19:20:50	0
1211031	99	36	27,8	cyclictest	119521	-21	kworker/u8:1+flush-8:0	20:50:52	0
1211031	99	36	2,29	cyclictest	1421778	-21	kworker/0:1+events	22:40:03	0
1210578	2	36	4,9	sleep1	0	-21	swapper/1	19:08:41	1
1211036	99	35	31,3	cyclictest	1227838	-21	kworker/u8:2+flush-8:0	19:40:55	1
1211036	99	35	27,6	cyclictest	1476069	-21	kworker/u8:0+flush-8:0	23:40:52	1
1211036	99	35	23,9	cyclictest	1704890	-21	systemd-journal	23:45:49	1
1211031	99	35	28,5	cyclictest	1476069	-21	kworker/u8:0+events_unbound	23:35:54	0
1211031	99	35	2,32	cyclictest	1222895	-21	kworker/0:2+events	19:37:27	0
1211031	99	35	2,31	cyclictest	1222895	-21	kworker/0:2+events	19:32:45	0
1211031	99	35	2,28	cyclictest	1222895	-21	kworker/0:2+events	20:00:33	0
1211036	99	34	29,4	cyclictest	1297217	-21	kworker/u8:3+flush-8:0	21:45:55	1
1211036	99	34	29,3	cyclictest	1486201	-21	kworker/u8:2+flush-8:0	23:50:42	1
1211036	99	34	28,4	cyclictest	1297217	-21	kworker/u8:3+events_unbound	21:55:56	1
1211036	99	34	28,3	cyclictest	119521	-21	kworker/u8:1+flush-8:0	21:30:43	1
1211031	99	34	3,30	cyclictest	1332322	-21	kworker/0:0+events	00:21:25	0
1211031	99	34	29,3	cyclictest	1297478	-21	latency_hist	20:35:00	0
1211031	99	34	28,4	cyclictest	1416577	-21	kworker/u8:3+events_unbound	22:50:38	0
1211031	99	34	25,7	cyclictest	1465497	-21	ntpq	23:20:50	0
1211031	99	34	24,8	cyclictest	1704890	-21	systemd-journal	19:50:00	0
1211031	99	34	2,31	cyclictest	1332322	-21	kworker/0:0+events	23:10:33	0
1211031	99	34	2,31	cyclictest	1332322	-21	kworker/0:0+events	21:56:03	0
1211031	99	34	2,31	cyclictest	1332322	-21	kworker/0:0+events	21:27:33	0
1211031	99	34	2,26	cyclictest	1332322	-21	kworker/0:0+events	00:00:33	0
1211031	99	34	21,4	cyclictest	1416836	-21	latency_hist	22:35:00	0
1211031	99	34	1,31	cyclictest	1332322	-21	kworker/0:0+events	22:39:03	0
1211031	99	34	0,33	cyclictest	1222895	-21	kworker/0:2+events	20:46:03	0
1211031	99	34	0,33	cyclictest	1222895	-21	kworker/0:2+events	20:46:02	0
1211039	99	33	28,4	cyclictest	1297217	-21	kworker/u8:3+events_unbound	21:55:49	2
1211039	99	33	26,5	cyclictest	1704890	-21	systemd-journal	20:24:59	2
1211036	99	33	28,4	cyclictest	1227838	-21	kworker/u8:2+flush-8:0	20:05:41	1
1211036	99	33	28,3	cyclictest	119521	-21	kworker/u8:1+flush-8:0	19:25:42	1
1211036	99	33	26,5	cyclictest	1451858	-21	apt-get	23:10:40	1
1211036	99	33	18,10	cyclictest	1704890	-21	systemd-journal	20:15:47	1
1211031	99	33	3,25	cyclictest	1222895	-21	kworker/0:2+events	20:40:05	0
1211031	99	33	2,30	cyclictest	1332322	-21	kworker/0:0+events	00:09:00	0
1211031	99	33	2,30	cyclictest	1222895	-21	kworker/0:2+events	20:36:29	0
1211031	99	33	2,30	cyclictest	1222895	-21	kworker/0:2+events	20:17:27	0
1211031	99	33	2,30	cyclictest	1191199	-21	kworker/0:0+events	19:12:46	0
1211031	99	33	2,29	cyclictest	1332322	-21	kworker/0:0+events	22:23:11	0
1211031	99	33	2,29	cyclictest	1332322	-21	kworker/0:0+events	22:23:11	0
1211031	99	33	2,29	cyclictest	1222895	-21	kworker/0:2+events	19:52:19	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17