OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Mon Dec 29, 2025 00:46:48)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1361947	2	3196	3134,46	sleep0	1360689	-21	kworker/0:1+events@ dbs_work_handler	19:05:25	0
1363135	99	138	124,7	cyclictest	1611090	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:18:37	1
1363135	99	131	118,7	cyclictest	1411504	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:12:43	1
1363146	99	127	121,3	cyclictest	0	-21	swapper/4	23:58:14	4
1363135	99	119	106,7	cyclictest	1374954	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:42:24	1
1363135	99	116	104,6	cyclictest	1574778	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:03:21	1
1363146	99	114	98,9	cyclictest	1442466	-21	ssh	21:37:49	4
1363146	99	113	108,2	cyclictest	0	-21	swapper/4	23:03:04	4
1363135	99	112	60,8	cyclictest	1478488	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:07:52	1
1363135	99	112	100,6	cyclictest	1489370	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:14:34	1
1363130	99	108	95,5	cyclictest	1574778	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:18:38	0
1363141	99	106	92,7	cyclictest	1453115	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:52:50	3
1363130	99	106	35,48	cyclictest	1437557	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:37:49	0
1363137	99	105	91,7	cyclictest	1364883	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:22:20	2
1588580	2	104	0,4	sleep3	0	-21	swapper/3	23:45:27	3
1571854	2	104	0,7	sleep1	1571849	-21	ntp_states	23:30:40	1
1363137	99	104	91,7	cyclictest	1360706	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:12:19	2
1363141	99	102	93,6	cyclictest	210	-21	kswapd0	00:20:16	3
1363135	99	102	88,7	cyclictest	1636859	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:35:33	1
1363135	99	102	88,7	cyclictest	1636859	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:35:32	1
1363130	99	102	90,6	cyclictest	1364883	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:07:28	0
1363130	99	102	90,6	cyclictest	1364883	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:07:28	0
1363135	99	99	87,6	cyclictest	1364883	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:22:32	1
1640661	2	98	0,5	sleep4	0	-21	swapper/4	00:30:38	4
1363141	99	98	85,7	cyclictest	1437557	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:17:56	3
1363141	99	98	84,7	cyclictest	1574778	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:05:33	3
1363146	99	97	87,6	cyclictest	1465427	-21	ssh	21:57:52	4
1363135	99	97	84,7	cyclictest	1459527	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:09:24	1
1363135	99	97	84,7	cyclictest	1459527	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:09:24	1
1363130	99	97	62,28	cyclictest	1414862	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:17:23	0
1363130	99	97	40,34	cyclictest	1568854	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:28:21	0
1363141	99	96	83,7	cyclictest	1478488	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:08:04	3
1363135	99	96	83,7	cyclictest	1489370	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:20:34	1
1363130	99	96	82,6	cyclictest	1489370	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:44:04	0
1363150	99	95	88,3	cyclictest	0	-21	swapper/5	22:55:07	5
1363141	99	95	76,4	cyclictest	210	-21	kswapd0	21:20:26	3
1363130	99	95	61,27	cyclictest	1459527	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:03:58	0
1363146	99	94	80,7	cyclictest	1414700	-21	diskmemload-4	00:26:33	4
1363135	99	94	81,7	cyclictest	1524819	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:54:35	1
1363135	99	94	81,6	cyclictest	1401260	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:57:41	1
1363135	99	94	81,6	cyclictest	1401260	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:57:41	1
1363135	99	94	64,7	cyclictest	1574778	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:36:34	1
1363135	99	94	64,7	cyclictest	1574778	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:36:34	1
1363146	99	93	80,7	cyclictest	1414700	-21	diskmemload-4	23:10:27	4
1363130	99	93	85,5	cyclictest	210	-21	kswapd0	23:16:45	0
1363146	99	92	86,3	cyclictest	0	-21	swapper/4	20:52:38	4
1363146	99	92	73,12	cyclictest	1559201	-21	sh	23:20:08	4
1363137	99	92	79,7	cyclictest	1393728	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:42:36	2
1363137	99	92	79,7	cyclictest	1393728	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:42:35	2
1363135	99	92	62,8	cyclictest	1478488	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:33:29	1
1363146	99	91	85,3	cyclictest	0	-21	swapper/4	20:16:34	4
1363137	99	91	77,7	cyclictest	1518169	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:47:34	2
1363135	99	91	62,7	cyclictest	1545832	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:29:12	1
1363130	99	91	78,7	cyclictest	1360706	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:25:15	0
1363146	99	90	83,3	cyclictest	0	-21	swapper/4	23:38:13	4
1363146	99	90	83,3	cyclictest	0	-21	swapper/4	23:38:13	4
1363146	99	90	82,3	cyclictest	0	-21	swapper/4	00:08:28	4
1363137	99	90	78,6	cyclictest	1364883	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:37:36	2
1363135	99	90	82,5	cyclictest	210	-21	kswapd0	22:35:17	1
1363146	99	89	82,3	cyclictest	0	-21	swapper/4	22:45:19	4
1363141	99	89	75,7	cyclictest	1420864	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:32:48	3
1363135	99	89	78,8	cyclictest	1537235	-21	bingrep	23:00:31	1
1363146	99	88	76,7	cyclictest	1414700	-21	diskmemload-4	21:21:52	4
1363141	99	88	75,7	cyclictest	1489370	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:22:16	3
1363141	99	88	60,6	cyclictest	1478488	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:36:56	3
1363135	99	88	79,6	cyclictest	210	-21	kswapd0	00:35:01	1
1363135	99	88	62,7	cyclictest	1489370	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:45:49	1
1363135	99	88	59,9	cyclictest	1411504	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:17:48	1
1363130	99	88	28,15	cyclictest	692	50	irq/530-eth0-Tx	23:10:23	0
1363146	99	87	80,3	cyclictest	0	-21	swapper/4	20:00:34	4
1363141	99	87	73,7	cyclictest	1489370	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:30:25	3
1363135	99	87	75,6	cyclictest	1568854	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:42:34	1
1363135	99	87	74,7	cyclictest	1453115	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:55:48	1
1363135	99	87	74,7	cyclictest	1437557	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:48:05	1
1363135	99	87	73,7	cyclictest	1478488	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:22:14	1
1363150	99	86	81,2	cyclictest	0	-21	swapper/5	19:10:17	5
1363146	99	86	76,5	cyclictest	1415224	-21	ssh	21:14:36	4
1363146	99	86	72,6	cyclictest	1414700	-21	diskmemload-4	23:27:18	4
1363137	99	86	77,4	cyclictest	1437557	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:42:47	2
1363135	99	86	73,7	cyclictest	1360706	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:20:30	1
1363135	99	86	71,9	cyclictest	1437557	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:15:16	1
1363135	99	86	56,7	cyclictest	1459527	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:00:54	1
1363146	99	85	79,3	cyclictest	0	-21	swapper/4	19:25:41	4
1363141	99	85	69,9	cyclictest	1626840	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:25:14	3
1363137	99	85	77,5	cyclictest	210	-21	kswapd0	22:16:16	2
1363137	99	85	73,6	cyclictest	1489370	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:53:02	2
1363137	99	85	71,7	cyclictest	1420864	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:30:02	2
1363137	99	85	64,8	cyclictest	210	-21	kswapd0	21:56:07	2
1363135	99	85	72,7	cyclictest	1360706	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:31:53	1
1363135	99	84	53,7	cyclictest	1459527	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:25:13	1
1363130	99	84	44,24	cyclictest	1420864	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:30:22	0
1363146	99	83	77,3	cyclictest	0	-21	swapper/4	23:16:47	4
1363146	99	83	68,9	cyclictest	1630016	-21	ssh	00:21:00	4
1363141	99	83	73,4	cyclictest	1360706	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:32:22	3
1363137	99	83	54,6	cyclictest	1582220	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:42:21	2
1363135	99	83	74,6	cyclictest	210	-21	kswapd0	23:15:26	1
1363135	99	83	72,7	cyclictest	1617373	-21	bingrep	00:10:26	1
1363135	99	83	70,7	cyclictest	1459527	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:40:52	1
1363135	99	83	69,7	cyclictest	1626840	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:25:55	1
1363130	99	83	9,5	cyclictest	1606282	-21	ntpq	00:00:37	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17