OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Sun May 31, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3278864	99	106	82,20	cyclictest	53	-21	kswapd0	11:15:18	0
3278864	99	98	77,19	cyclictest	3334332	-21	kworker/u4:0+events_unbound	09:50:00	0
3278865	99	81	71,7	cyclictest	3462275	-21	kworker/u4:3+events_unbound	12:05:25	1
3278865	99	78	40,35	cyclictest	0	-21	swapper/1	11:05:33	1
3278864	99	77	29,36	cyclictest	0	-21	swapper/0	11:40:41	0
3278865	99	76	4,30	cyclictest	3337448	-21	ssh	09:40:34	1
3278865	99	75	37,36	cyclictest	3381184	-21	gltestperf	10:30:22	1
3278864	99	75	66,7	cyclictest	3422576	-21	kworker/u4:10+events_unbound	12:10:26	0
3278864	99	75	39,34	cyclictest	3372191	-21	df_abs	10:20:18	0
3278864	99	75	23,28	cyclictest	0	-21	swapper/0	11:25:33	0
3278864	99	74	1,45	cyclictest	3303382	-21	apt-get	08:45:12	0
3278864	99	73	66,5	cyclictest	3280092	-21	kworker/u4:13+events_unbound	08:20:02	0
3278864	99	73	1,37	cyclictest	3283973	-21	munin-run	07:30:00	0
3278864	99	72	65,5	cyclictest	3355067	-21	gcc	10:00:32	0
3278865	99	71	31,37	cyclictest	0	-21	swapper/1	09:55:13	1
3278864	99	71	62,6	cyclictest	3347886	-21	kworker/u4:8+events_unbound	10:00:00	0
3278864	99	71	26,27	cyclictest	0	-21	swapper/0	11:55:37	0
3278864	99	70	2,46	cyclictest	3465188	-21	ntpq	12:05:33	0
3278864	99	70	2,45	cyclictest	3438629	-21	ntpq	11:35:27	0
3278864	99	70	1,44	cyclictest	3426427	-21	ssh	11:21:15	0
3278865	99	69	36,30	cyclictest	3303520	-21	cpu	08:45:16	1
3278864	99	69	4,36	cyclictest	3299549	-21	apt-get	08:30:15	0
3278865	99	68	60,6	cyclictest	3356184	-21	kworker/u4:10+events_unbound	10:05:03	1
3278865	99	68	27,36	cyclictest	0	-21	swapper/1	09:35:12	1
3278865	99	68	24,39	cyclictest	0	-21	swapper/1	07:45:22	1
3278864	99	68	35,30	cyclictest	3473658	-21	gltestperf	12:15:21	0
3278865	99	67	4,22	cyclictest	3315115	-21	ssh	09:15:26	1
3278865	99	67	38,27	cyclictest	0	-21	swapper/1	10:35:08	1
3278865	99	67	35,26	cyclictest	3475108	-21	kworker/u4:6-rpciod	12:25:16	1
3278865	99	67	35,26	cyclictest	3475108	-21	kworker/u4:6-rpciod	12:25:16	1
3278865	99	67	32,32	cyclictest	3380493	-21	latency_hist	10:30:01	1
3278865	99	67	29,35	cyclictest	0	-21	swapper/1	09:25:33	1
3278865	99	67	29,35	cyclictest	0	-21	swapper/1	09:10:22	1
3278865	99	67	29,35	cyclictest	0	-21	swapper/1	09:10:22	1
3278864	99	67	36,29	cyclictest	3305926	-21	aten2__	08:55:16	0
3278864	99	67	2,61	cyclictest	3416649	-21	ntpq	11:10:27	0
3278865	99	66	6,13	cyclictest	3371611	-21	modprobe	10:20:00	1
3278865	99	66	34,28	cyclictest	3286492	-21	cron	07:40:00	1
3278865	99	66	29,33	cyclictest	0	-21	swapper/1	08:15:16	1
3278865	99	66	28,33	cyclictest	0	-21	swapper/1	11:35:36	1
3278865	99	66	27,36	cyclictest	3323099	-21	latency_hist	09:25:02	1
3278865	99	66	26,3	cyclictest	0	-21	swapper/1	10:45:41	1
3278864	99	66	2,39	cyclictest	3376902	-21	ssh	10:25:22	0
3278865	99	65	31,31	cyclictest	3469943	-21	timerandwakeup	12:10:38	1
3278865	99	65	31,31	cyclictest	0	-21	swapper/1	12:20:36	1
3278865	99	65	28,34	cyclictest	0	-21	swapper/1	09:05:28	1
3278865	99	65	28,33	cyclictest	0	-21	swapper/1	10:55:23	1
3278864	99	65	1,60	cyclictest	3297011	-21	apt-get	08:20:12	0
3278865	99	64	58,4	cyclictest	3422576	-21	kworker/u4:10+events_unbound	11:25:03	1
3278865	99	64	35,9	cyclictest	3462278	-21	kworker/u4:7+events_unbound	12:15:29	1
3278865	99	64	35,26	cyclictest	3421558	-21	unixbench_multi	11:15:41	1
3278865	99	64	34,27	cyclictest	3363518	-21	gltestperf	10:10:18	1
3278865	99	64	33,28	cyclictest	3291669	-21	kworker/u4:1-xprtiod	08:40:37	1
3278865	99	64	29,32	cyclictest	0	-21	swapper/1	12:30:21	1
3278865	99	64	29,32	cyclictest	0	-21	swapper/1	11:45:39	1
3278865	99	64	29,32	cyclictest	0	-21	swapper/1	11:45:39	1
3278864	99	64	33,28	cyclictest	3328166	-21	gltestperf	09:30:17	0
3278864	99	64	31,29	cyclictest	0	-21	swapper/0	09:50:29	0
3278864	99	64	30,32	cyclictest	3434825	-21	unixbench_singl	11:30:40	0
3278864	99	64	2,55	cyclictest	3332154	-21	apt-get	09:35:17	0
3278864	99	64	2,40	cyclictest	3278844	-21	munin-run	07:10:01	0
3278865	99	63	5,19	cyclictest	3460747	-21	ntpq	12:00:29	1
3278865	99	63	5,14	cyclictest	3292987	-21	modprobe	08:05:00	1
3278865	99	63	32,28	cyclictest	3442575	-21	diskmemload	11:40:27	1
3278865	99	63	27,32	cyclictest	0	-21	swapper/1	11:20:39	1
3278865	99	63	26,34	cyclictest	0	-21	swapper/1	07:30:20	1
3278865	99	63	25,4	cyclictest	0	-21	swapper/1	10:50:20	1
3278864	99	63	33,27	cyclictest	0	-21	swapper/0	07:25:00	0
3278864	99	63	32,28	cyclictest	3295342	-21	timerwakeupswit	08:10:36	0
3278864	99	63	28,33	cyclictest	3307303	-21	aten_r7power_po	09:00:16	0
3278865	99	62	29,29	cyclictest	0	-21	swapper/1	07:50:28	1
3278865	99	62	28,31	cyclictest	0	-21	swapper/1	11:50:39	1
3278865	99	62	27,32	cyclictest	0	-21	swapper/1	11:00:16	1
3278865	99	62	25,9	cyclictest	3456563	-21	cut	11:55:39	1
3278865	99	62	25,4	cyclictest	0	-21	swapper/1	08:35:37	1
3278865	99	62	25,4	cyclictest	0	-21	swapper/1	07:20:20	1
3278865	99	62	22,7	cyclictest	0	-21	swapper/1	09:30:32	1
3278864	99	62	7,50	cyclictest	3358742	-21	ssh	10:05:17	0
3278864	99	62	52,7	cyclictest	3278861	-21	cyclictest	10:31:09	0
3278864	99	62	31,27	cyclictest	0	-21	swapper/0	10:35:25	0
3278864	99	62	21,37	cyclictest	0	-21	swapper/0	10:45:28	0
3278864	99	62	16,27	cyclictest	0	-21	swapper/0	08:05:20	0
3278864	99	62	1,38	cyclictest	0	-21	swapper/0	10:10:35	0
3278864	99	62	12,29	cyclictest	0	-21	swapper/0	10:15:38	0
3278865	99	61	24,6	cyclictest	0	-21	swapper/1	09:50:20	1
3278865	99	61	23,35	cyclictest	0	-21	swapper/1	07:15:18	1
3278865	99	61	21,8	cyclictest	0	-21	swapper/1	08:50:39	1
3278865	99	61	20,8	cyclictest	0	-21	swapper/1	09:45:41	1
3278864	99	61	5,45	cyclictest	3407908	-21	ssh	11:00:28	0
3278864	99	61	4,51	cyclictest	3319910	-21	ntpq	09:20:47	0
3278864	99	61	40,19	cyclictest	3492078	-21	/usr/sbin/munin	12:35:42	0
3278864	99	61	3,43	cyclictest	3298893	-21	ntpq	08:25:30	0
3278864	99	61	29,28	cyclictest	0	-21	swapper/0	09:40:38	0
3278864	99	61	27,31	cyclictest	0	-21	swapper/0	12:00:33	0
3278865	99	60	25,4	cyclictest	0	-21	swapper/1	10:40:23	1
3278865	99	60	23,5	cyclictest	3292968	-21	kworker/u4:8+rpciod	08:25:20	1
3278865	99	60	22,5	cyclictest	3352366	-21	kworker/u4:4-xprtiod	10:00:30	1
3278865	99	60	21,7	cyclictest	0	-21	swapper/1	07:55:20	1
3278864	99	60	50,8	cyclictest	3378571	-21	kworker/u4:2+events_unbound	10:55:12	0
3278864	99	60	34,24	cyclictest	3482177	-21	aten_r7power_en	12:25:16	0
3278864	99	60	34,24	cyclictest	3482177	-21	aten_r7power_en	12:25:16	0
3278864	99	60	2,52	cyclictest	3486462	-21	apt-get	12:30:14	0
3278864	99	60	1,43	cyclictest	3478331	-21	ntpq	12:20:26	0
3278864	99	60	12,28	cyclictest	0	-21	swapper/0	11:45:26	0
3278864	99	60	12,28	cyclictest	0	-21	swapper/0	11:45:26	0
3278865	99	59	49,7	cyclictest	3303182	-21	kworker/u4:12+events_unbound	09:05:02	1
3278865	99	59	25,6	cyclictest	0	-21	swapper/1	11:30:33	1
3278865	99	59	23,8	cyclictest	0	-21	swapper/1	07:10:24	1
3278864	99	59	8,29	cyclictest	0	-21	swapper/0	09:15:31	0
3278864	99	59	4,49	cyclictest	3398366	-21	apt-get	10:50:12	0
3278864	99	59	3,50	cyclictest	3324198	-21	ntpq	09:25:35	0
3278864	99	59	30,26	cyclictest	3287620	-21	timerwakeupswit	07:40:37	0
3278865	99	58	27,4	cyclictest	0	-21	swapper/1	07:44:25	1
3278864	99	58	8,44	cyclictest	3309764	-21	ssh	09:10:02	0
3278864	99	58	2,51	cyclictest	3284739	-21	ntpq	07:30:28	0
3278864	99	58	1,52	cyclictest	3301448	-21	ntpq	08:35:32	0
3278864	99	58	1,35	cyclictest	3452023	-21	ntpq	11:50:35	0
3278864	99	58	1,32	cyclictest	3309909	-21	apt-get	09:10:14	0
3278864	99	58	1,32	cyclictest	3309909	-21	apt-get	09:10:14	0
3278865	99	57	21,5	cyclictest	0	-21	swapper/1	11:11:42	1
3278864	99	57	3,51	cyclictest	3290596	-21	apt-get	07:55:15	0
3278864	99	57	3,47	cyclictest	3304652	-21	apt-get	08:50:12	0
3278864	99	57	2,48	cyclictest	3285403	-21	apt-get	07:35:13	0
3278865	99	56	47,6	cyclictest	3291671	-21	kworker/u4:6+events_unbound	09:00:01	1
3278864	99	56	3,48	cyclictest	3412523	-21	ps	11:05:38	0
3278864	99	56	34,19	cyclictest	3289358	-21	aten_r7power_cu	07:50:24	0
3278864	99	56	1,51	cyclictest	3280291	-21	apt-get	07:15:15	0
3278864	99	55	2,49	cyclictest	3291896	-21	apt-get	08:00:15	0
3278864	99	55	1,51	cyclictest	3389575	-21	ssh	10:40:11	0
3278864	99	54	22,29	cyclictest	0	-21	swapper/0	07:10:31	0
3278864	99	54	1,49	cyclictest	3302742	-21	/usr/sbin/munin	08:40:30	0
3278864	99	53	2,45	cyclictest	3287971	-21	apt-get	07:45:13	0
3278865	99	49	43,4	cyclictest	3372329	-21	fschecks_time	10:20:20	1
3278865	99	49	38,7	cyclictest	0	-21	swapper/1	08:30:32	1
3278865	99	49	26,20	cyclictest	0	-21	swapper/1	07:25:22	1
3278865	99	48	39,6	cyclictest	3493086	-21	kworker/u4:4+events_unbound	12:40:00	1
3278865	99	48	37,8	cyclictest	3294345	-21	latency_hist	08:10:01	1
3278865	99	45	33,8	cyclictest	3294627	-21	sed	08:10:15	1
3278865	99	37	28,6	cyclictest	3298138	-21	grep	08:25:01	1
3278865	99	32	24,6	cyclictest	0	-21	swapper/1	07:10:02	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17