OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Sep 18, 2025 00:44:18)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
788955	99	2833	13,2815	cyclictest	871026	-21	kworker/3:2+events	23:35:19	3
788949	99	2828	13,2811	cyclictest	866222	-21	kworker/1:0+events	23:26:08	1
788955	99	2774	13,2757	cyclictest	808438	-21	kworker/3:2+events	20:10:17	3
788944	99	2772	13,2754	cyclictest	885439	-21	kworker/0:2+events	00:25:17	0
788953	99	2764	12,2746	cyclictest	820928	-21	kworker/2:2+events	20:55:12	2
788953	99	2739	14,2722	cyclictest	824260	-21	kworker/2:1+events	21:05:01	2
788955	99	2652	13,2635	cyclictest	861301	-21	kworker/3:1+events	23:32:40	3
788955	99	2644	13,2628	cyclictest	816286	-21	kworker/3:1+events	20:45:14	3
788953	99	2641	12,2627	cyclictest	882267	-21	kworker/2:1+events	00:05:14	2
788944	99	2612	10,2599	cyclictest	846847	-21	kworker/0:1+events	22:30:22	0
788953	99	2609	13,2592	cyclictest	863167	-21	kworker/2:3+events	23:05:19	2
788949	99	2605	12,2589	cyclictest	880502	-21	kworker/1:2+events	00:20:18	1
788955	99	2538	12,2524	cyclictest	846675	-21	kworker/3:2+events	22:18:09	3
788955	99	2534	11,2520	cyclictest	816286	-21	kworker/3:1+events	20:33:58	3
788955	99	2530	11,2515	cyclictest	880710	-21	kworker/3:1+events	00:00:17	3
788955	99	2527	12,2512	cyclictest	814674	-21	kworker/3:0+events	20:40:20	3
788955	99	2521	11,2506	cyclictest	822196	-21	kworker/3:0+events	21:28:09	3
788955	99	2519	12,2504	cyclictest	822196	-21	kworker/3:0+events	21:08:27	3
788944	99	2519	12,2503	cyclictest	805226	-21	kworker/0:0+events	20:01:53	0
788949	99	2500	12,2485	cyclictest	849967	-21	kworker/1:2+events	22:24:39	1
788949	99	2498	11,2484	cyclictest	821169	-21	kworker/1:0+events	20:51:20	1
788944	99	2498	12,2482	cyclictest	885439	-21	kworker/0:2+events	00:23:22	0
788949	99	2497	12,2481	cyclictest	861273	-21	kworker/1:1+events	23:00:01	1
788944	99	2497	12,2482	cyclictest	890285	-21	kworker/0:0+events	00:37:26	0
788944	99	2497	12,2482	cyclictest	825630	-21	kworker/0:2+events	21:02:25	0
788944	99	2496	12,2481	cyclictest	846847	-21	kworker/0:1+events	22:22:44	0
788944	99	2494	12,2479	cyclictest	800036	-21	kworker/0:0+events	19:45:06	0
788949	99	2493	12,2477	cyclictest	839435	-21	kworker/1:0+events	21:54:07	1
788949	99	2492	12,2477	cyclictest	809834	-21	kworker/1:1+events	20:23:35	1
788949	99	2492	12,2476	cyclictest	857603	-21	kworker/1:2+events	23:08:22	1
788944	99	2492	12,2477	cyclictest	801969	-21	kworker/0:2+events	20:11:26	0
788955	99	2491	12,2475	cyclictest	822196	-21	kworker/3:0+events	20:51:42	3
788949	99	2491	11,2477	cyclictest	846473	-21	kworker/1:1+events	22:17:45	1
788944	99	2491	12,2476	cyclictest	833127	-21	kworker/0:2+events	21:29:42	0
788949	99	2490	12,2475	cyclictest	874059	-21	kworker/1:1+events	23:41:24	1
788949	99	2490	12,2474	cyclictest	877634	-21	kworker/1:1+events	00:04:52	1
788949	99	2490	12,2474	cyclictest	857603	-21	kworker/1:2+events	23:01:09	1
788944	99	2486	11,2471	cyclictest	888656	-21	kworker/0:1+events	00:34:22	0
788949	99	2485	11,2471	cyclictest	846473	-21	kworker/1:1+events	22:14:40	1
788944	99	2479	10,2465	cyclictest	828240	-21	kworker/0:2+events	21:17:53	0
788944	99	2479	10,2465	cyclictest	828240	-21	kworker/0:2+events	21:17:52	0
788949	99	2478	12,2463	cyclictest	809834	-21	kworker/1:1+events	20:30:30	1
788949	99	2478	11,2463	cyclictest	821169	-21	kworker/1:0+events	21:06:32	1
788944	99	2478	9,2465	cyclictest	814516	-21	kworker/0:1+events	20:28:57	0
788949	99	2477	12,2461	cyclictest	870784	-21	kworker/1:2+events	23:35:41	1
788944	99	2476	12,2461	cyclictest	786963	-21	kworker/0:1+events	19:35:58	0
788949	99	2474	12,2460	cyclictest	795239	-21	kworker/1:1+events	19:40:08	1
788944	99	2474	12,2459	cyclictest	816210	-21	kworker/0:2+events	20:45:37	0
788949	99	2473	11,2458	cyclictest	877634	-21	kworker/1:1+events	23:51:38	1
788949	99	2472	11,2457	cyclictest	822854	-21	kworker/1:1+events	20:57:05	1
788944	99	2472	9,2459	cyclictest	819505	-21	kworker/0:0+events	20:44:28	0
788949	99	2467	11,2453	cyclictest	834670	-21	kworker/1:1+events	21:43:05	1
788944	99	2463	11,2448	cyclictest	870845	-21	kworker/0:0+events	23:28:53	0
788949	99	2460	4,2452	cyclictest	795239	-21	kworker/1:1+events	19:38:37	1
788949	99	2459	11,2444	cyclictest	816130	-21	kworker/1:2+events	20:49:49	1
788953	99	2458	7,2448	cyclictest	820928	-21	kworker/2:2+events	21:07:41	2
788949	99	2458	11,2443	cyclictest	821169	-21	kworker/1:0+events	21:00:32	1
788955	99	2456	12,2441	cyclictest	814674	-21	kworker/3:0+events	20:28:34	3
788955	99	2453	11,2438	cyclictest	880710	-21	kworker/3:1+events	00:07:08	3
788944	99	2451	12,2436	cyclictest	808519	-21	kworker/0:0+events	20:32:26	0
788955	99	2450	10,2437	cyclictest	790203	-21	kworker/3:0+events	19:21:12	3
788955	99	2449	12,2434	cyclictest	822196	-21	kworker/3:0+events	21:31:36	3
788955	99	2449	11,2435	cyclictest	828370	-21	kworker/3:2+events	21:17:06	3
788955	99	2449	11,2435	cyclictest	828370	-21	kworker/3:2+events	21:17:06	3
788955	99	2448	12,2434	cyclictest	819698	-21	kworker/3:2+events	20:55:35	3
788955	99	2448	12,2432	cyclictest	839649	-21	kworker/3:0+events	22:05:33	3
788949	99	2447	12,2432	cyclictest	821169	-21	kworker/1:0+events	21:33:57	1
788955	99	2446	12,2430	cyclictest	840662	-21	kworker/3:1+events	22:02:51	3
788955	99	2445	12,2430	cyclictest	862961	-21	kworker/3:2+events	23:12:06	3
788955	99	2445	12,2429	cyclictest	822196	-21	kworker/3:0+events	21:01:18	3
788955	99	2445	11,2431	cyclictest	853857	-21	kworker/3:0+events	22:36:47	3
788955	99	2444	12,2429	cyclictest	810045	-21	kworker/3:0+events	20:17:54	3
788955	99	2442	12,2428	cyclictest	795544	-21	kworker/3:1+events	19:55:06	3
788955	99	2441	12,2426	cyclictest	795544	-21	kworker/3:1+events	19:52:51	3
788955	99	2441	11,2427	cyclictest	822196	-21	kworker/3:0+events	21:36:36	3
788944	99	2441	11,2427	cyclictest	844952	-21	kworker/0:0+events	22:09:22	0
788955	99	2440	12,2425	cyclictest	840662	-21	kworker/3:1+events	21:58:20	3
788955	99	2439	12,2424	cyclictest	797152	-21	kworker/3:2+events	19:37:05	3
788955	99	2438	12,2422	cyclictest	853857	-21	kworker/3:0+events	22:40:33	3
788955	99	2437	11,2423	cyclictest	856426	-21	kworker/3:2+events	22:45:50	3
788949	99	2437	12,2421	cyclictest	796871	-21	kworker/1:2+events	19:34:04	1
788949	99	2434	10,2420	cyclictest	840124	-21	kworker/1:1+events	21:56:49	1
788949	99	2432	10,2418	cyclictest	814523	-21	kworker/1:0+events	20:35:52	1
788949	99	2423	11,2408	cyclictest	834670	-21	kworker/1:1+events	21:39:14	1
788944	99	2419	11,2404	cyclictest	869198	-21	kworker/0:1+events	23:53:33	0
788949	99	2417	12,2401	cyclictest	803730	-21	kworker/1:0+events	20:05:18	1
788955	99	2414	11,2399	cyclictest	822196	-21	kworker/3:0+events	21:11:31	3
788953	99	2413	12,2398	cyclictest	802186	-21	kworker/2:0+events	20:01:30	2
788953	99	2410	12,2395	cyclictest	880532	-21	kworker/2:0+events	23:57:15	2
788955	99	2397	11,2383	cyclictest	836323	-21	kworker/3:2+events	21:52:37	3
788944	99	2388	11,2374	cyclictest	821107	-21	kworker/0:1+events	20:50:57	0
788955	99	2384	12,2369	cyclictest	861301	-21	kworker/3:1+events	23:29:57	3
788949	99	2384	12,2370	cyclictest	830069	-21	kworker/1:1+events	21:22:04	1
788955	99	2376	11,2362	cyclictest	858029	-21	kworker/3:1+events	22:50:31	3
788944	99	2376	12,2361	cyclictest	846847	-21	kworker/0:1+events	22:36:22	0
788953	99	2372	12,2357	cyclictest	846763	-21	kworker/2:2+events	22:21:13	2
788955	99	2369	12,2353	cyclictest	886919	-21	kworker/3:2+events	00:29:27	3
788955	99	2369	10,2356	cyclictest	888701	-21	kworker/3:1+events	00:24:33	3
788944	99	2365	10,2353	cyclictest	790262	-21	kworker/0:2+events	19:15:05	0
788944	99	2365	10,2353	cyclictest	790262	-21	kworker/0:2+events	19:15:05	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00