You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 01:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Sun May 04, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
287154299358412,3567cyclictest2957094-21kworker/2:0+events00:20:202
287154299305514,3036cyclictest2913530-21kworker/2:2+events21:30:222
287154299292514,2907cyclictest2913530-21kworker/2:2+events21:25:192
287153999285113,2834cyclictest2976327-21kworker/1:1+events00:35:011
287154299271013,2695cyclictest2943757-21kworker/2:0+events23:05:022
287154299269513,2678cyclictest2957094-21kworker/2:0+events00:05:232
287153999269311,2677cyclictest2900594-21kworker/1:1+events20:45:251
287154499266013,2645cyclictest2963783-21kworker/3:1+events00:05:013
287154499263013,2613cyclictest2938982-21kworker/3:0+events22:40:323
287153599262513,2608cyclictest2872761-21kworker/0:2+events19:25:200
287153599260712,2591cyclictest2887564-21kworker/0:2+events19:57:060
287153599256812,2552cyclictest2966735-21kworker/0:2+events00:03:070
287153999255212,2537cyclictest2960323-21kworker/1:2+events23:45:181
287153999254311,2528cyclictest2935506-21kworker/1:1+events22:28:001
287153999252512,2509cyclictest2958458-21kworker/1:1+events23:53:381
287154499252412,2509cyclictest2886112-21kworker/3:0+events19:53:123
287153599252011,2507cyclictest2974579-21kworker/0:0+events00:30:010
287153599251211,2497cyclictest2887564-21kworker/0:2+events20:04:500
287153999250212,2487cyclictest2948907-21kworker/1:1+events23:29:171
287154499249512,2479cyclictest2908664-21kworker/3:1+events21:05:343
287153999249311,2478cyclictest2926217-21kworker/1:0+events22:00:181
287153999249213,2475cyclictest2895176-21kworker/1:1+events20:27:581
287153999249212,2477cyclictest2953997-21kworker/1:0+events23:39:561
287153999249112,2476cyclictest2879390-21kworker/1:2+events19:46:181
287153999249012,2474cyclictest2926217-21kworker/1:0+events21:58:211
287153999249011,2476cyclictest2943585-21kworker/1:0+events22:55:521
287153999248812,2473cyclictest2932994-21kworker/1:0+events22:24:551
287153999248810,2474cyclictest2941979-21kworker/1:2+events22:49:241
287153999248711,2473cyclictest2877809-21kworker/1:0+events19:34:251
287153599248712,2473cyclictest2918396-21kworker/0:0+events21:36:530
287153599248612,2470cyclictest2921356-21kworker/0:1+events22:08:590
287154299248512,2470cyclictest2945868-21kworker/2:2+events23:30:012
287153599248512,2470cyclictest2935663-21kworker/0:2+events22:38:120
287153599248511,2470cyclictest2947260-21kworker/0:1+events23:06:090
287153999248412,2468cyclictest2976327-21kworker/1:1+events00:39:561
287153999248112,2467cyclictest2910531-21kworker/1:2+events21:16:361
287154299248012,2466cyclictest2940522-21kworker/2:0+events22:45:322
287153599247913,2463cyclictest2887564-21kworker/0:2+events20:07:100
287153599247912,2462cyclictest2966735-21kworker/0:2+events00:36:090
28715399924786,2469cyclictest2931071-21kworker/1:1+events22:16:121
287153999247812,2462cyclictest2945445-21kworker/1:2+events23:12:381
287153599247812,2463cyclictest2872761-21kworker/0:2+events19:40:350
287153599247812,2462cyclictest2910472-21kworker/0:0+events21:13:330
287154299247710,2463cyclictest2958725-21kworker/2:1+events23:40:202
287153599247712,2462cyclictest2881105-21kworker/0:1+events19:39:040
287153599247712,2462cyclictest2876836-21kworker/0:1+events19:30:160
287153999247511,2462cyclictest2958458-21kworker/1:1+events23:41:071
287153599247512,2460cyclictest2890923-21kworker/0:1+events20:26:310
287153599247512,2459cyclictest2972959-21kworker/0:1+events00:24:030
287153599247412,2460cyclictest2902128-21kworker/0:2+events21:05:100
287153999247311,2458cyclictest2886199-21kworker/1:2+events19:57:291
287153599247312,2458cyclictest2974579-21kworker/0:0+events00:27:440
287153599247112,2455cyclictest2899483-21kworker/0:1+events20:36:180
287153599247111,2457cyclictest2947260-21kworker/0:1+events23:11:070
287153599247012,2454cyclictest2890923-21kworker/0:1+events20:24:400
287153599246912,2453cyclictest2916575-21kworker/0:1+events21:29:580
287153599246812,2452cyclictest2958634-21kworker/0:2+events23:54:450
287153599246712,2451cyclictest2899483-21kworker/0:1+events20:41:370
28715359924649,2452cyclictest2947260-21kworker/0:1+events23:19:030
287153999246211,2447cyclictest2908876-21kworker/1:0+events21:13:561
28715399924589,2445cyclictest2948907-21kworker/1:1+events23:15:391
28715359924509,2438cyclictest2937350-21kworker/0:0+events22:43:130
287153999244711,2433cyclictest2897322-21kworker/1:2+events20:34:001
287153999244710,2433cyclictest2945445-21kworker/1:2+events23:02:261
287153999244612,2431cyclictest2927877-21kworker/1:1+events22:06:441
287153999244412,2430cyclictest2889406-21kworker/1:2+events20:15:101
287154499244312,2427cyclictest2969986-21kworker/3:0+events00:13:283
287153999244311,2428cyclictest2945445-21kworker/1:2+events23:07:401
287154499244211,2427cyclictest2899025-21kworker/3:2+events20:40:263
287154499243212,2416cyclictest2874916-21kworker/3:0+events19:19:413
287153999243111,2417cyclictest2879390-21kworker/1:2+events19:36:451
287153999242910,2416cyclictest2973135-21kworker/1:2+events00:26:591
287153999242311,2408cyclictest2908876-21kworker/1:0+events21:04:041
287154499242212,2407cyclictest2918274-21kworker/3:0+events21:40:203
287153999241411,2400cyclictest2921294-21kworker/1:0+events21:52:131
287154499240912,2394cyclictest2889436-21kworker/3:0+events20:09:283
287154299240912,2394cyclictest2913530-21kworker/2:2+events21:23:012
287154299240811,2393cyclictest2887807-21kworker/2:2+events20:23:332
287154499240111,2386cyclictest2945294-21kworker/3:0+events23:02:483
287154299239912,2384cyclictest2974379-21kworker/2:2+events00:33:522
287154299239212,2377cyclictest2952512-21kworker/2:1+events23:22:502
287154299239112,2376cyclictest2958725-21kworker/2:1+events23:52:312
287154299239111,2378cyclictest2900477-21kworker/2:0+events20:50:262
287154299239012,2374cyclictest2945868-21kworker/2:2+events23:16:452
287154299238911,2374cyclictest2918378-21kworker/2:0+events21:49:542
287154299238712,2371cyclictest2929356-21kworker/2:2+events22:39:222
287154299238712,2371cyclictest2918378-21kworker/2:0+events21:35:422
287153599238712,2372cyclictest2921356-21kworker/0:1+events22:02:100
287154299238611,2371cyclictest2974379-21kworker/2:2+events00:35:462
287154299238412,2369cyclictest2895952-21kworker/2:0+events20:25:242
287153999237713,2361cyclictest2908876-21kworker/1:0+events21:09:441
287154299237612,2360cyclictest2918378-21kworker/2:0+events21:43:022
28715399923759,2361cyclictest2961918-21kworker/1:0+events23:57:001
287153999236610,2353cyclictest2910531-21kworker/1:2+events21:20:251
287153599235911,2344cyclictest2921356-21kworker/0:1+events22:19:580
287154499235612,2340cyclictest2960556-21kworker/3:2+events23:59:413
287154299235410,2341cyclictest2929356-21kworker/2:2+events22:14:162
287154499235312,2338cyclictest2887718-21kworker/3:2+events20:18:363
287154299235312,2338cyclictest2881207-21kworker/2:1+events19:39:512
287154499234912,2333cyclictest2887718-21kworker/3:2+events20:13:373
287153999234411,2329cyclictest2913413-21kworker/1:1+events21:26:541
287154299234210,2328cyclictest2945868-21kworker/2:2+events23:36:312
287153999234012,2325cyclictest2937121-21kworker/1:0+events22:35:321
287153999233212,2316cyclictest2943585-21kworker/1:0+events22:53:101
287154499232911,2314cyclictest2935810-21kworker/3:1+events22:30:163
287154299232811,2314cyclictest2934250-21kworker/2:1+events22:25:182
287153599232711,2312cyclictest2890923-21kworker/0:1+events20:10:130
287154499232512,2310cyclictest2882904-21kworker/3:2+events19:46:423
287154499232412,2308cyclictest2945294-21kworker/3:0+events23:07:193
287153999232210,2308cyclictest2905405-21kworker/1:2+events20:58:211
287154499232112,2306cyclictest2899025-21kworker/3:2+events20:49:423
287153999232112,2305cyclictest2916757-21kworker/1:2+events21:36:061
287154499231812,2303cyclictest2900623-21kworker/3:0+events20:38:343
287154499231312,2298cyclictest2934149-21kworker/3:2+events22:29:313
287154499231312,2297cyclictest2969986-21kworker/3:0+events00:31:583
287154499231312,2297cyclictest2864827-21kworker/3:2+events19:13:353
287154499231211,2297cyclictest2899025-21kworker/3:2+events20:33:383
287153999231110,2298cyclictest2948907-21kworker/1:1+events23:24:251
287154499231012,2294cyclictest2929826-21kworker/3:1+events22:13:083
287153599230812,2293cyclictest2921356-21kworker/0:1+events21:55:180
287154499230711,2292cyclictest2912134-21kworker/3:1+events21:25:433
287153599230712,2292cyclictest2922955-21kworker/0:0+events21:51:250
287154499230613,2289cyclictest2934149-21kworker/3:2+events22:35:533
28715399923056,2295cyclictest2953997-21kworker/1:0+events23:30:461
287153599230311,2288cyclictest2941948-21kworker/0:2+events23:02:030
287153599230310,2289cyclictest2952209-21kworker/0:0+events23:24:000
28715359922996,2290cyclictest2883086-21kworker/0:0+events19:51:190
287154499229411,2279cyclictest2919906-21kworker/3:1+events21:48:223
287153599229211,2278cyclictest2968366-21kworker/0:0+events00:12:410
287153599229112,2277cyclictest2968366-21kworker/0:0+events00:15:000
287154499228710,2273cyclictest2864827-21kworker/3:2+events19:21:313
287154499228512,2269cyclictest2953672-21kworker/3:1+events23:22:043
287154499228310,2269cyclictest2940613-21kworker/3:1+events22:55:283
287153599227911,2264cyclictest2902128-21kworker/0:2+events20:58:010
287153599227711,2262cyclictest2960612-21kworker/0:0+events23:56:150
287153999227411,2260cyclictest2882875-21kworker/1:0+events19:44:501
287153599227311,2258cyclictest2912184-21kworker/0:2+events21:22:390
287153999227110,2258cyclictest2875254-21kworker/1:1+events19:25:421
287153999227110,2257cyclictest2967228-21kworker/1:1+events00:06:321
287153599227111,2256cyclictest2921356-21kworker/0:1+events22:29:540
287154499227012,2254cyclictest2918274-21kworker/3:0+events21:51:023
287153999227011,2256cyclictest2967228-21kworker/1:1+events00:21:281
287153599227011,2255cyclictest2872761-21kworker/0:2+events19:23:040
287153599226911,2254cyclictest2889316-21kworker/0:0+events20:17:050
287153999226811,2253cyclictest2889406-21kworker/1:2+events20:09:501
287153599226811,2254cyclictest2872761-21kworker/0:2+events19:15:520
287153599226811,2253cyclictest2941948-21kworker/0:2+events22:48:140
287153599226810,2254cyclictest2921356-21kworker/0:1+events22:21:530
28715399922678,2256cyclictest2872965-21kworker/1:2+events19:15:291
287153999226711,2252cyclictest2940366-21kworker/1:0+events22:42:281
287153999226611,2252cyclictest2971451-21kworker/1:0+events00:17:421
287153999226611,2252cyclictest2961918-21kworker/1:0+events00:04:371
287153999226611,2252cyclictest2868095-21kworker/1:1+events19:13:581
287153999226611,2251cyclictest2897322-21kworker/1:2+events20:35:311
28715359922668,2254cyclictest2908874-21kworker/0:1+events21:18:070
287153599226610,2253cyclictest2968366-21kworker/0:0+events00:08:530
287153999226510,2252cyclictest2969776-21kworker/1:2+events00:14:371
287153999226510,2252cyclictest2887775-21kworker/1:0+events20:00:561
287153999226410,2251cyclictest2926217-21kworker/1:0+events22:13:311
287153599226411,2250cyclictest2897698-21kworker/0:2+events20:32:050
287153599226410,2251cyclictest2883086-21kworker/0:0+events19:47:050
287153999226311,2248cyclictest2935506-21kworker/1:1+events22:31:031
287154499226212,2247cyclictest2905453-21kworker/3:0+events20:57:173
287153999226211,2248cyclictest2900594-21kworker/1:1+events20:54:141
287153999226210,2249cyclictest2895176-21kworker/1:1+events20:21:161
287153999226210,2249cyclictest2884521-21kworker/1:1+events19:53:371
287153599226110,2248cyclictest2902128-21kworker/0:2+events20:53:050
287153999226011,2246cyclictest2902212-21kworker/1:2+events20:43:541
287153599225711,2242cyclictest2941948-21kworker/0:2+events22:52:490
287153599225611,2242cyclictest2902128-21kworker/0:2+events21:03:400
28715399922529,2240cyclictest2918455-21kworker/1:1+events21:43:241
28715359922519,2239cyclictest2921356-21kworker/0:1+events22:31:250
287153599224610,2232cyclictest2956887-21kworker/0:1+events23:38:240
287154299224411,2231cyclictest2873149-21kworker/2:3+events19:43:172
287154299224010,2227cyclictest2877959-21kworker/2:1+events19:28:222
287153599224010,2227cyclictest2912184-21kworker/0:2+events21:41:310
287154499223812,2223cyclictest2958561-21kworker/3:0+events23:42:153
28715429922369,2223cyclictest2929356-21kworker/2:2+events22:51:202
287153999223310,2220cyclictest2915088-21kworker/1:0+events21:33:021
28715359922288,2216cyclictest2921356-21kworker/0:1+events21:46:520
287153599222611,2212cyclictest2958634-21kworker/0:2+events23:44:550
287154299222211,2207cyclictest2921682-21kworker/2:2+events21:54:562
287154299221411,2201cyclictest2942157-21kworker/2:1+events22:55:052
287154499220811,2194cyclictest2953672-21kworker/3:1+events23:48:183
287153599220810,2195cyclictest2872761-21kworker/0:2+events19:12:520
28715359922009,2188cyclictest2956887-21kworker/0:1+events23:31:550
287154499219611,2182cyclictest2918274-21kworker/3:0+events22:04:303
287154299219411,2179cyclictest2907197-21kworker/2:0+events21:14:422
28715429921939,2181cyclictest2887807-21kworker/2:2+events20:11:222
287154299219111,2177cyclictest2929356-21kworker/2:2+events22:24:322
28715429921909,2177cyclictest2902096-21kworker/2:1+events20:42:012
287154299219011,2176cyclictest2887807-21kworker/2:2+events20:17:492
28715429921876,2178cyclictest2905306-21kworker/2:1+events20:57:392
287154299218711,2173cyclictest2887807-21kworker/2:2+events19:59:252
28715429921849,2172cyclictest2924437-21kworker/2:1+events22:15:262
287154299218411,2169cyclictest2877959-21kworker/2:1+events19:31:452
287154299218311,2168cyclictest2926073-21kworker/2:0+events21:57:112
287154299218310,2170cyclictest2970063-21kworker/2:1+events00:19:112
287154299218310,2170cyclictest2924437-21kworker/2:1+events22:07:522
287153599218311,2169cyclictest2903734-21kworker/0:0+events20:49:180
287154299218210,2169cyclictest2924437-21kworker/2:1+events22:03:432
287154299218111,2167cyclictest2897626-21kworker/2:1+events20:30:362
287154299218110,2167cyclictest2958725-21kworker/2:1+events23:46:492
287154299218011,2166cyclictest2881207-21kworker/2:1+events20:02:062
28715429921799,2167cyclictest2905306-21kworker/2:1+events21:02:082
287154299217911,2164cyclictest2945868-21kworker/2:2+events23:01:402
287154299217910,2166cyclictest2945868-21kworker/2:2+events23:33:492
287154299217811,2164cyclictest2929356-21kworker/2:2+events22:32:072
287154299217711,2163cyclictest2876358-21kworker/2:0+events19:24:122
287154299217511,2162cyclictest2887807-21kworker/2:2+events20:35:542
28715449921748,2163cyclictest2910355-21kworker/3:0+events21:19:413
287154499217011,2156cyclictest2969986-21kworker/3:0+events00:19:343
287154499216810,2154cyclictest2874916-21kworker/3:0+events19:31:003
287154499216611,2151cyclictest2919906-21kworker/3:1+events21:56:513
287154299216611,2152cyclictest2881207-21kworker/2:1+events19:49:462
287153599216311,2149cyclictest2958634-21kworker/0:2+events23:49:270
287153599214611,2131cyclictest2928006-21kworker/0:2+events22:13:550
287154299214511,2131cyclictest2945868-21kworker/2:2+events23:14:542
287154299214410,2130cyclictest2887807-21kworker/2:2+events20:06:462
287154299214210,2129cyclictest2957094-21kworker/2:0+events00:00:272
287153599214110,2127cyclictest2941948-21kworker/0:2+events22:58:350
287154299213910,2126cyclictest2913530-21kworker/2:2+events21:18:542
287154499212811,2114cyclictest2918274-21kworker/3:0+events21:38:253
287154499212811,2113cyclictest2918274-21kworker/3:0+events22:07:293
28715449921278,2116cyclictest2887718-21kworker/3:2+events20:20:523
287154499212611,2112cyclictest2912134-21kworker/3:1+events21:22:173
287154499212111,2107cyclictest2932345-21kworker/3:0+events22:23:253
287154499212111,2106cyclictest2960556-21kworker/3:2+events23:52:543
287154499211911,2105cyclictest2950561-21kworker/3:0+events23:18:383
287154499211811,2103cyclictest2881014-21kworker/3:1+events19:39:273
287154499211810,2104cyclictest2955347-21kworker/3:0+events23:27:473
287154499211711,2103cyclictest2976507-21kworker/3:2+events00:37:193
287154499211711,2103cyclictest2948896-21kworker/3:2+events23:14:333
287154499211711,2102cyclictest2876537-21kworker/3:1+events19:29:083
287154499211611,2102cyclictest2973194-21kworker/3:2+events00:24:473
287154499211611,2102cyclictest2940613-21kworker/3:1+events22:50:563
287154499211611,2102cyclictest2887718-21kworker/3:2+events20:04:263
287154499211611,2102cyclictest2874916-21kworker/3:0+events19:40:583
287154499211511,2101cyclictest2938982-21kworker/3:0+events22:48:383
287154499211411,2102cyclictest2963783-21kworker/3:1+events00:08:043
287154499211411,2100cyclictest2969986-21kworker/3:0+events00:25:533
287154499211411,2100cyclictest2897399-21kworker/3:0+events20:28:223
287154499211410,2102cyclictest2886112-21kworker/3:0+events19:55:093
28715449921139,2100cyclictest2908664-21kworker/3:1+events21:03:173
28715359921108,2099cyclictest2912184-21kworker/0:2+events21:34:120
287154499210710,2093cyclictest2903824-21kworker/3:1+events20:51:123
287154499210610,2093cyclictest2956977-21kworker/3:2+events23:33:043
287154499210411,2090cyclictest2953672-21kworker/3:1+events23:37:163
287154499210211,2088cyclictest2915093-21kworker/3:2+events21:32:393
287153999209710,2084cyclictest2872965-21kworker/1:2+events19:22:411
287154299209110,2077cyclictest2929356-21kworker/2:2+events22:44:012
28715429920799,2066cyclictest2970063-21kworker/2:1+events00:29:142
287154299206810,2055cyclictest2903701-21kworker/2:2+events20:47:452
28715399920609,2048cyclictest2891041-21kworker/1:1+events20:10:371
287154299204410,2031cyclictest2869511-21kworker/2:2+events19:18:322
28715429920409,2028cyclictest2884713-21kworker/2:0+events19:52:052
287154299201910,2005cyclictest2957094-21kworker/2:0+events00:14:152
28715429920018,1990cyclictest2963694-21kworker/2:2+events23:57:222
287154499195910,1946cyclictest2932345-21kworker/3:0+events22:17:433
28715429919518,1940cyclictest2869511-21kworker/2:2+events19:10:592
28715359919479,1935cyclictest2953834-21kworker/0:2+events23:26:170
28715449919289,1915cyclictest2899025-21kworker/3:2+events21:11:183
287154299163160,2cyclictest2907197-21kworker/2:0+pm21:09:592
28710602157114,24sleep20-21swapper/219:06:252
28713362151104,26sleep00-21swapper/019:09:560
2871144214492,44sleep30-21swapper/319:07:303
28711212143110,27sleep10-21swapper/119:07:131
287153999140,13cyclictest2922458-21/usr/sbin/munin21:45:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional