You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-14 - 04:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Sat Mar 14, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
282713599282913,2812cyclictest2833677-21kworker/3:0+events19:30:003
282712499278214,2765cyclictest2912261-21kworker/1:2+events23:35:121
282712499276713,2750cyclictest2843511-21kworker/1:0+events20:30:001
28271299927657,2754cyclictest2860854-21kworker/2:1+events21:00:172
282712499274212,2725cyclictest2902784-21kworker/1:0+events23:10:121
282712999273613,2719cyclictest2907291-21kworker/2:1+events23:30:172
282712499271413,2699cyclictest2920510-21kworker/1:2+events00:10:161
282712199269610,2683cyclictest2843359-21kworker/0:0+events20:15:110
282712499267911,2664cyclictest2891552-21kworker/1:1+events22:45:181
282712199267712,2662cyclictest2871905-21kworker/0:0+events21:50:000
282713599266613,2649cyclictest2882112-21kworker/3:2+events22:00:163
282712999263312,2617cyclictest2854664-21kworker/2:0+events20:40:172
282713599259012,2574cyclictest2928398-21kworker/3:1+events00:21:403
282712199257912,2565cyclictest2830690-21kworker/0:0+events19:20:080
282712499257012,2556cyclictest2865473-21kworker/1:1+events21:15:051
282713599256710,2554cyclictest2910893-21kworker/3:1+events23:43:543
282712199255212,2536cyclictest2918761-21kworker/0:2+events00:03:490
282712199254811,2534cyclictest2883405-21kworker/0:0+events22:06:440
282712199254312,2527cyclictest2880837-21kworker/0:1+events22:04:490
28271249925178,2505cyclictest2913852-21kworker/1:1+events23:50:421
282712199249912,2483cyclictest2851291-21kworker/0:0+events20:37:340
282713599249712,2481cyclictest2899483-21kworker/3:0+events23:03:183
28271359924970,2494cyclictest2915564-21kworker/3:0+events00:09:313
282712499249512,2479cyclictest2901094-21kworker/1:1+events23:01:451
28271219924959,2482cyclictest2917135-21kworker/0:0+events23:49:320
282713599249412,2479cyclictest2894517-21kworker/3:1+events22:48:453
282713599249412,2479cyclictest2845188-21kworker/3:2+events20:07:573
282712199249412,2479cyclictest2851291-21kworker/0:0+events21:11:170
282712499249312,2477cyclictest2909023-21kworker/1:2+events23:23:061
282712499249312,2476cyclictest2902784-21kworker/1:0+events23:19:191
282712199249312,2477cyclictest2888336-21kworker/0:0+events22:51:470
282712199249311,2478cyclictest2904117-21kworker/0:0+events23:08:180
282712499249212,2477cyclictest2927045-21kworker/1:2+events00:27:221
282712499249212,2477cyclictest2853159-21kworker/1:1+events20:39:301
282712499249212,2476cyclictest2927045-21kworker/1:2+events00:36:101
28271219924928,2481cyclictest2843359-21kworker/0:0+events19:58:540
282712499249112,2476cyclictest2912261-21kworker/1:2+events23:47:171
282712499249111,2477cyclictest2868729-21kworker/1:0+events21:20:521
282712499249012,2475cyclictest2886551-21kworker/1:0+events22:11:421
282712499249012,2474cyclictest2861059-21kworker/1:2+events21:11:401
282712499249012,2474cyclictest2861059-21kworker/1:2+events21:05:401
282712499249012,2474cyclictest2861059-21kworker/1:2+events21:05:391
282712199249012,2475cyclictest2828415-21kworker/0:2+events19:50:540
282712499248912,2473cyclictest2925390-21kworker/1:0+events00:31:341
282712499248911,2474cyclictest2925390-21kworker/1:0+events00:21:181
282712199248912,2475cyclictest2930216-21kworker/0:2+events00:35:000
282712199248912,2474cyclictest2910593-21kworker/0:1+events23:58:560
282712199248812,2472cyclictest2908706-21kworker/0:0+events23:28:260
282712499248612,2471cyclictest2895086-21kworker/1:0+events22:55:151
282712199248612,2471cyclictest2859168-21kworker/0:2+events20:50:250
282712199248512,2470cyclictest2871905-21kworker/0:0+events21:38:450
282712199248510,2471cyclictest2920355-21kworker/0:0+events00:14:030
282712199248411,2469cyclictest2896398-21kworker/0:1+events22:46:060
282712499248312,2468cyclictest2886551-21kworker/1:0+events22:20:471
282712199247310,2460cyclictest2867189-21kworker/0:2+events21:21:150
282712199247112,2456cyclictest2912194-21kworker/0:2+events23:39:220
282712499246912,2454cyclictest2893286-21kworker/1:2+events22:38:561
282712499246912,2453cyclictest2875232-21kworker/1:0+events21:42:551
282712999246810,2454cyclictest2902419-21kworker/2:1+events23:09:272
282712499246612,2451cyclictest2910624-21kworker/1:0+events23:28:021
282712499246412,2448cyclictest2828758-21kworker/1:3+events19:35:221
282712499246410,2450cyclictest2859407-21kworker/1:1+events20:52:411
282712199246212,2447cyclictest2888336-21kworker/0:0+events22:34:040
282712499246112,2446cyclictest2895086-21kworker/1:0+events22:52:571
282712199245910,2446cyclictest2888336-21kworker/0:0+events22:39:180
282712499245812,2442cyclictest2839985-21kworker/1:2+events19:52:051
282712199245711,2443cyclictest2871905-21kworker/0:0+events21:34:150
282712199245710,2443cyclictest2851291-21kworker/0:0+events20:49:190
282712199244912,2433cyclictest2908706-21kworker/0:0+events23:30:420
282713599244812,2433cyclictest2857661-21kworker/3:2+events20:45:133
282712999244012,2424cyclictest2870336-21kworker/2:0+events21:48:092
282712199242712,2411cyclictest2918761-21kworker/0:2+events00:09:090
282713599242110,2408cyclictest2886732-21kworker/3:2+events22:17:493
282712199242012,2405cyclictest2910593-21kworker/0:1+events23:50:200
282712999241711,2403cyclictest2880509-21kworker/2:2+events21:56:062
282712999241211,2398cyclictest2843657-21kworker/2:1+events20:05:162
282712999241111,2397cyclictest2825099-21kworker/2:1+events19:15:132
28271219924119,2398cyclictest2900821-21kworker/0:2+events23:02:070
282712999240812,2393cyclictest2835161-21kworker/2:2+events19:39:312
282712999240812,2393cyclictest2825099-21kworker/2:1+events19:10:192
282712499240711,2393cyclictest2849787-21kworker/1:2+events20:18:131
282713599240510,2391cyclictest2859287-21kworker/3:1+events20:56:033
282712999240212,2387cyclictest2835161-21kworker/2:2+events19:57:212
282712999240011,2386cyclictest2920325-21kworker/2:1+events00:20:312
282712999240011,2385cyclictest2875394-21kworker/2:2+events21:42:322
28271219924009,2387cyclictest2841758-21kworker/0:1+events20:05:370
282712999239912,2383cyclictest2840192-21kworker/2:1+events19:52:272
282712999239811,2383cyclictest2900790-21kworker/2:0+events23:00:162
282712999239712,2381cyclictest2896078-21kworker/2:1+events22:51:242
282712999239512,2379cyclictest2870336-21kworker/2:0+events21:23:542
282712199239512,2379cyclictest2852952-21kworker/0:1+events20:32:130
282712999239312,2378cyclictest2893129-21kworker/2:0+events22:44:322
282712999239212,2378cyclictest2910989-21kworker/2:0+events23:35:342
282712999239212,2376cyclictest2889805-21kworker/2:2+events22:24:572
282712999239211,2377cyclictest2825099-21kworker/2:1+events19:25:292
282713599239012,2374cyclictest2880452-21kworker/3:1+events22:12:513
282712999239012,2375cyclictest2896078-21kworker/2:1+events22:49:312
282712999239012,2374cyclictest2883465-21kworker/2:1+events22:15:322
282712199237611,2361cyclictest2828415-21kworker/0:2+events19:48:120
282712199237510,2362cyclictest2877024-21kworker/0:2+events21:59:560
282712999236311,2348cyclictest2918701-21kworker/2:0+events00:01:582
282713599235712,2342cyclictest2899483-21kworker/3:0+events23:05:143
282712199234510,2331cyclictest2871905-21kworker/0:0+events21:40:390
282713599233512,2320cyclictest2870452-21kworker/3:0+events21:32:423
282712199233512,2318cyclictest2856388-21kworker/0:1+events20:43:170
282712999233011,2316cyclictest2868664-21kworker/2:2+events21:19:182
282713599232812,2312cyclictest2833677-21kworker/3:0+events19:32:173
282713599232712,2312cyclictest2918552-21kworker/3:2+events23:55:133
282713599232610,2312cyclictest2864171-21kworker/3:1+events21:04:543
282712999232611,2311cyclictest2904053-21kworker/2:0+events23:17:472
282713599232510,2312cyclictest2857661-21kworker/3:2+events20:50:493
28271299923219,2308cyclictest2849725-21kworker/2:1+events20:19:222
282712199232011,2306cyclictest2851291-21kworker/0:0+events20:23:340
28271359923138,2302cyclictest2876872-21kworker/3:0+events21:45:343
282713599231012,2295cyclictest2864171-21kworker/3:1+events21:25:473
282712499231011,2295cyclictest2833799-21kworker/1:0+events19:31:111
282713599230812,2292cyclictest2843543-21kworker/3:1+events20:04:103
282713599230612,2290cyclictest2915564-21kworker/3:0+events00:32:443
282712999230610,2293cyclictest2860854-21kworker/2:1+events20:55:422
282712199230610,2292cyclictest2832392-21kworker/0:1+events19:28:070
282713599230512,2289cyclictest2933126-21kworker/3:1+events00:36:333
282713599230412,2289cyclictest2902388-21kworker/3:1+events23:14:493
282713599230211,2288cyclictest2867161-21kworker/3:0+events21:15:253
282713599229610,2283cyclictest2913732-21kworker/3:2+events23:37:493
282712199229611,2282cyclictest2888336-21kworker/0:0+events22:43:040
282712999229310,2280cyclictest2913705-21kworker/2:2+events23:57:492
282712499229111,2276cyclictest2855998-21kworker/1:2+events20:45:351
282712999229011,2275cyclictest2928639-21kworker/2:0+events00:29:402
282712999228911,2274cyclictest2889805-21kworker/2:2+events22:26:492
282712499228910,2274cyclictest2835432-21kworker/1:1+events19:40:181
282712999228212,2266cyclictest2928639-21kworker/2:0+events00:33:082
282712199227810,2264cyclictest2867189-21kworker/0:2+events21:29:380
282712499227710,2264cyclictest2843511-21kworker/1:0+events20:24:211
282712199227411,2260cyclictest2862392-21kworker/0:2+events20:58:010
282712499227212,2257cyclictest2843511-21kworker/1:0+events19:59:161
282712499227111,2258cyclictest2870421-21kworker/1:1+events21:30:241
28271219922709,2258cyclictest2837002-21kworker/0:1+events19:41:240
282712199227011,2257cyclictest2926804-21kworker/0:2+events00:20:090
282713599226911,2255cyclictest2872086-21kworker/3:2+events21:44:263
28271299922692,2264cyclictest2913705-21kworker/2:2+events23:48:022
282712499226910,2256cyclictest2882267-21kworker/1:2+events22:06:001
282713599226810,2255cyclictest2862544-21kworker/3:2+events21:07:553
282713599226810,2255cyclictest2862544-21kworker/3:2+events21:07:543
28271249922689,2255cyclictest2872029-21kworker/1:2+events21:38:231
282712499226811,2253cyclictest2913852-21kworker/1:1+events23:56:421
282712499226810,2256cyclictest2891552-21kworker/1:1+events22:40:031
282712199226811,2254cyclictest2888336-21kworker/0:0+events22:56:020
282712499226711,2252cyclictest2843511-21kworker/1:0+events20:34:521
282712199226710,2253cyclictest2846642-21kworker/0:2+events20:10:170
282712499226611,2252cyclictest2848190-21kworker/1:1+events20:13:221
28271219922669,2254cyclictest2908706-21kworker/0:0+events23:22:200
282712199226611,2251cyclictest2865592-21kworker/0:1+events21:09:010
282712199226611,2251cyclictest2865592-21kworker/0:1+events21:09:010
282712999226511,2250cyclictest2868664-21kworker/2:2+events21:26:102
282712499226511,2251cyclictest2912261-21kworker/1:2+events23:44:171
282712499226510,2251cyclictest2927045-21kworker/1:2+events00:19:451
28271219922656,2255cyclictest2851291-21kworker/0:0+events20:28:550
282712199226511,2251cyclictest2902505-21kworker/0:1+events23:11:000
282712499226411,2249cyclictest2861059-21kworker/1:2+events20:57:131
282712499226410,2251cyclictest2880391-21kworker/1:1+events22:04:271
28271219922649,2253cyclictest2905839-21kworker/0:2+events23:15:110
28271219922648,2253cyclictest2843359-21kworker/0:0+events20:00:210
282712199226411,2250cyclictest2877024-21kworker/0:2+events21:50:470
282712499226310,2250cyclictest2868729-21kworker/1:0+events21:27:201
282713599226210,2248cyclictest2915564-21kworker/3:0+events00:01:113
28271249922629,2250cyclictest2861059-21kworker/1:2+events21:00:421
282712499226210,2248cyclictest2880391-21kworker/1:1+events21:54:561
282712199226210,2249cyclictest2885066-21kworker/0:2+events22:19:410
282713599226112,2246cyclictest2880452-21kworker/3:1+events22:29:523
282712499226111,2247cyclictest2891552-21kworker/1:1+events22:31:031
282712499225911,2244cyclictest2888276-21kworker/1:2+events22:27:121
28271249922588,2247cyclictest2913852-21kworker/1:1+events00:05:221
28271219922588,2247cyclictest2886671-21kworker/0:1+events22:13:130
282712199225810,2246cyclictest2928547-21kworker/0:1+events00:25:060
282712499225510,2241cyclictest2875232-21kworker/1:0+events21:57:151
282713599224611,2232cyclictest2832016-21kworker/3:1+events19:22:493
282712199224010,2227cyclictest2912194-21kworker/0:2+events23:43:080
282713599223910,2225cyclictest2851677-21kworker/3:0+events20:41:463
282712999223210,2218cyclictest2870336-21kworker/2:0+events21:54:122
282712999222011,2205cyclictest2915355-21kworker/2:1+events23:43:302
28271299922064,2199cyclictest2838507-21kworker/2:0+events19:44:252
282712199220610,2192cyclictest2889952-21kworker/0:1+events22:25:430
28271299922007,2190cyclictest2931934-21kworker/2:2+events00:39:342
282712999220011,2185cyclictest2897732-21kworker/2:2+events22:59:072
282712999220010,2186cyclictest2907291-21kworker/2:1+events23:26:542
28271299921999,2187cyclictest2851443-21kworker/2:2+events20:28:312
282712999219911,2185cyclictest2859198-21kworker/2:2+events20:48:132
28271299921989,2186cyclictest2842058-21kworker/2:0+events20:03:012
28271299921979,2185cyclictest2873514-21kworker/2:1+events21:34:372
282712999219710,2184cyclictest2831988-21kworker/2:0+events19:30:472
28271299921969,2183cyclictest2845309-21kworker/2:2+events20:10:402
282712999219610,2183cyclictest2920325-21kworker/2:1+events00:05:452
282712999219411,2180cyclictest2870336-21kworker/2:0+events22:05:352
28271299921936,2184cyclictest2851443-21kworker/2:2+events20:32:572
28271299921929,2180cyclictest2904053-21kworker/2:0+events23:13:402
282712999219010,2176cyclictest2920325-21kworker/2:1+events00:17:062
282713599218710,2174cyclictest2889044-21kworker/3:0+events22:30:383
28271299921876,2178cyclictest2825099-21kworker/2:1+events19:20:312
282712999218511,2171cyclictest2849725-21kworker/2:1+events20:23:122
282712999218511,2170cyclictest2920325-21kworker/2:1+events00:11:252
282712499218510,2172cyclictest2837207-21kworker/1:0+events19:46:411
282712999218411,2170cyclictest2889805-21kworker/2:2+events22:38:132
282712999218310,2169cyclictest2885335-21kworker/2:2+events22:13:382
28271299921829,2170cyclictest2870336-21kworker/2:0+events21:35:452
282712999218010,2167cyclictest2835161-21kworker/2:2+events19:49:212
282712999217811,2164cyclictest2907291-21kworker/2:1+events23:24:372
282713599217211,2158cyclictest2838679-21kworker/3:2+events19:52:503
282712999217011,2155cyclictest2883465-21kworker/2:1+events22:03:412
282712499217011,2156cyclictest2828758-21kworker/1:3+events19:28:301
282712999216711,2152cyclictest2860854-21kworker/2:1+events20:53:042
282712499216610,2152cyclictest2920510-21kworker/1:2+events00:04:351
282712999216510,2152cyclictest2893129-21kworker/2:0+events22:34:252
282712999216510,2152cyclictest2862455-21kworker/2:0+events21:09:252
282712999216510,2152cyclictest2862455-21kworker/2:0+events21:09:242
282713599216410,2151cyclictest2889044-21kworker/3:0+events22:35:113
282712999216410,2151cyclictest2849725-21kworker/2:1+events20:36:232
282713599216311,2148cyclictest2896166-21kworker/3:0+events22:44:113
282713599213411,2119cyclictest2899483-21kworker/3:0+events22:57:333
282712499213011,2116cyclictest2841853-21kworker/1:1+events20:00:431
282712199213010,2117cyclictest2920355-21kworker/0:0+events00:18:390
282713599212711,2113cyclictest2864171-21kworker/3:1+events21:23:293
282712499212310,2110cyclictest2875232-21kworker/1:0+events21:47:271
282712499212210,2108cyclictest2843511-21kworker/1:0+events20:07:101
282712199212010,2107cyclictest2828415-21kworker/0:2+events19:19:220
282713599211910,2105cyclictest2889044-21kworker/3:0+events22:23:053
282713599211611,2102cyclictest2876872-21kworker/3:0+events21:53:293
282713599211511,2101cyclictest2907260-21kworker/3:2+events23:27:183
28271219921159,2103cyclictest2862392-21kworker/0:2+events21:01:510
282712499211410,2100cyclictest2857625-21kworker/1:0+events20:44:261
282712199211410,2100cyclictest2828415-21kworker/0:2+events19:39:080
28271249921119,2099cyclictest2901094-21kworker/1:1+events23:07:551
28271359921109,2098cyclictest2907260-21kworker/3:2+events23:19:423
282713599210911,2094cyclictest2928398-21kworker/3:1+events00:25:293
28271249921098,2098cyclictest2828271-21kworker/1:2+events19:12:571
28271249921098,2097cyclictest2828758-21kworker/1:3+events19:23:111
28271219921099,2098cyclictest2930216-21kworker/0:2+events00:30:010
282712199210910,2096cyclictest2888336-21kworker/0:0+events22:23:250
282713599210711,2092cyclictest2838679-21kworker/3:2+events19:47:493
282713599210710,2094cyclictest2841912-21kworker/3:0+events19:56:583
282713599210611,2092cyclictest2864171-21kworker/3:1+events21:14:413
282712499210611,2092cyclictest2886551-21kworker/1:0+events22:17:271
282713599210511,2091cyclictest2925634-21kworker/3:2+events00:17:533
282713599210511,2091cyclictest2915564-21kworker/3:0+events23:53:193
282713599210511,2091cyclictest2833677-21kworker/3:0+events19:35:453
282713599210511,2090cyclictest2907260-21kworker/3:2+events23:22:423
282713599210311,2089cyclictest2910893-21kworker/3:1+events23:48:243
282713599210311,2089cyclictest2910893-21kworker/3:1+events23:31:473
282713599210311,2089cyclictest2830392-21kworker/3:0+events19:19:473
28271219921039,2090cyclictest2835342-21kworker/0:0+events19:34:370
282713599210211,2088cyclictest2885036-21kworker/3:0+events22:09:003
28271359921018,2090cyclictest2851677-21kworker/3:0+events20:39:063
28271219921019,2089cyclictest2826723-21kworker/0:1+events19:11:250
28271219920982,2093cyclictest2867189-21kworker/0:2+events21:19:420
282713599206710,2054cyclictest2849876-21kworker/3:2+events20:20:093
282713599205510,2042cyclictest2873831-21kworker/3:1+events21:37:593
28271249920436,2034cyclictest2828758-21kworker/1:3+events19:16:441
28271359920369,2024cyclictest2880452-21kworker/3:1+events21:59:323
28271359920309,2017cyclictest2843543-21kworker/3:1+events20:18:343
28271299920278,2016cyclictest2913705-21kworker/2:2+events23:53:412
282713599199911,1985cyclictest2894517-21kworker/3:1+events22:53:193
28271359919929,1980cyclictest2849876-21kworker/3:2+events20:26:583
28271359919828,1971cyclictest2826827-21kworker/3:2+events19:10:423
28271359919498,1938cyclictest2848249-21kworker/3:0+events20:14:283
28271359919489,1936cyclictest2923869-21kworker/3:1+events00:12:573
282712499194710,1934cyclictest2910624-21kworker/1:0+events23:32:571
28264902143107,32sleep30-21swapper/319:05:313
2826609214199,39sleep10-21swapper/119:07:021
28265502141111,25sleep00-21swapper/019:06:160
28268312140108,27sleep20-21swapper/219:09:512
2827135992217,3cyclictest966-40tracker-miner-f19:45:003
2827135992120,1cyclictest26450irq/143-i91520:30:463
282712999138,4cyclictest2867075-21taskset21:10:502
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional