You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-19 - 19:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Fri Dec 19, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
299051199314215,3123cyclictest3059826-21kworker/2:2+events22:44:592
29905039927195,2710cyclictest3059620-21kworker/0:0+events22:55:180
299050399271313,2696cyclictest3003142-21kworker/0:1+events20:15:200
299050399261112,2594cyclictest3090177-21kworker/0:2+events00:25:170
299051199256512,2550cyclictest3043694-21kworker/2:2+events21:55:162
299051399252312,2507cyclictest3030836-21kworker/3:1+events21:40:203
299050399249712,2481cyclictest3063327-21kworker/0:1+events23:00:160
299051399249510,2481cyclictest3094987-21kworker/3:0+events00:35:203
299051199249110,2477cyclictest3038584-21kworker/2:1+events21:42:152
299050799248712,2472cyclictest3091619-21kworker/1:0+events00:27:591
299051199248610,2472cyclictest3064632-21kworker/2:2+events23:03:382
299050799247811,2464cyclictest3065989-21kworker/1:2+events23:12:521
29905079924737,2463cyclictest3061421-21kworker/1:1+events22:52:141
299051199246111,2446cyclictest3038584-21kworker/2:1+events22:59:532
299050799245910,2446cyclictest3029129-21kworker/1:1+events21:16:371
299051399244812,2432cyclictest3085423-21kworker/3:1+events00:20:233
29905139924208,2408cyclictest3085423-21kworker/3:1+events00:08:113
299051399241912,2404cyclictest3007809-21kworker/3:1+events20:01:173
299051399241811,2404cyclictest3027389-21kworker/3:2+events21:04:153
29905139924178,2406cyclictest3030836-21kworker/3:1+events21:28:273
29905139924178,2406cyclictest3030836-21kworker/3:1+events21:28:263
299051199241612,2401cyclictest3053108-21kworker/2:0+events22:25:172
299051199241312,2398cyclictest3000133-21kworker/2:1+events19:54:232
299051399241210,2399cyclictest3045205-21kworker/3:0+events22:00:163
299051399241012,2395cyclictest3039089-21kworker/3:2+events22:08:373
299051399240711,2393cyclictest3039089-21kworker/3:2+events22:31:473
299050399239810,2384cyclictest3032413-21kworker/0:1+events21:30:210
299051399238911,2373cyclictest2999980-21kworker/3:0+events19:40:213
299050399238812,2373cyclictest3072336-21kworker/0:2+events23:33:520
299050399238212,2367cyclictest3048401-21kworker/0:2+events22:36:430
299050399238112,2366cyclictest3011294-21kworker/0:0+events20:21:500
299051199237312,2358cyclictest3011117-21kworker/2:1+events20:12:172
299050799235611,2342cyclictest3065989-21kworker/1:2+events23:23:591
299051199235512,2340cyclictest3059826-21kworker/2:2+events22:47:162
299050799234711,2331cyclictest3046891-21kworker/1:0+events22:06:231
299050799232812,2313cyclictest3077390-21kworker/1:1+events23:45:141
299051199232211,2308cyclictest3021050-21kworker/2:0+events21:18:072
299050799231610,2303cyclictest3012717-21kworker/1:1+events20:22:361
299050399231311,2298cyclictest3090177-21kworker/0:2+events00:18:530
299051399230911,2295cyclictest3039089-21kworker/3:2+events21:45:433
299050799230910,2296cyclictest3065989-21kworker/1:2+events23:28:581
299050799230811,2294cyclictest3012717-21kworker/1:1+events20:25:151
299051199230711,2293cyclictest3038584-21kworker/2:1+events23:10:122
299051199230611,2292cyclictest3070349-21kworker/2:2+events23:48:182
299051199230011,2286cyclictest3012784-21kworker/2:2+events20:29:272
299051199229711,2282cyclictest3059826-21kworker/2:2+events22:53:012
299051199229511,2281cyclictest3073881-21kworker/2:1+events23:27:482
299051199229510,2283cyclictest3038584-21kworker/2:1+events22:15:042
299050799229510,2281cyclictest3075546-21kworker/1:0+events23:34:371
299051199229410,2281cyclictest3016458-21kworker/2:1+events20:33:142
299050799229410,2281cyclictest2998614-21kworker/1:0+events19:37:451
29905079922939,2281cyclictest3067586-21kworker/1:0+events23:07:521
29905119922927,2282cyclictest3012784-21kworker/2:2+events20:24:282
299050799229211,2277cyclictest3014375-21kworker/1:2+events20:42:291
299050799229110,2278cyclictest3021207-21kworker/1:1+events20:55:511
299051199229011,2276cyclictest3019295-21kworker/2:2+events20:40:572
299050799229011,2276cyclictest3032204-21kworker/1:0+events21:23:011
299051199228810,2274cyclictest3045296-21kworker/2:0+events22:02:562
299050799228811,2274cyclictest3048581-21kworker/1:1+events22:10:541
299051399228711,2273cyclictest3050121-21kworker/3:0+events22:19:153
299050799228711,2273cyclictest3008209-21kworker/1:1+events20:06:581
299051199228610,2273cyclictest3084062-21kworker/2:2+events00:17:452
299050799228111,2268cyclictest3065989-21kworker/1:2+events23:15:071
299050799227911,2265cyclictest3093348-21kworker/1:1+events00:31:531
299050799227612,2261cyclictest3017960-21kworker/1:1+events20:39:011
299050399227111,2258cyclictest3085512-21kworker/0:0+events00:10:300
299051399227011,2256cyclictest3056662-21kworker/3:1+events22:35:333
299051399226811,2254cyclictest3070734-21kworker/3:0+events23:23:123
299051399226811,2254cyclictest3016664-21kworker/3:1+events20:42:073
299051399226810,2254cyclictest3062728-21kworker/3:1+events22:56:283
299051399226711,2252cyclictest3091923-21kworker/3:2+events00:26:043
299051399226411,2250cyclictest3012872-21kworker/3:1+events20:19:553
299051399226410,2251cyclictest3033770-21kworker/3:0+events21:21:553
299051399226311,2249cyclictest3039089-21kworker/3:2+events21:51:493
299051399226010,2247cyclictest3070734-21kworker/3:0+events23:29:413
299051399226010,2247cyclictest2993927-21kworker/3:1+events19:24:403
299051399225911,2245cyclictest3070734-21kworker/3:0+events23:31:353
299051399225911,2245cyclictest3021421-21kworker/3:0+events20:58:313
299051399225910,2246cyclictest3001601-21kworker/3:1+events19:51:433
29905139922588,2247cyclictest3048460-21kworker/3:1+events22:13:133
299051399225711,2243cyclictest3076253-21kworker/3:2+events23:45:363
299051399225610,2243cyclictest3009513-21kworker/3:0+events20:11:553
299051399225411,2240cyclictest3027389-21kworker/3:2+events21:11:353
299051199223910,2225cyclictest2998524-21kworker/2:2+events19:36:112
29905039922369,2224cyclictest3063327-21kworker/0:1+events23:06:430
299050399223611,2221cyclictest3034035-21kworker/0:0+events21:27:160
299050399223611,2221cyclictest3034035-21kworker/0:0+events21:27:160
299051399223410,2221cyclictest3027389-21kworker/3:2+events21:15:493
299051399223311,2219cyclictest3014552-21kworker/3:0+events20:25:383
299050799223311,2219cyclictest3080660-21kworker/1:0+events00:04:201
29905119922309,2218cyclictest3093501-21kworker/2:2+events00:30:432
29905039922299,2217cyclictest3032413-21kworker/0:1+events21:39:340
299051399222810,2215cyclictest3027389-21kworker/3:2+events21:07:433
299050399222810,2215cyclictest3030654-21kworker/0:2+events21:19:160
299051399222610,2213cyclictest3076253-21kworker/3:2+events23:42:133
299051399222511,2211cyclictest3090208-21kworker/3:0+events00:19:363
29905119922259,2213cyclictest3021050-21kworker/2:0+events21:08:062
29905039922259,2214cyclictest3017929-21kworker/0:1+events20:40:340
299050399222311,2209cyclictest3077496-21kworker/0:1+events23:48:420
29905039922219,2208cyclictest3024310-21kworker/0:0+events21:05:240
299050399222110,2208cyclictest3075635-21kworker/0:0+events23:37:150
299050399222110,2207cyclictest3096383-21kworker/0:1+events00:38:010
299050399222011,2206cyclictest3007974-21kworker/0:2+events20:07:450
299050399221910,2206cyclictest3075635-21kworker/0:0+events23:42:360
299051399221610,2203cyclictest3021421-21kworker/3:0+events20:46:203
299050399221611,2202cyclictest3000222-21kworker/0:2+events19:49:500
299050399221610,2203cyclictest3048401-21kworker/0:2+events22:31:010
29905139922137,2203cyclictest3062728-21kworker/3:1+events22:53:253
29905039922139,2201cyclictest3094590-21kworker/0:0+events00:31:060
29905039922139,2201cyclictest3000222-21kworker/0:2+events19:42:150
299050399221310,2200cyclictest3038556-21kworker/0:0+events21:51:040
299050399221011,2196cyclictest3059620-21kworker/0:0+events22:49:320
299050399220910,2195cyclictest3017929-21kworker/0:1+events20:35:320
299050399220810,2195cyclictest3030654-21kworker/0:2+events21:12:210
299051199220611,2192cyclictest3038584-21kworker/2:1+events22:24:102
299050399220311,2189cyclictest3003142-21kworker/0:1+events20:13:490
299050399220310,2190cyclictest3046741-21kworker/0:1+events22:02:330
299050399219511,2181cyclictest3085512-21kworker/0:0+events00:04:430
299051199219112,2176cyclictest3070349-21kworker/2:2+events23:18:322
299051199218911,2175cyclictest3070349-21kworker/2:2+events23:44:492
299051199218711,2173cyclictest3075608-21kworker/2:0+events23:36:092
29905119921869,2174cyclictest3090144-21kworker/2:0+events00:24:092
299051199217811,2164cyclictest3000133-21kworker/2:1+events19:45:162
29905039921778,2166cyclictest3011294-21kworker/0:0+events20:27:530
29905079921738,2162cyclictest2989679-21kworker/1:2+events19:23:311
299050399216910,2156cyclictest3080448-21kworker/0:2+events23:51:470
299050399216811,2154cyclictest3053312-21kworker/0:1+events22:44:160
29905039921678,2156cyclictest3003142-21kworker/0:1+events20:01:390
299050799216610,2153cyclictest3037320-21kworker/1:2+events21:57:121
299051399216010,2146cyclictest3085423-21kworker/3:1+events00:12:033
29905119921559,2143cyclictest3025881-21kworker/2:2+events21:01:552
299050799215310,2140cyclictest3058112-21kworker/1:1+events22:42:231
29905039921499,2137cyclictest3048401-21kworker/0:2+events22:26:490
299050799214610,2133cyclictest3082247-21kworker/1:2+events23:55:351
299051199214411,2130cyclictest3032325-21kworker/2:2+events21:31:052
299051199214410,2131cyclictest3016458-21kworker/2:1+events20:49:472
299050399214310,2130cyclictest2989890-21kworker/0:1+events19:22:010
299051199214111,2127cyclictest3070349-21kworker/2:2+events23:22:482
299051199214011,2126cyclictest3058144-21kworker/2:0+events22:38:582
299051199213911,2125cyclictest3095174-21kworker/2:0+events00:36:072
299051199213811,2124cyclictest3032325-21kworker/2:2+events21:37:152
29905119921380,2135cyclictest3003378-21kworker/2:0+events19:57:502
299051399213611,2122cyclictest3039089-21kworker/3:2+events22:29:553
29905119921358,2124cyclictest3084062-21kworker/2:2+events00:13:372
299050799213511,2121cyclictest3021207-21kworker/1:1+events20:47:291
299050399213411,2120cyclictest3085512-21kworker/0:0+events00:21:310
29905119921338,2122cyclictest3019295-21kworker/2:2+events20:38:132
299051199213310,2120cyclictest3048549-21kworker/2:0+events22:11:402
299050799213110,2118cyclictest3080660-21kworker/1:0+events23:52:111
299050799213011,2116cyclictest3037320-21kworker/1:2+events22:27:361
299050799212910,2116cyclictest3014375-21kworker/1:2+events20:34:441
299050399212810,2114cyclictest3083689-21kworker/0:1+events23:59:470
29905119921249,2112cyclictest3009485-21kworker/2:0+events20:07:212
299050799212311,2109cyclictest3091619-21kworker/1:0+events00:23:011
299051399212110,2108cyclictest2996104-21kworker/3:2+events19:31:103
299050799212110,2108cyclictest3012717-21kworker/1:1+events20:19:341
299050799211910,2106cyclictest2989679-21kworker/1:2+events19:48:191
29905079921179,2104cyclictest3003082-21kworker/1:0+events19:53:371
29905039921177,2106cyclictest3024310-21kworker/0:0+events21:00:210
299050799211610,2103cyclictest3089999-21kworker/1:2+events00:16:171
299051199211510,2102cyclictest2995314-21kworker/2:0+events19:27:412
299050799211510,2102cyclictest3037320-21kworker/1:2+events22:23:001
29905079921148,2103cyclictest3096587-21kworker/1:0+events00:39:521
29905079921119,2098cyclictest3027148-21kworker/1:2+events21:10:261
29905079921118,2100cyclictest3000249-21kworker/1:1+events19:41:291
299050799211110,2098cyclictest3075546-21kworker/1:0+events23:36:301
299051199210910,2096cyclictest2995314-21kworker/2:0+events19:33:082
29905079921078,2095cyclictest3051024-21kworker/1:0+events22:31:221
29905079921049,2092cyclictest3032204-21kworker/1:0+events21:29:111
29905079921049,2092cyclictest3032204-21kworker/1:0+events21:29:111
29905079921048,2093cyclictest3037320-21kworker/1:2+events21:36:061
299050399210310,2090cyclictest3085512-21kworker/0:0+events00:07:260
29905119921025,2094cyclictest3021050-21kworker/2:0+events20:50:332
299050799210210,2089cyclictest3035582-21kworker/1:1+events21:32:171
299051199210110,2088cyclictest3080693-21kworker/2:0+events00:02:272
29905079921004,2093cyclictest2989679-21kworker/1:2+events19:32:431
299050799210010,2087cyclictest3003082-21kworker/1:0+events19:57:281
29905119920997,2089cyclictest3034126-21kworker/2:1+events21:26:532
29905119920997,2089cyclictest3034126-21kworker/2:1+events21:26:522
299051199209910,2085cyclictest3000133-21kworker/2:1+events20:04:172
299050399209911,2084cyclictest3024310-21kworker/0:0+events20:58:080
29905119920989,2086cyclictest3042087-21kworker/2:0+events21:51:272
29905119920988,2087cyclictest3038584-21kworker/2:1+events22:07:272
299051199209810,2084cyclictest3038584-21kworker/2:1+events22:32:322
299050799209810,2086cyclictest3077390-21kworker/1:1+events23:41:041
299050799209810,2085cyclictest3037320-21kworker/1:2+events21:49:311
29905139920977,2086cyclictest3066074-21kworker/3:0+events23:05:563
299051199209710,2084cyclictest3021050-21kworker/2:0+events21:12:432
299050799209710,2084cyclictest2997003-21kworker/1:1+events19:29:391
29905079920949,2082cyclictest3051024-21kworker/1:0+events22:47:381
29905119920927,2081cyclictest3000133-21kworker/2:1+events19:43:232
29905139920907,2081cyclictest3016664-21kworker/3:1+events20:35:083
299050799209010,2077cyclictest3021207-21kworker/1:1+events20:52:481
29905039920908,2079cyclictest3046741-21kworker/0:1+events22:11:170
29905119920874,2080cyclictest3077465-21kworker/2:1+events23:57:062
299051199208310,2070cyclictest3009485-21kworker/2:0+events20:16:092
29905039920828,2071cyclictest2995623-21kworker/0:0+events19:39:380
29905119920814,2074cyclictest3066291-21kworker/2:0+events23:09:242
299051399208010,2067cyclictest3011145-21kworker/3:2+events20:24:533
29905139920784,2071cyclictest3003318-21kworker/3:2+events19:57:053
299051199207710,2064cyclictest3021050-21kworker/2:0+events20:57:472
299050399207510,2062cyclictest2989890-21kworker/0:1+events19:16:590
29905139920737,2063cyclictest3081969-21kworker/3:1+events23:52:333
29905079920739,2061cyclictest3061421-21kworker/1:1+events22:56:051
299051199207210,2059cyclictest2992101-21kworker/2:3+events19:15:302
299051399207011,2056cyclictest3058323-21kworker/3:2+events22:41:593
29905139920683,2062cyclictest3067737-21kworker/3:1+events23:10:353
29905139920678,2055cyclictest3091923-21kworker/3:2+events00:33:473
29905139920675,2059cyclictest3016664-21kworker/3:1+events20:50:093
299051399206710,2054cyclictest3078939-21kworker/3:0+events23:56:433
299050799206710,2054cyclictest3040094-21kworker/1:0+events21:41:511
299051399206610,2053cyclictest3078939-21kworker/3:0+events00:02:503
299051399206610,2053cyclictest3016664-21kworker/3:1+events20:32:513
299051399206610,2053cyclictest2991856-21kworker/3:0+events19:28:043
299050799206610,2052cyclictest3080660-21kworker/1:0+events00:09:441
299051399206510,2052cyclictest2999980-21kworker/3:0+events19:36:583
29905119920656,2056cyclictest3090144-21kworker/2:0+events00:27:362
29905139920649,2052cyclictest3030836-21kworker/3:1+events21:34:573
299051399206410,2051cyclictest3039089-21kworker/3:2+events22:21:073
29905139920638,2052cyclictest3064364-21kworker/3:2+events23:02:533
299051399206310,2050cyclictest3039089-21kworker/3:2+events21:57:343
29905139920629,2050cyclictest3074122-21kworker/3:1+events23:35:223
29905139920629,2050cyclictest3070734-21kworker/3:0+events23:18:113
29905139920586,2049cyclictest2999980-21kworker/3:0+events19:46:013
29905139920538,2042cyclictest3058323-21kworker/3:2+events22:49:563
299051199205210,2039cyclictest3038584-21kworker/2:1+events21:49:552
29905119920507,2041cyclictest3070349-21kworker/2:2+events23:30:062
29905079920479,2035cyclictest2993772-21kworker/1:1+events19:18:321
299050799204510,2032cyclictest3040094-21kworker/1:0+events21:50:401
29905079920429,2030cyclictest3003082-21kworker/1:0+events20:04:411
29905079920418,2030cyclictest3024136-21kworker/1:0+events21:00:451
29905139920406,2031cyclictest3003318-21kworker/3:2+events20:05:283
29905079920379,2025cyclictest3046891-21kworker/1:0+events22:04:281
29905039920367,2026cyclictest3070704-21kworker/0:0+events23:20:070
29905119920318,2020cyclictest2976779-21kworker/2:2+events19:22:232
29905039920317,2021cyclictest2993862-21kworker/0:2+events19:29:140
29905039920298,2017cyclictest3038556-21kworker/0:0+events21:59:540
29905039920269,2014cyclictest3030654-21kworker/0:2+events21:22:170
29905039920265,2018cyclictest3061241-21kworker/0:2+events22:50:190
299050399202310,2010cyclictest3072336-21kworker/0:2+events23:27:030
299050399202210,2009cyclictest3050094-21kworker/0:0+events22:18:290
29905039920217,2011cyclictest3063327-21kworker/0:1+events23:16:380
299050399202110,2008cyclictest3048401-21kworker/0:2+events22:21:300
29905119920199,2007cyclictest2976779-21kworker/2:2+events19:14:242
299050399201810,2005cyclictest2995623-21kworker/0:0+events19:33:540
29905039920173,2011cyclictest3063327-21kworker/0:1+events23:13:380
29905039920166,2007cyclictest3038556-21kworker/0:0+events22:05:370
29905119920127,2002cyclictest3084062-21kworker/2:2+events00:06:382
299050399201010,1997cyclictest3040334-21kworker/0:2+events21:48:450
299050799200710,1994cyclictest3051024-21kworker/1:0+events22:37:261
299050399200310,1990cyclictest3017929-21kworker/0:1+events20:52:030
29905139920019,1989cyclictest2989833-21kworker/3:2+events19:14:033
29905139919978,1986cyclictest2989833-21kworker/3:2+events19:16:143
29905039919965,1988cyclictest3012902-21kworker/0:2+events20:34:220
299051399198810,1975cyclictest3037221-21kworker/3:0+events21:38:003
29905039919867,1976cyclictest3017929-21kworker/0:1+events20:49:240
299050399197410,1961cyclictest3038556-21kworker/0:0+events21:44:090
299050399197010,1956cyclictest2989890-21kworker/0:1+events19:10:150
29905079919699,1957cyclictest2991644-21kworker/1:0+events19:12:281
29905039919538,1941cyclictest3005165-21kworker/0:0+events19:59:450
299051199194410,1931cyclictest3080693-21kworker/2:0+events23:54:482
29905079919439,1931cyclictest3065989-21kworker/1:2+events23:02:311
299050799194210,1929cyclictest3051024-21kworker/1:0+events22:17:211
29905119918679,1857cyclictest3021050-21kworker/2:0+events21:20:022
29897152142113,24sleep10-21swapper/119:06:011
29897902141108,30sleep20-21swapper/219:06:582
29898042138102,30sleep00-21swapper/019:07:080
29896652137107,26sleep30-21swapper/319:05:233
299050799114113,1cyclictest3003082-21kworker/1:0+events20:11:571
299050799189,4cyclictest3027743-10sshd21:05:101
299050799140,4cyclictest732-21runrttasks00:12:511
299050399140,12cyclictest733-21snmpd19:51:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional