Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MetricsAdvisor] Added RetryOnTooManyRequestsPolicy to tests #20653

Merged
merged 3 commits into from
Apr 28, 2021

Conversation

kinelski
Copy link
Member

@kinelski kinelski commented Apr 26, 2021

Fixes #20658.

@kinelski kinelski added Client This issue points to a problem in the data-plane of the library. Cognitive - Metrics Advisor labels Apr 26, 2021
@kinelski kinelski self-assigned this Apr 26, 2021
@kinelski
Copy link
Member Author

/azp run net - metricsadvisor - tests

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@kinelski
Copy link
Member Author

/azp run net - metricsadvisor - tests

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@@ -122,6 +122,7 @@ public async Task UpdateHookAsync()
}

[Test]
[Ignore("https://github.com/Azure/azure-sdk-for-net/issues/20677")]
Copy link
Member Author

@kinelski kinelski Apr 26, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Issue has been present for more than a week and is not related to these changes. This one is from Apr 19th: https://dev.azure.com/azure-sdk/internal/_build/results?buildId=849790&view=logs&j=68082d65-ebf7-5f3f-494d-d3fd09e80dd6&t=6f6444ca-c101-5878-5224-de85502bb056&l=89

@kinelski
Copy link
Member Author

/azp run net - metricsadvisor - tests

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@kinelski
Copy link
Member Author

/azp run net - metricsadvisor - tests

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@kinelski
Copy link
Member Author

/azp run net - metricsadvisor - tests

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@kinelski
Copy link
Member Author

/azp run net - metricsadvisor - tests

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

{
var options = new MetricsAdvisorClientsOptions();

options.Retry.MaxRetries = 6;
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Doubling the default maximum number of retries allowed by our retry policy (default = 3).

At first, my original approach was trying to use an HttpPipelinePolicy to keep retrying as long as we got 429 errors back from the service (you can check it here). It worked just fine.

However, I have changed the approach to something simpler (and a bit less deterministic). The HttpPipelinePolicy could end up in an endless loop if the service kept returning a 429 for any reason (for example, a bug on their side).

Increasing the maximum number of retries seems to be enough to solve the problem. Here is the list of status codes affected by this change. These are not critical errors and will be retried 3 more times in case of failure.

I have run the live tests pipeline 3 times with the MaxRetries approach and had zero failures, which is great given that we were hitting the problem in 100% of the runs. We can easily increase the number if we start seeing the error again, or consider using the HttpPipelinePolicy again if the error persists.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Out of curiosity, are the other languages facing this too? And are the solutions the same? I ask because this seems generic enough that according to how their pipelines are set, it will apply to everyone else.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I raised this concern during standup some weeks ago when the issue started, but no other languages seemed to be facing it at the time. It depends on how the pipelines are set like you said, and on the number of tests as well.

@kinelski kinelski marked this pull request as ready for review April 27, 2021 03:03
@kinelski kinelski requested a review from maririos April 27, 2021 03:03
@kinelski kinelski merged commit 2675518 into Azure:master Apr 28, 2021
@kinelski kinelski deleted the ma-429 branch April 28, 2021 13:52
Sandido added a commit that referenced this pull request May 18, 2021
…reviously released (#21167)

* Add CloudEvent binding (#20698)

* Add CloudEvent binding

* Clean up tests and add explicit exception if an unknown type is bound in output binding.

* [Storage] Prep hotfix release. (#20705)

* changelog + version.

* fix compile error.

* recordings.

* Temporarily replace macOS CI tests with ubuntu CI tests (#20198)

* Revert "Temporarily remove macOS from test matrix (#20194)"

This reverts commit b16aec8f6c935b6fee3e63937f660dd0fbf05c1b.

* Temporarily replace macOS CI tests with ubuntu CI tests

* Increment version for storage releases (#20709)

Increment package version after release of Azure.Storage.Blobs

* Update SnippetGenerator to be async (#20708)

* Update NUnit (#20707)

* [Communication] - TNM - Update TNM version after release (#20675)

* Update TNM version after release

* Resolve merge conflicts

Co-authored-by: Minnie Liu <[email protected]>

* Fix Up Delinquent Changelogs (#20026)

* Changelog test

* Fixup sdk\cognitiveservices\Knowledge.QnAMaker\CHANGELOG.md

* Fixup delinquent CHANGELOG.mds

* Remove unneeded Changes

* [MetricsAdvisor] Doubled maximum number of retries in tests (#20653)

* improve exception message (#20722)

* [Storage] Sas version in test continued (#20725)

* this should work..

* let's keep it inactive first.

* Include SubQueue option for Processor (#20719)

* Include SubQueue option for Processor

* Remove duplicate line

* Update prepare-release docs

* Bumped SAS version (#20726)

* Parse MD files coming over http as raw markdown files (#20728)

This will allow us to point our verify-link script at a raw
MD file in a github repo and have it parsed correctly for
links.

Co-authored-by: Wes Haggard <[email protected]>

* Add new key vault variable for phone number (#20729)

Co-authored-by: Minnie Liu <[email protected]>

* [TSI] Query client library optimizations and improvements (#20673)

* Update AutoRest C# version (#20446)

* Update AutoRest C# version to 3.0.0-beta.20210426.2

* update manual lro implementations to use the new internals

* Update AutoRest C# version to 3.0.0-beta.20210428.2

Co-authored-by: m-nash <[email protected]>

* Web PubSub function bindings sdk. (#20459)

* Init version for Web PubSub function bindings

* fix warns and dependencies.

* fix styling check.

* fix typo in readme and minor update.

* remove deploy files.

* fix and resolve comments

* add changelog.

* fix bug

* refactor and resolve some comments.

* resolve a few comments

* resolve comments.

* add generated api.

* Add package description and update changelog

* update readme.

* update authenticate part

* minor improve description.

* remove snippet.

* Sync eng/common directory with azure-sdk-tools for PR 1572 (#20742)

* Update prepare pipelines template.

* Update prepare-pipelines as well.

* Remove default line.

Co-authored-by: Mitch Denny <[email protected]>

* Set multiple sparse checkout paths in one command/job (#20730)

Co-authored-by: Ben Broderick Phillips <[email protected]>

* Add basic multi-version support to FR (#20693)

* Add basic multi-version support to FR

* enable multi-api testing with mostly 2.1p3

Co-authored-by: Mariana Rios Flores <[email protected]>

* [TSI] Bring sample changes to master (#20755)

* Revisions from the MAA API Review (#20558)

Significant revisions to the API surface to reflect API review comments.

Co-authored-by: Jesse Squire <[email protected]>

* [Communication] - SMS - Re-enabling Unauthorized Number SMS Test (#20642)

* Re-enabling Unauthorized Number SMS Test

* Update recordings

Co-authored-by: Minnie Liu <[email protected]>

* Readme and xmlk docs for Azure.Monitor.Query (#20731)

* Add DLQ sample (#20739)

* Add DLQ sample

* Fix broken links

* PR FB

* Prepare Attestation SDK for GA release (#20760)

* Search indexer knowledge store (#20691)

* Update to rest spec version d95c18e2
Introduce SearchIndexerKnowledgeStore

* Add tests for KnowledgeStore in skillsets

* Update sample in markdown

* Fix code that sanitizes storage account key from session records

* Adjust metric APIs and add tests (#20756)

* [TSI] Query Samples (#20744)

* Refactor batch to a pure model (#20723)

* refactor batch

* Sync Devops helper scripts from azure-sdk repo (#20763)

DevOps helper scripts were updated in azure-sdk repo
so syncing those changes into the tools repo so they
can be used prepare-release script.

Co-authored-by: Wes Haggard <[email protected]>

* Renamed ModelFactory methods to align with guidelines. (#20767)

* Renamed ModelFactory methods to align with Azure naming guidelines.

* Remove net5.0 from TestFramework explicit TargetFrameworks list (#20771)

* [Event Hubs Processor] Stop attempting to steal inappropriately (#20775)

The focus of these changes is to fix a bug in which load balancing
incorrectly identifies a need to attempt to steal a partition (even from
itself) and then fails to find an eligible candidate partition after running
unnecessary logic.  This manifests only as a log message for host applications,
as partitions were never actually stolen.

* add multivariate test sample (#20517)

* add multivariate test sample

* add multivariate in README

* add md file for multivariate detect

* fix

* Add broken links to ingore-links.txt

* add snippet

* align snippet name in md and cs file;
skip line after main method

* update after snippet generation and code generation

* remove trailing whitespace;
correct links

* remove the added ignore links for anomaly detector

Co-authored-by: Shivangi Reja <[email protected]>

* Use sample snippets for WPS (#20780)

* [Service Bus Client] README Link Fix (#20776)

The focus of these changes is to fix the "Source code" link in the README
to reference the correct location.

* uncomment nuget and docs links (#20782)

* Allow null value for PatternTokenizer["flags"] (#20789)

When there are no Flags set, we should pass null to the service

* separate endpoints into test classes and apply api-version to class (#20757)

* Pass default value (1) of query count to service if it is not set explicitly (#20790)

Update tests to validate change in behavior

* [Communication] - ALL - Add subscription configuration to tests.yml (#20781)

* Adding Subscription Configurations to tests.yml

* Fix formatting

* Updating tset-resources.json

* Fix formatting

* Fix indent

* Add extra line

* Revert test-resources.json

* Change back test-resources.json

* Change back test-resources.json

* Cleanup test-resources

* Adressed review comments

* Fix pipeline

Co-authored-by: Minnie Liu <[email protected]>

* Respect webproxy from config (#20743)

* Respect webproxy from config

* PR FB

* Rename to ClientRetryOptions for consistency with EH

* Fix test

* Fix test

* PR FB

* Export API

* Update dependency

* Update reference

* Use ToString for URI

* Revert ToString

* Fix JSON deserialization issue

* Remove unused code

* Sync eng/common directory with azure-sdk-tools for PR 1579 (#20740)

* Allow propogation of SetDevVersion.

* Allow use of SetDevVersion locally and across stages.

Co-authored-by: Mitch Denny <[email protected]>

* Propogate SetDevVersion.

* Added ContentType Extensible Enum (#20768)

* Added ContentType Extensible Enum

* Update sdk/core/Azure.Core.Experimental/src/ContentType.cs

Co-authored-by: Pavel Krymets <[email protected]>

* Updated API file

Co-authored-by: Pavel Krymets <[email protected]>

* recognizeContentTests (#20794)

* Sync eng/common directory with azure-sdk-tools for PR 1524 (#20769)

* Make RELEASE_TITLE_REGEX more specific

* Update eng/common/scripts/ChangeLog-Operations.ps1

Co-authored-by: Wes Haggard <[email protected]>

* Update release REGEX

* tighten up changelog verification

* Ensure releaseDate is in the appriopriate format.

* Update error messages.

* Retrun false after error

Co-authored-by: Chidozie Ononiwu <[email protected]>
Co-authored-by: Chidozie Ononiwu <[email protected]>
Co-authored-by: Wes Haggard <[email protected]>

* SDK Tests for Cosmos DB API Version 2021-04-15 (#20699)

* Regenerate Microsoft.Maintenance from API version 2021-05-01. (#20732)

Co-authored-by: Kalpesh Chavan <[email protected]>

* rename id and ID for identity (#20805)

* [Purview] Azure.Data -> Azure.Analytics (#20796)

After discussion, we would prefer to use `Analytics` instead of `Data`
for our group name.

* [Communication] - TNM - Modifying Update  Capabilities Phone number tests (#20761)

* Modifying Update  Capabilities Phone number tests

* Rerun pipeline

Co-authored-by: Minnie Liu <[email protected]>

* Fix sample readme (#20810)

* Fix sample readme

* Update README.md

* Made quick query parquet internal (#20759)

* Fix Test (#20791)

* [TSI] Renaming and hiding types (#20773)

* Decrease polling frequency for Key Vault tests (#20772)

Resolves #20735. Also fixes some slow Certificates mock tests.

* enable custom forms multi-version (#20795)

* make sure doctype is the same as what we shipped in 3.0 for v2.0 (#20785)

* [FR] Rename ReadingOrder to FormReadingOrder (#20813)

* [Purview] Design Refactor for Scanning (#20811)

Based on feedback with the C# architects, we've made some changes to
the class factoring here and renamed some methods. The goal was to try
to reduce the number of clients we have and clean up some naming
issues.

* Fix broken CODEOWNERS entry

* Remove subscription id since it is not needed in test-resources.json (#20797)

* Remove subscription id since it is not needed in test-resources.json

* Renames, Delete swallows 404s, Add StringFormatter overloads to Query methods (#20786)

* renames
* catch 404s
* string format overloads for Query methods

* Confidential Ledger CI (#20829)

* CI only

* Standardize on repositoryName parameter name in ContainerRegistryClient methods (#20832)

* fix #20831

* update API listing

* Remove lock token remarks from settlement method docs (#20826)

* Remove lock token remarks from settlement method docs

* Remove references to LinkCloseMode.

* [FR] Add API version to new methods in 2.1-preview.x (#20817)

* Topic filter sample (#20816)

* Topic filter sample

* Update README.md

* Update README.md

* Fix link

* PR FB

* PR fb

* Update identity to enable live testing in sovereign clouds for multiple services (#19203)

* only identity change

* resolve error

* change hardcode string

* change to supportedclouds

* remove hardcode

* remove change

* remove hardcode

* change to have the default in a common place

* Remove the StartsWith

* Remove the TestEnvironment.KeyvaultScope

* Remove change

* add hardcode string

* Delete TestEnvVar file.

* Remove hardcoded value of KeyvaultScope, add a initial value for it

* Remove invalid changes.

Co-authored-by: Wenjie Yu (Wicresoft North America Ltd) <[email protected]>
Co-authored-by: Tong Xu (Wicresoft North America Ltd) <[email protected]>

* [autorest.csharp] Bump to latest, write transforms to correct 2 swaggers. (#20833)

A recent bump to autorest core broke the autobump script, as two existing sdks refused validation.

This PR does the bump, writes transforms for the short term, and then regenerates code.

These issues are filed to update the swagger and remove the transform.

https://github.com/Azure/azure-sdk/issues/2803 handles this for ACR.
https://github.com/Azure/azure-sdk/issues/2805 handles this for Azure.AI.MetricsAdvisor .

* Pick up updated T2 mgmt generator (#20839)

* Reference correct version (#20844)

* Turn BearerTokenAuthenticationPolicy into BearerTokenChallengeAuthenticationPolicy (#20670)

* expose BearerTokenChallengeAuthenticationPolicy through BearerTokenAuthenticationPolicy

* Update AutoRest C# version to 3.0.0-beta.20210504.2 (#20851)

* Add QueryTimeSpan type (#20841)

Co-authored-by: Jesse Squire <[email protected]>

* add comments to properties (#20849)

* Temporary remove the NetworkTimeout (#20860)

* [TSI] Readme for samples (#20765)

* Regenerated from an updated 2020-03-01 swagger that removed faulty property validation (#20862)

* Updated TPM attestation APIs to remove BinaryData parameters. (#20843)

* Updated TPM attestation APIs at the request of the TPM attestation team

* [Event Hubs Client] Move Partition Initialization to the Background (#20733)

The focus of these changes is to o refactor partition initialization into
the background task responsible for processing the partition. Because
failures would still be surfaced through the error handler mechanism and
the flow for recovering would follow the existing partition processing failure,
there should be no change to usage patterns nor visible behavioral changes.

* Update ConfidentialLedger CI path (#20868)

* [FR] Flatten TextSyle in TextAppearance (#20857)

* redesing for TextAppearance

* changelog

* updated readme and changelog for may release (#20871)

* updated readme and changelog for may release

* user version number 1.0.1 for the hot bug fixes

* Update samples to use #if SNIPPET (#20847)

* Update samples to use #if SNIPPET

* Fix docs

* [Event Hubs Processor] Validate at Startup (#20861)

The focus of these changes is to introduce validation for configuration
and permissions errors that would prevent an event processor from being
able to recover without intervention.  For example, an incorrect connection
string or the inability to write to the storage container would be detected.

Validation is performed in an unobtrusive way intended to avoid delaying
the processor's ability to begin taking ownership of partitions while ensuring
that host applications are made aware of fatal problems within the scope of
the Start call, rather than having to rely on the error handler.

Also included in these changes is retiring of the ListCheckpointsAsync
implementation, which was deprecated in favor of GetCheckpointAsync previously.

* Update AutoRest C# version (#20869)

* [ACR] Cache Refresh Token (#20753)

* cache work

* WIP

* WIP

* first e2e impl

* renames and comment tidy for clarity

* update to expiry and force refresh condition

* tests pass

* removing printfs

* re-record tests to accomodate cached token

* fix live tests to run in CI

* work in progress

* index on acr-cache-refresh-token: f906f3b587 work in progress

* update tests

* get expiry time from jwt

* pr fb

* make work with new base class PR

* sanitize all but the expiration time in refresh_token in the recorded test logs

* record tokens that don't expire + extra comments

* pr fb

* Initial Confidential Ledger generated client (#20865)

* initial Confidential Ledger client

* [TSI] Address internal feedback for samples and readme (#20878)

* Regenerate SDK for new Swagger File, to remove 400 as expected response (#20806)

* Regenerate SDK for new Swagger File, to remove 400 as expected response

* Bumping up SDK version to 1.0.0-beta.2

Co-authored-by: Aditi Malladi <[email protected]>

* [Event Hubs Client] Test Configuration Adjustments (#20888)

The focus of these changes is to adjust the clouds used for nightly and
manual test runs, reverting to the Public and Canary clouds.  Weekly runs
will include the UsGov and China sovereign clouds as well.   After discussion,
this aligns with the configuration that the engineering team intended.

Due to the China cloud performing slowly during runs, we've seen some tests
start to exceed the previous execution time cap; this cap has been increased
to reduce flakiness in weekly runs.  I'll continue to monitor and adjust as we
learn more about test stability and performance in the sovereign clouds.

* Prepare Azure.Core release (#20885)

* [TSI] Address Managed Team API Review comments (#20879)

* Rename (#20890)

* update changelongs for release (#20891)

* update changelongs for release

* update codeowners

* [TSI] Clarify where a variant type came from (#20894)

* Create SUPPORT.md for .NET repo (#20848)

* [Event Hubs Processor] Incorporate Validation Feedback (#20884)

The focus of these changes is to incorporate some feedback overlooked in
the initial validation pull request (#20861).

* improve docstrings (#20881)

* Add public API spell check to Analyze job (#20088)

* Add cspell to Analyze

* Forward slashes

* Add spellchecking public APIs to aggregate-reports

* Add public api spell checking to formrecognizer and aggregate reports pipeline (aggregate reports uses continueOnError: true)

* Add spelling exception for ZhHant (a language specification)

* Remove empty pwsh step for spellcheck

* Simplify checking for npx command

Co-authored-by: Heath Stewart <[email protected]>

* Readd negative

* Add cspell.json to exceptions, add comments to word list

Co-authored-by: Heath Stewart <[email protected]>

* Samples for labeled tables (#20840)

* Samples for labeled tables

* too excited renaming

* Update sdk/formrecognizer/Azure.AI.FormRecognizer/README.md

Co-authored-by: Krista Pratico <[email protected]>

* selection mark

Co-authored-by: Krista Pratico <[email protected]>

* Revert changes to SetDevVersion. (#20900)

Co-authored-by: Mitch Denny <[email protected]>

* Back out SetDevVersion changes. (#20899)

* Add source generator for system event mapping/constants (#20873)

* Add source generator for system event mapping/constants

* PR FB

* PR FB

* Missing files

* docsettings

* remove code

* Fix build

* changelog

* More fixing

* Use correct property

* DocSettings

* Comment out assert in test (#20876)

* Comment out assert in test

* Update test

* Increment version for core releases (#20903)

Increment package version after release of Azure.Core.Experimental

* Remove APICompat from released packages (#20886)

* Extend Check Enforcer timeout (#20875)

Extend the timeout that Check Enforcer applies when waiting for a pipeline to start.

* Increment version for eventhub releases (#20893)

* Increment package version after release of Microsoft.Azure.EventHubs.Processor

* Increment package version after release of Microsoft.Azure.EventHubs

* Support modifying feature flag filter parameters (#20866)

* Prepare releases of extensions packages and AppConfig (#20887)

* Add a JsonPath sanitization callback (#20892)

* Update Azure.Core and Experimental (#20915)

* tests (#20896)

* update the version in the .csproj file to 1.0.1, fix formatting in changelog (#20898)

* update the version in the .csproj file to 1.0.1, fix formatting in changelog

* add ApiCompatVersion back

* Remove Azure.Core.props (#20917)

* [Service Bus] Populate TransportType (#20920)

The focus of these changes is to populate the `TransportType` property
on the `ServiceBusClient` at construction.  Previously, the requested
`TransportType` was honored but was nor correctly reflected in the
property.

* [Messaging Function Extension] README Updates (#20924)

The focus of these changes is to correct an error in the configuration
examples for Event Hubs and to include additional information about the permission
grants needed when using  managed identity.

* Upgrade MSAL and MSAL extesion library dependencies to latest (#20922)

* Upgrade MSAL and MSAL extesion library dependencies to latest

* exclude x-ms-PKeyAuth from record matching

* SDK update for TemplateSpecs GA API 2021-05-01 (#20846)

* Preparing for Storage STG 77 beta (#20812)

* Cleaned up breaking change description (#20929)

* Add spell check for changed files (#20822)

* Add spell check for changed files

* task -> template

* Add exceptions

* Add better error handling in Prepare-Release (#20933)

Co-authored-by: Wes Haggard <[email protected]>

* Increment version for attestation releases (#20932)

Increment package version after release of Azure.Security.Attestation

* Fix build warnings (#20921)

* Confidential Ledger samples (#20930)

* Samples

* CL samples (#20943)

* introduce header name constant

* Enable anonymous access for ACR (#20919)

* initial commit

* backup test-resources.json

* work in progress

* small cleanup

* more tidy

* add tests

* update API and re-record tests

* Prepare for 11.3.0-beta.2 release for Search (#20948)

* Update 11.3.0-beta.2 release date for Search

* Add period at the end of sentence

* [synapse] Add changelog for release (#20867)

* [synapse] Add changelog for release

* Add line ref for https://github.com/Azure/azure-sdk-for-net/issues/20051

* [Event Hubs] May Release Preparation (#20944)

The focus of these changes is to prepare the core Event Hubs package
for the May release and update changelogs for the core and processor
packages.

* regenerating recoveryservices-backup C# SDK for swagger spec V2021-03 (#20827)

* generating C# code for V2021-03

* updating file with new SDK version, adding new API version to RP.props

* updating test settings with the new API-version

* updated the encodedHttpRequestUri with the new API version

* updating ListOperations api version for mocking

* resetting vault API versions

* adding unescaped url to the mock records

* adding mock record with unescaped uri for getOperationResults

* corrected the status code and added location header in the mocks

Co-authored-by: Chandrika Gonuguntla <[email protected]>

* [Communication] - SDK - Renamed EVs to consolidated set (#20925)

* Prepare for EG release (#20956)

* [Communication] Update the repeatabilityFirstSent timestamp to correct format (#20959)

* Update the repeatabilityFirstSent timestamp to correct format

* Fix formatting

Co-authored-by: Minnie Liu <[email protected]>

* Add KV extension RBAC info (#20952)

Co-authored-by: Heath Stewart <[email protected]>

* ACR Beta2 Changelog updates (#20966)

* beta2 changelog

* update changelog

* more updates

* Increment version for eventhub releases (#20975)

Increment package version after release of Azure.Messaging.EventHubs

* Increment version for tables releases (#20977)

Increment package version after release of Azure.Data.Tables

* [Event Hubs Processor] May Release Preparation (#20976)

The focus of these changes is to prepare the processor package for the
May milestone release.

* Increment version for eventhub releases (#20978)

Increment package version after release of Azure.Messaging.EventHubs.Processor

* Increment version for synapse releases (#20983)

Increment package version after release of Azure.Analytics.Synapse.Artifacts

* Increment version for search releases (#20980)

Increment package version after release of Azure.Search.Documents

* Setup INT live tests (#20906)

Setup .net live tests pipeline for INT.

Add 'INT' configuration in 'subscription configuration'
Disable SMS tests and phone number update capability tests in INT because INT does not support SMS yet. Control by EV COMMUNICATION_SKIP_SMS_TEST (false in Prod, true in INT)
Disable phone number search test in INT for now since there is no Toll Free number in INT. Control by EV COMMUNICATION_SKIP_PHONENUMBERS_TEST (false in Prod, true in INT)

* [MetricsAdvisor] Renamed all TopCount occurrences to MaxPageSize (#20626)

* Don't log task canceled exceptions as errors when stopping processor. (#20940)

* Don't log task canceled exceptions as errors when stopping processor.

Don't log service timeout exceptions as errors when accepting sessions in processor.

* Update webjobs test to validate no errors are logged from SDK.

* PR FB

* More formatting

* Change default timeout to prevent flakiness

* PR FB

* Update AutoRest C# version (#20928)

* Update AutoRest C# version to 3.0.0-beta.20210510.2

* Add newly needed Azure.Core.Experimental ref

* Export new API

Co-authored-by: Chris Hamons <[email protected]>

* Update CHANGELOG.md with change info (#20988)

# All SDK Contribution checklist:

This checklist is used to make sure that common guidelines for a pull request are followed.
- [ ] **Please open PR in `Draft` mode if it is:**
	- Work in progress or not intended to be merged.
	- Encountering multiple pipeline failures and working on fixes.
- [ ] If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.
- [ ] **I have read the [contribution guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md).**
- [ ] **The pull request does not introduce [breaking changes](https://github.com/dotnet/corefx/blob/master/Documentation/coding-guidelines/breaking-change-rules.md).**

### [General Guidelines and Best Practices](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#general-guidelines)
- [ ] Title of the pull request is clear and informative.
- [ ] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, [see this page](https://github.com/Azure/azure-powershell/blob/master/documentation/development-docs/cleaning-up-commits.md).

### [Testing Guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#testing-guidelines)
- [ ] Pull request includes test coverage for the included changes.

### [SDK Generation Guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#sdk-generation-guidelines)
- [ ] The generate.cmd file for the SDK has been updated with the version of AutoRest, as well as the commitid of your swagger spec or link to the swagger spec, used to generate the code. (Track 2 only)
- [ ] The `*.csproj` and `AssemblyInfo.cs` files have been updated with the new version of the SDK. Please double check nuget.org current release version.

## Additional management plane SDK specific contribution checklist: 
Note: Only applies to `Microsoft.Azure.Management.[RP]` or `Azure.ResourceManager.[RP]`
 
- [ ] Include updated [management metadata](https://github.com/Azure/azure-sdk-for-net/tree/master/eng/mgmt/mgmtmetadata).
- [ ] Update AzureRP.props to add/remove version info to maintain up to date API versions.

### Management plane SDK Troubleshooting
- If this is very first SDK for a services and you are adding new service folders directly under /SDK, please add `new service` label and/or contact assigned reviewer.
- If the check fails at the `Verify Code Generation` step, please ensure:
	- Do not modify any code in generated folders.
	- Do not selectively include/remove generated files in the PR.
	- Do use `generate.ps1/cmd` to generate this PR instead of calling `autorest` directly.
	Please pay attention to the @microsoft.csharp version output after running `generate.ps1`. If it is lower than current released version (2.3.82), please run it again as it should pull down the latest version.
	
	**Note: We have recently updated the PSH module called by `generate.ps1` to emit additional data. This would help reduce/eliminate the Code Verification check error. Please run following command**:

	    `dotnet msbuild eng/mgmt.proj /t:Util /p:UtilityName=InstallPsModules`

### Old outstanding PR cleanup
 Please note:
	If PRs (including draft) has been out for more than 60 days and there are no responses from our query or followups, they will be closed to maintain a concise list for our reviewers.

* Increment version for confidentialledger releases (#20987)

Increment package version after release of Azure.Storage.ConfidentialLedger

* SQL V5 SDK Release (#20267)

* Adding generated models

* Add Usage model

* Fix Threat Detection tests for release .SDK v5 (#1)

* FIX TESTS WITH SDK VERSION 5

* small fixes

* records of threat detection tests

* Update ImportExport SDK to use newer Import method which is on DatabasesOperations and rerecorded tests (#3)

* Fixed all tests

* Add missing files

* Fix TDE and Usage tests

* Remove TDE test

* Remove TDE api

* Fixed build failures

* Remove unwanted sql_resource-manager.txt file

* Revert autorest.md file

* Add missing discrepancies

* Fix build errors

* Fix git diff

* Fix build error

* Update versions in csproj and assemblyinfo

Co-authored-by: ayeletshpigelman <[email protected]>
Co-authored-by: brandong-ms <[email protected]>

* [MetricsAdvisor] Renamed SkipCount to Skip (#20990)

* Update Event Grid version (#21004)

* Remove UseLegacyPowerShell (#20986)

* Remove UseLegacyPowerShell option

* Prepare Key Vault 4.2-beta release (#20901)

* Make the query batch a simpler model (#21009)

* [Communication] - Divide live test pipeline for each SDK (#20902)

* Divide live test pipeline

* Divide live test pipeline

* Fix pipeline

* Adding eng pipeline changes

* Fix pipeline

* Fix ci pipeline

* Fix ci pipeline

* Fix ci pipeline

* Adding separate yaml files

* Setting template as absolute path

* Fix path

* Fix path

* Fix path

* Fix default value

* Revert tests.yml

Co-authored-by: Minnie Liu <[email protected]>

* [FR] Move to 2.1 GA (#20967)

* oficially move to 2.1 GA

* add 3.1.0 to readme

* [TA] Targets service version 3.1-preview.5  (#20994)

* generation + build + tests + disable healthcare

* update public api with new version

* Added new api version 2021-02-01 in Az networking (#20989)

* Added mew api version 2021-02-01 in Az networking

* Added new api version details

* Reverted version to 20.5.0 instead of 20.6.0

* Increment version for keyvault releases (#21015)

* Increment package version after release of Azure.Security.KeyVault.Administration

* Increment package version after release of Azure.Security.KeyVault.Keys

* Increment package version after release of Azure.Security.KeyVault.Certificates

* Increment package version after release of Azure.Security.KeyVault.Secrets

* Increment version for communication releases (#21012)

Increment package version after release of Azure.Communication.Chat

* Increment version for extensions releases (#21007)

Increment package version after release of Microsoft.Extensions.Azure

* Increment version for eventgrid releases (#21002)

Increment package version after release of Azure.Messaging.EventGrid

* Increment version for objectanchors releases (#20999)

Increment package version after release of Azure.MixedReality.ObjectAnchors.Conversion

* Increment version for containerregistry releases (#20998)

Increment package version after release of Azure.Containers.ContainerRegistry

* [LLC] Add draft of 'protocol method' help text (#20951)

* Adding support for new storage serviceUri configurations (#19647)

* Adding support for new storage extensions configurations

* remove local artifact building

* Adding Configuration tests for Blob and Queue extensions

* fixing queue config tests

* [CODEOWNERS] WebPubSub (#21003)

The focus of these changes is to add the WebPubSub client library and
Functions extension into CODEOWNERS.   Also included is an update to
the Event Hubs service team ownership.

* [Smoke Tests] May Release Version Bumps (#21006)

Bumping smoke test reference versions to account for the May releases.

* Prepare for release (#21022)

* Dispose non buffered content streams (#20985)

* Prepared Storage for release (#21013)

* set version to 3.1.0 (#21029)

* Sync eng/common directory with azure-sdk-tools for PR 1594 (#20958)

* Update sparse checkout create directory step name

* plumb BaseBranchName to create pull request

Co-authored-by: Ben Broderick Phillips <[email protected]>

* Unify Key Vault Administration APIs (#20968)

* Rename operation classes and .models namespace
* Change order of role definition methods
* Use commit 1e2c9f3e for Administration package
* Create CreateOrUpdateRoleDefinitionOptions
* Rename KeyVaultRoleAssignmentPropertiesWithScope
* Enable backup and restore sample
* Updated custom role definition tests
* Rename to KeyVaultSelectiveKeyRestoreOperation and Result

* Update Changelog for 1.4.0 GA release (#21030)

* Update Changelog for 1.4.0 GA release

* changed back Tables api version from 2020-10 to 2020-08 (#20936)

* Increment version for storage releases (#21034)

* Increment package version after release of Azure.Storage.Blobs.Batch

* Increment package version after release of Azure.Storage.Common

* Increment package version after release of Azure.Storage.Blobs

* Increment package version after release of Azure.Storage.Files.DataLake

* Increment package version after release of Azure.Storage.Blobs.ChangeFeed

* Increment package version after release of Azure.Storage.Queues

* Increment package version after release of Azure.Storage.Files.Shares

* Make Azure.Core cspell-clean (#21027)

* [Communication] - Clean up communication pipeline parameters (#21033)

* Clean up communication pipeline parameters

* Remove tests.yml

Co-authored-by: Minnie Liu <[email protected]>

* Increment version for identity releases (#21037)

Increment package version after release of Azure.Identity

* [TSI] - Address comments from SDK Board API review (#20962)

* Rename EV (#21036)

* Remove note on v4 for Microsoft.Azure.ServiceBus as v5 is already out (#21041)

This PR updates the text in the migration guide for Service Bus to avoid using version number on Microsoft.Azure.ServiceBus as newer version of the same is already out.

Apologies, the rest of the changes are from my formatter.

* [MetricsAdvisor] Updated test hook ID (#21039)

* [TA] Add parameter DisableServiceLogs (#21028)

* [Purview] Regenerate Catalog Client (#21008)

* [Purview Catalog] Regenerate Based on Arch Board Feedback

* [Purview Catalog] Reduce number of top level clients

* [Purview] Snap Catalog to latest Swagger

* [Purview Catalog] Update README.md and CHANGELOG.md

* [Purview Scanning] Update README.md and CHANGELOG.md (#21014)

* Update service bus dependency (#21044)

* [MetricsAdvisor] Added Value and ExpectedValue properties (#20995)

* Increment package version after release of Azure.Messaging.ServiceBus (#21043)

* Increment version for eventgrid releases (#21052)

Increment package version after release of Microsoft.Azure.WebJobs.Extensions.EventGrid

* test changes for #13552 and #13578 (#21057)

* Increment version for purview releases (#21049)

Increment package version after release of Azure.Analytics.Purview.Scanning

* Update owners (#20692)

* Update owners

For Log Analytics and Application Insights - new team members

* Update CODEOWNERS

Change danhadari74 to danhadari - He updated his user

* Add StorageClientProvider support to EventHubs extension (#21047)

* Fix AppendPath locic for escaped strings (#21061)

* Fix AppendPath logic for escaped strings

* Adding SDK for Microsoft.DataProtection (#20683)

* adding dataprotection service

* changes for sdk generated file

* updating swagger sdk with stable version

* refactoring naming

* adding dummy test

* fixing vault creation

* policy json changes

* updating remove flatten sdk

* fixing policy cases

* create BI added

* changes fore removing friendly name

* added backup and restore

* added other operations tests

* changes for new generate powershell sdk

* changes for updated sdk

* safejsonconvert changes

* changes for adding operation status in mock

* changes

* recording json

* resolving pr comments

Co-authored-by: Mayank Aggarwal <[email protected]>

* [Storage] Upgrade API version to 2021-04-01 (#20939)

* [synapse] Bump to fc5e2fbcfc3f585d38bdb1c513ce1ad2c570cf3d for hotfix (#21062)

* generated new sdk and change test case (#20720)

* generated new and change test case

* Modified csproj file and assembly file

* fixed wording

* [Resources] Regenerate from API version 2021-01-01 and 2021-04-01 (#20643)

* Regenerate from 2021-01-01

* Re-record deployment and What-If tests

* Re-record policy tests

* Re-record provider tests

* Re-record resource group tests

* Re-record resource tests

* Re-record tags tests

* Re-record template spec tests

* Update versions and AzureApiTag

* Update assembly file version

* Update template spec tests

* Update generate.ps1

* Restore managementgroups tests

* Add release notes for 2021-01-01

* Add customizations to mitigate breaking changes

* generate 2021-04-01 SDK

* fix and rerun tests

* merge conflict

* rerun template specs tests with latest API version

* update assembly version and rerun tests

* remove launchSettings file

* Fix signatures of custom constructors

Co-authored-by: Wendy Chang <[email protected]>

* Remove analyzer suppressions (#21050)

* Remove analyzer suppressions

* Fix client creation

* API update (not really but the file changed)

* Remove receiver from MessageProcessor constructor (#21054)

* [syanpse] Update CHANGELOG (#21064)

# All SDK Contribution checklist:

This checklist is used to make sure that common guidelines for a pull request are followed.
- [ ] **Please open PR in `Draft` mode if it is:**
	- Work in progress or not intended to be merged.
	- Encountering multiple pipeline failures and working on fixes.
- [ ] If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.
- [ ] **I have read the [contribution guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md).**
- [ ] **The pull request does not introduce [breaking changes](https://github.com/dotnet/corefx/blob/master/Documentation/coding-guidelines/breaking-change-rules.md).**

### [General Guidelines and Best Practices](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#general-guidelines)
- [ ] Title of the pull request is clear and informative.
- [ ] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, [see this page](https://github.com/Azure/azure-powershell/blob/master/documentation/development-docs/cleaning-up-commits.md).

### [Testing Guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#testing-guidelines)
- [ ] Pull request includes test coverage for the included changes.

### [SDK Generation Guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#sdk-generation-guidelines)
- [ ] The generate.cmd file for the SDK has been updated with the version of AutoRest, as well as the commitid of your swagger spec or link to the swagger spec, used to generate the code. (Track 2 only)
- [ ] The `*.csproj` and `AssemblyInfo.cs` files have been updated with the new version of the SDK. Please double check nuget.org current release version.

## Additional management plane SDK specific contribution checklist: 
Note: Only applies to `Microsoft.Azure.Management.[RP]` or `Azure.ResourceManager.[RP]`
 
- [ ] Include updated [management metadata](https://github.com/Azure/azure-sdk-for-net/tree/master/eng/mgmt/mgmtmetadata).
- [ ] Update AzureRP.props to add/remove version info to maintain up to date API versions.

### Management plane SDK Troubleshooting
- If this is very first SDK for a services and you are adding new service folders directly under /SDK, please add `new service` label and/or contact assigned reviewer.
- If the check fails at the `Verify Code Generation` step, please ensure:
	- Do not modify any code in generated folders.
	- Do not selectively include/remove generated files in the PR.
	- Do use `generate.ps1/cmd` to generate this PR instead of calling `autorest` directly.
	Please pay attention to the @microsoft.csharp version output after running `generate.ps1`. If it is lower than current released version (2.3.82), please run it again as it should pull down the latest version.
	
	**Note: We have recently updated the PSH module called by `generate.ps1` to emit additional data. This would help reduce/eliminate the Code Verification check error. Please run following command**:

	    `dotnet msbuild eng/mgmt.proj /t:Util /p:UtilityName=InstallPsModules`

### Old outstanding PR cleanup
 Please note:
	If PRs (including draft) has been out for more than 60 days and there are no responses from our query or followups, they will be closed to maintain a concise list for our reviewers.

* [CODEOWNERS] Remove Wildcards in Messaging (#21060)

The focus of these changes is to remove the wildcard paths from the
Messaging SDKs to try and allow more targeted alerting for the
Azure Functions extensions.

* Take Core reference (#21067)

* Prepare for release (#21051)

* Prepare for release

* Update sdk/servicebus/Microsoft.Azure.WebJobs.Extensions.ServiceBus/CHANGELOG.md

Co-authored-by: Jesse Squire <[email protected]>

* Breaking changes

Co-authored-by: Jesse Squire <[email protected]>

* Add INT testing in sdk pipelines (#21068)

* Add INT testing in sdk pipelines

* Add Ignore SMS test check back

* Ledger Digest Upload SDK (#21021)

* adding ledger changes

* all generated changes

* adding ledger changes

* all generated changes

* generated files updates

* adding tests, new generated files from databases

* updating recorded tests for ledger

* renaming file path

* adding ListByServerWithHttpMessagesAsync to database operations customizations to fix breaking change

* fixing newline spacing

* upating based on most recent generation

* adding sql_resource-manager.txt file

* final updates to ListByServerWithHttpMessagesAsync interface and caller

* Microsoft.StoragePool New Service SDK (#21040)

* Initial commit

* Fixing build errors

Co-authored-by: Harshitha Akkaraju <[email protected]>

* Update gallery example, use 'Reset' rather than 'ResetToPrivate' (#20907)

* save the auto-generation work

* add gallery application version update auto-generation

* nit, add new line

* update record json

* update record json and add new tests for caps gallery with sharing profile and shared gallery

* save work for gallery with sharing profile, caps side test

* update blob as source code

* uncheck shared gallery test which can not run right now

* save

* save

* add shared gallery tests

* generate files again

* Revert "generate files again"

This reverts commit 051be5469e1ceece14c9bd386de7a54607ce05c2.

* update gallery

* revert unnecessary change

* update examples

* Cplat gallery build (#20407)

* Creating nuget package for blob as source (#20127)

* save the auto-generation work

* add gallery application version update auto-generation

* nit, add new line

* update record json

* update record json and add new tests for caps gallery with sharing profile and shared gallery

* save work for gallery with sharing profile, caps side test

* update blob as source code

* uncheck shared gallery test which can not run right now

* save

* save

* add shared gallery tests

* generate files again

* Revert "generate files again"

This reverts commit 051be5469e1ceece14c9bd386de7a54607ce05c2.

* update gallery

* revert unnecessary change

* update examples

* Update Microsoft.Azure.Management.Compute.csproj

Co-authored-by: kangsun-ctrl <[email protected]>

* Update AssemblyInfo.cs

* Update Microsoft.Azure.Management.Compute.csproj

* nit

* Update Microsoft.Azure.Management.Compute.csproj

* Update AssemblyInfo.cs

* Create AssemblyInfo.cs

* commit

* update, address comments

* update

* update test

Co-authored-by: Theodore Chang <[email protected]>

* Use column types for GetObject calls (#21071)

* [Core] Improve OperationHelpers used by our LROs (#19105)

* Prepare extensions release (#21077)

* [Communication] - SMS - Repeatability accepted check for SMS tests (#21063)

* Repeatability accepted check for SMS tests

* Fix ci build failure

Co-authored-by: Minnie Liu <[email protected]>

* Update SubscriptionProperties.cs (#21081)

the error description for MaxDeliveryCount returns incorrectr property name

* allow multiple invocations of archetype-sdk-tests-generate (#21080)

Co-authored-by: scbedd <[email protected]>

* Update keyvault to enable live testing in sovereign clouds for multiple services (#20345)

* Update keyvault to enable live testing in sovereign clouds for multiple services

* resolve the conflict

* Update the CloudConfig vaule.

* Remove Preview from the Clouds list.

* remove HSM tests

* change Clouds to SupportedClouds

Co-authored-by: Wenjie Yu (Wicresoft North America Ltd) <[email protected]>

* SDK changes for TrafficManager API 2018-08-01 (#20905)

* [ACR] Implementation of API Updates for Beta 3 (#21078)

* updates from new swagger file for Beta3 API

* separate out ArtifactManifestReference type

* update autorest.md

* re-record repository tests

* missed rename

* update generated API listing

* Update IoT Hub control plane to new version (#21072)

* Increment version for extensions releases (#21086)

* Increment package version after release of Azure.Extensions.AspNetCore.DataProtection.Blobs

* Increment package version after release of Azure.Extensions.AspNetCore.DataProtection.Keys

* Increment package version after release of Azure.Extensions.AspNetCore.Configuration.Secrets

* [MetricsAdvisor] Re-enabled GetHooksAsync sample (#21091)

* [MetricsAdvisor] Whitelisted redacted headers for logging (#21093)

* enable healthcare again and updating pii tests (#21108)

* update readme issue (#21103)

* update readme issue (#21104)

* [MetricsAdvisor] Removed HttpRequest and Elasticsearch data sources (#21095)

* [Media] AVA SDK Addition (#20700)

* regenerated and renamed to pipeline terminology

* name update

* fixing pr check errors

* added public swagger

* reverting old sdk

* restoring old sdk

* updating readme

* cleaning up old terminology

* addressing PR comments

* addressing PR comments

* fixes for PR checks:

* pr comments

* updating connectionstring

* exported new api file

* updating edge module version

* Increment version for synapse releases (#21111)

Increment package version after release of Azure.Analytics.Synapse.Artifacts

* Use explicit service version (#20770)

* Pass service version explicitly to search client options

* Initial Checkin for AVA Management SDK (#21070)

* Initial Checkin for AVA Management SDK

* rerun autorest with rename

* regenerate with checked in swaggers

* let's see (#21116)

* Blobs migration additions (#20965)

* blob metadata section

* Test new migration samples

* sample link fix

* pr feedback

Co-authored-by: jschrepp-MSFT <[email protected]>

* Added support for message metadata. (#21097)

Co-authored-by: Camilo Ramirez <[email protected]>

* Update AVA Management SDK to use beta instead of preview in version (#21122)

* Update AMS Management SDK to use beta instead of preview

* Update csproj to use beta instead of preview

* add more to changelog (#21110)

* add more to changelog

* [TA] Implement new Analyze sentiment in Analyze endpoint (#21109)

* Make AzureKeyVaultConfigurationProvider case insensitive again (#21141)

* fix tests

Co-authored-by: JoshLove-msft <[email protected]>
Co-authored-by: Kamil Sobol <[email protected]>
Co-authored-by: Ben Broderick Phillips <[email protected]>
Co-authored-by: Azure SDK Bot <[email protected]>
Co-authored-by: Pavel Krymets <[email protected]>
Co-authored-by: Kamil Sobol <[email protected]>
Co-authored-by: minnieliu <[email protected]>
Co-authored-by: Minnie Liu <[email protected]>
Co-authored-by: Chidozie Ononiwu <[email protected]>
Co-authored-by: kinelski <[email protected]>
Co-authored-by: Mariana Rios Flores <[email protected]>
Co-authored-by: Wes Haggard <[email protected]>
Co-authored-by: Sean McCullough <[email protected]>
Co-authored-by: Wes Haggard <[email protected]>
Co-authored-by: Basel Rustum <[email protected]>
Co-authored-by: m-nash <[email protected]>
Co-authored-by: JialinXin <[email protected]>
Co-authored-by: Mitch Denny <[email protected]>
Co-authored-by: tg-msft <[email protected]>
Co-authored-by: bikamani <[email protected]>
Co-authored-by: Larry Osterman <[email protected]>
Co-authored-by: Jesse Squire <[email protected]>
Co-authored-by: Mohit Chakraborty <[email protected]>
Co-authored-by: Christopher Scott <[email protected]>
Co-authored-by: Jesse Squire <[email protected]>
Co-authored-by: luxiong-ms <[email protected]>
Co-authored-by: Shivangi Reja <[email protected]>
Co-authored-by: Anne Thompson <[email protected]>
Co-authored-by: Krzysztof Cwalina <[email protected]>
Co-authored-by: Chidozie Ononiwu <[email protected]>
Co-authored-by: nichatur <[email protected]>
Co-authored-by: Kalpesh Chavan <[email protected]>
Co-authored-by: Kalpesh Chavan <[email protected]>
Co-authored-by: Matt Ellis <[email protected]>
Co-authored-by: Heath Stewart <[email protected]>
Co-authored-by: Sam Cheung <[email protected]>
Co-authored-by: Yun Lu (MSFT) <[email protected]>
Co-authored-by: Wenjie Yu (Wicresoft North America Ltd) <[email protected]>
Co-authored-by: Tong Xu (Wicresoft North America Ltd) <[email protected]>
Co-authored-by: Chris Hamons <[email protected]>
Co-authored-by: David R. Williamson <[email protected]>
Co-authored-by: glorialimicrosoft <[email protected]>
Co-authored-by: Aditi <[email protected]>
Co-authored-by: Aditi Malladi <[email protected]>
Co-authored-by: Elena <[email protected]>
Co-authored-by: Daniel Jurek <[email protected]>
Co-authored-by: Heath Stewart <[email protected]>
Co-authored-by: Krista Pratico <[email protected]>
Co-authored-by: ankitarorabit <[email protected]>
Co-authored-by: Scott Schaab <[email protected]>
Co-authored-by: Gokul Premraj <[email protected]>
Co-authored-by: chandrikagonuguntla <[email protected]>
Co-authored-by: Chandrika Gonuguntla <[email protected]>
Co-authored-by: Jorge Beauregard <[email protected]>
Co-authored-by: jastenze <[email protected]>
Co-authored-by: viparek <[email protected]>
Co-authored-by: ayeletshpigelman <[email protected]>
Co-authored-by: brandong-ms <[email protected]>
Co-authored-by: Mikhail <[email protected]>
Co-authored-by: karshinlin <[email protected]>
Co-authored-by: dabenhamMic <[email protected]>
Co-authored-by: armansabaa <[email protected]>
Co-authored-by: Ramya Rao <[email protected]>
Co-authored-by: omziv <[email protected]>
Co-authored-by: Mayank Aggarwal <[email protected]>
Co-authored-by: Mayank Aggarwal <[email protected]>
Co-authored-by: Wei Wei <[email protected]>
Co-authored-by: ruiminhu <[email protected]>
Co-authored-by: Shenglong Li <[email protected]>
Co-authored-by: Wendy Chang <[email protected]>
Co-authored-by: rewongmicrosoft <[email protected]>
Co-authored-by: Harshitha Akkaraju <[email protected]>
Co-authored-by: Harshitha Akkaraju <[email protected]>
Co-authored-by: kangsun-ctrl <[email protected]>
Co-authored-by: Theodore Chang <[email protected]>
Co-authored-by: Oscar Cabrero <[email protected]>
Co-authored-by: scbedd <[email protected]>
Co-authored-by: zedy <[email protected]>
Co-authored-by: allencal <[email protected]>
Co-authored-by: Yilin Hu (MSFT) <[email protected]>
Co-authored-by: hivyas <[email protected]>
Co-authored-by: giakas <[email protected]>
Co-authored-by: James <[email protected]>
Co-authored-by: jschrepp-MSFT <[email protected]>
Co-authored-by: Camilo Ramirez <[email protected]>
Co-authored-by: Camilo Ramirez <[email protected]>
Sandido added a commit that referenced this pull request May 25, 2021
* [FR] Add API version to new methods in 2.1-preview.x (#20817)

* Topic filter sample (#20816)

* Topic filter sample

* Update README.md

* Update README.md

* Fix link

* PR FB

* PR fb

* Update identity to enable live testing in sovereign clouds for multiple services (#19203)

* only identity change

* resolve error

* change hardcode string

* change to supportedclouds

* remove hardcode

* remove change

* remove hardcode

* change to have the default in a common place

* Remove the StartsWith

* Remove the TestEnvironment.KeyvaultScope

* Remove change

* add hardcode string

* Delete TestEnvVar file.

* Remove hardcoded value of KeyvaultScope, add a initial value for it

* Remove invalid changes.

Co-authored-by: Wenjie Yu (Wicresoft North America Ltd) <[email protected]>
Co-authored-by: Tong Xu (Wicresoft North America Ltd) <[email protected]>

* [autorest.csharp] Bump to latest, write transforms to correct 2 swaggers. (#20833)

A recent bump to autorest core broke the autobump script, as two existing sdks refused validation.

This PR does the bump, writes transforms for the short term, and then regenerates code.

These issues are filed to update the swagger and remove the transform.

https://github.com/Azure/azure-sdk/issues/2803 handles this for ACR.
https://github.com/Azure/azure-sdk/issues/2805 handles this for Azure.AI.MetricsAdvisor .

* Pick up updated T2 mgmt generator (#20839)

* Reference correct version (#20844)

* Turn BearerTokenAuthenticationPolicy into BearerTokenChallengeAuthenticationPolicy (#20670)

* expose BearerTokenChallengeAuthenticationPolicy through BearerTokenAuthenticationPolicy

* Update AutoRest C# version to 3.0.0-beta.20210504.2 (#20851)

* Add QueryTimeSpan type (#20841)

Co-authored-by: Jesse Squire <[email protected]>

* add comments to properties (#20849)

* Temporary remove the NetworkTimeout (#20860)

* [TSI] Readme for samples (#20765)

* Regenerated from an updated 2020-03-01 swagger that removed faulty property validation (#20862)

* Updated TPM attestation APIs to remove BinaryData parameters. (#20843)

* Updated TPM attestation APIs at the request of the TPM attestation team

* [Event Hubs Client] Move Partition Initialization to the Background (#20733)

The focus of these changes is to o refactor partition initialization into
the background task responsible for processing the partition. Because
failures would still be surfaced through the error handler mechanism and
the flow for recovering would follow the existing partition processing failure,
there should be no change to usage patterns nor visible behavioral changes.

* Update ConfidentialLedger CI path (#20868)

* [FR] Flatten TextSyle in TextAppearance (#20857)

* redesing for TextAppearance

* changelog

* updated readme and changelog for may release (#20871)

* updated readme and changelog for may release

* user version number 1.0.1 for the hot bug fixes

* Update samples to use #if SNIPPET (#20847)

* Update samples to use #if SNIPPET

* Fix docs

* [Event Hubs Processor] Validate at Startup (#20861)

The focus of these changes is to introduce validation for configuration
and permissions errors that would prevent an event processor from being
able to recover without intervention.  For example, an incorrect connection
string or the inability to write to the storage container would be detected.

Validation is performed in an unobtrusive way intended to avoid delaying
the processor's ability to begin taking ownership of partitions while ensuring
that host applications are made aware of fatal problems within the scope of
the Start call, rather than having to rely on the error handler.

Also included in these changes is retiring of the ListCheckpointsAsync
implementation, which was deprecated in favor of GetCheckpointAsync previously.

* Update AutoRest C# version (#20869)

* [ACR] Cache Refresh Token (#20753)

* cache work

* WIP

* WIP

* first e2e impl

* renames and comment tidy for clarity

* update to expiry and force refresh condition

* tests pass

* removing printfs

* re-record tests to accomodate cached token

* fix live tests to run in CI

* work in progress

* index on acr-cache-refresh-token: f906f3b587 work in progress

* update tests

* get expiry time from jwt

* pr fb

* make work with new base class PR

* sanitize all but the expiration time in refresh_token in the recorded test logs

* record tokens that don't expire + extra comments

* pr fb

* Initial Confidential Ledger generated client (#20865)

* initial Confidential Ledger client

* [TSI] Address internal feedback for samples and readme (#20878)

* Regenerate SDK for new Swagger File, to remove 400 as expected response (#20806)

* Regenerate SDK for new Swagger File, to remove 400 as expected response

* Bumping up SDK version to 1.0.0-beta.2

Co-authored-by: Aditi Malladi <[email protected]>

* [Event Hubs Client] Test Configuration Adjustments (#20888)

The focus of these changes is to adjust the clouds used for nightly and
manual test runs, reverting to the Public and Canary clouds.  Weekly runs
will include the UsGov and China sovereign clouds as well.   After discussion,
this aligns with the configuration that the engineering team intended.

Due to the China cloud performing slowly during runs, we've seen some tests
start to exceed the previous execution time cap; this cap has been increased
to reduce flakiness in weekly runs.  I'll continue to monitor and adjust as we
learn more about test stability and performance in the sovereign clouds.

* Prepare Azure.Core release (#20885)

* [TSI] Address Managed Team API Review comments (#20879)

* Rename (#20890)

* update changelongs for release (#20891)

* update changelongs for release

* update codeowners

* [TSI] Clarify where a variant type came from (#20894)

* Create SUPPORT.md for .NET repo (#20848)

* [Event Hubs Processor] Incorporate Validation Feedback (#20884)

The focus of these changes is to incorporate some feedback overlooked in
the initial validation pull request (#20861).

* improve docstrings (#20881)

* Add public API spell check to Analyze job (#20088)

* Add cspell to Analyze

* Forward slashes

* Add spellchecking public APIs to aggregate-reports

* Add public api spell checking to formrecognizer and aggregate reports pipeline (aggregate reports uses continueOnError: true)

* Add spelling exception for ZhHant (a language specification)

* Remove empty pwsh step for spellcheck

* Simplify checking for npx command

Co-authored-by: Heath Stewart <[email protected]>

* Readd negative

* Add cspell.json to exceptions, add comments to word list

Co-authored-by: Heath Stewart <[email protected]>

* Samples for labeled tables (#20840)

* Samples for labeled tables

* too excited renaming

* Update sdk/formrecognizer/Azure.AI.FormRecognizer/README.md

Co-authored-by: Krista Pratico <[email protected]>

* selection mark

Co-authored-by: Krista Pratico <[email protected]>

* Revert changes to SetDevVersion. (#20900)

Co-authored-by: Mitch Denny <[email protected]>

* Back out SetDevVersion changes. (#20899)

* Add source generator for system event mapping/constants (#20873)

* Add source generator for system event mapping/constants

* PR FB

* PR FB

* Missing files

* docsettings

* remove code

* Fix build

* changelog

* More fixing

* Use correct property

* DocSettings

* Comment out assert in test (#20876)

* Comment out assert in test

* Update test

* Increment version for core releases (#20903)

Increment package version after release of Azure.Core.Experimental

* Remove APICompat from released packages (#20886)

* Extend Check Enforcer timeout (#20875)

Extend the timeout that Check Enforcer applies when waiting for a pipeline to start.

* Increment version for eventhub releases (#20893)

* Increment package version after release of Microsoft.Azure.EventHubs.Processor

* Increment package version after release of Microsoft.Azure.EventHubs

* Support modifying feature flag filter parameters (#20866)

* Prepare releases of extensions packages and AppConfig (#20887)

* Add a JsonPath sanitization callback (#20892)

* Update Azure.Core and Experimental (#20915)

* tests (#20896)

* update the version in the .csproj file to 1.0.1, fix formatting in changelog (#20898)

* update the version in the .csproj file to 1.0.1, fix formatting in changelog

* add ApiCompatVersion back

* Remove Azure.Core.props (#20917)

* [Service Bus] Populate TransportType (#20920)

The focus of these changes is to populate the `TransportType` property
on the `ServiceBusClient` at construction.  Previously, the requested
`TransportType` was honored but was nor correctly reflected in the
property.

* [Messaging Function Extension] README Updates (#20924)

The focus of these changes is to correct an error in the configuration
examples for Event Hubs and to include additional information about the permission
grants needed when using  managed identity.

* Upgrade MSAL and MSAL extesion library dependencies to latest (#20922)

* Upgrade MSAL and MSAL extesion library dependencies to latest

* exclude x-ms-PKeyAuth from record matching

* SDK update for TemplateSpecs GA API 2021-05-01 (#20846)

* Preparing for Storage STG 77 beta (#20812)

* Cleaned up breaking change description (#20929)

* Add spell check for changed files (#20822)

* Add spell check for changed files

* task -> template

* Add exceptions

* Add better error handling in Prepare-Release (#20933)

Co-authored-by: Wes Haggard <[email protected]>

* Increment version for attestation releases (#20932)

Increment package version after release of Azure.Security.Attestation

* Fix build warnings (#20921)

* Confidential Ledger samples (#20930)

* Samples

* CL samples (#20943)

* introduce header name constant

* Enable anonymous access for ACR (#20919)

* initial commit

* backup test-resources.json

* work in progress

* small cleanup

* more tidy

* add tests

* update API and re-record tests

* Prepare for 11.3.0-beta.2 release for Search (#20948)

* Update 11.3.0-beta.2 release date for Search

* Add period at the end of sentence

* [synapse] Add changelog for release (#20867)

* [synapse] Add changelog for release

* Add line ref for https://github.com/Azure/azure-sdk-for-net/issues/20051

* [Event Hubs] May Release Preparation (#20944)

The focus of these changes is to prepare the core Event Hubs package
for the May release and update changelogs for the core and processor
packages.

* regenerating recoveryservices-backup C# SDK for swagger spec V2021-03 (#20827)

* generating C# code for V2021-03

* updating file with new SDK version, adding new API version to RP.props

* updating test settings with the new API-version

* updated the encodedHttpRequestUri with the new API version

* updating ListOperations api version for mocking

* resetting vault API versions

* adding unescaped url to the mock records

* adding mock record with unescaped uri for getOperationResults

* corrected the status code and added location header in the mocks

Co-authored-by: Chandrika Gonuguntla <[email protected]>

* [Communication] - SDK - Renamed EVs to consolidated set (#20925)

* Prepare for EG release (#20956)

* [Communication] Update the repeatabilityFirstSent timestamp to correct format (#20959)

* Update the repeatabilityFirstSent timestamp to correct format

* Fix formatting

Co-authored-by: Minnie Liu <[email protected]>

* Add KV extension RBAC info (#20952)

Co-authored-by: Heath Stewart <[email protected]>

* ACR Beta2 Changelog updates (#20966)

* beta2 changelog

* update changelog

* more updates

* Increment version for eventhub releases (#20975)

Increment package version after release of Azure.Messaging.EventHubs

* Increment version for tables releases (#20977)

Increment package version after release of Azure.Data.Tables

* [Event Hubs Processor] May Release Preparation (#20976)

The focus of these changes is to prepare the processor package for the
May milestone release.

* Increment version for eventhub releases (#20978)

Increment package version after release of Azure.Messaging.EventHubs.Processor

* Increment version for synapse releases (#20983)

Increment package version after release of Azure.Analytics.Synapse.Artifacts

* Increment version for search releases (#20980)

Increment package version after release of Azure.Search.Documents

* Setup INT live tests (#20906)

Setup .net live tests pipeline for INT.

Add 'INT' configuration in 'subscription configuration'
Disable SMS tests and phone number update capability tests in INT because INT does not support SMS yet. Control by EV COMMUNICATION_SKIP_SMS_TEST (false in Prod, true in INT)
Disable phone number search test in INT for now since there is no Toll Free number in INT. Control by EV COMMUNICATION_SKIP_PHONENUMBERS_TEST (false in Prod, true in INT)

* [MetricsAdvisor] Renamed all TopCount occurrences to MaxPageSize (#20626)

* Don't log task canceled exceptions as errors when stopping processor. (#20940)

* Don't log task canceled exceptions as errors when stopping processor.

Don't log service timeout exceptions as errors when accepting sessions in processor.

* Update webjobs test to validate no errors are logged from SDK.

* PR FB

* More formatting

* Change default timeout to prevent flakiness

* PR FB

* Update AutoRest C# version (#20928)

* Update AutoRest C# version to 3.0.0-beta.20210510.2

* Add newly needed Azure.Core.Experimental ref

* Export new API

Co-authored-by: Chris Hamons <[email protected]>

* Update CHANGELOG.md with change info (#20988)

# All SDK Contribution checklist:

This checklist is used to make sure that common guidelines for a pull request are followed.
- [ ] **Please open PR in `Draft` mode if it is:**
	- Work in progress or not intended to be merged.
	- Encountering multiple pipeline failures and working on fixes.
- [ ] If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.
- [ ] **I have read the [contribution guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md).**
- [ ] **The pull request does not introduce [breaking changes](https://github.com/dotnet/corefx/blob/master/Documentation/coding-guidelines/breaking-change-rules.md).**

### [General Guidelines and Best Practices](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#general-guidelines)
- [ ] Title of the pull request is clear and informative.
- [ ] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, [see this page](https://github.com/Azure/azure-powershell/blob/master/documentation/development-docs/cleaning-up-commits.md).

### [Testing Guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#testing-guidelines)
- [ ] Pull request includes test coverage for the included changes.

### [SDK Generation Guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#sdk-generation-guidelines)
- [ ] The generate.cmd file for the SDK has been updated with the version of AutoRest, as well as the commitid of your swagger spec or link to the swagger spec, used to generate the code. (Track 2 only)
- [ ] The `*.csproj` and `AssemblyInfo.cs` files have been updated with the new version of the SDK. Please double check nuget.org current release version.

## Additional management plane SDK specific contribution checklist: 
Note: Only applies to `Microsoft.Azure.Management.[RP]` or `Azure.ResourceManager.[RP]`
 
- [ ] Include updated [management metadata](https://github.com/Azure/azure-sdk-for-net/tree/master/eng/mgmt/mgmtmetadata).
- [ ] Update AzureRP.props to add/remove version info to maintain up to date API versions.

### Management plane SDK Troubleshooting
- If this is very first SDK for a services and you are adding new service folders directly under /SDK, please add `new service` label and/or contact assigned reviewer.
- If the check fails at the `Verify Code Generation` step, please ensure:
	- Do not modify any code in generated folders.
	- Do not selectively include/remove generated files in the PR.
	- Do use `generate.ps1/cmd` to generate this PR instead of calling `autorest` directly.
	Please pay attention to the @microsoft.csharp version output after running `generate.ps1`. If it is lower than current released version (2.3.82), please run it again as it should pull down the latest version.
	
	**Note: We have recently updated the PSH module called by `generate.ps1` to emit additional data. This would help reduce/eliminate the Code Verification check error. Please run following command**:

	    `dotnet msbuild eng/mgmt.proj /t:Util /p:UtilityName=InstallPsModules`

### Old outstanding PR cleanup
 Please note:
	If PRs (including draft) has been out for more than 60 days and there are no responses from our query or followups, they will be closed to maintain a concise list for our reviewers.

* Increment version for confidentialledger releases (#20987)

Increment package version after release of Azure.Storage.ConfidentialLedger

* SQL V5 SDK Release (#20267)

* Adding generated models

* Add Usage model

* Fix Threat Detection tests for release .SDK v5 (#1)

* FIX TESTS WITH SDK VERSION 5

* small fixes

* records of threat detection tests

* Update ImportExport SDK to use newer Import method which is on DatabasesOperations and rerecorded tests (#3)

* Fixed all tests

* Add missing files

* Fix TDE and Usage tests

* Remove TDE test

* Remove TDE api

* Fixed build failures

* Remove unwanted sql_resource-manager.txt file

* Revert autorest.md file

* Add missing discrepancies

* Fix build errors

* Fix git diff

* Fix build error

* Update versions in csproj and assemblyinfo

Co-authored-by: ayeletshpigelman <[email protected]>
Co-authored-by: brandong-ms <[email protected]>

* [MetricsAdvisor] Renamed SkipCount to Skip (#20990)

* Update Event Grid version (#21004)

* Remove UseLegacyPowerShell (#20986)

* Remove UseLegacyPowerShell option

* Prepare Key Vault 4.2-beta release (#20901)

* Make the query batch a simpler model (#21009)

* [Communication] - Divide live test pipeline for each SDK (#20902)

* Divide live test pipeline

* Divide live test pipeline

* Fix pipeline

* Adding eng pipeline changes

* Fix pipeline

* Fix ci pipeline

* Fix ci pipeline

* Fix ci pipeline

* Adding separate yaml files

* Setting template as absolute path

* Fix path

* Fix path

* Fix path

* Fix default value

* Revert tests.yml

Co-authored-by: Minnie Liu <[email protected]>

* [FR] Move to 2.1 GA (#20967)

* oficially move to 2.1 GA

* add 3.1.0 to readme

* [TA] Targets service version 3.1-preview.5  (#20994)

* generation + build + tests + disable healthcare

* update public api with new version

* Added new api version 2021-02-01 in Az networking (#20989)

* Added mew api version 2021-02-01 in Az networking

* Added new api version details

* Reverted version to 20.5.0 instead of 20.6.0

* Increment version for keyvault releases (#21015)

* Increment package version after release of Azure.Security.KeyVault.Administration

* Increment package version after release of Azure.Security.KeyVault.Keys

* Increment package version after release of Azure.Security.KeyVault.Certificates

* Increment package version after release of Azure.Security.KeyVault.Secrets

* Increment version for communication releases (#21012)

Increment package version after release of Azure.Communication.Chat

* Increment version for extensions releases (#21007)

Increment package version after release of Microsoft.Extensions.Azure

* Increment version for eventgrid releases (#21002)

Increment package version after release of Azure.Messaging.EventGrid

* Increment version for objectanchors releases (#20999)

Increment package version after release of Azure.MixedReality.ObjectAnchors.Conversion

* Increment version for containerregistry releases (#20998)

Increment package version after release of Azure.Containers.ContainerRegistry

* [LLC] Add draft of 'protocol method' help text (#20951)

* Adding support for new storage serviceUri configurations (#19647)

* Adding support for new storage extensions configurations

* remove local artifact building

* Adding Configuration tests for Blob and Queue extensions

* fixing queue config tests

* [CODEOWNERS] WebPubSub (#21003)

The focus of these changes is to add the WebPubSub client library and
Functions extension into CODEOWNERS.   Also included is an update to
the Event Hubs service team ownership.

* [Smoke Tests] May Release Version Bumps (#21006)

Bumping smoke test reference versions to account for the May releases.

* Prepare for release (#21022)

* Dispose non buffered content streams (#20985)

* Prepared Storage for release (#21013)

* set version to 3.1.0 (#21029)

* Sync eng/common directory with azure-sdk-tools for PR 1594 (#20958)

* Update sparse checkout create directory step name

* plumb BaseBranchName to create pull request

Co-authored-by: Ben Broderick Phillips <[email protected]>

* Unify Key Vault Administration APIs (#20968)

* Rename operation classes and .models namespace
* Change order of role definition methods
* Use commit 1e2c9f3e for Administration package
* Create CreateOrUpdateRoleDefinitionOptions
* Rename KeyVaultRoleAssignmentPropertiesWithScope
* Enable backup and restore sample
* Updated custom role definition tests
* Rename to KeyVaultSelectiveKeyRestoreOperation and Result

* Update Changelog for 1.4.0 GA release (#21030)

* Update Changelog for 1.4.0 GA release

* changed back Tables api version from 2020-10 to 2020-08 (#20936)

* Increment version for storage releases (#21034)

* Increment package version after release of Azure.Storage.Blobs.Batch

* Increment package version after release of Azure.Storage.Common

* Increment package version after release of Azure.Storage.Blobs

* Increment package version after release of Azure.Storage.Files.DataLake

* Increment package version after release of Azure.Storage.Blobs.ChangeFeed

* Increment package version after release of Azure.Storage.Queues

* Increment package version after release of Azure.Storage.Files.Shares

* Make Azure.Core cspell-clean (#21027)

* [Communication] - Clean up communication pipeline parameters (#21033)

* Clean up communication pipeline parameters

* Remove tests.yml

Co-authored-by: Minnie Liu <[email protected]>

* Increment version for identity releases (#21037)

Increment package version after release of Azure.Identity

* [TSI] - Address comments from SDK Board API review (#20962)

* Rename EV (#21036)

* Remove note on v4 for Microsoft.Azure.ServiceBus as v5 is already out (#21041)

This PR updates the text in the migration guide for Service Bus to avoid using version number on Microsoft.Azure.ServiceBus as newer version of the same is already out.

Apologies, the rest of the changes are from my formatter.

* [MetricsAdvisor] Updated test hook ID (#21039)

* [TA] Add parameter DisableServiceLogs (#21028)

* [Purview] Regenerate Catalog Client (#21008)

* [Purview Catalog] Regenerate Based on Arch Board Feedback

* [Purview Catalog] Reduce number of top level clients

* [Purview] Snap Catalog to latest Swagger

* [Purview Catalog] Update README.md and CHANGELOG.md

* [Purview Scanning] Update README.md and CHANGELOG.md (#21014)

* Update service bus dependency (#21044)

* [MetricsAdvisor] Added Value and ExpectedValue properties (#20995)

* Increment package version after release of Azure.Messaging.ServiceBus (#21043)

* Increment version for eventgrid releases (#21052)

Increment package version after release of Microsoft.Azure.WebJobs.Extensions.EventGrid

* test changes for #13552 and #13578 (#21057)

* Increment version for purview releases (#21049)

Increment package version after release of Azure.Analytics.Purview.Scanning

* Update owners (#20692)

* Update owners

For Log Analytics and Application Insights - new team members

* Update CODEOWNERS

Change danhadari74 to danhadari - He updated his user

* Add StorageClientProvider support to EventHubs extension (#21047)

* Fix AppendPath locic for escaped strings (#21061)

* Fix AppendPath logic for escaped strings

* Adding SDK for Microsoft.DataProtection (#20683)

* adding dataprotection service

* changes for sdk generated file

* updating swagger sdk with stable version

* refactoring naming

* adding dummy test

* fixing vault creation

* policy json changes

* updating remove flatten sdk

* fixing policy cases

* create BI added

* changes fore removing friendly name

* added backup and restore

* added other operations tests

* changes for new generate powershell sdk

* changes for updated sdk

* safejsonconvert changes

* changes for adding operation status in mock

* changes

* recording json

* resolving pr comments

Co-authored-by: Mayank Aggarwal <[email protected]>

* [Storage] Upgrade API version to 2021-04-01 (#20939)

* [synapse] Bump to fc5e2fbcfc3f585d38bdb1c513ce1ad2c570cf3d for hotfix (#21062)

* generated new sdk and change test case (#20720)

* generated new and change test case

* Modified csproj file and assembly file

* fixed wording

* [Resources] Regenerate from API version 2021-01-01 and 2021-04-01 (#20643)

* Regenerate from 2021-01-01

* Re-record deployment and What-If tests

* Re-record policy tests

* Re-record provider tests

* Re-record resource group tests

* Re-record resource tests

* Re-record tags tests

* Re-record template spec tests

* Update versions and AzureApiTag

* Update assembly file version

* Update template spec tests

* Update generate.ps1

* Restore managementgroups tests

* Add release notes for 2021-01-01

* Add customizations to mitigate breaking changes

* generate 2021-04-01 SDK

* fix and rerun tests

* merge conflict

* rerun template specs tests with latest API version

* update assembly version and rerun tests

* remove launchSettings file

* Fix signatures of custom constructors

Co-authored-by: Wendy Chang <[email protected]>

* Remove analyzer suppressions (#21050)

* Remove analyzer suppressions

* Fix client creation

* API update (not really but the file changed)

* Remove receiver from MessageProcessor constructor (#21054)

* [syanpse] Update CHANGELOG (#21064)

# All SDK Contribution checklist:

This checklist is used to make sure that common guidelines for a pull request are followed.
- [ ] **Please open PR in `Draft` mode if it is:**
	- Work in progress or not intended to be merged.
	- Encountering multiple pipeline failures and working on fixes.
- [ ] If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.
- [ ] **I have read the [contribution guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md).**
- [ ] **The pull request does not introduce [breaking changes](https://github.com/dotnet/corefx/blob/master/Documentation/coding-guidelines/breaking-change-rules.md).**

### [General Guidelines and Best Practices](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#general-guidelines)
- [ ] Title of the pull request is clear and informative.
- [ ] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, [see this page](https://github.com/Azure/azure-powershell/blob/master/documentation/development-docs/cleaning-up-commits.md).

### [Testing Guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#testing-guidelines)
- [ ] Pull request includes test coverage for the included changes.

### [SDK Generation Guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#sdk-generation-guidelines)
- [ ] The generate.cmd file for the SDK has been updated with the version of AutoRest, as well as the commitid of your swagger spec or link to the swagger spec, used to generate the code. (Track 2 only)
- [ ] The `*.csproj` and `AssemblyInfo.cs` files have been updated with the new version of the SDK. Please double check nuget.org current release version.

## Additional management plane SDK specific contribution checklist: 
Note: Only applies to `Microsoft.Azure.Management.[RP]` or `Azure.ResourceManager.[RP]`
 
- [ ] Include updated [management metadata](https://github.com/Azure/azure-sdk-for-net/tree/master/eng/mgmt/mgmtmetadata).
- [ ] Update AzureRP.props to add/remove version info to maintain up to date API versions.

### Management plane SDK Troubleshooting
- If this is very first SDK for a services and you are adding new service folders directly under /SDK, please add `new service` label and/or contact assigned reviewer.
- If the check fails at the `Verify Code Generation` step, please ensure:
	- Do not modify any code in generated folders.
	- Do not selectively include/remove generated files in the PR.
	- Do use `generate.ps1/cmd` to generate this PR instead of calling `autorest` directly.
	Please pay attention to the @microsoft.csharp version output after running `generate.ps1`. If it is lower than current released version (2.3.82), please run it again as it should pull down the latest version.
	
	**Note: We have recently updated the PSH module called by `generate.ps1` to emit additional data. This would help reduce/eliminate the Code Verification check error. Please run following command**:

	    `dotnet msbuild eng/mgmt.proj /t:Util /p:UtilityName=InstallPsModules`

### Old outstanding PR cleanup
 Please note:
	If PRs (including draft) has been out for more than 60 days and there are no responses from our query or followups, they will be closed to maintain a concise list for our reviewers.

* [CODEOWNERS] Remove Wildcards in Messaging (#21060)

The focus of these changes is to remove the wildcard paths from the
Messaging SDKs to try and allow more targeted alerting for the
Azure Functions extensions.

* Take Core reference (#21067)

* Prepare for release (#21051)

* Prepare for release

* Update sdk/servicebus/Microsoft.Azure.WebJobs.Extensions.ServiceBus/CHANGELOG.md

Co-authored-by: Jesse Squire <[email protected]>

* Breaking changes

Co-authored-by: Jesse Squire <[email protected]>

* Add INT testing in sdk pipelines (#21068)

* Add INT testing in sdk pipelines

* Add Ignore SMS test check back

* Ledger Digest Upload SDK (#21021)

* adding ledger changes

* all generated changes

* adding ledger changes

* all generated changes

* generated files updates

* adding tests, new generated files from databases

* updating recorded tests for ledger

* renaming file path

* adding ListByServerWithHttpMessagesAsync to database operations customizations to fix breaking change

* fixing newline spacing

* upating based on most recent generation

* adding sql_resource-manager.txt file

* final updates to ListByServerWithHttpMessagesAsync interface and caller

* Microsoft.StoragePool New Service SDK (#21040)

* Initial commit

* Fixing build errors

Co-authored-by: Harshitha Akkaraju <[email protected]>

* Update gallery example, use 'Reset' rather than 'ResetToPrivate' (#20907)

* save the auto-generation work

* add gallery application version update auto-generation

* nit, add new line

* update record json

* update record json and add new tests for caps gallery with sharing profile and shared gallery

* save work for gallery with sharing profile, caps side test

* update blob as source code

* uncheck shared gallery test which can not run right now

* save

* save

* add shared gallery tests

* generate files again

* Revert "generate files again"

This reverts commit 051be5469e1ceece14c9bd386de7a54607ce05c2.

* update gallery

* revert unnecessary change

* update examples

* Cplat gallery build (#20407)

* Creating nuget package for blob as source (#20127)

* save the auto-generation work

* add gallery application version update auto-generation

* nit, add new line

* update record json

* update record json and add new tests for caps gallery with sharing profile and shared gallery

* save work for gallery with sharing profile, caps side test

* update blob as source code

* uncheck shared gallery test which can not run right now

* save

* save

* add shared gallery tests

* generate files again

* Revert "generate files again"

This reverts commit 051be5469e1ceece14c9bd386de7a54607ce05c2.

* update gallery

* revert unnecessary change

* update examples

* Update Microsoft.Azure.Management.Compute.csproj

Co-authored-by: kangsun-ctrl <[email protected]>

* Update AssemblyInfo.cs

* Update Microsoft.Azure.Management.Compute.csproj

* nit

* Update Microsoft.Azure.Management.Compute.csproj

* Update AssemblyInfo.cs

* Create AssemblyInfo.cs

* commit

* update, address comments

* update

* update test

Co-authored-by: Theodore Chang <[email protected]>

* Use column types for GetObject calls (#21071)

* [Core] Improve OperationHelpers used by our LROs (#19105)

* Prepare extensions release (#21077)

* [Communication] - SMS - Repeatability accepted check for SMS tests (#21063)

* Repeatability accepted check for SMS tests

* Fix ci build failure

Co-authored-by: Minnie Liu <[email protected]>

* Update SubscriptionProperties.cs (#21081)

the error description for MaxDeliveryCount returns incorrectr property name

* allow multiple invocations of archetype-sdk-tests-generate (#21080)

Co-authored-by: scbedd <[email protected]>

* Update keyvault to enable live testing in sovereign clouds for multiple services (#20345)

* Update keyvault to enable live testing in sovereign clouds for multiple services

* resolve the conflict

* Update the CloudConfig vaule.

* Remove Preview from the Clouds list.

* remove HSM tests

* change Clouds to SupportedClouds

Co-authored-by: Wenjie Yu (Wicresoft North America Ltd) <[email protected]>

* SDK changes for TrafficManager API 2018-08-01 (#20905)

* [ACR] Implementation of API Updates for Beta 3 (#21078)

* updates from new swagger file for Beta3 API

* separate out ArtifactManifestReference type

* update autorest.md

* re-record repository tests

* missed rename

* update generated API listing

* Update IoT Hub control plane to new version (#21072)

* Increment version for extensions releases (#21086)

* Increment package version after release of Azure.Extensions.AspNetCore.DataProtection.Blobs

* Increment package version after release of Azure.Extensions.AspNetCore.DataProtection.Keys

* Increment package version after release of Azure.Extensions.AspNetCore.Configuration.Secrets

* [MetricsAdvisor] Re-enabled GetHooksAsync sample (#21091)

* [MetricsAdvisor] Whitelisted redacted headers for logging (#21093)

* enable healthcare again and updating pii tests (#21108)

* update readme issue (#21103)

* update readme issue (#21104)

* [MetricsAdvisor] Removed HttpRequest and Elasticsearch data sources (#21095)

* [Media] AVA SDK Addition (#20700)

* regenerated and renamed to pipeline terminology

* name update

* fixing pr check errors

* added public swagger

* reverting old sdk

* restoring old sdk

* updating readme

* cleaning up old terminology

* addressing PR comments

* addressing PR comments

* fixes for PR checks:

* pr comments

* updating connectionstring

* exported new api file

* updating edge module version

* Increment version for synapse releases (#21111)

Increment package version after release of Azure.Analytics.Synapse.Artifacts

* Use explicit service version (#20770)

* Pass service version explicitly to search client options

* Initial Checkin for AVA Management SDK (#21070)

* Initial Checkin for AVA Management SDK

* rerun autorest with rename

* regenerate with checked in swaggers

* let's see (#21116)

* Blobs migration additions (#20965)

* blob metadata section

* Test new migration samples

* sample link fix

* pr feedback

Co-authored-by: jschrepp-MSFT <[email protected]>

* Added support for message metadata. (#21097)

Co-authored-by: Camilo Ramirez <[email protected]>

* Update AVA Management SDK to use beta instead of preview in version (#21122)

* Update AMS Management SDK to use beta instead of preview

* Update csproj to use beta instead of preview

* add more to changelog (#21110)

* add more to changelog

* [TA] Implement new Analyze sentiment in Analyze endpoint (#21109)

* Make AzureKeyVaultConfigurationProvider case insensitive again (#21141)

* Updates for ACR Beta 3 (#21123)

* flattening writable properties

* correct build

* make writeable properties writeable

* API updates per consistency

* make created on and last updated on required

* add registry field back to model types

* update registry name to registry login server name

* follow-up

* add constructors to property types

* bug fix

* missed API removal

* regen API and some whitespace nits

* Update sdk/containerregistry/Azure.Containers.ContainerRegistry/src/Models/RepositoryProperties.cs

Co-authored-by: Christopher Scott <[email protected]>

* Update sdk/containerregistry/Azure.Containers.ContainerRegistry/src/Models/RepositoryProperties.cs

Co-authored-by: Christopher Scott <[email protected]>

* pr fb

Co-authored-by: Christopher Scott <[email protected]>

* Add endpoint parameter to LogsClient and MetricsClient (#21073)

* Increment version for extensions releases (#21146)

Increment package version after release of Azure.Extensions.AspNetCore.Configuration.Secrets

* Make MetricUnit an extensible enum, use DateTimeRange in MetricQueryResult (#21145)

* add release date (#21147)

* Storage Extension release prep. (#21151)

* prep webjobs release.

* sample config.

* Increment version for textanalytics releases (#21154)

Increment package version after release of Azure.AI.TextAnalytics

* remove hardcoded latest (#21159)

* update new swagger (#21158)

* Increment version for eventhub releases (#21152)

Increment package version after release of Microsoft.Azure.WebJobs.Extensions.EventHubs

* [TA] Rename analyze to remove batch from the name (#21134)

* rename analyze to remove batch

* add changelog

* Resource Identity fixes for SQL Server (#21136)

* Resource Identity fixes for SQL Server

* Modified assemblyinfo and csproj

* Increment version for storage releases (#21168)

Increment package version after release of Microsoft.Azure.WebJobs.Extensions.Storage.Blobs

* Increment version for storage releases (#21169)

Increment package version after release of Microsoft.Azure.WebJobs.Extensions.Storage.Queues

* Merge from master and merge Disk and Gallery test changes that were previously released (#21167)

* Add CloudEvent binding (#20698)

* Add CloudEvent binding

* Clean up tests and add explicit exception if an unknown type is bound in output binding.

* [Storage] Prep hotfix release. (#20705)

* changelog + version.

* fix compile error.

* recordings.

* Temporarily replace macOS CI tests with ubuntu CI tests (#20198)

* Revert "Temporarily remove macOS from test matrix (#20194)"

This reverts commit b16aec8f6c935b6fee3e63937f660dd0fbf05c1b.

* Temporarily replace macOS CI tests with ubuntu CI tests

* Increment version for storage releases (#20709)

Increment package version after release of Azure.Storage.Blobs

* Update SnippetGenerator to be async (#20708)

* Update NUnit (#20707)

* [Communication] - TNM - Update TNM version after release (#20675)

* Update TNM version after release

* Resolve merge conflicts

Co-authored-by: Minnie Liu <[email protected]>

* Fix Up Delinquent Changelogs (#20026)

* Changelog test

* Fixup sdk\cognitiveservices\Knowledge.QnAMaker\CHANGELOG.md

* Fixup delinquent CHANGELOG.mds

* Remove unneeded Changes

* [MetricsAdvisor] Doubled maximum number of retries in tests (#20653)

* improve exception message (#20722)

* [Storage] Sas version in test continued (#20725)

* this should work..

* let's keep it inactive first.

* Include SubQueue option for Processor (#20719)

* Include SubQueue option for Processor

* Remove duplicate line

* Update prepare-release docs

* Bumped SAS version (#20726)

* Parse MD files coming over http as raw markdown files (#20728)

This will allow us to point our verify-link script at a raw
MD file in a github repo and have it parsed correctly for
links.

Co-authored-by: Wes Haggard <[email protected]>

* Add new key vault variable for phone number (#20729)

Co-authored-by: Minnie Liu <[email protected]>

* [TSI] Query client library optimizations and improvements (#20673)

* Update AutoRest C# version (#20446)

* Update AutoRest C# version to 3.0.0-beta.20210426.2

* update manual lro implementations to use the new internals

* Update AutoRest C# version to 3.0.0-beta.20210428.2

Co-authored-by: m-nash <[email protected]>

* Web PubSub function bindings sdk. (#20459)

* Init version for Web PubSub function bindings

* fix warns and dependencies.

* fix styling check.

* fix typo in readme and minor update.

* remove deploy files.

* fix and resolve comments

* add changelog.

* fix bug

* refactor and resolve some comments.

* resolve a few comments

* resolve comments.

* add generated api.

* Add package description and update changelog

* update readme.

* update authenticate part

* minor improve description.

* remove snippet.

* Sync eng/common directory with azure-sdk-tools for PR 1572 (#20742)

* Update prepare pipelines template.

* Update prepare-pipelines as well.

* Remove default line.

Co-authored-by: Mitch Denny <[email protected]>

* Set multiple sparse checkout paths in one command/job (#20730)

Co-authored-by: Ben Broderick Phillips <[email protected]>

* Add basic multi-version support to FR (#20693)

* Add basic multi-version support to FR

* enable multi-api testing with mostly 2.1p3

Co-authored-by: Mariana Rios Flores <[email protected]>

* [TSI] Bring sample changes to master (#20755)

* Revisions from the MAA API Review (#20558)

Significant revisions to the API surface to reflect API review comments.

Co-authored-by: Jesse Squire <[email protected]>

* [Communication] - SMS - Re-enabling Unauthorized Number SMS Test (#20642)

* Re-enabling Unauthorized Number SMS Test

* Update recordings

Co-authored-by: Minnie Liu <[email protected]>

* Readme and xmlk docs for Azure.Monitor.Query (#20731)

* Add DLQ sample (#20739)

* Add DLQ sample

* Fix broken links

* PR FB

* Prepare Attestation SDK for GA release (#20760)

* Search indexer knowledge store (#20691)

* Update to rest spec version d95c18e2
Introduce SearchIndexerKnowledgeStore

* Add tests for KnowledgeStore in skillsets

* Update sample in markdown

* Fix code that sanitizes storage account key from session records

* Adjust metric APIs and add tests (#20756)

* [TSI] Query Samples (#20744)

* Refactor batch to a pure model (#20723)

* refactor batch

* Sync Devops helper scripts from azure-sdk repo (#20763)

DevOps helper scripts were updated in azure-sdk repo
so syncing those changes into the tools repo so they
can be used prepare-release script.

Co-authored-by: Wes Haggard <[email protected]>

* Renamed ModelFactory methods to align with guidelines. (#20767)

* Renamed ModelFactory methods to align with Azure naming guidelines.

* Remove net5.0 from TestFramework explicit TargetFrameworks list (#20771)

* [Event Hubs Processor] Stop attempting to steal inappropriately (#20775)

The focus of these changes is to fix a bug in which load balancing
incorrectly identifies a need to attempt to steal a partition (even from
itself) and then fails to find an eligible candidate partition after running
unnecessary logic.  This manifests only as a log message for host applications,
as partitions were never actually stolen.

* add multivariate test sample (#20517)

* add multivariate test sample

* add multivariate in README

* add md file for multivariate detect

* fix

* Add broken links to ingore-links.txt

* add snippet

* align snippet name in md and cs file;
skip line after main method

* update after snippet generation and code generation

* remove trailing whitespace;
correct links

* remove the added ignore links for anomaly detector

Co-authored-by: Shivangi Reja <[email protected]>

* Use sample snippets for WPS (#20780)

* [Service Bus Client] README Link Fix (#20776)

The focus of these changes is to fix the "Source code" link in the README
to reference the correct location.

* uncomment nuget and docs links (#20782)

* Allow null value for PatternTokenizer["flags"] (#20789)

When there are no Flags set, we should pass null to the service

* separate endpoints into test classes and apply api-version to class (#20757)

* Pass default value (1) of query count to service if it is not set explicitly (#20790)

Update tests to validate change in behavior

* [Communication] - ALL - Add subscription configuration to tests.yml (#20781)

* Adding Subscription Configurations to tests.yml

* Fix formatting

* Updating tset-resources.json

* Fix formatting

* Fix indent

* Add extra line

* Revert test-resources.json

* Change back test-resources.json

* Change back test-resources.json

* Cleanup test-resources

* Adressed review comments

* Fix pipeline

Co-authored-by: Minnie Liu <[email protected]>

* Respect webproxy from config (#20743)

* Respect webproxy from config

* PR FB

* Rename to ClientRetryOptions for consistency with EH

* Fix test

* Fix test

* PR FB

* Export API

* Update dependency

* Update reference

* Use ToString for URI

* Revert ToString

* Fix JSON deserialization issue

* Remove unused code

* Sync eng/common directory with azure-sdk-tools for PR 1579 (#20740)

* Allow propogation of SetDevVersion.

* Allow use of SetDevVersion locally and across stages.

Co-authored-by: Mitch Denny <[email protected]>

* Propogate SetDevVersion.

* Added ContentType Extensible Enum (#20768)

* Added ContentType Extensible Enum

* Update sdk/core/Azure.Core.Experimental/src/ContentType.cs

Co-authored-by: Pavel Krymets <[email protected]>

* Updated API file

Co-authored-by: Pavel Krymets <[email protected]>

* recognizeContentTests (#20794)

* Sync eng/common directory with azure-sdk-tools for PR 1524 (#20769)

* Make RELEASE_TITLE_REGEX more specific

* Update eng/common/scripts/ChangeLog-Operations.ps1

Co-authored-by: Wes Haggard <[email protected]>

* Update release REGEX

* tighten up changelog verification

* Ensure releaseDate is in the appriopriate format.

* Update error messages.

* Retrun false after error

Co-authored-by: Chidozie Ononiwu <[email protected]>
Co-authored-by: Chidozie Ononiwu <[email protected]>
Co-authored-by: Wes Haggard <[email protected]>

* SDK Tests for Cosmos DB API Version 2021-04-15 (#20699)

* Regenerate Microsoft.Maintenance from API version 2021-05-01. (#20732)

Co-authored-by: Kalpesh Chavan <[email protected]>

* rename id and ID for identity (#20805)

* [Purview] Azure.Data -> Azure.Analytics (#20796)

After discussion, we would prefer to use `Analytics` instead of `Data`
for our group name.

* [Communication] - TNM - Modifying Update  Capabilities Phone number tests (#20761)

* Modifying Update  Capabilities Phone number tests

* Rerun pipeline

Co-authored-by: Minnie Liu <[email protected]>

* Fix sample readme (#20810)

* Fix sample readme

* Update README.md

* Made quick query parquet internal (#20759)

* Fix Test (#20791)

* [TSI] Renaming and hiding types (#20773)

* Decrease polling frequency for Key Vault tests (#20772)

Resolves #20735. Also fixes some slow Certificates mock tests.

* enable custom forms multi-version (#20795)

* make sure doctype is the same as what we shipped in 3.0 for v2.0 (#20785)

* [FR] Rename ReadingOrder to FormReadingOrder (#20813)

* [Purview] Design Refactor for Scanning (#20811)

Based on feedback with the C# architects, we've made some changes to
the class factoring here and renamed some methods. The goal was to try
to reduce the number of clients we have and clean up some naming
issues.

* Fix broken CODEOWNERS entry

* Remove subscription id since it is not needed in test-resources.json (#20797)

* Remove subscription id since it is not needed in test-resources.json

* Renames, Delete swallows 404s, Add StringFormatter overloads to Query methods (#20786)

* renames
* catch 404s
* string format overloads for Query methods

* Confidential Ledger CI (#20829)

* CI only

* Standardize on repositoryName parameter name in ContainerRegistryClient methods (#20832)

* fix #20831

* update API listing

* Remove lock token remarks from settlement method docs (#20826)

* Remove lock token remarks from settlement method docs

* Remove references to LinkCloseMode.

* [FR] Add API version to new methods in 2.1-preview.x (#20817)

* Topic filter sample (#20816)

* Topic filter sample

* Update README.md

* Update README.md

* Fix link

* PR FB

* PR fb

* Update identity to enable live testing in sovereign clouds for multiple services (#19203)

* only identity change

* resolve error

* change hardcode string

* change to supportedclouds

* remove hardcode

* remove change

* remove hardcode

* change to have the default in a common place

* Remove the StartsWith

* Remove the TestEnvironment.KeyvaultScope

* Remove change

* add hardcode string

* Delete TestEnvVar file.

* Remove hardcoded value of KeyvaultScope, add a initial value for it

* Remove invalid changes.

Co-authored-by: Wenjie Yu (Wicresoft North America Ltd) <[email protected]>
Co-authored-by: Tong Xu (Wicresoft North America Ltd) <[email protected]>

* [autorest.csharp] Bump to latest, write transforms to correct 2 swaggers. (#20833)

A recent bump to autorest core broke the autobump script, as two existing sdks refused validation.

This PR does the bump, writes transforms for the short term, and then regenerates code.

These issues are filed to update the swagger and remove the transform.

https://github.com/Azure/azure-sdk/issues/2803 handles this for ACR.
https://github.com/Azure/azure-sdk/issues/2805 handles this for Azure.AI.MetricsAdvisor .

* Pick up updated T2 mgmt generator (#20839)

* Reference correct version (#20844)

* Turn BearerTokenAuthenticationPolicy into BearerTokenChallengeAuthenticationPolicy (#20670)

* expose BearerTokenChallengeAuthenticationPolicy through BearerTokenAuthenticationPolicy

* Update AutoRest C# version to 3.0.0-beta.20210504.2 (#20851)

* Add QueryTimeSpan type (#20841)

Co-authored-by: Jesse Squire <[email protected]>

* add comments to properties (#20849)

* Temporary remove the NetworkTimeout (#20860)

* [TSI] Readme for samples (#20765)

* Regenerated from an updated 2020-03-01 swagger that removed faulty property validation (#20862)

* Updated TPM attestation APIs to remove BinaryData parameters. (#20843)

* Updated TPM attestation APIs at the request of the TPM attestation team

* [Event Hubs Client] Move Partition Initialization to the Background (#20733)

The focus of these changes is to o refactor partition initialization into
the background task responsible for processing the partition. Because
failures would still be surfaced through the error handler mechanism and
the flow for recovering would follow the existing partition processing failure,
there should be no change to usage patterns nor visible behavioral changes.

* Update ConfidentialLedger CI path (#20868)

* [FR] Flatten TextSyle in TextAppearance (#20857)

* redesing for TextAppearance

* changelog

* updated readme and changelog for may release (#20871)

* updated readme and changelog for may release

* user version number 1.0.1 for the hot bug fixes

* Update samples to use #if SNIPPET (#20847)

* Update samples to use #if SNIPPET

* Fix docs

* [Event Hubs Processor] Validate at Startup (#20861)

The focus of these changes is to introduce validation for configuration
and permissions errors that would prevent an event processor from being
able to recover without intervention.  For example, an incorrect connection
string or the inability to write to the storage container would be detected.

Validation is performed in an unobtrusive way intended to avoid delaying
the processor's ability to begin taking ownership of partitions while ensuring
that host applications are made aware of fatal problems within the scope of
the Start call, rather than having to rely on the error handler.

Also included in these changes is retiring of the ListCheckpointsAsync
implementation, which was deprecated in favor of GetCheckpointAsync previously.

* Update AutoRest C# version (#20869)

* [ACR] Cache Refresh Token (#20753)

* cache work

* WIP

* WIP

* first e2e impl

* renames and comment tidy for clarity

* update to expiry and force refresh condition

* tests pass

* removing printfs

* re-record tests to accomodate cached token

* fix live tests to run in CI

* work in progress

* index on acr-cache-refresh-token: f906f3b587 work in progress

* update tests

* get expiry time from jwt

* pr fb

* make work with new base class PR

* sanitize all but the expiration time in refresh_token in the recorded test logs

* record tokens that don't expire + extra comments

* pr fb

* Initial Confidential Ledger generated client (#20865)

* initial Confidential Ledger client

* [TSI] Address internal feedback for samples and readme (#20878)

* Regenerate SDK for new Swagger File, to remove 400 as expected response (#20806)

* Regenerate SDK for new Swagger File, to remove 400 as expected response

* Bumping up SDK version to 1.0.0-beta.2

Co-authored-by: Aditi Malladi <[email protected]>

* [Event Hubs Client] Test Configuration Adjustments (#20888)

The focus of these changes is to adjust the clouds used for nightly and
manual test runs, reverting to the Public and Canary clouds.  Weekly runs
will include the UsGov and China sovereign clouds as well.   After discussion,
this aligns with the configuration that the engineering team intended.

Due to the China cloud performing slowly during runs, we've seen some tests
start to exceed the previous execution time cap; this cap has been increased
to reduce flakiness in weekly runs.  I'll continue to monitor and adjust as we
learn more about test stability and performance in the sovereign clouds.

* Prepare Azure.Core release (#20885)

* [TSI] Address Managed Team API Review comments (#20879)

* Rename (#20890)

* update changelongs for release (#20891)

* update changelongs for release

* update codeowners

* [TSI] Clarify where a variant type came from (#20894)

* Create SUPPORT.md for .NET repo (#20848)

* [Event Hubs Processor] Incorporate Validation Feedback (#20884)

The focus of these changes is to incorporate some feedback overlooked in
the initial validation pull request (#20861).

* improve docstrings (#20881)

* Add public API spell check to Analyze job (#20088)

* Add cspell to Analyze

* Forward slashes

* Add spellchecking public APIs to aggregate-reports

* Add public api spell checking to formrecognizer and aggregate reports pipeline (aggregate reports uses continueOnError: true)

* Add spelling exception for ZhHant (a language specification)

* Remove empty pwsh step for spellcheck

* Simplify checking for npx command

Co-authored-by: Heath Stewart <[email protected]>

* Readd negative

* Add cspell.json to exceptions, add comments to word list

Co-authored-by: Heath Stewart <[email protected]>

* Samples for labeled tables (#20840)

* Samples for labeled tables

* too excited renaming

* Update sdk/formrecognizer/Azure.AI.FormRecognizer/README.md

Co-authored-by: Krista Pratico <[email protected]>

* selection mark

Co-authored-by: Krista Pratico <[email protected]>

* Revert changes to SetDevVersion. (#20900)

Co-authored-by: Mitch Denny <[email protected]>

* Back out SetDevVersion changes. (#20899)

* Add source generator for system event mapping/constants (#20873)

* Add source generator for system event mapping/constants

* PR FB

* PR FB

* Missing files

* docsettings

* remove code

* Fix build

* changelog

* More fixing

* Use correct property

* DocSettings

* Comment out assert in test (#20876)

* Comment out assert in test

* Update test

* Increment version for core releases (#20903)

Increment package version after release of Azure.Core.Experimental

* Remove APICompat from released packages (#20886)

* Extend Check Enforcer timeout (#20875)

Extend the timeout that Check Enforcer applies when waiting for a pipeline to start.

* Increment version for eventhub releases (#20893)

* Increment package version after release of Microsoft.Azure.EventHubs.Processor

* Increment package version after release of Microsoft.Azure.EventHubs

* Support modifying feature flag filter parameters (#20866)

* Prepare releases of extensions packages and AppConfig (#20887)

* Add a JsonPath sanitization callback (#20892)

* Update Azure.Core and Experimental (#20915)

* tests (#20896)

* update the version in the .csproj file to 1.0.1, fix formatting in changelog (#20898)

* update the version in the .csproj file to 1.0.1, fix formatting in changelog

* add ApiCompatVersion back

* Remove Azure.Core.props (#20917)

* [Service Bus] Populate TransportType (#20920)

The focus of these changes is to populate the `TransportType` property
on the `ServiceBusClient` at construction.  Previously, the requested
`TransportType` was honored but was nor correctly reflected in the
property.

* [Messaging Function Extension] README Updates (#20924)

The focus of these changes is to correct an error in the configuration
examples for Event Hubs and to include additional information about the permission
grants needed when using  managed identity.

* Upgrade MSAL and MSAL extesion library dependencies to latest (#20922)

* Upgrade MSAL and MSAL extesion library dependencies to latest

* exclude x-ms-PKeyAuth from record matching

* SDK update for TemplateSpecs GA API 2021-05-01 (#20846)

* Preparing for Storage STG 77 beta (#20812)

* Cleaned up breaking change description (#20929)

* Add spell check for changed files (#20822)

* Add spell check for changed files

* task -> template

* Add exceptions

* Add better error handling in Prepare-Release (#20933)

Co-authored-by: Wes Haggard <[email protected]>

* Increment version for attestation releases (#20932)

Increment package version after release of Azure.Security.Attestation

* Fix build warnings (#20921)

* Confidential Ledger samples (#20930)

* Samples

* CL samples (#20943)

* introduce header name constant

* Enable anonymous access for ACR (#20919)

* initial commit

* backup test-resources.json

* work in progress

* small cleanup

* more tidy

* add tests

* update API and re-record tests

* Prepare for 11.3.0-beta.2 release for Search (#20948)

* Update 11.3.0-beta.2 release date for Search

* Add period at the end of sentence

* [synapse] Add changelog for release (#20867)

* [synapse] Add changelog for release

* Add line ref for https://github.com/Azure/azure-sdk-for-net/issues/20051

* [Event Hubs] May Release Preparation (#20944)

The focus of these changes is to prepare the core Event Hubs package
for the May release and update changelogs for the core and processor
packages.

* regenerating recoveryservices-backup C# SDK for swagger spec V2021-03 (#20827)

* generating C# code for V2021-03

* updating file with new SDK version, adding new API version to RP.props

* updating test settings with the new API-version

* updated the encodedHttpRequestUri with the new API version

* updating ListOperations api version for mocking

* resetting vault API versions

* adding unescaped url to the mock records

* adding mock record with unescaped uri for getOperationResults

* corrected the status code and added location header in the mocks

Co-authored-by: Chandrika Gonuguntla <[email protected]>

* [Communication] - SDK - Renamed EVs to consolidated set (#20925)

* Prepare for EG release (#20956)

* [Communication] Update the repeatabilityFirstSent timestamp to correct format (#20959)

* Update the repeatabilityFirstSent timestamp to correct format

* Fix formatting

Co-authored-by: Minnie Liu <[email protected]>

* Add KV extension RBAC info (#20952)

Co-authored-by: Heath Stewart <[email protected]>

* ACR Beta2 Changelog updates (#20966)

* beta2 changelog

* update changelog

* more updates

* Increment version for eventhub releases (#20975)

Increment package version after release of Azure.Messaging.EventHubs

* Increment version for tables releases (#20977)

Increment package version after release of Azure.Data.Tables

* [Event Hubs Processor] May Release Preparation (#20976)

The focus of these changes is to prepare the processor package for the
May milestone release.

* Increment version for eventhub releases (#20978)

Increment package version after release of Azure.Messaging.EventHubs.Processor

* Increment version for synapse releases (#20983)

Increment package version after release of Azure.Analytics.Synapse.Artifacts

* Increment version for search releases (#20980)

Increment package version after release of Azure.Search.Documents

* Setup INT live tests (#20906)

Setup .net live tests pipeline for INT.

Add 'INT' configuration in 'subscription configuration'
Disable SMS tests and phone number update capability tests in INT because INT does not support SMS yet. Control by EV COMMUNICATION_SKIP_SMS_TEST (false in Prod, true in INT)
Disable phone number search test in INT for now since there is no Toll Free number in INT. Control by EV COMMUNICATION_SKIP_PHONENUMBERS_TEST (false in Prod, true in INT)

* [MetricsAdvisor] Renamed all TopCount occurrences to MaxPageSize (#20626)

* Don't log task canceled exceptions as errors when stopping processor. (#20940)

* Don't log task canceled exceptions as errors when stopping processor.

Don't log service timeout exceptions as errors when accepting sessions in processor.

* Update webjobs test to validate no errors are logged from SDK.

* PR FB

* More formatting

* Change default timeout to prevent flakiness

* PR FB

* Update AutoRest C# version (#20928)

* Update AutoRest C# version to 3.0.0-beta.20210510.2

* Add newly needed Azure.Core.Experimental ref

* Export new API

Co-authored-by: Chris Hamons <[email protected]>

* Update CHANGELOG.md with change info (#20988)

# All SDK Contribution checklist:

This checklist is used to make sure that common guidelines for a pull request are followed.
- [ ] **Please open PR in `Draft` mode if it is:**
	- Work in progress or not intended to be merged.
	- Encountering multiple pipeline failures and working on fixes.
- […
markcowl pushed a commit that referenced this pull request Jun 3, 2021
* api reference updates

* test recording updates

* trustedLaunch update

* Merge from master, update tests, generated code for 2021-03-01 (#21336)

* [FR] Add API version to new methods in 2.1-preview.x (#20817)

* Topic filter sample (#20816)

* Topic filter sample

* Update README.md

* Update README.md

* Fix link

* PR FB

* PR fb

* Update identity to enable live testing in sovereign clouds for multiple services (#19203)

* only identity change

* resolve error

* change hardcode string

* change to supportedclouds

* remove hardcode

* remove change

* remove hardcode

* change to have the default in a common place

* Remove the StartsWith

* Remove the TestEnvironment.KeyvaultScope

* Remove change

* add hardcode string

* Delete TestEnvVar file.

* Remove hardcoded value of KeyvaultScope, add a initial value for it

* Remove invalid changes.

Co-authored-by: Wenjie Yu (Wicresoft North America Ltd) <[email protected]>
Co-authored-by: Tong Xu (Wicresoft North America Ltd) <[email protected]>

* [autorest.csharp] Bump to latest, write transforms to correct 2 swaggers. (#20833)

A recent bump to autorest core broke the autobump script, as two existing sdks refused validation.

This PR does the bump, writes transforms for the short term, and then regenerates code.

These issues are filed to update the swagger and remove the transform.

https://github.com/Azure/azure-sdk/issues/2803 handles this for ACR.
https://github.com/Azure/azure-sdk/issues/2805 handles this for Azure.AI.MetricsAdvisor .

* Pick up updated T2 mgmt generator (#20839)

* Reference correct version (#20844)

* Turn BearerTokenAuthenticationPolicy into BearerTokenChallengeAuthenticationPolicy (#20670)

* expose BearerTokenChallengeAuthenticationPolicy through BearerTokenAuthenticationPolicy

* Update AutoRest C# version to 3.0.0-beta.20210504.2 (#20851)

* Add QueryTimeSpan type (#20841)

Co-authored-by: Jesse Squire <[email protected]>

* add comments to properties (#20849)

* Temporary remove the NetworkTimeout (#20860)

* [TSI] Readme for samples (#20765)

* Regenerated from an updated 2020-03-01 swagger that removed faulty property validation (#20862)

* Updated TPM attestation APIs to remove BinaryData parameters. (#20843)

* Updated TPM attestation APIs at the request of the TPM attestation team

* [Event Hubs Client] Move Partition Initialization to the Background (#20733)

The focus of these changes is to o refactor partition initialization into
the background task responsible for processing the partition. Because
failures would still be surfaced through the error handler mechanism and
the flow for recovering would follow the existing partition processing failure,
there should be no change to usage patterns nor visible behavioral changes.

* Update ConfidentialLedger CI path (#20868)

* [FR] Flatten TextSyle in TextAppearance (#20857)

* redesing for TextAppearance

* changelog

* updated readme and changelog for may release (#20871)

* updated readme and changelog for may release

* user version number 1.0.1 for the hot bug fixes

* Update samples to use #if SNIPPET (#20847)

* Update samples to use #if SNIPPET

* Fix docs

* [Event Hubs Processor] Validate at Startup (#20861)

The focus of these changes is to introduce validation for configuration
and permissions errors that would prevent an event processor from being
able to recover without intervention.  For example, an incorrect connection
string or the inability to write to the storage container would be detected.

Validation is performed in an unobtrusive way intended to avoid delaying
the processor's ability to begin taking ownership of partitions while ensuring
that host applications are made aware of fatal problems within the scope of
the Start call, rather than having to rely on the error handler.

Also included in these changes is retiring of the ListCheckpointsAsync
implementation, which was deprecated in favor of GetCheckpointAsync previously.

* Update AutoRest C# version (#20869)

* [ACR] Cache Refresh Token (#20753)

* cache work

* WIP

* WIP

* first e2e impl

* renames and comment tidy for clarity

* update to expiry and force refresh condition

* tests pass

* removing printfs

* re-record tests to accomodate cached token

* fix live tests to run in CI

* work in progress

* index on acr-cache-refresh-token: f906f3b587 work in progress

* update tests

* get expiry time from jwt

* pr fb

* make work with new base class PR

* sanitize all but the expiration time in refresh_token in the recorded test logs

* record tokens that don't expire + extra comments

* pr fb

* Initial Confidential Ledger generated client (#20865)

* initial Confidential Ledger client

* [TSI] Address internal feedback for samples and readme (#20878)

* Regenerate SDK for new Swagger File, to remove 400 as expected response (#20806)

* Regenerate SDK for new Swagger File, to remove 400 as expected response

* Bumping up SDK version to 1.0.0-beta.2

Co-authored-by: Aditi Malladi <[email protected]>

* [Event Hubs Client] Test Configuration Adjustments (#20888)

The focus of these changes is to adjust the clouds used for nightly and
manual test runs, reverting to the Public and Canary clouds.  Weekly runs
will include the UsGov and China sovereign clouds as well.   After discussion,
this aligns with the configuration that the engineering team intended.

Due to the China cloud performing slowly during runs, we've seen some tests
start to exceed the previous execution time cap; this cap has been increased
to reduce flakiness in weekly runs.  I'll continue to monitor and adjust as we
learn more about test stability and performance in the sovereign clouds.

* Prepare Azure.Core release (#20885)

* [TSI] Address Managed Team API Review comments (#20879)

* Rename (#20890)

* update changelongs for release (#20891)

* update changelongs for release

* update codeowners

* [TSI] Clarify where a variant type came from (#20894)

* Create SUPPORT.md for .NET repo (#20848)

* [Event Hubs Processor] Incorporate Validation Feedback (#20884)

The focus of these changes is to incorporate some feedback overlooked in
the initial validation pull request (#20861).

* improve docstrings (#20881)

* Add public API spell check to Analyze job (#20088)

* Add cspell to Analyze

* Forward slashes

* Add spellchecking public APIs to aggregate-reports

* Add public api spell checking to formrecognizer and aggregate reports pipeline (aggregate reports uses continueOnError: true)

* Add spelling exception for ZhHant (a language specification)

* Remove empty pwsh step for spellcheck

* Simplify checking for npx command

Co-authored-by: Heath Stewart <[email protected]>

* Readd negative

* Add cspell.json to exceptions, add comments to word list

Co-authored-by: Heath Stewart <[email protected]>

* Samples for labeled tables (#20840)

* Samples for labeled tables

* too excited renaming

* Update sdk/formrecognizer/Azure.AI.FormRecognizer/README.md

Co-authored-by: Krista Pratico <[email protected]>

* selection mark

Co-authored-by: Krista Pratico <[email protected]>

* Revert changes to SetDevVersion. (#20900)

Co-authored-by: Mitch Denny <[email protected]>

* Back out SetDevVersion changes. (#20899)

* Add source generator for system event mapping/constants (#20873)

* Add source generator for system event mapping/constants

* PR FB

* PR FB

* Missing files

* docsettings

* remove code

* Fix build

* changelog

* More fixing

* Use correct property

* DocSettings

* Comment out assert in test (#20876)

* Comment out assert in test

* Update test

* Increment version for core releases (#20903)

Increment package version after release of Azure.Core.Experimental

* Remove APICompat from released packages (#20886)

* Extend Check Enforcer timeout (#20875)

Extend the timeout that Check Enforcer applies when waiting for a pipeline to start.

* Increment version for eventhub releases (#20893)

* Increment package version after release of Microsoft.Azure.EventHubs.Processor

* Increment package version after release of Microsoft.Azure.EventHubs

* Support modifying feature flag filter parameters (#20866)

* Prepare releases of extensions packages and AppConfig (#20887)

* Add a JsonPath sanitization callback (#20892)

* Update Azure.Core and Experimental (#20915)

* tests (#20896)

* update the version in the .csproj file to 1.0.1, fix formatting in changelog (#20898)

* update the version in the .csproj file to 1.0.1, fix formatting in changelog

* add ApiCompatVersion back

* Remove Azure.Core.props (#20917)

* [Service Bus] Populate TransportType (#20920)

The focus of these changes is to populate the `TransportType` property
on the `ServiceBusClient` at construction.  Previously, the requested
`TransportType` was honored but was nor correctly reflected in the
property.

* [Messaging Function Extension] README Updates (#20924)

The focus of these changes is to correct an error in the configuration
examples for Event Hubs and to include additional information about the permission
grants needed when using  managed identity.

* Upgrade MSAL and MSAL extesion library dependencies to latest (#20922)

* Upgrade MSAL and MSAL extesion library dependencies to latest

* exclude x-ms-PKeyAuth from record matching

* SDK update for TemplateSpecs GA API 2021-05-01 (#20846)

* Preparing for Storage STG 77 beta (#20812)

* Cleaned up breaking change description (#20929)

* Add spell check for changed files (#20822)

* Add spell check for changed files

* task -> template

* Add exceptions

* Add better error handling in Prepare-Release (#20933)

Co-authored-by: Wes Haggard <[email protected]>

* Increment version for attestation releases (#20932)

Increment package version after release of Azure.Security.Attestation

* Fix build warnings (#20921)

* Confidential Ledger samples (#20930)

* Samples

* CL samples (#20943)

* introduce header name constant

* Enable anonymous access for ACR (#20919)

* initial commit

* backup test-resources.json

* work in progress

* small cleanup

* more tidy

* add tests

* update API and re-record tests

* Prepare for 11.3.0-beta.2 release for Search (#20948)

* Update 11.3.0-beta.2 release date for Search

* Add period at the end of sentence

* [synapse] Add changelog for release (#20867)

* [synapse] Add changelog for release

* Add line ref for https://github.com/Azure/azure-sdk-for-net/issues/20051

* [Event Hubs] May Release Preparation (#20944)

The focus of these changes is to prepare the core Event Hubs package
for the May release and update changelogs for the core and processor
packages.

* regenerating recoveryservices-backup C# SDK for swagger spec V2021-03 (#20827)

* generating C# code for V2021-03

* updating file with new SDK version, adding new API version to RP.props

* updating test settings with the new API-version

* updated the encodedHttpRequestUri with the new API version

* updating ListOperations api version for mocking

* resetting vault API versions

* adding unescaped url to the mock records

* adding mock record with unescaped uri for getOperationResults

* corrected the status code and added location header in the mocks

Co-authored-by: Chandrika Gonuguntla <[email protected]>

* [Communication] - SDK - Renamed EVs to consolidated set (#20925)

* Prepare for EG release (#20956)

* [Communication] Update the repeatabilityFirstSent timestamp to correct format (#20959)

* Update the repeatabilityFirstSent timestamp to correct format

* Fix formatting

Co-authored-by: Minnie Liu <[email protected]>

* Add KV extension RBAC info (#20952)

Co-authored-by: Heath Stewart <[email protected]>

* ACR Beta2 Changelog updates (#20966)

* beta2 changelog

* update changelog

* more updates

* Increment version for eventhub releases (#20975)

Increment package version after release of Azure.Messaging.EventHubs

* Increment version for tables releases (#20977)

Increment package version after release of Azure.Data.Tables

* [Event Hubs Processor] May Release Preparation (#20976)

The focus of these changes is to prepare the processor package for the
May milestone release.

* Increment version for eventhub releases (#20978)

Increment package version after release of Azure.Messaging.EventHubs.Processor

* Increment version for synapse releases (#20983)

Increment package version after release of Azure.Analytics.Synapse.Artifacts

* Increment version for search releases (#20980)

Increment package version after release of Azure.Search.Documents

* Setup INT live tests (#20906)

Setup .net live tests pipeline for INT.

Add 'INT' configuration in 'subscription configuration'
Disable SMS tests and phone number update capability tests in INT because INT does not support SMS yet. Control by EV COMMUNICATION_SKIP_SMS_TEST (false in Prod, true in INT)
Disable phone number search test in INT for now since there is no Toll Free number in INT. Control by EV COMMUNICATION_SKIP_PHONENUMBERS_TEST (false in Prod, true in INT)

* [MetricsAdvisor] Renamed all TopCount occurrences to MaxPageSize (#20626)

* Don't log task canceled exceptions as errors when stopping processor. (#20940)

* Don't log task canceled exceptions as errors when stopping processor.

Don't log service timeout exceptions as errors when accepting sessions in processor.

* Update webjobs test to validate no errors are logged from SDK.

* PR FB

* More formatting

* Change default timeout to prevent flakiness

* PR FB

* Update AutoRest C# version (#20928)

* Update AutoRest C# version to 3.0.0-beta.20210510.2

* Add newly needed Azure.Core.Experimental ref

* Export new API

Co-authored-by: Chris Hamons <[email protected]>

* Update CHANGELOG.md with change info (#20988)

# All SDK Contribution checklist:

This checklist is used to make sure that common guidelines for a pull request are followed.
- [ ] **Please open PR in `Draft` mode if it is:**
	- Work in progress or not intended to be merged.
	- Encountering multiple pipeline failures and working on fixes.
- [ ] If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.
- [ ] **I have read the [contribution guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md).**
- [ ] **The pull request does not introduce [breaking changes](https://github.com/dotnet/corefx/blob/master/Documentation/coding-guidelines/breaking-change-rules.md).**

### [General Guidelines and Best Practices](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#general-guidelines)
- [ ] Title of the pull request is clear and informative.
- [ ] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, [see this page](https://github.com/Azure/azure-powershell/blob/master/documentation/development-docs/cleaning-up-commits.md).

### [Testing Guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#testing-guidelines)
- [ ] Pull request includes test coverage for the included changes.

### [SDK Generation Guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#sdk-generation-guidelines)
- [ ] The generate.cmd file for the SDK has been updated with the version of AutoRest, as well as the commitid of your swagger spec or link to the swagger spec, used to generate the code. (Track 2 only)
- [ ] The `*.csproj` and `AssemblyInfo.cs` files have been updated with the new version of the SDK. Please double check nuget.org current release version.

## Additional management plane SDK specific contribution checklist: 
Note: Only applies to `Microsoft.Azure.Management.[RP]` or `Azure.ResourceManager.[RP]`
 
- [ ] Include updated [management metadata](https://github.com/Azure/azure-sdk-for-net/tree/master/eng/mgmt/mgmtmetadata).
- [ ] Update AzureRP.props to add/remove version info to maintain up to date API versions.

### Management plane SDK Troubleshooting
- If this is very first SDK for a services and you are adding new service folders directly under /SDK, please add `new service` label and/or contact assigned reviewer.
- If the check fails at the `Verify Code Generation` step, please ensure:
	- Do not modify any code in generated folders.
	- Do not selectively include/remove generated files in the PR.
	- Do use `generate.ps1/cmd` to generate this PR instead of calling `autorest` directly.
	Please pay attention to the @microsoft.csharp version output after running `generate.ps1`. If it is lower than current released version (2.3.82), please run it again as it should pull down the latest version.
	
	**Note: We have recently updated the PSH module called by `generate.ps1` to emit additional data. This would help reduce/eliminate the Code Verification check error. Please run following command**:

	    `dotnet msbuild eng/mgmt.proj /t:Util /p:UtilityName=InstallPsModules`

### Old outstanding PR cleanup
 Please note:
	If PRs (including draft) has been out for more than 60 days and there are no responses from our query or followups, they will be closed to maintain a concise list for our reviewers.

* Increment version for confidentialledger releases (#20987)

Increment package version after release of Azure.Storage.ConfidentialLedger

* SQL V5 SDK Release (#20267)

* Adding generated models

* Add Usage model

* Fix Threat Detection tests for release .SDK v5 (#1)

* FIX TESTS WITH SDK VERSION 5

* small fixes

* records of threat detection tests

* Update ImportExport SDK to use newer Import method which is on DatabasesOperations and rerecorded tests (#3)

* Fixed all tests

* Add missing files

* Fix TDE and Usage tests

* Remove TDE test

* Remove TDE api

* Fixed build failures

* Remove unwanted sql_resource-manager.txt file

* Revert autorest.md file

* Add missing discrepancies

* Fix build errors

* Fix git diff

* Fix build error

* Update versions in csproj and assemblyinfo

Co-authored-by: ayeletshpigelman <[email protected]>
Co-authored-by: brandong-ms <[email protected]>

* [MetricsAdvisor] Renamed SkipCount to Skip (#20990)

* Update Event Grid version (#21004)

* Remove UseLegacyPowerShell (#20986)

* Remove UseLegacyPowerShell option

* Prepare Key Vault 4.2-beta release (#20901)

* Make the query batch a simpler model (#21009)

* [Communication] - Divide live test pipeline for each SDK (#20902)

* Divide live test pipeline

* Divide live test pipeline

* Fix pipeline

* Adding eng pipeline changes

* Fix pipeline

* Fix ci pipeline

* Fix ci pipeline

* Fix ci pipeline

* Adding separate yaml files

* Setting template as absolute path

* Fix path

* Fix path

* Fix path

* Fix default value

* Revert tests.yml

Co-authored-by: Minnie Liu <[email protected]>

* [FR] Move to 2.1 GA (#20967)

* oficially move to 2.1 GA

* add 3.1.0 to readme

* [TA] Targets service version 3.1-preview.5  (#20994)

* generation + build + tests + disable healthcare

* update public api with new version

* Added new api version 2021-02-01 in Az networking (#20989)

* Added mew api version 2021-02-01 in Az networking

* Added new api version details

* Reverted version to 20.5.0 instead of 20.6.0

* Increment version for keyvault releases (#21015)

* Increment package version after release of Azure.Security.KeyVault.Administration

* Increment package version after release of Azure.Security.KeyVault.Keys

* Increment package version after release of Azure.Security.KeyVault.Certificates

* Increment package version after release of Azure.Security.KeyVault.Secrets

* Increment version for communication releases (#21012)

Increment package version after release of Azure.Communication.Chat

* Increment version for extensions releases (#21007)

Increment package version after release of Microsoft.Extensions.Azure

* Increment version for eventgrid releases (#21002)

Increment package version after release of Azure.Messaging.EventGrid

* Increment version for objectanchors releases (#20999)

Increment package version after release of Azure.MixedReality.ObjectAnchors.Conversion

* Increment version for containerregistry releases (#20998)

Increment package version after release of Azure.Containers.ContainerRegistry

* [LLC] Add draft of 'protocol method' help text (#20951)

* Adding support for new storage serviceUri configurations (#19647)

* Adding support for new storage extensions configurations

* remove local artifact building

* Adding Configuration tests for Blob and Queue extensions

* fixing queue config tests

* [CODEOWNERS] WebPubSub (#21003)

The focus of these changes is to add the WebPubSub client library and
Functions extension into CODEOWNERS.   Also included is an update to
the Event Hubs service team ownership.

* [Smoke Tests] May Release Version Bumps (#21006)

Bumping smoke test reference versions to account for the May releases.

* Prepare for release (#21022)

* Dispose non buffered content streams (#20985)

* Prepared Storage for release (#21013)

* set version to 3.1.0 (#21029)

* Sync eng/common directory with azure-sdk-tools for PR 1594 (#20958)

* Update sparse checkout create directory step name

* plumb BaseBranchName to create pull request

Co-authored-by: Ben Broderick Phillips <[email protected]>

* Unify Key Vault Administration APIs (#20968)

* Rename operation classes and .models namespace
* Change order of role definition methods
* Use commit 1e2c9f3e for Administration package
* Create CreateOrUpdateRoleDefinitionOptions
* Rename KeyVaultRoleAssignmentPropertiesWithScope
* Enable backup and restore sample
* Updated custom role definition tests
* Rename to KeyVaultSelectiveKeyRestoreOperation and Result

* Update Changelog for 1.4.0 GA release (#21030)

* Update Changelog for 1.4.0 GA release

* changed back Tables api version from 2020-10 to 2020-08 (#20936)

* Increment version for storage releases (#21034)

* Increment package version after release of Azure.Storage.Blobs.Batch

* Increment package version after release of Azure.Storage.Common

* Increment package version after release of Azure.Storage.Blobs

* Increment package version after release of Azure.Storage.Files.DataLake

* Increment package version after release of Azure.Storage.Blobs.ChangeFeed

* Increment package version after release of Azure.Storage.Queues

* Increment package version after release of Azure.Storage.Files.Shares

* Make Azure.Core cspell-clean (#21027)

* [Communication] - Clean up communication pipeline parameters (#21033)

* Clean up communication pipeline parameters

* Remove tests.yml

Co-authored-by: Minnie Liu <[email protected]>

* Increment version for identity releases (#21037)

Increment package version after release of Azure.Identity

* [TSI] - Address comments from SDK Board API review (#20962)

* Rename EV (#21036)

* Remove note on v4 for Microsoft.Azure.ServiceBus as v5 is already out (#21041)

This PR updates the text in the migration guide for Service Bus to avoid using version number on Microsoft.Azure.ServiceBus as newer version of the same is already out.

Apologies, the rest of the changes are from my formatter.

* [MetricsAdvisor] Updated test hook ID (#21039)

* [TA] Add parameter DisableServiceLogs (#21028)

* [Purview] Regenerate Catalog Client (#21008)

* [Purview Catalog] Regenerate Based on Arch Board Feedback

* [Purview Catalog] Reduce number of top level clients

* [Purview] Snap Catalog to latest Swagger

* [Purview Catalog] Update README.md and CHANGELOG.md

* [Purview Scanning] Update README.md and CHANGELOG.md (#21014)

* Update service bus dependency (#21044)

* [MetricsAdvisor] Added Value and ExpectedValue properties (#20995)

* Increment package version after release of Azure.Messaging.ServiceBus (#21043)

* Increment version for eventgrid releases (#21052)

Increment package version after release of Microsoft.Azure.WebJobs.Extensions.EventGrid

* test changes for #13552 and #13578 (#21057)

* Increment version for purview releases (#21049)

Increment package version after release of Azure.Analytics.Purview.Scanning

* Update owners (#20692)

* Update owners

For Log Analytics and Application Insights - new team members

* Update CODEOWNERS

Change danhadari74 to danhadari - He updated his user

* Add StorageClientProvider support to EventHubs extension (#21047)

* Fix AppendPath locic for escaped strings (#21061)

* Fix AppendPath logic for escaped strings

* Adding SDK for Microsoft.DataProtection (#20683)

* adding dataprotection service

* changes for sdk generated file

* updating swagger sdk with stable version

* refactoring naming

* adding dummy test

* fixing vault creation

* policy json changes

* updating remove flatten sdk

* fixing policy cases

* create BI added

* changes fore removing friendly name

* added backup and restore

* added other operations tests

* changes for new generate powershell sdk

* changes for updated sdk

* safejsonconvert changes

* changes for adding operation status in mock

* changes

* recording json

* resolving pr comments

Co-authored-by: Mayank Aggarwal <[email protected]>

* [Storage] Upgrade API version to 2021-04-01 (#20939)

* [synapse] Bump to fc5e2fbcfc3f585d38bdb1c513ce1ad2c570cf3d for hotfix (#21062)

* generated new sdk and change test case (#20720)

* generated new and change test case

* Modified csproj file and assembly file

* fixed wording

* [Resources] Regenerate from API version 2021-01-01 and 2021-04-01 (#20643)

* Regenerate from 2021-01-01

* Re-record deployment and What-If tests

* Re-record policy tests

* Re-record provider tests

* Re-record resource group tests

* Re-record resource tests

* Re-record tags tests

* Re-record template spec tests

* Update versions and AzureApiTag

* Update assembly file version

* Update template spec tests

* Update generate.ps1

* Restore managementgroups tests

* Add release notes for 2021-01-01

* Add customizations to mitigate breaking changes

* generate 2021-04-01 SDK

* fix and rerun tests

* merge conflict

* rerun template specs tests with latest API version

* update assembly version and rerun tests

* remove launchSettings file

* Fix signatures of custom constructors

Co-authored-by: Wendy Chang <[email protected]>

* Remove analyzer suppressions (#21050)

* Remove analyzer suppressions

* Fix client creation

* API update (not really but the file changed)

* Remove receiver from MessageProcessor constructor (#21054)

* [syanpse] Update CHANGELOG (#21064)

# All SDK Contribution checklist:

This checklist is used to make sure that common guidelines for a pull request are followed.
- [ ] **Please open PR in `Draft` mode if it is:**
	- Work in progress or not intended to be merged.
	- Encountering multiple pipeline failures and working on fixes.
- [ ] If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.
- [ ] **I have read the [contribution guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md).**
- [ ] **The pull request does not introduce [breaking changes](https://github.com/dotnet/corefx/blob/master/Documentation/coding-guidelines/breaking-change-rules.md).**

### [General Guidelines and Best Practices](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#general-guidelines)
- [ ] Title of the pull request is clear and informative.
- [ ] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, [see this page](https://github.com/Azure/azure-powershell/blob/master/documentation/development-docs/cleaning-up-commits.md).

### [Testing Guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#testing-guidelines)
- [ ] Pull request includes test coverage for the included changes.

### [SDK Generation Guidelines](https://github.com/Azure/azure-sdk-for-net/blob/master/CONTRIBUTING.md#sdk-generation-guidelines)
- [ ] The generate.cmd file for the SDK has been updated with the version of AutoRest, as well as the commitid of your swagger spec or link to the swagger spec, used to generate the code. (Track 2 only)
- [ ] The `*.csproj` and `AssemblyInfo.cs` files have been updated with the new version of the SDK. Please double check nuget.org current release version.

## Additional management plane SDK specific contribution checklist: 
Note: Only applies to `Microsoft.Azure.Management.[RP]` or `Azure.ResourceManager.[RP]`
 
- [ ] Include updated [management metadata](https://github.com/Azure/azure-sdk-for-net/tree/master/eng/mgmt/mgmtmetadata).
- [ ] Update AzureRP.props to add/remove version info to maintain up to date API versions.

### Management plane SDK Troubleshooting
- If this is very first SDK for a services and you are adding new service folders directly under /SDK, please add `new service` label and/or contact assigned reviewer.
- If the check fails at the `Verify Code Generation` step, please ensure:
	- Do not modify any code in generated folders.
	- Do not selectively include/remove generated files in the PR.
	- Do use `generate.ps1/cmd` to generate this PR instead of calling `autorest` directly.
	Please pay attention to the @microsoft.csharp version output after running `generate.ps1`. If it is lower than current released version (2.3.82), please run it again as it should pull down the latest version.
	
	**Note: We have recently updated the PSH module called by `generate.ps1` to emit additional data. This would help reduce/eliminate the Code Verification check error. Please run following command**:

	    `dotnet msbuild eng/mgmt.proj /t:Util /p:UtilityName=InstallPsModules`

### Old outstanding PR cleanup
 Please note:
	If PRs (including draft) has been out for more than 60 days and there are no responses from our query or followups, they will be closed to maintain a concise list for our reviewers.

* [CODEOWNERS] Remove Wildcards in Messaging (#21060)

The focus of these changes is to remove the wildcard paths from the
Messaging SDKs to try and allow more targeted alerting for the
Azure Functions extensions.

* Take Core reference (#21067)

* Prepare for release (#21051)

* Prepare for release

* Update sdk/servicebus/Microsoft.Azure.WebJobs.Extensions.ServiceBus/CHANGELOG.md

Co-authored-by: Jesse Squire <[email protected]>

* Breaking changes

Co-authored-by: Jesse Squire <[email protected]>

* Add INT testing in sdk pipelines (#21068)

* Add INT testing in sdk pipelines

* Add Ignore SMS test check back

* Ledger Digest Upload SDK (#21021)

* adding ledger changes

* all generated changes

* adding ledger changes

* all generated changes

* generated files updates

* adding tests, new generated files from databases

* updating recorded tests for ledger

* renaming file path

* adding ListByServerWithHttpMessagesAsync to database operations customizations to fix breaking change

* fixing newline spacing

* upating based on most recent generation

* adding sql_resource-manager.txt file

* final updates to ListByServerWithHttpMessagesAsync interface and caller

* Microsoft.StoragePool New Service SDK (#21040)

* Initial commit

* Fixing build errors

Co-authored-by: Harshitha Akkaraju <[email protected]>

* Update gallery example, use 'Reset' rather than 'ResetToPrivate' (#20907)

* save the auto-generation work

* add gallery application version update auto-generation

* nit, add new line

* update record json

* update record json and add new tests for caps gallery with sharing profile and shared gallery

* save work for gallery with sharing profile, caps side test

* update blob as source code

* uncheck shared gallery test which can not run right now

* save

* save

* add shared gallery tests

* generate files again

* Revert "generate files again"

This reverts commit 051be5469e1ceece14c9bd386de7a54607ce05c2.

* update gallery

* revert unnecessary change

* update examples

* Cplat gallery build (#20407)

* Creating nuget package for blob as source (#20127)

* save the auto-generation work

* add gallery application version update auto-generation

* nit, add new line

* update record json

* update record json and add new tests for caps gallery with sharing profile and shared gallery

* save work for gallery with sharing profile, caps side test

* update blob as source code

* uncheck shared gallery test which can not run right now

* save

* save

* add shared gallery tests

* generate files again

* Revert "generate files again"

This reverts commit 051be5469e1ceece14c9bd386de7a54607ce05c2.

* update gallery

* revert unnecessary change

* update examples

* Update Microsoft.Azure.Management.Compute.csproj

Co-authored-by: kangsun-ctrl <[email protected]>

* Update AssemblyInfo.cs

* Update Microsoft.Azure.Management.Compute.csproj

* nit

* Update Microsoft.Azure.Management.Compute.csproj

* Update AssemblyInfo.cs

* Create AssemblyInfo.cs

* commit

* update, address comments

* update

* update test

Co-authored-by: Theodore Chang <[email protected]>

* Use column types for GetObject calls (#21071)

* [Core] Improve OperationHelpers used by our LROs (#19105)

* Prepare extensions release (#21077)

* [Communication] - SMS - Repeatability accepted check for SMS tests (#21063)

* Repeatability accepted check for SMS tests

* Fix ci build failure

Co-authored-by: Minnie Liu <[email protected]>

* Update SubscriptionProperties.cs (#21081)

the error description for MaxDeliveryCount returns incorrectr property name

* allow multiple invocations of archetype-sdk-tests-generate (#21080)

Co-authored-by: scbedd <[email protected]>

* Update keyvault to enable live testing in sovereign clouds for multiple services (#20345)

* Update keyvault to enable live testing in sovereign clouds for multiple services

* resolve the conflict

* Update the CloudConfig vaule.

* Remove Preview from the Clouds list.

* remove HSM tests

* change Clouds to SupportedClouds

Co-authored-by: Wenjie Yu (Wicresoft North America Ltd) <[email protected]>

* SDK changes for TrafficManager API 2018-08-01 (#20905)

* [ACR] Implementation of API Updates for Beta 3 (#21078)

* updates from new swagger file for Beta3 API

* separate out ArtifactManifestReference type

* update autorest.md

* re-record repository tests

* missed rename

* update generated API listing

* Update IoT Hub control plane to new version (#21072)

* Increment version for extensions releases (#21086)

* Increment package version after release of Azure.Extensions.AspNetCore.DataProtection.Blobs

* Increment package version after release of Azure.Extensions.AspNetCore.DataProtection.Keys

* Increment package version after release of Azure.Extensions.AspNetCore.Configuration.Secrets

* [MetricsAdvisor] Re-enabled GetHooksAsync sample (#21091)

* [MetricsAdvisor] Whitelisted redacted headers for logging (#21093)

* enable healthcare again and updating pii tests (#21108)

* update readme issue (#21103)

* update readme issue (#21104)

* [MetricsAdvisor] Removed HttpRequest and Elasticsearch data sources (#21095)

* [Media] AVA SDK Addition (#20700)

* regenerated and renamed to pipeline terminology

* name update

* fixing pr check errors

* added public swagger

* reverting old sdk

* restoring old sdk

* updating readme

* cleaning up old terminology

* addressing PR comments

* addressing PR comments

* fixes for PR checks:

* pr comments

* updating connectionstring

* exported new api file

* updating edge module version

* Increment version for synapse releases (#21111)

Increment package version after release of Azure.Analytics.Synapse.Artifacts

* Use explicit service version (#20770)

* Pass service version explicitly to search client options

* Initial Checkin for AVA Management SDK (#21070)

* Initial Checkin for AVA Management SDK

* rerun autorest with rename

* regenerate with checked in swaggers

* let's see (#21116)

* Blobs migration additions (#20965)

* blob metadata section

* Test new migration samples

* sample link fix

* pr feedback

Co-authored-by: jschrepp-MSFT <[email protected]>

* Added support for message metadata. (#21097)

Co-authored-by: Camilo Ramirez <[email protected]>

* Update AVA Management SDK to use beta instead of preview in version (#21122)

* Update AMS Management SDK to use beta instead of preview

* Update csproj to use beta instead of preview

* add more to changelog (#21110)

* add more to changelog

* [TA] Implement new Analyze sentiment in Analyze endpoint (#21109)

* Make AzureKeyVaultConfigurationProvider case insensitive again (#21141)

* Updates for ACR Beta 3 (#21123)

* flattening writable properties

* correct build

* make writeable properties writeable

* API updates per consistency

* make created on and last updated on required

* add registry field back to model types

* update registry name to registry login server name

* follow-up

* add constructors to property types

* bug fix

* missed API removal

* regen API and some whitespace nits

* Update sdk/containerregistry/Azure.Containers.ContainerRegistry/src/Models/RepositoryProperties.cs

Co-authored-by: Christopher Scott <[email protected]>

* Update sdk/containerregistry/Azure.Containers.ContainerRegistry/src/Models/RepositoryProperties.cs

Co-authored-by: Christopher Scott <[email protected]>

* pr fb

Co-authored-by: Christopher Scott <[email protected]>

* Add endpoint parameter to LogsClient and MetricsClient (#21073)

* Increment version for extensions releases (#21146)

Increment package version after release of Azure.Extensions.AspNetCore.Configuration.Secrets

* Make MetricUnit an extensible enum, use DateTimeRange in MetricQueryResult (#21145)

* add release date (#21147)

* Storage Extension release prep. (#21151)

* prep webjobs release.

* sample config.

* Increment version for textanalytics releases (#21154)

Increment package version after release of Azure.AI.TextAnalytics

* remove hardcoded latest (#21159)

* update new swagger (#21158)

* Increment version for eventhub releases (#21152)

Increment package version after release of Microsoft.Azure.WebJobs.Extensions.EventHubs

* [TA] Rename analyze to remove batch from the name (#21134)

* rename analyze to remove batch

* add changelog

* Resource Identity fixes for SQL Server (#21136)

* Resource Identity fixes for SQL Server

* Modified assemblyinfo and csproj

* Increment version for storage releases (#21168)

Increment package version after release of Microsoft.Azure.WebJobs.Extensions.Storage.Blobs

* Increment version for storage releases (#21169)

Increment package version after release of Microsoft.Azure.WebJobs.Extensions.Storage.Queues

* Merge from master and merge Disk and Gallery test changes that were previously released (#21167)

* Add CloudEvent binding (#20698)

* Add CloudEvent binding

* Clean up tests and add explicit exception if an unknown type is bound in output binding.

* [Storage] Prep hotfix release. (#20705)

* changelog + version.

* fix compile error.

* recordings.

* Temporarily replace macOS CI tests with ubuntu CI tests (#20198)

* Revert "Temporarily remove macOS from test matrix (#20194)"

This reverts commit b16aec8f6c935b6fee3e63937f660dd0fbf05c1b.

* Temporarily replace macOS CI tests with ubuntu CI tests

* Increment version for storage releases (#20709)

Increment package version after release of Azure.Storage.Blobs

* Update SnippetGenerator to be async (#20708)

* Update NUnit (#20707)

* [Communication] - TNM - Update TNM version after release (#20675)

* Update TNM version after release

* Resolve merge conflicts

Co-authored-by: Minnie Liu <[email protected]>

* Fix Up Delinquent Changelogs (#20026)

* Changelog test

* Fixup sdk\cognitiveservices\Knowledge.QnAMaker\CHANGELOG.md

* Fixup delinquent CHANGELOG.mds

* Remove unneeded Changes

* [MetricsAdvisor] Doubled maximum number of retries in tests (#20653)

* improve exception message (#20722)

* [Storage] Sas version in test continued (#20725)

* this should work..

* let's keep it inactive first.

* Include SubQueue option for Processor (#20719)

* Include SubQueue option for Processor

* Remove duplicate line

* Update prepare-release docs

* Bumped SAS version (#20726)

* Parse MD files coming over http as raw markdown files (#20728)

This will allow us to point our verify-link script at a raw
MD file in a github repo and have it parsed correctly for
links.

Co-authored-by: Wes Haggard <[email protected]>

* Add new key vault variable for phone number (#20729)

Co-authored-by: Minnie Liu <[email protected]>

* [TSI] Query client library optimizations and improvements (#20673)

* Update AutoRest C# version (#20446)

* Update AutoRest C# version to 3.0.0-beta.20210426.2

* update manual lro implementations to use the new internals

* Update AutoRest C# version to 3.0.0-beta.20210428.2

Co-authored-by: m-nash <[email protected]>

* Web PubSub function bindings sdk. (#20459)

* Init version for Web PubSub function bindings

* fix warns and dependencies.

* fix styling check.

* fix typo in readme and minor update.

* remove deploy files.

* fix and resolve comments

* add changelog.

* fix bug

* refactor and resolve some comments.

* resolve a few comments

* resolve comments.

* add generated api.

* Add package description and update changelog

* update readme.

* update authenticate part

* minor improve description.

* remove snippet.

* Sync eng/common directory with azure-sdk-tools for PR 1572 (#20742)

* Update prepare pipelines template.

* Update prepare-pipelines as well.

* Remove default line.

Co-authored-by: Mitch Denny <[email protected]>

* Set multiple sparse checkout paths in one command/job (#20730)

Co-authored-by: Ben Broderick Phillips <[email protected]>

* Add basic multi-version support to FR (#20693)

* Add basic multi-version support to FR

* enable multi-api testing with mostly 2.1p3

Co-authored-by: Mariana Rios Flores <[email protected]>

* [TSI] Bring sample changes to master (#20755)

* Revisions from the MAA API Review (#20558)

Significant revisions to the API surface to reflect API review comments.

Co-authored-by: Jesse Squire <[email protected]>

* [Communication] - SMS - Re-enabling Unauthorized Number SMS Test (#20642)

* Re-enabling Unauthorized Number SMS Test

* Update recordings

Co-authored-by: Minnie Liu <[email protected]>

* Readme and xmlk docs for Azure.Monitor.Query (#20731)

* Add DLQ sample (#20739)

* Add DLQ sample

* Fix broken links

* PR FB

* Prepare Attestation SDK for GA release (#20760)

* Search indexer knowledge store (#20691)

* Update to rest spec version d95c18e2
Introduce SearchIndexerKnowledgeStore

* Add tests for KnowledgeStore in skillsets

* Update sample in markdown

* Fix code that sanitizes storage account key from session records

* Adjust metric APIs and add tests (#20756)

* [TSI] Query Samples (#20744)

* Refactor batch to a pure model (#20723)

* refactor batch

* Sync Devops helper scripts from azure-sdk repo (#20763)

DevOps helper scripts were updated in azure-sdk repo
so syncing those changes into the tools repo so they
can be used prepare-release script.

Co-authored-by: Wes Haggard <[email protected]>

* Renamed ModelFactory methods to align with guidelines. (#20767)

* Renamed ModelFactory methods to align with Azure naming guidelines.

* Remove net5.0 from TestFramework explicit TargetFrameworks list (#20771)

* [Event Hubs Processor] Stop attempting to steal inappropriately (#20775)

The focus of these changes is to fix a bug in which load balancing
incorrectly identifies a need to attempt to steal a partition (even from
itself) and then fails to find an eligible candidate partition after running
unnecessary logic.  This manifests only as a log message for host applications,
as partitions were never actually stolen.

* add multivariate test sample (#20517)

* add multivariate test sample

* add multivariate in README

* add md file for multivariate detect

* fix

* Add broken links to ingore-links.txt

* add snippet

* align snippet name in md and cs file;
skip line after main method

* update after snippet generation and code generation

* remove trailing whitespace;
correct links

* remove the added ignore links for anomaly detector

Co-authored-by: Shivangi Reja <[email protected]>

* Use sample snippets for WPS (#20780)

* [Service Bus Client] README Link Fix (#20776)

The focus of these changes is to fix the "Source code" link in the README
to reference the correct location.

* uncomment nuget and docs links (#20782)

* Allow null value for PatternTokenizer["flags"] (#20789)

When there are no Flags set, we should pass null to the service

* separate endpoints into test classes and apply api-version to class (#20757)

* Pass default value (1) of query count to service if it is not set explicitly (#20790)

Update tests to validate change in behavior

* [Communication] - ALL - Add subscription configuration to tests.yml (#20781)

* Adding Subscription Configurations to tests.yml

* Fix formatting

* Updating tset-resources.json

* Fix formatting

* Fix indent

* Add extra line

* Revert test-resources.json

* Change back test-resources.json

* Change back test-resources.json

* Cleanup test-resources

* Adressed review comments

* Fix pipeline

Co-authored-by: Minnie Liu <[email protected]>

* Respect webproxy from config (#20743)

* Respect webproxy from config

* PR FB

* Rename to ClientRetryOptions for consistency with EH

* Fix test

* Fix test

* PR FB

* Export API

* Update dependency

* Update reference

* Use ToString for URI

* Revert ToString

* Fix JSON deserialization issue

* Remove unused code

* Sync eng/common directory with azure-sdk-tools for PR 1579 (#20740)

* Allow propogation of SetDevVersion.

* Allow use of SetDevVersion locally and across stages.

Co-authored-by: Mitch Denny <[email protected]>

* Propogate SetDevVersion.

* Added ContentType Extensible Enum (#20768)

* Added ContentType Extensible Enum

* Update sdk/core/Azure.Core.Experimental/src/ContentType.cs

Co-authored-by: Pavel Krymets <[email protected]>

* Updated API file

Co-authored-by: Pavel Krymets <[email protected]>

* recognizeContentTests (#20794)

* Sync eng/common directory with azure-sdk-tools for PR 1524 (#20769)

* Make RELEASE_TITLE_REGEX more specific

* Update eng/common/scripts/ChangeLog-Operations.ps1

Co-authored-by: Wes Haggard <[email protected]>

* Update release REGEX

* tighten up changelog verification

* Ensure releaseDate is in the appriopriate format.

* Update error messages.

* Retrun false after error

Co-authored-by: Chidozie Ononiwu <[email protected]>
Co-authored-by: Chidozie Ononiwu <[email protected]>
Co-authored-by: Wes Haggard <[email protected]>

* SDK Tests for Cosmos DB API Version 2021-04-15 (#20699)

* Regenerate Microsoft.Maintenance from API version 2021-05-01. (#20732)

Co-authored-by: Kalpesh Chavan <[email protected]>

* rename id and ID for identity (#20805)

* [Purview] Azure.Data -> Azure.Analytics (#20796)

After discussion, we would prefer to use `Analytics` instead of `Data`
for our group name.

* [Communication] - TNM - Modifying Update  Capabilities Phone number tests (#20761)

* Modifying Update  Capabilities Phone number tests

* Rerun pipeline

Co-authored-by: Minnie Liu <[email protected]>

* Fix sample readme (#20810)

* Fix sample readme

* Update README.md

* Made quick query parquet internal (#20759)

* Fix Test (#20791)

* [TSI] Renaming and hiding types (#20773)

* Decrease polling frequency for Key Vault tests (#20772)

Resolves #20735. Also fixes some slow Certificates mock tests.

* enable custom forms multi-version (#20795)

* make sure doctype is the same as what we shipped in 3.0 for v2.0 (#20785)

* [FR] Rename ReadingOrder to FormReadingOrder (#20813)

* [Purview] Design Refactor for Scanning (#20811)

Based on feedback with the C# architects, we've made some changes to
the class factoring here and renamed some methods. The goal was to try
to reduce the number of clients we have and clean up some naming
issues.

* Fix broken CODEOWNERS entry

* Remove subscription id since it is not needed in test-resources.json (#20797)

* Remove subscription id since it is not needed in test-resources.json

* Renames, Delete swallows 404s, Add StringFormatter overloads to Query methods (#20786)

* renames
* catch 404s
* string format overloads for Query methods

* Confidential Ledger CI (#20829)

* CI only

* Standardize on repositoryName parameter name in ContainerRegistryClient methods (#20832)

* fix #20831

* update API listing

* Remove lock token remarks from settlement method docs (#20826)

* Remove lock token remarks from settlement method docs

* Remove references to LinkCloseMode.

* [FR] Add API version to new methods in 2.1-preview.x (#20817)

* Topic filter sample (#20816)

* Topic filter sample

* Update README.md

* Update README.md

* Fix link

* PR FB

* PR fb

* Update identity to enable live testing in sovereign clouds for multiple services (#19203)

* only identity change

* resolve error

* change hardcode string

* change to supportedclouds

* remove hardcode

* remove change

* remove hardcode

* change to have the default in a common place

* Remove the StartsWith

* Remove the TestEnvironment.KeyvaultScope

* Remove change

* add hardcode string

* Delete TestEnvVar file.

* Remove hardcoded value of KeyvaultScope, add a initial value for it

* Remove invalid changes.

Co-authored-by: Wenjie Yu (Wicresoft North America Ltd) <[email protected]>
Co-authored-by: Tong Xu (Wicresoft North America Ltd) <[email protected]>

* [autorest.csharp] Bump to latest, write transforms to correct 2 swaggers. (#20833)

A recent bump to autorest core broke the autobump script, as two existing sdks refused validation.

This PR does the bump, writes transforms for the short term, and then regenerates code.

These issues are filed to update the swagger and remove the transform.

https://github.com/Azure/azure-sdk/issues/2803 handles this for ACR.
https://github.com/Azure/azure-sdk/issues/2805 handles this for Azure.AI.MetricsAdvisor .

* Pick up updated T2 mgmt generator (#20839)

* Reference correct version (#20844)

* Turn BearerTokenAuthenticationPolicy into BearerTokenChallengeAuthenticationPolicy (#20670)

* expose BearerTokenChallengeAuthenticationPolicy through BearerTokenAuthenticationPolicy

* Update AutoRest C# version to 3.0.0-beta.20210504.2 (#20851)

* Add QueryTimeSpan type (#20841)

Co-authored-by: Jesse Squire <[email protected]>

* add comments to properties (#20849)

* Temporary remove the NetworkTimeout (#20860)

* [TSI] Readme for samples (#20765)

* Regenerated from an updated 2020-03-01 swagger that removed faulty property validation (#20862)

* Updated TPM attestation APIs to remove BinaryData parameters. (#20843)

* Updated TPM attestation APIs at the request of the TPM attestation team

* [Event Hubs Client] Move Partition Initialization to the Background (#20733)

The focus of these changes is to o refactor partition initialization into
the background task responsible for processing the partition. Because
failures would still be surfaced through the error handler mechanism and
the flow for recovering would follow the existing partition processing failure,
there should be no change to usage patterns nor visible behavioral changes.

* Update ConfidentialLedger CI path (#20868)

* [FR] Flatten TextSyle in TextAppearance (#20857)

* redesing for TextAppearance

* changelog

* updated readme and changelog for may release (#20871)

* updated readme and changelog for may release

* user version number 1.0.1 for the hot bug fixes

* Update samples to use #if SNIPPET (#20847)

* Update samples to use #if SNIPPET

* Fix docs

* [Event Hubs Processor] Validate at Startup (#20861)

The focus of these changes is to introduce validation for configuration
and permissions errors that would prevent an event processor from being
able to recover without intervention.  For example, an incorrect connection
string or the inability to write to the storage container would be detected.

Validation is performed in an unobtrusive way intended to avoid delaying
the processor's ability to begin taking ownership of partitions while ensuring
that host applications are made aware of fatal problems within the scope of
the Start call, rather than having to rely on the error handler.

Also included in these changes is retiring of the ListCheckpointsAsync
implementation, which was deprecated in favor of GetCheckpointAsync previously.

* Update AutoRest C# version (#20869)

* [ACR] Cache Refresh Token (#20753)

* cache work

* WIP

* WIP

* first e2e impl

* renames and comment tidy for clarity

* update to expiry and force refresh condition

* tests pass

* removing printfs

* re-record tests to accomodate cached token

* fix live tests to run in CI

* work in progress

* index on acr-cache-refresh-token: f906f3b587 work in progress

* update tests

* get expiry time from jwt

* pr fb

* make work with new base class PR

* sanitize all but the expiration time in refresh_token in the recorded test logs

* record tokens that don't expire + extra comments

* pr fb

* Initial Confidential Ledger generated client (#20865)

* initial Confidential Ledger client

* [TSI] Address internal feedback for samples and readme (#20878)

* Regenerate SDK for new Swagger File, to remove 400 as expected response (#20806)

* Regenerate SDK for new Swagger File, to remove 400 as expected response

* Bumping up SDK version to 1.0.0-beta.2

Co-authored-by: Aditi Malladi <[email protected]>

* [Event Hubs Client] Test Configuration Adjustments (#20888)

The focus of these changes is to adjust the clouds used for nightly and
manual test runs, reverting to the Public and Canary clouds.  Weekly runs
will include the UsGov and China sovereign clouds as well.   After discussion,
this aligns with the configuration that the engineering team intended.

Due to the China cloud performing slowly during runs, we've seen some tests
start to exceed the previous execution time cap; this cap has been increased
to reduce flakiness in weekly runs.  I'll continue to monitor and adjust as we
learn more about test stability and performance in the sovereign clouds.

* Prepare Azure.Core release (#20885)

* [TSI] Address Managed Team API Review comments (#20879)

* Rename (#20890)

* update changelongs for release (#20891)

* update changelongs for release

* update codeowners

* [TSI] Clarify where a variant type came from (#20894)

* Create SUPPORT.md for .NET repo (#20848)

* [Event Hubs Processor] Incorporate Validation Feedback (#20884)

The focus of these changes is to incorporate some feedback overlooked in
the initial validation pull request (#20861).

* improve docstrings (#20881)

* Add public API spell check to Analyze job (#20088)

* Add cspell to Analyze

* Forward slashes

* Add spellchecking public APIs to aggregate-reports

* Add public api spell checking to formrecognizer and aggregate reports pipeline (aggregate reports uses continueOnError: true)

* Add spelling exception for ZhHant (a language specification)

* Remove empty pwsh step for spellcheck

* Simplify checking for npx command

Co-authored-by: Heath Stewart <[email protected]>

* Readd negative

* Add cspell.json to exceptions, add comments to word list

Co-authored-by: Heath Stewart <[email protected]>

* Samples for labeled tables (#20840)

* Samples for labeled tables

* too excited renaming

* Update sdk/formrecognizer/Azure.AI.FormRecognizer/README.md

Co-authored-by: Krista Pratico <[email protected]>

* selection mark

Co-authored-by: Krista Pratico <[email protected]>

* Revert changes to SetDevVersion. (#20900)

Co-authored-by: Mitch Denny <[email protected]>

* Back out SetDevVersion changes. (#20899)

* Add source generator for system event mapping/constants (#20873)

* Add source generator for system event mapping/constants

* PR FB

* PR FB

* Missing files

* docsettings

* remove code

* Fix build

* changelog

* More fixing

* Use correct property

* DocSettings

* Comment out assert in test (#20876)

* Comment out assert in test

* Update test

* Increment version for core releases (#20903)

Increment package version after release of Azure.Core.Experimental

* Remove APICompat from released packages (#20886)

* Extend Check Enforcer timeout (#20875)

Extend the timeout that Check Enforcer applies when waiting for a pipeline to start.

* Increment version for eventhub releases (#20893)

* Increment package version after release of Microsoft.Azure.EventHubs.Processor

* Increment package version after release of Microsoft.Azure.EventHubs

* Support modifying feature flag filter parameters (#20866)

* Prepare releases of extensions packages and AppConfig (#20887)

* Add a JsonPath sanitization callback (#20892)

* Update Azure.Core and Experimental (#20915)

* tests (#20896)

* update the version in the .csproj file to 1.0.1, fix formatting in changelog (#20898)

* update the version in the .csproj file to 1.0.1, fix formatting in changelog

* add ApiCompatVersion back

* Remove Azure.Core.props (#20917)

* [Service Bus] Populate TransportType (#20920)

The focus of these changes is to populate the `TransportType` property
on the `ServiceBusClient` at construction.  Previously, the requested
`TransportType` was honored but was nor correctly reflected in the
property.

* [Messaging Function Extension] README Updates (#20924)

The focus of these changes is to correct an error in the configuration
examples for Event Hubs and to include additional information about the permission
grants needed when using  managed identity.

* Upgrade MSAL and MSAL extesion library dependencies to latest (#20922)

* Upgrade MSAL and MSAL extesion library dependencies to latest

* exclude x-ms-PKeyAuth from record matching

* SDK update for TemplateSpecs GA API 2021-05-01 (#20846)

* Preparing for Storage STG 77 beta (#20812)

* Cleaned up breaking change description (#20929)

* Add spell check for changed files (#20822)

* Add spell check for changed files

* task -> template

* Add exceptions

* Add better error handling in Prepare-Release (#20933)

Co-authored-by: Wes Haggard <[email protected]>

* Increment version for attestation releases (#20932)

Increment package version after release of Azure.Security.Attestation

* Fix build warnings (#20921)

* Confidential Ledger samples (#20930)

* Samples

* CL samples (#20943)

* introduce header name constant

* Enable anonymous access for ACR (#20919)

* initial commit

* backup test-resources.json

* work in progress

* small cleanup

* more tidy

* add tests

* update API and re-record tests

* Prepare for 11.3.0-beta.2 release for Search (#20948)

* Update 11.3.0-beta.2 release date for Search

* Add period at the end of sentence

* [synapse] Add changelog for release (#20867)

* [synapse] Add changelog for release

* Add line ref for https://github.com/Azure/azure-sdk-for-net/issues/20051

* [Event Hubs] May Release Preparation (#20944)

The focus of these changes is to prepare the core Event Hubs package
for the May release and update changelogs for the core and processor
packages.

* regenerating recoveryservices-backup C# SDK for swagger spec V2021-03 (#20827)

* generating C# code for V2021-03

* updating file with new SDK version, adding new API version to RP.props

* updating test settings with the new API-version

* updated the encodedHttpRequestUri with the new API version

* updating ListOperations api version for mocking

* resetting vault API versions

* adding unescaped url to the mock records

* adding mock record with unescaped uri for getOperationResults

* corrected the status code and added location header in the mocks

Co-authored-by: Chandrika Gonuguntla <[email protected]>

* [Communication] - SDK - Renamed EVs to consolidated set (#20925)

* Prepare for EG release (#20956)

* [Communication] Update the repeatabilityFirstSent timestamp to correct format (#20959)

* Update the repeatabilityFirstSent timestamp to correct format

* Fix formatting

Co-authored-by: Minnie Liu <[email protected]>

* Add KV extension RBAC info (#20952)

Co-authored-by: Heath Stewart <[email protected]>

* ACR Beta2 Changelog updates (#20966)

* beta2 changelog

* update changelog

* more updates

* Increment version for eventhub releases (#20975)

Increment package version after release of Azure.Messaging.EventHubs

* Increment version for tables releases (#20977)

Increment package version after release of Azure.Data.Tables

* [Event Hubs Processor] May Release Preparation (#20976)

The focus of these changes is to prepare the processor package for the
May milestone release.

* Increment version for eventhub releases (#20978)

Increment package version after release of Azure.Messaging.EventHubs.Processor

* Increment version for synapse releases (#20983)

Increment package version after release of Azure.Analytics.Synapse.Artifacts

* Increment version for search releases (#20980)

Increment package version after release of Azure.Search.Documents

* Setup INT live tests (#20906)

Setup .net live tests pipeline for INT.

Add 'INT' configuration in 'subscription configuration'
Disable SMS tests and phone number update capability tests in INT because INT does not support SMS yet. Control by EV COMMUNICATION_SKIP_SMS_TEST (false in Prod, true in INT)
Disable phone number search test in INT for now since there is no Toll Free number in INT. Control by EV COMMUNICATION_SKIP_PHONENUMBERS_TEST (false in Prod, true in INT)

* [MetricsAdvisor] Renamed all TopCount occurrences to MaxPageSize (#20626)

* Don't log task canceled exceptions as errors when stopping processor. (#20940)

* Don't log task canceled exceptions as errors when stopping processor.

Don't log service timeout exceptions as errors when accepting sessions in processor.

* Update webjobs test to validate no errors are logged from SDK.

* PR FB

* More formatting

* Change default timeout to prevent flakiness

* PR FB

* Update AutoRest C# version (#20928)

* Update AutoRest C# version to 3.0.0-beta.20210510.2

* Add newly needed Azure.Core.Experimental ref

* Export new API

Co-authored-by: Chris Hamons <[email protected]>

* Update CHANGELOG.md with change info (#20988)

# All SDK Contribution checklist:

This checklist is used to make sure that common guidelines for a pull request are followed.
- [ ] **Please open PR in `Draft` mode if it i…
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Client This issue points to a problem in the data-plane of the library. Cognitive - Metrics Advisor
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[MetricsAdvisor] Flaky tests: too many requests
2 participants