Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DataFacory]Update avroCompressionCodec and orcCompressionCodec from string to object #14770

Merged
merged 2 commits into from
Jun 21, 2021
Merged

Conversation

Jingshu923
Copy link
Contributor

@Jingshu923 Jingshu923 commented Jun 11, 2021

MSFT employees can try out our new experience at OpenAPI Hub - one location for using our validation tools and finding your workflow.

Changelog

Please ensure to add changelog with this PR by answering the following questions.

  1. What's the purpose of the update?
    • new service onboarding
    • new API version
    • update existing version for new feature
    • update existing version to fix swagger quality issue in s360
    • Other, please clarify
  2. When you are targeting to deploy new service/feature to public regions? Please provide date, or month to public if date is not available yet.
  3. When you expect to publish swagger? Please provide date, or month to public if date is not available yet.
  4. If it's an update to existing version, please select SDKs of specific language and CLIs that require refresh after swagger is published.
    • SDK of .NET (need service team to ensure code readiness)
    • SDK of Python
    • SDK of Java
    • SDK of Js
    • SDK of Go
    • PowerShell
    • CLI
    • Terraform
    • No, no need to refresh for updates in this PR

Contribution checklist:

If any further question about AME onboarding or validation tools, please view the FAQ.

ARM API Review Checklist

  • Ensure to check this box if one of the following scenarios meet updates in the PR, so that label “WaitForARMFeedback” will be added automatically to involve ARM API Review. Failure to comply may result in delays for manifest application. Note this does not apply to data plane APIs, all “removals” and “adding a new property” no more require ARM API review.

    • Adding new API(s)
    • Adding a new API version
    • Ensure to copy the existing version into new directory structure for first commit (including refactoring) and then push new changes including version updates in separate commits. This is required to review the changes efficiently.
    • Adding a new service
  • Please ensure you've reviewed following guidelines including ARM resource provider contract and REST guidelines. Estimated time (4 hours). This is required before you can request review from ARM API Review board.

  • If you are blocked on ARM review and want to get the PR merged with urgency, please get the ARM oncall for reviews (RP Manifest Approvers team under Azure Resource Manager service) from IcM and reach out to them.

Breaking Change Review Checklist

If there are following updates in the PR, ensure to request an approval from Breaking Change Review Board as defined in the Breaking Change Policy.

  • Removing API(s) in stable version
  • Removing properties in stable version
  • Removing API version(s) in stable version
  • Updating API in stable or public preview version with Breaking Change Validation errors
  • Updating API(s) in public preview over 1 year (refer to Retirement of Previews)

Action: to initiate an evaluation of the breaking change, create a new intake using the template for breaking changes. Addition details on the process and office hours are on the Breaking change Wiki.

Please follow the link to find more details on PR review process.

@Jingshu923 Jingshu923 requested a review from zhangyd2015 as a code owner June 11, 2021 01:26
@openapi-workflow-bot
Copy link

Hi, @Jingshu923 Thanks for your PR. I am workflow bot for review process. Here are some small tips.

  • Please ensure to do self-check against checklists in first PR comment.
  • PR assignee is the person auto-assigned and responsible for your current PR reviewing and merging.
  • For specs comparison cross API versions, Use API Specs Comparison Report Generator
  • If there is CI failure(s), to fix CI error(s) is mandatory for PR merging; or you need to provide justification in PR comment for explanation. How to fix?

  • Any feedback about review process or workflow bot, pls contact swagger and tools team. [email protected]

    @openapi-workflow-bot
    Copy link

    [Call for Action] To better understand Azure service dev/test scenario, and support Azure service developer better on Swagger and REST API related tests in early phase, please help to fill in with this survey https://aka.ms/SurveyForEarlyPhase. It will take 5 to 10 minutes. If you already complete survey, please neglect this comment. Thanks.

    @openapi-pipeline-app
    Copy link

    openapi-pipeline-app bot commented Jun 11, 2021

    Swagger Validation Report

    ️⌛BreakingChange pending [Detail]
    ️⌛LintDiff pending [Detail]
    ️🔄Avocado inProgress [Detail]
    ️🔄ModelValidation inProgress [Detail]
    ️🔄SemanticValidation inProgress [Detail]
    ️️✔️Cross-Version Breaking Changes succeeded [Detail] [Expand]
    There are no breaking changes.
    ️⌛CredScan pending [Detail]
    ️🔄[Staging] SDK Track2 Validation inProgress [Detail]
    ️🔄[Staging] PrettierCheck inProgress [Detail]
    ️⌛[Staging] SpellCheck pending [Detail]
    ️🔄[Staging] Lint(RPaaS) inProgress [Detail]
    Posted by Swagger Pipeline | How to fix these errors?

    @openapi-pipeline-app
    Copy link

    openapi-pipeline-app bot commented Jun 11, 2021

    Swagger Generation Artifacts

    ️🔄[Staging] ApiDocPreview inProgress [Detail]
    ️❌[Staging] SDK Breaking Change Tracking failed [Detail]

    Breaking Changes Tracking

    azure-sdk-for-go - datafactory/mgmt/2018-06-01/datafactory - v55.3.0
    +	Type of `AvroDatasetTypeProperties.AvroCompressionCodec` has been changed from `AvroCompressionCodec` to `interface{}`
    +	Type of `OrcDatasetTypeProperties.OrcCompressionCodec` has been changed from `OrcCompressionCodec` to `interface{}`
    ️✔️azure-sdk-for-go - preview/datafactory/mgmt/2017-09-01-preview/datafactory - v55.3.0
    azure-sdk-for-python-track2 - track2_azure-mgmt-datafactory - 1.1.0
    ️️✔️ azure-sdk-for-net succeeded [Detail] [Expand]
    • ️✔️Succeeded [Logs]Release - Generate from 7d84fc2. SDK Automation 14.0.0
      warn	Skip initScript due to not configured
      command	sudo apt-get install -y dotnet-sdk-5.0
      command	autorest --version=V2 --csharp --reflect-api-versions --license-header=MICROSOFT_MIT_NO_VERSION [email protected]/[email protected] --csharp-sdks-folder=/home/vsts/work/1/s/azure-sdk-for-net/sdk ../azure-rest-api-specs/specification/datafactory/resource-manager/readme.md
      cmderr	[Autorest] realpath(): Permission denied
      cmderr	[Autorest] realpath(): Permission denied
      cmderr	[Autorest] realpath(): Permission denied
      cmderr	[Autorest] realpath(): Permission denied
      cmderr	[Autorest] realpath(): Permission denied
      cmderr	[Autorest] realpath(): Permission denied
    • ️✔️Microsoft.Azure.Management.DataFactory [View full logs]  [Release SDK Changes]
    ️⚠️ azure-sdk-for-python-track2 warning [Detail]
    • ⚠️Warning [Logs]Release - Generate from 7d84fc2. SDK Automation 14.0.0
      command	sh scripts/automation_init.sh ../azure-sdk-for-python_tmp/initInput.json ../azure-sdk-for-python_tmp/initOutput.json
      cmderr	[automation_init.sh] WARNING: Skipping azure-nspkg as it is not installed.
      command	sh scripts/automation_generate.sh ../azure-sdk-for-python_tmp/generateInput.json ../azure-sdk-for-python_tmp/generateOutput.json
    • ️✔️track2_azure-mgmt-datafactory [View full logs]  [Release SDK Changes] Breaking Change Detected
      Only show 120 items here, please refer to log for details.
      info	[Changelog]   - Model SqlMISource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model MySqlSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model Db2Source has a new parameter disable_metrics_collection
      info	[Changelog]   - Model RelationalSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model OdbcSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model GreenplumSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model CommonDataServiceForAppsSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SybaseSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model ZohoSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model DynamicsCrmSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model BinarySink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzureBlobStorageWriteSettings has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzureSqlSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AvroSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SftpWriteSettings has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SnowflakeSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzureSearchIndexSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AmazonRedshiftSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model DynamicsCrmSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model PostgreSqlSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model HttpReadSettings has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SapBwSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SapEccSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model ParquetSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzureDataLakeStoreSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model MagentoSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SharePointOnlineListSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model DynamicsSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model CosmosDbMongoDbApiSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model OracleServiceCloudSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SqlDWSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SalesforceSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model MongoDbV2Source has a new parameter disable_metrics_collection
      info	[Changelog]   - Model JsonSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SparkSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzureMariaDBSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzureFileStorageWriteSettings has a new parameter disable_metrics_collection
      info	[Changelog]   - Model HiveSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SalesforceServiceCloudSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model OrcSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzureMySqlSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model JiraSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model RestSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SapOpenHubSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model GoogleBigQuerySource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model CopySink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model OdbcSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model CosmosDbSqlApiSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model GoogleAdWordsSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model ConcurSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SalesforceSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model CassandraSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model ShopifySource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model CopySource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model DocumentDbCollectionSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model ExcelDataset has a new parameter sheet_index
      info	[Changelog]   - Model AzureTableSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model HdfsSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model FileServerReadSettings has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzureBlobFSSink has a new parameter metadata
      info	[Changelog]   - Model AzureBlobFSSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model HttpSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SqlServerSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model BlobSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model MicrosoftAccessSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzureSqlSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model ExcelSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model MongoDbAtlasSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AvroSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SnowflakeSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzureDataLakeStoreSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model DelimitedTextSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model MariaDBSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model OracleSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SquareSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SqlDWSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzureSqlMILinkedService has a new parameter always_encrypted_settings
      info	[Changelog]   - Model AzureDataExplorerSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model FileSystemSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model TeradataSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model MicrosoftAccessSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzureDataExplorerSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model EloquaSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model MarketoSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model FileSystemSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SalesforceServiceCloudSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model OracleCloudStorageReadSettings has a new parameter disable_metrics_collection
      info	[Changelog]   - Model DynamicsSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model HBaseSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model OracleSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzureDataLakeStoreReadSettings has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AmazonS3CompatibleReadSettings has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AmazonMWSSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model StoreWriteSettings has a new parameter disable_metrics_collection
      info	[Changelog]   - Model JsonSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model XeroSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model CouchbaseSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model QuickBooksSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzureTableSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model XmlSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model TabularSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SftpReadSettings has a new parameter disable_metrics_collection
      info	[Changelog]   - Model ImpalaSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SqlSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model CosmosDbSqlApiSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model FileServerWriteSettings has a new parameter disable_metrics_collection
      info	[Changelog]   - Model CosmosDbMongoDbApiSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model SapTableSource has a new parameter disable_metrics_collection
      info	[Changelog]   - Model DelimitedTextSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzurePostgreSqlSink has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AzureBlobFSWriteSettings has a new parameter disable_metrics_collection
      info	[Changelog]   - Model AmazonS3ReadSettings has a new parameter disable_metrics_collection
      info	[Changelog]   - Added operation group PrivateEndPointConnectionsOperations
      info	[Changelog]   - Added operation group PrivateEndpointConnectionOperations
      info	[Changelog]   - Added operation group PrivateLinkResourcesOperations
      info	[Changelog]
      info	[Changelog] **Breaking changes**
      info	[Changelog]
      info	[Changelog]   - Parameter type of model MappingDataFlow is now required
      info	[Changelog]   - Parameter type of model DataFlow is now required
    ️⚠️ azure-sdk-for-java warning [Detail]
    • ⚠️Warning [Logs]Release - Generate from 7d84fc2. SDK Automation 14.0.0
      command	./eng/mgmt/automation/init.sh ../azure-sdk-for-java_tmp/initInput.json ../azure-sdk-for-java_tmp/initOutput.json
      command	./eng/mgmt/automation/generate.py ../azure-sdk-for-java_tmp/generateInput.json ../azure-sdk-for-java_tmp/generateOutput.json
      cmderr	[generate.py] 2021-06-21 01:51:24 INFO [VERSION][Found] current version "com.azure.resourcemanager:azure-resourcemanager-datafactory;1.0.0-beta.2;1.0.0-beta.3"
      cmderr	[generate.py] 2021-06-21 01:51:24 INFO [VERSION][Not Found] cannot find stable version, current version "1.0.0-beta.3"
      cmderr	[generate.py] 2021-06-21 01:51:24 INFO autorest --version=3.1.3 --use=@autorest/[email protected] --java.azure-libraries-for-java-folder=/home/vsts/work/1/s/azure-sdk-for-java --java.output-folder=/home/vsts/work/1/s/azure-sdk-for-java/sdk/datafactory/azure-resourcemanager-datafactory --java.namespace=com.azure.resourcemanager.datafactory   --java --pipeline.modelerfour.additional-checks=false --pipeline.modelerfour.lenient-model-deduplication=true --azure-arm --verbose --sdk-integration --fluent=lite --java.fluent=lite --java.license-header=MICROSOFT_MIT_SMALL ../azure-rest-api-specs/specification/datafactory/resource-manager/readme.md
      cmderr	[generate.py] 2021-06-21 01:53:08 INFO [CI][Skip] ci.yml already has module azure-resourcemanager-datafactory
      cmderr	[generate.py] 2021-06-21 01:53:08 INFO [POM][Process] dealing with pom.xml
      cmderr	[generate.py] 2021-06-21 01:53:08 INFO [POM][Skip] pom already has module azure-resourcemanager-datafactory
      cmderr	[generate.py] 2021-06-21 01:53:08 INFO [POM][Success] Write to pom.xml
      cmderr	[generate.py] 2021-06-21 01:53:08 INFO [POM][Process] dealing with root pom
      cmderr	[generate.py] 2021-06-21 01:53:08 INFO [POM][Skip] pom already has module sdk/datafactory
      cmderr	[generate.py] 2021-06-21 01:53:08 INFO [POM][Success] Write to root pom
    • ️✔️azure-resourcemanager-datafactory [View full logs]  [Release SDK Changes]
      cmderr	[Inst] 2021-06-21 01:58:12 DEBUG Got artifact_id: azure-resourcemanager-datafactory
      cmderr	[Inst] 2021-06-21 01:58:12 DEBUG Got artifact: pom.xml
      cmderr	[Inst] 2021-06-21 01:58:12 DEBUG Got artifact: azure-resourcemanager-datafactory-1.0.0-beta.3.jar
      cmderr	[Inst] 2021-06-21 01:58:12 DEBUG Match jar package: azure-resourcemanager-datafactory-1.0.0-beta.3.jar
      cmderr	[Inst] 2021-06-21 01:58:12 DEBUG output: {"full": "```sh\ncurl -L \"https://portal.azure-devex-tools.com/api/sdk-dl-pub?p=Azure/14770/azure-sdk-for-java/azure-resourcemanager-datafactory/azure-resourcemanager-datafactory-1.0.0-beta.3.jar\" -o azure-resourcemanager-datafactory-1.0.0-beta.3.jar\nmvn install:install-file -DgroupId=com.azure.resourcemanager -DartifactId=azure-resourcemanager-datafactory -Dversion=1.0.0-beta.0 -Dfile=azure-resourcemanager-datafactory-1.0.0-beta.3.jar -Dpackaging=jar -DgeneratePom=true
      ```"}
    ️️✔️ azure-sdk-for-go succeeded [Detail] [Expand]
    • ️✔️Succeeded [Logs]Release - Generate from 7d84fc2. SDK Automation 14.0.0
      command	sh ./initScript.sh ../../../../../azure-sdk-for-go_tmp/initInput.json ../../../../../azure-sdk-for-go_tmp/initOutput.json
      command	generator automation ../../../../../azure-sdk-for-go_tmp/generateInput.json ../../../../../azure-sdk-for-go_tmp/generateOutput.json
    • ️✔️datafactory/mgmt/2018-06-01/datafactory [View full logs]  [Release SDK Changes] Breaking Change Detected
      info	[Changelog] ### Breaking Changes
      info	[Changelog]
      info	[Changelog] - Type of `AvroDatasetTypeProperties.AvroCompressionCodec` has been changed from `AvroCompressionCodec` to `interface{}`
      info	[Changelog] - Type of `OrcDatasetTypeProperties.OrcCompressionCodec` has been changed from `OrcCompressionCodec` to `interface{}`
      info	[Changelog]
      info	[Changelog] ### New Content
      info	[Changelog]
      info	[Changelog]
      info	[Changelog] Total 2 breaking change(s), 0 additive change(s).
      info	[Changelog]
    • ️✔️preview/datafactory/mgmt/2017-09-01-preview/datafactory [View full logs]  [Release SDK Changes]
      info	[Changelog] No exported changes
    ️🔄 azure-sdk-for-js inProgress [Detail]
    ️️✔️ azure-cli-extensions succeeded [Detail] [Expand]
    • ️✔️Succeeded [Logs]Release - Generate from 7d84fc2. Azure CLI Automation 14.0.0
      Only show 120 items here, please refer to log for details.
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'ForEachActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'AzureMLBatchExecutionActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'AzureMLBatchExecutionActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'AzureMLUpdateResourceActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'AzureMLUpdateResourceActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'AzureMLExecutePipelineActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'AzureMLExecutePipelineActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'DataLakeAnalyticsUSQLActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'DataLakeAnalyticsUSQLActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'WaitActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'WaitActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'UntilActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'UntilActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'ValidationActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'ValidationActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'FilterActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'FilterActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'DatabricksNotebookActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'DatabricksNotebookActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'DatabricksSparkJarActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'DatabricksSparkJarActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'DatabricksSparkPythonActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'DatabricksSparkPythonActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'SetVariableActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'SetVariableActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'AppendVariableActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'AppendVariableActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'AzureFunctionActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'AzureFunctionActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'WebHookActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'WebHookActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'ExecuteDataFlowActivity' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'ExecuteDataFlowActivityTypeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'MultiplePipelineTrigger' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'ScheduleTrigger-typeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'BlobTrigger-typeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'BlobEventsTrigger-typeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'CustomEventsTrigger-typeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'TumblingWindowTrigger-typeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'RetryPolicy' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'RerunTumblingWindowTrigger-typeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/SchemaMissingType): The schema 'ChainingTrigger-typeProperties' with an undefined type and decalared properties is a bit ambigious. This has been auto-corrected to 'type:object'
      cmdout	[Autorest] WARNING (PreCheck/CheckDuplicateSchemas): Checking for duplicate schemas, this could take a (long) while.  Run with --verbose for more detail.
      cmdout	[Autorest] WARNING (PreCheck/DuplicateSchema): Duplicate Schema named BlobEventTypes -- type: undefined => "string",items: {"$ref":"#/components/schemas/BlobEventTypes"} => <none>,enum: undefined => ["Microsoft.Storage.BlobCreated","Microsoft.Storage.BlobDeleted"],x-ms-enum: undefined => {"name":"BlobEventTypes","modelAsString":true}
      cmdout	[Autorest] WARNING (): Operation Update has already existed in group! Skip split!
      cmdout	[Autorest] WARNING (): Operation Update has already existed in group! Skip split!
      cmdout	[Autorest] WARNING (): cli.auto-parameter-hidden is not true, skip visibility cleaner
      cmdout	[Autorest] WARNING:  newAzName:linked-integration-runtime create
      cmderr	[Autorest] BELOW TEST SCENARIO SECTION CAN BE USED IN readme.cli.md
      cmderr	[Autorest] --------------------------------------------------------
      cmderr	[Autorest]   test-scenario:
      cmderr	[Autorest]     - name: /Factories/put/Factories_CreateOrUpdate
      cmderr	[Autorest]     - name: /Factories/get/Factories_Get
      cmderr	[Autorest]     - name: /Factories/get/Factories_List
      cmderr	[Autorest]     - name: /Factories/get/Factories_ListByResourceGroup
      cmderr	[Autorest]     - name: /Factories/patch/Factories_Update
      cmderr	[Autorest]     - name: /Factories/post/Factories_ConfigureFactoryRepo
      cmderr	[Autorest]     - name: /Factories/post/Factories_GetDataPlaneAccess
      cmderr	[Autorest]     - name: /Factories/post/Factories_GetGitHubAccessToken
      cmderr	[Autorest]     - name: /ActivityRuns/post/ActivityRuns_QueryByPipelineRun
      cmderr	[Autorest]     - name: /Datasets/put/Datasets_Create
      cmderr	[Autorest]     - name: /Datasets/put/Datasets_Update
      cmderr	[Autorest]     - name: /Datasets/get/Datasets_Get
      cmderr	[Autorest]     - name: /Datasets/get/Datasets_ListByFactory
      cmderr	[Autorest]     - name: /Datasets/delete/Datasets_Delete
      cmderr	[Autorest]     - name: /IntegrationRuntimes/put/IntegrationRuntimes_Create
      cmderr	[Autorest]     - name: /IntegrationRuntimes/get/IntegrationRuntimes_Get
      cmderr	[Autorest]     - name: /IntegrationRuntimes/get/IntegrationRuntimes_ListByFactory
      cmderr	[Autorest]     - name: /IntegrationRuntimes/patch/IntegrationRuntimes_Update
      cmderr	[Autorest]     - name: /IntegrationRuntimes/post/IntegrationRuntimes_CreateLinkedIntegrationRuntime
      cmderr	[Autorest]     - name: /IntegrationRuntimes/post/IntegrationRuntimes_GetConnectionInfo
      cmderr	[Autorest]     - name: /IntegrationRuntimes/post/IntegrationRuntimes_GetMonitoringData
      cmderr	[Autorest]     - name: /IntegrationRuntimes/post/IntegrationRuntimes_GetStatus
      cmderr	[Autorest]     - name: /IntegrationRuntimes/post/IntegrationRuntimes_ListAuthKeys
      cmderr	[Autorest]     - name: /IntegrationRuntimes/post/IntegrationRuntimes_RegenerateAuthKey
      cmderr	[Autorest]     - name: /IntegrationRuntimes/post/IntegrationRuntimes_Start
      cmderr	[Autorest]     - name: /IntegrationRuntimes/post/IntegrationRuntimes_Stop
      cmderr	[Autorest]     - name: /IntegrationRuntimes/post/IntegrationRuntimes_SyncCredentials
      cmderr	[Autorest]     - name: /IntegrationRuntimes/post/IntegrationRuntimes_Upgrade
      cmderr	[Autorest]     - name: /IntegrationRuntimes/post/IntegrationRuntimes_Upgrade
      cmderr	[Autorest]     - name: /IntegrationRuntimeNodes/get/IntegrationRuntimeNodes_Get
      cmderr	[Autorest]     - name: /IntegrationRuntimeNodes/patch/IntegrationRuntimeNodes_Update
      cmderr	[Autorest]     - name: /IntegrationRuntimeNodes/post/IntegrationRuntimeNodes_GetIpAddress
      cmderr	[Autorest]     - name: /IntegrationRuntimeNodes/delete/IntegrationRuntimesNodes_Delete
      cmderr	[Autorest]     - name: /IntegrationRuntimes/delete/IntegrationRuntimes_Delete
      cmderr	[Autorest]     - name: /LinkedServices/put/LinkedServices_Create
      cmderr	[Autorest]     - name: /LinkedServices/put/LinkedServices_Update
      cmderr	[Autorest]     - name: /LinkedServices/get/LinkedServices_Get
      cmderr	[Autorest]     - name: /LinkedServices/get/LinkedServices_ListByFactory
      cmderr	[Autorest]     - name: /LinkedServices/delete/LinkedServices_Delete
      cmderr	[Autorest]     - name: /PipelineRuns/get/PipelineRuns_Get
      cmderr	[Autorest]     - name: /PipelineRuns/post/PipelineRuns_Cancel
      cmderr	[Autorest]     - name: /PipelineRuns/post/PipelineRuns_QueryByFactory
      cmderr	[Autorest]     - name: /Pipelines/put/Pipelines_Create
      cmderr	[Autorest]     - name: /Pipelines/put/Pipelines_Update
      cmderr	[Autorest]     - name: /Pipelines/get/Pipelines_Get
      cmderr	[Autorest]     - name: /Pipelines/get/Pipelines_ListByFactory
      cmderr	[Autorest]     - name: /Pipelines/post/Pipelines_CreateRun
      cmderr	[Autorest]     - name: /Pipelines/delete/Pipelines_Delete
      cmderr	[Autorest]     - name: /privateEndPointConnections/get/privateEndPointConnections_ListByFactory
      cmderr	[Autorest]     - name: /PrivateEndpointConnection/put/Approves or rejects a private endpoint connection for a factory.
      cmderr	[Autorest]     - name: /PrivateEndpointConnection/get/Get a private endpoint connection for a datafactory.
      cmderr	[Autorest]     - name: /PrivateEndpointConnection/delete/Delete a private endpoint connection for a datafactory.
      cmderr	[Autorest]     - name: /privateLinkResources/get/Get private link resources of a site
      cmderr	[Autorest]     - name: /Triggers/put/Triggers_Create
      cmderr	[Autorest]     - name: /Triggers/put/Triggers_Update
      cmderr	[Autorest]     - name: /Triggers/get/Triggers_Get
      cmderr	[Autorest]     - name: /Triggers/get/Triggers_ListByFactory
      cmderr	[Autorest]     - name: /Triggers/post/Triggers_GetEventSubscriptionStatus
      cmderr	[Autorest]     - name: /Triggers/post/Triggers_QueryByFactory
      cmderr	[Autorest]     - name: /Triggers/post/Triggers_Start
      cmderr	[Autorest]     - name: /Triggers/post/Triggers_Stop
      cmderr	[Autorest]     - name: /Triggers/post/Triggers_SubscribeToEvents
      cmderr	[Autorest]     - name: /Triggers/post/Triggers_UnsubscribeFromEvents
      cmderr	[Autorest]     - name: /TriggerRuns/post/TriggerRuns_QueryByFactory
      cmderr	[Autorest]     - name: /TriggerRuns/post/Triggers_Cancel
      cmderr	[Autorest]     - name: /TriggerRuns/post/Triggers_Rerun
      cmderr	[Autorest]     - name: /Triggers/delete/Triggers_Delete
      cmderr	[Autorest]     - name: /Factories/delete/Factories_Delete
      cmderr	[Autorest] --------------------------------------------------------
    • ️✔️datafactory [View full logs]  [Release Azure CLI Changes]
    ️⚠️ azure-resource-manager-schemas warning [Detail]
    • ⚠️Warning [Logs]Release - Generate from 7d84fc2. Schema Automation 14.0.0
      command	.sdkauto/initScript.sh ../azure-resource-manager-schemas_tmp/initInput.json ../azure-resource-manager-schemas_tmp/initOutput.json
      cmderr	[initScript.sh] WARN old lockfile
      cmderr	[initScript.sh] npm WARN old lockfile The package-lock.json file was created with an old version of npm,
      cmderr	[initScript.sh] npm WARN old lockfile so supplemental metadata must be fetched from the registry.
      cmderr	[initScript.sh] npm WARN old lockfile
      cmderr	[initScript.sh] npm WARN old lockfile This is a one-time fix-up, please be patient...
      cmderr	[initScript.sh] npm WARN old lockfile
      warn	File azure-resource-manager-schemas_tmp/initOutput.json not found to read
      command	.sdkauto/generateScript.sh ../azure-resource-manager-schemas_tmp/generateInput.json ../azure-resource-manager-schemas_tmp/generateOutput.json
    • ️✔️datafactory [View full logs]  [Release Schema Changes]
    Posted by Swagger Pipeline | How to fix these errors?

    @openapi-workflow-bot
    Copy link

    Hi @Jingshu923, one or multiple breaking change(s) is detected in your PR. Please check out the breaking change(s), and provide business justification in the PR comment and @ PR assignee why you must have these change(s), and how external customer impact can be mitigated. Please ensure to follow breaking change policy to request breaking change review and approval before proceeding swagger PR review.
    Action: To initiate an evaluation of the breaking change, create a new intake using the template for breaking changes. Addition details on the process and office hours are on the Breaking change Wiki.
    If you want to know the production traffic statistic, please see ARM Traffic statistic.
    If you think it is false positive breaking change, please provide the reasons in the PR comment, report to Swagger Tooling Team via https://aka.ms/swaggerfeedback.

    @leni-msft
    Copy link
    Contributor

    /azp run

    @azure-pipelines
    Copy link

    Azure Pipelines successfully started running 1 pipeline(s).

    @openapi-pipeline-app
    Copy link

    openapi-pipeline-app bot commented Jun 18, 2021

    Swagger Validation Report

    ️❌BreakingChange: 2 Errors, 0 Warnings failed [Detail]
    Rule Message
    1026 - TypeChanged The new version has a different type 'object' than the previous one 'string'.
    New: stable/2018-06-01/entityTypes/Dataset.json#L648:9
    Old: stable/2018-06-01/entityTypes/Dataset.json#L648:9
    1026 - TypeChanged The new version has a different type 'object' than the previous one 'string'.
    New: stable/2018-06-01/entityTypes/Dataset.json#L949:9
    Old: stable/2018-06-01/entityTypes/Dataset.json#L945:9
    ️🔄LintDiff inProgress [Detail]
    ️️✔️Avocado succeeded [Detail] [Expand]
    Validation passes for Avocado.
    ️️✔️ModelValidation succeeded [Detail] [Expand]
    Validation passes for ModelValidation.
    ️️✔️SemanticValidation succeeded [Detail] [Expand]
    Validation passes for SemanticValidation.
    ️️✔️Cross-Version Breaking Changes succeeded [Detail] [Expand]
    There are no breaking changes.
    ️️✔️CredScan succeeded [Detail] [Expand]
    There is no credential detected.
    ️️✔️[Staging] SDK Track2 Validation succeeded [Detail]
    The following errors/warnings are introduced by current PR:

    |:speech_balloon: AutorestCore/Exception|"readme":"datafactory/resource-manager/readme.md",
    "tag":"package-2018-06",
    "details":"> Installing AutoRest extension '@microsoft.azure/openapi-validator' (1.8.0)"|
    |:speech_balloon: AutorestCore/Exception|"readme":"datafactory/resource-manager/readme.md",
    "tag":"package-2018-06",
    "details":"> Installed AutoRest extension '@microsoft.azure/openapi-validator' (1.8.0->1.8.0)"|


    The following errors/warnings exist before current PR submission:

    Rule Message
    AutorestCore/Exception "readme":"datafactory/resource-manager/readme.md",
    "tag":"package-2018-06",
    "details":"Error: Semantic validation failed. There was some errors"
    💬 AutorestCore/Exception "readme":"datafactory/resource-manager/readme.md",
    "tag":"package-2018-06",
    "details":"> Loading AutoRest extension '@autorest/modelerfour' (4.15.456->4.15.456)"
    ️️✔️[Staging] PrettierCheck succeeded [Detail] [Expand]
    Validation passes for PrettierCheck.
    ️️✔️[Staging] SpellCheck succeeded [Detail] [Expand]
    Validation passes for SpellCheck.
    ️️✔️[Staging] Lint(RPaaS) succeeded [Detail] [Expand]
    Validation passes for Lint(RPaaS).
    Posted by Swagger Pipeline | How to fix these errors?

    asager pushed a commit to asager/azure-rest-api-specs that referenced this pull request Jun 24, 2021
    …string to object (Azure#14770)
    
    * [DataFacory]Update avroCompressionCodec and orcCompressionCodec from string to object
    
    * update json
    mkarmark pushed a commit to mkarmark/azure-rest-api-specs that referenced this pull request Jul 21, 2021
    …string to object (Azure#14770)
    
    * [DataFacory]Update avroCompressionCodec and orcCompressionCodec from string to object
    
    * update json
    Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
    Labels
    Approved-BreakingChange DO NOT USE! OBSOLETE label. See https://github.com/Azure/azure-sdk-tools/issues/6374 CI-BreakingChange-Go
    Projects
    None yet
    Development

    Successfully merging this pull request may close these issues.

    5 participants