Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add table azure_data_factory_dataset. Closes #150 #168

Merged
merged 7 commits into from
Jul 13, 2021
Merged

Add table azure_data_factory_dataset. Closes #150 #168

merged 7 commits into from
Jul 13, 2021

Conversation

rajeshbal65
Copy link
Contributor

Integration test logs

Logs 
No env file present for the current environment:  staging
 Falling back to .env config
No env file present for the current environment:  staging
customEnv TURBOT_TEST_EXPECTED_TIMEOUT undefined

SETUP: tests/azure_data_factory_dataset []

PRETEST: tests/azure_data_factory_dataset

TEST: tests/azure_data_factory_dataset
Running terraform
azurerm_resource_group.named_test_resource: Refreshing state... [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest90046]
azurerm_data_factory.named_test_resource: Refreshing state... [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest90046/providers/Microsoft.DataFactory/factories/turbottest90046]
azurerm_data_factory_linked_service_mysql.named_test_resource: Refreshing state... [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest90046/providers/Microsoft.DataFactory/factories/turbottest90046/linkedservices/turbottest90046]
azurerm_data_factory_dataset_mysql.named_test_resource: Refreshing state... [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest90046/providers/Microsoft.DataFactory/factories/turbottest90046/datasets/turbottest90046]
azurerm_data_factory_dataset_mysql.named_test_resource: Destroying... [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest90046/providers/Microsoft.DataFactory/factories/turbottest90046/datasets/turbottest90046]
azurerm_data_factory_dataset_mysql.named_test_resource: Destruction complete after 2s
azurerm_data_factory_linked_service_mysql.named_test_resource: Destroying... [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest90046/providers/Microsoft.DataFactory/factories/turbottest90046/linkedservices/turbottest90046]
azurerm_data_factory_linked_service_mysql.named_test_resource: Destruction complete after 3s
azurerm_data_factory.named_test_resource: Destroying... [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest90046/providers/Microsoft.DataFactory/factories/turbottest90046]
azurerm_data_factory.named_test_resource: Destruction complete after 7s
azurerm_resource_group.named_test_resource: Destroying... [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest90046]
azurerm_resource_group.named_test_resource: Still destroying... [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-...3dae6c8/resourceGroups/turbottest90046, 10s elapsed]
azurerm_resource_group.named_test_resource: Still destroying... [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-...3dae6c8/resourceGroups/turbottest90046, 20s elapsed]
azurerm_resource_group.named_test_resource: Still destroying... [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-...3dae6c8/resourceGroups/turbottest90046, 30s elapsed]
azurerm_resource_group.named_test_resource: Still destroying... [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-...3dae6c8/resourceGroups/turbottest90046, 40s elapsed]
azurerm_resource_group.named_test_resource: Still destroying... [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-...3dae6c8/resourceGroups/turbottest90046, 50s elapsed]
azurerm_resource_group.named_test_resource: Destruction complete after 52s
azurerm_resource_group.named_test_resource: Creating...
azurerm_resource_group.named_test_resource: Creation complete after 2s [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest39077]
azurerm_data_factory.named_test_resource: Creating...
azurerm_data_factory.named_test_resource: Still creating... [10s elapsed]
azurerm_data_factory.named_test_resource: Creation complete after 11s [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest39077/providers/Microsoft.DataFactory/factories/turbottest39077]
azurerm_data_factory_linked_service_mysql.named_test_resource: Creating...
azurerm_data_factory_linked_service_mysql.named_test_resource: Creation complete after 3s [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest39077/providers/Microsoft.DataFactory/factories/turbottest39077/linkedservices/turbottest39077]
azurerm_data_factory_dataset_mysql.named_test_resource: Creating...
azurerm_data_factory_dataset_mysql.named_test_resource: Creation complete after 5s [id=/subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest39077/providers/Microsoft.DataFactory/factories/turbottest39077/datasets/turbottest39077]

Warning: Deprecated Resource

The null_data_source was historically used to construct intermediate values to
re-use elsewhere in configuration, the same can now be achieved using locals


Warning: Version constraints inside provider configuration blocks are deprecated

  on variables.tf line 22, in provider "azurerm":
  22:   version         = "=1.36.0"

Terraform 0.13 and earlier allowed provider version constraints inside the
provider configuration block, but that is now deprecated and will be removed
in a future version of Terraform. To silence this warning, move the provider
version constraint into the required_providers block.


Apply complete! Resources: 4 added, 0 changed, 4 destroyed.

Outputs:

resource_aka = "azure:///subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest39077/providers/Microsoft.DataFactory/factories/turbottest39077/datasets/turbottest39077"
resource_aka_lower = "azure:///subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourcegroups/turbottest39077/providers/microsoft.datafactory/factories/turbottest39077/datasets/turbottest39077"
resource_id = "/subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest39077/providers/Microsoft.DataFactory/factories/turbottest39077/datasets/turbottest39077"
resource_name = "turbottest39077"
subscription_id = "d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8"

Running SQL query: test-get-query.sql
[
  {
    "id": "/subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest39077/providers/Microsoft.DataFactory/factories/turbottest39077/datasets/turbottest39077",
    "name": "turbottest39077",
    "resource_group": "turbottest39077",
    "subscription_id": "d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8",
    "type": "Microsoft.DataFactory/factories/datasets"
  }
]
✔ PASSED

Running SQL query: test-list-query.sql
[
  {
    "id": "/subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest39077/providers/Microsoft.DataFactory/factories/turbottest39077/datasets/turbottest39077",
    "name": "turbottest39077",
    "type": "Microsoft.DataFactory/factories/datasets"
  }
]
✔ PASSED

Running SQL query: test-not-found-query.sql
null
✔ PASSED

Running SQL query: test-turbot-query.sql
[
  {
    "akas": [
      "azure:///subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest39077/providers/Microsoft.DataFactory/factories/turbottest39077/datasets/turbottest39077",
      "azure:///subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourcegroups/turbottest39077/providers/microsoft.datafactory/factories/turbottest39077/datasets/turbottest39077"
    ],
    "name": "turbottest39077",
    "title": "turbottest39077"
  }
]
✔ PASSED

POSTTEST: tests/azure_data_factory_dataset

TEARDOWN: tests/azure_data_factory_dataset

SUMMARY:

1/1 passed.

Example query results

Results 
### Basic info

```sql
select
  name,
  id,
  description,
  etag,
  type
from
  azure_data_factory_dataset;

+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------+--------------------------------------+------------------------------------------+
| name            | id                                                                                                                                                                    | description | etag                                 | type                                     |
+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------+--------------------------------------+------------------------------------------+
| turbottest99785 | /subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest99785/providers/Microsoft.DataFactory/factories/turbottest99785/datasets/turbottest99785 | <null>      | 0100cfee-0000-0100-0000-60e2cec00000 | Microsoft.DataFactory/factories/datasets |
+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------+--------------------------------------+------------------------------------------+

List relational table type Datasets

select
  name,
  id,
  type,
  properties ->> 'type' as dataset_type
from
  azure_data_factory_dataset
where
  properties ->> 'type' = 'RelationalTable';

+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------+-----------------+
| name            | id                                                                                                                                                                    | type                                     | dataset_type    |
+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------+-----------------+
| turbottest99785 | /subscriptions/d7245080-b4ae-4fe5-b6fa-2e71b3dae6c8/resourceGroups/turbottest99785/providers/Microsoft.DataFactory/factories/turbottest99785/datasets/turbottest99785 | Microsoft.DataFactory/factories/datasets | RelationalTable |
+-----------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------+-----------------+
</details>

@rajeshbal65 rajeshbal65 self-assigned this Jul 5, 2021
@rajeshbal65 rajeshbal65 linked an issue Jul 5, 2021 that may be closed by this pull request
Add table azure_datafactory_dataset #150
Closed
@Subhajit97 Subhajit97 requested a review from rajlearner17 July 9, 2021 09:10
@Subhajit97 Subhajit97 requested a review from cbruno10 July 9, 2021 09:37
@cbruno10 cbruno10 changed the title Add table azure_datafactory_dataset. Closes #150 Add table azure_data_factory_dataset. Closes #150 Jul 13, 2021
@cbruno10 cbruno10 merged commit 85be243 into main Jul 13, 2021
@cbruno10 cbruno10 deleted the issue-150 branch July 13, 2021 17:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Subhajit97 Subhajit97 Subhajit97 approved these changes

@rajlearner17 rajlearner17 rajlearner17 approved these changes

@cbruno10 cbruno10 cbruno10 approved these changes

Assignees

@rajeshbal65 rajeshbal65

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Add table azure_datafactory_dataset
4 participants
@rajeshbal65 @cbruno10 @rajlearner17 @Subhajit97