Skip to content

Commit

Permalink
Update data solutions tests
Browse files Browse the repository at this point in the history
  • Loading branch information
juliocc committed Feb 10, 2023
1 parent 255405e commit 8d2482c
Show file tree
Hide file tree
Showing 35 changed files with 163 additions and 575 deletions.
17 changes: 17 additions & 0 deletions blueprints/data-solutions/cloudsql-multiregion/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -165,3 +165,20 @@ The above command will delete the associated resources so there will be no billa
| [service_accounts](outputs.tf#L46) | Service Accounts. | |

<!-- END TFDOC -->

## Test

```hcl
module "test" {
source = "./fabric/blueprints/data-solutions/cloudsql-multiregion/"
data_eng_principals = ["[email protected]"]
postgres_user_password = "my-root-password"
project_id = "project"
project_create = {
billing_account_id = "123456-123456-123456"
parent = "folders/12345678"
}
prefix = "prefix"
}
# tftest modules=10 resources=50
```
14 changes: 14 additions & 0 deletions blueprints/data-solutions/cmek-via-centralized-kms/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -54,3 +54,17 @@ This sample creates several distinct groups of resources:
| [vm_keys](outputs.tf#L41) | GCE VM Cloud KMS crypto keys. | |

<!-- END TFDOC -->

## Test

```hcl
module "test" {
source = "./fabric/blueprints/data-solutions/cmek-via-centralized-kms/"
project_config = {
billing_account_id = "123456-123456-123456"
parent = "folders/12345678"
}
prefix = "prefix"
}
# tftest modules=8 resources=27
```
15 changes: 15 additions & 0 deletions blueprints/data-solutions/composer-2/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -113,3 +113,18 @@ service_encryption_keys = {
| [composer_dag_gcs](outputs.tf#L22) | The Cloud Storage prefix of the DAGs for the Cloud Composer environment. | |

<!-- END TFDOC -->

## Test

```hcl
module "test" {
source = "./fabric/blueprints/data-solutions/composer-2/"
project_id = "project"
project_create = {
billing_account_id = "123456-123456-123456"
parent = "folders/12345678"
}
prefix = "prefix"
}
# tftest modules=5 resources=26
```
15 changes: 15 additions & 0 deletions blueprints/data-solutions/data-playground/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -68,3 +68,18 @@ You can now connect to the Vertex AI notbook to perform your data analysy.
| [vpc](outputs.tf#L38) | VPC Network. | |

<!-- END TFDOC -->

## Test

```hcl
module "test" {
source = "./fabric/blueprints/data-solutions/data-playground"
project_id = "sampleproject"
prefix = "tst"
project_create = {
billing_account_id = "123456-123456-123456",
parent = "folders/467898377"
}
}
# tftest modules=8 resources=39
```
Original file line number Diff line number Diff line change
Expand Up @@ -215,3 +215,18 @@ The above command will delete the associated resources so there will be no billa
| [service_accounts](outputs.tf#L69) | Service account. | |

<!-- END TFDOC -->

## Test

```hcl
module "test" {
source = "./fabric/blueprints/data-solutions/gcs-to-bq-with-least-privileges/"
project_create = {
billing_account_id = "123456-123456-123456"
parent = "folders/12345678"
}
project_id = "project-1"
prefix = "prefix"
}
# tftest modules=12 resources=47
```
30 changes: 30 additions & 0 deletions blueprints/data-solutions/shielded-folder/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -178,3 +178,33 @@ terraform apply
| [folders_sink_writer_identities](outputs.tf#L23) | Folders id. | |

<!-- END TFDOC -->

## Test

```hcl
module "test" {
source = "./fabric/blueprints/data-solutions/shielded-folder"
data_dir = "./fabric/blueprints/data-solutions/shielded-folder/data"
access_policy_config = {
access_policy_create = {
parent = "organizations/1234567890123"
title = "ShieldedMVP"
}
}
folder_config = {
folder_create = {
display_name = "ShieldedMVP"
parent = "organizations/1234567890123"
}
}
organization = {
domain = "example.com"
id = "1122334455"
}
prefix = "prefix"
project_config = {
billing_account_id = "123456-123456-123456"
}
}
# tftest modules=6 resources=38 inventory=simple.yaml
```
20 changes: 20 additions & 0 deletions blueprints/data-solutions/sqlserver-alwayson/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -69,3 +69,23 @@ and to `C:\GcpSetupLog.txt` file.
| [instructions](outputs.tf#L19) | List of steps to follow after applying. | |

<!-- END TFDOC -->

## Test

```hcl
module "test" {
source = "./fabric/blueprints/data-solutions/sqlserver-alwayson/"
project_create = {
billing_account_id = "123456-123456-123456"
parent = "folders/12345678"
}
project_id = "project-1"
prefix = "test"
network = "example-network"
subnetwork = "example-subnetwork"
sql_admin_password = "password"
ad_domain_fqdn = "ad.example.com"
ad_domain_netbios = "ad"
}
# tftest modules=12 resources=38
```
33 changes: 31 additions & 2 deletions blueprints/data-solutions/vertex-mlops/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -74,6 +74,35 @@ This blueprint can be used as a building block for setting up an end2end ML Ops
| [project_id](outputs.tf#L49) | Project ID. | |

<!-- END TFDOC -->
# TODO
## TODO
- Add support for User Managed Notebooks, SA permission option and non default SA for Single User mode.
- Improve default naming for local VPC and Cloud NAT
- Improve default naming for local VPC and Cloud NAT

## Test

```hcl
module "test" {
source = "./fabric/blueprints/data-solutions/vertex-mlops/"
labels = {
"env" : "dev",
"team" : "ml"
}
bucket_name = "test-dev"
dataset_name = "test"
identity_pool_claims = "attribute.repository/ORGANIZATION/REPO"
notebooks = {
"myworkbench" : {
"owner" : "[email protected]",
"region" : "europe-west4",
"subnet" : "default",
}
}
prefix = "pref"
project_id = "test-dev"
project_create = {
billing_account_id = "000000-123456-123456"
parent = "folders/111111111111"
}
}
# tftest modules=12 resources=56
```
13 changes: 0 additions & 13 deletions tests/blueprints/data_solutions/__init__.py

This file was deleted.

13 changes: 0 additions & 13 deletions tests/blueprints/data_solutions/cloudsql_multiregion/__init__.py

This file was deleted.

This file was deleted.

19 changes: 0 additions & 19 deletions tests/blueprints/data_solutions/cloudsql_multiregion/test_plan.py

This file was deleted.

This file was deleted.

This file was deleted.

This file was deleted.

13 changes: 0 additions & 13 deletions tests/blueprints/data_solutions/composer_2/__init__.py

This file was deleted.

26 changes: 0 additions & 26 deletions tests/blueprints/data_solutions/composer_2/fixture/main.tf

This file was deleted.

19 changes: 0 additions & 19 deletions tests/blueprints/data_solutions/composer_2/test_plan.py

This file was deleted.

Loading

0 comments on commit 8d2482c

Please sign in to comment.