Merge pull request #113 from modular-magician/master

Add BigQuery, Source Repositories

Gemfile

@@ -13,5 +13,6 @@ group :development do
   gem 'passgen'
   gem 'pry-coolline'
   gem 'rake'
+  gem 'vcr'
   gem 'webmock'
 end

Rakefile

@@ -43,7 +43,7 @@ namespace :test do
 
   task :init_workspace do
     # Initialize terraform workspace
-    cmd = format("cd %s/build/ && terraform init", integration_dir)
+    cmd = format("cd %s/build/ && terraform init -upgrade", integration_dir)
     sh(cmd)
   end
 

docs/resources/google_bigquery_dataset.md

@@ -71,3 +71,9 @@ Properties that can be accessed from the `google_bigquery_dataset` resource:
   * `last_modified_time`: The date when this dataset or any of its tables was last modified, in milliseconds since the epoch.
 
   * `location`: The geographic location where the dataset should reside. Possible values include EU and US. The default value is US.
+
+
+
+## GCP Permissions
+
+Ensure the [BigQuery API](https://console.cloud.google.com/apis/library/bigquery-json.googleapis.com/) is enabled for the current project.

docs/resources/google_bigquery_datasets.md

@@ -28,3 +28,7 @@ See [google_bigquery_dataset.md](google_bigquery_dataset.md) for more detailed i
 ## Filter Criteria
 This resource supports all of the above properties as filter criteria, which can be used
 with `where` as a block or a method.
+
+## GCP Permissions
+
+Ensure the [BigQuery API](https://console.cloud.google.com/apis/library/bigquery-json.googleapis.com/) is enabled for the current project.

docs/resources/google_bigquery_table.md

@@ -0,0 +1,117 @@
+---
+title: About the google_bigquery_table resource
+platform: gcp
+---
+
+## Syntax
+A `google_bigquery_table` is used to test a Google Table resource
+
+## Examples
+```
+describe google_bigquery_table(project: 'chef-gcp-inspec', dataset: 'inspec_gcp_dataset', name: 'inspec_gcp_bigquery_table') do
+  it { should exist }
+
+  its('expiration_time') { should cmp '1738882264000' }
+  its('time_partitioning.type') { should eq 'DAY' }
+  its('description') { should eq 'A BigQuery table' }
+end
+
+describe google_bigquery_table(project: 'chef-gcp-inspec', dataset: 'inspec_gcp_dataset', name: 'nonexistent') do
+  it { should_not exist }
+end
+```
+
+## Properties
+Properties that can be accessed from the `google_bigquery_table` resource:
+
+  * `table_reference`: Reference describing the ID of this table
+
+    * `datasetId`: The ID of the dataset containing this table
+
+    * `projectId`: The ID of the project containing this table
+
+    * `tableId`: The ID of the the table
+
+  * `creation_time`: The time when this dataset was created, in milliseconds since the epoch.
+
+  * `description`: A user-friendly description of the dataset
+
+  * `friendly_name`: A descriptive name for this table
+
+  * `id`: An opaque ID uniquely identifying the table.
+
+  * `labels`: The labels associated with this dataset. You can use these to organize and group your datasets
+
+  * `last_modified_time`: The time when this table was last modified, in milliseconds since the epoch.
+
+  * `location`: The geographic location where the table resides. This value is inherited from the dataset.
+
+  * `name`: Name of the table
+
+  * `num_bytes`: The size of this table in bytes, excluding any data in the streaming buffer.
+
+  * `num_long_term_bytes`: The number of bytes in the table that are considered "long-term storage".
+
+  * `num_rows`: The number of rows of data in this table, excluding any data in the streaming buffer.
+
+  * `type`: Describes the table type
+
+  * `view`: The view definition.
+
+    * `useLegacySql`: Specifies whether to use BigQuery's legacy SQL for this view
+
+    * `userDefinedFunctionResources`: Describes user-defined function resources used in the query.
+
+  * `time_partitioning`: If specified, configures time-based partitioning for this table.
+
+    * `expirationMs`: Number of milliseconds for which to keep the storage for a partition.
+
+    * `type`: The only type supported is DAY, which will generate one partition per day.
+
+  * `streaming_buffer`: Contains information regarding this table's streaming buffer, if one is present. This field will be absent if the table is not being streamed to or if there is no data in the streaming buffer.
+
+    * `estimatedBytes`: A lower-bound estimate of the number of bytes currently in the streaming buffer.
+
+    * `estimatedRows`: A lower-bound estimate of the number of rows currently in the streaming buffer.
+
+    * `oldestEntryTime`: Contains the timestamp of the oldest entry in the streaming buffer, in milliseconds since the epoch, if the streaming buffer is available.
+
+  * `schema`: Describes the schema of this table
+
+    * `fields`: Describes the fields in a table.
+
+  * `encryption_configuration`: Custom encryption configuration
+
+    * `kmsKeyName`: Describes the Cloud KMS encryption key that will be used to protect destination BigQuery table. The BigQuery Service Account associated with your project requires access to this encryption key.
+
+  * `expiration_time`: The time when this table expires, in milliseconds since the epoch. If not present, the table will persist indefinitely.
+
+  * `external_data_configuration`: Describes the data format, location, and other properties of a table stored outside of BigQuery. By defining these properties, the data source can then be queried as if it were a standard BigQuery table.
+
+    * `autodetect`: Try to detect schema and format options automatically. Any option specified explicitly will be honored.
+
+    * `compression`: The compression type of the data source
+
+    * `ignoreUnknownValues`: Indicates if BigQuery should allow extra values that are not represented in the table schema
+
+    * `maxBadRecords`: The maximum number of bad records that BigQuery can ignore when reading data
+
+    * `sourceFormat`: The data format
+
+    * `sourceUris`: The fully-qualified URIs that point to your data in Google Cloud. For Google Cloud Storage URIs: Each URI can contain one '*' wildcard character and it must come after the 'bucket' name. Size limits related to load jobs apply to external data sources. For Google Cloud Bigtable URIs: Exactly one URI can be specified and it has be a fully specified and valid HTTPS URL for a Google Cloud Bigtable table. For Google Cloud Datastore backups, exactly one URI can be specified. Also, the '*' wildcard character is not allowed.
+
+    * `schema`: The schema for the data. Schema is required for CSV and JSON formats
+
+    * `googleSheetsOptions`: Additional options if sourceFormat is set to GOOGLE_SHEETS.
+
+    * `csvOptions`: Additional properties to set if sourceFormat is set to CSV.
+
+    * `bigtableOptions`: Additional options if sourceFormat is set to BIGTABLE.
+
+  * `dataset`: Name of the dataset
+
+
+
+## GCP Permissions
+
+Ensure the [BigQuery API](https://console.cloud.google.com/apis/library/bigquery-json.googleapis.com/) is enabled for the current project.

docs/resources/google_bigquery_tables.md

@@ -0,0 +1,51 @@
+---
+title: About the google_bigquery_tables resource
+platform: gcp
+---
+
+## Syntax
+A `google_bigquery_tables` is used to test a Google Table resource
+
+## Examples
+```
+describe.one do
+  google_bigquery_tables(project: 'chef-gcp-inspec', dataset: 'inspec_gcp_dataset').table_references.each do |table_reference|
+    describe google_bigquery_table(project: 'chef-gcp-inspec', dataset: 'inspec_gcp_dataset', name: table_reference.table_id) do
+      its('expiration_time') { should cmp '1738882264000' }
+      its('description') { should eq 'A BigQuery table' }
+    end
+  end
+end
+```
+
+## Properties
+Properties that can be accessed from the `google_bigquery_tables` resource:
+
+See [google_bigquery_table.md](google_bigquery_table.md) for more detailed information
+  * `table_references`: an array of `google_bigquery_table` table_reference
+  * `creation_times`: an array of `google_bigquery_table` creation_time
+  * `friendly_names`: an array of `google_bigquery_table` friendly_name
+  * `ids`: an array of `google_bigquery_table` id
+  * `labels`: an array of `google_bigquery_table` labels
+  * `last_modified_times`: an array of `google_bigquery_table` last_modified_time
+  * `locations`: an array of `google_bigquery_table` location
+  * `num_bytes`: an array of `google_bigquery_table` num_bytes
+  * `num_long_term_bytes`: an array of `google_bigquery_table` num_long_term_bytes
+  * `num_rows`: an array of `google_bigquery_table` num_rows
+  * `types`: an array of `google_bigquery_table` type
+  * `views`: an array of `google_bigquery_table` view
+  * `time_partitionings`: an array of `google_bigquery_table` time_partitioning
+  * `streaming_buffers`: an array of `google_bigquery_table` streaming_buffer
+  * `schemas`: an array of `google_bigquery_table` schema
+  * `encryption_configurations`: an array of `google_bigquery_table` encryption_configuration
+  * `expiration_times`: an array of `google_bigquery_table` expiration_time
+  * `external_data_configurations`: an array of `google_bigquery_table` external_data_configuration
+  * `datasets`: an array of `google_bigquery_table` dataset
+
+## Filter Criteria
+This resource supports all of the above properties as filter criteria, which can be used
+with `where` as a block or a method.
+
+## GCP Permissions
+
+Ensure the [BigQuery API](https://console.cloud.google.com/apis/library/bigquery-json.googleapis.com/) is enabled for the current project.

docs/resources/google_cloudbuild_trigger.md

@@ -35,7 +35,7 @@ Properties that can be accessed from the `google_cloudbuild_trigger` resource:
 
   * `substitutions`: Substitutions data for Build resource.
 
-  * `filename`: Path, from the source root, to a file whose contents is used for the template.
+  * `filename`: Path, from the source root, to a file whose contents is used for the template. Either a filename or build template must be provided.
 
   * `ignored_files`: ignoredFiles and includedFiles are file glob matches using http://godoc/pkg/path/filepath#Match extended with support for `**`.  If ignoredFiles and changed files are both empty, then they are not used to determine whether or not to trigger a build.  If ignoredFiles is not empty, then we ignore any files that match any of the ignored_file globs. If the change has no files that are outside of the ignoredFiles globs, then we do not trigger a build.
 
@@ -49,16 +49,22 @@ Properties that can be accessed from the `google_cloudbuild_trigger` resource:
 
     * `dir`: Directory, relative to the source root, in which to run the build.  This must be a relative path. If a step's dir is specified and is an absolute path, this value is ignored for that step's execution.
 
-    * `branchName`: Name of the branch to build.
+    * `branchName`: Name of the branch to build. Exactly one a of branch name, tag, or commit SHA must be provided.
 
-    * `tagName`: Name of the tag to build.
+    * `tagName`: Name of the tag to build. Exactly one of a branch name, tag, or commit SHA must be provided.
 
-    * `commitSha`: Explicit commit SHA to build.
+    * `commitSha`: Explicit commit SHA to build. Exactly one of a branch name, tag, or commit SHA must be provided.
 
-  * `build`: Contents of the build template.
+  * `build`: Contents of the build template. Either a filename or build template must be provided.
 
     * `tags`: Tags for annotation of a Build. These are not docker tags.
 
     * `images`: A list of images to be pushed upon the successful completion of all build steps. The images are pushed using the builder service account's credentials. The digests of the pushed images will be stored in the Build resource's results field. If any of the images fail to be pushed, the build status is marked FAILURE.
 
     * `steps`: The operations to be performed on the workspace.
+
+
+
+## GCP Permissions
+
+Ensure the [Cloud Build API](https://console.cloud.google.com/apis/library/cloudbuild.googleapis.com/) is enabled for the current project.

docs/resources/google_cloudbuild_triggers.md

@@ -40,3 +40,7 @@ See [google_cloudbuild_trigger.md](google_cloudbuild_trigger.md) for more detail
 ## Filter Criteria
 This resource supports all of the above properties as filter criteria, which can be used
 with `where` as a block or a method.
+
+## GCP Permissions
+
+Ensure the [Cloud Build API](https://console.cloud.google.com/apis/library/cloudbuild.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_autoscaler.md

@@ -51,3 +51,9 @@ Properties that can be accessed from the `google_compute_autoscaler` resource:
   * `target`: URL of the managed instance group that this autoscaler will scale.
 
   * `zone`: URL of the zone where the instance group resides.
+
+
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_autoscalers.md

@@ -36,3 +36,7 @@ See [google_compute_autoscaler.md](google_compute_autoscaler.md) for more detail
 ## Filter Criteria
 This resource supports all of the above properties as filter criteria, which can be used
 with `where` as a block or a method.
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_backend_service.md

@@ -88,3 +88,9 @@ Properties that can be accessed from the `google_compute_backend_service` resour
   * `session_affinity`: Type of session affinity to use. The default is NONE.  When the load balancing scheme is EXTERNAL, can be NONE, CLIENT_IP, or GENERATED_COOKIE.  When the load balancing scheme is INTERNAL, can be NONE, CLIENT_IP, CLIENT_IP_PROTO, or CLIENT_IP_PORT_PROTO.  When the protocol is UDP, this field is not used.
 
   * `timeout_sec`: How many seconds to wait for the backend before considering it a failed request. Default is 30 seconds. Valid range is [1, 86400].
+
+
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_backend_services.md

@@ -42,3 +42,7 @@ See [google_compute_backend_service.md](google_compute_backend_service.md) for m
 ## Filter Criteria
 This resource supports all of the above properties as filter criteria, which can be used
 with `where` as a block or a method.
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_disk.md

@@ -91,3 +91,9 @@ Properties that can be accessed from the `google_compute_disk` resource:
     * `sha256`: The RFC 4648 base64 encoded SHA-256 hash of the customer-supplied encryption key that protects this resource.
 
   * `source_snapshot_id`: The unique ID of the snapshot used to create this disk. This value identifies the exact snapshot that was used to create this persistent disk. For example, if you created the persistent disk from a snapshot that was later deleted and recreated under the same name, the source snapshot ID would identify the exact version of the snapshot that was used.
+
+
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_disks.md

@@ -44,3 +44,7 @@ See [google_compute_disk.md](google_compute_disk.md) for more detailed informati
 ## Filter Criteria
 This resource supports all of the above properties as filter criteria, which can be used
 with `where` as a block or a method.
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_global_address.md

@@ -36,3 +36,9 @@ Properties that can be accessed from the `google_compute_global_address` resourc
   * `region`: A reference to the region where the regional address resides.
 
   * `address_type`: The type of the address to reserve, default is EXTERNAL.  * EXTERNAL indicates public/external single IP address. * INTERNAL indicates internal IP ranges belonging to some network.
+
+
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_global_addresses.md

@@ -31,3 +31,7 @@ See [google_compute_global_address.md](google_compute_global_address.md) for mor
 ## Filter Criteria
 This resource supports all of the above properties as filter criteria, which can be used
 with `where` as a block or a method.
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_global_forwarding_rule.md

@@ -51,3 +51,9 @@ Properties that can be accessed from the `google_compute_global_forwarding_rule`
   * `region`: A reference to the region where the regional forwarding rule resides. This field is not applicable to global forwarding rules.
 
   * `target`: This target must be a global load balancing resource. The forwarded traffic must be of a type appropriate to the target object.  Valid types: HTTP_PROXY, HTTPS_PROXY, SSL_PROXY, TCP_PROXY
+
+
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_global_forwarding_rules.md

@@ -37,3 +37,7 @@ See [google_compute_global_forwarding_rule.md](google_compute_global_forwarding_
 ## Filter Criteria
 This resource supports all of the above properties as filter criteria, which can be used
 with `where` as a block or a method.
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_health_check.md

@@ -91,3 +91,9 @@ Properties that can be accessed from the `google_compute_health_check` resource:
     * `portName`: Port name as defined in InstanceGroup#NamedPort#name. If both port and port_name are defined, port takes precedence.
 
     * `proxyHeader`: Specifies the type of proxy header to append before sending data to the backend, either NONE or PROXY_V1. The default is NONE.
+
+
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_health_checks.md

@@ -35,3 +35,7 @@ See [google_compute_health_check.md](google_compute_health_check.md) for more de
 ## Filter Criteria
 This resource supports all of the above properties as filter criteria, which can be used
 with `where` as a block or a method.
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_http_health_check.md

@@ -44,3 +44,9 @@ Properties that can be accessed from the `google_compute_http_health_check` reso
   * `timeout_sec`: How long (in seconds) to wait before claiming failure. The default value is 5 seconds.  It is invalid for timeoutSec to have greater value than checkIntervalSec.
 
   * `unhealthy_threshold`: A so-far healthy instance will be marked unhealthy after this many consecutive failures. The default value is 2.
+
+
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_http_health_checks.md

@@ -34,3 +34,7 @@ See [google_compute_http_health_check.md](google_compute_http_health_check.md) f
 ## Filter Criteria
 This resource supports all of the above properties as filter criteria, which can be used
 with `where` as a block or a method.
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_https_health_check.md

@@ -45,3 +45,9 @@ Properties that can be accessed from the `google_compute_https_health_check` res
   * `timeout_sec`: How long (in seconds) to wait before claiming failure. The default value is 5 seconds.  It is invalid for timeoutSec to have greater value than checkIntervalSec.
 
   * `unhealthy_threshold`: A so-far healthy instance will be marked unhealthy after this many consecutive failures. The default value is 2.
+
+
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.

docs/resources/google_compute_https_health_checks.md

@@ -34,3 +34,7 @@ See [google_compute_https_health_check.md](google_compute_https_health_check.md)
 ## Filter Criteria
 This resource supports all of the above properties as filter criteria, which can be used
 with `where` as a block or a method.
+
+## GCP Permissions
+
+Ensure the [Compute Engine API](https://console.cloud.google.com/apis/library/compute.googleapis.com/) is enabled for the current project.