google_bigquery_job wait for job complete

[YuriiYashchenko]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment. If the issue is assigned to the "modular-magician" user, it is either in the process of being autogenerated, or is planned to be autogenerated soon. If the issue is assigned to a user, that user is claiming responsibility for the issue. If the issue is assigned to "hashibot", a community member has claimed the issue already.

Description

google_bigquery_job resource can create a long-running job, for example, BQ script. After the job is triggered, Terraform doesn't wait until it is completed and marks the resource as successfully created. There is no way to know when is it's safe to use results. If some other resource depends on the job results, there is an issue with describing this dependency without using a workaround such as additional time_sleep resource. It would be nice to have an option like wait_for_job_complete to wait for DONE state.

New or Affected Resource(s)

• google_bigquery_job

Potential Terraform Configuration

resource "google_bigquery_job" "item_recreate_job" {
  project  = var.project_id
  location = var.location
  job_id   = format("Item_%s", uuid())
  query {
    query          = <<EOF
     #standardSQL 
    select * 
    FROM dwh.Item_view
EOF
    use_legacy_sql = false
    destination_table {
      project_id = var.project_id
      dataset_id = google_bigquery_dataset.bi_star.dataset_id
      table_id   = "Item"
    }
    write_disposition = "WRITE_TRUNCATE"
  }
  wait_for_job_complete=true
}

References

• #0000