Supporting hivePartitioningOptions offered in table.insert in the TF external_data_configuration block

[megaz94]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment. If the issue is assigned to the "modular-magician" user, it is either in the process of being autogenerated, or is planned to be autogenerated soon. If the issue is assigned to a user, that user is claiming responsibility for the issue. If the issue is assigned to "hashibot", a community member has claimed the issue already.

Description

Terraform BigQuery currently does not support ExternalDataConfiguration > hivePartitioningOptions. At the time of writing this message, terraform supports 2 ExternalDataConfiguration options: csvOptions and googleSheetsOptions.

Potential Terraform Configuration

At this time, there is no configuration workaround.

As a hint for the terraform team, note that the constructions of table.insert for hivePartitioningOptions must have the following form:

{
tableReference {},
externalDataConfiguration{schema {}, hivePartitioningOptions{}} // putting the schema inside externalDataConfiguration and not in the outer scope
}

Constructing the JSON in the following way is incorrect and doesn't propagate the hive_keys correctly to the BQ destination table:

{
tableReference {},
schema {},
externalDataConfiguration{hivePartitioningOptions{}}
}

[danawillow]

Duplicate of #5664. The feature has been merged so I think it'll show up in next Monday's release.

[ghost]

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you feel this issue should be reopened, we encourage creating a new issue linking back to this one for added context. If you feel I made an error 🤖 🙉 , please reach out to my human friends 👉 [email protected]. Thanks!