BigQueryCreateExternalTableOperator uses deprecated function

[eladkal]

Body

The BigQueryCreateExternalTableOperator uses create_external_table:

airflow/airflow/providers/google/cloud/operators/bigquery.py

Lines 1131 to 1147 in cd49a8b

	table = bq_hook.create_external_table(
	external_project_dataset_table=self.destination_project_dataset_table,
	schema_fields=schema_fields,
	source_uris=source_uris,
	source_format=self.source_format,
	autodetect=self.autodetect,
	compression=self.compression,
	skip_leading_rows=self.skip_leading_rows,
	field_delimiter=self.field_delimiter,
	max_bad_records=self.max_bad_records,
	quote_character=self.quote_character,
	allow_quoted_newlines=self.allow_quoted_newlines,
	allow_jagged_rows=self.allow_jagged_rows,
	src_fmt_configs=self.src_fmt_configs,
	labels=self.labels,
	encryption_configuration=self.encryption_configuration,
	)

this function is deprecated:

airflow/airflow/providers/google/cloud/hooks/bigquery.py

Lines 598 to 602 in 511d0ee

	warnings.warn(
	"This method is deprecated. Please use `BigQueryHook.create_empty_table` method with "
	"passing the `table_resource` object. This gives more flexibility than this method.",
	DeprecationWarning,
	)

The task:
Refactor/change the operator to replace create_external_table with create_empty_table.

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[cswpy]

Hello @eladkal, I can take this issue.

[eladkal]

@cswpy assigned

[cswpy]

Thanks for assigning me the task.
I took a look at the code and I want to make sure that my approach is correct before proceeding. I should create a table_resouce (where I would define info relating to the external table) object to pass into the create_empty_table?

[potiuk]

I think it's better to discuss with the code and in PR - make a draft PR with your proposal and it can be discussed there - it's far easier this way because the discussion can be focused around the actual code without looking it up and guessing what you really want to do @cswpy.

[cswpy]

Thanks for the tip @potiuk. I will come up with something and submit a PR.