Bring gcloud apis up to date for kettle

[MushuEE]

*This still needs testing in staging

Kettle google-cloud packages are severely out of date and there are some methods that have changed/vanished. It will only be come increasingly painful to maintain so proactive updates seems appropriate.

/area kettle
/hold full test
#19358

[MushuEE]

References...
BQ API for insert_rows - This seems to auto handle the schemas now.
BQ API change List for where everything is
BQ pubsub API
BQ client Code

[MushuEE]

At the point that everything feels correct, however pulling data from the database seems to be not working. I am unsure how it is populated in the test and it is quite confusing

[MushuEE]

@spiffxp @amwat This was pretty miserable change... and it was pretty hard to validate some of the new API functionality. I will test in staging this weekend.

[MushuEE]

/label tide/merge-method-squash

[MushuEE]

Tested in staging

root@kettle-staging-56664586d8-7ggpq:/kettle# python3 stream.py --poll kubernetes-jenkins/gcs-changes/kettle   --dataset k8s-gubernator:build --tables staging:0 --stop_at=1

==== 2020-11-03 17:48:38 PST ========================================
PULLED 246
ACK irrelevant 245
EXTEND-ACK  1

/hold cancel
@spiffxp @amwat

[spiffxp]

/approve
/lgtm

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: MushuEE, spiffxp

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• kettle/OWNERS [MushuEE,spiffxp]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment