AIRFLOW-15: Remove gcloud

[criccomini]

https://issues.apache.org/jira/browse/AIRFLOW-15

[landscape-bot]

Repository health decreased by 0.25% when pulling 1218120 on criccomini:remove-gcloud into 6cbe4a4 on airbnb:master.

• 1 new problem was found (including 0 errors and 1 code smell).
• 2 problems were fixed (including 0 errors and 2 code smells).

[criccomini]

Test failure is due to deletion of some files, which reduces license header count.

[landscape-bot]

Repository health decreased by 0.18% when pulling c2dc266 on criccomini:remove-gcloud into 6cbe4a4 on airbnb:master.

• 1 new problem was found (including 0 errors and 1 code smell).
• 2 problems were fixed (including 0 errors and 2 code smells).

[criccomini]

I added some license headers to make the tests pass.

[coveralls]

Changes Unknown when pulling c2dc2665a2fa56b5d4c5d276794aa59dbe2110f4 on criccomini:remove-gcloud into * on airbnb:master*.

[jlowin]

I think the logging.error() that is below this line (not shown in github diff) should now go inside this except statement. Otherwise it prints the error every time

[criccomini]

Nice catch. Fixing.

[jlowin]

Please see my one comment about the error always printing. Also, I tried running this in my local env with no key in the Airflow connection (in other words, using global gcloud auth) and got the following message:

INFO:root:Getting connection using `gcloud auth` user, since no service_account/key_path are defined for hook.
WARNING:oauth2client.util:__init__() takes at most 2 positional arguments (3 given)

But I'm not sure if this matters (or even if it's on the Airflow side), since it appears to read/write the logs to GCS just fine.

One last thought -- would be great to bump this up to oauth2client 2.0 compatibility. Maybe not this PR but at some point. This is the offending line: from oauth2client.client import SignedJwtAssertionCredentials, GoogleCredentials. I think the signed credentials just need to be pulled from a different module but I don't know the library well so I'm not sure.

[jlowin]

I just saw your message on the Apache issue that you're already looking at compatibility issues :) Sorry for being repetitive. Need to get used to the split infrastructure...

[landscape-bot]

Repository health decreased by 0.18% when pulling 844eb2c on criccomini:remove-gcloud into 6cbe4a4 on airbnb:master.

• 3 new problems were found (including 0 errors and 3 code smells).
• 4 problems were fixed (including 0 errors and 4 code smells).

[coveralls]

Changes Unknown when pulling 844eb2c on criccomini:remove-gcloud into * on airbnb:master*.

[criccomini]

@jlowin updated based on your feedback.

Could I get a +1?

Re: oauth compatibility, I'll bump to latest as part of https://issues.apache.org/jira/browse/AIRFLOW-16

[jlowin]

Looking good to me @criccomini. Merge away.