Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Debug dataproc failed presubmits #1119

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Debug dataproc failed presubmits #1119

wants to merge 1 commit into from

Conversation

bcheena
Copy link
Contributor

@bcheena bcheena commented Dec 5, 2023 •
edited
Loading

Do not merge this PR. Only for debugging purposes.

@bcheena
Copy link
Contributor Author

bcheena commented Dec 5, 2023

/gcbrun

@bcheena
Copy link
Contributor Author

bcheena commented Dec 5, 2023

This is the error after debug logs:

Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220014553Z ==================== Test output for //knox:test_knox (shard 6 of 6):
Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220021987Z Running tests under Python 3.8.10: /usr/bin/python3
Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220045910Z W1205 08:20:47.712818 140201952642880 dataproc_test_case.py:57] Printing debug logs for project here
Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220085387Z W1205 08:20:49.442378 140201952642880 dataproc_test_case.py:58] (1, '', 'ERROR: gcloud failed to load. You are running gcloud with Python 3.11, which is not currently supported by gcloud.\nInstall a compatible version of Python 3.8-3.10 and set the CLOUDSDK_PYTHON environment variable to point to it.\n\nIf you are still experiencing problems, please reinstall the Google Cloud CLI using the instructions here:\n    https://cloud.google.com/sdk/docs/install\n')
Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220094003Z W1205 08:20:49.442851 140201952642880 dataproc_test_case.py:59] 
Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220101885Z W1205 08:20:51.024891 140201952642880 dataproc_test_case.py:64] Printing debug logs for region here
Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220109438Z W1205 08:20:52.446720 140201952642880 dataproc_test_case.py:65] (1, '', 'ERROR: gcloud failed to load. You are running gcloud with Python 3.11, which is not currently supported by gcloud.\nInstall a compatible version of Python 3.8-3.10 and set the CLOUDSDK_PYTHON environment variable to point to it.\n\nIf you are still experiencing problems, please reinstall the Google Cloud CLI using the instructions here:\n    https://cloud.google.com/sdk/docs/install\n')
Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220116263Z W1205 08:20:52.447159 140201952642880 dataproc_test_case.py:66] 
Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220130123Z [  FAILED  ] setUpClass (__main__.KnoxTestCase)
Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220140215Z ======================================================================
Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220162364Z ERROR: setUpClass (__main__.KnoxTestCase)
Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220170769Z ----------------------------------------------------------------------
Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220178225Z Traceback (most recent call last):
Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220186764Z   File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/knox/test_knox.runfiles/__main__/integration_tests/dataproc_test_case.py", line 68, in setUpClass
Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220194241Z     assert cls.PROJECT
Step #4 - "dataproc-1.5-ubuntu18-tests": 2023-12-05T08:20:54.220201750Z AssertionError

Specifically,

ERROR: gcloud failed to load. You are running gcloud with Python 3.11, which is not currently supported by gcloud.\nInstall a compatible version of Python 3.8-3.10 and set the CLOUDSDK_PYTHON environment variable to point to it.\n\nIf you are still experiencing problems, please reinstall the Google Cloud CLI using the instructions here:\n    https://cloud.google.com/sdk/docs/install\n'

@bcheena
Copy link
Contributor Author

bcheena commented Dec 5, 2023

The latest version of gcloud mentions python support extended upto 3.11.6 in the release notes.

gcloud somehow picks up its own bundled 3.11 and claims to have the wrong version. I was able to check this internally where in one of our frontend checks, we had not modified MAX_SUPPORTED_PY3_VERSION from 3.10 to 3.11. This has been fixed in a change raised on Dec 1st and should be available in prod soon.

No action from our side should be needed to fix this presubmit.

@bcheena
Copy link
Contributor Author

bcheena commented Dec 6, 2023

/gcbrun

6 similar comments
@bcheena
Copy link
Contributor Author

bcheena commented Dec 8, 2023

/gcbrun

@bcheena
Copy link
Contributor Author

bcheena commented Dec 11, 2023

/gcbrun

@bcheena
Copy link
Contributor Author

bcheena commented Dec 12, 2023

/gcbrun

@bcheena
Copy link
Contributor Author

bcheena commented Dec 18, 2023

/gcbrun

@bcheena
Copy link
Contributor Author

bcheena commented Jan 3, 2024

/gcbrun

@bcheena
Copy link
Contributor Author

bcheena commented Jan 18, 2024

/gcbrun

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@bcheena