Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for Hive/Spark on Python 3.12 #148

Merged
merged 6 commits into from
Nov 5, 2024
Merged

Support for Hive/Spark on Python 3.12 #148

merged 6 commits into from
Nov 5, 2024

Conversation

sassmith
Copy link
Contributor

@sassmith sassmith commented Nov 1, 2024 •
edited
Loading

What's New

  • For Hive and Spark connections the PyHive client does not support python 3.12 when an HTTPS connection is used.
  • This PR switches to using the Impyla client which has a beta release that supports python 3.12
  • Impyla client's execute() method is already an asynchronous executor.
  • A connection timeout parameter is set when the connection is created and is provided to the agent in the connection_args.

@linear Linear
Copy link

linear bot commented Nov 1, 2024

MES-903 Upgrade Hive/Spark connection to Python 3.12

@sassmith sassmith changed the title Ssmith/mes 903 upgrade hivespark connection to python 312 Support for Hive/Spark on Python 3.12 Nov 1, 2024
@sassmith sassmith force-pushed the ssmith/mes-903-upgrade-hivespark-connection-to-python-312 branch from 9d1b40d to 0e11e9f Compare November 4, 2024 17:08
@sassmith sassmith marked this pull request as ready for review November 4, 2024 18:07
@sassmith sassmith requested a review from a team as a code owner November 4, 2024 18:07
mrostan
mrostan approved these changes Nov 4, 2024
View reviewed changes
Copy link
Contributor

@mrostan mrostan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!

@sassmith sassmith added this pull request to the merge queue Nov 5, 2024
Merged via the queue into main with commit f8616b5 Nov 5, 2024
5 checks passed
@sassmith sassmith deleted the ssmith/mes-903-upgrade-hivespark-connection-to-python-312 branch November 5, 2024 15:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@mrostan mrostan mrostan approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@sassmith @mrostan