Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Trino blueprint upgrade #702

Merged
merged 7 commits into from
Nov 12, 2024
Merged

feat: Trino blueprint upgrade #702

merged 7 commits into from
Nov 12, 2024

Conversation

vara-bonthu
Copy link
Collaborator

@vara-bonthu vara-bonthu commented Nov 9, 2024

What does this PR do?

🛑 Please open an issue first to discuss any significant work and flesh out details/direction. When we triage the issues, we will add labels to the issue like "Enhancement", "Bug" which should indicate to you that this issue can be worked on and we are looking forward to your PR. We would hate for your time to be wasted.
Consult the CONTRIBUTING guide for submitting pull-requests.

  • Trino Blueprint upgrade with latest addons
  • Trino helm chart config to scale for large scale workloads

Motivation

More

  • Yes, I have tested the PR using my local account setup (Provide any test evidence report under Additional Notes)
  • Mandatory for new blueprints. Yes, I have added a example to support my blueprint PR
  • Mandatory for new blueprints. Yes, I have updated the website/docs or website/blog section for this feature
  • Yes, I ran pre-commit run -a with this PR. Link for installing pre-commit locally

For Moderators

  • E2E Test successfully complete before merge?

Additional Notes

@vara-bonthu vara-bonthu marked this pull request as ready for review November 10, 2024 07:10
@@ -69,17 +145,4 @@ serviceAccount:
create: true
name: ${sa}
ingress:
enabled: true
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed to avoid creating a public load balancer

Copy link
Collaborator

@ratnopamc ratnopamc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

coordinator:
jvm:
maxHeapSize: "8G"
maxHeapSize: "32G" # ~80% of container memory
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we add some description in the website doc explaining rationale behind setting these values.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agree! Planning to update the Trino website doc in the second PR with all the best practices.

@vara-bonthu vara-bonthu merged commit f8dda1a into main Nov 12, 2024
35 of 39 checks passed
Comment on lines +107 to +109
- "query.max-hash-partition-count=100" # Updated from query.hash-partition-count
- "spill-enabled=true" # Updated from experimental.spill-enabled
- "spiller-spill-path=/tmp/spill" # Chagne this to SSD mount for faster
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we add note in the documentation about spill to disk and how it helps.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants