-
Notifications
You must be signed in to change notification settings - Fork 670
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature] Add multi-query Presto support #562
Labels
enhancement
New feature or request
Comments
wild-endeavor
added
enhancement
New feature or request
untriaged
This issues has not yet been looked at by the Maintainers
labels
Oct 21, 2020
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Dec 20, 2022
flyteorg#562) * fix: update timeline view to show dynamic wf internals on first render Signed-off-by: Olga Nad <[email protected]> * fix: update tests and clean up code Signed-off-by: Olga Nad <[email protected]> * fix: test Signed-off-by: Olga Nad <[email protected]> Signed-off-by: Olga Nad <[email protected]>
I think we should close this issue, as Flyte Agent framework can add support for this, if needed |
kumare3
removed
the
untriaged
This issues has not yet been looked at by the Maintainers
label
Jun 25, 2023
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Jul 24, 2023
Signed-off-by: Yee Hing Tong <[email protected]>
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Jul 24, 2023
Signed-off-by: Kevin Su <[email protected]>
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Aug 9, 2023
Signed-off-by: Kevin Su <[email protected]>
eapolinario
pushed a commit
to eapolinario/flyte
that referenced
this issue
Aug 21, 2023
Signed-off-by: Yee Hing Tong <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Motivation: Why do you think this is important?
When developing the Presto plugin, we overlooked the fact that users can't submit multiple queries within one query like they can in Hive and most other query languages. Thus the practice of setting up temp tables to stage data before a final query is not something that is easily done.
We shoul further investigate this need, and amend the Presto task/plugin to be able to support this use case. Perhaps a series of related queries can be passed in per task that can be run sequentially. This brings in questions around atomicity of course.
Goal: What should the final outcome look like, ideally?
Support users who want to first query into a temp table, and then make a final query. Should investigate if this is possible with with statements in the current framework.
Describe alternatives you've considered
with statements?
Flyte component
[Optional] Propose: Link/Inline
If you have ideas about the implementation please propose the change. If inline keep it short, if larger then you link to an external document.
Additional context
Add any other context or screenshots about the feature request here.
Is this a blocker for you to adopt Flyte
Please let us know if this makes it impossible to adopt Flyte
The text was updated successfully, but these errors were encountered: