Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Add multi-query Presto support #562

Closed
2 of 13 tasks
wild-endeavor opened this issue Oct 21, 2020 · 1 comment
Closed
2 of 13 tasks

[Feature] Add multi-query Presto support #562

wild-endeavor opened this issue Oct 21, 2020 · 1 comment
Labels
enhancement New feature or request

Comments

@wild-endeavor
Copy link
Contributor

Motivation: Why do you think this is important?
When developing the Presto plugin, we overlooked the fact that users can't submit multiple queries within one query like they can in Hive and most other query languages. Thus the practice of setting up temp tables to stage data before a final query is not something that is easily done.

We shoul further investigate this need, and amend the Presto task/plugin to be able to support this use case. Perhaps a series of related queries can be passed in per task that can be run sequentially. This brings in questions around atomicity of course.

Goal: What should the final outcome look like, ideally?
Support users who want to first query into a temp table, and then make a final query. Should investigate if this is possible with with statements in the current framework.

Describe alternatives you've considered
with statements?

Flyte component

  • Overall
  • Flyte Setup and Installation scripts
  • Flyte Documentation
  • Flyte communication (slack/email etc)
  • FlytePropeller
  • FlyteIDL (Flyte specification language)
  • Flytekit (Python SDK)
  • FlyteAdmin (Control Plane service)
  • FlytePlugins
  • DataCatalog
  • FlyteStdlib (common libraries)
  • FlyteConsole (UI)
  • Other

[Optional] Propose: Link/Inline
If you have ideas about the implementation please propose the change. If inline keep it short, if larger then you link to an external document.

Additional context
Add any other context or screenshots about the feature request here.

Is this a blocker for you to adopt Flyte
Please let us know if this makes it impossible to adopt Flyte

@wild-endeavor wild-endeavor added enhancement New feature or request untriaged This issues has not yet been looked at by the Maintainers labels Oct 21, 2020
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 20, 2022
flyteorg#562)

* fix: update timeline view to show dynamic wf internals on first render

Signed-off-by: Olga Nad <[email protected]>

* fix: update tests and clean up code

Signed-off-by: Olga Nad <[email protected]>

* fix: test

Signed-off-by: Olga Nad <[email protected]>

Signed-off-by: Olga Nad <[email protected]>
@kumare3
Copy link
Contributor

kumare3 commented Jun 25, 2023

I think we should close this issue, as Flyte Agent framework can add support for this, if needed

@kumare3 kumare3 removed the untriaged This issues has not yet been looked at by the Maintainers label Jun 25, 2023
@kumare3 kumare3 closed this as completed Jun 25, 2023
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Jul 24, 2023
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Jul 24, 2023
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Aug 9, 2023
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Aug 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants