Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for Spark 3.0 #426

Closed
1 of 13 tasks
akhurana001 opened this issue Jul 22, 2020 · 1 comment
Closed
1 of 13 tasks

Add support for Spark 3.0 #426

akhurana001 opened this issue Jul 22, 2020 · 1 comment
Assignees
Labels
enhancement New feature or request
Milestone

Comments

@akhurana001
Copy link
Contributor

akhurana001 commented Jul 22, 2020

Motivation: Why do you think this is important?
Spark 3.0 was released a while ago. Flyte currently supports 2.4.x via flytekit. Add support for Spark 3.0

Goal: What should the final outcome look like, ideally?
A clear and concise description of what you want to happen or achieve.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Flyte component

  • Overall
  • Flyte Setup and Installation scripts
  • Flyte Documentation
  • Flyte communication (slack/email etc)
  • FlytePropeller
  • FlyteIDL (Flyte specification language)
  • Flytekit (Python SDK)
  • FlyteAdmin (Control Plane service)
  • FlytePlugins
  • DataCatalog
  • FlyteStdlib (common libraries)
  • FlyteConsole (UI)
  • Other

[Optional] Propose: Link/Inline
If you have ideas about the implementation please propose the change. If inline keep it short, if larger then you link to an external document.

Additional context
Add any other context or screenshots about the feature request here.

Is this a blocker for you to adopt Flyte
Please let us know if this makes it impossible to adopt Flyte

@akhurana001 akhurana001 added enhancement New feature or request untriaged This issues has not yet been looked at by the Maintainers labels Jul 22, 2020
@akhurana001 akhurana001 self-assigned this Jul 22, 2020
@akhurana001 akhurana001 added this to the 0.6.0 milestone Jul 22, 2020
@kumare3 kumare3 removed the untriaged This issues has not yet been looked at by the Maintainers label Jul 22, 2020
@akhurana001
Copy link
Contributor Author

Available via https://github.com/lyft/flytekit/releases/tag/v0.10.10 or higher. Marking as done.

eapolinario added a commit to eapolinario/flyte that referenced this issue Dec 6, 2022
Signed-off-by: Eduardo Apolinario <[email protected]>

Co-authored-by: Eduardo Apolinario <[email protected]>
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 6, 2022
* Added base64 encoding for metadata field

Signed-off-by: Prafulla Mahindrakar <[email protected]>

* Fixed unit test

Signed-off-by: Prafulla Mahindrakar <[email protected]>

* removed empty test

Signed-off-by: Prafulla Mahindrakar <[email protected]>

* returing error during decode

Signed-off-by: Prafulla Mahindrakar <[email protected]>
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 20, 2022
* Update Flytesnacks Contribution Guide

Signed-off-by: Samhita Alla <[email protected]>

* fix README

Signed-off-by: Samhita Alla <[email protected]>

* fix README

Signed-off-by: Samhita Alla <[email protected]>

* fix README

Signed-off-by: Samhita Alla <[email protected]>

* fix README

Signed-off-by: Samhita Alla <[email protected]>

* add docs env setup

Signed-off-by: Samhita Alla <[email protected]>

* add docs env setup

Signed-off-by: Samhita Alla <[email protected]>
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 20, 2022
BREAKING CHANGE: BREAKING CHANGE
Signed-off-by: Nastya Rusina <[email protected]>
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 20, 2022
eapolinario added a commit to eapolinario/flyte that referenced this issue Aug 9, 2023
Signed-off-by: Eduardo Apolinario <[email protected]>

Co-authored-by: Eduardo Apolinario <[email protected]>
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Aug 21, 2023
* Added base64 encoding for metadata field

Signed-off-by: Prafulla Mahindrakar <[email protected]>

* Fixed unit test

Signed-off-by: Prafulla Mahindrakar <[email protected]>

* removed empty test

Signed-off-by: Prafulla Mahindrakar <[email protected]>

* returing error during decode

Signed-off-by: Prafulla Mahindrakar <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants