Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Improvement]: Extract Spark Common Module to reuse code between different spark versions. #1449

Closed
3 tasks done
Tracked by #1930
baiyangtx opened this issue May 19, 2023 · 0 comments · Fixed by #1858
Closed
3 tasks done
Tracked by #1930

[Improvement]: Extract Spark Common Module to reuse code between different spark versions. #1449

baiyangtx opened this issue May 19, 2023 · 0 comments · Fixed by #1858
Labels
module:mixed-spark Spark module for Mixed Format type:improvement

Comments

@baiyangtx
Copy link
Contributor

Search before asking

  • I have searched in the issues and found no similar issues.

What would you like to be improved?

Too much duplicate codes in spark 3.x modules. we can extract a common module to reuse those codes.

How should we improve?

Extract a spark common module to reuse codes:

  1. to reuse tests like SQL tests.
  2. to reuse util class which dosen't matter with spark version or depend on stable api

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Subtasks

No response

Code of Conduct
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
module:mixed-spark Spark module for Mixed Format type:improvement
Projects
None yet
Milestone
No milestone
1 participant
@baiyangtx