Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DSIP-13][Feature][Python] Adding a resource file loading plugin to the DolphinScheduler Python API #10911

Closed
21 tasks done
Tracked by #14102
xdu-chenrj opened this issue Jul 12, 2022 · 9 comments
Closed
21 tasks done
Tracked by #14102
Assignees
Labels

Comments

@xdu-chenrj
Copy link
Contributor

xdu-chenrj commented Jul 12, 2022

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Description

  • Decorator implementation
    • A simple Resource plugin that supports local files
    • Local Resource Plugin Refinement
  • GitHub Resource Plugin
    • Private Repository Authentication
    • File Reading
      • Shared Repository File Reading
      • Private Repository File Reading
  • GitLab Resource Plugin
    • Private Authentication
    • File Reading
  • Amazon S3 Resource Plugin
    • Private Authentication
    • File Reading
  • AliCloud OSS Resource Plugin
    • Private Authentication
    • File Reading
  • Other special file reads for different plugins

Use case

No response

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@xdu-chenrj xdu-chenrj added feature new feature Waiting for reply Waiting for reply labels Jul 12, 2022
@github-actions
Copy link

Thank you for your feedback, we have received your issue, Please wait patiently for a reply.

  • In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
  • If you haven't received a reply for a long time, you can join our slack and send your question to channel #troubleshooting

@zhongjiajie zhongjiajie added soc and removed Waiting for reply Waiting for reply labels Jul 12, 2022
@zhongjiajie
Copy link
Member

Same TIPs from #10905 (comment)

@zhongjiajie
Copy link
Member

zhongjiajie commented Jul 12, 2022

tests and documents not included in your tasks, it is ok not exists in tasks but I hope you will submit both tests and documents in each task's PR, Specifically how a developer develops a new plugin

@xdu-chenrj
Copy link
Contributor Author

tests and documents not included in your tasks, it is ok not exists in tasks but I hope you will submit both tests and documents in each task's PR, Specifically how a developer develops a new plugin

ok

@zhongjiajie zhongjiajie changed the title [Feature][Python] Adding a resource file loading plugin to the DolphinScheduler Python API [DSIP-13][Feature][Python] Adding a resource file loading plugin to the DolphinScheduler Python API Jul 28, 2022
@EricGao888
Copy link
Member

@xdu-chenrj I could help with the AliCloud OSS Resource Plugin if you don't mind : )

@EricGao888
Copy link
Member

@xdu-chenrj I could help with the AliCloud OSS Resource Plugin if you don't mind : )

related: #11683

@zhongjiajie
Copy link
Member

maybe we should better follow the DSIP process and introduce this feature to our community

@zhongjiajie
Copy link
Member

already done

@Capricorn0010
Copy link

have a test sample yaml file?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants