Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add DRS publishing #5

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from
Draft

Conversation

nvnieuwk
Copy link

@nvnieuwk nvnieuwk commented Oct 2, 2024

This PR adds the creation of DRS objects on a file publish. This PR currently contains a lot of custom code from our internal implementation so it still needs some love before this can be considered ready for this plugin. I'll add a list here of things I know that still need to happen, feel free to expand this list if you encounter more:

  • DRS object ids are now generated using random UUIDs, while this is expected for our system, other DRS API implementation might expect other IDs. Some system should be created to allow users to customize how the IDs will be generated.
  • Authentication
    • Allow unauthorized DRS requests (although this is probably not 100% useful for file publishing, this can be useful later on when DRS fetching were to be implemented)
    • Implement other Authentication schemes. Currently the plugin only supports BearerAuth while the DRS specs also allow BasicAuth and PassportAuth
  • Add support for all AccessUrl types. Currently only s3 and local files are supported while the specs also specify other types:
    • gs
    • ftp
    • gsiftp
    • globus
    • htsget
    • https (this is probably already supported but I haven't tested it)
  • Currently a custom function is used to determine the name of the DRS object. This will of course only work for our internal implementation so this should be expanded to also work for other implementations.
  • Allow support for multiple versions of the DRS object structure
  • ...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants