Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data transfer: extend samples to utilize S3 (minio) #34

Closed
5 tasks
paullatzelsperger opened this issue Aug 22, 2023 · 0 comments · Fixed by #179
Closed
5 tasks

Data transfer: extend samples to utilize S3 (minio) #34

paullatzelsperger opened this issue Aug 22, 2023 · 0 comments · Fixed by #179
Assignees
Labels
documentation Improvements or additions to documentation enhancement New feature or request

Comments

@paullatzelsperger
Copy link
Contributor

WHAT

The MXD walkthrough should be extended so that one provider connector, e.g. "Alice" hosts an asset, that is actually stored in S3 (using the MinIO container image).
Bob then transfers the data into some arbitrary location, e.g. his own S3 store.

In the course of this issue, it should also be tested, whether a transfer HTTP -> S3 can be achieved.

WHY

Highlighting standard Tx-EDC use cases and making them accessible for users of MXD.

HOW

  • add terraform resources for MinIO (suggestion: use a kubernetes_deployment)
  • create a bucket on provider side and put some test data into that bucket. This needs to be done automatically, without manual commands. (suggestion: could use a job)
  • add relevant documentation to mxd/README.md outlining the process, including the correct curl command and transfer request JSON
  • repeat for transfers HTTP -> S3
  • Suggestion: after each transfer, show the contents of the relevant database tables on provider and consumer side, to further illustrate what's going on.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation enhancement New feature or request
Projects
None yet
4 participants