Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Filesystem - Shared Folders #1727

Open
1 task
mrnicegyu11 opened this issue Sep 23, 2024 · 3 comments
Open
1 task

Filesystem - Shared Folders #1727

mrnicegyu11 opened this issue Sep 23, 2024 · 3 comments
Assignees
Labels
PO issue Created by Product owners

Comments

@mrnicegyu11
Copy link
Member

mrnicegyu11 commented Sep 23, 2024

In light of potentially using EBS instead of EFS:

Can we mount the EBS drive into multiple ec2 instances or do we offer the possibility to run mulitple services on a dedicated ec2 instance? ITISFoundation/osparc-simcore#5669

The users filesystem in a dynamic sidecar shall be extended by and additional folder called share:

- work/workspace
- work/inputs
- work/outputs
- work/share

Similar to the workspace folder share can be cached on the efs. The folder itself however has some additional properties:

  1. It is not tied to a node_id but rather to a project_id and or user_id. It can be mounted into several services concurently (shared).
  2. The content itself is stored in S3 in the same way the work folder is.
  3. To reduce complexity, we will start with a project wide shared folder. Sharing a study should then work by giving the sharee access to all files.
  4. The files are either stored in: s3/project_id/ or s3/user_id/project_id whatever works best.
  5. In the long term, users will be able to interact with this part of the filesystem through the file broswer in the project homepage
  6. Initilally, this will be made availalbe to selected users to receive early feedback

Event Horizon

No tasks being tracked yet.

Tasks

@mrnicegyu11 mrnicegyu11 added this to the MartinKippenberger milestone Sep 23, 2024
@mrnicegyu11 mrnicegyu11 added the PO issue Created by Product owners label Sep 23, 2024
@mrnicegyu11
Copy link
Member Author

old case #1313

@mguidon
Copy link
Member

mguidon commented Nov 5, 2024

Roadmap:

  1. Add shared folder concept (efs and dynamic-sidecar change)
  2. Listing in storage needs to inlucde shared folder
  3. How to do sharing/copying of projects if there is a shared folder present

@matusdrobuliak66
Copy link
Contributor

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
PO issue Created by Product owners
Projects
None yet
Development

No branches or pull requests

3 participants