Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create folders when needed, rather than at beginning? #3

Open
shinzlet opened this issue Oct 9, 2024 · 1 comment
Open

Create folders when needed, rather than at beginning? #3

shinzlet opened this issue Oct 9, 2024 · 1 comment

Comments

@shinzlet
Copy link
Collaborator

shinzlet commented Oct 9, 2024

Right now we create an empty zarr archive folder structure at the destination before starting softcopy. However this means that, if the user says they're gonna acquire 1000 timepoints but only acquires 3, we have lots of folders on the destination that don't neccessarily exist at the source. Although I'm not sure if tensorstore creates folders on demand either - this might be a moot point.

@shinzlet
Copy link
Collaborator Author

shinzlet commented Oct 9, 2024

This is actually useful in either case for tensorstore - it takes a long time to create ~10^4 folders on our cluster, and so it would probably be a lot faster to create them on demand

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant