Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow access to netCDF-4 files in S3 object stores #285

Closed
davidhassell opened this issue Feb 12, 2024 · 0 comments · Fixed by #307
Closed

Allow access to netCDF-4 files in S3 object stores #285

davidhassell opened this issue Feb 12, 2024 · 0 comments · Fixed by #307
Labels
enhancement New feature or request netCDF read Relating to reading netCDF datasets
Milestone

Comments

@davidhassell
Copy link
Contributor

Currently netCDF files are only opened and read by the netCDF4 library. However, netCDF4 can't read files in S3 object stores.

h5netcdf, on the other hand can, access S3 netCDF-4 files (but not netCDF-3).

A new default behaviour for an arbitrary file should be to try netCDF4, and fall back on h5netcdf if that doesn't work. There should also be the option to cfdm.read to specifically choose one or other of the libraries.

Access to an S3 object store may require credentials, which will need to be passed in via a new cfdm.read argument.

@davidhassell davidhassell added enhancement New feature or request netCDF read Relating to reading netCDF datasets labels Feb 12, 2024
@davidhassell davidhassell added this to the Next release milestone Feb 12, 2024
@davidhassell davidhassell modified the milestones: 1.11.1.0, H5 Apr 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request netCDF read Relating to reading netCDF datasets
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant