0.10.0

[forman]

Changes in 0.10.0

Incompatible Changes

• The configuration DataStores for xcube serve changed in an
  incompatible way with xcube 0.9.x: The value of former Identifier
  must now be assigned to Path, which is a mandatory parameter.
  Path may contain wildcard characters **, *, ?.
  Identifier is now optional, the default is
  "${store_id}~${data_id}. If given, it should only be used to
  uniquely identify single datasets within a data store
  pointed to by Path. (Unify xcube dataset i/o #516)

Enhancements

• It is now possible to use environment variables in most
  xcube configuration files. Unix bash syntax is used, i.e.
  ${ENV_VAR_NAME} or $ENV_VAR_NAME. (xcube gen2 DataStore configuration to understand env var references #580)

  Supported tools include

  • xcube gen --config CONFIG
  • xcube gen2 --stores STORES_CONFIG --service SERVICE_CONFIG
  • xcube serve -c CONFIG

• Changed the xcube gen tool to extract metadata for pre-sorting inputs
  from other than NetCDF inputs, e.g. GeoTIFF.

• Optimized function xcube.core.geom.rasterize_features().
  It is now twice as fast while its memory usage dropped to the half. (Daskify geometry operations #593)

Fixes

• xcube serve now also serves datasets that are located in
  subdirectories of filesystem-based data stores such as
  "file", "s3", "memory". (xcube server cannot serve nested datasets #579)

• xcube serve now accepts datasets whose spatial
  resolutions differ up to 1%. (xcube serve too strict wrt spatial x,y resolutions #590)
  It also no longer rejects datasets with large dimension
  sizes. (Formerly, an integer-overflow occurred in size
  computation.)

• DatasetChunkCacheSize is now optional in xcube serve
  configuration. (Formerly, when omitted, the server crashed.)

• Fixed bug that would cause that requesting data ids on some s3 stores would
  fail with a confusing ValueError.

• Fixed that only last dataset of a directory listing was published via
  xcube serve when using the DataStores configuration with
  filesystem-based datastores such as "s3" or "file". (Only last configured Identifier is published via xcube serve for StoreID: s3  #576)

Other

• Pinned Python version to < 3.10 to avoid import errors caused by a
  third-party library.

• Values obs and local for the FileSystem parameter in xcube
  configuration files have been replaced by s3 and file, but are kept
  temporarily for the sake of backwards compatibility.

All Issues addressed

• Martin's gen support for geotiff inputs by @martin-boettcher in Martin's gen support for geotiff inputs #568
• naming of secrets GH PAT in the GH actions workflow by @dzelge in naming of secrets GH PAT in the GH actions workflow #575
• Pinning openssl to fix failing unittest on mac by @AliceBalfanz in Pinning openssl to fix failing unittest on mac #578
• Use env vars in configs by @forman in Use env vars in configs #582
• Restrict python version by @TonioF in Restrict python version #584
• Retrieval of Data IDs fails on some s3 stores by @TonioF in Retrieval of Data IDs fails on some s3 stores #587
• Only last configured Identifier is published via xcube serve by @TonioF in Only last configured Identifier is published via xcube serve #589
• now also serve nested datasets by @forman in now also serve nested datasets #588
• Revise spatial x,y resolutions check by @forman in Revise spatial x,y resolutions check #591
• extract CLI: ensure CSV times are timezone-naive by @pont-us in extract CLI: ensure CSV times are timezone-naive #596
• Daskify geometry operations, Part 1 by @forman in Daskify geometry operations, Part 1 #594
• Fixing tests for accessing data from xcube server via python api by @AliceBalfanz in Fixing tests for accessing data from xcube server via python api #592
• Toniof 598 gridmapping test fail by @TonioF in Toniof 598 gridmapping test fail #599
• Unify Dataset IO by @TonioF in Unify Dataset IO #535
• Tile server: ensure timezone-naive time selector by @pont-us in Tile server: ensure timezone-naive time selector #602
• Replaced file system values obs and local with s3 and file by @TonioF in Replaced file system values obs and local with s3 and file #600
• Corrected retrieval of store params by @TonioF in Corrected retrieval of store params #606
• adapt to zarr 2.11 by @TonioF in adapt to zarr 2.11 #607

New Contributors

• @martin-boettcher made their first contribution in Martin's gen support for geotiff inputs #568

Full Changelog: v0.9.2...v0.10.0

---

This discussion was created from the release 0.10.0.