Community Meeting - December 1st at 1 PM Eastern

[abkfenris]

Ahh, it's about that time again for another community meeting. Shout if you need an invite.

[abkfenris]

Attendees:

• Joe Hamman / Earthmover / @jhamman
• Alex Kerney / Gulf of Maine Research Institute / @abkfenris
• Matthew Iannucci / RPS Ocean Science / @mpiannucci
• Jonathan Joyce / RPS Ocean Science / @jonmjoyce
• Kristen Thyng
• Shane St Savage
• Xavier Nogueira / LimnoTech / @xaviernogueira

Agenda and Notes:

• Who will be at AGU?
  • Just Joe
  • Jonathan will present at AMS remotely. Jan 30 at 5pm EST.
• Xpublish OpenDAP
  • Bug in opendap plugin related to datatypes
  • Xavier going to look into it
    • Change how we access dtype xpublish-opendap#45
• WMS
  • done with the implementation part
  • Making the GetFeatureInfo more accurate based on grid cell and interpolating rather than just finding the nearest node
  • Tested with a bunch of unstructured models
  • examples via https://nextgen-dev.ioos.us/xreds/
  • Working reasonably well, if there are any datasets that don't work, let Matt know
    • He's mainly working from the NOMADS bucket, not CO-OPs
    • Except for the St John's river model as it's a hot mess
  • Support NcWMS extensions?
    • GetTimeseries is supported
    • Some others aren't that RPS isn't using
  • wms capabilities
  • OceansMap uses a seperate catalog that aggregates multiple servers rather than hitting /datasets/
  • Room for optimization if a stateful cache can be used somehow
• Async
  • Eventually want to figure out async workflows with xpublish routes
  • Alex started dask provider workflow
• Caching
  • Possibility of using redis to cache zarr values (metadata, chunks) which can be shared among instances of xpublish when used in a cluster
  • Not sure if fsspec, zarr/xarray, or xpublish is the right level for this functionality
  • If you want to provide predictable caching, you may want to turn Xarray's caching off
  • Not sure there is much benefit of redis over dask persist beyond TTL functionality

High-level ideas for improving xpublish capabilities: https://github.com/orgs/xpublish-community/discussions/19