CI: Add support for Python 3.12

[amotl]

About

Trying to bring in support for Python 3.12, to be released on 2023-10-02 ¹.

Details

NumPy compatibility for Python 3.12 (numpy/numpy#23808) is probably only one step-stone towards Python 3.12. The build will probably fail due to various other reasons.

Footnotes

1. https://devguide.python.org/versions/ ↩

[amotl]

Note

There is a warning at run #6213169937, but the installation process succeeded, and software testing proceeds.

Warning:
The specified Python version (3.12.0) is not supported by the project (^3.9,<3.12).
Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.

Solution

Relax the constraint over here.

wetterdienst/pyproject.toml

Lines 101 to 102 in de40c3b

	[tool.poetry.dependencies]
	python = "^3.9,<3.12"

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 90.82%. Comparing base (011a7e9) to head (756357b).
Report is 336 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1008      +/-   ##
==========================================
+ Coverage   90.41%   90.82%   +0.40%     
==========================================
  Files         103      103              
  Lines        9828     9828              
  Branches     1128     1128              
==========================================
+ Hits         8886     8926      +40     
+ Misses        747      706      -41     
- Partials      195      196       +1     

Flag	Coverage Δ
unittests	90.82% <ø> (+0.40%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[amotl]

Apparently, the installation of the geojson package fails on Python 3.12, so we reported it to the upstream maintainers, and submitted a fix.

• Compatibility with Python 3.12 jazzband/geojson#221
• Add support for Python 3.12 jazzband/geojson#222

[amotl]

The patch jazzband/geojson#222 has been merged, but geojson release is yet pending.
Edit: I've asked for a PyPI release at jazzband/geojson#221 (comment).

[amotl]

Observations I

h5py is failing to be pulled in on Python 3.12.

Loading library to get build settings and version: libhdf5.so
error: Unable to load dependency HDF5, make sure HDF5 is installed properly
Library dirs checked: []
error: libhdf5.so: cannot open shared object file: No such file or directory

-- https://github.com/earthobservations/wetterdienst/actions/runs/6526603320/job/17720521769?pr=1008#step:6:227

Observations II

On the other hand, it looks like wheel packages for Python 3.12 are available since Oct 9, 2023.

-- https://pypi.org/project/h5py/#files

Action?

We will probably need to relax this version constraint.

h5py = { version = ">=3.1,<3.10", optional = true}

-- https://github.com/earthobservations/wetterdienst/blob/v0.64.0/pyproject.toml#L199

[amotl]

Thanks for updating. Windows tests are failing because it tries to build DuckDB ¹? Even the latest pre-release does not offer wheels for Python 3.12 ², so we may want to skip it in one way or another, in order to make Wetterdienst support Python 3.12 in general?

Footnotes

1. https://github.com/earthobservations/wetterdienst/actions/runs/7303009067/job/19902700550?pr=1008#step:6:928 ↩

2. https://pypi.org/project/duckdb/0.9.3.dev1990/#files ↩

[gutzbenj]

Yes, I suggest we skip duckdb installation in CI under 3.12 and make the duckdb test fully optional (I guess it is already?!).

[amotl]

Excellent. Thanks for taking care, Benjamin. I've just added a suggestion about the test skipping.