Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: Test build with latest dependencies #257

Merged
merged 3 commits into from
Mar 1, 2021

Conversation

snowman2
Copy link
Member

No description provided.

@codecov
Copy link

codecov bot commented Feb 26, 2021

Codecov Report

Merging #257 (7bfb363) into master (63ce87f) will increase coverage by 0.15%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #257      +/-   ##
==========================================
+ Coverage   93.78%   93.94%   +0.15%     
==========================================
  Files          12       12              
  Lines        1352     1354       +2     
==========================================
+ Hits         1268     1272       +4     
+ Misses         84       82       -2     
Impacted Files Coverage Δ
rioxarray/raster_array.py 98.25% <0.00%> (+0.01%) ⬆️
rioxarray/_io.py 87.67% <0.00%> (+0.54%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 63ce87f...7bfb363. Read the comment docs.

@djhoese
Copy link
Contributor

djhoese commented Feb 26, 2021

FYI We borrowed from the dask/xarray crew and install unstable numpy too:

https://github.com/pytroll/satpy/blob/5504ea48a77969ec0df1ccdfdb51b73aa8b575c0/.github/workflows/ci.yaml#L97-L112

          python -m pip install \
          -f https://7933911d6844c6c53a7d-47bd50c35cd79bd838daf386af554a83.ssl.cf2.rackcdn.com \
          --no-deps --pre --upgrade \
          matplotlib \
          numpy \
          pandas \
          scipy; \
          python -m pip install \
          --no-deps --upgrade \
          git+https://github.com/dask/dask \
          git+https://github.com/dask/distributed \
          git+https://github.com/zarr-developers/zarr \
          git+https://github.com/Unidata/cftime \
          git+https://github.com/mapbox/rasterio \
          git+https://github.com/pydata/bottleneck \
          git+https://github.com/pydata/xarray;

@snowman2
Copy link
Member Author

@djhoese thanks for the reference. Unfortunately, I think it is outdated ref.

Most people have moved to Anaconda.org instead now - there's a slightly complicated example in https://github.com/MacPython/pandas-wheels/blob/master/azure/posix.yml - see the end of the file.

@snowman2
Copy link
Member Author

New path? https://pypi.anaconda.org/scipy-wheels-nightly/simple

@snowman2
Copy link
Member Author

snowman2 commented Feb 26, 2021

          python -m pip install \
            --index-url https://pypi.anaconda.org/scipy-wheels-nightly/simple \
            --trusted-host pypi.anaconda.org \
            --no-deps --pre --upgrade \
            numpy \
            pandas \
            scipy;

@snowman2 snowman2 changed the title CI: Test build with latest xarray, rasterio, pyproj dependencies CI: Test build with latest dependencies Feb 26, 2021
djhoese added a commit to pytroll/satpy that referenced this pull request Feb 26, 2021
@snowman2 snowman2 force-pushed the xarray_master branch 2 times, most recently from 4a55604 to 32892dd Compare February 26, 2021 19:44
@djhoese
Copy link
Contributor

djhoese commented Feb 26, 2021

Trying to apply the same URL to the Satpy builds shows a lot of warnings about version inconsistencies and pip not wanting to use the packages.

@djhoese
Copy link
Contributor

djhoese commented Feb 26, 2021

 Collecting scipy
  Downloading https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/1.7.0.dev0%2B5e9eb01/scipy-1.7.0.dev0%2B20210110040759_5e9eb01-cp38-cp38-manylinux1_x86_64.whl (27.3 MB)
WARNING: Discarding https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/1.7.0.dev0%2B5e9eb01/scipy-1.7.0.dev0%2B20210110040759_5e9eb01-cp38-cp38-manylinux1_x86_64.whl (from https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/). Requested scipy from https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/1.7.0.dev0%2B5e9eb01/scipy-1.7.0.dev0%2B20210110040759_5e9eb01-cp38-cp38-manylinux1_x86_64.whl has inconsistent version: filename has '1.7.0.dev0+20210110040759.5e9eb01', but metadata has '1.7.0.dev0+5e9eb01'
  Downloading https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/1.7.0.dev0%2B9b9f2e8/scipy-1.7.0.dev0%2B20210103040256_9b9f2e8-cp38-cp38-manylinux1_x86_64.whl (27.3 MB)
WARNING: Discarding https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/1.7.0.dev0%2B9b9f2e8/scipy-1.7.0.dev0%2B20210103040256_9b9f2e8-cp38-cp38-manylinux1_x86_64.whl (from https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/). Requested scipy from https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/1.7.0.dev0%2B9b9f2e8/scipy-1.7.0.dev0%2B20210103040256_9b9f2e8-cp38-cp38-manylinux1_x86_64.whl has inconsistent version: filename has '1.7.0.dev0+20210103040256.9b9f2e8', but metadata has '1.7.0.dev0+9b9f2e8'
  Downloading https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/1.7.0.dev0%2Bb21b303/scipy-1.7.0.dev0%2B20201227035541_b21b303-cp38-cp38-manylinux1_x86_64.whl (27.2 MB)
WARNING: Discarding https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/1.7.0.dev0%2Bb21b303/scipy-1.7.0.dev0%2B20201227035541_b21b303-cp38-cp38-manylinux1_x86_64.whl (from https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/). Requested scipy from https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/1.7.0.dev0%2Bb21b303/scipy-1.7.0.dev0%2B20201227035541_b21b303-cp38-cp38-manylinux1_x86_64.whl has inconsistent version: filename has '1.7.0.dev0+20201227035541.b21b303', but metadata has '1.7.0.dev0+b21b303'
  Downloading https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/1.7.0.dev0%2B3cc6834/scipy-1.7.0.dev0%2B20201220035335_3cc6834-cp38-cp38-manylinux1_x86_64.whl (27.2 MB)
WARNING: Discarding https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/1.7.0.dev0%2B3cc6834/scipy-1.7.0.dev0%2B20201220035335_3cc6834-cp38-cp38-manylinux1_x86_64.whl (from https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/). Requested scipy from https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/1.7.0.dev0%2B3cc6834/scipy-1.7.0.dev0%2B20201220035335_3cc6834-cp38-cp38-manylinux1_x86_64.whl has inconsistent version: filename has '1.7.0.dev0+20201220035335.3cc6834', but metadata has '1.7.0.dev0+3cc6834'
  Downloading https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/1.7.0.dev0%2B6148b7c/scipy-1.7.0.dev0%2B20201213035410_6148b7c-cp38-cp38-manylinux1_x86_64.whl (27.2 MB)
WARNING: Discarding https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/1.7.0.dev0%2B6148b7c/scipy-1.7.0.dev0%2B20201213035410_6148b7c-cp38-cp38-manylinux1_x86_64.whl (from https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/). Requested scipy from https://pypi.anaconda.org/scipy-wheels-nightly/simple/scipy/1.7.0.dev0%2B6148b7c/scipy-1.7.0.dev0%2B20201213035410_6148b7c-cp38-cp38-manylinux1_x86_64.whl has inconsistent version: filename has '1.7.0.dev0+20201213035410.6148b7c', but metadata has '1.7.0.dev0+6148b7c'
  Downloading scipy-1.6.1-cp38-cp38-manylinux1_x86_64.whl (27.3 MB)

@snowman2
Copy link
Member Author

Maybe --extra-index-url should be --index-url

@snowman2
Copy link
Member Author

Trying to apply the same URL to the Satpy builds shows a lot of warnings about version inconsistencies and pip not wanting to use the packages.

Maybe something to raise upstream?

@djhoese
Copy link
Contributor

djhoese commented Feb 26, 2021

But who/what/where is upstream?

@snowman2
Copy link
Member Author

@snowman2 snowman2 requested a review from justingruca March 1, 2021 15:28
@snowman2
Copy link
Member Author

snowman2 commented Mar 1, 2021

Already catching failures #260

@snowman2 snowman2 merged commit 2049384 into corteva:master Mar 1, 2021
@snowman2 snowman2 deleted the xarray_master branch April 14, 2021 18:14
djhoese added a commit to pytroll/satpy that referenced this pull request Apr 18, 2021
djhoese added a commit to pytroll/satpy that referenced this pull request Apr 18, 2021
* Fix nightly/unstable CI URL

See corteva/rioxarray#257

* Try --index-url instead of --extra-index-url
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants