Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue with catboost and Poetry version 1.4.1 #7692

Closed
4 tasks done
boennecd opened this issue Mar 20, 2023 · 5 comments
Closed
4 tasks done

Issue with catboost and Poetry version 1.4.1 #7692

boennecd opened this issue Mar 20, 2023 · 5 comments
Labels
area/installer Related to the dependency installer kind/bug Something isn't working as expected status/duplicate Duplicate issues status/external-issue Issue is caused by external project (platform, dep, etc)

Comments

@boennecd
Copy link

  • Poetry version: 1.4.1
  • Python version: 3.9.12 (but also on Linux machines)
  • OS version and name: MacOS version 13.2.1
  • pyproject.toml: clean project (see below)
  • I am on the latest stable Poetry version, installed using a recommended method.
  • I have searched the issues of this repo and believe that this is not a duplicate.
  • I have consulted the FAQ and blog for any relevant entries or release notes.
  • If an exception occurs when executing a command, I executed it again in debug mode (-vvv option) and have included the output below.

Issue

If I do the following

curl -sSL https://install.python-poetry.org | python3 - --version 1.4.1
cd ~
poetry new testPoetry  
cd testPoetry
poetry env use 3.9
poetry -vvv add catboost

Then I get

...

• Installing catboost (1.1.1): Failed

  Stack trace:

  5  ~/Library/Application Support/pypoetry/venv/lib/python3.9/site-packages/poetry/installation/executor.py:272 in _execute_operation
      270│ 
      271│             try:
    → 272│                 result = self._do_execute_operation(operation)
      273│             except EnvCommandError as e:
      274│                 if e.e.returncode == -2:

  4  ~/Library/Application Support/pypoetry/venv/lib/python3.9/site-packages/poetry/installation/executor.py:374 in _do_execute_operation
      372│             return 0
      373│ 
    → 374│         result: int = getattr(self, f"_execute_{method}")(operation)
      375│ 
      376│         if result != 0:

  3  ~/Library/Application Support/pypoetry/venv/lib/python3.9/site-packages/poetry/installation/executor.py:494 in _execute_install
      492│ 
      493│     def _execute_install(self, operation: Install | Update) -> int:
    → 494│         status_code = self._install(operation)
      495│ 
      496│         self._save_url_reference(operation)

  2  ~/Library/Application Support/pypoetry/venv/lib/python3.9/site-packages/poetry/installation/executor.py:552 in _install
      550│                 self._remove(operation.initial_package)
      551│ 
    → 552│             self._wheel_installer.install(archive)
      553│         finally:
      554│             if cleanup_archive:

  1  ~/Library/Application Support/pypoetry/venv/lib/python3.9/site-packages/poetry/installation/wheel_installer.py:101 in install
       99│     def install(self, wheel: Path) -> None:
      100│         with WheelFile.open(wheel) as source:
    → 101│             source.validate_record()
      102│             install(
      103│                 source=source,

  _WheelFileValidationError

  ["In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.data/data/etc/jupyter/nbconfig/notebook.d/catboost-widget.json didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.data/data/share/jupyter/labextensions/catboost-widget/package.json didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.data/data/share/jupyter/labextensions/catboost-widget/static/remoteEntry.64b1a05fa8a34d8acb22.js didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.data/data/share/jupyter/labextensions/catboost-widget/static/479.8635cb839b51b24dbe44.js.LICENSE.txt didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.data/data/share/jupyter/labextensions/catboost-widget/static/908.11316378aafcadcd81b8.js didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.data/data/share/jupyter/labextensions/catboost-widget/static/486.c2672c1c6aabd4dcb1c5.js.LICENSE.txt didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.data/data/share/jupyter/labextensions/catboost-widget/static/138.594e2e2f9fae55d2125b.js didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.data/data/share/jupyter/labextensions/catboost-widget/static/style.js didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.data/data/share/jupyter/labextensions/catboost-widget/static/755.f7277b38a5f70148dece.js didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.data/data/share/jupyter/labextensions/catboost-widget/static/479.8635cb839b51b24dbe44.js didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.data/data/share/jupyter/labextensions/catboost-widget/static/486.c2672c1c6aabd4dcb1c5.js didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.data/data/share/jupyter/labextensions/catboost-widget/static/755.f7277b38a5f70148dece.js.LICENSE.txt didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.data/data/share/jupyter/nbextensions/catboost-widget/index.js didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.data/data/share/jupyter/nbextensions/catboost-widget/extension.js didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.dist-info/WHEEL didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.dist-info/top_level.txt didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost-1.1.1.dist-info/METADATA didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/monoforest.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/plot_helpers.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/metrics.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/version.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/text_processing.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/datasets.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/__init__.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/core.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/utils.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/_catboost.so didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/widget/__init__.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/widget/metrics_plotter.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/widget/ipythonwidget.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/widget/callbacks.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/hnsw/__init__.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/hnsw/hnsw.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/hnsw/_hnsw.so didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/eval/catboost_evaluation.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/eval/_fold_model.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/eval/_readers.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/eval/log_config.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/eval/_splitter.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/eval/__init__.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/eval/execution_case.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/eval/_fold_storage.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/eval/factor_utils.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/eval/utils.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/eval/evaluation_result.py didn't match RECORD", "In /my/path/Library/Caches/pypoetry/artifacts/f0/c2/01/761d1ea5f1c7219383dc66924b24cf458e092da4c4d173f2e1739c0dc5/catboost-1.1.1-cp39-none-macosx_10_6_universal2.whl, hash / size of catboost/eval/_fold_models_handler.py didn't match RECORD"]

  at ~/Library/Application Support/pypoetry/venv/lib/python3.9/site-packages/installer/sources.py:289 in validate_record
      285│                         f"In {self._zipfile.filename}, hash / size of {item.filename} didn't match RECORD"
      286│                     )
      287│ 
      288│         if issues:
    → 289│             raise _WheelFileValidationError(issues)
      290│ 
      291│     def get_contents(self) -> Iterator[WheelContentElement]:
      292│         """Sequential access to all contents of the wheel (including dist-info files).

It also fails on Linux machines on Google and on tests using Linux on GitHub.

It runs fine with 1.4.0:

curl -sSL https://install.python-poetry.org | python3 - --version 1.4.0
cd ~
poetry new testPoetry  
cd testPoetry
poetry env use 3.9
poetry -vvv add catboost
@boennecd boennecd added kind/bug Something isn't working as expected status/triage This issue needs to be triaged labels Mar 20, 2023
@dimbleby
Copy link
Contributor

As the error message says, the catboost wheel is invalid - please report that to them.

Otherwise, duplicate #7686, please close

@matanby
Copy link

matanby commented Mar 20, 2023

Same issue for me with installing PyTorch.
Our entire CI/CD pipeline broke in a day since v1.4.1 was released 😄😭

@boennecd
Copy link
Author

As the error message says, the catboost wheel is invalid - please report that to them.

Otherwise, duplicate #7686, please close

Thank you for the quickly reply! This is highly appreciated.

Indeed it seems like #7686 and I will close the issue for this reason. I am sorry that I did not see this. It works to run

curl -sSL https://install.python-poetry.org | python3 - --version 1.4.1
cd ~
poetry config installer.modern-installation false
poetry new testPoetry
cd testPoetry
poetry env use 3.9
poetry add catboost

I was not immediately clear for me that "In FILE1, hash / size of FILE2 didn't match RECORD" is an up stream issue. This is an error on my side as this is just an error that is passed on, I guess.

@dimbleby
Copy link
Contributor

if and when you submit an issue to catboost - or even a pull request - you can tell them that the problem is that they forgot the rstrip("=") at https://github.com/catboost/catboost/blob/26cae4a03dd8f6d393adf011e9ff4fad4a49e96a/catboost/python-package/mk_wheel.py#L237

@radoering radoering added area/installer Related to the dependency installer status/duplicate Duplicate issues status/external-issue Issue is caused by external project (platform, dep, etc) and removed status/triage This issue needs to be triaged labels Mar 20, 2023
Copy link

This issue has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Feb 29, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
area/installer Related to the dependency installer kind/bug Something isn't working as expected status/duplicate Duplicate issues status/external-issue Issue is caused by external project (platform, dep, etc)
Projects
None yet
Development

No branches or pull requests

4 participants