2020 resolver stalls during installation #8705
Comments
triage-new-issues
bot
added
the
S: needs triage
|
Apologies, this seems precisely like a duplicate of #8683. I searched for some keywords that don't quite appear in that issue, and neglected to scroll through the first page of issues 🤦 feel free to close—I'll leave open for the moment as a data point. |
triage-new-issues
bot
removed
the
S: needs triage
|
For anyone arriving back here—I found that my specific situation was caused by an incompatibility between two I found this while testing whether the solution described here would fix my issue, ultimately finding that I could fix the stalling myself regardless of the resolver version if I just know the right conflicting dependencies to investigate. |
What did you want to do?
We have a private Artifactory registry. The set of dependencies listed in the tree at the end install properly when running the following:
$ PIP_INDEX_URL=https://our-artifactory.biz/artifactory/api/pypi/pypi/simple \ python -m pip install --no-cache-dir \ [private package 1] \ [private package 2] \ ... \ 'pytest>=5.0.1,<6' \ 'pytest-cov>=2.7.1,<3' \ 'pytest-django>=3.4.8,<4' \ 'pytest-randomly>=3,<3.3.0' \ mypy \ pylintBut doing the same with
PIP_USE_FEATURE=2020-resolvercauses a stall. In our CI environment I gave the process as long as 4 hours to complete and it did not.As an experiment I tried installing with the current resolver first and using the 2020 resolver afterward, and was at one point able to see that it was spinning infinitely on
Requirement already satisfiedfor some ofpylint's dependencies. I notice also that the new resolver seems to want to download multiple versions of two different packages thatpylintdepends on (noteastroidandmccabeversions in the output below).So far I've been unable to create a more minimal reproduction—attempting to install pylint by itself doesn't cause an issue.
Output
Additional information
pip version: 20.2.1
This example shows the result of running with the new resolver after having run the current resolver already, which provides some evidence that the new resolver seems eager to download more versions:
Dependency tree
root@ac97dcf7ba94:/code/shared-packages/[private package]# pipdeptree Warning!!! Possibly conflicting dependencies found: * astroid==2.4.2 - wrapt [required: ~=1.11, installed: 1.10.4] ------------------------------------------------------------------------ [private package] - Django [required: >=1.11, installed: 3.1] - asgiref [required: ~=3.2.10, installed: 3.2.10] - pytz [required: Any, installed: 2020.1] - sqlparse [required: >=0.2.2, installed: 0.3.1] - [private package] - beautifulsoup4 [required: >=4.3.2,<5, installed: 4.9.1] - soupsieve [required: >1.2, installed: 2.0.1] - boto3 [required: >=1.9,<2, installed: 1.14.35] - botocore [required: >=1.17.35,<1.18.0, installed: 1.17.35] - docutils [required: >=0.10,<0.16, installed: 0.15.2] - jmespath [required: >=0.7.1,<1.0.0, installed: 0.10.0] - python-dateutil [required: >=2.1,<3.0.0, installed: 2.8.1] - six [required: >=1.5, installed: 1.15.0] - urllib3 [required: >=1.20,<1.26, installed: 1.25.10] - jmespath [required: >=0.7.1,<1.0.0, installed: 0.10.0] - s3transfer [required: >=0.3.0,<0.4.0, installed: 0.3.3] - botocore [required: >=1.12.36,<2.0a.0, installed: 1.17.35] - docutils [required: >=0.10,<0.16, installed: 0.15.2] - jmespath [required: >=0.7.1,<1.0.0, installed: 0.10.0] - python-dateutil [required: >=2.1,<3.0.0, installed: 2.8.1] - six [required: >=1.5, installed: 1.15.0] - urllib3 [required: >=1.20,<1.26, installed: 1.25.10] - botocore [required: >=1.12,<2, installed: 1.17.35] - docutils [required: >=0.10,<0.16, installed: 0.15.2] - jmespath [required: >=0.7.1,<1.0.0, installed: 0.10.0] - python-dateutil [required: >=2.1,<3.0.0, installed: 2.8.1] - six [required: >=1.5, installed: 1.15.0] - urllib3 [required: >=1.20,<1.26, installed: 1.25.10] - Django [required: >=1.11, installed: 3.1] - asgiref [required: ~=3.2.10, installed: 3.2.10] - pytz [required: Any, installed: 2020.1] - sqlparse [required: >=0.2.2, installed: 0.3.1] - html5lib [required: ==0.999, installed: 0.999] - six [required: Any, installed: 1.15.0] - netaddr [required: ==0.7.15, installed: 0.7.15] - python3-memcached [required: ==1.51, installed: 1.51] - requests [required: >=2.11.1,<3, installed: 2.24.0] - certifi [required: >=2017.4.17, installed: 2020.6.20] - chardet [required: >=3.0.2,<4, installed: 3.0.4] - idna [required: >=2.5,<3, installed: 2.10] - urllib3 [required: >=1.21.1,<1.26,!=1.25.1,!=1.25.0, installed: 1.25.10] - statsd [required: >=3.1,<4, installed: 3.3.0] - [private package] - Django [required: >=1.11, installed: 3.1] - asgiref [required: ~=3.2.10, installed: 3.2.10] - pytz [required: Any, installed: 2020.1] - sqlparse [required: >=0.2.2, installed: 0.3.1] - requests [required: >=2.9.1,<3, installed: 2.24.0] - certifi [required: >=2017.4.17, installed: 2020.6.20] - chardet [required: >=3.0.2,<4, installed: 3.0.4] - idna [required: >=2.5,<3, installed: 2.10] - urllib3 [required: >=1.21.1,<1.26,!=1.25.1,!=1.25.0, installed: 1.25.10] - wrapt [required: ==1.10.4, installed: 1.10.4] - statsd [required: >=3.1,<4, installed: 3.3.0] mypy==0.782 - mypy-extensions [required: >=0.4.3,<0.5.0, installed: 0.4.3] - typed-ast [required: >=1.4.0,<1.5.0, installed: 1.4.1] - typing-extensions [required: >=3.7.4, installed: 3.7.4.2] pipdeptree==1.0.0 - pip [required: >=6.0.0, installed: 20.2.1] pylint==2.5.3 - astroid [required: >=2.4.0,<=2.5, installed: 2.4.2] - lazy-object-proxy [required: ==1.4.*, installed: 1.4.3] - six [required: ~=1.12, installed: 1.15.0] - typed-ast [required: >=1.4.0,<1.5, installed: 1.4.1] - wrapt [required: ~=1.11, installed: 1.10.4] - isort [required: >=4.2.5,<5, installed: 4.3.21] - mccabe [required: >=0.6,<0.7, installed: 0.6.1] - toml [required: >=0.7.1, installed: 0.10.1] pytest-cov==2.10.0 - coverage [required: >=4.4, installed: 5.2.1] - pytest [required: >=4.6, installed: 5.4.3] - attrs [required: >=17.4.0, installed: 19.3.0] - importlib-metadata [required: >=0.12, installed: 1.7.0] - zipp [required: >=0.5, installed: 3.1.0] - more-itertools [required: >=4.0.0, installed: 8.4.0] - packaging [required: Any, installed: 20.4] - pyparsing [required: >=2.0.2, installed: 2.4.7] - six [required: Any, installed: 1.15.0] - pluggy [required: >=0.12,<1.0, installed: 0.13.1] - importlib-metadata [required: >=0.12, installed: 1.7.0] - zipp [required: >=0.5, installed: 3.1.0] - py [required: >=1.5.0, installed: 1.9.0] - wcwidth [required: Any, installed: 0.2.5] pytest-django==3.9.0 - pytest [required: >=3.6, installed: 5.4.3] - attrs [required: >=17.4.0, installed: 19.3.0] - importlib-metadata [required: >=0.12, installed: 1.7.0] - zipp [required: >=0.5, installed: 3.1.0] - more-itertools [required: >=4.0.0, installed: 8.4.0] - packaging [required: Any, installed: 20.4] - pyparsing [required: >=2.0.2, installed: 2.4.7] - six [required: Any, installed: 1.15.0] - pluggy [required: >=0.12,<1.0, installed: 0.13.1] - importlib-metadata [required: >=0.12, installed: 1.7.0] - zipp [required: >=0.5, installed: 3.1.0] - py [required: >=1.5.0, installed: 1.9.0] - wcwidth [required: Any, installed: 0.2.5] pytest-randomly==3.2.1 - importlib-metadata [required: Any, installed: 1.7.0] - zipp [required: >=0.5, installed: 3.1.0] - pytest [required: Any, installed: 5.4.3] - attrs [required: >=17.4.0, installed: 19.3.0] - importlib-metadata [required: >=0.12, installed: 1.7.0] - zipp [required: >=0.5, installed: 3.1.0] - more-itertools [required: >=4.0.0, installed: 8.4.0] - packaging [required: Any, installed: 20.4] - pyparsing [required: >=2.0.2, installed: 2.4.7] - six [required: Any, installed: 1.15.0] - pluggy [required: >=0.12,<1.0, installed: 0.13.1] - importlib-metadata [required: >=0.12, installed: 1.7.0] - zipp [required: >=0.5, installed: 3.1.0] - py [required: >=1.5.0, installed: 1.9.0] - wcwidth [required: Any, installed: 0.2.5] [private package] - apiron [required: >=5.1.0,<6, installed: 5.1.0] - requests [required: >=2.11.1,<3, installed: 2.24.0] - certifi [required: >=2017.4.17, installed: 2020.6.20] - chardet [required: >=3.0.2,<4, installed: 3.0.4] - idna [required: >=2.5,<3, installed: 2.10] - urllib3 [required: >=1.21.1,<1.26,!=1.25.1,!=1.25.0, installed: 1.25.10] - boto3 [required: >=1.9,<2, installed: 1.14.35] - botocore [required: >=1.17.35,<1.18.0, installed: 1.17.35] - docutils [required: >=0.10,<0.16, installed: 0.15.2] - jmespath [required: >=0.7.1,<1.0.0, installed: 0.10.0] - python-dateutil [required: >=2.1,<3.0.0, installed: 2.8.1] - six [required: >=1.5, installed: 1.15.0] - urllib3 [required: >=1.20,<1.26, installed: 1.25.10] - jmespath [required: >=0.7.1,<1.0.0, installed: 0.10.0] - s3transfer [required: >=0.3.0,<0.4.0, installed: 0.3.3] - botocore [required: >=1.12.36,<2.0a.0, installed: 1.17.35] - docutils [required: >=0.10,<0.16, installed: 0.15.2] - jmespath [required: >=0.7.1,<1.0.0, installed: 0.10.0] - python-dateutil [required: >=2.1,<3.0.0, installed: 2.8.1] - six [required: >=1.5, installed: 1.15.0] - urllib3 [required: >=1.20,<1.26, installed: 1.25.10] - botocore [required: >=1.12,<2, installed: 1.17.35] - docutils [required: >=0.10,<0.16, installed: 0.15.2] - jmespath [required: >=0.7.1,<1.0.0, installed: 0.10.0] - python-dateutil [required: >=2.1,<3.0.0, installed: 2.8.1] - six [required: >=1.5, installed: 1.15.0] - urllib3 [required: >=1.20,<1.26, installed: 1.25.10] - Django [required: >=1.11, installed: 3.1] - asgiref [required: ~=3.2.10, installed: 3.2.10] - pytz [required: Any, installed: 2020.1] - sqlparse [required: >=0.2.2, installed: 0.3.1] - [private package] - apiron [required: >=4.2.0,<6, installed: 5.1.0] - requests [required: >=2.11.1,<3, installed: 2.24.0] - certifi [required: >=2017.4.17, installed: 2020.6.20] - chardet [required: >=3.0.2,<4, installed: 3.0.4] - idna [required: >=2.5,<3, installed: 2.10] - urllib3 [required: >=1.21.1,<1.26,!=1.25.1,!=1.25.0, installed: 1.25.10] - [private package] - beautifulsoup4 [required: >=4.3.2,<5, installed: 4.9.1] - soupsieve [required: >1.2, installed: 2.0.1] - boto3 [required: >=1.9,<2, installed: 1.14.35] - botocore [required: >=1.17.35,<1.18.0, installed: 1.17.35] - docutils [required: >=0.10,<0.16, installed: 0.15.2] - jmespath [required: >=0.7.1,<1.0.0, installed: 0.10.0] - python-dateutil [required: >=2.1,<3.0.0, installed: 2.8.1] - six [required: >=1.5, installed: 1.15.0] - urllib3 [required: >=1.20,<1.26, installed: 1.25.10] - jmespath [required: >=0.7.1,<1.0.0, installed: 0.10.0] - s3transfer [required: >=0.3.0,<0.4.0, installed: 0.3.3] - botocore [required: >=1.12.36,<2.0a.0, installed: 1.17.35] - docutils [required: >=0.10,<0.16, installed: 0.15.2] - jmespath [required: >=0.7.1,<1.0.0, installed: 0.10.0] - python-dateutil [required: >=2.1,<3.0.0, installed: 2.8.1] - six [required: >=1.5, installed: 1.15.0] - urllib3 [required: >=1.20,<1.26, installed: 1.25.10] - botocore [required: >=1.12,<2, installed: 1.17.35] - docutils [required: >=0.10,<0.16, installed: 0.15.2] - jmespath [required: >=0.7.1,<1.0.0, installed: 0.10.0] - python-dateutil [required: >=2.1,<3.0.0, installed: 2.8.1] - six [required: >=1.5, installed: 1.15.0] - urllib3 [required: >=1.20,<1.26, installed: 1.25.10] - Django [required: >=1.11, installed: 3.1] - asgiref [required: ~=3.2.10, installed: 3.2.10] - pytz [required: Any, installed: 2020.1] - sqlparse [required: >=0.2.2, installed: 0.3.1] - html5lib [required: ==0.999, installed: 0.999] - six [required: Any, installed: 1.15.0] - netaddr [required: ==0.7.15, installed: 0.7.15] - python3-memcached [required: ==1.51, installed: 1.51] - requests [required: >=2.11.1,<3, installed: 2.24.0] - certifi [required: >=2017.4.17, installed: 2020.6.20] - chardet [required: >=3.0.2,<4, installed: 3.0.4] - idna [required: >=2.5,<3, installed: 2.10] - urllib3 [required: >=1.21.1,<1.26,!=1.25.1,!=1.25.0, installed: 1.25.10] - statsd [required: >=3.1,<4, installed: 3.3.0] - [private package] [required: >=1.0.0,<2, installed: 1.1.0] - Django [required: >=1.11, installed: 3.1] - asgiref [required: ~=3.2.10, installed: 3.2.10] - pytz [required: Any, installed: 2020.1] - sqlparse [required: >=0.2.2, installed: 0.3.1] - requests [required: >=2.9.1,<3, installed: 2.24.0] - certifi [required: >=2017.4.17, installed: 2020.6.20] - chardet [required: >=3.0.2,<4, installed: 3.0.4] - idna [required: >=2.5,<3, installed: 2.10] - urllib3 [required: >=1.21.1,<1.26,!=1.25.1,!=1.25.0, installed: 1.25.10] - wrapt [required: ==1.10.4, installed: 1.10.4] - pydantic [required: >=1.4, installed: 1.6.1] - requests [required: >=2.24.0,<3, installed: 2.24.0] - certifi [required: >=2017.4.17, installed: 2020.6.20] - chardet [required: >=3.0.2,<4, installed: 3.0.4] - idna [required: >=2.5,<3, installed: 2.10] - urllib3 [required: >=1.21.1,<1.26,!=1.25.1,!=1.25.0, installed: 1.25.10] - retrying [required: >=1.3.3,<2, installed: 1.3.3] - six [required: >=1.7.0, installed: 1.15.0] - urllib3 [required: >=1.25.7,<2, installed: 1.25.10] - [private package] - Django [required: >=1.11, installed: 3.1] - asgiref [required: ~=3.2.10, installed: 3.2.10] - pytz [required: Any, installed: 2020.1] - sqlparse [required: >=0.2.2, installed: 0.3.1] - requests [required: >=2.9.1,<3, installed: 2.24.0] - certifi [required: >=2017.4.17, installed: 2020.6.20] - chardet [required: >=3.0.2,<4, installed: 3.0.4] - idna [required: >=2.5,<3, installed: 2.10] - urllib3 [required: >=1.21.1,<1.26,!=1.25.1,!=1.25.0, installed: 1.25.10] setuptools==47.1.0 tox==3.18.1 - filelock [required: >=3.0.0, installed: 3.0.12] - importlib-metadata [required: >=0.12,<2, installed: 1.7.0] - zipp [required: >=0.5, installed: 3.1.0] - packaging [required: >=14, installed: 20.4] - pyparsing [required: >=2.0.2, installed: 2.4.7] - six [required: Any, installed: 1.15.0] - pluggy [required: >=0.12.0, installed: 0.13.1] - importlib-metadata [required: >=0.12, installed: 1.7.0] - zipp [required: >=0.5, installed: 3.1.0] - py [required: >=1.4.17, installed: 1.9.0] - six [required: >=1.14.0, installed: 1.15.0] - toml [required: >=0.9.4, installed: 0.10.1] - virtualenv [required: >=16.0.0,!=20.0.7,!=20.0.6,!=20.0.5,!=20.0.4,!=20.0.3,!=20.0.2,!=20.0.1,!=20.0.0, installed: 20.0.30] - appdirs [required: >=1.4.3,<2, installed: 1.4.4] - distlib [required: >=0.3.1,<1, installed: 0.3.1] - filelock [required: >=3.0.0,<4, installed: 3.0.12] - importlib-metadata [required: >=0.12,<2, installed: 1.7.0] - zipp [required: >=0.5, installed: 3.1.0] - six [required: >=1.9.0,<2, installed: 1.15.0]The text was updated successfully, but these errors were encountered: