Options using in requirements causing lookup error

[AZ-201]

Description

cmd: /home/xxx/var/.tox/py37/bin/python -m pip install -i https://pip.nie.netease.com/simple -r/home/xxx/e2e/misc/requirements.txt >var/.tox/py37/log/py37-1.log
log:

LookupError: https://pip.nie.netease.com/packages/1a/16/441080c907df829016729e71d8bdd42d99b9bdde48b01492ed08912c0aa9/importlib_metadata-4.12.0.tar.gz#sha256=637245b8bab2b6502fcbc752cc4b7a6f6243bb02b31c5c26156ad103d3d45670 (from https://pip.nie.netease.com/simple/importlib-metadata/) (requires-python:>=3.7) is already being built: importlib-metadata from https://pip.nie.netease.com/packages/1a/16/441080c907df829016729e71d8bdd42d99b9bdde48b01492ed08912c0aa9/importlib_metadata-4.12.0.tar.gz#sha256=637245b8bab2b6502fcbc752cc4b7a6f6243bb02b31c5c26156ad103d3d45670 (from setuptools_scm>3)

the requirements:

attrs==21.2.0
certifi==2021.5.30
chardet==4.0.0
idna==2.10
iniconfig==1.1.1
Jinja2==3.0.1
MarkupSafe==2.0.1
packaging==20.9
pluggy==0.13.1
py==1.10.0
pycurl==7.45.1  --global-option=build_ext \
                --global-option="-L/usr/local/opt/openssl/lib" \
                --global-option="-I/usr/local/opt/openssl/include" # These options are causing the problem
pyparsing==2.4.7
pytest==6.2.4
pytest-html==3.1.1
pytest-metadata==1.11.0
requests==2.25.1
toml==0.10.2
urllib3==1.26.6
jsonpath==0.82
pytest-xdist==2.5.0
pytest-timeout==1.4.2
pytest-parallel
six==1.16.0
pytest-assume==2.4.3
PyMySQL==1.0.2
paramiko==2.7.2
pytest-rerunfailures==10.2

Expected behavior

pip install all requirements successfully

pip version

pip 22.1.2 from /home/xxx/var/.tox/py37/lib/python3.7/site-packages/pip (python 3.7)

Python version

Python 3.7.3

OS

Linux xxx 4.19.0-8-amd64 #1 SMP Debian 4.19.98-1 (2020-01-26) x86_64 GNU/Linux

How to Reproduce

1. using the requirements above.
2. run python -m pip install -i https://pip.nie.netease.com/simple -r/home/cuiweihang/niecdn-tool/e2e/misc/requirements.txt >var/.tox/py37/log/py37-1.log

Output

No response

Code of Conduct

• I agree to follow the PSF Code of Conduct.

[AZ-201]

I saw an issue #5739 before, not sure if they are related.

[sbidoul]

The use of --global-option implies --no-binary=:all:. These means pip only downloads source distributions and not wheels.

I suspect this creates some kind of bootstrapping / chicken and wheel issue somewhere.

You could try passing these options via --config-settings and --use-pep517, but be aware that at this moment --config-settings is a global option and there may be pecularities with the way setuptools handles config settings.

[AZ-201]

@sbidoul
Well I messed up the production environment yesterday. Dev might not be happy if I try this again. So I changed the way I'm using it.
I 'll try your approach in a container or something later. Thanks!