2021.11.9 pipenv install does not install

[vvvlc]

Issue description

When running pipenv install not all packages are install, I'm missing click

Expected result

Expected set of installed packages

+ python3 -m pip list
Package                           Version   Location                                                                                          
--------------------------------- --------- --------------------------------------------------------------------------------------------------
aenum                             3.1.3     
atomicwrites                      1.4.0     
attrs                             21.2.0    
autopep8                          1.6.0     
backports.entry-points-selectable 1.1.1     
bcrypt                            3.2.0     
beautifulsoup4                    4.10.0    
bottle                            0.12.19   
cached-property                   1.5.2     
certifi                           2021.10.8 
cffi                              1.15.0    
charset-normalizer                2.0.7     
click                             8.0.3     
colorama                          0.4.4     
contexttimer                      0.3.3     
cryptography                      3.2.1     
distlib                           0.3.3     
ebcdic                            1.1.1     
filelock                          3.3.2     
humanfriendly                     10.0      
idna                              3.3       
isort                             5.10.1    
JayDeBeApi                        1.2.3     
jeepney                           0.7.1     
JPype1                            1.2.1     
keyring                           21.2.1    
keyrings.alt                      4.1.0     
lxml                              4.6.4     
more-itertools                    8.11.0    
ntlm-auth                         1.5.0     
numpy                             1.21.4    
packaging                         21.2      
pandas                            1.3.4     
paramiko                          2.7.2     
Paste                             3.5.0     
pexpect                           4.8.0     
pip                               19.3.1    
pipenv                            2021.5.29 
platformdirs                      2.4.0     
pluggy                            0.13.1    
ptg2                              0.3.14    /var/Jenkins17/workspace/db2tools-environment/db2tools-new-instance-prod/.pyenv-python3.8/src/ptg2
ptyprocess                        0.7.0     
py                                1.11.0    
pycodestyle                       2.8.0     
pycparser                         2.21      
pycryptodome                      3.11.0    
PyNaCl                            1.4.0     
pyparsing                         2.4.7     
pytest                            4.6.11    
python-dateutil                   2.8.2     
python-sql                        1.3.0     
pytz                              2021.3    
requests                          2.26.0    
requests-ntlm2                    6.4.2     
SecretStorage                     3.3.1     
selenium                          3.141.0   
semantic-version                  2.8.5     
setuptools                        41.6.0    
six                               1.16.0    
soupsieve                         2.3       
stringcase                        1.2.0     
tabulate                          0.8.9     
toml                              0.10.2    
urllib3                           1.26.7    
virtualenv                        20.10.0   
virtualenv-clone                  0.5.7     
wcwidth                           0.2.5     
WARNING: You are using pip version 19.3.1; however, version 21.3.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.

Actual result

+ python3 -V
Python 3.8.6
+ python3 -m pip install --upgrade pip
Collecting pip
  Using cached https://files.pythonhosted.org/packages/a4/6d/6463d49a933f547439d6b5b98b46af8742cc03ae83543e4d7688c2420f8b/pip-21.3.1-py3-none-any.whl
Installing collected packages: pip
  Found existing installation: pip 19.3.1
    Uninstalling pip-19.3.1:
      Successfully uninstalled pip-19.3.1
Successfully installed pip-21.3.1
+ python3 -m pip install --upgrade pipenv
Collecting pipenv
  Using cached pipenv-2021.11.9-py2.py3-none-any.whl (3.9 MB)
Requirement already satisfied: setuptools>=36.2.1 in ./.pyenv-python3.8/lib/python3.8/site-packages (from pipenv) (41.6.0)
Requirement already satisfied: pip>=18.0 in ./.pyenv-python3.8/lib/python3.8/site-packages (from pipenv) (21.3.1)
Collecting virtualenv-clone>=0.2.5
  Using cached virtualenv_clone-0.5.7-py3-none-any.whl (6.6 kB)
Collecting virtualenv
  Using cached virtualenv-20.10.0-py2.py3-none-any.whl (5.6 MB)
Collecting certifi
  Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting platformdirs<3,>=2
  Using cached platformdirs-2.4.0-py3-none-any.whl (14 kB)
Collecting six<2,>=1.9.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting filelock<4,>=3.2
  Using cached filelock-3.3.2-py3-none-any.whl (9.7 kB)
Collecting distlib<1,>=0.3.1
  Using cached distlib-0.3.3-py2.py3-none-any.whl (496 kB)
Collecting backports.entry-points-selectable>=1.0.4
  Using cached backports.entry_points_selectable-1.1.1-py2.py3-none-any.whl (6.2 kB)
Installing collected packages: six, platformdirs, filelock, distlib, backports.entry-points-selectable, virtualenv-clone, virtualenv, certifi, pipenv
Successfully installed backports.entry-points-selectable-1.1.1 certifi-2021.10.8 distlib-0.3.3 filelock-3.3.2 pipenv-2021.11.9 platformdirs-2.4.0 six-1.16.0 virtualenv-20.10.0 virtualenv-clone-0.5.7
+ export CI=1
+ CI=1
+ pipenv install
Courtesy Notice: Pipenv found itself running within a virtual environment, so it will automatically use that environment, instead of creating its own for any project. You can set PIPENV_IGNORE_VIRTUALENVS=1 to force pipenv to ignore that environment and create its own instead. You can set PIPENV_VERBOSITY=-1 to suppress this warning.
Pipfile.lock not found, creating...
Locking [dev-packages] dependencies...

Building requirements...

Resolving dependencies...
Success!
Locking [packages] dependencies...
Updated Pipfile.lock (d8a0a1)!
Installing dependencies from Pipfile.lock (d8a0a1)...

+ python3 -m pip list
Package                           Version   Editable project location
--------------------------------- --------- --------------------------------------------------------------------------------------------------------
backports.entry-points-selectable 1.1.1
certifi                           2021.10.8
distlib                           0.3.3
filelock                          3.3.2
pip                               21.3.1
pipenv                            2021.11.9
platformdirs                      2.4.0
ptg2                              0.3.14    /var/Jenkins17/workspace/db2tools-environment/devtest/db2tools-new-instance-qa/.pyenv-python3.8/src/ptg2
setuptools                        41.6.0
six                               1.16.0
virtualenv                        20.10.0
virtualenv-clone                  0.5.7

Steps to replicate

$ pipenv --support

Pipenv version: '2021.11.9'

Pipenv location: '/var/Jenkins17/workspace/db2tools-environment/devtest/db2tools-new-instance-qa/.pyenv-python3.8/lib64/python3.8/site-packages/pipenv'

Python location: '/var/Jenkins17/workspace/db2tools-environment/devtest/db2tools-new-instance-qa/.pyenv-python3.8/bin/python3'

Python installations found:

• 3.8.6: /var/Jenkins17/workspace/db2tools-environment/devtest/db2tools-new-instance-qa/.pyenv-python3.8/bin/python3.8
• 3.8.6: /var/Jenkins17/workspace/db2tools-environment/devtest/db2tools-new-instance-qa/.pyenv-python3.8/bin/python
• 3.8.6: /var/Jenkins17/workspace/db2tools-environment/devtest/db2tools-new-instance-qa/.pyenv-python3.8/bin/python3
• 3.8.6: /var/Jenkins17/workspace/db2tools-environment/devtest/db2tools-new-instance-qa/.pyenv-python3.8/bin/python3.8
• 3.8.6: /var/Jenkins17/workspace/db2tools-environment/devtest/db2tools-new-instance-qa/.pyenv-python3.8/bin/python
• 3.8.6: /var/Jenkins17/workspace/db2tools-environment/devtest/db2tools-new-instance-qa/.pyenv-python3.8/bin/python3
• 3.8.6: /usr/bin/python3.8
• 3.6.8: /usr/bin/python3
• 3.6.8: /usr/bin/python3.6
• 3.6.8: /usr/bin/python3.6m
• 2.7.5: /usr/bin/python
• 2.7.5: /usr/bin/python2
• 2.7.5: /usr/bin/python2.7

PEP 508 Information:

{'implementation_name': 'cpython',
 'implementation_version': '3.8.6',
 'os_name': 'posix',
 'platform_machine': 'x86_64',
 'platform_python_implementation': 'CPython',
 'platform_release': '3.10.0-1160.21.1.el7.x86_64',
 'platform_system': 'Linux',
 'platform_version': '#1 SMP Tue Mar 16 18:28:22 UTC 2021',
 'python_full_version': '3.8.6',
 'python_version': '3.8',
 'sys_platform': 'linux'}

System environment variables:

• DB2TOOLS
• POZINK_CREDENTIALS
• JENKINS_NODE_COOKIE
• XDG_SESSION_ID
• BUILD_URL
• rvm_bin_path
• BROADCOM_SERVICE_NAME
• GEM_HOME
• PATH+COVERITYANALYSIS
• SHELL
• TERM
• HUDSON_SERVER_COOKIE
• IRBRC
• STAGE_NAME
• SSH_CLIENT
• BUILD_TAG
• library.coveritySharedPipeline.version
• PTG_LOCAL_DOMAIN
• POZINK_URL
• GIT_PREVIOUS_COMMIT
• MY_RUBY_HOME
• JOB_URL
• WORKSPACE
• RUN_CHANGES_DISPLAY_URL
• ZINC_NAME
• BRANCH
• USER
• PTG2_RELEASED_STABLE
• CRED_PSW
• rvm_path
• RUN_ARTIFACTS_DISPLAY_URL
• CRED
• VIRTUAL_ENV
• PTG_COMMON_FAILPOINT
• CRED_USR
• JENKINS_HOME
• rvm_prefix
• GIT_COMMIT
• PATH
• DB2TOOLS_DEPLOY
• MAIL
• library.adminSuiteSharedPipeline.version
• RUN_DISPLAY_URL
• GIT_PASSWORD
• REVERT_COMMAND
• PWD
• JAVA_HOME
• HUDSON_URL
• LANG
• BROADCOM_VM_NAME
• BROADCOM_SERVICE_ID
• JOB_NAME
• PTG2_ARTIFACTORY_URL
• GIT_LFS_SKIP_SMUDGE
• BUILD_DISPLAY_NAME
• PTG_DOMAIN_CONFIGURATION_URL
• JENKINS_URL
• BUILD_ID
• BUILD_TIMESTAMP
• JAVA_TOOL_OPTIONS
• JOB_BASE_NAME
• rvm_version
• RUN_TESTS_DISPLAY_URL
• PATH+COVERITYREPORTS
• SHLVL
• HOME
• GIT_USER
• GIT_BRANCH
• CI
• POZINK_USER
• EXECUTOR_NUMBER
• JENKINS_SERVER_COOKIE
• COVERITY_TOOL_HOME
• NODE_LABELS
• GIT_URL
• BROADCOM_VM_ID
• LOGNAME
• POZINK_PASSWORD
• XDG_DATA_DIRS
• HUDSON_HOME
• comgenqa
• GEM_PATH
• SSH_CONNECTION
• NODE_NAME
• LESSOPEN
• JOB_DISPLAY_URL
• PTG2_RELEASED_STABLE_COMMON_COMPONENTS
• BUILD_NUMBER
• HUDSON_COOKIE
• XDG_RUNTIME_DIR
• x3270_path
• RUBY_VERSION
• library.subsystemSharedPipeline.version
• _
• PIP_SHIMS_BASE_MODULE
• PIP_DISABLE_PIP_VERSION_CHECK
• PYTHONDONTWRITEBYTECODE
• PIP_PYTHON_PATH
• PYTHONFINDER_IGNORE_UNSUPPORTED

Pipenv–specific environment variables:

Debug–specific environment variables:

• PATH: /var/Jenkins17/workspace/db2tools-environment/devtest/db2tools-new-instance-qa/.pyenv-python3.8/bin:/var/coverity/reports/cov-reports-linux64-2020.12/bin:/var/coverity/analysis/cov-analysis-linux64-2020.12/bin:/usr/bin:/var/coverity/reports/cov-reports-linux64-2020.12/bin:/var/coverity/analysis/cov-analysis-linux64-2020.12/bin:/usr/local/rvm/gems/ruby-2.7.2/bin:/usr/local/rvm/gems/ruby-2.7.2@global/bin:/usr/local/rvm/rubies/ruby-2.7.2/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/usr/local/rvm/bin
• SHELL: /bin/bash
• LANG: en_US.UTF-8
• PWD: /var/Jenkins17/workspace/db2tools-environment/devtest/db2tools-new-instance-qa
• VIRTUAL_ENV: /var/Jenkins17/workspace/db2tools-environment/devtest/db2tools-new-instance-qa/.pyenv-python3.8

---

Contents of Pipfile ('/var/Jenkins17/workspace/db2tools-environment/devtest/db2tools-new-instance-qa/Pipfile'):

[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"

[packages]
click = "*"
tabulate = "*"
pandas = "*"
#debugpy = "*"

[dev-packages]
strip-ansi = "*"
pytest = "*"
httpretty = "*"
python-jenkins = "*"
# keyring = "*"
# keyrings.alt = "*"

[requires]
python_version = "3.8"

[packages.ptg2]
editable = true
ref = "master"
git = "https://github.gwd.broadcom.net/MFD/ptg2.git"

Contents of Pipfile.lock ('/var/Jenkins17/workspace/db2tools-environment/devtest/db2tools-new-instance-qa/Pipfile.lock'):

{
    "_meta": {
        "hash": {
            "sha256": "c61ab1e7b260dbdd63309f5bdf2ff54e8534273f8f2236274330e06693d8a0a1"
        },
        "pipfile-spec": 6,
        "requires": {
            "python_version": "3.8"
        },
        "sources": [
            {
                "name": "pypi",
                "url": "https://pypi.org/simple",
                "verify_ssl": true
            }
        ]
    },
    "default": {
        "ptg2": {
            "editable": true,
            "git": "https://github.gwd.broadcom.net/MFD/ptg2.git",
            "ref": "master"
        }
    },
    "develop": {
        "attrs": {
            "hashes": [
                "sha256:149e90d6d8ac20db7a955ad60cf0e6881a3f20d37096140088356da6c716b0b1",
                "sha256:ef6aaac3ca6cd92904cdd0d83f629a15f18053ec84e6432106f7a4d04ae4f5fb"
            ],
            "markers": "python_version >= '2.7' and python_version not in '3.0, 3.1, 3.2, 3.3, 3.4'",
            "version": "==21.2.0"
        },
        "certifi": {
            "hashes": [
                "sha256:78884e7c1d4b00ce3cea67b44566851c4343c120abd683433ce934a68ea58872",
                "sha256:d62a0163eb4c2344ac042ab2bdf75399a71a2d8c7d47eac2e2ee91b9d6339569"
            ],
            "version": "==2021.10.8"
        },
        "charset-normalizer": {
            "hashes": [
                "sha256:e019de665e2bcf9c2b64e2e5aa025fa991da8720daa3c1138cadd2fd1856aed0",
                "sha256:f7af805c321bfa1ce6714c51f254e0d5bb5e5834039bc17db7ebe3a4cec9492b"
            ],
            "markers": "python_version >= '3'",
            "version": "==2.0.7"
        },
        "httpretty": {
            "hashes": [
                "sha256:20de0e5dd5a18292d36d928cc3d6e52f8b2ac73daec40d41eb62dee154933b68"
            ],
            "index": "pypi",
            "version": "==1.1.4"
        },
        "idna": {
            "hashes": [
                "sha256:84d9dd047ffa80596e0f246e2eab0b391788b0503584e8945f2368256d2735ff",
                "sha256:9d643ff0a55b762d5cdb124b8eaa99c66322e2157b69160bc32796e824360e6d"
            ],
            "markers": "python_version >= '3'",
            "version": "==3.3"
        },
        "iniconfig": {
            "hashes": [
                "sha256:011e24c64b7f47f6ebd835bb12a743f2fbe9a26d4cecaa7f53bc4f35ee9da8b3",
                "sha256:bc3af051d7d14b2ee5ef9969666def0cd1a000e121eaea580d4a313df4b37f32"
            ],
            "version": "==1.1.1"
        },
        "multi-key-dict": {
            "hashes": [
                "sha256:3a1e1fc705a30a7de1a153ec2992b3ca3655ccd9225d2e427fe6525c8f160d6d",
                "sha256:cb1e00aa9d8192496cc0cc040f6d9602f35e4cf099e866248be06b04fd45b42b",
                "sha256:deebdec17aa30a1c432cb3f437e81f8621e1c0542a0c0617a74f71e232e9939e",
                "sha256:fb67a532d7361a66820aa1e8fe6c0c939f4c34a3a09a3e8db199ce7b77c4fb78"
            ],
            "version": "==2.0.3"
        },
        "packaging": {
            "hashes": [
                "sha256:096d689d78ca690e4cd8a89568ba06d07ca097e3306a4381635073ca91479966",
                "sha256:14317396d1e8cdb122989b916fa2c7e9ca8e2be9e8060a6eff75b6b7b4d8a7e0"
            ],
            "markers": "python_version >= '3.6'",
            "version": "==21.2"
        },
        "pbr": {
            "hashes": [
                "sha256:4651ca1445e80f2781827305de3d76b3ce53195f2227762684eb08f17bc473b7",
                "sha256:60002958e459b195e8dbe61bf22bcf344eedf1b4e03a321a5414feb15566100c"
            ],
            "markers": "python_version >= '2.6'",
            "version": "==5.7.0"
        },
        "pluggy": {
            "hashes": [
                "sha256:4224373bacce55f955a878bf9cfa763c1e360858e330072059e10bad68531159",
                "sha256:74134bbf457f031a36d68416e1509f34bd5ccc019f0bcc952c7b909d06b37bd3"
            ],
            "markers": "python_version >= '3.6'",
            "version": "==1.0.0"
        },
        "py": {
            "hashes": [
                "sha256:51c75c4126074b472f746a24399ad32f6053d1b34b68d2fa41e558e6f4a98719",
                "sha256:607c53218732647dff4acdfcd50cb62615cedf612e72d1724fb1a0cc6405b378"
            ],
            "markers": "python_version >= '2.7' and python_version not in '3.0, 3.1, 3.2, 3.3, 3.4'",
            "version": "==1.11.0"
        },
        "pyparsing": {
            "hashes": [
                "sha256:c203ec8783bf771a155b207279b9bccb8dea02d8f0c9e5f8ead507bc3246ecc1",
                "sha256:ef9d7589ef3c200abe66653d3f1ab1033c3c419ae9b9bdb1240a85b024efc88b"
            ],
            "markers": "python_version >= '2.6' and python_version not in '3.0, 3.1, 3.2'",
            "version": "==2.4.7"
        },
        "pytest": {
            "hashes": [
                "sha256:131b36680866a76e6781d13f101efb86cf674ebb9762eb70d3082b6f29889e89",
                "sha256:7310f8d27bc79ced999e760ca304d69f6ba6c6649c0b60fb0e04a4a77cacc134"
            ],
            "index": "pypi",
            "version": "==6.2.5"
        },
        "python-jenkins": {
            "hashes": [
                "sha256:c49c6e8770966906c0be1fe21d5e2ba08e08c93f315632929b20b3c2f2c3004c",
                "sha256:deed8fa79d32769a615984a5dde5e01eda04914d3f4091bd9a23d30474695106"
            ],
            "index": "pypi",
            "version": "==1.7.0"
        },
        "requests": {
            "hashes": [
                "sha256:6c1246513ecd5ecd4528a0906f910e8f0f9c6b8ec72030dc9fd154dc1a6efd24",
                "sha256:b8aa58f8cf793ffd8782d3d8cb19e66ef36f7aba4353eec859e74678b01b07a7"
            ],
            "markers": "python_version >= '2.7' and python_version not in '3.0, 3.1, 3.2, 3.3, 3.4, 3.5'",
            "version": "==2.26.0"
        },
        "six": {
            "hashes": [
                "sha256:1e61c37477a1626458e36f7b1d82aa5c9b094fa4802892072e49de9c60c4c926",
                "sha256:8abb2f1d86890a2dfb989f9a77cfcfd3e47c2a354b01111771326f8aa26e0254"
            ],
            "markers": "python_version >= '2.7' and python_version not in '3.0, 3.1, 3.2'",
            "version": "==1.16.0"
        },
        "strip-ansi": {
            "hashes": [
                "sha256:5d60f239cc8a37fdd52b43c3e66e893d45ba0423115db59eca0d2eef83b07729",
                "sha256:9f55280e1b0ba84dac49d4f18aa6b51b90ff766b22e4918ffc01cc87b394ecd1"
            ],
            "index": "pypi",
            "version": "==0.1.1"
        },
        "toml": {
            "hashes": [
                "sha256:806143ae5bfb6a3c6e736a764057db0e6a0e05e338b5630894a5f779cabb4f9b",
                "sha256:b3bda1d108d5dd99f4a20d24d9c348e91c4db7ab1b749200bded2f839ccbe68f"
            ],
            "markers": "python_version >= '2.6' and python_version not in '3.0, 3.1, 3.2'",
            "version": "==0.10.2"
        },
        "urllib3": {
            "hashes": [
                "sha256:4987c65554f7a2dbf30c18fd48778ef124af6fab771a377103da0585e2336ece",
                "sha256:c4fdf4019605b6e5423637e01bc9fe4daef873709a7973e195ceba0a62bbc844"
            ],
            "markers": "python_version >= '2.7' and python_version not in '3.0, 3.1, 3.2, 3.3, 3.4' and python_version < '4.0'",
            "version": "==1.26.7"
        }
    }
}

Version `2021.5.29` works fine. Issue started after this was resolved #4847

[frostming]

It seems to have been fixed on the main branch

[janpeterka]

when will this fix be released? It's quite critical bug.

[frostming]

Released in https://github.com/pypa/pipenv/releases/tag/v2021.11.15