Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Various Python dependency incompatibility warnings #4576

Closed
jezdez opened this issue Jan 22, 2020 · 3 comments
Closed

Various Python dependency incompatibility warnings #4576

jezdez opened this issue Jan 22, 2020 · 3 comments

Comments

@jezdez
Copy link
Member

jezdez commented Jan 22, 2020

Issue Summary

When I was build a current master built I saw that some of the Redash Python dependencies are wrongly pinned:

ERROR: boto3 1.11.7 has requirement botocore<1.15.0,>=1.14.7, but you'll have botocore 1.13.50 which is incompatible.
ERROR: dql 0.5.26 has requirement python-dateutil<2.7.0, but you'll have python-dateutil 2.8.0 which is incompatible.
ERROR: memsql 3.0.0 has requirement mysqlclient==1.3.13, but you'll have mysqlclient 1.3.14 which is incompatible.
ERROR: pymapd 0.19.0 has requirement thrift==0.11.0, but you'll have thrift 0.13.0 which is incompatible.

These should probably be improved somehow.

Steps to Reproduce

  1. docker-compose build
  2. See the red warnings in the console output

Technical details:

  • Redash Version: master
  • Browser/OS: Firefox/macOS
  • How did you install Redash: Docker
@jezdez
Copy link
Member Author

jezdez commented Jan 22, 2020

FWIW this was previously raised in #3342.

@yoshiken
Copy link
Contributor

When a similar problem was reproduced, a new required version was raised.

boto3 1.12.23 has requirement botocore<1.16.0,>=1.15.23, but you'll have botocore 1.14.17 which is incompatible.

This is expected because the latest of PyAthena is seeking the latest of boto3.

PyAthena==1.10.2
  - boto3 [required: >=1.4.4, installed: 1.12.23]
    - botocore [required: >=1.15.23,<1.16.0, installed: 1.14.17]
      - docutils [required: >=0.10,<0.16, installed: 0.15.2]
      - jmespath [required: >=0.7.1,<1.0.0, installed: 0.9.5]
      - python-dateutil [required: >=2.1,<3.0.0, installed: 2.8.1]
        - six [required: >=1.5, installed: 1.14.0]
      - urllib3 [required: >=1.20,<1.26, installed: 1.25.8]
    - jmespath [required: >=0.7.1,<1.0.0, installed: 0.9.5]
    - s3transfer [required: >=0.3.0,<0.4.0, installed: 0.3.3]
      - botocore [required: >=1.12.36,<2.0a.0, installed: 1.14.17]
        - docutils [required: >=0.10,<0.16, installed: 0.15.2]
        - jmespath [required: >=0.7.1,<1.0.0, installed: 0.9.5]
        - python-dateutil [required: >=2.1,<3.0.0, installed: 2.8.1]
          - six [required: >=1.5, installed: 1.14.0]
        - urllib3 [required: >=1.20,<1.26, installed: 1.25.8]
  - botocore [required: >=1.5.52, installed: 1.14.17]
    - docutils [required: >=0.10,<0.16, installed: 0.15.2]
    - jmespath [required: >=0.7.1,<1.0.0, installed: 0.9.5]
    - python-dateutil [required: >=2.1,<3.0.0, installed: 2.8.1]
      - six [required: >=1.5, installed: 1.14.0]
    - urllib3 [required: >=1.20,<1.26, installed: 1.25.8]
  - future [required: Any, installed: 0.18.2]
  - tenacity [required: >=4.1.0, installed: 6.1.0]
    - six [required: >=1.9.0, installed: 1.14.0]

So need to update botocore and lock PyAthena version.

@guidopetri
Copy link
Contributor

With our new poetry setup, this should be working now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants