Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Python 3.11 + Airflow 2.9.3 #210

Open
tchangalov opened this issue Dec 4, 2024 · 1 comment
Open

Python 3.11 + Airflow 2.9.3 #210

tchangalov opened this issue Dec 4, 2024 · 1 comment

Comments

@tchangalov
Copy link

tchangalov commented Dec 4, 2024

We found that dominodatalab[airflow] seems to be incompatible with python 3.11 & airflow==2.9.3

requirements.txt:

apache-airflow-providers-postgres
apache-airflow-providers-celery
apache-airflow-providers-fab
apache-airflow[kubernetes]
apache-airflow-providers-amazon[aiobotocore]
dominodatalab[airflow]==1.4.3

Installation:

export AIRFLOW_VERSION=2.9.3
export PYTHON_VERSION=3.11

python3 -m pip install \
-r ./requirements.txt --constraint  \ 
"https://raw.githubusercontent.com/apache/airflow/constraints-${AIRFLOW_VERSION}/constraints-${PYTHON_VERSION}.txt"

Result:

12.56 The conflict is caused by:
12.56     dominodatalab 1.4.3 depends on urllib3~=1.26.12
12.56     The user requested (constraint) urllib3==2.0.7
12.56 
12.56 To fix this you could try to:
12.56 1. loosen the range of package versions you've specified
12.56 2. remove package versions to allow pip to attempt to solve the dependency conflict
@tchangalov
Copy link
Author

tchangalov commented Dec 4, 2024

We were able to proceed/workaround the issue with the following code changes: master...tchangalov:python-domino:master

@tchangalov tchangalov changed the title Airflow 2.9.3 + Python 3.11 Python 3.11 + Airflow 2.9.3 Dec 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant