Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Joblib integration tests #677

Merged
merged 4 commits into from
Sep 29, 2021
+184 −139
Merged

Joblib integration tests #677

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
26f9c90
pre-commit linting
cosmicBboy Sep 28, 2021
6a160fa
update reqs
cosmicBboy Sep 29, 2021
8603958
update tests
cosmicBboy Sep 29, 2021
5dc66ca
update requirements
cosmicBboy Sep 29, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 6 additions & 1 deletion Makefile
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
export REPOSITORY=flytekit

PIP_COMPILE = pip-compile --upgrade --verbose
MOCK_FLYTE_REPO=tests/flytekit/integration/remote/mock_flyte_repo/workflows

.SILENT: help
.PHONY: help
Expand Down Expand Up @@ -70,8 +71,12 @@ doc-requirements.txt: export CUSTOM_COMPILE_COMMAND := make doc-requirements.txt
doc-requirements.txt: doc-requirements.in install-piptools
$(PIP_COMPILE) $<

${MOCK_FLYTE_REPO}/requirements.txt: export CUSTOM_COMPILE_COMMAND := make ${MOCK_FLYTE_REPO}/requirements.txt
${MOCK_FLYTE_REPO}/requirements.txt: ${MOCK_FLYTE_REPO}/requirements.in install-piptools
$(PIP_COMPILE) $<

.PHONY: requirements
requirements: requirements.txt dev-requirements.txt requirements-spark2.txt doc-requirements.txt ## Compile requirements
requirements: requirements.txt dev-requirements.txt requirements-spark2.txt doc-requirements.txt ${MOCK_FLYTE_REPO}/requirements.txt ## Compile requirements

# TODO: Change this in the future to be all of flytekit
.PHONY: coverage
Expand Down
1 change: 1 addition & 0 deletions dev-requirements.in
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@

git+git://github.com/flyteorg/pytest-flyte@main#egg=pytest-flyte
coverage[toml]
joblib
mock
pytest
mypy
Expand Down
39 changes: 20 additions & 19 deletions dev-requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ cffi==1.14.6
# pynacl
cfgv==3.3.1
# via pre-commit
charset-normalizer==2.0.4
charset-normalizer==2.0.6
# via
# -c requirements.txt
# requests
Expand All @@ -53,11 +53,11 @@ cryptography==3.4.8
# via
# -c requirements.txt
# paramiko
dataclasses-json==0.5.5
dataclasses-json==0.5.6
# via
# -c requirements.txt
# flytekit
decorator==5.0.9
decorator==5.1.0
# via
# -c requirements.txt
# retry
Expand All @@ -73,7 +73,7 @@ diskcache==5.2.1
# via
# -c requirements.txt
# flytekit
distlib==0.3.2
distlib==0.3.3
# via virtualenv
distro==1.6.0
# via docker-compose
Expand All @@ -95,17 +95,17 @@ docstring-parser==0.10
# via
# -c requirements.txt
# flytekit
filelock==3.0.12
filelock==3.1.0
# via virtualenv
flyteidl==0.21.0
flyteidl==0.21.2
# via
# -c requirements.txt
# flytekit
grpcio==1.40.0
grpcio==1.41.0
# via
# -c requirements.txt
# flytekit
identify==2.2.14
identify==2.2.15
# via pre-commit
idna==3.2
# via
Expand All @@ -121,11 +121,13 @@ jinja2==3.0.1
# via
# -c requirements.txt
# pytest-flyte
joblib==1.0.1
# via -r dev-requirements.in
jsonschema==3.2.0
# via
# -c requirements.txt
# docker-compose
keyring==23.1.0
keyring==23.2.1
# via
# -c requirements.txt
# flytekit
Expand Down Expand Up @@ -171,7 +173,7 @@ packaging==21.0
# via
# -c requirements.txt
# pytest
pandas==1.3.2
pandas==1.3.3
# via
# -c requirements.txt
# flytekit
Expand All @@ -183,15 +185,15 @@ pathspec==0.9.0
# via
# -c requirements.txt
# scantree
platformdirs==2.3.0
platformdirs==2.4.0
# via
# -c requirements.txt
# virtualenv
pluggy==1.0.0
# via pytest
pre-commit==2.15.0
# via -r dev-requirements.in
protobuf==3.17.3
protobuf==3.18.0
# via
# -c requirements.txt
# flyteidl
Expand Down Expand Up @@ -228,7 +230,7 @@ pytest==6.2.5
# pytest-flyte
pytest-docker==0.10.3
# via pytest-flyte
git+git://github.com/flyteorg/pytest-flyte@main#egg=pytest-flyte
pytest-flyte @ git+git://github.com/flyteorg/pytest-flyte@main
# via -r dev-requirements.in
python-dateutil==2.8.1
# via
Expand Down Expand Up @@ -256,7 +258,7 @@ pyyaml==5.4.1
# -c requirements.txt
# docker-compose
# pre-commit
regex==2021.8.28
regex==2021.9.24
# via
# -c requirements.txt
# docker-image-py
Expand All @@ -267,7 +269,7 @@ requests==2.26.0
# docker-compose
# flytekit
# responses
responses==0.13.4
responses==0.14.0
# via
# -c requirements.txt
# flytekit
Expand All @@ -287,7 +289,6 @@ six==1.16.0
# flytekit
# grpcio
# jsonschema
# protobuf
# pynacl
# python-dateutil
# responses
Expand Down Expand Up @@ -319,13 +320,13 @@ typing-inspect==0.7.1
# via
# -c requirements.txt
# dataclasses-json
urllib3==1.26.6
urllib3==1.26.7
# via
# -c requirements.txt
# flytekit
# requests
# responses
virtualenv==20.7.2
virtualenv==20.8.1
# via pre-commit
websocket-client==0.59.0
# via
Expand All @@ -340,7 +341,7 @@ wrapt==1.12.1
# -c requirements.txt
# deprecated
# flytekit
zipp==3.5.0
zipp==3.6.0
# via
# -c requirements.txt
# importlib-metadata
Expand Down
Loading