Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[% mlflow run -e fetch --experiment-name fetch . ] fails on mac because the required packages in conda.yaml are not in the channels anymore #1

Open
cerkut opened this issue Jan 6, 2023 · 2 comments · Fixed by #3

Comments

@cerkut
Copy link

cerkut commented Jan 6, 2023

I am experimenting with the new/newest versions of the packages... I'll update when everything works. I'll also test on linux.

% mlflow run -e fetch --experiment-name fetch .
2023/01/06 07:16:58 INFO mlflow.projects: 'fetch' does not exist. Creating a new experiment
2023/01/06 07:17:00 INFO mlflow.utils.conda: === Creating conda environment mlflow-f3a887a8670b1c12ea791603ac8214bc2c2f0cc8 ===
Collecting package metadata (repodata.json): ...working... ls
done
Solving environment: ...working... failed

ResolvePackageNotFound: 
  - scikit-learn==0.22.1
  - torchaudio==0.7.2
  - pytorch==1.7.1=py3.7_cuda10.1.243_cudnn7.6.3_0
  - pandas==0.25.3
  - ignite==0.3.0
  - python==3.7.10
  - pytest==5.3.5
  - torchvision==0.8.2=py37_cu101
  - scipy==1.4.1
  - numpy==1.18.1
@cerkut
Copy link
Author

cerkut commented Jan 6, 2023

pruning the versions on conda.yaml works but then I get a data download error
`(torch-nightly) % mlflow run -e fetch --experiment-name fetch .
2023/01/06 09:03:31 INFO mlflow.utils.conda: Conda environment mlflow-762c55660d3ef06c42273cf930ff0c6df523e084 already exists.
2023/01/06 09:03:31 INFO mlflow.projects.utils: === Created directory /var/folders/j4/0lv7gs9s385byhj07wh6tch40000gp/T/tmpjp1rpwya for downloading remote URIs passed to arguments of type 'path' ===
2023/01/06 09:03:31 INFO mlflow.projects.backend.local: === Running command 'source /opt/homebrew/Caskroom/miniforge/base/bin/../etc/profile.d/conda.sh && conda activate mlflow-762c55660d3ef06c42273cf930ff0c6df523e084 1>&2 && $SHELL scripts/fetch.sh data
' in run with ID '97ab94ac3c144ff58f5b1bfe709f7aa2' ===
+scripts/fetch.sh:5> SMDATA_DIR=data
+scripts/fetch.sh:7> FRAXTIL_URLS=$'https://fra.xtil.net/simfiles/data/tsunamix/III/Tsunamix%20III%20%5BSM5%5D.zip\nhttps://fra.xtil.net/simfiles/data/arrowarrangements/Fraxtil%27s%20Arrow%20Arrangements%20%5BSM5%5D.zip\nhttps://fra.xtil.net/simfiles/data/beastbeats/Fraxtil%27s%20Beast%20Beats%20%5BSM5%5D.zip\n'
+scripts/fetch.sh:11> ITG_URLS=$'https://search.stepmaniaonline.net/static/new/In%20The%20Groove%201.zip\nhttps://search.stepmaniaonline.net/static/new/In%20The%20Groove%202.zip\n'
+scripts/fetch.sh:15> mkdir -p data/raw
+scripts/fetch.sh:16> pushd data/raw
+scripts/fetch.sh:18> mkdir -p fraxtil
+scripts/fetch.sh:19> pushd fraxtil
+scripts/fetch.sh:20> I=https://fra.xtil.net/simfiles/data/tsunamix/III/Tsunamix%20III%20%5BSM5%5D.zip
https://fra.xtil.net/simfiles/data/arrowarrangements/Fraxtil%27s%20Arrow%20Arrangements%20%5BSM5%5D.zip
https://fra.xtil.net/simfiles/data/beastbeats/Fraxtil%27s%20Beast%20Beats%20%5BSM5%5D.zip

+scripts/fetch.sh:22> curl $'https://fra.xtil.net/simfiles/data/tsunamix/III/Tsunamix%20III%20%5BSM5%5D.zip\nhttps://fra.xtil.net/simfiles/data/arrowarrangements/Fraxtil%27s%20Arrow%20Arrangements%20%5BSM5%5D.zip\nhttps://fra.xtil.net/simfiles/data/beastbeats/Fraxtil%27s%20Beast%20Beats%20%5BSM5%5D.zip\n' -o temp.zip
curl: (3) URL using bad/illegal format or missing URL
2023/01/06 09:03:31 ERROR mlflow.cli: === Run (ID '97ab94ac3c144ff58f5b1bfe709f7aa2') failed ===
(torch-nightly) cer@AAU121633 6040 %
`

@NaokiHamada
Copy link
Collaborator

Thanks for reporting.
The download error was due to URLs in FRAXTIL_URLS and ITG_URLS that seem not to be separated by linebreak, fixed by #3.

I'm still working on the package not found issue.

@NaokiHamada NaokiHamada reopened this Apr 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants