Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pkg: deploy model or dataset #1768

Closed
dmpetrov opened this issue Mar 22, 2019 · 3 comments
Closed

pkg: deploy model or dataset #1768

dmpetrov opened this issue Mar 22, 2019 · 3 comments
Assignees
Labels
feature request Requesting a new feature

Comments

@dmpetrov
Copy link
Member

Currently dvc pkg install instantiates data artifacts in a current repository and cannot work outside of a repo.

In some cases, like production model deployment scenario, a repository is not needed. The only important thing is a data file content without any meta files (aka dvc-files).

We need to implement an option (like --flatten or --deploy) for this out-of-repository scenario.

Model deployment example:

$ mkdir /mnt/deploy
$ ls -a /mnt/deploy
.   ..
$ dvc pkg install --flatten -s model.pkl http://github.com/dmpetrov/new_tag_classifier /mnt/deploy/
$ ls -a /mnt/deploy
.   ..    model.pkl 

Download a dataset example:

$ dvc pkg install --flatten http://github.com/dmpetrov/imagenet .
$ ls -a
.   ..    imagenet/ 
$ du -sh imagenet
118G

Possible option names:

  1. --flatten, -f - it might conflict with the current -f FILE, --file FILE.
  2. --deploy, -d
@dmpetrov dmpetrov added the feature request Requesting a new feature label Mar 22, 2019
@ghost
Copy link

ghost commented May 8, 2019

For your command dvc pkg install --flatten -s model.pkl http://github.com/dmpetrov/new_tag_classifier /mnt/deploy/ how would the command specify the specific version of the model.pkl? Should it be included in the Git URL (http://github.com/dmpetrov/new_tag_classifier#v1.0) or maybe via arguments (--tag v1.0 or --branch prod)?

@dmpetrov
Copy link
Member Author

dmpetrov commented May 8, 2019

Hi @snagacarl
The command was not released yet :) pease expect API changes

@efiop is working on the implementation which might change API.
I’d expect to have version in arguments. Version in URL might be a good addition to this.

@efiop efiop self-assigned this Jun 12, 2019
@efiop
Copy link
Contributor

efiop commented Jun 17, 2019

Fixed by #2012 . Example command (can be ran outside of dvc repo):

dvc pkg get https://github.com/iterative/dvc scripts/innosetup/dvc.ico

Importing the whole package will be handled by #2140

@efiop efiop closed this as completed Jun 17, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request Requesting a new feature
Projects
None yet
Development

No branches or pull requests

2 participants