Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

experiments: submit to studio #10324

Closed
dberenbaum opened this issue Feb 26, 2024 · 0 comments
Closed

experiments: submit to studio #10324

dberenbaum opened this issue Feb 26, 2024 · 0 comments
Labels
A: experiments Related to dvc exp p2-medium Medium priority, should be done, but less important product: Studio Integration with Studio

Comments

@dberenbaum
Copy link
Collaborator

dberenbaum commented Feb 26, 2024

Similar to #9641, studio now has the ability to run experiments. DVC should be able to submit experiments to studio as long as the studio token is set.

This can be invoked in the CLI like this:

$ dvc queue start --task studio_task_id

See here for a demo of how to register a task in studio. The above command should:

  • Create a special ref for each queued experiment (this will create an additional commit for each experiment)
  • For each experiment, push the ref to the git remote and the dvc-tracked data to the dvc remote
  • Call Studio API and provide the refs and the task ID
  • Mark each queued experiment as submitted to studio

This should provide everything studio needs to run the experiment using the provided task ID.

@dberenbaum dberenbaum added A: experiments Related to dvc exp product: Studio Integration with Studio p1-important Important, aka current backlog of things to do labels Feb 26, 2024
@dberenbaum dberenbaum added this to DVC Feb 26, 2024
@dberenbaum dberenbaum moved this to Backlog in DVC Feb 26, 2024
@dberenbaum dberenbaum added p2-medium Medium priority, should be done, but less important and removed p1-important Important, aka current backlog of things to do labels Mar 25, 2024
@dberenbaum dberenbaum closed this as not planned Won't fix, can't repro, duplicate, stale Apr 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A: experiments Related to dvc exp p2-medium Medium priority, should be done, but less important product: Studio Integration with Studio
Projects
No open projects
Status: Backlog
Development

No branches or pull requests

1 participant