Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

exp run --reset : Clarify behavior #2745

Closed
Tracked by #2768
daavoo opened this issue Aug 23, 2021 · 5 comments · Fixed by #3182
Closed
Tracked by #2768

exp run --reset : Clarify behavior #2745

daavoo opened this issue Aug 23, 2021 · 5 comments · Fixed by #3182
Labels
A: docs Area: user documentation (gatsby-theme-iterative) type: enhancement Something is not clear, small updates, improvement suggestions

Comments

@daavoo
Copy link
Contributor

daavoo commented Aug 23, 2021

If the user has a pipeline using checkpoints and runs dvc exp run --reset without changing the deps, the checkpoints: true stage(s) run(s) again.

This is currently intended behavior, it's not really a bug. Doing exp run --reset is treated similarly to doing dvc repro --force, and will reproduce your entire pipeline from the initial checkpoint state.

I see. I guess that at least we should clarify this --force similarity in the docs, as it seems to be missing from https://dvc.org/doc/command-reference/exp/run#--reset

From iterative/dvc#6475

UPDATE: Also

reset here is to reset the epochs to 0, so it is reasonable to restart the training

@daavoo daavoo changed the title exp run --rest: Clarify behavior exp run --reset: Clarify behavior Aug 23, 2021
@daavoo daavoo changed the title exp run --reset: Clarify behavior exp run --reset : Clarify behavior Aug 23, 2021
@dberenbaum
Copy link
Contributor

Agree that we should clarify, but let's decide on what the expected behavior is before changing the functionality or docs. I don't think the current docs are clear about whether the experiment will be run again.

Related: iterative/dvc#6475

@shcheklein shcheklein added type: enhancement Something is not clear, small updates, improvement suggestions A: docs Area: user documentation (gatsby-theme-iterative) labels Aug 24, 2021
@jorgeorpinel
Copy link
Contributor

If it's a small edit like just saying "this has the same result as --reset above" in the --force bullet then let's go for it meanwhile?

@dberenbaum
Copy link
Contributor

Sure, if we can easily add more clarity, there's no harm.

@jorgeorpinel

This comment has been minimized.

@jorgeorpinel
Copy link
Contributor

jorgeorpinel commented Jan 27, 2022

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A: docs Area: user documentation (gatsby-theme-iterative) type: enhancement Something is not clear, small updates, improvement suggestions
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants