Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dvc integration: summarizing already running experiment #7

Closed
pared opened this issue Nov 27, 2020 · 3 comments
Closed

dvc integration: summarizing already running experiment #7

pared opened this issue Nov 27, 2020 · 3 comments
Assignees

Comments

@pared
Copy link
Contributor

pared commented Nov 27, 2020

Scenario:

  1. We run experiment, with logger turned on
  2. We want to take a peek into our training
  3. We run a command dvc logs show --continuous {target} (I presume dvc logs show {target} will be reserved for ad-hoc check
  4. Command keeps generating new HTML until we are done with training

We need to detach summary generation from dvclive (as it is done currently).

EDIT:
probably we do not need to implement --continuous in the beginning as it is easily replaceable by simple watch command.

@dmpetrov
Copy link
Member

I'd expect that the Summary&HTML files regeneration will happen automatically without any additional command. We can consider a suppression flag if needed.

@pared
Copy link
Contributor Author

pared commented Nov 30, 2020

@dmpetrov ok, do we want to keep dvc logs command functionality? I imagine there can be use cases for that - eg when someone just wants to see comparison of two different training runs, on a fresh repo clone.

@pared
Copy link
Contributor Author

pared commented Jan 4, 2021

We introduced command for producing run summary as in #16, in iterative/dvc#4902

@pared pared closed this as completed Jan 4, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants