log_artifact: add cache option, only write to dvc.yaml if metadata ex… #620
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Extracted from #613.
dvc.yaml:artifacts
if some metadata is provided (type, name, desc, labels, or meta). This is a breaking change, but I can't see how anyone is making use of this without any metadata since it won't be used by the model registry. It's needed in auto save model in lightning #613 so we can cache a whole directory of checkpoints without annotating the whole directory.cache
kwarg tolog_artifact
(defaults toTrue
) so that it's possible to annotate the artifact metadata without caching the object. It's needed in auto save model in lightning #613 so we can annotate thebest
artifact indvc.yaml
without re-caching (since it overlaps with the cached checkpoints directory).There are probably workarounds for both in #613, but I think this flexibility to choose when to cache and when to annotate in
dvc.yaml
is useful. It also should close #572and #551(edit: and partially address #551) since it decouples caching and annotation.