Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding artifacts section to docs #4481

Merged
merged 12 commits into from
Apr 25, 2023
Merged

Adding artifacts section to docs #4481

merged 12 commits into from
Apr 25, 2023

Conversation

aguschin
Copy link
Contributor

adds first items in #4423

@aguschin aguschin self-assigned this Apr 21, 2023
@aguschin
Copy link
Contributor Author

@dberenbaum this is a first touch on docs - it updates some pages.

If I'm not missing something, this is what already done (log_artifact, artifacts: section), so we can quickly iterate & merge this. Next chunk of work (GS, UG) will be more involved, so we'll spend more time on it - makes sense to merge this first if you agree.

@shcheklein shcheklein temporarily deployed to dvc-org-artifacts-uawisejujyju April 21, 2023 16:40 Inactive
@github-actions
Copy link
Contributor

github-actions bot commented Apr 21, 2023

Link Check Report

There were no links to check!

[cache](/doc/start/data-management/data-versioning) the `model.pt` file with DVC
and make Git ignore it. It will generate a `model.pt.dvc` metadata file, which
can be tracked in Git and becomes part of the experiment. With this metadata
file, you can [retrieve](/doc/start/data-management/data-versioning#retrieving)
the versioned artifact from the Git commit.

Passing `type="model"` or `type="data"` will it to `artifacts` section of
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we are adding to artifacts.yaml regardless of what other info gets passed, right @daavoo? As mentioned in the other comments, let's clarify what gets written to artifacts.yaml and clarify that the model registry won't do anything yet but soon will work with type=model artifacts.

Copy link
Contributor Author

@aguschin aguschin Apr 24, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IIUC, You are right @dberenbaum

Copy link
Contributor

@dberenbaum dberenbaum left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice start @aguschin! Left some suggestions to clarify behavior in a few places.

@dberenbaum
Copy link
Contributor

Also added @tapadipti and @shcheklein as reviewers. I'd like for either them or some others to take a look since it's our first attempt to start explaining the revamped model registry.

@shcheklein shcheklein temporarily deployed to dvc-org-artifacts-uawisejujyju April 24, 2023 05:42 Inactive
Co-authored-by: Dave Berenbaum <[email protected]>
@shcheklein shcheklein temporarily deployed to dvc-org-artifacts-uawisejujyju April 24, 2023 05:43 Inactive
@shcheklein shcheklein temporarily deployed to dvc-org-artifacts-uawisejujyju April 24, 2023 05:57 Inactive
@aguschin
Copy link
Contributor Author

aguschin commented Apr 24, 2023

@dberenbaum thanks for the helpful review! Processed that. I resolved all of your comments since they're addressed now.

content/docs/use-cases/model-registry.md Outdated Show resolved Hide resolved
content/docs/use-cases/model-registry.md Outdated Show resolved Hide resolved
@shcheklein shcheklein temporarily deployed to dvc-org-artifacts-uawisejujyju April 24, 2023 10:54 Inactive
@shcheklein shcheklein temporarily deployed to dvc-org-artifacts-uawisejujyju April 24, 2023 10:55 Inactive
Comment on lines 91 to 93
Passing `type="model"` or `type="data"` will add it to `artifacts` section of
`dvc.yaml`, allowing DVC to understand what it is and show models in
[Studio Model Registry](/doc/use-cases/model-registry).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This still feels a little confusing to me because:

  1. We aren't currently working on any Studio functionality for type=data (let's only talk about plans for things that are at least in progress already).
  2. It still sounds like it only adds to artifacts if type=model or type=data, which isn't true.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, sorry - I thought I fixed that. Doing it now.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok, did that. It's ready to merge I believe.

Copy link
Contributor

@dberenbaum dberenbaum left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for making those updates @aguschin! I left a couple follow-up comments. Once those are addressed, I think it's ready to merge.

@shcheklein shcheklein temporarily deployed to dvc-org-artifacts-uawisejujyju April 25, 2023 03:17 Inactive
Copy link
Contributor

@omesser omesser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good @aguschin !
I've added a few comments and suggestions, please take a look.
Still, IMO non are real blockers to merge - approving

content/docs/dvclive/how-it-works.md Outdated Show resolved Hide resolved
content/docs/dvclive/how-it-works.md Outdated Show resolved Hide resolved
content/docs/dvclive/live/log_artifact.md Outdated Show resolved Hide resolved
If `Live` was initialized with `dvcyaml=True` (which is the default), it will
add an [artifact](/doc/user-guide/project-structure/dvcyaml-files#artifacts) and
all the metadata passed as arguments to corresponding `dvc.yaml`. Passing
`type="model"` will mark it as a `model` for DVC and will make it appear in
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

... for DVC and will also make Studio Model Registry support it (coming soon!).

Same as above

content/docs/dvclive/how-it-works.md Outdated Show resolved Hide resolved
content/docs/use-cases/model-registry.md Outdated Show resolved Hide resolved
content/docs/use-cases/model-registry.md Outdated Show resolved Hide resolved
content/docs/use-cases/model-registry.md Outdated Show resolved Hide resolved
content/docs/use-cases/model-registry.md Outdated Show resolved Hide resolved
content/docs/user-guide/project-structure/dvcyaml-files.md Outdated Show resolved Hide resolved
@shcheklein shcheklein requested a deployment to dvc-org-artifacts-uawisejujyju April 25, 2023 12:41 Abandoned
@shcheklein shcheklein requested a deployment to dvc-org-artifacts-uawisejujyju April 25, 2023 12:42 Abandoned
@shcheklein shcheklein temporarily deployed to dvc-org-artifacts-uawisejujyju April 25, 2023 12:43 Inactive
@aguschin aguschin dismissed dberenbaum’s stale review April 25, 2023 12:44

let's merge, we'll have another chance to update this

@aguschin aguschin merged commit c29ecfc into main Apr 25, 2023
@aguschin aguschin deleted the artifacts branch April 25, 2023 12:45
@omesser
Copy link
Contributor

omesser commented Apr 25, 2023

Nice work, Thanks @aguschin 🙏

@dberenbaum
Copy link
Contributor

Yep, looks good, thanks @aguschin!

@dberenbaum dberenbaum mentioned this pull request Apr 25, 2023
13 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants