Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

glossary: create "stage" entry #2198

Closed
wants to merge 47 commits into from
Closed
Changes from 2 commits
Commits
Show all changes
47 commits
Select commit Hold shift + click to select a range
dac8b8b
guide: intro (empty) EM guide + basic links
jorgeorpinel Feb 3, 2021
352aaac
Merge branch 'master' into guide/experiments
jorgeorpinel Feb 3, 2021
b1e4c58
guide: intro, structure, and run-cache section in Exp Mgmt
jorgeorpinel Feb 3, 2021
92c3b1f
guide: finish Exp Mgmt intro, shorten run-cache section
jorgeorpinel Feb 4, 2021
70e4f91
guide: shorten Exp Mgmt intro and its run-cache section more, and
jorgeorpinel Feb 5, 2021
f73ae78
guide: finish explaining ephimeral exps
jorgeorpinel Feb 9, 2021
6b9b509
guide: improves to ephimeral exps, intro persisten exps in Exp Mgmt
jorgeorpinel Feb 9, 2021
203fa3c
guide: more info on ephimeral exps and wrap up persistent exps section
jorgeorpinel Feb 9, 2021
fd344d6
guide: begin Orging exps in Exp Mgmt
jorgeorpinel Feb 9, 2021
c7cc388
guide: copy edits Ephemeral experiments
jorgeorpinel Feb 9, 2021
2fabec3
Merge branch 'master' into guide/experiments
jorgeorpinel Feb 10, 2021
ea260f6
guide: remove 0. Tests and add add Checkpoints section
jorgeorpinel Feb 10, 2021
3099d1a
guide: 3 main exp forms in Exp Mgmt
jorgeorpinel Feb 10, 2021
d012334
guide: simplify Exp Mgmt tech details
jorgeorpinel Feb 10, 2021
006068c
guide: finish Checkpoints section in Exp Mgmt
jorgeorpinel Feb 11, 2021
520563b
guide: mention params, metrics, plots, and other copy edits to Exp Mgmt
jorgeorpinel Feb 11, 2021
b571f50
guide: wrap up comprehensive Ecx Mgmt doc, add checkpoint to dvc.yaml…
jorgeorpinel Feb 16, 2021
b540d4e
Merge branch 'master' into guide/experiments
jorgeorpinel Feb 16, 2021
143a2b2
glossary: create "stage" entry
iesahin Feb 16, 2021
f1bfda3
ref: move checkpoint field into dvc.yaml output spec
jorgeorpinel Feb 16, 2021
51fa327
glossary: migrate exp tooltip to new format (fontmatter)
jorgeorpinel Feb 16, 2021
1ea2da3
modified to have a more informal language and removed BC text from th…
iesahin Feb 17, 2021
3d7aed3
cmd: add dvc update --to-remote docs (#2175)
isidentical Feb 18, 2021
ba8178e
Draft of Feb Heartbeat (#2190)
jendefig Feb 18, 2021
bdf1396
dvc 2.0 pre-release
dmpetrov Feb 18, 2021
be79555
Update content/blog/2021-02-18-dvc-2-0-pre-release.md
jorgeorpinel Feb 18, 2021
f84dac4
Update content/blog/2021-02-18-dvc-2-0-pre-release.md
jorgeorpinel Feb 18, 2021
25b13fe
Update content/blog/2021-02-18-dvc-2-0-pre-release.md
jorgeorpinel Feb 18, 2021
ed3e96f
Update content/blog/2021-02-18-dvc-2-0-pre-release.md
jorgeorpinel Feb 18, 2021
3788662
Update content/blog/2021-02-18-dvc-2-0-pre-release.md
jorgeorpinel Feb 18, 2021
8db8665
Update content/blog/2021-02-18-dvc-2-0-pre-release.md
jorgeorpinel Feb 18, 2021
9503aa0
Update content/blog/2021-02-18-dvc-2-0-pre-release.md
jorgeorpinel Feb 18, 2021
cd27812
Update content/blog/2021-02-18-dvc-2-0-pre-release.md
jorgeorpinel Feb 18, 2021
47b85cb
Update content/blog/2021-02-18-dvc-2-0-pre-release.md
jorgeorpinel Feb 18, 2021
26fda1d
feedback & experiments
dmpetrov Feb 18, 2021
a2310da
live metrics
dmpetrov Feb 18, 2021
5209585
Update content/blog/2021-02-18-dvc-2-0-pre-release.md
jorgeorpinel Feb 18, 2021
308c825
show live metrics
dmpetrov Feb 18, 2021
3a2ffeb
add tables in checkpoint section
dmpetrov Feb 18, 2021
7c6e34c
Merge pull request #2211 from iterative/dvc-20-pre-release
dmpetrov Feb 19, 2021
943e55f
Merge pull request #2146 from iterative/guide/experiments
jorgeorpinel Feb 19, 2021
4398f7c
pre-release blog fixes
dmpetrov Feb 19, 2021
d651fc0
exp run - fix resume table
dmpetrov Feb 19, 2021
e3e3653
fix duplication issue in table
dmpetrov Feb 19, 2021
1908fa1
Merge pull request #2218 from iterative/dvc-20-pre-release-fixes
dmpetrov Feb 19, 2021
87942d0
document stage:add (#2208)
skshetry Feb 19, 2021
8293e53
Merge branch 'iesahin/issue1579' of github.com:iterative/dvc.org into…
iesahin Feb 20, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions content/docs/user-guide/basic-concepts/stage.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
---
name: 'Stage'
match: ['stage', 'stages']
tooltip: >-
A single step in a pipeline which may import data, run experiments and produce
some (intermediate or final) output. Stages may depend other stages and they
can be automatically invalidated when their dependencies change.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good start. I'd look in https://dvc.org/doc/command-reference/run for the existing definition/explanation. Specific questions on this current text:

  • Stages run experiments? I think not exactly
  • Probably need to describe "invalidated"

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A user runs experiments in stages and a stage may be completely about running an experiment, right? Am I missing something? Stages don't run experiment but a stage may only be about running an experiment.

Will add a "user" there.

Instead of invalidation, I can tell how run or repro skips some stages but succinctly using the "invalidation" seemed more appropriate.

Copy link
Contributor

@jorgeorpinel jorgeorpinel Feb 18, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Experiments are broader than individual stages (see WIP https://dvc-org-guide-experimen-xigcev.herokuapp.com/doc/user-guide/experiment-management). For now I think there's no need to complicate this tooltip with the concept of experiments.

Instead of invalidation, I can tell how run or repro skips some stages

Check the "parameter" and "pipelines file" tooltips: they use invalid (considered outdated)

---