Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

clarify external data examples #2538

Closed
casperdcl opened this issue Jun 4, 2021 · 2 comments
Closed

clarify external data examples #2538

casperdcl opened this issue Jun 4, 2021 · 2 comments
Labels
A: docs Area: user documentation (gatsby-theme-iterative)

Comments

@casperdcl
Copy link
Contributor

casperdcl commented Jun 4, 2021

https://dvc.org/doc/user-guide/managing-external-data#examples is a bit confusing to me since the external-data in the examples doesn't seem to be used.

Maybe after dvc add --external there should be something like dvc run -d remote://external-data ...?

Also instead of labelling

  1. Config
  2. Tracking
  3. Create,

it should be more like

  1. Config
  2. Use cases
    a) Tracking
    b) Create,

unless I've misunderstood something?

@casperdcl casperdcl added the A: docs Area: user documentation (gatsby-theme-iterative) label Jun 4, 2021
@shcheklein
Copy link
Member

Related #520

You are not alone :)

Some context:

  1. External deps/outs - are advanced features, so we haven't been paying enough attention for now
  2. Managing external data was initially named "External outputs" and it was even more confusing - since it was hard to find a basic scenario (I have data on S3 - how do I add it as-is and manage it in place? why is it an output in that case??) So as temp solution we renamed it to be this title and it should be addressed as part of the guide: consolidate external data mgmt guides #520 eventually.
  3. This section might include other scenarios eventually - straight to remote, ext outs and ext deps together, external cache probably, etc.

I hope that help a bit :) Let me know if there are more questions now, good to discuss and hear more opinions about this.

I would suggest to continue in #520 though.

@casperdcl
Copy link
Contributor Author

migrated & merged with #2542

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A: docs Area: user documentation (gatsby-theme-iterative)
Projects
None yet
Development

No branches or pull requests

2 participants