Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

config: fs: introduce fs_config sections #9922

Open
efiop opened this issue Sep 6, 2023 · 0 comments
Open

config: fs: introduce fs_config sections #9922

efiop opened this issue Sep 6, 2023 · 0 comments
Labels
feature request Requesting a new feature

Comments

@efiop
Copy link
Contributor

efiop commented Sep 6, 2023

We've introduced things like --config/--remote-config/--fs-config in dvc import/get/ls/[-url], but we are missing a general mechanism to tweak config options by matching urls instead of matching remote section names.

This could be useful for operating on multiple legacy commits, where remote names changed multiple times over the years.

This could also be very useful for in-dvcfile urls (e.g. dvc import-url), where we don't want to use remote:// notation for some reason or we can't use it at all (e.g. in dvc import and chained imports).

Inspired by git's credential sections https://git-scm.com/docs/gitcredentials#_credential_contexts

[credential "https://example.com"]
	username = foo

, we could do something more general like so:

# will match all urls (or more precisely fs instances that we create for those urls) that start with `azure://mycontainer`
[ fs_config "azure://mycontainer1" ]
# could set all config options that one might need, same as with `dvc remote`
connection_string = XXX

Related #9886

Kudos @uditrana

@efiop efiop added feature is a feature feature request Requesting a new feature and removed feature is a feature labels Sep 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request Requesting a new feature
Projects
None yet
Development

No branches or pull requests

1 participant