Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dvc gc --all-commits --cloud: Inconsistency in behavior when using "config.local" file for "gc" and "push" commands. #10560

Open
RaahimSiddiqi opened this issue Sep 18, 2024 · 0 comments
Labels
A: gc Related go garbage collection bug Did we break something? p2-medium Medium priority, should be done, but less important

Comments

@RaahimSiddiqi
Copy link

RaahimSiddiqi commented Sep 18, 2024

Bug Report

Inconsistency in behavior when using "config.local" file for "gc" and "push" commands. I am using a password-based authentication system for a remote SSH system. The "url" field is in the regular config file, and the "password" field is in the "config.local" file.

When running "dvc push" commands, this successfully picks up the url from the regular config file, and the password from the config.local file. However, running "dvc gc" related commands fails, and throws an error related to a missing url field. However, if i copy-paste the url field from the regular config file into the config-local file, this will work.

Reproduce


config file:

[core]
    remote = localremote
['remote "localremote"']
    url = ssh://@DVCSystem:22/DVC/

config.local file:

['remote "localremote"']
    password = 12345678

  1. Now run the dvc push command, and verify it is working.
  2. Now run dvc gc --all-commits --cloud command, and it will fail.

Expected

An error will be thrown about a missing URL field in the dictionary.

I am aware that this issue can be solved by copy-pasting the URL from config file into the config.local file. But i'm hoping for a proper fix for this.

DVC doctor

DVC version: 3.55.2 (pip)

Platform: Python 3.11.9 on Windows-10-10.0.22631-SP0
Subprojects:
dvc_data = 3.16.5
dvc_objects = 5.1.0
dvc_render = 1.0.2
dvc_task = 0.4.0
scmrepo = 3.3.7
Supports:
azure (adlfs = 2024.7.0, knack = 0.12.0, azure-identity = 1.17.1),
http (aiohttp = 3.10.5, aiohttp-retry = 2.8.3),
https (aiohttp = 3.10.5, aiohttp-retry = 2.8.3),
ssh (sshfs = 2024.6.0)
Config:
Global: C:\Users\Raahim.siddiqi\AppData\Local\iterative\dvc
System: C:\ProgramData\iterative\dvc
Cache types: https://error.dvc.org/no-dvc-cache
Caches: local
Remotes: azure, ssh
Workspace directory: NTFS on C:
Repo: dvc, git
Repo.site_cache_dir: C:\ProgramData\iterative\dvc\Cache\repo\0a64a38d268fc6862f2aa4915375898d

@RaahimSiddiqi RaahimSiddiqi changed the title dvc gc --all-commits: Inconsistency in behavior when using "config.local" file for "gc" and "push" commands. dvc gc --all-commits --cloud: Inconsistency in behavior when using "config.local" file for "gc" and "push" commands. Sep 18, 2024
@shcheklein shcheklein added bug Did we break something? A: gc Related go garbage collection p2-medium Medium priority, should be done, but less important labels Sep 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A: gc Related go garbage collection bug Did we break something? p2-medium Medium priority, should be done, but less important
Projects
None yet
Development

No branches or pull requests

2 participants