Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

remote: use progress bar when paginating #3526

Closed
efiop opened this issue Mar 24, 2020 · 1 comment · Fixed by #3532
Closed

remote: use progress bar when paginating #3526

efiop opened this issue Mar 24, 2020 · 1 comment · Fixed by #3532
Assignees
@pmrowla
Labels
enhancement Enhances DVC ui user interface / interaction

Comments

@efiop
Copy link
Contributor

efiop commented Mar 24, 2020

Followup for #3501
@efiop efiop added enhancement Enhances DVC ui user interface / interaction labels Mar 24, 2020
@pmrowla
Copy link
Contributor

pmrowla commented Mar 25, 2020

Currently for cache_exists() threaded traverse, there is a single progress bar that shows that tracks how many cache prefixes (out of 256) have been fetched. For large remotes, fetching each prefix will still be a slow operation, and it may appear to the user that dvc is hanging.

Since we have an estimated size for the remote and know approximately how many objects/pages will be returned for each prefix, we can track progress for the total number of pages fetched rather than the number of prefixes fetched.

@pmrowla pmrowla mentioned this issue Mar 25, 2020
Merged
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@pmrowla pmrowla

Labels
enhancement Enhances DVC ui user interface / interaction
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

remote: use progress bar when paginating pmrowla/dvc
2 participants
@pmrowla @efiop