Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

objects: fix gdrive CI issue #6338

Merged
merged 2 commits into from
Jul 20, 2021
Merged

objects: fix gdrive CI issue #6338

merged 2 commits into from
Jul 20, 2021

Conversation

pmrowla
Copy link
Contributor

@pmrowla pmrowla commented Jul 20, 2021

Thank you for the contribution - we'll try to review it as soon as possible. πŸ™

dvc/fs/base.py Outdated
Comment on lines 185 to 188
size = self.info(path_info).get("size")
if size is not None:
size = int(size)
return size
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Was gdrive returning string size? fs.info should always return size as int, so prob worth fixing in gdrive.py itself.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, there were 2 issues

  • after the transfer change we were verifying the destination ODB on both push and pull, when previously we only verified on pull
  • the verify on push caused us to read sizes from the gdrive fs, which made the issue w/gdrive returning string sizes show up

I'll move the conversion into our gdrive fs, still waiting for the branch build to finish to make sure there's nothing else

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@pmrowla Nice catch! πŸ”₯

@pmrowla pmrowla force-pushed the odb-transfer-gdrive branch from 0db5b1d to a36750a Compare July 20, 2021 12:53
@pmrowla pmrowla marked this pull request as ready for review July 20, 2021 13:12
@pmrowla pmrowla requested a review from a team as a code owner July 20, 2021 13:12
@pmrowla pmrowla requested review from karajan1001 and efiop July 20, 2021 13:12
@efiop efiop merged commit 12d1e3e into master Jul 20, 2021
@efiop efiop deleted the odb-transfer-gdrive branch July 20, 2021 15:54
@efiop efiop added bugfix fixes bug p0-critical Critical issue. Needs to be fixed ASAP. labels Jul 20, 2021
@efiop
Copy link
Contributor

efiop commented Jul 20, 2021

Thank you, @pmrowla ! πŸ™

@efiop
Copy link
Contributor

efiop commented Jul 20, 2021

Hm, looks like test_cloud is still a bit flaky on master πŸ€”

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bugfix fixes bug p0-critical Critical issue. Needs to be fixed ASAP.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants