Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add snap tests #2956

Merged
merged 11 commits into from
Jan 19, 2020
Merged

add snap tests #2956

merged 11 commits into from
Jan 19, 2020

Conversation

casperdcl
Copy link
Contributor

@casperdcl casperdcl commented Dec 14, 2019

@casperdcl casperdcl added ui user interface / interaction testing Related to the tests and the testing infrastructure build Issues/features related to building dvc install packages. labels Dec 14, 2019
@casperdcl casperdcl requested a review from efiop December 14, 2019 17:00
@casperdcl casperdcl self-assigned this Dec 14, 2019
@casperdcl
Copy link
Contributor Author

casperdcl commented Dec 14, 2019

https://status.python.org/

PyPI Backends Unavailable
Investigating - We are currently investigating this issue.
Dec 14, 17:10 UTC

Looks like they've had issues for a couple of days though:

image

scripts/build_package.sh Outdated Show resolved Hide resolved
@casperdcl
Copy link
Contributor Author

casperdcl commented Dec 17, 2019

https://travis-ci.com/iterative/dvc/jobs/268243764#L2141

+dvc get https://github.com/iterative/dvc scripts/innosetup/dvc.ico
ERROR: failed to get 'scripts/innosetup/dvc.ico' from 'https://github.com/iterative/dvc' - URL 'https://github.com/iterative/dvc' is not a dvc repository.

@efiop not sure how to debug this - the command works on my machine

@efiop
Copy link
Contributor

efiop commented Dec 18, 2019

@casperdcl Let's start with full log first (add -v flag). But it is probably caused by gitpython not being able to clone from that url, not sure about specific reasons.

@casperdcl
Copy link
Contributor Author

casperdcl commented Dec 18, 2019

hm tried to re-run in case it was a connectivity issue. Also added -v:

dvc get -v https://github.com/iterative/dvc scripts/innosetup/dvc.ico
DEBUG: Removing '.E2pCP5rJPv8KEEHvaEUce9'
ERROR: failed to get 'scripts/innosetup/dvc.ico' from 'https://github.com/iterative/dvc' - URL 'https://github.com/iterative/dvc' is not a dvc repository.
------------------------------------------------------------
Traceback (most recent call last):
  File "/snap/dvc/x1/lib/python3.6/site-packages/dvc/repo/get.py", line 47, in get
    with external_repo(cache_dir=tmp_dir, url=url, rev=rev) as repo:
  File "/snap/dvc/x1/usr/lib/python3.6/contextlib.py", line 81, in __enter__
    return next(self.gen)
  File "/snap/dvc/x1/lib/python3.6/site-packages/dvc/external_repo.py", line 25, in external_repo
    path = _external_repo(url=url, rev=rev_lock or rev, cache_dir=cache_dir)
  File "/snap/dvc/x1/lib/python3.6/site-packages/dvc/external_repo.py", line 71, in _external_repo
    repo = Repo(new_path)
  File "/snap/dvc/x1/lib/python3.6/site-packages/dvc/repo/__init__.py", line 81, in __init__
    root_dir = self.find_root(root_dir)
  File "/snap/dvc/x1/lib/python3.6/site-packages/dvc/repo/__init__.py", line 149, in find_root
    raise NotDvcRepoError(root)
dvc.exceptions.NotDvcRepoError: you are not inside of a dvc repository (checked up to mount point /')
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/snap/dvc/x1/lib/python3.6/site-packages/dvc/command/get.py", line 23, in run
    rev=self.args.rev,
  File "/snap/dvc/x1/lib/python3.6/site-packages/dvc/repo/get.py", line 76, in get
    raise UrlNotDvcRepoError(url)
dvc.exceptions.UrlNotDvcRepoError: URL 'https://github.com/iterative/dvc' is not a dvc repository.
------------------------------------------------------------

@efiop
Copy link
Contributor

efiop commented Dec 21, 2019

@casperdcl Sorry, just noticed your comment. Probably connectivity issues in the container? Maybe it needs some special perms to access the network?

@efiop
Copy link
Contributor

efiop commented Jan 7, 2020

@casperdcl Was the issue resolved?

@casperdcl casperdcl restored the snap branch January 8, 2020 05:54
@casperdcl
Copy link
Contributor Author

nope, just mistakenly deleted the branch

@casperdcl
Copy link
Contributor Author

just rebased; will try to investigate. Do we have ssh debugging in travis @efiop?

@casperdcl
Copy link
Contributor Author

well running the snap's built-in version of git works (dvc.git fetch --all completes successfully) so it doesn't seem to be a snap connectivity issue. Maybe missing dependencies for dvc get?

@casperdcl
Copy link
Contributor Author

also the fact that dvc.git status works successfully implies that file system i/o isn't an issue either

@efiop
Copy link
Contributor

efiop commented Jan 8, 2020

just rebased; will try to investigate. Do we have ssh debugging in travis @efiop?

I'm pretty sure we don't. Or at least I'm not aware of it.

Try modifying find_root https://github.com/iterative/dvc/blob/master/dvc/repo/__init__.py#L132 to print listdirs when he walks them. Looks like it doesn't see .dvc for some reason, which might be because of a broken git clone, which could be broken because of gitpython and some weird env situation here.
These are just my thoughts, I haven't looked into this deep enough.

@efiop efiop changed the title add snap tests [WIP] add snap tests Jan 10, 2020
@casperdcl casperdcl changed the title [WIP] add snap tests add snap tests Jan 19, 2020
@casperdcl casperdcl requested a review from efiop January 19, 2020 19:14
@efiop
Copy link
Contributor

efiop commented Jan 19, 2020

@casperdcl Looks good. Is this ready for merge?

EDIT: got a confirmation in PMs.

@efiop efiop merged commit ec2c8ad into iterative:master Jan 19, 2020
@casperdcl casperdcl deleted the snap branch January 19, 2020 20:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Issues/features related to building dvc install packages. research testing Related to the tests and the testing infrastructure ui user interface / interaction
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Snap stable channel not updating add snap tests
2 participants