-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fresh install /.dvc/updater.lock for all commands #2897
Comments
Hi @hjuhel-cdpq ! Could you please install psutil using |
Hi @efiop Thanks for your response My bad, I did not noticed the differences between the two commands. The output of the command is the following :
|
@hjuhel-cdpq Got it. So looks like you are running on a FUSE fs, which doesn't have hardlink implemented. Related to #2831 . I suppose it is a virtual machien that you are running and that partition is coming from the host, right? |
Yes you are right. The I'm using a directory mounted on my VM but hosted in the Windows Host. |
@hjuhel-cdpq Could you try installing this dev version:
and then run |
It's working ! Thanks a lot ! The "add" seems to be working too. Do you plan to permanently use flock locks ? |
@hjuhel-cdpq We'll definitely bring back flock by default and either will automatically detect that it is not supported (so far it seems problematic, as it might just hang forever on some nfs versions) or will introduce a config option to use nfs locks. Or, there is one more idea, where we could make the lock dir configurable, so that we could place the locks somewhere outside of the repo. In any case, it is on our TODO list for this sprint, so the permanent solution is coming soon, stay tuned! 🙂 Thanks for the feedback! |
@hjuhel-cdpq One more workaround would be to only use fuse mount as an external directory (see |
I have start reading about the cache dir in the docs. I am definitely going to try this too. |
As it turned out (see issue numbers down below), we can't really take hardlinks for granted, so `flufl.lock` is not a panacea for all filesystems. Considering that the vast majority of filesystems that our users use support `zc.lockfile`(flock-based) and it has benefits like more reliable mechanism, auto-delete when process exits, more sturdy implementation, etc, it makes more sense to bring it back and use by default again. For filesystems that don't support `flock()`, users will be able to manually enable `flufl.lock` use through the config option. It would be ideal if we could auto-detect that flock is not supported, but in the real world, it turned out to be non-trivial, as it might hang forever in a kernel context, which makes the implementation way too complex for our purposes. So what we're doing instead is showing a message before locking with `zc.lockfile` that, under normal circumstances will disappear once the lock is taken or failed, otherwise it will point users to the related documentation where they can learn about how to opt-in for `flufl.lock`. Fixes iterative#2831 Fixes iterative#2897 Related iterative#2860
Setup informations
Installed with pip, on a Ubuntu 18.04 version
Issue
Hi,
I am m new to DVC. I have installed DVC on a fresh Ubuntu install. Every command (except
init
andget
) I tried to run raised the following error :With <path_to_repo> being a path to a working Git repository.
The issue first occured when I was following the "Get Started" section of DVC :
For now I have tried :
updater.loc
, but the file does not exist.dvc/tmp/*.lock
.The
status
is not working neither.Can you help figuring out what I'm doing wrong please ?
The text was updated successfully, but these errors were encountered: