Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ssh: handle concurrency issues for raw command execution #6370

Merged
merged 2 commits into from
Jul 29, 2021

Conversation

isidentical
Copy link
Contributor

From #6295 (comment). There are 2 primary issues, one is that we used to max out all the sessions with SFTP channels, so after a certain amount of operations there wasn't any channels to use for SSH. Now we allocate 2 channels for it. The second issue is that, AsyncFileSystem that fsspec offers overrides the move() command with it's own copy()+remove() implementation. Now that is also temporarily fixed on the sshfs, and will submit a patch against fsspec upstream.

@isidentical isidentical requested a review from a team as a code owner July 29, 2021 10:26
@isidentical isidentical requested a review from karajan1001 July 29, 2021 10:26
@efiop efiop merged commit 9634efe into iterative:master Jul 29, 2021
@efiop
Copy link
Contributor

efiop commented Jul 29, 2021

Tested in my setup, works like charm now. Thank you! 🙏

@isidentical
Copy link
Contributor Author

Thanks for giving it a try @efiop!

@isidentical isidentical added the fs: ssh Related to the SSH filesystem label Jul 29, 2021
@isidentical isidentical self-assigned this Jul 29, 2021
@efiop efiop added the bugfix fixes bug label Aug 2, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bugfix fixes bug fs: ssh Related to the SSH filesystem
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants