Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WSL2 git is slow from gitlab #6602

Closed
golkedj opened this issue Mar 1, 2021 · 20 comments
Closed

WSL2 git is slow from gitlab #6602

golkedj opened this issue Mar 1, 2021 · 20 comments

Comments

@golkedj
Copy link

golkedj commented Mar 1, 2021

Environment

Windows build number: [Version 10.0.19041.804]
Your Distribution version: [Ubuntu 20.04]
Whether the issue is on WSL 2 and/or WSL 1: [Linux version 4.19.128-microsoft-standard (oe-user@oe-host) (gcc version 8.2.0 (GCC)) #1 SMP Tue Jun 23 12:58:10 UTC 2020]

Steps to reproduce

  • Launch Ubuntu for WSL2
  • Install and run speed test: https://www.speedtest.net/apps/cli
  • Attempt to clone a git repository within the \\wsl$\Ubuntu\home\<user> directory
  • Observe that gits reported network performance is far under the systems available network performance

Expected behavior

Git clones the repository in a timely manner with reasonable network speeds for the network you are on

Actual behavior

Git takes extremely long to finish the clone command and is operating well below the network thresholds.

This issue is is the worst when running git operations on repositories that are located on Gitlab (all repositories, private, public, etc). When interacting with Gitlab I see speeds <= ~80 KiB/s. When checking out from Github I see speeds >= 1 MiB/s. When interacting with either Gitlab or Github using windows git.exe commands I see speeds >= 20 MiB/s. I have also ran a speed test on my WSL2 Ubuntu instance via the command line tool and am getting ~200 Mbpsdownload and~20 Mbpsupload. Furthermore, all of my repositories are within\wsl$\Ubuntu\home\golkedj` and therefore should not be experiences I/O performance issues based on what I have read in this thread and other threads.
I am convinced that this issue only recently starting presenting itself because I have been interacting with this repository for several months with this exact same WSL2 Ubuntu instance and have noticed no issues at all until recently when I was unable to do anything with this repository within a reasonable amount of time. For example when I first set up this WSL2 Ubuntu instance I cloned this repository without issue, but now a fresh clone of it is taking several hours to complete (I have not actually been able to wait long enough for it to complete successfully).

I currently worked around this issue by using wsl.exe after modifying the core.autocrlf setting to input but this is not a feasible workaround due to the number of repositories I work with daily and the need to be able to run the WSL2 git command for them for consistency.

Performance details:

  • Gitlab clone with WSL Ubuntu's git command:
    • Receiving objects: 16% (553/3435), 268.01 KiB | 34.00 KiB/s
  • Github clone with WSL Ubuntu's git command:
    • Receiving objects: 100% (1034/1034), 487.62 KiB | 4.31 MiB/s, done.
  • speed test results: https://www.speedtest.net/result/c/1b45ae1f-41ba-4e32-bea2-bc283632ccdf
  • Gitlab clone with Windows git.exe command:
    • Receiving objects: 100% (3435/3435), 903.49 MiB | 19.56 MiB/s, done.
  • Github clone with Windows git.exe command:
    • Receiving objects: 100% (434/434), 7.43 MiB | 13.19 MiB/s, done.
@golkedj golkedj changed the title Git slow in WSL2 within \\wsl$\<distro> repository Git slow in WSL2 within \\wsl$\<distro> directory Mar 2, 2021
@golkedj golkedj changed the title Git slow in WSL2 within \\wsl$\<distro> directory Git slow in WSL2 within \\wsl$\<distro>\home\<user>\ directory Mar 2, 2021
@therealkenc
Copy link
Collaborator

Gitlab clone with WSL Ubuntu's git command:
Receiving objects: 16% (553/3435), 268.01 KiB | 34.00 KiB/s

Can you please clarify the repro. Inside WSL Ubuntu, your options are cloning into /mnt/c/somewhere and /home/you/somewhere (contrast \\wsl$\Ubuntu\somewhere). Or post a screencap for context.

@golkedj
Copy link
Author

golkedj commented Mar 2, 2021

@therealkenc I am attempting to clone into /home/you/somewhere or equivalent (not /mnt/c/somewhere)

@therealkenc
Copy link
Collaborator

Okay, thanks. So presumably it is slow into /anywhere.

On a lark, total WAG experiment, try:

$ sudo ifconfig eth0 mtu 1350
$ git clone ....

@therealkenc therealkenc changed the title Git slow in WSL2 within \\wsl$\<distro>\home\<user>\ directory WSL2 git is slow from gitlab Mar 2, 2021
@golkedj
Copy link
Author

golkedj commented Mar 2, 2021

@therealkenc Which package should ifconfig come from?

golkedj@DESKTOP-UQQ4025:~/tmp$ sudo ifconfig eth0 mtu 1350
[sudo] password for golkedj:
sudo: ifconfig: command not found
golkedj@DESKTOP-UQQ4025:~/tmp$ sudo apt install ifconfig
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Unable to locate package ifconfig

It looks like ifconfig has been deprecated and replaced with ip, however I am not familiar enough with either to be able to convert your example command to a new ip command. Source: https://unix.stackexchange.com/questions/145447/ifconfig-command-not-found#:~:text=You%20were%20probably%20looking%20for,ip%20from%20the%20package%20iproute2%20.

@therealkenc
Copy link
Collaborator

therealkenc commented Mar 2, 2021

sudo apt install net-tools for ifconfig. For ip (via iproute2 package), it looks like:

$ sudo ip link set dev eth0 mtu 1350

@golkedj
Copy link
Author

golkedj commented Mar 2, 2021

It is still stuck with a KiB/s speed.

golkedj@DESKTOP-UQQ4025:~/tmp$ sudo ip link set dev eth0 mtu 1350
[sudo] password for golkedj:
golkedj@DESKTOP-UQQ4025:~/tmp$ git clone [email protected]:some-repository.git
Cloning into 'some-repository'...
remote: Enumerating objects: 240, done.
remote: Counting objects: 100% (240/240), done.
remote: Compressing objects: 100% (130/130), done.
Receiving objects:  16% (553/3435), 4.80 MiB | 51.00 KiB/s0 KiB/s

@therealkenc
Copy link
Collaborator

Was worth a try, thanks. You are variation #4901 but can have your own landing zone, given variable gitlab has come up a few times and doesn't have a good explanation.

@golkedj
Copy link
Author

golkedj commented Mar 2, 2021

For me I do not think it is a network issue as mentioned in #4901. I ran a speed test via WSL and the speed test CLI and that gave me extremely good numbers. Something else is going on here like throttling for specific things and/or slowdown due to I/O performance. I provided the speed test results in the issue description.

@JensLincke
Copy link

I had a similar issue with git performance under wsl2 and browsing other issues stumbled upon #6585.

I replace the default /etc/resolve.conf with

nameserver 8.8.8.8

And after this my "git pull" was pretty fast again. The problem was that resolving names the did not exist seems to be problematic when there is a VPN connection hanging around...

@golkedj
Copy link
Author

golkedj commented Mar 10, 2021

@JensLincke That does not seem to help in my case

@therealkenc
Copy link
Collaborator

That does not seem to help in my case

Yes, you are seeing a crazy low bitrate (34.00 KiB/s). DNS related git "slowness" manifests as an unholy pause while the resolver sorts itself (if it does at all), but once the IP address has been resolved, the download proper proceeds at pace.

@golkedj
Copy link
Author

golkedj commented Mar 16, 2021

Is there any workaround for this? I'm contemplating completely abandoning using WSL2 for development and switching back to a pure Windows development environment setup. However, I really do enjoy the WSL2 experience, other than this specific issue

@benhillis
Copy link
Member

We have a fix for this incoming, but in the meantime this should get things working:

sudo ifconfig eth0 mtu 1350 up

@Actticus
Copy link

We have a fix for this incoming, but in the meantime this should get things working:

sudo ifconfig eth0 mtu 1350 up

Hi. Whats about fix? sudo ifconfig eth0 mtu 1350 up doesn't worked for me :(

@Housi
Copy link

Housi commented Oct 1, 2022

This looks like more general networking issue within WSL. When connected to VPN all downloads get stuck or are super slow at best. I've checked alternative protocols, and it seems that OpenVPN (both TCP and UDP), works well. ExpressVPN's Lightway and IKEv2 don't.

@tchafack
Copy link

tchafack commented Nov 2, 2022

I was stuck on a "git push"
I close and open back WSL and I could push instantly

@huangzl97
Copy link

I had a similar issue with git performance under wsl2 and browsing other issues stumbled upon #6585.

I replace the default /etc/resolve.conf with

nameserver 8.8.8.8

And after this my "git pull" was pretty fast again. The problem was that resolving names the did not exist seems to be problematic when there is a VPN connection hanging around...

It works for me.
also remember to follow this comment #5420 (comment) to prevent wsl overwriting your resolve.conf file

@KTanAug21
Copy link

I had a similar issue with git performance under wsl2 and browsing other issues stumbled upon #6585.

I replace the default /etc/resolve.conf with

nameserver 8.8.8.8

And after this my "git pull" was pretty fast again. The problem was that resolving names the did not exist seems to be problematic when there is a VPN connection hanging around...

This works wonders! I was stuck cloning a repo at KiB/s, now it's MiB/s and completed! Thank you so much!

@ProximaB
Copy link

ProximaB commented Jun 19, 2023

I have the same issue. cloning, fetching from wsl at Kb/s. Replacing the content of /etc/resolv.cong didn't work for me.
I am using Self Hosted Gitlab, FortiClient VPN and WSL2.
Funny thing that after invoking git pull, it surprisingly starts working at normal pace.
Edit: I think it may be somehow related to pausing system(sleep mode), git pull doesn't seems to help now

Copy link
Contributor

This issue has been automatically closed since it has not had any activity for the past year. If you're still experiencing this issue please re-file this as a new issue or feature request.

Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

10 participants