rsync support for /dist mirroring

[jsumners]

Way back in 2012 you asked on Twitter if there are any public mirrors -- https://twitter.com/nodejs/status/211311765479374848

Someone asked you how, and you were silent. Today, I find myself wanting to mirror at least v4.x and v5.x of /dist to a local system for other systems I run that can't access the Internet. Using wget is a rather poor solution, and you probably don't want that load on the web server.

So, I'm asking you to provide us with a better way to mirror the /dist content.

[stevemao]

ping @nodejs/build
This should be probably asked in the build or help repo.

[jsumners]

Okay. I wasn't sure where it should go.

[fhemberger]

This may help:
nodejs/nodejs.org-archive#23
https://gist.github.com/rgbkrk/5499863

[jsumners]

@fhemberger I already know of the python script. It's a decent stop-gap, but it isn't a good replacement for rsync.

[fhemberger]

@rvagg @nodejs/build Do we need to change something in /dist to allow rsync mirroring?

[jsumners]

@fhemberger no. You just need to add an rsync server definition:

/etc/rsyncd.conf:

[dist]
  path = /path/to/web/dist
  comment = dist files via rsync

[jsumners]

For the interim, or if you decide to not implement rsync, I wrote a better script, bandwidth saving, script:

https://gist.github.com/jsumners/4d1861c586708fab7c758f711952ed85

[ghost]

@jsumners could you put that in a gist and link it here? kinda clutters up the issue a bit 😶

[rvagg]

If anyone here's interested in beta testing an rsync endpoint, please hit me up @ [email protected] and @jbergstroem and I will get you set up to try out our shiny new experiment.

[fhemberger]

@nodejs/build Is this issue resolved?

[jbergstroem]

We have a rsync endpoint up and running at unencrypted.nodejs.org. The idea was to make it official as part of hsts but seeing how that hasn't happened the public announcement is pending. It is working and gets regularly updated, though.

[fhemberger]

Closing this issue here due to lack of activity, further discussion should take place in @nodejs/build.
Feel free to re-open if there's a new development.