Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RFC] Replace "parallel learning" in docs with "distributed learning"? #3596

Closed
jameslamb opened this issue Nov 25, 2020 · 4 comments
Closed
Assignees

Comments

@jameslamb
Copy link
Collaborator

LightGBM comes with the ability to use multiple machines for training. This can be done with the CLI, or with integrations like Spark, Kubeflow Fairing, and Dask (#3515 ).

Today, the docs refer to training with multiple machines as "parallel learning".

image

I think that this is not quite precise enough, and can lead to some confusion.

LightGBM has at least two types of parallelism:

  • within one process (shared memory), using multithreading with OpenMP
  • across multiple processes (possibly on multiple machines, and with distributed data), using either sockets or MPI

https://lightgbm.readthedocs.io/en/latest/Parallel-Learning-Guide.html#parallel-learning-guide only refers to the second case today.

I think we should rename this guide to "Distributed Learning" and use the word "distributed" everywhere in the documentation that talks about using multiple machines to accomplish model training.

Wanted to open this request for comment before I start making changes. What do you think?

@StrikerRUS
Copy link
Collaborator

I'm +1, BUT with keeping old links alive.

@guolinke
Copy link
Collaborator

agree with @StrikerRUS

@jameslamb
Copy link
Collaborator Author

ok thanks! I'll prepare a PR.

I also agree on preserving the prior links

@github-actions
Copy link

This issue has been automatically locked since there has not been any recent activity since it was closed. To start a new related discussion, open a new issue at https://github.com/microsoft/LightGBM/issues including a reference to this.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Aug 23, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

3 participants