From 9cb884fb092908d1005d5fd817dbd11549cc2ba0 Mon Sep 17 00:00:00 2001 From: Cengguang Zhang Date: Wed, 14 Sep 2022 13:29:28 +0800 Subject: [PATCH 1/9] feat: add faq to ray overview doc. --- docs/readthedocs/source/doc/Ray/Overview/ray.md | 15 +++++++++++++++ 1 file changed, 15 insertions(+) diff --git a/docs/readthedocs/source/doc/Ray/Overview/ray.md b/docs/readthedocs/source/doc/Ray/Overview/ray.md index c3d1a1a6b60..1c00d91af91 100644 --- a/docs/readthedocs/source/doc/Ray/Overview/ray.md +++ b/docs/readthedocs/source/doc/Ray/Overview/ray.md @@ -116,3 +116,18 @@ Add the environment variables when calling `init_orca_context` would resolve the ```python sc = init_orca_context(cluster_mode, init_ray_on_spark=True, env={"LANG": "C.UTF-8", "LC_ALL": "C.UTF-8"}) ``` + +--- +### **5. FAQ** +- ValueError: Ray component worker_ports is trying to use a port number ... that is used by other components. +This error is because that some port in worker port list is occupied by other processes. To handle this issue, we can set range of the worker port list by using parameters `min-worker-port` and `max-worker-port` in `init_orca_context()` as follows: + +```python +init_orca_context(extra_params={"min-worker-port": "30000", "max-worker-port": "30033"}) +``` + +Or you also can directly set the worker port list with parameter `worker-port-list` in `init_orca_context()` as follows: + +```python +init_orca_context(extra_params={"worker-port-list": "30001,30003,30005"}) +``` From e21039b359ef065a2e3031c69eeae7c4aa04fc39 Mon Sep 17 00:00:00 2001 From: Cengguang Zhang Date: Wed, 14 Sep 2022 13:33:48 +0800 Subject: [PATCH 2/9] fix: fix doc style. --- .../source/doc/Ray/Overview/ray.md | 19 ++++++++++--------- 1 file changed, 10 insertions(+), 9 deletions(-) diff --git a/docs/readthedocs/source/doc/Ray/Overview/ray.md b/docs/readthedocs/source/doc/Ray/Overview/ray.md index 1c00d91af91..e62a138912a 100644 --- a/docs/readthedocs/source/doc/Ray/Overview/ray.md +++ b/docs/readthedocs/source/doc/Ray/Overview/ray.md @@ -119,15 +119,16 @@ sc = init_orca_context(cluster_mode, init_ray_on_spark=True, env={"LANG": "C.UTF --- ### **5. FAQ** -- ValueError: Ray component worker_ports is trying to use a port number ... that is used by other components. -This error is because that some port in worker port list is occupied by other processes. To handle this issue, we can set range of the worker port list by using parameters `min-worker-port` and `max-worker-port` in `init_orca_context()` as follows: +- **ValueError: Ray component worker_ports is trying to use a port number ... that is used by other components.** -```python -init_orca_context(extra_params={"min-worker-port": "30000", "max-worker-port": "30033"}) -``` + This error is because that some port in worker port list is occupied by other processes. To handle this issue, we can set range of the worker port list by using parameters `min-worker-port` and `max-worker-port` in `init_orca_context()` as follows: -Or you also can directly set the worker port list with parameter `worker-port-list` in `init_orca_context()` as follows: + ```python + init_orca_context(extra_params={"min-worker-port": "30000", "max-worker-port": "30033"}) + ``` -```python -init_orca_context(extra_params={"worker-port-list": "30001,30003,30005"}) -``` + Or you also can directly set the worker port list with parameter `worker-port-list` in `init_orca_context()` as follows: + + ```python + init_orca_context(extra_params={"worker-port-list": "30001,30003,30005"}) + ``` From 2e9470c6a661b00cf0869aedf507baba2bac1c1c Mon Sep 17 00:00:00 2001 From: Cengguang Zhang Date: Wed, 14 Sep 2022 13:35:24 +0800 Subject: [PATCH 3/9] fix: fix typo. --- docs/readthedocs/source/doc/Ray/Overview/ray.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/readthedocs/source/doc/Ray/Overview/ray.md b/docs/readthedocs/source/doc/Ray/Overview/ray.md index e62a138912a..57db48e0a0d 100644 --- a/docs/readthedocs/source/doc/Ray/Overview/ray.md +++ b/docs/readthedocs/source/doc/Ray/Overview/ray.md @@ -121,7 +121,7 @@ sc = init_orca_context(cluster_mode, init_ray_on_spark=True, env={"LANG": "C.UTF ### **5. FAQ** - **ValueError: Ray component worker_ports is trying to use a port number ... that is used by other components.** - This error is because that some port in worker port list is occupied by other processes. To handle this issue, we can set range of the worker port list by using parameters `min-worker-port` and `max-worker-port` in `init_orca_context()` as follows: + This error is because that some port in worker port list is occupied by other processes. To handle this issue, you can set range of the worker port list by using parameters `min-worker-port` and `max-worker-port` in `init_orca_context()` as follows: ```python init_orca_context(extra_params={"min-worker-port": "30000", "max-worker-port": "30033"}) From 6b51c83fb0cd5c0340feb7d841758d08c3ba4076 Mon Sep 17 00:00:00 2001 From: lalalapotter Date: Thu, 15 Sep 2022 10:15:55 +0800 Subject: [PATCH 4/9] feat: add ray redis and dashboard port conflict to faq. --- docs/readthedocs/source/doc/Ray/Overview/ray.md | 12 ++++++++++-- 1 file changed, 10 insertions(+), 2 deletions(-) diff --git a/docs/readthedocs/source/doc/Ray/Overview/ray.md b/docs/readthedocs/source/doc/Ray/Overview/ray.md index 57db48e0a0d..f2e683a26c6 100644 --- a/docs/readthedocs/source/doc/Ray/Overview/ray.md +++ b/docs/readthedocs/source/doc/Ray/Overview/ray.md @@ -127,8 +127,16 @@ sc = init_orca_context(cluster_mode, init_ray_on_spark=True, env={"LANG": "C.UTF init_orca_context(extra_params={"min-worker-port": "30000", "max-worker-port": "30033"}) ``` - Or you also can directly set the worker port list with parameter `worker-port-list` in `init_orca_context()` as follows: +- **ValueError: Failed to bind to 0.0.0.0:8265 because it's already occupied. You can use `ray start --dashboard-port ...` or `ray.init(dashboard_port=...)` to select a different port.** + + This error is because that ray dashboard port is occupied by other processes. To handle this issues, you can end the process occupyied the port or you can set the ray dashboard port by using parameters `dashboard-port` in `init_orca_context()` as follows: + + ```python + init_orca_context(extra_params={"dashboard-port": "50005"}) + ``` + + Note that, the similar error can happen to ray redis port as well, you can also set the ray redis port by using parameters `port` in `init_orca_context()` as follows: ```python - init_orca_context(extra_params={"worker-port-list": "30001,30003,30005"}) + init_orca_context(extra_params={"port": "50006"}) ``` From 2ceb569abd7bbb06ae8270713b8bf9cb0676dbec Mon Sep 17 00:00:00 2001 From: Cengguang Zhang Date: Thu, 15 Sep 2022 15:43:03 +0800 Subject: [PATCH 5/9] fix: fix redis port param name. --- docs/readthedocs/source/doc/Ray/Overview/ray.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/readthedocs/source/doc/Ray/Overview/ray.md b/docs/readthedocs/source/doc/Ray/Overview/ray.md index f2e683a26c6..28a0773c6db 100644 --- a/docs/readthedocs/source/doc/Ray/Overview/ray.md +++ b/docs/readthedocs/source/doc/Ray/Overview/ray.md @@ -135,8 +135,8 @@ sc = init_orca_context(cluster_mode, init_ray_on_spark=True, env={"LANG": "C.UTF init_orca_context(extra_params={"dashboard-port": "50005"}) ``` - Note that, the similar error can happen to ray redis port as well, you can also set the ray redis port by using parameters `port` in `init_orca_context()` as follows: + Note that, the similar error can happen to ray redis port as well, you can also set the ray redis port by using parameters `redis_port` in `init_orca_context()` as follows: ```python - init_orca_context(extra_params={"port": "50006"}) + init_orca_context(redis_port=50005) ``` From bf980f9c686852a984e29adefe058cfbda10873b Mon Sep 17 00:00:00 2001 From: Cengguang Zhang Date: Thu, 15 Sep 2022 15:43:59 +0800 Subject: [PATCH 6/9] fix: fix redis port param name. --- docs/readthedocs/source/doc/Ray/Overview/ray.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/readthedocs/source/doc/Ray/Overview/ray.md b/docs/readthedocs/source/doc/Ray/Overview/ray.md index 28a0773c6db..5cc57eab547 100644 --- a/docs/readthedocs/source/doc/Ray/Overview/ray.md +++ b/docs/readthedocs/source/doc/Ray/Overview/ray.md @@ -138,5 +138,5 @@ sc = init_orca_context(cluster_mode, init_ray_on_spark=True, env={"LANG": "C.UTF Note that, the similar error can happen to ray redis port as well, you can also set the ray redis port by using parameters `redis_port` in `init_orca_context()` as follows: ```python - init_orca_context(redis_port=50005) + init_orca_context(redis_port=50006) ``` From 81f5e90c12e497127dd4b0abe683abaf71f18d29 Mon Sep 17 00:00:00 2001 From: Cengguang Zhang Date: Thu, 15 Sep 2022 15:56:35 +0800 Subject: [PATCH 7/9] fix: fix typo --- docs/readthedocs/source/doc/Ray/Overview/ray.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/readthedocs/source/doc/Ray/Overview/ray.md b/docs/readthedocs/source/doc/Ray/Overview/ray.md index 5cc57eab547..b6884e38467 100644 --- a/docs/readthedocs/source/doc/Ray/Overview/ray.md +++ b/docs/readthedocs/source/doc/Ray/Overview/ray.md @@ -129,13 +129,13 @@ sc = init_orca_context(cluster_mode, init_ray_on_spark=True, env={"LANG": "C.UTF - **ValueError: Failed to bind to 0.0.0.0:8265 because it's already occupied. You can use `ray start --dashboard-port ...` or `ray.init(dashboard_port=...)` to select a different port.** - This error is because that ray dashboard port is occupied by other processes. To handle this issues, you can end the process occupyied the port or you can set the ray dashboard port by using parameters `dashboard-port` in `init_orca_context()` as follows: + This error is because that ray dashboard port is occupied by other processes. To handle this issue, you can end the process occupyies the port or you can manually set the ray dashboard port by using parameter `dashboard-port` in `init_orca_context()` as follows: ```python init_orca_context(extra_params={"dashboard-port": "50005"}) ``` - Note that, the similar error can happen to ray redis port as well, you can also set the ray redis port by using parameters `redis_port` in `init_orca_context()` as follows: + Note that, the similar error can happen to ray redis port as well, you can also set the ray redis port by using parameter `redis_port` in `init_orca_context()` as follows: ```python init_orca_context(redis_port=50006) From ae582734854926b960f71be20a815e46a27285cd Mon Sep 17 00:00:00 2001 From: Cengguang Zhang Date: Thu, 15 Sep 2022 15:57:12 +0800 Subject: [PATCH 8/9] fix: fix typo --- docs/readthedocs/source/doc/Ray/Overview/ray.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/readthedocs/source/doc/Ray/Overview/ray.md b/docs/readthedocs/source/doc/Ray/Overview/ray.md index b6884e38467..53fe0658de5 100644 --- a/docs/readthedocs/source/doc/Ray/Overview/ray.md +++ b/docs/readthedocs/source/doc/Ray/Overview/ray.md @@ -129,7 +129,7 @@ sc = init_orca_context(cluster_mode, init_ray_on_spark=True, env={"LANG": "C.UTF - **ValueError: Failed to bind to 0.0.0.0:8265 because it's already occupied. You can use `ray start --dashboard-port ...` or `ray.init(dashboard_port=...)` to select a different port.** - This error is because that ray dashboard port is occupied by other processes. To handle this issue, you can end the process occupyies the port or you can manually set the ray dashboard port by using parameter `dashboard-port` in `init_orca_context()` as follows: + This error is because that ray dashboard port is occupied by other processes. To handle this issue, you can end the process that occupies the port or you can manually set the ray dashboard port by using parameter `dashboard-port` in `init_orca_context()` as follows: ```python init_orca_context(extra_params={"dashboard-port": "50005"}) From 7778f7a09eed5aac2ecf71ae71c086d6b0b81210 Mon Sep 17 00:00:00 2001 From: Cengguang Zhang Date: Thu, 15 Sep 2022 19:21:32 +0800 Subject: [PATCH 9/9] fix: fix wording. --- docs/readthedocs/source/doc/Ray/Overview/ray.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/readthedocs/source/doc/Ray/Overview/ray.md b/docs/readthedocs/source/doc/Ray/Overview/ray.md index 53fe0658de5..e7e20f87d5b 100644 --- a/docs/readthedocs/source/doc/Ray/Overview/ray.md +++ b/docs/readthedocs/source/doc/Ray/Overview/ray.md @@ -121,7 +121,7 @@ sc = init_orca_context(cluster_mode, init_ray_on_spark=True, env={"LANG": "C.UTF ### **5. FAQ** - **ValueError: Ray component worker_ports is trying to use a port number ... that is used by other components.** - This error is because that some port in worker port list is occupied by other processes. To handle this issue, you can set range of the worker port list by using parameters `min-worker-port` and `max-worker-port` in `init_orca_context()` as follows: + This error is because that some port in worker port list is occupied by other processes. To handle this issue, you can set range of the worker port list by using the parameters `min-worker-port` and `max-worker-port` in `init_orca_context` as follows: ```python init_orca_context(extra_params={"min-worker-port": "30000", "max-worker-port": "30033"}) @@ -129,13 +129,13 @@ sc = init_orca_context(cluster_mode, init_ray_on_spark=True, env={"LANG": "C.UTF - **ValueError: Failed to bind to 0.0.0.0:8265 because it's already occupied. You can use `ray start --dashboard-port ...` or `ray.init(dashboard_port=...)` to select a different port.** - This error is because that ray dashboard port is occupied by other processes. To handle this issue, you can end the process that occupies the port or you can manually set the ray dashboard port by using parameter `dashboard-port` in `init_orca_context()` as follows: + This error is because that ray dashboard port is occupied by other processes. To handle this issue, you can end the process that occupies the port or you can manually set the ray dashboard port by using the parameter `dashboard-port` in `init_orca_context` as follows: ```python init_orca_context(extra_params={"dashboard-port": "50005"}) ``` - Note that, the similar error can happen to ray redis port as well, you can also set the ray redis port by using parameter `redis_port` in `init_orca_context()` as follows: + Note that, the similar error can happen to ray redis port as well, you can also set the ray redis port by using the parameter `redis_port` in `init_orca_context` as follows: ```python init_orca_context(redis_port=50006)