From 5cce85f8a8be1ce2ff0bb747cb483f79efa203ab Mon Sep 17 00:00:00 2001 From: SamyOubouaziz Date: Tue, 8 Oct 2024 10:59:21 +0200 Subject: [PATCH 1/3] docs(DLB): update FAQ/create troubleshooting on cluster scaling MTA-5133 --- faq/data-lab.mdx | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/faq/data-lab.mdx b/faq/data-lab.mdx index 9c2fb7e418..1f69292090 100644 --- a/faq/data-lab.mdx +++ b/faq/data-lab.mdx @@ -25,3 +25,9 @@ Apache Spark processes data in memory, which allows it to perform tasks up to 10 ## How am I billed for Distributed Data Lab? During the private beta, Scaleway Distributed Data Lab is free. + +## Can I upscale or downscale a Distributed Data Lab? + +Yes, you can upscale a Data Lab cluster to distribute your workloads across a greater number of worker nodes for faster processing. You can also scale it down to zero to reduce costs, while retaining your configuration and context. + +You can still access the notebook of a Data Lab cluster with zero worker nodes, but you cannot perform any calculation. You can resume the activity of your cluster by provisioning at least one worker node. \ No newline at end of file From 2f7f14bdf45217388acea8aeb34a554a82de116b Mon Sep 17 00:00:00 2001 From: SamyOubouaziz Date: Tue, 8 Oct 2024 11:18:03 +0200 Subject: [PATCH 2/3] docs(DLB): update --- .../how-to/manage-delete-data-lab.mdx | 4 ++ .../troubleshooting/cannot-run-data-lab.mdx | 39 +++++++++++++++++++ 2 files changed, 43 insertions(+) create mode 100644 managed-services/data-lab/troubleshooting/cannot-run-data-lab.mdx diff --git a/managed-services/data-lab/how-to/manage-delete-data-lab.mdx b/managed-services/data-lab/how-to/manage-delete-data-lab.mdx index c4cdfd7040..a5d32651e0 100644 --- a/managed-services/data-lab/how-to/manage-delete-data-lab.mdx +++ b/managed-services/data-lab/how-to/manage-delete-data-lab.mdx @@ -34,6 +34,10 @@ This page explains how to manage and delete your Distributed Data Lab. 4. From this view, you can: - Add, consult, or delete tags for your cluster. + - Update the number of worker nodes provisioned for your cluster. + + Provisioning zero worker nodes lets you retain and access you cluster and notebook configurations, but will not allow you to run calculations. + - [Delete your Data Lab cluster](/managed-services/data-lab/how-to/manage-delete-data-lab/#how-to-delete-a-distributed-data-lab). diff --git a/managed-services/data-lab/troubleshooting/cannot-run-data-lab.mdx b/managed-services/data-lab/troubleshooting/cannot-run-data-lab.mdx new file mode 100644 index 0000000000..fbba125421 --- /dev/null +++ b/managed-services/data-lab/troubleshooting/cannot-run-data-lab.mdx @@ -0,0 +1,39 @@ +--- +meta: + title: Troubleshooting Distributed Data Lab execution issues + description: This page helps you troubleshoot problems when you cannot execute calculations with your Distributed Data Lab cluster +content: + h1: Troubleshooting Distributed Data Lab execution issues + paragraph: This page helps you troubleshoot problems when you cannot execute calculations with your Distributed Data Lab cluster +tags: execution run distributed data-lab worker-node error cannot process issue troubleshooting solution +dates: + validation: 2024-10-08 + posted: 2024-10-08 +categories: + - managed-services +--- + + + +- A Scaleway account logged into the [console](https://console.scaleway.com) +- [Owner](/identity-and-access-management/iam/concepts/#owner) status or [IAM permissions](/identity-and-access-management/iam/concepts/#permission) allowing you to perform actions in the intended Organization +- A [Distributed Data Lab](/compute/instances/how-to/create-an-instance/) + +## Timeout errors + +### Problem + +Executing calculations within the notebook returns a timeout error after a few minutes. + +### Cause + +The Distributed Data Lab cluster has zero worker nodes provisioned and cannot raise any resource to perform the required operations. + +### Solution + +[Edit your cluster configuration](/managed-services/data-lab/how-to/manage-delete-data-lab/) by provisioning at least one worker node to be able to run calculations with it. + + +You can provision zero worker nodes again to retain you cluster and notebook configurations while minimizing its cost. + + From ef28ce0ef09d3ab969159c7ffdcb61d1ea653daf Mon Sep 17 00:00:00 2001 From: SamyOubouaziz Date: Tue, 8 Oct 2024 11:19:27 +0200 Subject: [PATCH 3/3] docs(DLB): update --- .../data-lab/troubleshooting/cannot-run-data-lab.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/managed-services/data-lab/troubleshooting/cannot-run-data-lab.mdx b/managed-services/data-lab/troubleshooting/cannot-run-data-lab.mdx index fbba125421..91db8d27e1 100644 --- a/managed-services/data-lab/troubleshooting/cannot-run-data-lab.mdx +++ b/managed-services/data-lab/troubleshooting/cannot-run-data-lab.mdx @@ -17,7 +17,7 @@ categories: - A Scaleway account logged into the [console](https://console.scaleway.com) - [Owner](/identity-and-access-management/iam/concepts/#owner) status or [IAM permissions](/identity-and-access-management/iam/concepts/#permission) allowing you to perform actions in the intended Organization -- A [Distributed Data Lab](/compute/instances/how-to/create-an-instance/) +- A [Distributed Data Lab](/managed-services/data-lab/how-to/create-data-lab/) ## Timeout errors