Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs(DLB): update FAQ/create troubleshooting on cluster scaling MTA-5133 #3805

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions faq/data-lab.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -25,3 +25,9 @@ Apache Spark processes data in memory, which allows it to perform tasks up to 10
## How am I billed for Distributed Data Lab?

During the private beta, Scaleway Distributed Data Lab is free.

## Can I upscale or downscale a Distributed Data Lab?

Yes, you can upscale a Data Lab cluster to distribute your workloads across a greater number of worker nodes for faster processing. You can also scale it down to zero to reduce costs, while retaining your configuration and context.

You can still access the notebook of a Data Lab cluster with zero worker nodes, but you cannot perform any calculation. You can resume the activity of your cluster by provisioning at least one worker node.
4 changes: 4 additions & 0 deletions managed-services/data-lab/how-to/manage-delete-data-lab.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,10 @@ This page explains how to manage and delete your Distributed Data Lab.
4. From this view, you can:

- Add, consult, or delete tags for your cluster.
- Update the number of worker nodes provisioned for your cluster.
<Message type="note">
Provisioning zero worker nodes lets you retain and access you cluster and notebook configurations, but will not allow you to run calculations.
</Message>
- [Delete your Data Lab cluster](/managed-services/data-lab/how-to/manage-delete-data-lab/#how-to-delete-a-distributed-data-lab).

<Message type="note">
Expand Down
39 changes: 39 additions & 0 deletions managed-services/data-lab/troubleshooting/cannot-run-data-lab.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
---
meta:
title: Troubleshooting Distributed Data Lab execution issues
description: This page helps you troubleshoot problems when you cannot execute calculations with your Distributed Data Lab cluster
content:
h1: Troubleshooting Distributed Data Lab execution issues
paragraph: This page helps you troubleshoot problems when you cannot execute calculations with your Distributed Data Lab cluster
tags: execution run distributed data-lab worker-node error cannot process issue troubleshooting solution
dates:
validation: 2024-10-08
posted: 2024-10-08
categories:
- managed-services
---

<Macro id="requirements" />

- A Scaleway account logged into the [console](https://console.scaleway.com)
- [Owner](/identity-and-access-management/iam/concepts/#owner) status or [IAM permissions](/identity-and-access-management/iam/concepts/#permission) allowing you to perform actions in the intended Organization
- A [Distributed Data Lab](/managed-services/data-lab/how-to/create-data-lab/)

## Timeout errors

### Problem

Executing calculations within the notebook returns a timeout error after a few minutes.

### Cause

The Distributed Data Lab cluster has zero worker nodes provisioned and cannot raise any resource to perform the required operations.

### Solution

[Edit your cluster configuration](/managed-services/data-lab/how-to/manage-delete-data-lab/) by provisioning at least one worker node to be able to run calculations with it.

<Message type="note">
You can provision zero worker nodes again to retain you cluster and notebook configurations while minimizing its cost.
</Message>

Loading