Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

databricks as a data connector docs #125

Merged
merged 3 commits into from
Mar 25, 2024
Merged
Changes from 2 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
28 changes: 28 additions & 0 deletions spiceaidocs/content/en/data-connectors/databricks.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
---
type: docs
title: 'Databricks Data Connector'
linkTitle: 'Databricks Data Connector'
description: 'Databricks Data Connector Documentation'
---

Databricks as a connector for federated SQL query against Databrick's [Delta Lake](https://docs.databricks.com/en/delta/index.html).

## Configuration
### Secrets
- `token`: An active personal access token for the Databricks instance (equivalent to `DATABRICKS_TOKEN`).
- Other keys provided in the secret are directly passed to the underlying object store (e.g. `AWS_ACCESS_KEY_ID` and `AWS_SECRET_ACCESS_KEY` if backed by AWS S3).

`spice login databricks` can be used to configure secrets for the Spice runtime (including AWS object store keys).

### Parameters
- `endpoint`: The HTTPS endpoint of the Databricks host storing the desired tables.

## Example

```yaml
datasets:
- from: databricks.com:spiceai/datasets // A reference to a table in the Databricks unity catalog
Jeadie marked this conversation as resolved.
Show resolved Hide resolved
name: my_delta_lake_table
params:
endpoint: "https://dbc-a1b2345c-d6e7.cloud.databricks.com"
```
Loading