Skip to content

Commit

Permalink
databricks as a data connector docs (#125)
Browse files Browse the repository at this point in the history
* databricks as a data connector docs

* fix refence in YAML

* fix 'from: '
  • Loading branch information
Jeadie authored Mar 25, 2024
1 parent 5cda75c commit 76214ab
Showing 1 changed file with 28 additions and 0 deletions.
28 changes: 28 additions & 0 deletions spiceaidocs/content/en/data-connectors/databricks.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
---
type: docs
title: 'Databricks Data Connector'
linkTitle: 'Databricks Data Connector'
description: 'Databricks Data Connector Documentation'
---

Databricks as a connector for federated SQL query against Databrick's [Delta Lake](https://docs.databricks.com/en/delta/index.html).

## Configuration
### Secrets
- `token`: An active personal access token for the Databricks instance (equivalent to `DATABRICKS_TOKEN`).
- Other keys provided in the secret are directly passed to the underlying object store (e.g. `AWS_ACCESS_KEY_ID` and `AWS_SECRET_ACCESS_KEY` if backed by AWS S3).

`spice login databricks` can be used to configure secrets for the Spice runtime (including AWS object store keys).

### Parameters
- `endpoint`: The HTTPS endpoint of the Databricks host storing the desired tables.

## Example

```yaml
datasets:
- from: databricks:spiceai.datasets.my_awesome_table // A reference to a table in the Databricks unity catalog
name: my_delta_lake_table
params:
endpoint: "https://dbc-a1b2345c-d6e7.cloud.databricks.com"
```

0 comments on commit 76214ab

Please sign in to comment.