-
Notifications
You must be signed in to change notification settings - Fork 11
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
databricks
as a data connector docs (#125)
* databricks as a data connector docs * fix refence in YAML * fix 'from: '
- Loading branch information
Showing
1 changed file
with
28 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,28 @@ | ||
--- | ||
type: docs | ||
title: 'Databricks Data Connector' | ||
linkTitle: 'Databricks Data Connector' | ||
description: 'Databricks Data Connector Documentation' | ||
--- | ||
|
||
Databricks as a connector for federated SQL query against Databrick's [Delta Lake](https://docs.databricks.com/en/delta/index.html). | ||
|
||
## Configuration | ||
### Secrets | ||
- `token`: An active personal access token for the Databricks instance (equivalent to `DATABRICKS_TOKEN`). | ||
- Other keys provided in the secret are directly passed to the underlying object store (e.g. `AWS_ACCESS_KEY_ID` and `AWS_SECRET_ACCESS_KEY` if backed by AWS S3). | ||
|
||
`spice login databricks` can be used to configure secrets for the Spice runtime (including AWS object store keys). | ||
|
||
### Parameters | ||
- `endpoint`: The HTTPS endpoint of the Databricks host storing the desired tables. | ||
|
||
## Example | ||
|
||
```yaml | ||
datasets: | ||
- from: databricks:spiceai.datasets.my_awesome_table // A reference to a table in the Databricks unity catalog | ||
name: my_delta_lake_table | ||
params: | ||
endpoint: "https://dbc-a1b2345c-d6e7.cloud.databricks.com" | ||
``` |