Skip to content

Commit

Permalink
docs:(mlops) update spark image docs
Browse files Browse the repository at this point in the history
Signed-off-by: Piotr Mossakowski <[email protected]>
  • Loading branch information
moss2k13 committed Oct 1, 2024
1 parent 44bad38 commit 0ada502
Showing 1 changed file with 9 additions and 4 deletions.
13 changes: 9 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,14 +25,19 @@ used to build and manage local versions of `base-notebook` image that are no lon
Based on the [jupyter/pyspark-notebook](https://jupyter-docker-stacks.readthedocs.io/en/latest/using/selecting.html#jupyter-pyspark-notebook)
image with additional setup of:

* conda-backed python 3.9 environment
* conda-backed python 3.11 environment with [kedro 0.19.8](https://docs.kedro.org/en/0.19.8/) framework
* [jupyterlab-git](https://github.com/jupyterlab/jupyterlab-git) extension
* [jupyter-server-proxy](https://jupyter-server-proxy.readthedocs.io) extension
* local [MLflow](https://mlflow.org/) server for experiment tracking
* additional conda environment with python 3.8 and [kedro](https://kedro.readthedocs.io/en/stable/) framework
* Istio-compatible Spark executor entrypoint
* local [code-server](https://github.com/coder/code-server) as IDE accessed from the browser
* local [Spark 3.5.0](https://spark.apache.org/docs/3.5.0/) server for data analytics

![jupyterlab-mlops-launcher](docs/jupyterlab-mlops-launcher.png)

Compatibility:

- [x] [JupyterHub](https://jupyter.org/hub)

### jupyterlab-mlops:python-3.11

Based on the [jupyter/minimal-notebook:python-3.11](https://jupyter-docker-stacks.readthedocs.io/en/latest/using/selecting.html#jupyter-minimal-notebook)
Expand All @@ -49,7 +54,7 @@ image with additional setup of:
Compatibility:

- [x] [Kubeflow Notebook Servers](https://www.kubeflow.org/docs/components/notebooks/)
- [x] [Vertex AI Notebooks](https://cloud.google.com/vertex-ai/docs/general/notebooks)
- [x] [JupyterHub](https://jupyter.org/hub)

## jupyterlab-dataops

Expand Down

0 comments on commit 0ada502

Please sign in to comment.