This image adds a working Python environment to databricksruntime/minimal
using virtualenv, and is supported for Databricks Runtime 7.3 LTS and above.
For a conda-based Python environment, an alternative image can be found here.
Note that Databricks recommends using this recipe unless you need libraries that are only available from conda, as certain features like notebook-scoped libraries (e.g. %pip
) will not work with the conda recipe in newer runtimes (Databricks Runtime 9.0 and above).
- Scala Notebooks
- Java/Jar jobs
- Python Notebooks, Python Jobs,
%pip
%sh
- Spark Submit Jobs
- DBFS FUSE mount (/dbfs)
- Ganglia
- SSH