tl; dr; A combinator data component that installs Seldon-Core, an ML serving framework.
Seldon-Core is an open-source model serving and monitoring framework. It allows you to deploy your ML models so that they can be consumed by users over consistent REST APIs. In addition, other Seldon tools allow you to monitor your model in production.
Learn more about Seldon-Core in the repo.
The fastest way to get started is to use the test drive functionality provided by TestFaster. Click on the "Launch Test Drive" button below (opens a new window).
Once the component has launched, click on the Jupyter link. Seldon-Core does not have a UI by default. You will use Jupyter to interact with Seldon-Core via its Kubernetes API.
Once inside Jupyter, browse to the demo notebook, which comes from the official quick start guide. Follow the instructions in the notebook to deploy a pre-trained model.
Start by preparing your Kubernetes cluster using one of the infrastructure components or use your own cluster.
module "seldon" {
source = "combinator-ml/seldon/k8s"
# Optional settings go here
}
See the full configuration options below.
Name | Version |
---|---|
helm | >= 2.0.0 |
kubectl | >= 1.7.0 |
kubernetes | >= 2.0.0 |
Name | Version |
---|---|
helm | >= 2.0.0 |
kubectl | >= 1.7.0 |
kubernetes | >= 2.0.0 |
Name | Source | Version |
---|---|---|
istio | combinator-ml/istio/k8s | 0.0.1 |
Name |
---|
helm_release |
kubectl_file_documents |
kubectl_manifest |
kubernetes_namespace |
Name | Description | Type | Default | Required |
---|---|---|---|---|
enable_example_seldon_deployment | Enable an example seldon deployment | bool |
true |
no |
enable_seldon_gateway | Create an istio gateway for seldon | bool |
true |
no |
seldon_core_operator_namespace | (Optional) The namespace to install the minio operator into. Defaults to minio-operator | string |
"seldon-system" |
no |
seldon_core_values | (Optional) List of values in raw yaml to pass to helm. | list(string) |
[] |
no |
No output.