Skip to content

Commit

Permalink
Add PVC for dev.kubeflow.org
Browse files Browse the repository at this point in the history
  • Loading branch information
Peter MacKinnon committed May 24, 2018
1 parent 31023ab commit da36990
Show file tree
Hide file tree
Showing 63 changed files with 10,260 additions and 119 deletions.
1 change: 0 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
@@ -1,7 +1,6 @@
# pkg and bin directories currently contain build artifacts
# only so we exclude them.
bin/
vendor/

.vscode/

Expand Down
4 changes: 2 additions & 2 deletions .pylintrc
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@

# Add files or directories to the blacklist. They should be base names, not
# paths.
ignore=third_party
ignore=vendor

# Add files or directories matching the regex patterns to the blacklist. The
# regex matches against base names, not paths.
Expand Down Expand Up @@ -401,4 +401,4 @@ exclude-protected=_asdict,_fields,_replace,_source,_make

# Exceptions that will emit a warning when being caught. Defaults to
# "Exception"
overgeneral-exceptions=Exception
overgeneral-exceptions=Exception
10 changes: 5 additions & 5 deletions dev-kubeflow-org/ks-app/app.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -10,25 +10,25 @@ kind: ksonnet.io/app
libraries:
core:
gitVersion:
commitSha: fe9fc2aa3cceba6266ced46ee828ba21ee0152bd
commitSha: 01ccdffb79e499ddd6ab5d2f60b8c0fbac5ac8df
refSpec: master
name: core
registry: kubeflow
seldon:
gitVersion:
commitSha: fe9fc2aa3cceba6266ced46ee828ba21ee0152bd
commitSha: 01ccdffb79e499ddd6ab5d2f60b8c0fbac5ac8df
refSpec: master
name: seldon
registry: kubeflow
tf-job:
gitVersion:
commitSha: fe9fc2aa3cceba6266ced46ee828ba21ee0152bd
commitSha: 01ccdffb79e499ddd6ab5d2f60b8c0fbac5ac8df
refSpec: master
name: tf-job
registry: kubeflow
tf-serving:
gitVersion:
commitSha: fe9fc2aa3cceba6266ced46ee828ba21ee0152bd
commitSha: 01ccdffb79e499ddd6ab5d2f60b8c0fbac5ac8df
refSpec: master
name: tf-serving
registry: kubeflow
Expand All @@ -42,7 +42,7 @@ registries:
uri: github.com/ksonnet/parts/tree/master/incubator
kubeflow:
gitVersion:
commitSha: fe9fc2aa3cceba6266ced46ee828ba21ee0152bd
commitSha: 01ccdffb79e499ddd6ab5d2f60b8c0fbac5ac8df
refSpec: master
protocol: github
uri: github.com/kubeflow/kubeflow/tree/master/kubeflow
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -14,5 +14,6 @@ local image = params.image;
local namespace = updatedParams.namespace;
local replicas = params.replicas;
local endpoint = params.endpoint;
local pvcName = params.endpoint;

k.core.v1.list.new(serve.parts(namespace).serve(name, image, replicas, endpoint))
k.core.v1.list.new(serve.parts(namespace).serve(name, image, replicas, endpoint, pvcName))
2 changes: 2 additions & 0 deletions dev-kubeflow-org/ks-app/components/params.libsonnet
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,7 @@
tfDefaultImage: "null",
tfJobImage: "gcr.io/kubeflow-images-public/tf_operator:v20180329-a7511ff",
tfJobUiServiceType: "ClusterIP",
tfJobVersion: "v1alpha1",
usageId: "f85740a3-5f60-4146-91b6-2ab7089cf01c",
},
"cert-manager": {
Expand Down Expand Up @@ -56,6 +57,7 @@
image: "gcr.io/kubeflow-images-public/issue-summarization:0.1",
name: "issue-summarization",
namespace: "kubeflow",
pvcName: "null",
replicas: 1,
},
"issue-summarization-ui": {
Expand Down
216 changes: 108 additions & 108 deletions dev-kubeflow-org/ks-app/lib/v1.7.0/k8s.libsonnet

Large diffs are not rendered by default.

72 changes: 72 additions & 0 deletions dev-kubeflow-org/ks-app/vendor/kubeflow/core/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,72 @@
<!-- START doctoc generated TOC please keep comment here to allow auto update -->
<!-- DON'T EDIT THIS SECTION, INSTEAD RE-RUN doctoc TO UPDATE -->
**Table of Contents** *generated with [DocToc](https://github.com/thlorenz/doctoc)*

- [core](#core)
- [Quickstart](#quickstart)
- [Using the library](#using-the-library)
- [io.ksonnet.pkg.kubeflow-core](#ioksonnetpkgkubeflow-core)
- [Example](#example)
- [Parameters](#parameters)

<!-- END doctoc generated TOC please keep comment here to allow auto update -->

# core

> Core components of Kubeflow.

* [Quickstart](#quickstart)
* [Using Prototypes](#using-prototypes)
* [io.ksonnet.pkg.kubeflow-core](#io.ksonnet.pkg.kubeflow-core)

## Quickstart

*The following commands use the `io.ksonnet.pkg.kubeflow` prototype to generate Kubernetes YAML for core, and then deploys it to your Kubernetes cluster.*

First, create a cluster and install the ksonnet CLI (see root-level [README.md](rootReadme)).

If you haven't yet created a [ksonnet application](linkToSomewhere), do so using `ks init <app-name>`.

Finally, in the ksonnet application directory, run the following:

```shell
# Expand prototype as a Jsonnet file, place in a file in the
# `components/` directory. (YAML and JSON are also available.)
$ ks prototype use io.ksonnet.pkg.kubeflow-core \
--name core \
--namespace default \
--disks

# Apply to server.
$ ks apply -f core.jsonnet
```

## Using the library

The library files for core define a set of relevant *parts* (_e.g._, deployments, services, secrets, and so on) that can be combined to configure core for a wide variety of scenarios. For example, a database like Redis may need a secret to hold the user password, or it may have no password if it's acting as a cache.

This library provides a set of pre-fabricated "flavors" (or "distributions") of core, each of which is configured for a different use case. These are captured as ksonnet *prototypes*, which allow users to interactively customize these distributions for their specific needs.

These prototypes, as well as how to use them, are enumerated below.

### io.ksonnet.pkg.kubeflow-core

Kubeflow core components
#### Example

```shell
# Expand prototype as a Jsonnet file, place in a file in the
# `components/` directory. (YAML and JSON are also available.)
$ ks prototype use io.ksonnet.pkg.kubeflow-core core \
--name YOUR_NAME_HERE
```

#### Parameters

The available options to pass prototype are:

* `--name=<name>`: Name to give to each of the components [string]


[rootReadme]: https://github.com/ksonnet/mixins
19 changes: 19 additions & 0 deletions dev-kubeflow-org/ks-app/vendor/kubeflow/core/all.libsonnet
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
{
parts(params):: {
local ambassador = import "kubeflow/core/ambassador.libsonnet",
local jupyterhub = import "kubeflow/core/jupyterhub.libsonnet",
local nfs = import "kubeflow/core/nfs.libsonnet",
local tfjob = import "kubeflow/core/tf-job-operator.libsonnet",
local spartakus = import "kubeflow/core/spartakus.libsonnet",
local centraldashboard = import "kubeflow/core/centraldashboard.libsonnet",
local version = import "kubeflow/core/version.libsonnet",

all:: jupyterhub.all(params)
+ tfjob.all(params)
+ ambassador.all(params)
+ nfs.all(params)
+ spartakus.all(params)
+ centraldashboard.all(params)
+ version.all(params),
},
}
Loading

0 comments on commit da36990

Please sign in to comment.