Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

run examples on k8s readme #2163

Merged
merged 5 commits into from
Apr 13, 2020
Merged
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
formatting
Le-Zheng authored Apr 8, 2020

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
commit 2cd8950c1c8fbd87230de5943c4327eac0eead59
65 changes: 33 additions & 32 deletions docker/hyperzoo/submit-examples-k8s.md
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
# Submit Analytics Zoo examples on k8s

- [Prerequisites](#Prerequisites)
- [Launch pre-built k8s image](launch-pre-built-k8s-image)
- [Submit Analytics Zoo examples on k8s](Submit-analytics-zoo-examples-on-k8s)
- [Submit Analytics Zoo Scala examples on k8s](Submit-analytics-zoo-scala-examples-on k8s)
- [Submit Analytics Zoo python examples on k8s](Submit-analytics-zoo-python-examples-on-k8s)
- [Launch pre-built k8s image](#launch-pre-built-k8s-image)
- [Submit Analytics Zoo examples on k8s](#Submit-analytics-zoo-examples-on-k8s)
- [Submit Analytics Zoo Scala examples on k8s](#Submit-analytics-zoo-scala-examples-on-k8s)
- [Submit Analytics Zoo python examples on k8s](#Submit-analytics-zoo-python-examples-on-k8s)

## Prerequisites

@@ -102,7 +102,7 @@ Options:

- --name: the Spark application name

- -- conf: include container image to use for the Spark application, driver volumes name and path, label of pods, spark driver and executor configuration.
- -- conf: include container image to use for the Spark application, driver volumes name and path, label of pods, spark driver and executor configuration, etc.

see the [spark configuration page](https://spark.apache.org/docs/latest/configuration.html) and [spark on k8s configuration page](https://spark.apache.org/docs/latest/running-on-kubernetes.html#configuration) for more details.

@@ -146,18 +146,18 @@ $ kubectl delete pod -l <pod label>

Here view each [Scala example](https://github.com/intel-analytics/analytics-zoo/tree/master/zoo/src/main/scala/com/intel/analytics/zoo/examples) running command. Please prepare the models or data according to related readme of each example.

- [anomalydetection](anomalydetection)
- [chatbot](chatbot)
- [imageclassification](imageclassification)
- [inception](inception)
- [nnframes](nnframes)
- [objectdetection](objectdetection)
- [qaranker](qaranker)
- [recommendation](recommendation)
- [resnet](resnet)
- [tensorflow/tfnet](tensorflow/tfnet)
- [textclassification](textclassification)
- [vnni](vnni)
- [anomalydetection](#anomalydetection)
- [chatbot](#chatbot)
- [imageclassification](#imageclassification)
- [inception](#inception)
- [nnframes](#nnframes)
- [objectdetection](#objectdetection)
- [qaranker](#qaranker)
- [recommendation](#recommendation)
- [resnet](#resnet)
- [tensorflow/tfnet](#tensorflow-tfnet)
- [textclassification](#textclassification)
- [vnni](#vnni)

##### anomalydetection

@@ -808,20 +808,20 @@ ${SPARK_HOME}/bin/spark-submit \

Here view each [python example](https://github.com/intel-analytics/analytics-zoo/tree/master/pyzoo/zoo/examples) running command. Please prepare the models or data according to related readme of each example.

- [anomalydetection](anomalydetection)
- [attention](attention)
- [autograd](autograd)
- [imageclassification](imageclassification)
- [inception](inception)
- [nnframes](nnframes)
- [objectdetection](objectdetection)
- [openvino](openvino)
- [pytorch](pytorch)
- [qaranker](qaranker)
- [ray](ray)
- [tensorflow](tensorflow)
- [textclassification](textclassification)
- [vnni/openvino](vnni/openvino)
- [anomalydetection](#anomalydetection)
- [attention](#attention)
- [autograd](#autograd)
- [imageclassification](#imageclassification)
- [inception](#inception)
- [nnframes](#nnframes)
- [objectdetection](#objectdetection)
- [openvino](#openvino)
- [pytorch](#pytorch)
- [qaranker](#qaranker)
- [ray](#ray)
- [tensorflow](#tensorflow)
- [textclassification](#textclassification)
- [vnni/openvino](#vnni-openvino)

##### anomalydetection

@@ -884,6 +884,7 @@ Here view each [python example](https://github.com/intel-analytics/analytics-zoo
file:///opt/analytics-zoo-examples/python/attention/transformer.py
```

#### autograd
###### autograd custom

```bash
@@ -1700,7 +1701,7 @@ ${SPARK_HOME}/bin/spark-submit \
--embedding_path /zoo/data/glove.6B
```

##### openvino/vnni
##### vnni/openvino

```bash
${SPARK_HOME}/bin/spark-submit \