Skip to content
This repository has been archived by the owner on Oct 23, 2024. It is now read-only.

Commit

Permalink
KUDO Spark Operator 2.4.5-1.0.0 release (#94)
Browse files Browse the repository at this point in the history
* KUDO Spark Operator 2.4.5-1.0.0 release

* Update `operators` submodule

Signed-off-by: Alex Lembiewski <[email protected]>
  • Loading branch information
alembiewski authored Feb 21, 2020
1 parent e0f7109 commit c13927b
Show file tree
Hide file tree
Showing 5 changed files with 6 additions and 6 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ Required software:
* GNU Make 4.2.1 or higher
* sha1sum
* [kubectl](https://kubernetes.io/docs/tasks/tools/install-kubectl/)
* [KUDO CLI Plugin](https://kudo.dev/docs/#install-kudo-cli) 0.8.0 or higher
* [KUDO CLI Plugin](https://kudo.dev/docs/#install-kudo-cli) 0.10.1 or higher

For test cluster provisioning and Stub Universe artifacts upload valid AWS access credentials required:
* `AWS_PROFILE` **or** `AWS_ACCESS_KEY_ID` and `AWS_SECRET_ACCESS_KEY` environment variables should be provided
Expand Down Expand Up @@ -46,7 +46,7 @@ To run tests on a pre-existing cluster with specified operator and spark images,
```
make test KUBECONFIG=$HOME/.kube/config \
SPARK_IMAGE_FULL_NAME=mesosphere/spark:spark-2.4.5-hadoop-2.9-k8s \
OPERATOR_IMAGE_FULL_NAME=mesosphere/kudo-spark-operator:spark-2.4.5-hadoop-2.9-k8s
OPERATOR_IMAGE_FULL_NAME=mesosphere/kudo-spark-operator:2.4.5-1.0.0
```

# Installing and using Spark Operator
Expand Down
2 changes: 1 addition & 1 deletion operators
Submodule operators updated 32 files
+8 −7 repository/spark/README.md
+1 −1 repository/spark/docs/2.4.4-0.2.0/README.md
+13 −0 repository/spark/docs/2.4.5-1.0.0/README.md
+114 −0 repository/spark/docs/2.4.5-1.0.0/advanced-configuration.md
+138 −0 repository/spark/docs/2.4.5-1.0.0/configuration.md
+162 −0 repository/spark/docs/2.4.5-1.0.0/history-server.md
+56 −0 repository/spark/docs/2.4.5-1.0.0/installation.md
+108 −0 repository/spark/docs/2.4.5-1.0.0/kerberos.md
+9 −0 repository/spark/docs/2.4.5-1.0.0/limitations.md
+76 −0 repository/spark/docs/2.4.5-1.0.0/monitoring.md
+22 −0 repository/spark/docs/2.4.5-1.0.0/release-notes.md
+1,189 −0 repository/spark/docs/2.4.5-1.0.0/resources/dashboards/grafana_spark_applications.json
+2,001 −0 repository/spark/docs/2.4.5-1.0.0/resources/dashboards/grafana_spark_operator.json
+ repository/spark/docs/2.4.5-1.0.0/resources/img/ha.png
+ repository/spark/docs/2.4.5-1.0.0/resources/img/spark-ui-1.png
+ repository/spark/docs/2.4.5-1.0.0/resources/img/spark-ui-2.png
+40 −0 repository/spark/docs/2.4.5-1.0.0/resources/monitoring/spark-application-with-metrics.yaml
+14 −0 repository/spark/docs/2.4.5-1.0.0/resources/spark-pi-service.yaml
+31 −0 repository/spark/docs/2.4.5-1.0.0/resources/spark-pi.yaml
+172 −0 repository/spark/docs/2.4.5-1.0.0/security.md
+237 −0 repository/spark/docs/2.4.5-1.0.0/submission.md
+10 −0 repository/spark/docs/2.4.5-1.0.0/versions.md
+1 −0 repository/spark/docs/latest/README.md
+1 −1 repository/spark/docs/latest/configuration.md
+3 −1 repository/spark/docs/latest/history-server.md
+1 −1 repository/spark/docs/latest/installation.md
+108 −0 repository/spark/docs/latest/kerberos.md
+4 −4 repository/spark/docs/latest/monitoring.md
+7 −1 repository/spark/docs/latest/release-notes.md
+5 −6 repository/spark/docs/latest/security.md
+1 −1 repository/spark/operator/operator.yaml
+1 −1 repository/spark/operator/params.yaml
2 changes: 1 addition & 1 deletion scripts/install_operator.sh
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ OPERATOR_DIR="$(dirname ${SCRIPT_DIR})/operators/repository/spark/operator"

NAMESPACE=${NAMESPACE:-spark}
OPERATOR_DOCKER_REPO=${OPERATOR_DOCKER_REPO:-mesosphere/kudo-spark-operator}
OPERATOR_VERSION=${OPERATOR_VERSION:-2.4.5-0.2.0}
OPERATOR_VERSION=${OPERATOR_VERSION:-2.4.5-1.0.0}

echo "Using namespace '${NAMESPACE}' for installation"

Expand Down
2 changes: 1 addition & 1 deletion tests/utils/common.go
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ const cmdLogFormat = "> %s %v\n%s"
const DefaultRetryInterval = 5 * time.Second
const DefaultRetryTimeout = 10 * time.Minute

var OperatorImage = GetenvOr("OPERATOR_IMAGE", "mesosphere/kudo-spark-operator:2.4.5-0.2.0")
var OperatorImage = GetenvOr("OPERATOR_IMAGE", "mesosphere/kudo-spark-operator:2.4.5-1.0.0")
var SparkImage = GetenvOr("SPARK_IMAGE", "mesosphere/spark:spark-2.4.5-hadoop-2.9-k8s")
var SparkVersion = GetenvOr("SPARK_VERSION", "2.4.5")
var TestDir = GetenvOr("TEST_DIR", goUpToRootDir())
Expand Down
2 changes: 1 addition & 1 deletion tests/utils/spark_operator.go
Original file line number Diff line number Diff line change
Expand Up @@ -66,7 +66,7 @@ func (spark *SparkOperatorInstallation) InstallSparkOperator() error {
spark.Params = make(map[string]string)
}
if strings.Contains(OperatorImage, ":") {
// handle the case, when using local docker registry (e.g. registry:5000/kudo-spark-operator:2.4.5-0.2.0)
// handle the case, when using local docker registry (e.g. registry:5000/kudo-spark-operator:2.4.5-1.0.0)
tagIndex := strings.LastIndex(OperatorImage, ":")
spark.Params["operatorImageName"] = OperatorImage[0:tagIndex]
spark.Params["operatorVersion"] = OperatorImage[tagIndex+1:]
Expand Down

0 comments on commit c13927b

Please sign in to comment.