Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spark CRD + Operator v1beta2 #572

Merged
merged 8 commits into from
Nov 17, 2020
Merged

Spark CRD + Operator v1beta2 #572

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
fe09784
Spark v1beta2
Oct 27, 2020
96b146e
Update labels
Oct 28, 2020
bbb67e7
update propeller
Oct 28, 2020
c210479
Update Propeller version
Nov 5, 2020
dd6b6bd
Merge remote-tracking branch 'origin/master' into v1beta2
Nov 5, 2020
d17dae2
Merge remote-tracking branch 'origin/master' into v1beta2
Nov 17, 2020
5a5a457
Bump propeller version
Nov 17, 2020
ead0dd9
Fix end-to-end tests
Nov 17, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/tests.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ jobs:
- uses: actions/checkout@v1
- name: Kustomize and diff
run: DELTA_CHECK=true make kustomize
- uses: engineerd/setup-kind@v0.4.0
- uses: engineerd/setup-kind@v0.5.0
- name: End2End
env:
DOCKER_USERNAME: ${{ github.actor }}
Expand Down
7,527 changes: 7,517 additions & 10 deletions deployment/eks/flyte_generated.yaml
View file
Open in desktop

Large diffs are not rendered by default.

7,527 changes: 7,517 additions & 10 deletions deployment/gcp/flyte_generated.yaml
View file
Open in desktop

Large diffs are not rendered by default.

7,527 changes: 7,517 additions & 10 deletions deployment/sandbox/flyte_generated.yaml
View file
Open in desktop

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion deployment/test/flyte_generated.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1067,7 +1067,7 @@ spec:
valueFrom:
fieldRef:
fieldPath: metadata.name
image: docker.io/lyft/flytepropeller:v0.4.8
image: docker.io/lyft/flytepropeller:v0.5.2
imagePullPolicy: IfNotPresent
name: flytepropeller
ports:
Expand Down
7 changes: 3 additions & 4 deletions kustomize/base/operators/spark/deployment.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,13 +5,12 @@ metadata:
namespace: sparkoperator
labels:
app.kubernetes.io/name: sparkoperator
app.kubernetes.io/version: v2.4.0-v1beta1
app.kubernetes.io/version: v2.4.5-v1beta2
spec:
replicas: 1
selector:
matchLabels:
app.kubernetes.io/name: sparkoperator
app.kubernetes.io/version: v2.4.0-v1beta1
strategy:
type: Recreate
template:
Expand All @@ -22,7 +21,7 @@ spec:
prometheus.io/path: "/metrics"
labels:
app.kubernetes.io/name: sparkoperator
app.kubernetes.io/version: v2.4.0-v1beta1
app.kubernetes.io/version: v2.4.5-v1beta2
spec:
serviceAccountName: sparkoperator
volumes:
Expand All @@ -31,7 +30,7 @@ spec:
secretName: spark-webhook-certs
containers:
- name: sparkoperator-unknown
image: gcr.io/spark-operator/spark-operator:v2.4.0-v1beta1-0.9.0
image: gcr.io/spark-operator/spark-operator:v1beta2-1.1.2-2.4.5
volumeMounts:
- name: webhook-certs
mountPath: /etc/webhook-certs
Expand Down
3 changes: 2 additions & 1 deletion kustomize/base/operators/spark/kustomization.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
resources:
- spark-operator.yaml
- spark-dummy-crd.yaml
- sparkapplications-crd.yaml
akhurana001 marked this conversation as resolved.
Show resolved Hide resolved
- scheduledsparkapplications-crd.yaml
- deployment.yaml
- webhook.yaml

Expand Down
3,758 changes: 3,758 additions & 0 deletions kustomize/base/operators/spark/scheduledsparkapplications-crd.yaml
View file
Open in desktop

Large diffs are not rendered by default.

15 changes: 0 additions & 15 deletions kustomize/base/operators/spark/spark-dummy-crd.yaml
View file
Open in desktop

This file was deleted.

2 changes: 1 addition & 1 deletion kustomize/base/operators/spark/spark-operator.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@ rules:
resources: ["mutatingwebhookconfigurations"]
verbs: ["create", "get", "update", "delete"]
- apiGroups: ["sparkoperator.k8s.io"]
resources: ["sparkapplications", "scheduledsparkapplications"]
resources: ["sparkapplications", "scheduledsparkapplications", "sparkapplications/status", "scheduledsparkapplications/status"]
verbs: ["*"]
---
apiVersion: rbac.authorization.k8s.io/v1beta1
Expand Down
Loading