Skip to content

Commit

Permalink
Update Flyte components (#6110)
Browse files Browse the repository at this point in the history
Signed-off-by: Yee Hing Tong <[email protected]>
  • Loading branch information
flyte-bot authored Dec 17, 2024
1 parent e21a6ad commit 8a5f54c
Show file tree
Hide file tree
Showing 26 changed files with 225 additions and 143 deletions.
19 changes: 19 additions & 0 deletions CHANGELOG/CHANGELOG-v1.14.1.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
# Flyte 1.14.1 Release Notes

* Update flytestdlib and affected tools (copilot) for missing config.

## What's Changed
* docs: Refactor merge sort code example to use literalinclude by @davidlin20dev in https://github.com/flyteorg/flyte/pull/6091
* [DOCS] Using ImageSpec in ContainerTask by @machichima in https://github.com/flyteorg/flyte/pull/6095
* Eager doc updates by @wild-endeavor in https://github.com/flyteorg/flyte/pull/6099
* Revert "fix: return the config file not found error" by @eapolinario in https://github.com/flyteorg/flyte/pull/6100
* Remove notes on deprecated Batch size by @wild-endeavor in https://github.com/flyteorg/flyte/pull/6102
* Upstream: Add labels to published execution events by @katrogan in https://github.com/flyteorg/flyte/pull/6104
* Fix: Make distributed error aggregation opt-in by @fg91 in https://github.com/flyteorg/flyte/pull/6103
* Add default labels and annotations to Ray worker pods too. by @katrogan in https://github.com/flyteorg/flyte/pull/6107
* Fix: Remove the default search dialog if it exists (on CMD + K) by @chmod77 in https://github.com/flyteorg/flyte/pull/6106

## New Contributors
* @chmod77 made their first contribution in https://github.com/flyteorg/flyte/pull/6106

**Full Changelog**: https://github.com/flyteorg/flyte/compare/v1.14.0...v1.14.1
2 changes: 1 addition & 1 deletion charts/flyte-binary/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ Chart for basic single Flyte executable deployment
| configuration.auth.oidc.clientId | string | `""` | |
| configuration.auth.oidc.clientSecret | string | `""` | |
| configuration.co-pilot.image.repository | string | `"cr.flyte.org/flyteorg/flytecopilot"` | |
| configuration.co-pilot.image.tag | string | `"v1.14.0"` | |
| configuration.co-pilot.image.tag | string | `"v1.14.1"` | |
| configuration.database.dbname | string | `"flyte"` | |
| configuration.database.host | string | `"127.0.0.1"` | |
| configuration.database.options | string | `"sslmode=disable"` | |
Expand Down
2 changes: 1 addition & 1 deletion charts/flyte-binary/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -167,7 +167,7 @@ configuration:
# repository CoPilot sidecar image repository
repository: cr.flyte.org/flyteorg/flytecopilot # FLYTECOPILOT_IMAGE
# tag CoPilot sidecar image tag
tag: v1.14.0 # FLYTECOPILOT_TAG
tag: v1.14.1 # FLYTECOPILOT_TAG
# agentService Flyte Agent configuration
agentService:
defaultAgent:
Expand Down
12 changes: 6 additions & 6 deletions charts/flyte-core/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -110,8 +110,8 @@ helm install gateway bitnami/contour -n flyte
| configmap.clusters.clusterConfigs | list | `[]` | |
| configmap.clusters.labelClusterMap | object | `{}` | |
| configmap.console | object | `{"BASE_URL":"/console","CONFIG_DIR":"/etc/flyte/config"}` | Configuration for Flyte console UI |
| configmap.copilot | object | `{"plugins":{"k8s":{"co-pilot":{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.14.0","name":"flyte-copilot-","start-timeout":"30s"}}}}` | Copilot configuration |
| configmap.copilot.plugins.k8s.co-pilot | object | `{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.14.0","name":"flyte-copilot-","start-timeout":"30s"}` | Structure documented [here](https://pkg.go.dev/github.com/lyft/[email protected]/go/tasks/pluginmachinery/flytek8s/config#FlyteCoPilotConfig) |
| configmap.copilot | object | `{"plugins":{"k8s":{"co-pilot":{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.14.1","name":"flyte-copilot-","start-timeout":"30s"}}}}` | Copilot configuration |
| configmap.copilot.plugins.k8s.co-pilot | object | `{"image":"cr.flyte.org/flyteorg/flytecopilot:v1.14.1","name":"flyte-copilot-","start-timeout":"30s"}` | Structure documented [here](https://pkg.go.dev/github.com/lyft/[email protected]/go/tasks/pluginmachinery/flytek8s/config#FlyteCoPilotConfig) |
| configmap.core | object | `{"manager":{"pod-application":"flytepropeller","pod-template-container-name":"flytepropeller","pod-template-name":"flytepropeller-template"},"propeller":{"downstream-eval-duration":"30s","enable-admin-launcher":true,"leader-election":{"enabled":true,"lease-duration":"15s","lock-config-map":{"name":"propeller-leader","namespace":"flyte"},"renew-deadline":"10s","retry-period":"2s"},"limit-namespace":"all","literal-offloading-config":{"enabled":true},"max-workflow-retries":30,"metadata-prefix":"metadata/propeller","metrics-prefix":"flyte","prof-port":10254,"queue":{"batch-size":-1,"batching-interval":"2s","queue":{"base-delay":"5s","capacity":1000,"max-delay":"120s","rate":100,"type":"maxof"},"sub-queue":{"capacity":100,"rate":10,"type":"bucket"},"type":"batch"},"rawoutput-prefix":"s3://my-s3-bucket/","workers":4,"workflow-reeval-duration":"30s"},"webhook":{"certDir":"/etc/webhook/certs","serviceName":"flyte-pod-webhook"}}` | Core propeller configuration |
| configmap.core.manager | object | `{"pod-application":"flytepropeller","pod-template-container-name":"flytepropeller","pod-template-name":"flytepropeller-template"}` | follows the structure specified [here](https://pkg.go.dev/github.com/flyteorg/flytepropeller/manager/config#Config). |
| configmap.core.propeller | object | `{"downstream-eval-duration":"30s","enable-admin-launcher":true,"leader-election":{"enabled":true,"lease-duration":"15s","lock-config-map":{"name":"propeller-leader","namespace":"flyte"},"renew-deadline":"10s","retry-period":"2s"},"limit-namespace":"all","literal-offloading-config":{"enabled":true},"max-workflow-retries":30,"metadata-prefix":"metadata/propeller","metrics-prefix":"flyte","prof-port":10254,"queue":{"batch-size":-1,"batching-interval":"2s","queue":{"base-delay":"5s","capacity":1000,"max-delay":"120s","rate":100,"type":"maxof"},"sub-queue":{"capacity":100,"rate":10,"type":"bucket"},"type":"batch"},"rawoutput-prefix":"s3://my-s3-bucket/","workers":4,"workflow-reeval-duration":"30s"}` | follows the structure specified [here](https://pkg.go.dev/github.com/flyteorg/flytepropeller/pkg/controller/config). |
Expand Down Expand Up @@ -145,7 +145,7 @@ helm install gateway bitnami/contour -n flyte
| datacatalog.extraArgs | object | `{}` | Appends extra command line arguments to the main command |
| datacatalog.image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy |
| datacatalog.image.repository | string | `"cr.flyte.org/flyteorg/datacatalog"` | Docker image for Datacatalog deployment |
| datacatalog.image.tag | string | `"v1.14.0"` | Docker image tag |
| datacatalog.image.tag | string | `"v1.14.1"` | Docker image tag |
| datacatalog.nodeSelector | object | `{}` | nodeSelector for Datacatalog deployment |
| datacatalog.podAnnotations | object | `{}` | Annotations for Datacatalog pods |
| datacatalog.podEnv | object | `{}` | Additional Datacatalog container environment variables |
Expand Down Expand Up @@ -182,7 +182,7 @@ helm install gateway bitnami/contour -n flyte
| flyteadmin.extraArgs | object | `{}` | Appends extra command line arguments to the serve command |
| flyteadmin.image.pullPolicy | string | `"IfNotPresent"` | |
| flyteadmin.image.repository | string | `"cr.flyte.org/flyteorg/flyteadmin"` | Docker image for Flyteadmin deployment |
| flyteadmin.image.tag | string | `"v1.14.0"` | |
| flyteadmin.image.tag | string | `"v1.14.1"` | |
| flyteadmin.initialProjects | list | `["flytesnacks","flytetester","flyteexamples"]` | Initial projects to create |
| flyteadmin.nodeSelector | object | `{}` | nodeSelector for Flyteadmin deployment |
| flyteadmin.podAnnotations | object | `{}` | Annotations for Flyteadmin pods |
Expand Down Expand Up @@ -253,7 +253,7 @@ helm install gateway bitnami/contour -n flyte
| flytepropeller.extraArgs | object | `{}` | Appends extra command line arguments to the main command |
| flytepropeller.image.pullPolicy | string | `"IfNotPresent"` | |
| flytepropeller.image.repository | string | `"cr.flyte.org/flyteorg/flytepropeller"` | Docker image for Flytepropeller deployment |
| flytepropeller.image.tag | string | `"v1.14.0"` | |
| flytepropeller.image.tag | string | `"v1.14.1"` | |
| flytepropeller.manager | bool | `false` | |
| flytepropeller.nodeSelector | object | `{}` | nodeSelector for Flytepropeller deployment |
| flytepropeller.podAnnotations | object | `{}` | Annotations for Flytepropeller pods |
Expand Down Expand Up @@ -285,7 +285,7 @@ helm install gateway bitnami/contour -n flyte
| flytescheduler.configPath | string | `"/etc/flyte/config/*.yaml"` | Default regex string for searching configuration files |
| flytescheduler.image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy |
| flytescheduler.image.repository | string | `"cr.flyte.org/flyteorg/flytescheduler"` | Docker image for Flytescheduler deployment |
| flytescheduler.image.tag | string | `"v1.14.0"` | Docker image tag |
| flytescheduler.image.tag | string | `"v1.14.1"` | Docker image tag |
| flytescheduler.nodeSelector | object | `{}` | nodeSelector for Flytescheduler deployment |
| flytescheduler.podAnnotations | object | `{}` | Annotations for Flytescheduler pods |
| flytescheduler.podEnv | object | `{}` | Additional Flytescheduler container environment variables |
Expand Down
10 changes: 5 additions & 5 deletions charts/flyte-core/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ flyteadmin:
image:
# -- Docker image for Flyteadmin deployment
repository: cr.flyte.org/flyteorg/flyteadmin # FLYTEADMIN_IMAGE
tag: v1.14.0 # FLYTEADMIN_TAG
tag: v1.14.1 # FLYTEADMIN_TAG
pullPolicy: IfNotPresent
# -- Additional flyteadmin container environment variables
#
Expand Down Expand Up @@ -148,7 +148,7 @@ flytescheduler:
# -- Docker image for Flytescheduler deployment
repository: cr.flyte.org/flyteorg/flytescheduler # FLYTESCHEDULER_IMAGE
# -- Docker image tag
tag: v1.14.0 # FLYTESCHEDULER_TAG
tag: v1.14.1 # FLYTESCHEDULER_TAG
# -- Docker image pull policy
pullPolicy: IfNotPresent
# -- Default resources requests and limits for Flytescheduler deployment
Expand Down Expand Up @@ -214,7 +214,7 @@ datacatalog:
# -- Docker image for Datacatalog deployment
repository: cr.flyte.org/flyteorg/datacatalog # DATACATALOG_IMAGE
# -- Docker image tag
tag: v1.14.0 # DATACATALOG_TAG
tag: v1.14.1 # DATACATALOG_TAG
# -- Docker image pull policy
pullPolicy: IfNotPresent
# -- Default resources requests and limits for Datacatalog deployment
Expand Down Expand Up @@ -311,7 +311,7 @@ flytepropeller:
image:
# -- Docker image for Flytepropeller deployment
repository: cr.flyte.org/flyteorg/flytepropeller # FLYTEPROPELLER_IMAGE
tag: v1.14.0 # FLYTEPROPELLER_TAG
tag: v1.14.1 # FLYTEPROPELLER_TAG
pullPolicy: IfNotPresent
# -- Default resources requests and limits for Flytepropeller deployment
resources:
Expand Down Expand Up @@ -807,7 +807,7 @@ configmap:
# -- Structure documented [here](https://pkg.go.dev/github.com/lyft/[email protected]/go/tasks/pluginmachinery/flytek8s/config#FlyteCoPilotConfig)
co-pilot:
name: flyte-copilot-
image: cr.flyte.org/flyteorg/flytecopilot:v1.14.0 # FLYTECOPILOT_IMAGE
image: cr.flyte.org/flyteorg/flytecopilot:v1.14.1 # FLYTECOPILOT_IMAGE
start-timeout: 30s

# -- Core propeller configuration
Expand Down
16 changes: 8 additions & 8 deletions charts/flyte/README.md

Large diffs are not rendered by default.

10 changes: 5 additions & 5 deletions charts/flyte/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ flyte:
# -- Docker image for Flyteadmin deployment
repository: cr.flyte.org/flyteorg/flyteadmin # FLYTEADMIN_IMAGE
# -- Docker image tag
tag: v1.14.0 # FLYTEADMIN_TAG
tag: v1.14.1 # FLYTEADMIN_TAG
# -- Docker image pull policy
pullPolicy: IfNotPresent
# -- Additional flyteadmin container environment variables
Expand Down Expand Up @@ -83,7 +83,7 @@ flyte:
# -- Docker image for Flytescheduler deployment
repository: cr.flyte.org/flyteorg/flytescheduler # FLYTESCHEDULER_IMAGE
# -- Docker image tag
tag: v1.14.0 # FLYTESCHEDULER_TAG
tag: v1.14.1 # FLYTESCHEDULER_TAG
# -- Docker image pull policy
pullPolicy: IfNotPresent
# -- Default resources requests and limits for Flytescheduler deployment
Expand Down Expand Up @@ -128,7 +128,7 @@ flyte:
# -- Docker image for Datacatalog deployment
repository: cr.flyte.org/flyteorg/datacatalog # DATACATALOG_IMAGE
# -- Docker image tag
tag: v1.14.0 # DATACATALOG_TAG
tag: v1.14.1 # DATACATALOG_TAG
# -- Docker image pull policy
pullPolicy: IfNotPresent
# -- Default resources requests and limits for Datacatalog deployment
Expand Down Expand Up @@ -177,7 +177,7 @@ flyte:
# -- Docker image for Flytepropeller deployment
repository: cr.flyte.org/flyteorg/flytepropeller # FLYTEPROPELLER_IMAGE
# -- Docker image tag
tag: v1.14.0 # FLYTEPROPELLER_TAG
tag: v1.14.1 # FLYTEPROPELLER_TAG
# -- Docker image pull policy
pullPolicy: IfNotPresent
# -- Default resources requests and limits for Flytepropeller deployment
Expand Down Expand Up @@ -473,7 +473,7 @@ flyte:
# -- Structure documented [here](https://pkg.go.dev/github.com/lyft/[email protected]/go/tasks/pluginmachinery/flytek8s/config#FlyteCoPilotConfig)
co-pilot:
name: flyte-copilot-
image: cr.flyte.org/flyteorg/flytecopilot:v1.14.0 # FLYTECOPILOT_IMAGE
image: cr.flyte.org/flyteorg/flytecopilot:v1.14.1 # FLYTECOPILOT_IMAGE
start-timeout: 30s

# -- Core propeller configuration
Expand Down
2 changes: 1 addition & 1 deletion charts/flyteagent/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ A Helm chart for Flyte agent
| fullnameOverride | string | `""` | |
| image.pullPolicy | string | `"IfNotPresent"` | Docker image pull policy |
| image.repository | string | `"cr.flyte.org/flyteorg/flyteagent"` | Docker image for flyteagent deployment |
| image.tag | string | `"1.13.14"` | Docker image tag |
| image.tag | string | `"1.14.2"` | Docker image tag |
| nameOverride | string | `""` | |
| nodeSelector | object | `{}` | nodeSelector for flyteagent deployment |
| podAnnotations | object | `{}` | Annotations for flyteagent pods |
Expand Down
2 changes: 1 addition & 1 deletion charts/flyteagent/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ image:
# -- Docker image for flyteagent deployment
repository: cr.flyte.org/flyteorg/flyteagent # FLYTEAGENT_IMAGE
# -- Docker image tag
tag: 1.13.14 # FLYTEAGENT_TAG
tag: 1.14.2 # FLYTEAGENT_TAG
# -- Docker image pull policy
pullPolicy: IfNotPresent
ports:
Expand Down
2 changes: 1 addition & 1 deletion deployment/agent/flyte_agent_helm_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -79,7 +79,7 @@ spec:
- pyflyte
- serve
- agent
image: "cr.flyte.org/flyteorg/flyteagent:1.13.14"
image: "cr.flyte.org/flyteorg/flyteagent:1.14.2"
imagePullPolicy: "IfNotPresent"
name: flyteagent
volumeMounts:
Expand Down
30 changes: 15 additions & 15 deletions deployment/eks/flyte_aws_scheduler_helm_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -436,7 +436,7 @@ data:
plugins:
k8s:
co-pilot:
image: cr.flyte.org/flyteorg/flytecopilot:v1.14.0
image: cr.flyte.org/flyteorg/flytecopilot:v1.14.1
name: flyte-copilot-
start-timeout: 30s
core.yaml: |
Expand Down Expand Up @@ -879,7 +879,7 @@ spec:
- /etc/flyte/config/*.yaml
- migrate
- run
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.0"
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: run-migrations
securityContext:
Expand All @@ -900,7 +900,7 @@ spec:
- flytesnacks
- flytetester
- flyteexamples
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.0"
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: seed-projects
securityContext:
Expand All @@ -918,7 +918,7 @@ spec:
- /etc/flyte/config/*.yaml
- clusterresource
- sync
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.0"
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: sync-cluster-resources
securityContext:
Expand All @@ -935,7 +935,7 @@ spec:
- mountPath: /etc/secrets/
name: admin-secrets
- name: generate-secrets
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.0"
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.1"
imagePullPolicy: "IfNotPresent"
command: ["/bin/sh", "-c"]
args:
Expand All @@ -962,7 +962,7 @@ spec:
- --config
- /etc/flyte/config/*.yaml
- serve
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.0"
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: flyteadmin
ports:
Expand Down Expand Up @@ -1069,7 +1069,7 @@ spec:
- /etc/flyte/config/*.yaml
- clusterresource
- run
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.0"
image: "cr.flyte.org/flyteorg/flyteadmin:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: sync-cluster-resources
volumeMounts:
Expand Down Expand Up @@ -1199,7 +1199,7 @@ spec:
- /etc/datacatalog/config/*.yaml
- migrate
- run
image: "cr.flyte.org/flyteorg/datacatalog:v1.14.0"
image: "cr.flyte.org/flyteorg/datacatalog:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: run-migrations
volumeMounts:
Expand All @@ -1217,7 +1217,7 @@ spec:
- --config
- /etc/datacatalog/config/*.yaml
- serve
image: "cr.flyte.org/flyteorg/datacatalog:v1.14.0"
image: "cr.flyte.org/flyteorg/datacatalog:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: datacatalog
ports:
Expand Down Expand Up @@ -1280,7 +1280,7 @@ spec:
template:
metadata:
annotations:
configChecksum: "7c75b4d396049b3c0c3d425f22aaa11c5517e44d62a4e4a9e181327cd4693f5"
configChecksum: "d506150c845dea702ff708615390d9ed7dfac19b77a88429ed888b08fc6c9db"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
labels:
Expand Down Expand Up @@ -1308,7 +1308,7 @@ spec:
valueFrom:
fieldRef:
fieldPath: metadata.namespace
image: "cr.flyte.org/flyteorg/flytepropeller:v1.14.0"
image: "cr.flyte.org/flyteorg/flytepropeller:v1.14.1"
imagePullPolicy: "IfNotPresent"
name: flytepropeller
ports:
Expand Down Expand Up @@ -1362,9 +1362,9 @@ spec:
labels:
app: flyte-pod-webhook
app.kubernetes.io/name: flyte-pod-webhook
app.kubernetes.io/version: v1.14.0
app.kubernetes.io/version: v1.14.1
annotations:
configChecksum: "7c75b4d396049b3c0c3d425f22aaa11c5517e44d62a4e4a9e181327cd4693f5"
configChecksum: "d506150c845dea702ff708615390d9ed7dfac19b77a88429ed888b08fc6c9db"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
spec:
Expand All @@ -1378,7 +1378,7 @@ spec:
serviceAccountName: flyte-pod-webhook
initContainers:
- name: generate-secrets
image: "cr.flyte.org/flyteorg/flytepropeller:v1.14.0"
image: "cr.flyte.org/flyteorg/flytepropeller:v1.14.1"
imagePullPolicy: "IfNotPresent"
command:
- flytepropeller
Expand All @@ -1405,7 +1405,7 @@ spec:
mountPath: /etc/flyte/config
containers:
- name: webhook
image: "cr.flyte.org/flyteorg/flytepropeller:v1.14.0"
image: "cr.flyte.org/flyteorg/flytepropeller:v1.14.1"
imagePullPolicy: "IfNotPresent"
command:
- flytepropeller
Expand Down
Loading

0 comments on commit 8a5f54c

Please sign in to comment.