-
Notifications
You must be signed in to change notification settings - Fork 669
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
* Update Flyte Components Signed-off-by: Flyte-Bot <[email protected]> * Update flytetools image Signed-off-by: Haytham Abuelfutuh <[email protected]> * Updates Signed-off-by: Haytham Abuelfutuh <[email protected]> * Set image sizes Signed-off-by: Haytham Abuelfutuh <[email protected]> * Update CHANGELOG-v0.17.0.md Signed-off-by: Haytham Abuelfutuh <[email protected]> * PR feedback Signed-off-by: Haytham Abuelfutuh <[email protected]> * Redo <img> tags Signed-off-by: Haytham Abuelfutuh <[email protected]> Co-authored-by: katrogan <[email protected]> Co-authored-by: Haytham Abuelfutuh <[email protected]> Co-authored-by: HackMD <[email protected]>
- Loading branch information
4 people
authored
Sep 2, 2021
1 parent
e930c6c
commit cb658c8
Showing
17 changed files
with
164 additions
and
126 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,38 @@ | ||
| # Flyte v0.17.0 | ||
|
|
||
| ## Platform | ||
| 1. Recovery Mode: Executions that fail due to external system failures (e.g. external system being down) can now be rerun in recovery mode ([flytectl --recover docs](https://docs.flyte.org/projects/flytectl/en/latest/gen/flytectl_create_execution.html)). It's also available in the UI: | ||
|
|
||
| <img src="https://i.imgur.com/hYYzkLK.png" alt="Recovery mode in the UI" width="800"/> | ||
|
|
||
|
|
||
| ## Flytekit | ||
| 1. Great Expectations Integration ([docs](https://docs.flyte.org/projects/cookbook/en/latest/auto/integrations/flytekit_plugins/greatexpectations/index.html#great-expectations)). | ||
| 1. Access to durable blob stores (AWS/GCS/etc) are now pluggable. | ||
| 1. Local task execution has been updated to also trigger the type engine. | ||
| 1. Tasks that have `cache=True` should now be cached when running locally as well ([docs](https://docs.flyte.org/projects/cookbook/en/latest/auto/core/flyte_basics/task_cache.html#how-local-caching-works)). | ||
|
|
||
| Please see the [flytekit release](https://github.com/flyteorg/flytekit/releases/tag/v0.22.0) for the full list and more details. | ||
|
|
||
| ## UI | ||
| 1. Shiny new Graph UX. The graph rendering has been revamped to be more functional and accessible. More updates are coming for better visualization for nested executions and branches. | ||
|
|
||
| <img src="https://i.imgur.com/HTfuios.png" alt="New Graph UX" width="800"/> | ||
| 1. JSON Validation for json-based types in the UI. | ||
|
|
||
|
|
||
|
|
||
| | Before | After | | ||
| | -------- | -------- | | ||
| |  |  | | ||
|
|
||
| 1. Enum support in UI | ||
|
|
||
|  | ||
|
|
||
|
|
||
| ## FlyteCtl | ||
| 1. `flytectl upgrade` to automatically upgrade itself ([docs](https://docs.flyte.org/projects/flytectl/en/latest/gen/flytectl_upgrade.html)). | ||
| 1. `--dryRun` is available in most commands with server-side-effects to simulate the operations before committing any changes. | ||
|
|
||
| And various stabilization [fixes](https://github.com/flyteorg/flyte/milestone/17?closed=1)! |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -91,7 +91,7 @@ helm install gateway bitnami/contour -n flyte | |
| | configmap.task_logs.plugins.logs.cloudwatch-enabled | bool | `false` | One option is to enable cloudwatch logging for EKS, update the region and log group accordingly | | ||
| | configmap.task_resource_defaults | object | `{"task_resources":{"defaults":{"cpu":"100m","memory":"100Mi","storage":"5Mi"},"limits":{"cpu":2,"gpu":1,"memory":"1Gi","storage":"20Mi"}}}` | Task default resources configuration Refer to the full [structure](https://pkg.go.dev/github.com/lyft/[email protected]/pkg/runtime/interfaces#TaskResourceConfiguration). | | ||
| | configmap.task_resource_defaults.task_resources | object | `{"defaults":{"cpu":"100m","memory":"100Mi","storage":"5Mi"},"limits":{"cpu":2,"gpu":1,"memory":"1Gi","storage":"20Mi"}}` | Task default resources parameters | | ||
| | datacatalog | object | `{"affinity":{},"configPath":"/etc/datacatalog/config/*.yaml","image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/datacatalog","tag":"v0.3.6"},"nodeSelector":{},"podAnnotations":{},"replicaCount":1,"resources":{"limits":{"cpu":"500m","ephemeral-storage":"100Mi","memory":"500Mi"},"requests":{"cpu":"10m","ephemeral-storage":"50Mi","memory":"50Mi"}},"service":{"annotations":{"projectcontour.io/upstream-protocol.h2c":"grpc"},"type":"NodePort"},"serviceAccount":{"annotations":{},"create":true,"imagePullSecrets":{}},"tolerations":[]}` | DATACATALOG SETTINGS | | ||
| | datacatalog | object | `{"affinity":{},"configPath":"/etc/datacatalog/config/*.yaml","image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/datacatalog","tag":"v0.3.9"},"nodeSelector":{},"podAnnotations":{},"replicaCount":1,"resources":{"limits":{"cpu":"500m","ephemeral-storage":"100Mi","memory":"500Mi"},"requests":{"cpu":"10m","ephemeral-storage":"50Mi","memory":"50Mi"}},"service":{"annotations":{"projectcontour.io/upstream-protocol.h2c":"grpc"},"type":"NodePort"},"serviceAccount":{"annotations":{},"create":true,"imagePullSecrets":{}},"tolerations":[]}` | DATACATALOG SETTINGS | | ||
| | datacatalog.affinity | object | `{}` | affinity for Datacatalog deployment | | ||
| | datacatalog.configPath | string | `"/etc/datacatalog/config/*.yaml"` | Default regex string for searching configuration files | | ||
| | datacatalog.image.repository | string | `"cr.flyte.org/flyteorg/datacatalog"` | Docker image for Datacatalog deployment | | ||
|
|
@@ -110,7 +110,7 @@ helm install gateway bitnami/contour -n flyte | |
| | flyteadmin.configPath | string | `"/etc/flyte/config/*.yaml"` | Default regex string for searching configuration files | | ||
| | flyteadmin.image.pullPolicy | string | `"IfNotPresent"` | | | ||
| | flyteadmin.image.repository | string | `"cr.flyte.org/flyteorg/flyteadmin"` | Docker image for Flyteadmin deployment | | ||
| | flyteadmin.image.tag | string | `"v0.6.16"` | | | ||
| | flyteadmin.image.tag | string | `"v0.6.22"` | | | ||
| | flyteadmin.initialProjects | list | `["flytesnacks","flytetester","flyteexamples"]` | Initial projects to create | | ||
| | flyteadmin.nodeSelector | object | `{}` | nodeSelector for Flyteadmin deployment | | ||
| | flyteadmin.podAnnotations | object | `{}` | Annotations for Flyteadmin pods | | ||
|
|
@@ -123,7 +123,7 @@ helm install gateway bitnami/contour -n flyte | |
| | flyteadmin.serviceAccount.create | bool | `true` | Should a service account be created for flyteadmin | | ||
| | flyteadmin.serviceAccount.imagePullSecrets | object | `{}` | ImapgePullSecrets to automatically assign to the service account | | ||
| | flyteadmin.tolerations | list | `[]` | tolerations for Flyteadmin deployment | | ||
| | flyteconsole | object | `{"affinity":{},"image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/flyteconsole","tag":"v0.20.1"},"nodeSelector":{},"podAnnotations":{},"replicaCount":1,"resources":{"limits":{"cpu":"500m","memory":"250Mi"},"requests":{"cpu":"10m","memory":"50Mi"}},"service":{"annotations":{},"type":"ClusterIP"},"tolerations":[]}` | FLYTECONSOLE SETTINGS | | ||
| | flyteconsole | object | `{"affinity":{},"image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/flyteconsole","tag":"v0.25.0"},"nodeSelector":{},"podAnnotations":{},"replicaCount":1,"resources":{"limits":{"cpu":"500m","memory":"250Mi"},"requests":{"cpu":"10m","memory":"50Mi"}},"service":{"annotations":{},"type":"ClusterIP"},"tolerations":[]}` | FLYTECONSOLE SETTINGS | | ||
| | flyteconsole.affinity | object | `{}` | affinity for Flyteconsole deployment | | ||
| | flyteconsole.image.repository | string | `"cr.flyte.org/flyteorg/flyteconsole"` | Docker image for Flyteconsole deployment | | ||
| | flyteconsole.nodeSelector | object | `{}` | nodeSelector for Flyteconsole deployment | | ||
|
|
@@ -132,7 +132,7 @@ helm install gateway bitnami/contour -n flyte | |
| | flyteconsole.resources | object | `{"limits":{"cpu":"500m","memory":"250Mi"},"requests":{"cpu":"10m","memory":"50Mi"}}` | Default resources requests and limits for Flyteconsole deployment | | ||
| | flyteconsole.service | object | `{"annotations":{},"type":"ClusterIP"}` | Service settings for Flyteconsole | | ||
| | flyteconsole.tolerations | list | `[]` | tolerations for Flyteconsole deployment | | ||
| | flytepropeller | object | `{"affinity":{},"cacheSizeMbs":0,"configPath":"/etc/flyte/config/*.yaml","image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/flytepropeller","tag":"v0.13.4"},"nodeSelector":{},"podAnnotations":{},"replicaCount":1,"resources":{"limits":{"cpu":"200m","ephemeral-storage":"100Mi","memory":"200Mi"},"requests":{"cpu":"10m","ephemeral-storage":"50Mi","memory":"50Mi"}},"serviceAccount":{"annotations":{},"create":true,"imagePullSecrets":{}},"tolerations":[]}` | FLYTEPROPELLER SETTINGS | | ||
| | flytepropeller | object | `{"affinity":{},"cacheSizeMbs":0,"configPath":"/etc/flyte/config/*.yaml","image":{"pullPolicy":"IfNotPresent","repository":"cr.flyte.org/flyteorg/flytepropeller","tag":"v0.13.20"},"nodeSelector":{},"podAnnotations":{},"replicaCount":1,"resources":{"limits":{"cpu":"200m","ephemeral-storage":"100Mi","memory":"200Mi"},"requests":{"cpu":"10m","ephemeral-storage":"50Mi","memory":"50Mi"}},"serviceAccount":{"annotations":{},"create":true,"imagePullSecrets":{}},"tolerations":[]}` | FLYTEPROPELLER SETTINGS | | ||
| | flytepropeller.affinity | object | `{}` | affinity for Flytepropeller deployment | | ||
| | flytepropeller.configPath | string | `"/etc/flyte/config/*.yaml"` | Default regex string for searching configuration files | | ||
| | flytepropeller.image.repository | string | `"cr.flyte.org/flyteorg/flytepropeller"` | Docker image for Flytepropeller deployment | | ||
|
|
||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.