Flyte v0.18.1 milestone release

0.18.1 Release ChangeLog

Closed Issues

UX

FlyteKit

See the flytekit 0.24.0 release for the full list of changes. Here are some of the highlights:

1. We've added the following models to the top-level of the flytekit package. The classes will not move from their original locations, but importing from the top level will always be safer as we promise not to break these.

   - Annotations, AuthRole, Labels
   - WorkflowExecutionPhase
   - Literal, LiteralType, Scalar, BlobType, Blob, BlobMetadata

   Instead of from flytekit.models.common import Labels, Annotations, please now do

   from flytekit import Labels, Annotations

2. Support for python pickle. Starting in this release, flytekit is going to pickle inputs and outputs for types which it doesn't have a specific transformer for. This brings a lot of more freedom in porting over code to flyte's model, since it won't force users to write a type transformer in order to use existing code. Keep in mind that all the caveats around pickling code apply in this case.

3. We added a cookiecutter template, simplifying the Getting started docs and also unlocking the path to cookiecutter templates for specific use-cases, e.g. pytorch-enabled samples, etc.

4. Faster installation in Apple M1 Macs. We're now requiring pyarrow 6.0, which contains prebuilt wheels for the M1.

FlyteConsole

1. Added new UI for Workflow details including execution bar chart.
2. Added new bar chart user-selected filter for workflow executions.
3. Added new launch form controls ("Advanced Options")
4. Minor bug fixes

System

1. Performance improvements for executions.
   1. Smaller workflow CRDs,
   2. Better handling of partial failures in large fanout scenarios,
2. All flyte containers now run as non-root users. Docs (Thanks @frsann)
3. Stability and bug fixes

Documentation

1. Plugin Setup Docs (e.g. MPI, Tensorflow, Spark Operators, AWS Batch & Athena, Snowflake and Google BigQuery)

Sandbox

1. Fixed race condition in minio pod initialization.