Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Plugins should have a standardized interface #94

Closed
georgesnelling opened this issue Nov 19, 2019 · 1 comment
Closed

Plugins should have a standardized interface #94

georgesnelling opened this issue Nov 19, 2019 · 1 comment
Assignees
Labels
Milestone

Comments

@georgesnelling
Copy link
Contributor

My recommendation

  • Have a low level plugin interface (Tasks)
  • Have a higher level FlyteK8s interface
  • Have a higher level Services interface

All these interfaces may exist with FlyteIDL or some other place.
The implementation of the machinery that controls them could probably exist with FlytePropeller. The implementations of the plugins could be supplied from various different repositories

@EngHabu
Copy link
Contributor

EngHabu commented Dec 6, 2019

Fixed

eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 6, 2022

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 6, 2022

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 6, 2022

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 20, 2022

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
* Add AWS Batch metrics for queued
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 20, 2022

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Signed-off-by: Ketan Umare <ketan.umare@gmail.com>
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 20, 2022

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Aug 9, 2023

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Aug 21, 2023

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Aug 21, 2023
* Add AWS Batch metrics for queued
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Aug 21, 2023
Signed-off-by: Ketan Umare <ketan.umare@gmail.com>
eapolinario pushed a commit that referenced this issue Sep 8, 2023
eapolinario added a commit that referenced this issue Sep 8, 2023
* Add workflow state enums and update endpoint (#53)

* Add new phases to Task execution (#52)

* Add new phases to Task execution

* Update flyteidl python version (#54)

* Add state to NamedEntity (#55)

* Add filters to named entity list requests (#56)

* Add an ErrorKind field in ContainerError (#60)

* Add an ErrorKind field in ContainerError

* Bump versions

* Arbitrary container support without Flytekit using FlyteCoPilot (#62)

* Releasing v0.17.29 for RawContainerPlugin (#63)

* Add Auth to execution spec (#59)

* Flyte CoPilot now available for all containers (#64)

* Allow different modes of data download and upload in flyte co-pilot (#65)

* pytorch.proto and respective changes (#61)

* Add FailureHandlingStrategy to workflow idl (#67)

* Add FailureHandlingStrategy to workflow idl

* Rename and allow overrides per LaunchPlan and Execution

* Revert override changes

* revert

* Only keep options we will implement at the moment (#69)

* Only keep options we will implement at the moment

* regenerate

* feature; tfoperator for tensorflow distributed training plugin (#71)

* Add quality of service to launch plan/execution spec (#68)

* IDL changes for Node-Node relationship refactor (#72)

* IDL changes for Node-Node relationship refactor
* Ability to provide information of the parent node.
* Introduction of group_id to indicate grouping of nodes within the Parent node - (instead of dummy nodes)
* Support for querying all nodes under node with group.
* Support for node_id to point to original node in the workflow/graph, and node_name

* feature; catalog metadata and caching status published in node events (#70)

* Catalog store handling

* Event proto updated

* generated

* merged

* Dataset Identifier changed

* Better model

* Exposing TaskNodeMetadata with catalog information in the API

* 0.17.38

* Comment

* docs updated

* Adding proto definitions for supporting SageMaker TrainingJob (built-in algorithms) and HyperparameterTuningJob (#66)

* adding sagemaker protos

Co-authored-by: Haytham AbuelFutuh <habuelfutuh@lyft.com>

* Add output prefix to LaunchPlanSpec (#74)

* [ignore] Tweaking a couple comments (#75)

* Return full execution inputs & outputs (#73)

* [Autogenerated] Add labels to projects in flyteidl (#77)

* first cut

* bump version

* add to project.json

* regen

Co-authored-by: Konstantin Gizdarski <kgizdarski@lyft.com>
Co-authored-by: Katrina Rogan <krogan@lyft.com>

* Introduce ProjectUpdate endpoint to Flyte Admin API (#78)

* add project update endpoint

* PR comments

* pr comments

* pr comments (last one ;p)

* spelling

* generate

Co-authored-by: Konstantin Gizdarski <kgizdarski@lyft.com>
Co-authored-by: Katrina Rogan <krogan@lyft.com>

* Fix Stackdriver log link (#79)

This PR fixes Stackdriver log link using `resource.labels.pod_name` as `advancedFilter` instead of `logName`.

* Create PluginOverrides MatchableResource. (#80)

* Make plugin overrides repeated (#81)

* Add option to record whether a task ran on a spot instance. (#82)

* Support Styx style schedule (#83)

* Support cron schedule with offset.

For example: https://github.com/spotify/styx#schedule-string

* Add generated files

* Update protos/flyteidl/admin/schedule.proto

Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Update protos/flyteidl/admin/schedule.proto

Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Update protos/flyteidl/admin/schedule.proto

Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Regenerate files

* Regenerate files

* Change the message name back

* Revert "Change the message name back"

This reverts commit e468ea836dd30fc01699fd417ee64a182603b7f7.

* Add comments for schedule and offset

Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Adding necessary fields in training job message for distributed training  (#84)

* `distributed_protocol` added as a field in training job resource config

* Added state to project (#88)

Add state to a project

* Create conf.py

* Revert conf.py addition (#91)

* Add filter and sort param when listing projects (#90)

* Add filter and sort param when listing projects

* Bump version

* Deprecate Log Plugins (#94)

* Update CI post migration (#95)

* Migrate off of travis

* move proto test to actions

* wip

* wip

* wip

* wip

* install git

* wip

* wip

* update script

* try uploading

* wip

* wip

* add the rest of the steps

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Update pull_request.yml

* Update pull_request.yml

* Update pull_request.yml

* Ignore generated code

* Update pull_request.yml

* Update pull_request.yml

* wip

* regenerate

* fix workdir

* wip

* wip

* wip

* wip

* wip

* fixing lint

* lint

* Add NPM Publish Step

* cleanup

* Update setup.py

* update maintainer emails

* Publish public npm package

* Publish NPM Package

* Docs for FlyteIDL (#97)

* Change Security/Permission fields with overrides (#98)

* Change Security/Permission fields with overrides

* Added changes from flyteplugins and also added functionality for FetchFromLiteral (#101)

* Added changes from flyteplugins

* Moved more code fromflyteplugins due to test dependencies

* Moved unit test for time primitive

* Added fetchFromliteral functionality

* Fixing lint issues

* Minor lint fixes

* Moved Fetch literal functionality to separate file

* Incorporated the feedback

Co-authored-by: pmahindrakar <pmahindrakar@vmware.com>

* Add task version to template (#102)

* Update ArrayJob for Map task changes (#103)

* Update Organization. Lyft -> Flyteorg, use k8s libraries (#109)

* Revamp Security context to be more specific and expose it to task templates (#108)

* Revamp Security Context Message

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Security Context in Admin entities

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* fix tabs

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* add deprecated message

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update protos/flyteidl/core/types.proto

Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update protos/flyteidl/core/types.proto

Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Move to security proto

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* comment

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com>

* Added new rpc service GetVersion (#110)

* Added new rpc service GetVersion

Signed-off-by: Yuvraj <evalsocket@gmail.com>

* More changes

Signed-off-by: Yuvraj <yuvraj@datapane.com>

* Update get version description

Signed-off-by: Yuvraj <yuvraj@datapane.com>

* Version v0.18.16 (#111)

* Version v0.18.16

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Update GetVersion API to match the other API style

 - Have an additional envelop structure

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Move proto from datacatalog (#113)

* Move proto from datacatalog

Signed-off-by: niant <niant@spotify.com>

* add generated files

Signed-off-by: niant <niant@spotify.com>

Co-authored-by: niant <niant@spotify.com>

* Add free form map config for task custom (#112)

* Add Secret Group (#114)

* Add Secret Group

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Automatically update flyteidl versions when a github release is created (#115)

* wip: Added version automatically in setup.py

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: small fix

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: small fix

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: added npm version update

Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com>

* wip: added workflow for master merge

Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com>

* wip: added goreleaser for creating release

Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com>

* Revert Getversion method from put to get (#116)

* Revert Getversion method from put to get

Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com>

* Added version in api url

Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com>

* Remove need condition in github action (#117)

Signed-off-by: yuvraj <evalsocket@gmail.com>

* npm auto release fix (#118)

Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com>

Thank you!

* Deprecate log plugins (#123)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Literal Transformations from a string or an interface based on literalTypes (#120)

* wip: more transformations

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Changed the String formatter from %s to %v and added more unit tests (#122)

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>
Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Added default condition for unsupported type while creating literal (#124)

* Changed the String formatter from %s to %v and added more unit tests

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* Added unsupported type default condition

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>
Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

Co-authored-by: pmahindrakar-oss <77798312+pmahindrakar-oss@users.noreply.github.com>
Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* #patch: Add in task execution event fields (#119)

* Add group_version to secrets (#125)

* Add group_version to secrets

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Fix typo in external resource message (#126)

* Fix field id for ExecutionSpec#auth_role (#127)

Changing field id wasn't intentional

Co-Authored-By: Fernando Diaz <fernandodiaz@spotify.com>

Signed-off-by: Gleb Kanterov <gleb@spotify.com>

* update docs theme (#133)

* update docs theme

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* add community link

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* [go] Add blob support for MakeLiteralForType (#131)

The MakeLiteralForType client method currently doesn't support the blob type. This adds support for that.

Signed-off-by: Sam Lai <slai@lyft.com>

* dark theme updates (#134)

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* Added workflow for updating flyteidl version in all component (#132)

* Added workflow for updating flyte comopnent version

Signed-off-by: yuvraj <evalsocket@gmail.com>

* Added a single workflow for release flyteidl

Signed-off-by: yuvraj <evalsocket@gmail.com>

* revert workflow changes

Signed-off-by: yuvraj <evalsocket@gmail.com>

* bug fix in ci (#135)

Signed-off-by: yuvraj <evalsocket@gmail.com>

* Enable flyteidl update version for all component (#136)

* enable flyteidl update version for all component

Signed-off-by: yuvraj <evalsocket@gmail.com>

* Added more component

Signed-off-by: yuvraj <evalsocket@gmail.com>

* remove flytekit from component

Signed-off-by: yuvraj <evalsocket@gmail.com>

* Pass dynamic workflow closure in node execution events (#141)

* Documentation for Datacatalog (#143)

Datacatalog service documentation

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Fix Datacatalog title.rst in docs (#145)

* missing blank line in title.rst

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* generated docs

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Enable release automation for flytectl (#144)

Signed-off-by: yuvraj <evalsocket@gmail.com>

* Add GetOrReserveArtifact and ExtendReservation API (#142)

* Move dynamic workflow metadata to GetNodeExecutionData response (#151)

* Add DYNAMIC_RUNNING node execution phase (#152)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Introduce Auth Metadata and Identity Grpc Service and support Pkce auth in admin client (#155)

* Introduce Auth Metadata and Identity Grpc Service

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* merge conflicts

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update deps

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* cleanup deps

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* update deps

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Delete unused catalog client

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Remove the need for UseAuth config to simplify setup further

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add deprecated comment

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Allow config of insecure creds transmission

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Moved the 3legged auth files from flytectl and also added config option for it (#156)

* Moved the 3legged auth files from flytectl and also added config option for it

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Fixed the expiry bug

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Changed logic to refresh the token

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Refactored the getAuthenticationDialOption

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added more unit tests

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Fixed unit tests

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added more unit tests

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* refactor pkce package

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* rename

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* bump for dco

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Added ClientSetBuilder inorder to remove keyring dependency (#158)

* Added ClientSetBuilder inorder to remove keyring dependency

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added token cache to deprecated method too

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Refactoring latest changes

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* rename

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* do not close server right away

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* don't close http server too soon

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* event init error

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Cleanup

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

Co-authored-by: pmahindrakar-oss <77798312+pmahindrakar-oss@users.noreply.github.com>

* documentation revamp according to RFC (#160)

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* Update README.rst

* Update validate module to protoc-gen-validate 0.6.1 (#165)

* Update validate module to protoc-gen-validate 0.6.1

Signed-off-by: Hans Werner <hwerner@lyft.com>

* include generated output

Signed-off-by: Hans Werner <hwerner@lyft.com>

* update code

Signed-off-by: Hans Werner <hwerner@lyft.com>

Co-authored-by: Julio Capote <jcapote@lyft.com>

* Added flyteidl documentation (#167)

* Added flyteidl documentation

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Generated doc requirements and updated CI to not generate docs for now

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Moved to rst file for events

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Moved to rst file for all index files

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
(cherry picked from commit 6dc3c4785dc95b05412a9bec2377016cf16b5ea8)

* Added tmp doc generation step for getting doc dependencies

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Using RST for documentation generation (#169)

* Fix the links in generated html files

* Added handler for build finished event to fix doc links

* Added contributing guide

* Adding wait for the subprocess

* Fixed the path issue with finding the script for fixing the links

* Added darwin switch for sed -i flag

* Fixed non darwin with -i flag for sed

* Using find instead of xargs as it fails on readthedocs

* Moving the substitution errors to /dev/null

* Escaped the Link values

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Using protoc-gen-doc plugin directly

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Removed the example message

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Fixed datacatalog file generation

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Using template to generate docs and also removed unused imports in proto files and fixed doc issues

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Minor doc fix

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added dependency to protoc-gen in biolerplate module

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* add main nav font awesome icons (#170)

* add main nav font awesome icons

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* add "edit on github button" config

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* fix html theme config

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* Support annotations/labels in sidecar (#171)

* Add K8sPod as a task target option (#172)

* Support passing an iam role AND a k8s service account (#173)

* Support passing an iam role AND a k8s service account (again) (#175)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Added boilerplate automation (#162)

* Added boilerplate automation

Signed-off-by: Yuvraj <evalsocket@gmail.com>

* More changes

Signed-off-by: Yuvraj <evalsocket@gmail.com>

* Using protoc-gen-doc from the flyteorg and regenerated docs for new modules (#174)

* Fix the links in generated html files

* Added handler for build finished event to fix doc links

* Added contributing guide

* Adding wait for the subprocess

* Fixed the path issue with finding the script for fixing the links

* Added darwin switch for sed -i flag

* Fixed non darwin with -i flag for sed

* Using find instead of xargs as it fails on readthedocs

* Moving the substitution errors to /dev/null

* Escaped the Link values

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Using protoc-gen-doc plugin directly

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Removed the example message

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Fixed datacatalog file generation

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Using template to generate docs and also removed unused imports in proto files and fixed doc issues

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Minor doc fix

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added dependency to protoc-gen in biolerplate module

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Pulled the latest boilerplate changes

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added support for Generic type for extracting a literal value (#176)

* Added support for Generic type for extracting a literal value

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added grpc gateway jsonpb marshaller and unmarshaller for struct type

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Using json.Marshal

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Incorporated feedback and added another test for string generic

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Add workflow execution config matchable attribute (#182)

* #minor Enum type (#183)

* Enum type definition

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Enum Type support in flyteidl

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* lint fixes

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* re-generated

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Enum default values are the first value in the list

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Added missing docs and included boiler plate update as prereq for generate (#185)

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Add max concurrency to launch plan & execution spec (#186)

* MakeLiteralForType shouldn't print <nil> for nil values (#188)

* Add max concurrency to launch plan & execution spec (#186)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* MakeLiteralForType shouldn't print <nil> for nil values

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* bump

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

Co-authored-by: Katrina Rogan <katrina@nuclyde.io>

* Clean up flyteadmin proto definitions and comments. (#189)

* Add Task Node overrides (#190)

* Update Boilerplate (#181)

Signed-off-by: Flyte-Bot <admin@flyte.org>

Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com>

* Bringin back README.md #patch (#192)

* Bringin back README.md

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Moved contents of developing.rst to README (#193)

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Replaced doc_requirements.in with doc-requirements.in

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* Added InsecureSkipVerify flag (#191)

* add deployment to the top TOC (#194)

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* algolia search (#195)

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix TOC (#196)

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* Add core entity links to admin request structures (#197)

* Fix typos in message comments (#199)


Signed-off-by: Sean Lin <sean@union.ai>

* Add endpoint to recover workflow execution (#187)

* update doc requirements with sphinx v4 (#201)

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* Update code of conduct (#200)

* update code of conduct

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* boilerplate

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* Handling large integers (#202)

* Handling large integers

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Add ephemeral storage as a container resource (#203)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Add ephemeral storage as a matchable resource too (#204)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Add Raw Output Metadata to events (#205)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Disable bump-version and goreleaser workflow in the forked repository (#209)

* Update master.yml

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update master.yml

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update master.yml

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add raw output data to admin execution models (#210)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Update Boilerplate (#208)

Signed-off-by: Flyte-Bot <admin@flyte.org>

Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com>

* Fix up comment for raw output data (#211)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* readd docs (#212)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Change variable map to repeated map entries for ordering (#206)

Signed-off-by: Sean Lin <sean@union.ai>

* Add Sql in target proto (#214)


Signed-off-by: Kevin Su <pingsutw@apache.org>

* fix timestamp and duration literal extraction (#218)

* fixed literal extraction for timestamp and duration types - was previously returning protobufs instead of native golang types

Signed-off-by: Daniel Rammer <daniel@union.ai>

* fixed lint error with imports being non-alphabetical

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Revert variable ordering change PR (#220)

* Revert "Change variable map to repeated map entries for ordering (#206)"

Signed-off-by: Sean Lin <sean@union.ai>

* Update EventError with Is and Unwrap functions (#221)

* update EventError with Is and Unwrap functions for use in errors API

Signed-off-by: Daniel Rammer <daniel@union.ai>

* changed EventError Is* functionality to check entire error stack

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added nil tests to EventError.Is function

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Schema type support for flytectl (#219)

* MPI Operator plugin interface (#217)

* Added mpi plugin

Signed-off-by: Yuvraj <code@evalsocket.dev>

* Rename variable name

Signed-off-by: Yuvraj <code@evalsocket.dev>

* Added docs for mpi

Signed-off-by: Yuvraj <code@evalsocket.dev>

* Support external token source for flyteadmin clients (#222)

* refactor: add token source provider interface
and implementation for clientcredentials and pkce

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* remove unused getAuthType method

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* refactorings

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* add TokenSourceProvider interface documentation

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* move token source provider logic to admin to avoid circular deps

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* fix authentication dial option tests

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* lint files

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* allow external auth process

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* dont forget to trim

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* refactor: change if to switch

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* refactor: rename AuthType value and config

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* refactor: move credentials TS Provider with other types

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

Co-authored-by: Babis Kiosidis <babisk@spotify.com>

* Add Slack button to README (#224)

* Add Slack button to README

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* update slack link

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* Add Architecture field to Container (#226)

* Add Architecture field to Container

Signed-off-by: Anmol Khurana <akhurana@lyft.com>

* Update enum

Signed-off-by: Anmol Khurana <akhurana@lyft.com>

* Update enum

Signed-off-by: Anmol Khurana <akhurana@lyft.com>

* remove events package (#225)

* moved 'go generate' snippet so that when events is removed admin service mocks are still generated

Signed-off-by: Daniel Rammer <daniel@union.ai>

* removed events package

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Adding grpc health service in the clientset (#228)

* Adding grpc health service in the clientset

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added unit tests

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Update Boilerplate (#229)

Signed-off-by: Flyte-Bot <admin@flyte.org>

Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com>

* dummy edit -- updated requirements.txt (#223)

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* Cache Serialize API (#215)

* removed datacatalog ExtendReservation API

Signed-off-by: Daniel Rammer <daniel@union.ai>

* filled out generated content with 'make generate'

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated protobuf docs for admin and core definitions

Signed-off-by: Daniel Rammer <daniel@union.ai>

* created ReservationID message to reuse

Signed-off-by: Daniel Rammer <daniel@union.ai>

* changed artifact reservation API to not include handling of artifacts - only reservations.

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added cache reservation comments

Signed-off-by: Daniel Rammer <daniel@union.ai>

* fixed indenting issues that always drive me crazy

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated discovery_reservable to discovery_serializable to adhere to name change

Signed-off-by: Daniel Rammer <daniel@union.ai>

* moved catalog reservation status enum into a message

Signed-off-by: Daniel Rammer <daniel@union.ai>

* changed discovery_serializable TaskMetadata field to cache_serializable

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Execution closures in the API should defer to GetData calls for passing output data (#234)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Update Boilerplate (#236)

Signed-off-by: Flyte-Bot <admin@flyte.org>

Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com>

* Added flag to pass in CAcerts (#242)

* Added flag to pass in CAcerts

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Incorporated feedback

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* caCert instead of caCerts

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* caCert to caCertFilePath

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Add incompatible cluster event error (#240)

* Add aborting workflow execution phase (#245)

* New StructuredDataset type/literal #patch (#227)

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* bump docsearch version (#246)

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* update flyteidl for new navbar (#247)

* update furo dep git > https (#249)

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

* Update Boilerplate (#243)

Signed-off-by: Flyte-Bot <admin@flyte.org>

Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com>

* Add RetryAttempt and Phase to ExternalResourceInfo proto (#244)

* added retry attempt and phase to ExternalResourceInfo proto

Signed-off-by: Daniel Rammer <daniel@union.ai>

* captialized ExternalResourceInfo retry_attempt comment

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added index to ExternalResourceInfo proto

Signed-off-by: Daniel Rammer <daniel@union.ai>

* regenerated protos to fix rebase issues

Signed-off-by: Daniel Rammer <daniel@union.ai>

* add sphinx panels to docs (#250)

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

* Added UpdateExecution API and api objects (#248)

* Expose flyteadmin client's auth opt (#252)

* Expose flyteadmin client's auth opt
Signed-off-by: Sean Lin <sean@union.ai>

* Move authOpt to global
Signed-off-by: Sean Lin <sean@union.ai>

* minor fix
Signed-off-by: Sean Lin <sean@union.ai>

* Introduce TypeAnnotation#minor (#232)

* feat: introduce TypeAnnotation

Signed-off-by: Kenny Workman <kennyworkman@sbcglobal.net>

* fix: message description

Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com>
Signed-off-by: Kenny Workman <kennyworkman@sbcglobal.net>

* fix: regen proto after merge

Signed-off-by: Kenny Workman <kennyworkman@sbcglobal.net>

Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Remove AdminAuth Client global state (#254)

* Remove AdminAuth Client global state

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Fix unit test

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Added isDynamic flag for distinguishing subworkflows and dynamic workflows (#256)

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Add missing Python libs (#258)

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Add hash to literal #minor (#237)

* Add hash to Literal

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* make generate

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Comment hash

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Added RawOutputDataConfig in ExecutionSpec (#260)

* Added RawOutputDataConfig in ExecutionSpec

Signed-off-by: Kevin Su <pingsutw@apache.org>

* bring back missing rsts

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* update comment, remove @latest, regenerate

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* die @latest

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Union Types #minor (#235)

* Add support union type

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update union type + add union literal repr

* Update union types to use string tags

* Fix typo + generate protos

* Implement changed design

* generate

* Remove changes to download_tooling.sh

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

Co-authored-by: Kevin Su <pingsutw@apache.org>
Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Add custom token source that allows preemptive token refresh (#262)

* Add custom token source that allows preemptive token refresh
Signed-off-by: Sean Lin <sean@union.ai>

* Switch to apimachinery jitter
Signed-off-by: Sean Lin <sean@union.ai>

* Switch back to max because min doesnt make sense
Signed-off-by: Sean Lin <sean@union.ai>

* fix lint
Signed-off-by: Sean Lin <sean@union.ai>

* goimport
Signed-off-by: Sean Lin <sean@union.ai>

* minor fix
Signed-off-by: Sean Lin <sean@union.ai>

* Rename and trim config
Signed-off-by: Sean Lin <sean@union.ai>

* Introduce cluster assignment attribute to execution spec (#255)

* checkpoint

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* one more

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* good riddance

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* one more

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* revert

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* DataProxy Service Definition (#261)

* Added missing docs and mocks for DataProxy (#269)

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Additional execution properties as matchable entities. (#253)

* proposal

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* comments

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Fixed the import and updated tooling

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Updating the golang version to 1.7

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* feedback

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

Co-authored-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Adding authType in pflags and also updated docs with valid values (#268)

* Adding authType in pflags and also updated docs with valid values

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* removed the default message

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* fixed spaces in mesages

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Add cache_status and logs to ExternalResrouce proto (#271)

* added protobuf dependencies to doc generation

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added cache_status and logs to ExternalResourceInfo proto

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Generate mocks

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add is_parent & is_dynamic to node execution events (#272)

* Rename DataProxy to DataProxyService for consistency (#273)

* Rename DataProxy to DataProxyService for consistency

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update client go

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* bump

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Grammar edit  (#267)

* Minor grammar changes

Grammar fix
Changed Flyte IDL to Flyteidl
Updated index.rst files

Signed-off-by: SmritiSatyanV <smriti@union.ai>

* Fix docs (#275)

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* Introduce taints and tolerations to cluster assignment  (#276)

* Add workflow execution JSON schema (#270)

* Add workflow execution jsonschema

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Updated schema

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Added Readme

Signed-off-by: Kevin Su <pingsutw@apache.org>

* updated

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add ContentMD5 parameter for CreateUploadLocationRequest (#278)

* Add ContentMD5 parameter for CreateUploadLocationRequest

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Change contentMD5 type to bytes

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Rename suffix to filename

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* fix docs (#282)

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* Adding event_version to TaskExecutionEvent and TaskExecutionClosure (#279)

* added event_version to TaskExecutionEvent

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added event_version to TaskExecutionClosure

Signed-off-by: Daniel Rammer <daniel@union.ai>

* generated protos

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Add ServiceHttpEndpoint to be returned to clients (#277)

* Add ServiceHttpEndpoint to be returned to clients

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* add make generate check

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add missing docs (#284)

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update docs (#285)

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Go Linter Github  action (#283)

* Usess re-usable linter

Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com>

Co-authored-by: Yuvraj <code@evalsocket.dev>

* Fix pattern to hide generated code in github (#288)

* Fix pattern to hide generated code in github

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Hide changes to rst files

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* #major Release 1.0.0 (#290)

* #major Release 1.0.0

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update flytestdlib to 1.0.0

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Bump github tag action version (#292)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Changed default npm/python versions to valid semver (#293)

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Add interruptible override to execution #minor (#287)

* Added interruptible flag for execution to protos

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Changed execution interruptible flag to use regular bool

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Changed interruptible overrides to use BoolValue
Allows distinguishment between a value not being provided and the go zerovalue false

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Interruptible flag comment/documentation

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Interruptible flag comment/documentation

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Removed unescaped quotes from proto comments
Included documentation for  in proto generation

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Re-generated documentation

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Updates  go version used  in the pipeline (#294)

* Adds linter for go code

Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com>

* Usess re-usable linter

Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com>

* changes wrt comment

Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com>

* changes wrt comments

Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com>

* updates go version in the yaml file

Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com>

Co-authored-by: Yuvraj <code@evalsocket.dev>

* Dockerized docs gen (#295)

* Dockerized docs generation
Now uses protoc-gen-dec Docker image instead of running protoc using the protoc-gen-doc plugin locally

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Minor cleanup of doc templates
Replaced double with single quotes in proto comments (cause escaping issues with protoc-gen-doc text renderer)

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Set locale override during protos/docs generation to ensure consistent sorting

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Added deck_uri to NodeExecutionEvent (#286)

* Added deck metadata in TaskMetadata

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Updated IDL

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Updated IDL

Signed-off-by: Kevin Su <pingsutw@apache.org>

* wip

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Updated IDL

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Updated gitignore

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Updated idl

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Updated comment

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add CreateDownloadLocation service

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add CreateDownloadLocation service

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add CreateDownloadLocation service

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add deck_uri in NodeExecutionClosure

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* updated

Signed-off-by: Kevin Su <pingsutw@apache.org>

* updated

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* add deck_uri to task execution event

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Remove deck_uri from task execution

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Remove deprecated sidecar job (#302)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Grpc default service config (#301)

* add load balancer config

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* add policies doc link

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* add available load balancing policies comment

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* add descriptive comment about missing balancer value

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* describe load balancing policy behaviour

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* import balancers

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* skip linting for empty imports

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* lint nolint

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* rely on grpc client functionality for the configs
and remove todo

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* dont repeat the comment

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* change load balancing config to serviceConfig

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* Change config name and remove package preloading

Signed-off-by: Hongxin Liang <honnix@users.noreply.github.com>

* Test it

Signed-off-by: Hongxin Liang <honnix@users.noreply.github.com>

Co-authored-by: Babis Kiosidis <ckiosidis@gmail.com>

* feat: buf integration for proto release  (#300)

* fix: integrated buf

Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com>

* added protoc-gen-swagger

Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com>

* buf mod update

Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com>

* fix proto path in ci

Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com>

Co-authored-by: Yuvraj <evalsocket@users.noreply.github.com>

* Add go_package for datacatalog.proto (#304)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* fix flyteidl version upgrade automation (#305)

Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com>

* Update execution.proto (#309)

* Update execution.proto

[Slack conversation](https://flyte-org.slack.com/archives/C01P3B761A6/p1657755908722469)
Signed-off-by: SmritiSatyanV <smriti@union.ai>

* Make generate

Signed-off-by: Kevin Su <pingsutw@apache.org>

Co-authored-by: Kevin Su <pingsutw@apache.org>

* Ray task proposal (#308)

* Ray plugin

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Ray plugin

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update cluster spec

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update cluster spec

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update proto

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update proto

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update proto

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update proto

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update proto

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Fix lint error

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Remove shutdown_after_job_finishes

Signed-off-by: Kevin Su <pingsutw@apache.org>

* More comments

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Allow passing in authentication client secret as an environment variable (#311)

* Read client secret from env var first since the location has a default  (#312)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Adding device  authorization oauth2 flow  (#313)

* Added config skip opening browser for pkce auth

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* added docs

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* increased the default browser session timeout to 2min

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Adding device flow idl changes

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Adding device flow orchestration

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* lint fixes

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* nit

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* fixes

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* refactor and feedback

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* nit

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* test fixes

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* more test fixes

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* feedback

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* update buf (#316)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Use grpc client interceptors to properly check for auth requirement (#315)

* Use grpc client interceptors to properly check for auth requirement

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Some refactor and add unit tests

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* lint

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* unit tests

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Attempt a random port

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Listen to localhost only

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* use chain unary interceptor instead

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* only log on errors

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Attempt to disable error check

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Expose newAuthInterceptor to allow other clients to create authenticating clients (#319)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add CheckpointUri to TaskNodeMetadata (#322)

* Add CheckpointUri to TaskNodeMetadata

Signed-off-by: Andrew Dye <andrewwdye@gmail.com>

* Update swagger-codegen-cli image for arm

Signed-off-by: Andrew Dye <andrewwdye@gmail.com>

Signed-off-by: Andrew Dye <andrewwdye@gmail.com>

* Project level attributes via matchable resource (#320)

* copy pasta

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* generate

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* fix comment

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* ClusterAssignment stores cluster pool for execution placement (#321)

* Cluster Pool execution placement

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Make generate

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* wip

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* make generate using new image

Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>

* make generate again

Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>

* make generate

Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>

* make generate go1.18

Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>

* make generate go1.18.5

Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>

* backward-compatible ClusterAssignment

Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>

* make generate

Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>
Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>
Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update token source provider to optionally call GetPublicClientConfig (#326)

* Update token source provider

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* GH actions incident

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Make call to auth metadata optional (#327)

* Make call to auth metadata optional

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* debug

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* revert

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* undeprecate

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Add unit tests

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* codecov is not very good

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Adding audience field to device flow token request (#314)

* Add createworkflow failure proto #minor (#331)

* Added GateNode message (#296)

* added GateNode message

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added signal service

Signed-off-by: Daniel Rammer <daniel@union.ai>

* fleshed out Signal service

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated signal service with a GetOrCreateSignal and SetSignal API

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated signal service api to use GetOrCreate semantics

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added the ListSignals API

Signed-off-by: Daniel Rammer <daniel@union.ai>

* fixed SignalListResponse proto name

Signed-off-by: Daniel Rammer <daniel@union.ai>

* set HTTP API parameters

Signed-off-by: Daniel Rammer <daniel@union.ai>

* generated protos

Signed-off-by: Daniel Rammer <daniel@union.ai>

* documented GateNode

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated signal list API

Signed-off-by: Daniel Rammer <daniel@union.ai>

* filled out signal list api

Signed-off-by: Daniel Rammer <daniel@union.ai>

* addressing pr comments on docs

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added an output variable name to the signal condition

Signed-off-by: Daniel Rammer <daniel@union.ai>

* reworded signal condition docs

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added ApproveCondition to GateNode

Signed-off-by: Daniel Rammer <daniel@union.ai>

* removed authOpt

Signed-off-by: Daniel Rammer <daniel@union.ai>

* fixed types

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated doc_gen_deps to fix docs generation

Signed-off-by: Daniel Rammer <daniel@union.ai>

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Generate javascript proto (#336)

* Cache eviction for single execution in datacatalog and flyteadmin (#318)

* Added datacatalog endpoint for updating artifacts
Existing artifacts can have their associated ArtifactData overwritten

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* datacatalog.UpdateArtifact returns ArtifactID

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Added skip_cache override to ExecutionSpec, LaunchPlanSpec and WorkflowExecutionConfig

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Added CatalogCacheStatus for skipped cache lookups

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Added skip_cache flag to ExecutionRelaunchRequest

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Renamed skip_cache flag to overwrite_cache

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Doc Hub proposal (#303)

* Add description entity

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add id

Signed-off-by: Kevin Su <pingsutw@apache.org>

* wip

Signed-off-by: Kevin Su <pingsutw@apache.org>

* few update

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update service

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update service

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add description entity to task and workflow

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update des entity

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* typo

Signed-off-by: Kevin Su <pingsutw@apache.org>

* address comment

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update idl

Signed-off-by: Kevin Su <pingsutw@apache.org>

* list description entity

Signed-off-by: Kevin Su <pingsutw@apache.org>

* make generate

Signed-off-by: Kevin Su <pingsutw@apache.org>

* make generate

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update service name

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update endpoint

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update endpoint

Signed-off-by: Kevin Su <pingsutw@apache.org>

* remove create_description_entity endpoint

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add description to task/workflow

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update

Signed-off-by: Kevin Su <pingsutw@apache.org>

* address comments

Signed-off-by: Kevin Su <pingsutw@apache.org>

* address comments

Signed-off-by: Kevin Su <pingsutw@apache.org>

* fix tests

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* fix test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add id.resource_type

Signed-off-by: Kevin Su <pingsutw@apache.org>

* undeclared name: ResourceType

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update wrong code manually

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Fixed tests

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Fixed tests

Signed-off-by: Kevin Su <pingsutw@apache.org>

Signed-off-by: Kevin Su <pingsutw@apache.org>
Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Add a more restrict CreateDownloadLink API (#332)

* Add a more restrict CreateDownloadLink API

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* generate

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* regenerate?

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add generates_deck to task metadata

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Remove ARTIFACT_TYPE_OUTPUT_METADATA

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Use buf to generate python stubs (#346)

* Buf python migration

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Generate pyi files

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Add venv to .gitgnore

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Use buf to generate python stubs

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Use buf docker image to generate stubs

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Add stubs produced by call to `buf generate` using buf's docker image

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Add pyi files

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Use buf locally

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Verify that generated protos by using buf

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Copy generated code to a separate artifact

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Move back to go_generate.yml@master

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Fix python package and publish typing information (#347)

* Add __init__.py files to generated stubs

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Publish stubs in the package

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Include __init__.py in verification workflow

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Bump versions of remote plugins

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Metadata tags (#348)

* add tags to metadata

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* make generate

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Comment annotations and doc generation #minor (#350)

* Comment swagger annotations in proto

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Regenerate proto stubs

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Add Databricks config to Spark config (#351)

* databricks plugin

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update comment

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Use struct instead of string

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add token

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* add instance name

Signed-off-by: Kevin Su <pingsutw@apache.org>

* add instance name

Signed-off-by: Kevin Su <pingsutw@apache.org>

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add inital `dask` plugin IDL (#339)

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* added comments to the catalog reservation API (#355)

Signed-off-by: Daniel Rammer <daniel@union.ai>

Signed-off-by: Daniel Rammer <daniel@union.ai>

* dockerizing buf call (#356)

Signed-off-by: Daniel Rammer <daniel@union.ai>

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Add raw claims to user info response (#357)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Adding configurable audience property for flyte clients (#329)

* Adding configurable audience property for flyte clients

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* changed the const audience to audienceKey

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* fixed unit tests

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* fixed unit test

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* nit

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* feedback

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* refactored unit tests

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* Added UseAudienceFromAdmin property to force pull audience from admin config. Default is false and expects clients to pass it

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* Added test for expected number of calls to the public admin endpoint

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* fixed the tests

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* Added template configuration to task template (#358)

* added template to task template

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated docs

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated pod_template_name location to TaskMetadata proto message

Signed-off-by: Daniel Rammer <daniel@union.ai>

---------

Signed-off-by: Daniel Rammer <daniel@union.ai>

* bumping go version to 1.19 (#363)

Signed-off-by: Daniel Rammer <daniel@union.ai>

* gen (#359)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>
Co-authored-by: Katrina Rogan <katrina@Katrinas-MBP.UNION.AI>

* Adding support for structured dataset (#369)

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* added dynamic_job_spec_uri to dynamic workflow metadata and node execution closure (#360)

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Use TokenCache in ClientCredentialsTokenSourceProvider (#377)

* Init customTokenSource.refreshTime (#381)

Signed-off-by: Andrew Dy…
eapolinario pushed a commit that referenced this issue Sep 13, 2023
Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
pvditt pushed a commit that referenced this issue Dec 29, 2023

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Apr 30, 2024

Verified

This commit was signed with the committer’s verified signature.
austin362667 Austin Liu
Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
pmahindrakar-oss pushed a commit that referenced this issue May 1, 2024
## Overview
Flyte fork builds take 30+ minutes. This is mostly due to building images that cloud does not use (single binary, sandbox).

This change:
- removes parts of image building workflows that cloud does not use
- removes couple of unrelated unused workflows.

Context: https://unionai.slack.com/archives/C02CTFRHWDS/p1708664432669819

## Test Plan
*TODO: Summarize tests added, integration tests run, or other steps you took to validate this change. Include (or link to) relevant test output or screenshots.*

## Rollout Plan (if applicable)
*TODO: Describe any deployment or compatibility considerations for rolling out this change.*

## Upstream Changes
Should this change be upstreamed to OSS (flyteorg/flyte)? If so, please check this box for auditing. Note, this is the responsibility of each developer. See [this guide](https://unionai.atlassian.net/wiki/spaces/ENG/pages/447610883/Flyte+-+Union+Cloud+Development+Runbook/#When-are-versions-updated%3F).
- [ ] To be upstreamed

## Jira Issue
https://unionai.atlassian.net/browse/<project-number>

## Checklist
* [ ] Added tests
* [ ] Ran a deploy dry run and shared the terraform plan
* [ ] Added logging and metrics
* [ ] Updated [dashboards](https://unionai.grafana.net/dashboards) and [alerts](https://unionai.grafana.net/alerting/list)
* [ ] Updated documentation
austin362667 pushed a commit to austin362667/flyte that referenced this issue May 7, 2024
Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
robert-ulbrich-mercedes-benz pushed a commit to robert-ulbrich-mercedes-benz/flyte that referenced this issue Jul 2, 2024
Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants