Skip to content

Commit

Permalink
Merge pull request #4017 from flyteorg/monorepo--import-flyteidl
Browse files Browse the repository at this point in the history
* Add workflow state enums and update endpoint (#53)

* Add new phases to Task execution (#52)

* Add new phases to Task execution

* Update flyteidl python version (#54)

* Add state to NamedEntity (#55)

* Add filters to named entity list requests (#56)

* Add an ErrorKind field in ContainerError (#60)

* Add an ErrorKind field in ContainerError

* Bump versions

* Arbitrary container support without Flytekit using FlyteCoPilot (#62)

* Releasing v0.17.29 for RawContainerPlugin (#63)

* Add Auth to execution spec (#59)

* Flyte CoPilot now available for all containers (#64)

* Allow different modes of data download and upload in flyte co-pilot (#65)

* pytorch.proto and respective changes (#61)

* Add FailureHandlingStrategy to workflow idl (#67)

* Add FailureHandlingStrategy to workflow idl

* Rename and allow overrides per LaunchPlan and Execution

* Revert override changes

* revert

* Only keep options we will implement at the moment (#69)

* Only keep options we will implement at the moment

* regenerate

* feature; tfoperator for tensorflow distributed training plugin (#71)

* Add quality of service to launch plan/execution spec (#68)

* IDL changes for Node-Node relationship refactor (#72)

* IDL changes for Node-Node relationship refactor
* Ability to provide information of the parent node.
* Introduction of group_id to indicate grouping of nodes within the Parent node - (instead of dummy nodes)
* Support for querying all nodes under node with group.
* Support for node_id to point to original node in the workflow/graph, and node_name

* feature; catalog metadata and caching status published in node events (#70)

* Catalog store handling

* Event proto updated

* generated

* merged

* Dataset Identifier changed

* Better model

* Exposing TaskNodeMetadata with catalog information in the API

* 0.17.38

* Comment

* docs updated

* Adding proto definitions for supporting SageMaker TrainingJob (built-in algorithms) and HyperparameterTuningJob (#66)

* adding sagemaker protos

Co-authored-by: Haytham AbuelFutuh <habuelfutuh@lyft.com>

* Add output prefix to LaunchPlanSpec (#74)

* [ignore] Tweaking a couple comments (#75)

* Return full execution inputs & outputs (#73)

* [Autogenerated] Add labels to projects in flyteidl (#77)

* first cut

* bump version

* add to project.json

* regen

Co-authored-by: Konstantin Gizdarski <kgizdarski@lyft.com>
Co-authored-by: Katrina Rogan <krogan@lyft.com>

* Introduce ProjectUpdate endpoint to Flyte Admin API (#78)

* add project update endpoint

* PR comments

* pr comments

* pr comments (last one ;p)

* spelling

* generate

Co-authored-by: Konstantin Gizdarski <kgizdarski@lyft.com>
Co-authored-by: Katrina Rogan <krogan@lyft.com>

* Fix Stackdriver log link (#79)

This PR fixes Stackdriver log link using `resource.labels.pod_name` as `advancedFilter` instead of `logName`.

* Create PluginOverrides MatchableResource. (#80)

* Make plugin overrides repeated (#81)

* Add option to record whether a task ran on a spot instance. (#82)

* Support Styx style schedule (#83)

* Support cron schedule with offset.

For example: https://github.com/spotify/styx#schedule-string

* Add generated files

* Update protos/flyteidl/admin/schedule.proto

Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Update protos/flyteidl/admin/schedule.proto

Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Update protos/flyteidl/admin/schedule.proto

Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Regenerate files

* Regenerate files

* Change the message name back

* Revert "Change the message name back"

This reverts commit e468ea836dd30fc01699fd417ee64a182603b7f7.

* Add comments for schedule and offset

Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Adding necessary fields in training job message for distributed training  (#84)

* `distributed_protocol` added as a field in training job resource config

* Added state to project (#88)

Add state to a project

* Create conf.py

* Revert conf.py addition (#91)

* Add filter and sort param when listing projects (#90)

* Add filter and sort param when listing projects

* Bump version

* Deprecate Log Plugins (#94)

* Update CI post migration (#95)

* Migrate off of travis

* move proto test to actions

* wip

* wip

* wip

* wip

* install git

* wip

* wip

* update script

* try uploading

* wip

* wip

* add the rest of the steps

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Update pull_request.yml

* Update pull_request.yml

* Update pull_request.yml

* Ignore generated code

* Update pull_request.yml

* Update pull_request.yml

* wip

* regenerate

* fix workdir

* wip

* wip

* wip

* wip

* wip

* fixing lint

* lint

* Add NPM Publish Step

* cleanup

* Update setup.py

* update maintainer emails

* Publish public npm package

* Publish NPM Package

* Docs for FlyteIDL (#97)

* Change Security/Permission fields with overrides (#98)

* Change Security/Permission fields with overrides

* Added changes from flyteplugins and also added functionality for FetchFromLiteral (#101)

* Added changes from flyteplugins

* Moved more code fromflyteplugins due to test dependencies

* Moved unit test for time primitive

* Added fetchFromliteral functionality

* Fixing lint issues

* Minor lint fixes

* Moved Fetch literal functionality to separate file

* Incorporated the feedback

Co-authored-by: pmahindrakar <pmahindrakar@vmware.com>

* Add task version to template (#102)

* Update ArrayJob for Map task changes (#103)

* Update Organization. Lyft -> Flyteorg, use k8s libraries (#109)

* Revamp Security context to be more specific and expose it to task templates (#108)

* Revamp Security Context Message

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Security Context in Admin entities

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* fix tabs

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* add deprecated message

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update protos/flyteidl/core/types.proto

Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update protos/flyteidl/core/types.proto

Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Move to security proto

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* comment

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

Co-authored-by: Ketan Umare <16888709+kumare3@users.noreply.github.com>

* Added new rpc service GetVersion (#110)

* Added new rpc service GetVersion

Signed-off-by: Yuvraj <evalsocket@gmail.com>

* More changes

Signed-off-by: Yuvraj <yuvraj@datapane.com>

* Update get version description

Signed-off-by: Yuvraj <yuvraj@datapane.com>

* Version v0.18.16 (#111)

* Version v0.18.16

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Update GetVersion API to match the other API style

 - Have an additional envelop structure

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Move proto from datacatalog (#113)

* Move proto from datacatalog

Signed-off-by: niant <niant@spotify.com>

* add generated files

Signed-off-by: niant <niant@spotify.com>

Co-authored-by: niant <niant@spotify.com>

* Add free form map config for task custom (#112)

* Add Secret Group (#114)

* Add Secret Group

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Automatically update flyteidl versions when a github release is created (#115)

* wip: Added version automatically in setup.py

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: small fix

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: small fix

Signed-off-by: yuvraj <evalsocket@gmail.com>

* wip: added npm version update

Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com>

* wip: added workflow for master merge

Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com>

* wip: added goreleaser for creating release

Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com>

* Revert Getversion method from put to get (#116)

* Revert Getversion method from put to get

Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com>

* Added version in api url

Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com>

* Remove need condition in github action (#117)

Signed-off-by: yuvraj <evalsocket@gmail.com>

* npm auto release fix (#118)

Signed-off-by: Yuvraj <yuvraj.yad001@gmail.com>

Thank you!

* Deprecate log plugins (#123)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Literal Transformations from a string or an interface based on literalTypes (#120)

* wip: more transformations

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Changed the String formatter from %s to %v and added more unit tests (#122)

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>
Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Added default condition for unsupported type while creating literal (#124)

* Changed the String formatter from %s to %v and added more unit tests

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* Added unsupported type default condition

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>
Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

Co-authored-by: pmahindrakar-oss <77798312+pmahindrakar-oss@users.noreply.github.com>
Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* #patch: Add in task execution event fields (#119)

* Add group_version to secrets (#125)

* Add group_version to secrets

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Fix typo in external resource message (#126)

* Fix field id for ExecutionSpec#auth_role (#127)

Changing field id wasn't intentional

Co-Authored-By: Fernando Diaz <fernandodiaz@spotify.com>

Signed-off-by: Gleb Kanterov <gleb@spotify.com>

* update docs theme (#133)

* update docs theme

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* add community link

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* [go] Add blob support for MakeLiteralForType (#131)

The MakeLiteralForType client method currently doesn't support the blob type. This adds support for that.

Signed-off-by: Sam Lai <slai@lyft.com>

* dark theme updates (#134)

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* Added workflow for updating flyteidl version in all component (#132)

* Added workflow for updating flyte comopnent version

Signed-off-by: yuvraj <evalsocket@gmail.com>

* Added a single workflow for release flyteidl

Signed-off-by: yuvraj <evalsocket@gmail.com>

* revert workflow changes

Signed-off-by: yuvraj <evalsocket@gmail.com>

* bug fix in ci (#135)

Signed-off-by: yuvraj <evalsocket@gmail.com>

* Enable flyteidl update version for all component (#136)

* enable flyteidl update version for all component

Signed-off-by: yuvraj <evalsocket@gmail.com>

* Added more component

Signed-off-by: yuvraj <evalsocket@gmail.com>

* remove flytekit from component

Signed-off-by: yuvraj <evalsocket@gmail.com>

* Pass dynamic workflow closure in node execution events (#141)

* Documentation for Datacatalog (#143)

Datacatalog service documentation

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Fix Datacatalog title.rst in docs (#145)

* missing blank line in title.rst

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* generated docs

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Enable release automation for flytectl (#144)

Signed-off-by: yuvraj <evalsocket@gmail.com>

* Add GetOrReserveArtifact and ExtendReservation API (#142)

* Move dynamic workflow metadata to GetNodeExecutionData response (#151)

* Add DYNAMIC_RUNNING node execution phase (#152)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Introduce Auth Metadata and Identity Grpc Service and support Pkce auth in admin client (#155)

* Introduce Auth Metadata and Identity Grpc Service

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* merge conflicts

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update deps

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* cleanup deps

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* update deps

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Delete unused catalog client

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Remove the need for UseAuth config to simplify setup further

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add deprecated comment

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Allow config of insecure creds transmission

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Moved the 3legged auth files from flytectl and also added config option for it (#156)

* Moved the 3legged auth files from flytectl and also added config option for it

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Fixed the expiry bug

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Changed logic to refresh the token

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Refactored the getAuthenticationDialOption

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added more unit tests

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Fixed unit tests

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added more unit tests

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* refactor pkce package

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* rename

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* bump for dco

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Added ClientSetBuilder inorder to remove keyring dependency (#158)

* Added ClientSetBuilder inorder to remove keyring dependency

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added token cache to deprecated method too

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Refactoring latest changes

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* rename

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* do not close server right away

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* don't close http server too soon

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* event init error

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Cleanup

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

Co-authored-by: pmahindrakar-oss <77798312+pmahindrakar-oss@users.noreply.github.com>

* documentation revamp according to RFC (#160)

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* Update README.rst

* Update validate module to protoc-gen-validate 0.6.1 (#165)

* Update validate module to protoc-gen-validate 0.6.1

Signed-off-by: Hans Werner <hwerner@lyft.com>

* include generated output

Signed-off-by: Hans Werner <hwerner@lyft.com>

* update code

Signed-off-by: Hans Werner <hwerner@lyft.com>

Co-authored-by: Julio Capote <jcapote@lyft.com>

* Added flyteidl documentation (#167)

* Added flyteidl documentation

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Generated doc requirements and updated CI to not generate docs for now

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Moved to rst file for events

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Moved to rst file for all index files

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>
(cherry picked from commit 6dc3c4785dc95b05412a9bec2377016cf16b5ea8)

* Added tmp doc generation step for getting doc dependencies

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Using RST for documentation generation (#169)

* Fix the links in generated html files

* Added handler for build finished event to fix doc links

* Added contributing guide

* Adding wait for the subprocess

* Fixed the path issue with finding the script for fixing the links

* Added darwin switch for sed -i flag

* Fixed non darwin with -i flag for sed

* Using find instead of xargs as it fails on readthedocs

* Moving the substitution errors to /dev/null

* Escaped the Link values

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Using protoc-gen-doc plugin directly

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Removed the example message

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Fixed datacatalog file generation

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Using template to generate docs and also removed unused imports in proto files and fixed doc issues

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Minor doc fix

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added dependency to protoc-gen in biolerplate module

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* add main nav font awesome icons (#170)

* add main nav font awesome icons

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* add "edit on github button" config

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* fix html theme config

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* Support annotations/labels in sidecar (#171)

* Add K8sPod as a task target option (#172)

* Support passing an iam role AND a k8s service account (#173)

* Support passing an iam role AND a k8s service account (again) (#175)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Added boilerplate automation (#162)

* Added boilerplate automation

Signed-off-by: Yuvraj <evalsocket@gmail.com>

* More changes

Signed-off-by: Yuvraj <evalsocket@gmail.com>

* Using protoc-gen-doc from the flyteorg and regenerated docs for new modules (#174)

* Fix the links in generated html files

* Added handler for build finished event to fix doc links

* Added contributing guide

* Adding wait for the subprocess

* Fixed the path issue with finding the script for fixing the links

* Added darwin switch for sed -i flag

* Fixed non darwin with -i flag for sed

* Using find instead of xargs as it fails on readthedocs

* Moving the substitution errors to /dev/null

* Escaped the Link values

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Using protoc-gen-doc plugin directly

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Removed the example message

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Fixed datacatalog file generation

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Using template to generate docs and also removed unused imports in proto files and fixed doc issues

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Minor doc fix

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added dependency to protoc-gen in biolerplate module

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Pulled the latest boilerplate changes

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added support for Generic type for extracting a literal value (#176)

* Added support for Generic type for extracting a literal value

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added grpc gateway jsonpb marshaller and unmarshaller for struct type

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Using json.Marshal

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Incorporated feedback and added another test for string generic

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Add workflow execution config matchable attribute (#182)

* #minor Enum type (#183)

* Enum type definition

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Enum Type support in flyteidl

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* lint fixes

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* re-generated

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Enum default values are the first value in the list

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Added missing docs and included boiler plate update as prereq for generate (#185)

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Add max concurrency to launch plan & execution spec (#186)

* MakeLiteralForType shouldn't print <nil> for nil values (#188)

* Add max concurrency to launch plan & execution spec (#186)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* MakeLiteralForType shouldn't print <nil> for nil values

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* bump

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

Co-authored-by: Katrina Rogan <katrina@nuclyde.io>

* Clean up flyteadmin proto definitions and comments. (#189)

* Add Task Node overrides (#190)

* Update Boilerplate (#181)

Signed-off-by: Flyte-Bot <admin@flyte.org>

Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com>

* Bringin back README.md #patch (#192)

* Bringin back README.md

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* Moved contents of developing.rst to README (#193)

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Replaced doc_requirements.in with doc-requirements.in

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

Co-authored-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* Added InsecureSkipVerify flag (#191)

* add deployment to the top TOC (#194)

Signed-off-by: Ketan Umare <ketan.umare@gmail.com>

* algolia search (#195)

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix TOC (#196)

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* Add core entity links to admin request structures (#197)

* Fix typos in message comments (#199)


Signed-off-by: Sean Lin <sean@union.ai>

* Add endpoint to recover workflow execution (#187)

* update doc requirements with sphinx v4 (#201)

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* Update code of conduct (#200)

* update code of conduct

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* boilerplate

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* Handling large integers (#202)

* Handling large integers

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Add ephemeral storage as a container resource (#203)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Add ephemeral storage as a matchable resource too (#204)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Add Raw Output Metadata to events (#205)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Disable bump-version and goreleaser workflow in the forked repository (#209)

* Update master.yml

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update master.yml

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update master.yml

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add raw output data to admin execution models (#210)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Update Boilerplate (#208)

Signed-off-by: Flyte-Bot <admin@flyte.org>

Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com>

* Fix up comment for raw output data (#211)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* readd docs (#212)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Change variable map to repeated map entries for ordering (#206)

Signed-off-by: Sean Lin <sean@union.ai>

* Add Sql in target proto (#214)


Signed-off-by: Kevin Su <pingsutw@apache.org>

* fix timestamp and duration literal extraction (#218)

* fixed literal extraction for timestamp and duration types - was previously returning protobufs instead of native golang types

Signed-off-by: Daniel Rammer <daniel@union.ai>

* fixed lint error with imports being non-alphabetical

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Revert variable ordering change PR (#220)

* Revert "Change variable map to repeated map entries for ordering (#206)"

Signed-off-by: Sean Lin <sean@union.ai>

* Update EventError with Is and Unwrap functions (#221)

* update EventError with Is and Unwrap functions for use in errors API

Signed-off-by: Daniel Rammer <daniel@union.ai>

* changed EventError Is* functionality to check entire error stack

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added nil tests to EventError.Is function

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Schema type support for flytectl (#219)

* MPI Operator plugin interface (#217)

* Added mpi plugin

Signed-off-by: Yuvraj <code@evalsocket.dev>

* Rename variable name

Signed-off-by: Yuvraj <code@evalsocket.dev>

* Added docs for mpi

Signed-off-by: Yuvraj <code@evalsocket.dev>

* Support external token source for flyteadmin clients (#222)

* refactor: add token source provider interface
and implementation for clientcredentials and pkce

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* remove unused getAuthType method

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* refactorings

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* add TokenSourceProvider interface documentation

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* move token source provider logic to admin to avoid circular deps

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* fix authentication dial option tests

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* lint files

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* allow external auth process

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* dont forget to trim

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* refactor: change if to switch

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* refactor: rename AuthType value and config

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* refactor: move credentials TS Provider with other types

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

Co-authored-by: Babis Kiosidis <babisk@spotify.com>

* Add Slack button to README (#224)

* Add Slack button to README

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* update slack link

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* Add Architecture field to Container (#226)

* Add Architecture field to Container

Signed-off-by: Anmol Khurana <akhurana@lyft.com>

* Update enum

Signed-off-by: Anmol Khurana <akhurana@lyft.com>

* Update enum

Signed-off-by: Anmol Khurana <akhurana@lyft.com>

* remove events package (#225)

* moved 'go generate' snippet so that when events is removed admin service mocks are still generated

Signed-off-by: Daniel Rammer <daniel@union.ai>

* removed events package

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Adding grpc health service in the clientset (#228)

* Adding grpc health service in the clientset

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Added unit tests

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Update Boilerplate (#229)

Signed-off-by: Flyte-Bot <admin@flyte.org>

Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com>

* dummy edit -- updated requirements.txt (#223)

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* Cache Serialize API (#215)

* removed datacatalog ExtendReservation API

Signed-off-by: Daniel Rammer <daniel@union.ai>

* filled out generated content with 'make generate'

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated protobuf docs for admin and core definitions

Signed-off-by: Daniel Rammer <daniel@union.ai>

* created ReservationID message to reuse

Signed-off-by: Daniel Rammer <daniel@union.ai>

* changed artifact reservation API to not include handling of artifacts - only reservations.

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added cache reservation comments

Signed-off-by: Daniel Rammer <daniel@union.ai>

* fixed indenting issues that always drive me crazy

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated discovery_reservable to discovery_serializable to adhere to name change

Signed-off-by: Daniel Rammer <daniel@union.ai>

* moved catalog reservation status enum into a message

Signed-off-by: Daniel Rammer <daniel@union.ai>

* changed discovery_serializable TaskMetadata field to cache_serializable

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Execution closures in the API should defer to GetData calls for passing output data (#234)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Update Boilerplate (#236)

Signed-off-by: Flyte-Bot <admin@flyte.org>

Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com>

* Added flag to pass in CAcerts (#242)

* Added flag to pass in CAcerts

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Incorporated feedback

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* caCert instead of caCerts

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* caCert to caCertFilePath

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Add incompatible cluster event error (#240)

* Add aborting workflow execution phase (#245)

* New StructuredDataset type/literal #patch (#227)

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* bump docsearch version (#246)

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* update flyteidl for new navbar (#247)

* update furo dep git > https (#249)

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

* Update Boilerplate (#243)

Signed-off-by: Flyte-Bot <admin@flyte.org>

Co-authored-by: flyte-bot <flyte-bot@users.noreply.github.com>

* Add RetryAttempt and Phase to ExternalResourceInfo proto (#244)

* added retry attempt and phase to ExternalResourceInfo proto

Signed-off-by: Daniel Rammer <daniel@union.ai>

* captialized ExternalResourceInfo retry_attempt comment

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added index to ExternalResourceInfo proto

Signed-off-by: Daniel Rammer <daniel@union.ai>

* regenerated protos to fix rebase issues

Signed-off-by: Daniel Rammer <daniel@union.ai>

* add sphinx panels to docs (#250)

Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>

* Added UpdateExecution API and api objects (#248)

* Expose flyteadmin client's auth opt (#252)

* Expose flyteadmin client's auth opt
Signed-off-by: Sean Lin <sean@union.ai>

* Move authOpt to global
Signed-off-by: Sean Lin <sean@union.ai>

* minor fix
Signed-off-by: Sean Lin <sean@union.ai>

* Introduce TypeAnnotation#minor (#232)

* feat: introduce TypeAnnotation

Signed-off-by: Kenny Workman <kennyworkman@sbcglobal.net>

* fix: message description

Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com>
Signed-off-by: Kenny Workman <kennyworkman@sbcglobal.net>

* fix: regen proto after merge

Signed-off-by: Kenny Workman <kennyworkman@sbcglobal.net>

Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Remove AdminAuth Client global state (#254)

* Remove AdminAuth Client global state

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Fix unit test

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Added isDynamic flag for distinguishing subworkflows and dynamic workflows (#256)

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Add missing Python libs (#258)

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Add hash to literal #minor (#237)

* Add hash to Literal

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* make generate

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Comment hash

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Added RawOutputDataConfig in ExecutionSpec (#260)

* Added RawOutputDataConfig in ExecutionSpec

Signed-off-by: Kevin Su <pingsutw@apache.org>

* bring back missing rsts

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* update comment, remove @latest, regenerate

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* die @latest

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Union Types #minor (#235)

* Add support union type

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update union type + add union literal repr

* Update union types to use string tags

* Fix typo + generate protos

* Implement changed design

* generate

* Remove changes to download_tooling.sh

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

Co-authored-by: Kevin Su <pingsutw@apache.org>
Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Add custom token source that allows preemptive token refresh (#262)

* Add custom token source that allows preemptive token refresh
Signed-off-by: Sean Lin <sean@union.ai>

* Switch to apimachinery jitter
Signed-off-by: Sean Lin <sean@union.ai>

* Switch back to max because min doesnt make sense
Signed-off-by: Sean Lin <sean@union.ai>

* fix lint
Signed-off-by: Sean Lin <sean@union.ai>

* goimport
Signed-off-by: Sean Lin <sean@union.ai>

* minor fix
Signed-off-by: Sean Lin <sean@union.ai>

* Rename and trim config
Signed-off-by: Sean Lin <sean@union.ai>

* Introduce cluster assignment attribute to execution spec (#255)

* checkpoint

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* one more

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* good riddance

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* one more

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* revert

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* DataProxy Service Definition (#261)

* Added missing docs and mocks for DataProxy (#269)

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Additional execution properties as matchable entities. (#253)

* proposal

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* comments

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Fixed the import and updated tooling

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Updating the golang version to 1.7

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* feedback

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

Co-authored-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Adding authType in pflags and also updated docs with valid values (#268)

* Adding authType in pflags and also updated docs with valid values

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* removed the default message

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* fixed spaces in mesages

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Add cache_status and logs to ExternalResrouce proto (#271)

* added protobuf dependencies to doc generation

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added cache_status and logs to ExternalResourceInfo proto

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Generate mocks

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add is_parent & is_dynamic to node execution events (#272)

* Rename DataProxy to DataProxyService for consistency (#273)

* Rename DataProxy to DataProxyService for consistency

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update client go

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* bump

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Grammar edit  (#267)

* Minor grammar changes

Grammar fix
Changed Flyte IDL to Flyteidl
Updated index.rst files

Signed-off-by: SmritiSatyanV <smriti@union.ai>

* Fix docs (#275)

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* Introduce taints and tolerations to cluster assignment  (#276)

* Add workflow execution JSON schema (#270)

* Add workflow execution jsonschema

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Updated schema

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Added Readme

Signed-off-by: Kevin Su <pingsutw@apache.org>

* updated

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add ContentMD5 parameter for CreateUploadLocationRequest (#278)

* Add ContentMD5 parameter for CreateUploadLocationRequest

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Change contentMD5 type to bytes

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Rename suffix to filename

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* fix docs (#282)

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* Adding event_version to TaskExecutionEvent and TaskExecutionClosure (#279)

* added event_version to TaskExecutionEvent

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added event_version to TaskExecutionClosure

Signed-off-by: Daniel Rammer <daniel@union.ai>

* generated protos

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Add ServiceHttpEndpoint to be returned to clients (#277)

* Add ServiceHttpEndpoint to be returned to clients

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* add make generate check

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add missing docs (#284)

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update docs (#285)

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Go Linter Github  action (#283)

* Usess re-usable linter

Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com>

Co-authored-by: Yuvraj <code@evalsocket.dev>

* Fix pattern to hide generated code in github (#288)

* Fix pattern to hide generated code in github

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Hide changes to rst files

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* #major Release 1.0.0 (#290)

* #major Release 1.0.0

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update flytestdlib to 1.0.0

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Bump github tag action version (#292)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Changed default npm/python versions to valid semver (#293)

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Add interruptible override to execution #minor (#287)

* Added interruptible flag for execution to protos

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Changed execution interruptible flag to use regular bool

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Changed interruptible overrides to use BoolValue
Allows distinguishment between a value not being provided and the go zerovalue false

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Interruptible flag comment/documentation

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Interruptible flag comment/documentation

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Removed unescaped quotes from proto comments
Included documentation for  in proto generation

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Re-generated documentation

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Updates  go version used  in the pipeline (#294)

* Adds linter for go code

Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com>

* Usess re-usable linter

Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com>

* changes wrt comment

Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com>

* changes wrt comments

Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com>

* updates go version in the yaml file

Signed-off-by: Yukesh Kumar <hashtagtheyk@gmail.com>

Co-authored-by: Yuvraj <code@evalsocket.dev>

* Dockerized docs gen (#295)

* Dockerized docs generation
Now uses protoc-gen-dec Docker image instead of running protoc using the protoc-gen-doc plugin locally

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Minor cleanup of doc templates
Replaced double with single quotes in proto comments (cause escaping issues with protoc-gen-doc text renderer)

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Set locale override during protos/docs generation to ensure consistent sorting

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Added deck_uri to NodeExecutionEvent (#286)

* Added deck metadata in TaskMetadata

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Updated IDL

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Updated IDL

Signed-off-by: Kevin Su <pingsutw@apache.org>

* wip

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Updated IDL

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Updated gitignore

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Updated idl

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Updated comment

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add CreateDownloadLocation service

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add CreateDownloadLocation service

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add CreateDownloadLocation service

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add deck_uri in NodeExecutionClosure

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* updated

Signed-off-by: Kevin Su <pingsutw@apache.org>

* updated

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* add deck_uri to task execution event

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Remove deck_uri from task execution

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Remove deprecated sidecar job (#302)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Grpc default service config (#301)

* add load balancer config

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* add policies doc link

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* add available load balancing policies comment

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* add descriptive comment about missing balancer value

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* describe load balancing policy behaviour

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* import balancers

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* skip linting for empty imports

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* lint nolint

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* rely on grpc client functionality for the configs
and remove todo

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* dont repeat the comment

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* change load balancing config to serviceConfig

Signed-off-by: Babis Kiosidis <ckiosidis@gmail.com>

* Change config name and remove package preloading

Signed-off-by: Hongxin Liang <honnix@users.noreply.github.com>

* Test it

Signed-off-by: Hongxin Liang <honnix@users.noreply.github.com>

Co-authored-by: Babis Kiosidis <ckiosidis@gmail.com>

* feat: buf integration for proto release  (#300)

* fix: integrated buf

Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com>

* added protoc-gen-swagger

Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com>

* buf mod update

Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com>

* fix proto path in ci

Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com>

Co-authored-by: Yuvraj <evalsocket@users.noreply.github.com>

* Add go_package for datacatalog.proto (#304)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* fix flyteidl version upgrade automation (#305)

Signed-off-by: Yuvraj <evalsocket@users.noreply.github.com>

* Update execution.proto (#309)

* Update execution.proto

[Slack conversation](https://flyte-org.slack.com/archives/C01P3B761A6/p1657755908722469)
Signed-off-by: SmritiSatyanV <smriti@union.ai>

* Make generate

Signed-off-by: Kevin Su <pingsutw@apache.org>

Co-authored-by: Kevin Su <pingsutw@apache.org>

* Ray task proposal (#308)

* Ray plugin

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Ray plugin

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update cluster spec

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update cluster spec

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update proto

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update proto

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update proto

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update proto

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update proto

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Fix lint error

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Remove shutdown_after_job_finishes

Signed-off-by: Kevin Su <pingsutw@apache.org>

* More comments

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Allow passing in authentication client secret as an environment variable (#311)

* Read client secret from env var first since the location has a default  (#312)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Adding device  authorization oauth2 flow  (#313)

* Added config skip opening browser for pkce auth

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* added docs

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* increased the default browser session timeout to 2min

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Adding device flow idl changes

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* Adding device flow orchestration

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* lint fixes

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* nit

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* fixes

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* refactor and feedback

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* nit

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* test fixes

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* more test fixes

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* feedback

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

Signed-off-by: Prafulla Mahindrakar <prafulla.mahindrakar@gmail.com>

* update buf (#316)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Use grpc client interceptors to properly check for auth requirement (#315)

* Use grpc client interceptors to properly check for auth requirement

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Some refactor and add unit tests

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* lint

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* unit tests

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Attempt a random port

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Listen to localhost only

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* use chain unary interceptor instead

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* only log on errors

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Attempt to disable error check

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Expose newAuthInterceptor to allow other clients to create authenticating clients (#319)

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add CheckpointUri to TaskNodeMetadata (#322)

* Add CheckpointUri to TaskNodeMetadata

Signed-off-by: Andrew Dye <andrewwdye@gmail.com>

* Update swagger-codegen-cli image for arm

Signed-off-by: Andrew Dye <andrewwdye@gmail.com>

Signed-off-by: Andrew Dye <andrewwdye@gmail.com>

* Project level attributes via matchable resource (#320)

* copy pasta

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* generate

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* fix comment

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* ClusterAssignment stores cluster pool for execution placement (#321)

* Cluster Pool execution placement

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Make generate

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* wip

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* make generate using new image

Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>

* make generate again

Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>

* make generate

Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>

* make generate go1.18

Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>

* make generate go1.18.5

Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>

* backward-compatible ClusterAssignment

Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>

* make generate

Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>
Signed-off-by: Iaroslav Ciupin <iaroslav@union.ai>
Co-authored-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Update token source provider to optionally call GetPublicClientConfig (#326)

* Update token source provider

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* GH actions incident

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Make call to auth metadata optional (#327)

* Make call to auth metadata optional

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* debug

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* revert

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* undeprecate

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Add unit tests

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* codecov is not very good

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Adding audience field to device flow token request (#314)

* Add createworkflow failure proto #minor (#331)

* Added GateNode message (#296)

* added GateNode message

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added signal service

Signed-off-by: Daniel Rammer <daniel@union.ai>

* fleshed out Signal service

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated signal service with a GetOrCreateSignal and SetSignal API

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated signal service api to use GetOrCreate semantics

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added the ListSignals API

Signed-off-by: Daniel Rammer <daniel@union.ai>

* fixed SignalListResponse proto name

Signed-off-by: Daniel Rammer <daniel@union.ai>

* set HTTP API parameters

Signed-off-by: Daniel Rammer <daniel@union.ai>

* generated protos

Signed-off-by: Daniel Rammer <daniel@union.ai>

* documented GateNode

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated signal list API

Signed-off-by: Daniel Rammer <daniel@union.ai>

* filled out signal list api

Signed-off-by: Daniel Rammer <daniel@union.ai>

* addressing pr comments on docs

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added an output variable name to the signal condition

Signed-off-by: Daniel Rammer <daniel@union.ai>

* reworded signal condition docs

Signed-off-by: Daniel Rammer <daniel@union.ai>

* added ApproveCondition to GateNode

Signed-off-by: Daniel Rammer <daniel@union.ai>

* removed authOpt

Signed-off-by: Daniel Rammer <daniel@union.ai>

* fixed types

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated doc_gen_deps to fix docs generation

Signed-off-by: Daniel Rammer <daniel@union.ai>

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Generate javascript proto (#336)

* Cache eviction for single execution in datacatalog and flyteadmin (#318)

* Added datacatalog endpoint for updating artifacts
Existing artifacts can have their associated ArtifactData overwritten

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* datacatalog.UpdateArtifact returns ArtifactID

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Added skip_cache override to ExecutionSpec, LaunchPlanSpec and WorkflowExecutionConfig

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Added CatalogCacheStatus for skipped cache lookups

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Added skip_cache flag to ExecutionRelaunchRequest

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Renamed skip_cache flag to overwrite_cache

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

Signed-off-by: Nick Müller <nmueller@blackshark.ai>

* Doc Hub proposal (#303)

* Add description entity

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add id

Signed-off-by: Kevin Su <pingsutw@apache.org>

* wip

Signed-off-by: Kevin Su <pingsutw@apache.org>

* few update

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update service

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update service

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add description entity to task and workflow

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update des entity

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* typo

Signed-off-by: Kevin Su <pingsutw@apache.org>

* address comment

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update idl

Signed-off-by: Kevin Su <pingsutw@apache.org>

* list description entity

Signed-off-by: Kevin Su <pingsutw@apache.org>

* make generate

Signed-off-by: Kevin Su <pingsutw@apache.org>

* make generate

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Update service name

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update endpoint

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update endpoint

Signed-off-by: Kevin Su <pingsutw@apache.org>

* remove create_description_entity endpoint

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add description to task/workflow

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update

Signed-off-by: Kevin Su <pingsutw@apache.org>

* address comments

Signed-off-by: Kevin Su <pingsutw@apache.org>

* address comments

Signed-off-by: Kevin Su <pingsutw@apache.org>

* fix tests

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* fix test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add id.resource_type

Signed-off-by: Kevin Su <pingsutw@apache.org>

* undeclared name: ResourceType

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update wrong code manually

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Fixed tests

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Fixed tests

Signed-off-by: Kevin Su <pingsutw@apache.org>

Signed-off-by: Kevin Su <pingsutw@apache.org>
Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Add a more restrict CreateDownloadLink API (#332)

* Add a more restrict CreateDownloadLink API

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* generate

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* regenerate?

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Add generates_deck to task metadata

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Remove ARTIFACT_TYPE_OUTPUT_METADATA

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* PR Comments

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

Signed-off-by: Haytham Abuelfutuh <haytham@afutuh.com>

* Use buf to generate python stubs (#346)

* Buf python migration

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Generate pyi files

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Add venv to .gitgnore

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Use buf to generate python stubs

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Use buf docker image to generate stubs

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Add stubs produced by call to `buf generate` using buf's docker image

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Add pyi files

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Use buf locally

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Verify that generated protos by using buf

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Copy generated code to a separate artifact

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Move back to go_generate.yml@master

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Fix python package and publish typing information (#347)

* Add __init__.py files to generated stubs

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Publish stubs in the package

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Include __init__.py in verification workflow

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Bump versions of remote plugins

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Metadata tags (#348)

* add tags to metadata

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* make generate

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>

* Comment annotations and doc generation #minor (#350)

* Comment swagger annotations in proto

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Regenerate proto stubs

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* Add Databricks config to Spark config (#351)

* databricks plugin

Signed-off-by: Kevin Su <pingsutw@apache.org>

* update comment

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Use struct instead of string

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add token

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* add instance name

Signed-off-by: Kevin Su <pingsutw@apache.org>

* add instance name

Signed-off-by: Kevin Su <pingsutw@apache.org>

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add inital `dask` plugin IDL (#339)

Signed-off-by: Bernhard Stadlbauer <b.stadlbauer@gmx.net>

* added comments to the catalog reservation API (#355)

Signed-off-by: Daniel Rammer <daniel@union.ai>

Signed-off-by: Daniel Rammer <daniel@union.ai>

* dockerizing buf call (#356)

Signed-off-by: Daniel Rammer <daniel@union.ai>

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Add raw claims to user info response (#357)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>

* Adding configurable audience property for flyte clients (#329)

* Adding configurable audience property for flyte clients

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* changed the const audience to audienceKey

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* fixed unit tests

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* fixed unit test

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* nit

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* feedback

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* refactored unit tests

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* Added UseAudienceFromAdmin property to force pull audience from admin config. Default is false and expects clients to pass it

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* Added test for expected number of calls to the public admin endpoint

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* fixed the tests

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* Added template configuration to task template (#358)

* added template to task template

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated docs

Signed-off-by: Daniel Rammer <daniel@union.ai>

* updated pod_template_name location to TaskMetadata proto message

Signed-off-by: Daniel Rammer <daniel@union.ai>

---------

Signed-off-by: Daniel Rammer <daniel@union.ai>

* bumping go version to 1.19 (#363)

Signed-off-by: Daniel Rammer <daniel@union.ai>

* gen (#359)

Signed-off-by: Katrina Rogan <katroganGH@gmail.com>
Co-authored-by: Katrina Rogan <katrina@Katrinas-MBP.UNION.AI>

* Adding support for structured dataset (#369)

Signed-off-by: pmahindrakar-oss <prafulla.mahindrakar@gmail.com>

* added dynamic_job_spec_uri to dynamic workflow metadata and node execution closure (#360)

Signed-off-by: Daniel Rammer <daniel@union.ai>

* Use TokenCache in ClientCredentialsTokenSourceProvider (#377)

* Init customTokenSource.refreshTime (#381)

Signed-off-by: Andrew Dy…
  • Loading branch information
62 people authored Sep 8, 2023

Verified

This commit was signed with the committer’s verified signature.
gsmet Guillaume Smet
2 parents 1e2ecbe + 55bb4af commit 8970d4c
Showing 1,714 changed files with 1,139,322 additions and 0 deletions.
2 changes: 2 additions & 0 deletions flyteidl/.gitattributes
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
gen/** linguist-generated=true
protos/**/*.rst linguist-generated=true
16 changes: 16 additions & 0 deletions flyteidl/.github/config.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
# Comment to be posted on PRs from first-time contributors in your repository
newPRWelcomeComment: |
Thank you for opening this pull request! 🙌
These tips will help get your PR across the finish line:
- Most of the repos have a PR template; if not, fill it out to the best of your knowledge.
- Sign off your commits (Reference: [DCO Guide](https://github.com/src-d/guide/blob/master/developer-community/fix-DCO.md)).
# Comment to be posted to on pull requests merged by a first time user
firstPRMergeComment: >
Congrats on merging your first pull request! 🎉
# Comment to be posted on first-time issues
newIssueWelcomeComment: >
Thank you for opening your first issue here! 🛠
36 changes: 36 additions & 0 deletions flyteidl/.github/workflows/boilerplate-automation.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
name: Update Boilerplate Automation
on:
workflow_dispatch:

jobs:
update-boilerplate:
name: Update Boilerplate
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v2
with:
fetch-depth: "0"
- name: Update Boilerplate
run: |
make update_boilerplate
- name: Create Pull Request
id: cpr
uses: peter-evans/create-pull-request@v3
with:
token: ${{ secrets.FLYTE_BOT_PAT }}
commit-message: Update Boilerplate
committer: Flyte-Bot <admin@flyte.org>
author: ${{ github.actor }} <${{ github.actor }}@users.noreply.github.com>
signoff: true
branch: flyte-bot-update-boilerplate
delete-branch: true
title: 'Update Boilerplate'
body: |
Update Boilerplate
- Auto-generated by [flyte-bot]
labels: |
boilerplate
team-reviewers: |
owners
maintainers
draft: false
16 changes: 16 additions & 0 deletions flyteidl/.github/workflows/buf_publish.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
name: Publish Buf Package

on:
release:
types: [created]

jobs:
buf:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v2
- uses: bufbuild/buf-setup-action@v1
- uses: bufbuild/buf-push-action@v1
with:
buf_token: ${{ secrets.BUF_TOKEN }}
input: 'protos'
46 changes: 46 additions & 0 deletions flyteidl/.github/workflows/master.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
name: Master

on:
push:
branches:
- master

jobs:
bump-version:
if: github.repository == 'flyteorg/flyteidl'
name: Bump Version
runs-on: ubuntu-latest
outputs:
version: ${{ steps.bump-version.outputs.tag }}
steps:
- uses: actions/checkout@v2
with:
fetch-depth: '0'
- name: Bump version and push tag
id: bump-version
uses: anothrNick/github-tag-action@1.36.0
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
WITH_V: true
DEFAULT_BUMP: patch

goreleaser:
if: github.repository == 'flyteorg/flyteidl'
name: Goreleaser
runs-on: ubuntu-latest
needs: [bump-version]
steps:
- uses: actions/checkout@v2
with:
fetch-depth: "0"
- name: Set up Go
uses: actions/setup-go@v2
with:
go-version: 1.19
- name: Run GoReleaser
uses: goreleaser/goreleaser-action@v2
with:
version: latest
args: release --rm-dist
env:
GITHUB_TOKEN: ${{ secrets.FLYTE_BOT_PAT }}
26 changes: 26 additions & 0 deletions flyteidl/.github/workflows/npmpublish.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,26 @@
name: Publish NPM Package

on:
release:
types: [created]

jobs:
deploy:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v2
# Setup .npmrc file to publish to npm
- uses: actions/setup-node@v1
with:
node-version: "12.x"
registry-url: "https://registry.npmjs.org"
- name: Autobump version
run: |
# from refs/tags/v1.2.3 get 1.2.3
VERSION=$(echo $GITHUB_REF | sed 's#.*/v##')
VERSION=$VERSION make update_npmversion
shell: bash
- run: npm install
- run: npm publish --access=public
env:
NODE_AUTH_TOKEN: ${{ secrets.NPM_TOKEN }}
32 changes: 32 additions & 0 deletions flyteidl/.github/workflows/pythonpublish.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
name: Upload PyPi Package

on:
release:
types: [created]

jobs:
deploy:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v2
- name: Set up Python
uses: actions/setup-python@v1
with:
python-version: "3.x"
- name: Install dependencies
run: |
python -m pip install --upgrade pip
pip install setuptools wheel twine
- name: Autobump version
run: |
# from refs/tags/v1.2.3 get 1.2.3
VERSION=$(echo $GITHUB_REF | sed 's#.*/v##')
VERSION=$VERSION make update_pyversion
shell: bash
- name: Build and publish
env:
TWINE_USERNAME: ${{ secrets.PYPI_USERNAME }}
TWINE_PASSWORD: ${{ secrets.PYPI_PASSWORD }}
run: |
python setup.py sdist bdist_wheel
twine upload dist/*
20 changes: 20 additions & 0 deletions flyteidl/.github/workflows/release-automation.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
name: Invoke Workflow

on:
release:
types: [created]

jobs:
deploy:
runs-on: ubuntu-latest
strategy:
matrix:
COMPONENT: [flyteadmin, flytepropeller, flyteconsole, flytecopilot, flyteplugins, datacatalog, flytectl]
fail-fast: false
steps:
- uses: actions/checkout@v2
- name: Update flyteidl version
run: |
WORKFLOW_ID=$(curl -sS https://api.github.com/repos/flyteorg/${{matrix.COMPONENT}}/actions/workflows | jq '.workflows[] | select(.path == ".github/workflows/upgrade_automation.yml") | {id}' | jq .id)
curl -X POST -H "Accept: application/vnd.github.v3+json" https://api.github.com/repos/flyteorg/${{matrix.COMPONENT}}/actions/workflows/$WORKFLOW_ID/dispatches -H "Authorization: token ${{ secrets.FLYTE_BOT_PAT }}" -d '{"ref":"master", "inputs": {"component": "flyteidl"}}'
shell: bash
Loading

0 comments on commit 8970d4c

Please sign in to comment.