Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bring in buf protobufs #1363

Merged
merged 9 commits into from
Dec 8, 2022
Merged

Bring in buf protobufs #1363

merged 9 commits into from
Dec 8, 2022

Conversation

eapolinario
Copy link
Collaborator

@eapolinario eapolinario commented Dec 7, 2022

TL;DR

Use new protobuf stubs generated in flyteidl

Type

  • Bug Fix
  • Feature
  • Plugin

Are all requirements met?

  • Code completed
  • Smoke tested
  • Unit tests added
  • Code documentation added
  • Any pending items have an associated Issue

Complete description

This PR brings in flyteidl 1.3.0, which contains the first version of protobuf stubs generated via buf.

Once this PR is merged we will commence the work to delete all model files under https://github.com/flyteorg/flytekit/tree/master/flytekit/models without the loss of auto-completion and all niceties that those model files bring to the table, while at the same time removing a substantial portion of the code (~20%) of the code.

We also had to single out tensorflow loading code since its stubs are still using the old protobuf library. The tensorflow team documented the issue on their side. From the looks of it, there's someone actively working on the migration.

Tracking Issue

flyteorg/flyte#3139

Follow-up issue

NA
OR
https://github.com/flyteorg/flyte/issues/

wild-endeavor
wild-endeavor previously approved these changes Dec 7, 2022
@codecov
Copy link

codecov bot commented Dec 8, 2022

Codecov Report

Merging #1363 (8c77c57) into master (53cc246) will decrease coverage by 0.01%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##           master    #1363      +/-   ##
==========================================
- Coverage   69.08%   69.07%   -0.02%     
==========================================
  Files         295      295              
  Lines       26928    26931       +3     
  Branches     2531     2532       +1     
==========================================
- Hits        18604    18602       -2     
- Misses       7829     7836       +7     
+ Partials      495      493       -2     
Impacted Files Coverage Δ
flytekit/core/type_engine.py 58.77% <0.00%> (ø)
flytekit/extras/tensorflow/__init__.py 0.00% <0.00%> (ø)
setup.py 0.00% <ø> (ø)
flytekit/extras/tensorflow/record.py 44.82% <0.00%> (-2.30%) ⬇️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@eapolinario eapolinario force-pushed the bring-in-buf-protobufs branch from 6d7eea5 to 8c77c57 Compare December 8, 2022 08:54
@eapolinario eapolinario merged commit 56014d7 into master Dec 8, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants