Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Match flytekit versions used to register and run functional tests #5059

Merged
merged 6 commits into from
Mar 15, 2024

Conversation

eapolinario
Copy link
Contributor

@eapolinario eapolinario commented Mar 14, 2024

Tracking issue

NA

Why are the changes needed?

We should use the same version of flytekit to register and run tests, thereby decreasing the chances of mismatches in expectations of commands used to run the tasks in the tests.

In this specific case, we shipped flyteorg/flytekit#2242 in version 1.12.0b0, which changed the the resolvers used in the registration of map tasks (arraynode-based and legacy). That change is present in the latest flytekit images (ghcr.io/flyteorg/flytekit:py.3.11-latest, etc). That is the same image used in the registration of functional tests in single-binary. The issue happens when we use a different version to register those tests (because the task templates are produced during registration, and those will use the older resolvers for map task).

What changes were proposed in this pull request?

Move to python 3.12 and force the image used during registration to match the same installed version of flytekit.

Also took the opportunity to implement the TODO.

How was this patch tested?

Setup process

Screenshots

Check all the applicable boxes

  • I updated the documentation accordingly.
  • All new and existing tests passed.
  • All commits are signed-off.

Related PRs

Docs link

Signed-off-by: Eduardo Apolinario <[email protected]>
@dosubot dosubot bot added size:XS This PR changes 0-9 lines, ignoring generated files. housekeeping Issues that help maintain flyte and keep it tech-debt free labels Mar 14, 2024
Copy link

codecov bot commented Mar 14, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 59.00%. Comparing base (44914b1) to head (ac1f57e).
Report is 3 commits behind head on master.

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #5059   +/-   ##
=======================================
  Coverage   59.00%   59.00%           
=======================================
  Files         645      645           
  Lines       55578    55578           
=======================================
  Hits        32792    32792           
  Misses      20194    20194           
  Partials     2592     2592           
Flag Coverage Δ
unittests 59.00% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Signed-off-by: Eduardo Apolinario <[email protected]>
Signed-off-by: Eduardo Apolinario <[email protected]>
@eapolinario eapolinario changed the title wip - test Match flytekit versions used to register and run functional tests Mar 14, 2024
Signed-off-by: Eduardo Apolinario <[email protected]>
Signed-off-by: Eduardo Apolinario <[email protected]>
@eapolinario eapolinario enabled auto-merge (squash) March 14, 2024 23:48
@eapolinario eapolinario merged commit 3100c12 into master Mar 15, 2024
48 checks passed
@eapolinario eapolinario deleted the pin-flytekit-to-1.11.0-in-functional-tests branch March 15, 2024 00:01
@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Mar 15, 2024
yubofredwang pushed a commit to yubofredwang/flyte that referenced this pull request Mar 26, 2024
…yteorg#5059)

* wip - test

Signed-off-by: Eduardo Apolinario <[email protected]>

* Use latest flytekit to register tests

Signed-off-by: Eduardo Apolinario <[email protected]>

* Use python 3.12 to run tests

Signed-off-by: Eduardo Apolinario <[email protected]>

* Force versions of flytekit and image to match

Signed-off-by: Eduardo Apolinario <[email protected]>

* Use awk

Signed-off-by: Eduardo Apolinario <[email protected]>

* Checkout specific flytesnacks ref

Signed-off-by: Eduardo Apolinario <[email protected]>

---------

Signed-off-by: Eduardo Apolinario <[email protected]>
Co-authored-by: Eduardo Apolinario <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
housekeeping Issues that help maintain flyte and keep it tech-debt free lgtm This PR has been approved by a maintainer size:XS This PR changes 0-9 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants