Skip to content
This repository has been archived by the owner on Oct 23, 2023. It is now read-only.

Add CheckpointUri to TaskNodeMetadata #322

Merged
merged 2 commits into from
Sep 20, 2022

Conversation

andrewwdye
Copy link
Contributor

TL;DR

Add CheckpointUri to TaskNodeMetadata so that we can pass intra-task checkpoint path to recovered node executions. This must be stored in admin because propeller does not have direct access to the output path of a prior execution. It will be sent to propeller as part of NodeExecution.Closure.

Additional changes required to propeller and admin

Type

  • Bug Fix
  • Feature
  • Plugin

Are all requirements met?

  • Code completed
  • Smoke tested
  • Unit tests added
  • Code documentation added
  • Any pending items have an associated Issue

Complete description

How did you fix the bug, make the feature etc. Link to any design docs etc

Tracking Issue

flyteorg/flyte#2254

Follow-up issue

NA

@welcome
Copy link

welcome bot commented Sep 19, 2022

Thank you for opening this pull request! 🙌

These tips will help get your PR across the finish line:

  • Most of the repos have a PR template; if not, fill it out to the best of your knowledge.
  • Sign off your commits (Reference: DCO Guide).

@codecov
Copy link

codecov bot commented Sep 19, 2022

Codecov Report

Merging #322 (e0b882c) into master (88213c5) will not change coverage.
The diff coverage is n/a.

❗ Current head e0b882c differs from pull request most recent head 915cf79. Consider uploading reports for the commit 915cf79 to get more accurate results

@@           Coverage Diff           @@
##           master     #322   +/-   ##
=======================================
  Coverage   75.04%   75.04%           
=======================================
  Files          18       18           
  Lines        1162     1162           
=======================================
  Hits          872      872           
  Misses        237      237           
  Partials       53       53           
Flag Coverage Δ
unittests ?

Flags with carried forward coverage won't be shown. Click here to find out more.

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@andrewwdye andrewwdye force-pushed the node-execution-checkpoints branch from d8f4ba3 to 66304f7 Compare September 19, 2022 22:37
@andrewwdye andrewwdye force-pushed the node-execution-checkpoints branch from e7950e6 to 915cf79 Compare September 20, 2022 15:27
@hamersaw hamersaw merged commit c4ea1f9 into flyteorg:master Sep 20, 2022
@welcome
Copy link

welcome bot commented Sep 20, 2022

Congrats on merging your first pull request! 🎉

eapolinario pushed a commit that referenced this pull request Sep 8, 2023
* Add CheckpointUri to TaskNodeMetadata

Signed-off-by: Andrew Dye <[email protected]>

* Update swagger-codegen-cli image for arm

Signed-off-by: Andrew Dye <[email protected]>

Signed-off-by: Andrew Dye <[email protected]>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants