Skip to content
This repository has been archived by the owner on Oct 9, 2023. It is now read-only.

Fixing pod plugin event reporting timestamps #307

Merged
merged 9 commits into from
Mar 23, 2023

Conversation

hamersaw
Copy link
Contributor

@hamersaw hamersaw commented Jan 9, 2023

TL;DR

Currently the pod plugin timestamps to detect when a pod started and finished are never hit. This means that when reporting these timestamps, Flyte uses the current time (ie. when Flyte checks the pod status) and consequently these are inaccurate. In this PR we attempt to use the timestamps from the container to ensure accurate reporting.

Type

  • Bug Fix
  • Feature
  • Plugin

Are all requirements met?

  • Code completed
  • Smoke tested
  • Unit tests added
  • Code documentation added
  • Any pending items have an associated Issue

Complete description

^^^

Tracking Issue

flyteorg/flyte#3272

Follow-up issue

NA

@codecov
Copy link

codecov bot commented Jan 9, 2023

Codecov Report

Merging #307 (cefcf9e) into master (f0db511) will increase coverage by 1.22%.
The diff coverage is 18.18%.

❗ Current head cefcf9e differs from pull request most recent head f5ff949. Consider uploading reports for the commit f5ff949 to get more accurate results

@@            Coverage Diff             @@
##           master     #307      +/-   ##
==========================================
+ Coverage   62.83%   64.06%   +1.22%     
==========================================
  Files         146      146              
  Lines       12171     9884    -2287     
==========================================
- Hits         7648     6332    -1316     
+ Misses       3946     2974     -972     
- Partials      577      578       +1     
Flag Coverage Δ
unittests ?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
go/tasks/pluginmachinery/core/phase.go 24.05% <ø> (-1.54%) ⬇️
go/tasks/pluginmachinery/flytek8s/pod_helper.go 69.81% <0.00%> (-4.49%) ⬇️
go/tasks/plugins/k8s/ray/config.go 50.00% <ø> (ø)
go/tasks/plugins/k8s/ray/ray.go 77.01% <0.00%> (-3.45%) ⬇️
go/tasks/plugins/k8s/pod/plugin.go 82.35% <100.00%> (+1.96%) ⬆️

... and 126 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@hamersaw hamersaw marked this pull request as ready for review February 28, 2023 14:52
eapolinario
eapolinario previously approved these changes Mar 9, 2023
Signed-off-by: Daniel Rammer <[email protected]>
@hamersaw hamersaw merged commit 60d345d into master Mar 23, 2023
@hamersaw hamersaw deleted the feature/performance-observability branch March 23, 2023 13:45
eapolinario pushed a commit that referenced this pull request Sep 6, 2023
* corrected timestamps for pod plugin

Signed-off-by: Dan Rammer <[email protected]>

* but actually this time

Signed-off-by: Dan Rammer <[email protected]>

* added reported at support

Signed-off-by: Daniel Rammer <[email protected]>

* fixed merge

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl

Signed-off-by: Daniel Rammer <[email protected]>

* updated flyteidl deps

Signed-off-by: Daniel Rammer <[email protected]>

---------

Signed-off-by: Dan Rammer <[email protected]>
Signed-off-by: Daniel Rammer <[email protected]>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants