Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cost Optimizations - Queuing Workloads #342

Closed
7 tasks
migueltol22 opened this issue Jun 4, 2020 · 2 comments
Closed
7 tasks

Cost Optimizations - Queuing Workloads #342

migueltol22 opened this issue Jun 4, 2020 · 2 comments
Labels
enhancement New feature or request stale untriaged This issues has not yet been looked at by the Maintainers

Comments

@migueltol22
Copy link
Contributor

Motivation: Why do you think this is important?
Flyte workflows produce a set of compute tasks (both single and multi pod) that run on a set of physical machines. These physical machines are procured at different rates depending on availability at that moment (reserved, on-demand, spot, etc). At any given time a workload may be cheaper or more expensive to run on. Deferring execution at a later time (e.g when reserved instances are freed up) can provide substantial cost savings for any org adopting flyte.

Goal: What should the final outcome look like, ideally?
Reduce costs by running workflows at a later more cost efficient time for workflows in which the user has selected to opt in to the queuing.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Flyte component

  • [x ] Overall
  • Flyte Setup and Installation scripts
  • Flyte Documentation
  • Flyte communication (slack/email etc)
  • [ x] FlytePropeller
  • [ x] FlyteIDL (Flyte specification language)
  • [ x] Flytekit (Python SDK)
  • [ x] FlyteAdmin (Control Plane service)
  • [ x] FlytePlugins
  • DataCatalog
  • FlyteStdlib (common libraries)
  • FlyteConsole (UI)
  • Other

[Optional] Propose: Link/Inline
https://docs.google.com/document/d/1nqAp5-DanklNvG6OeQ3uIacZYGvf0oXioz7CboP_CsU/edit?usp=sharing

Additional context
Add any other context or screenshots about the feature request here.

Is this a blocker for you to adopt Flyte
Please let us know if this makes it impossible to adopt Flyte
@migueltol22 migueltol22 added enhancement New feature or request untriaged This issues has not yet been looked at by the Maintainers labels Jun 4, 2020
This was referenced Jun 4, 2020
Closed
Closed
Closed
@katrogan katrogan mentioned this issue Jun 8, 2020
Open
8 tasks
@migueltol22 migueltol22 mentioned this issue Jun 11, 2020
Closed
11 tasks
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 20, 2022
@cosmicBboy
update dev requirements (flyteorg#342)
b3b34d7 
* update dev requirements

flyteorg/flytesnacks#341 only updated the
docs requirement, which resulted in a docs build issue

https://readthedocs.org/projects/flytecookbook/builds/14327792/

Signed-off-by: cosmicBboy <[email protected]>

* docs build installing deps in ci matches rtd

Signed-off-by: cosmicBboy <[email protected]>
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 20, 2022
@pmahindrakar-oss
Fix flytectl sandbox crash on M1 macs due to json-iterate (flyteorg#342)
0dd0fc1 
Signed-off-by: Prafulla Mahindrakar <[email protected]>

Signed-off-by: Prafulla Mahindrakar <[email protected]>
@github-actions
Copy link

Hello 👋, This issue has been inactive for over 9 months. To help maintain a clean and focused backlog, we'll be marking this issue as stale and will close the issue if we detect no activity in the next 7 days. Thank you for your contribution and understanding! 🙏

@github-actions github-actions bot added the stale label Aug 26, 2023
@github-actions
Copy link

github-actions bot commented Sep 2, 2023

Hello 👋, This issue has been inactive for over 9 months and hasn't received any updates since it was marked as stale. We'll be closing this issue for now, but if you believe this issue is still relevant, please feel free to reopen it. Thank you for your contribution and understanding! 🙏

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Sep 2, 2023
@eapolinario eapolinario reopened this Nov 2, 2023
@kumare3 kumare3 closed this as completed Dec 22, 2023
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Apr 30, 2024
@pmahindrakar-oss
Fix flytectl sandbox crash on M1 macs due to json-iterate (flyteorg#342)
1fe32fa 
Signed-off-by: Prafulla Mahindrakar <[email protected]>

Signed-off-by: Prafulla Mahindrakar <[email protected]>
austin362667 pushed a commit to austin362667/flyte that referenced this issue May 7, 2024
@pmahindrakar-oss @austin362667
Fix flytectl sandbox crash on M1 macs due to json-iterate (flyteorg#342)
117407e 
Signed-off-by: Prafulla Mahindrakar <[email protected]>

Signed-off-by: Prafulla Mahindrakar <[email protected]>
robert-ulbrich-mercedes-benz pushed a commit to robert-ulbrich-mercedes-benz/flyte that referenced this issue Jul 2, 2024
@pmahindrakar-oss @robert-ulbrich-mercedes-benz
Fix flytectl sandbox crash on M1 macs due to json-iterate (flyteorg#342)
5716857 
Signed-off-by: Prafulla Mahindrakar <[email protected]>

Signed-off-by: Prafulla Mahindrakar <[email protected]>
troychiu pushed a commit that referenced this issue Jul 8, 2024
@iaroslav-ciupin
Fix metrics scale division in timer (#342)
ab7117e 
* Fix metrics scale division in timer

Signed-off-by: Iaroslav Ciupin <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request stale untriaged This issues has not yet been looked at by the Maintainers
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@eapolinario @kumare3 @migueltol22