Skip to content
This repository has been archived by the owner on Sep 13, 2023. It is now read-only.

Sagemaker deployments #366

Merged
merged 14 commits into from
Aug 29, 2022
Merged

Conversation

mike0sv
Copy link
Contributor

@mike0sv mike0sv commented Jul 30, 2022

No description provided.

@mike0sv mike0sv self-assigned this Jul 30, 2022
@mike0sv mike0sv requested a review from a team July 30, 2022 09:13
@mike0sv mike0sv temporarily deployed to internal July 30, 2022 09:13 Inactive
@mike0sv mike0sv temporarily deployed to internal August 7, 2022 10:09 Inactive
@mike0sv mike0sv temporarily deployed to internal August 7, 2022 11:59 Inactive
@mike0sv mike0sv temporarily deployed to internal August 8, 2022 07:09 Inactive
@mike0sv mike0sv temporarily deployed to internal August 23, 2022 16:54 Inactive
@mike0sv mike0sv temporarily deployed to internal August 23, 2022 17:36 Inactive
# Conflicts:
#	mlem/contrib/docker/base.py
@mike0sv mike0sv temporarily deployed to internal August 23, 2022 18:10 Inactive
@mike0sv mike0sv temporarily deployed to internal August 23, 2022 19:44 Inactive
@mike0sv mike0sv temporarily deployed to internal August 23, 2022 20:53 Inactive
@mike0sv mike0sv temporarily deployed to internal August 24, 2022 12:00 Inactive
@codecov
Copy link

codecov bot commented Aug 24, 2022

Codecov Report

❗ No coverage uploaded for pull request base (feature/new-state@8f4fe8b). Click here to learn what that means.
The diff coverage is n/a.

@@                 Coverage Diff                  @@
##             feature/new-state     #366   +/-   ##
====================================================
  Coverage                     ?   87.03%           
====================================================
  Files                        ?       86           
  Lines                        ?     6973           
  Branches                     ?        0           
====================================================
  Hits                         ?     6069           
  Misses                       ?      904           
  Partials                     ?        0           

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@mike0sv mike0sv temporarily deployed to internal August 24, 2022 14:47 Inactive
@mike0sv mike0sv temporarily deployed to internal August 24, 2022 15:24 Inactive
@mike0sv mike0sv temporarily deployed to internal August 25, 2022 11:38 Inactive
@mike0sv mike0sv temporarily deployed to internal August 25, 2022 12:12 Inactive
@mike0sv mike0sv temporarily deployed to internal August 25, 2022 15:36 Inactive
@mike0sv mike0sv temporarily deployed to internal August 25, 2022 18:40 Inactive
@mike0sv mike0sv temporarily deployed to internal August 26, 2022 12:59 Inactive
@mike0sv mike0sv temporarily deployed to internal August 29, 2022 09:58 Inactive
@mike0sv mike0sv merged commit 6f466bb into feature/new-state Aug 29, 2022
@mike0sv mike0sv deleted the feature/new-state-sagemaker branch August 29, 2022 13:30
mike0sv added a commit that referenced this pull request Sep 14, 2022
* new state POC

* update docker and mock deployments

* add locks

* simplify deployment meta (by complexifying code)

* fix tests

* fix tests

* fix tests

* fix win tests

* default env and server

* fsspec manager as default

* Sagemaker deployments (#366)

* WIP

* its alive (kinda)

* it works but it's ugly

* little less ugly

* lil fix

* fix lint

* fix lint

* fix tests

* fix tests

* fix windows bugs

* fix tests

* fix tests

* fix for dirs deployment state

* create MlemSource to choose how mlem is added to docker

* test that all configs in entrypoints

* better cli val error

* better docker package install

* finish merge

* fix short tests

* fix short tests

* Update mlem/contrib/sagemaker/runtime.py

Co-authored-by: Alexander Guschin <[email protected]>

* Update mlem/core/objects.py

Co-authored-by: Alexander Guschin <[email protected]>

* Update mlem/core/objects.py

Co-authored-by: Alexander Guschin <[email protected]>

* Update mlem/contrib/docker/base.py

Co-authored-by: Alexander Guschin <[email protected]>

* Update mlem/contrib/docker/base.py

Co-authored-by: Alexander Guschin <[email protected]>

* Update mlem/contrib/docker/base.py

Co-authored-by: Alexander Guschin <[email protected]>

* Update mlem/contrib/heroku/meta.py

Co-authored-by: Alexander Guschin <[email protected]>

* Apply suggestions from code review

Co-authored-by: Alexander Guschin <[email protected]>

* Update mlem/contrib/sagemaker/build.py

Co-authored-by: Alexander Guschin <[email protected]>

Co-authored-by: Alexander Guschin <[email protected]>
madhur-tandon pushed a commit that referenced this pull request Sep 14, 2022
* WIP

* its alive (kinda)

* it works but it's ugly

* little less ugly

* lil fix

* fix lint

* fix lint

* fix tests

* fix tests

* fix windows bugs

* fix tests

* fix tests
mike0sv added a commit that referenced this pull request Sep 15, 2022
* fix tests

* Sagemaker deployments (#366)

* WIP

* its alive (kinda)

* it works but it's ugly

* little less ugly

* lil fix

* fix lint

* fix lint

* fix tests

* fix tests

* fix windows bugs

* fix tests

* fix tests

* test that all configs in entrypoints

* fix short tests

* wip kubernetes support

* use APIs to deploy and get status, deletion still pending

* remove get client from state

* fix param

* fix jinja template

* working remove and status

* fix client

* small fixes

* attempt to add tests

* setup github actions for k8s tests

* fix linter

* use predict method of client

* allow registry to be configurable by cli

* change calculation of host and port according to service type

* re-enable k8s test as new workflow

* fix daemon access in tests

* make linter happy

* fix fixtures

* suggested fixes and refactor

* make namespace as a separate field and use enums

* use watcher to figure out when resources are deleted

* check minikube status before loading kubeconfig in fixture

* minor suggestions

* use enums for comparisons as well

* create abstract class for services for host and port info

* raise error when service of type clusterIP

* fix build and use tag as model hash

* fix echo message

* hot swapping of docker image deployed

* remove unnecessary f-string

* skip swapping when same hash is tried to be deployed again

* suggested improvements

* fix lint

* fix pylint

* suggested improvements

* fix pylint

* update entrypoints

* add docstrings for K8sYamlBuildArgs

* add docstrings for k8s service type classes

* capitalize docstrings for fields

* remove service type enum

* Remove new workflow for K8s

* remove duplicate methods

* remove version from iterative-telemetry

Co-authored-by: mike0sv <[email protected]>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
No open projects
Status: Done
Development

Successfully merging this pull request may close these issues.

1 participant