Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create initial docs for Transformers #229

Closed
ukclivecox opened this issue Sep 24, 2018 · 1 comment
Closed

Create initial docs for Transformers #229

ukclivecox opened this issue Sep 24, 2018 · 1 comment
Assignees
@arnaudvl

Comments

@ukclivecox
Copy link
Contributor

  • Step by step guide for users to create their own transformers
@ukclivecox
Copy link
Contributor Author

Out of date.

agrski pushed a commit that referenced this issue Dec 2, 2022
@sakoush @ukclivecox
v2 control plane grpc + various fixes for scalability (#229)
e3f98cc 
* add transport settings for v2client

* add error codes

* fix httpmock tests

* add model to cache if failed unload

* add error handling for unload model

* tidy up logic

* add test

* lint

* limit http / grpc connections.

* increase http connection timeout

* Tidy up tests

* lint

* fix test

* Update server snapshot creation in scheduler

* read events in go routines

* add v2 control plane protos

* initial v2 grpc impl

* add counter for load / unload models

* add test

* compute counts without models

* add triton control plance to v2 dataplane for now

* protos

* compute memory including loading models

* fix scheduler test

* fix test

* add a note

* create a copy

* cap

* add a mutex around state map management

* do not access map directly in memory store

* return err

* remove sleep

* refactor and fix test

* add v2 grpc test

* add more test cases

* add aggregate infer metrics and test

* fix test and lint

Co-authored-by: Clive Cox <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@arnaudvl arnaudvl

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ukclivecox @arnaudvl