Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Updated Seldon Data Plane #1389

Closed
ukclivecox opened this issue Jan 31, 2020 · 4 comments
Closed

Updated Seldon Data Plane #1389

ukclivecox opened this issue Jan 31, 2020 · 4 comments
Assignees
@ukclivecox
Labels
Roadmap Feature High level roadmap feature for planning
Milestone
1.2

Comments

@ukclivecox
Copy link
Contributor

ukclivecox commented Jan 31, 2020 •
edited
Loading

Update Seldon Data plane for REST and gRPC:

Some things to include:

  • Health
    • Server Ready
    • Server Live
    • Model ready
  • Server Metadata
  • Model Metadata
  • Server metrics

Look at NVIDIA TRTIS data plane to align.

Linked issues:

#1387
#1362
@ukclivecox ukclivecox added the Roadmap Feature High level roadmap feature for planning label Jan 31, 2020
@ukclivecox ukclivecox added this to the 1.2 milestone Jan 31, 2020
@ukclivecox ukclivecox self-assigned this Jan 31, 2020
@lennon310
Copy link
Contributor

Could you elaborate a bit on Status since it is related to error handling in old Java Engine?

@ukclivecox
Copy link
Contributor Author

@lennon310 I have updated the initial description to make more clear the areas to cover. Feel free to add your own requirements in this issue to help with planning.

@gaocegege
Copy link
Contributor

Will we migrate to KFServing community standard inference? TRTIS is planning to migrate to it.

@ukclivecox
Copy link
Contributor Author

Yes - we will fully support it. Will close this to open new ones focused on particular data planes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ukclivecox ukclivecox

Labels
Roadmap Feature High level roadmap feature for planning
Projects
None yet
Milestone
1.2
Development

No branches or pull requests
3 participants
@lennon310 @gaocegege @ukclivecox