Add model_name when chaining requests

[adriangonz]

What this PR does / why we need it:

• Ensure that model_name is updated when chaining requests across a model graph.
• Ensure that model_name is present on the first request (i.e. so that it's not necessary that the user sends it on the initial request to the graph).
• Add integration tests around inference graphs in the V2 protocol (for both REST and gRPC).

Which issue(s) this PR fixes:

Fixes #3792

Special notes for your reviewer:

Does this PR introduce a user-facing change?:

NONE

[adriangonz]

/test integration

[seldondev]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
To complete the pull request process, please assign adriangonz
You can assign the PR to them by writing /assign @adriangonz in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[adriangonz]

/test integration

[sakoush]

you mentioned that there is a model version as well possibly, but I dont see how is that handled in what you have done so far.

Another point, do we have also model_name and model_version in REST payload? if not how are we handling then this case? in other words are we going to suffer from the same issue in REST?

[sakoush]

you mentioned a version that we need to handle in the PR description, where is that handled?

[adriangonz]

Apologies, missed this comment.

Mmmh not sure what you mean. Was this on the PR description? Could you point out where?

[adriangonz]

The failed integration tests seem to be known flaky ones,

• TestRollingHttp.test_rolling_update10[ambas]
• TestRollingHttp.test_rolling_update5[ambas]
• test_label_update[1.5.0]

So this PR should be OK to go ahead 👍

[adriangonz]

/test integration

[adriangonz]

/test integration

[adriangonz]

/retest

[adriangonz]

/test integration

[adriangonz]

/test integration

[adriangonz]

/test integration

[seldondev]

@adriangonz: The following test failed, say /retest to rerun them all:

Test name	Commit	Details	Rerun command
integration	211597f	link	/test integration

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the jenkins-x/lighthouse repository. I understand the commands that are listed here.

[adriangonz]

It seems that the failed integration tests are known flaky ones unrelated to the changes on this PR, so I think it should be good to go:

• TestRollingHttp.test_rolling_update10[ambas]
• TestRollingHttp.test_rolling_update5[ambas]
• test_label_update[1.5.0]
• test_namespace_update[1.7.0]

[adriangonz]

Hey @sakoush ,

Apologies, just noticed your review comment now.

Not sure what you mean about the model version. Could you point out where was that mentioned?

When using REST, the model name and version are part of the endpoint, so not required to be on the payload as well. This is only required for gRPC, as per the V2 Protocol spec.

[sakoush]

Ok thanks for clarification