Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

So pointer can be used without loading #5645

Merged
merged 26 commits into from
May 19, 2021

Conversation

ilya-lavrenov
Copy link
Contributor

Details:

  • Based on So pointer can be used without loading #5643
  • ICore, InferencePlugin return internal executable networks
  • Updated MULTI, HETERO, AUTO to work with internal objects:
    • Updated callbacks as well and removed CurrentException() from plugin API

@ilya-lavrenov ilya-lavrenov added the category: inference OpenVINO Runtime library - Inference label May 15, 2021
@ilya-lavrenov ilya-lavrenov added this to the 2021.4 milestone May 15, 2021
@ilya-lavrenov ilya-lavrenov force-pushed the auto branch 2 times, most recently from 4a6b832 to 83f8c58 Compare May 17, 2021 14:32
@apankratovantonp apankratovantonp self-requested a review May 17, 2021 17:09
@azhogov
Copy link

azhogov commented May 19, 2021

@azhogov azhogov marked this pull request as ready for review May 19, 2021 10:18
@azhogov azhogov requested a review from a team as a code owner May 19, 2021 10:18
@azhogov azhogov requested review from a team May 19, 2021 10:18
@azhogov azhogov merged commit 181ad06 into openvinotoolkit:master May 19, 2021
@ilya-lavrenov ilya-lavrenov changed the title Auto So pointer can be used without loading May 19, 2021
@ilya-lavrenov ilya-lavrenov deleted the auto branch May 19, 2021 11:04
myshevts added a commit to myshevts/openvino that referenced this pull request May 19, 2021
…kit#5645 merged) it is safe to set.

Also test modification to verify that the callback is called on the same (user's) request and e.g. not on the actual device's request
myshevts added a commit to myshevts/openvino that referenced this pull request May 19, 2021
…kit#5645 merged) it is safe to set.

Also test modification to verify that the callback is called on the same (user's) request and e.g. not on the actual device's request
myshevts added a commit to myshevts/openvino that referenced this pull request May 19, 2021
…kit#5645 merged) it is safe to set.

Also test modification to verify that the callback is called on the same (user's) request and e.g. not on the actual device's request
ilya-lavrenov added a commit to ilya-lavrenov/openvino that referenced this pull request May 19, 2021
ilya-lavrenov added a commit that referenced this pull request May 20, 2021
mashoujiang pushed a commit to mashoujiang/openvino that referenced this pull request May 20, 2021
…kit#5645 merged) it is safe to set.

Also test modification to verify that the callback is called on the same (user's) request and e.g. not on the actual device's request
myshevts added a commit that referenced this pull request May 20, 2021
* Async auto-request, now with revamped SetCallback (after #5645 merged) it is safe to set.
Also test modification to verify that the callback is called on the same (user's) request and e.g. not on the actual device's request

* Override CreateInferRequestImpl() instead of CreateInferRequest()

Signed-off-by: Shoujiang Ma <[email protected]>

Co-authored-by: myshevts <[email protected]>
myshevts added a commit to myshevts/openvino that referenced this pull request May 24, 2021
…kit#5645 merged) it is safe to set.

Also test modification to verify that the callback is called on the same (user's) request and e.g. not on the actual device's request
yekruglov pushed a commit to yekruglov/openvino that referenced this pull request Jun 7, 2021
* Added LoadNetwork(filename) to AUTO

* Added more files

* So pointer can be used without loading

* Changed InferencePlugin, ICore to return internal interfaces

* Added SoPointers for InferRequest, ExecutableNetwork

* Fixed Windows

* Fixed KMB

* Fixes for KMB

* Removed dereference operator

* Play with include files

* Fixed compilation with older compilers

* Fixed comments

* Fixed win build

* Try  to fix Windows

* Try  to fix Windows 2

* Fixed windows

* Fixed windows

* Removed SOPointer as a base class

* Reverted back SOPointer split

* Code review

Co-authored-by: apankratovantonp <[email protected]>
yekruglov pushed a commit to yekruglov/openvino that referenced this pull request Jun 7, 2021
yekruglov pushed a commit to yekruglov/openvino that referenced this pull request Jun 7, 2021
* Async auto-request, now with revamped SetCallback (after openvinotoolkit#5645 merged) it is safe to set.
Also test modification to verify that the callback is called on the same (user's) request and e.g. not on the actual device's request

* Override CreateInferRequestImpl() instead of CreateInferRequest()

Signed-off-by: Shoujiang Ma <[email protected]>

Co-authored-by: myshevts <[email protected]>
myshevts added a commit to myshevts/openvino that referenced this pull request Jun 25, 2021
…kit#5645 merged) it is safe to set.

Also test modification to verify that the callback is called on the same (user's) request and e.g. not on the actual device's request
rnugmanx pushed a commit to rnugmanx/openvino that referenced this pull request Aug 26, 2021
* Added LoadNetwork(filename) to AUTO

* Added more files

* So pointer can be used without loading

* Changed InferencePlugin, ICore to return internal interfaces

* Added SoPointers for InferRequest, ExecutableNetwork

* Fixed Windows

* Fixed KMB

* Fixes for KMB

* Removed dereference operator

* Play with include files

* Fixed compilation with older compilers

* Fixed comments

* Fixed win build

* Try  to fix Windows

* Try  to fix Windows 2

* Fixed windows

* Fixed windows

* Removed SOPointer as a base class

* Reverted back SOPointer split

* Code review

Co-authored-by: apankratovantonp <[email protected]>
rnugmanx pushed a commit to rnugmanx/openvino that referenced this pull request Aug 26, 2021
rnugmanx pushed a commit to rnugmanx/openvino that referenced this pull request Aug 26, 2021
* Async auto-request, now with revamped SetCallback (after openvinotoolkit#5645 merged) it is safe to set.
Also test modification to verify that the callback is called on the same (user's) request and e.g. not on the actual device's request

* Override CreateInferRequestImpl() instead of CreateInferRequest()

Signed-off-by: Shoujiang Ma <[email protected]>

Co-authored-by: myshevts <[email protected]>
tadamowicz pushed a commit to tadamowicz/openvino that referenced this pull request Aug 30, 2023
* Added LoadNetwork(filename) to AUTO

* Added more files

* So pointer can be used without loading

* Changed InferencePlugin, ICore to return internal interfaces

* Added SoPointers for InferRequest, ExecutableNetwork

* Fixed Windows

* Fixed KMB

* Fixes for KMB

* Removed dereference operator

* Play with include files

* Fixed compilation with older compilers

* Fixed comments

* Fixed win build

* Try  to fix Windows

* Try  to fix Windows 2

* Fixed windows

* Fixed windows

* Removed SOPointer as a base class

* Reverted back SOPointer split

* Code review

Co-authored-by: apankratovantonp <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: inference OpenVINO Runtime library - Inference
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants