Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inference with streams #5608

Merged
merged 15 commits into from
May 25, 2021

Conversation

akoryach
Copy link
Contributor

@akoryach akoryach commented May 12, 2021

Details:

  • Created separate test with enabled streams > 1

Tickets:

  • 35634

@akoryach akoryach requested review from nkogteva, asomsiko, just-sparta, vurusovs and a team May 12, 2021 13:01
@just-sparta
Copy link
Contributor

Please add description: ticket (for ex 00000) and details of implementation

@openvino-pushbot openvino-pushbot added the category: IE Tests OpenVINO Test: plugins and common label May 12, 2021
@just-sparta
Copy link
Contributor

Need to check vmsize, vmpeak, vmrssm, vmhwm values for failed ie tests (models ssd300 and vgg16)

@vurusovs vurusovs merged commit 0e86b09 into openvinotoolkit:master May 25, 2021
inferRequest = exeNetwork.CreateInferRequest();
fillBlobs(inferRequest, inputsInfo, batchSize);

inferRequest.Infer();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sstreams imply async execution, so just loop and run'm all with StartAsync, and count arrival (completion) in the callback (or, simpler, wait them in another loop)

AlexeyLebedev1 pushed a commit to AlexeyLebedev1/openvino that referenced this pull request May 27, 2021
yekruglov pushed a commit to yekruglov/openvino that referenced this pull request Jun 7, 2021
rnugmanx pushed a commit to rnugmanx/openvino that referenced this pull request Aug 26, 2021
@akoryach akoryach deleted the inference_with_streams_2 branch October 26, 2021 14:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: IE Tests OpenVINO Test: plugins and common
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants