Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Infer methods extended #19

Merged
merged 26 commits into from
May 12, 2021
Merged
Changes from 1 commit
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
e700831
Fix callbacks for single Infer Request
Apr 7, 2021
fce8b28
Add jobs argument to InferQueue
Apr 8, 2021
d5b7360
extend blob with a __str__ method
Apr 13, 2021
315fc8a
Added Containers with bindings to custom dicts
Apr 13, 2021
6dd8e16
inject infer methods
Apr 13, 2021
1566e3a
replace InferRequest with wrapper and update infer methods
Apr 14, 2021
7f41127
Update ExectuableNetwork, InferRequest and InferQueue infer methods
Apr 14, 2021
cd7ec50
Add extended Blob casting and fixed numpy to blob method
Apr 14, 2021
2070cae
fixed copy error
Apr 14, 2021
9a27375
Fill Blobs instead of creating them
Apr 14, 2021
4d1a172
Async infer fixes and added InferRequestWrapper to InferQueue
Apr 15, 2021
8d79c2d
Add examples
Apr 15, 2021
e303ca1
Patched getting results and infer calls for ExecutableNetwork and Inf…
Apr 18, 2021
1ae6b23
Draft for queue example with database
Apr 19, 2021
fec6898
adapt examples
Apr 27, 2021
3d53bb0
Add latency
Apr 28, 2021
88fa0c8
add latency property
May 11, 2021
4140814
Add getting status of the next queued request
May 11, 2021
44c7c01
Update benchmark app
May 12, 2021
38a6576
Update benchmark app README
May 12, 2021
bf3f701
Update Benchmark app and InferQueue to solve result_not_ready status
May 12, 2021
9b09155
Getting optimal numbers of requests in InferQueue
May 12, 2021
3395741
Fixed ConstWrapper error
May 12, 2021
224e364
Workaround for new IE API
May 12, 2021
0907c1c
Fix get_optimal_number_of_requests
May 12, 2021
3f70e6e
Add workaround to benchmark nireq
May 12, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Add workaround to benchmark nireq
jiwaszki committed May 12, 2021
commit 3f70e6efa426b8364c3fe48cbbca2e910ab4024e
1 change: 1 addition & 0 deletions tools/benchmark/main.py
Original file line number Diff line number Diff line change
@@ -272,6 +272,7 @@ def set_throughput_streams():
else:
from openvino.inference_engine import InferQueue
infer_requests = InferQueue(network=exe_network, jobs=benchmark.nireq)
benchmark.nireq = len(infer_requests)
else:
infer_requests = exe_network.requests