Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Eisw 121295 indices as ids poc backup #24

Closed
Changes from 1 commit
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
e1211f3
Renaming the I/O descriptor structure
razvanapetroaie Apr 25, 2024
74871bb
Using indices for serializing the I/O metadata when the compiler vers…
razvanapetroaie May 1, 2024
74a3764
Reintroducing an additional shape attribute inside the "IODescriptor"
razvanapetroaie May 1, 2024
23710dd
Updating the I/O metadata extraction performed inside the plugin-driv…
razvanapetroaie May 2, 2024
ac73acd
Refactoring the "SyncInferRequest" class
razvanapetroaie May 2, 2024
64ba3cd
Refactoring the Level Zero backend
razvanapetroaie May 2, 2024
aa19290
Adding back support for stateful and dynamic models
razvanapetroaie May 7, 2024
d3612aa
Refactoring the "checkLevelZeroAttributesMatch" function
razvanapetroaie May 8, 2024
64fe760
Fixing the accuracy issues
razvanapetroaie May 8, 2024
3860ffc
Removing a couple of unused functions
razvanapetroaie May 8, 2024
59a019c
Adding more comments
razvanapetroaie May 9, 2024
e3157ea
Constraining the input/output entries inside the dummy OV model const…
razvanapetroaie May 12, 2024
81f52d3
Fixing the batching implementation
razvanapetroaie May 13, 2024
db634de
Fixing the "getBatchSize" function
razvanapetroaie May 13, 2024
7997aa0
Removing some unused code passages
razvanapetroaie May 15, 2024
7b0a66a
Restoring the optional "shapeFromIRModel" due to potential driver bug
razvanapetroaie May 20, 2024
2f59b32
Adding an extra log message in the batching implementation
razvanapetroaie May 20, 2024
5a502be
Adding more comments
razvanapetroaie May 20, 2024
4432a71
Adding a test checking whether models using duplicate node names work…
razvanapetroaie May 27, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fixing the accuracy issues
razvanapetroaie committed May 27, 2024
commit 64fe7608d6ce54f6374da7c45489d6ed16cef178
4 changes: 2 additions & 2 deletions src/plugins/intel_npu/src/backend/src/zero_infer_request.cpp
Original file line number Diff line number Diff line change
@@ -285,14 +285,14 @@ void ZeroInferRequest::get_result() {

std::memcpy(tensorBuffer, copyTensorBuffer, outputTensor->get_byte_size());
}

++outputIndex;
}

for (size_t i = 0; i < _batchSize; i++) {
_pipeline->reset(i);
}
_logger.debug("InferRequest::get_result finished");

++outputIndex;
}

void ZeroInferRequest::check_network_precision(const ov::element::Type_t precision) {