Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CoreImpl small refactoring #16145

Merged
merged 10 commits into from
Mar 8, 2023

Conversation

ilya-lavrenov
Copy link
Contributor

Details:

  • item1
  • ...

Tickets:

  • ticket-id

@ilya-lavrenov ilya-lavrenov added the category: inference OpenVINO Runtime library - Inference label Mar 7, 2023
@ilya-lavrenov ilya-lavrenov added this to the 2023.0 milestone Mar 7, 2023
@ilya-lavrenov ilya-lavrenov requested review from a team as code owners March 7, 2023 18:34
@ilya-lavrenov ilya-lavrenov requested review from a team as code owners March 7, 2023 18:34
@github-actions github-actions bot added category: CPU OpenVINO CPU plugin category: HETERO OpenVINO HETERO plugin labels Mar 7, 2023
@ilya-lavrenov ilya-lavrenov removed request for a team March 7, 2023 19:18
// coreConfig.set_and_update(config);
// once GPU remove support of ov::cache_dir
// CoreConfg::set_and_update will drop CACHE_DIR from config map
// and updates core config with new ov::cache_dir
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I supposed that ov::cache_dir will be removed from all plugin and only exist on ov::core level, it is reasonable.
If so, we also need PR to remove ov::cache_dir from meta plugin(AUTO/BATCH/HETERO)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good point that meta plugins support cache_dir to transfer it to underlying HW plugins.
Need to think how to simplify this handling.

In general, our goal is to avoid handling of core properties by META plugins to simplify them.

@ilya-lavrenov ilya-lavrenov requested review from a team as code owners March 8, 2023 08:00
@github-actions github-actions bot added category: AUTO OpenVINO AUTO device selection plugin category: TEMPLATE OpenVINO Template plugin labels Mar 8, 2023
@@ -97,5 +97,5 @@ void ov::ICompiledModel::loaded_from_cache() {
wrapper->get_executable_network()->loadedFromCache();
return;
}
OPENVINO_NOT_IMPLEMENTED;
// OPENVINO_NOT_IMPLEMENTED;
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ilyachur please, fix this separately

src/inference/src/dev/core_impl.cpp Show resolved Hide resolved
// here we can store values like GPU.0, GPU.1 and we need to set properties to plugin
// for each such .0, .1, .# device to make sure plugin can handle different settings for different
// device IDs
for (auto pluginDesc : pluginRegistry) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
for (auto pluginDesc : pluginRegistry) {
for (auto&& pluginDesc : pluginRegistry) {

@ilya-lavrenov ilya-lavrenov merged commit c3b22af into openvinotoolkit:master Mar 8, 2023
@ilya-lavrenov ilya-lavrenov deleted the core-refactoring branch March 8, 2023 15:19
andrei-cv pushed a commit to andrei-cv/openvino that referenced this pull request Mar 21, 2023
* Small CoreImpl refactoring

* Removed cache_dirhandling from CPU plugin

* clang-format

* Fixed python tests

* Fix

* Fixed bugs in HETERO case

* Fixed clang-format and warnings in auto plugin

* Added import_export as capability for TEMPLATE plugin

* Commented throw exception from loaded_from_cache

* Fixed clang-formatof ro template plugin
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: AUTO OpenVINO AUTO device selection plugin category: CPU OpenVINO CPU plugin category: HETERO OpenVINO HETERO plugin category: inference OpenVINO Runtime library - Inference category: TEMPLATE OpenVINO Template plugin
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants