diff --git a/src/plugins/intel_npu/README.md b/src/plugins/intel_npu/README.md index 5fc880314da1a2..b7508c68704e32 100644 --- a/src/plugins/intel_npu/README.md +++ b/src/plugins/intel_npu/README.md @@ -11,7 +11,6 @@ OpenVINO™ toolkit is officially supported and validated on the following platf | Host | NPU device | OS (64-bit) | | :--- | :--- | :--- | -| Raptor Lake (discrete NPU) | NPU 3700 | MS Windows* 11 | | Meteor Lake (integrated NPU) | NPU 3720 | Ubuntu* 22, MS Windows* 11 | | Lunar Lake (integrated NPU) | NPU 4000 | Ubuntu* 22, MS Windows* 11 | @@ -75,7 +74,7 @@ NPU plugin will use the Level Zero (L0) API to execute the precompiled model on ### Device management -There is currently no support for multiple devices (N x discrete + integrated), one single level zero device will be enumerated during level zero backend initialization. Support for multiple devices will be added in future releases. +There is currently no support for multiple devices, which means only one level-zero device will be enumerated during level-zero backend initialization. Support for multiple devices will be added in future releases. ### Inference pipeline @@ -161,17 +160,17 @@ The following properties are supported: | `ov::log::level`/
`LOG_LEVEL` | RW | Sets the log level for NPU Plugin. An environment variable is also made available to expose logs from early initialization phase: OV_NPU_LOG_LEVEL. | `LOG_NONE`/
`LOG_ERROR`/
`LOG_WARNING`/
`LOG_INFO`/
`LOG_DEBUG`/
`LOG_TRACE` | `LOG_NONE` | | `ov::cache_dir`/
`CACHE_DIR` | RW | Folder path to be used by the OpenVINO cache. | `N/A` | empty | | `ov::available_devices`/
`AVAILABLE_DEVICES` | RO | Returns the list of enumerated NPU devices.
NPU plugin does not currently support multiple devices. | `N/A`| `N/A` | -| `ov::device::id`/
`DEVICE_ID` | RW | Device identifier. Empty means auto detection. | empty/
`3700`/
`3720`/
`4000` | empty | +| `ov::device::id`/
`DEVICE_ID` | RW | Device identifier. Empty means auto detection. | empty/
`3720`/
`4000` | empty | | `ov::device::uuid`/
| RO | Returns the Universal Unique ID of the NPU device. | `N/A`| `N/A` | | `ov::device::architecture`/
`DEVICE_ARCHITECTURE` | RO | Returns the platform information. | `N/A`| `N/A` | | `ov::device::full_name`/
`FULL_DEVICE_NAME` | RO | Returns the full name of the NPU device. | `N/A`| `N/A` | | `ov::internal::exclusive_async_requests`/
`EXCLUSIVE_ASYNC_REQUESTS` | RW | Allows to use exclusive task executor for asynchronous infer requests. | `YES`/ `NO`| `NO` | -| `ov::device::type`/
`DEVICE_TYPE` | RO | Returns the type of device, discrete or integrated. | `DISCREETE` /
`INTEGRATED` | `N/A` | +| `ov::device::type`/
`DEVICE_TYPE` | RO | Returns the type of device, discrete or integrated. | `DISCRETE` /
`INTEGRATED` | `N/A` | | `ov::device::gops`/
`DEVICE_GOPS` | RO | Returns the Giga OPS per second count (GFLOPS or GIOPS) for a set of precisions supported by specified device. | `N/A`| `N/A` | | `ov::device::pci_info`/
`DEVICE_PCI_INFO` | RO | Returns the PCI bus information of device. See PCIInfo struct definition for details | `N/A`| `N/A` | -| `ov::intel_npu::device_alloc_mem_size`/
`NPU_DEVICE_ALLOC_MEM_SIZE` | RO | Size of already allocated NPU DDR memory (both for discrete/integrated NPU devices) | `N/A` | `N/A` | -| `ov::intel_npu::device_total_mem_size`/
`NPU_DEVICE_TOTAL_MEM_SIZE` | RO | Size of available NPU DDR memory (both for discrete/integrated NPU devices) | `N/A` | `N/A` | -| `ov::intel_npu::driver_version`/
`NPU_DRIVER_VERSION` | RO | NPU driver version (for both discrete/integrated NPU devices). | `N/A` | `N/A` | +| `ov::intel_npu::device_alloc_mem_size`/
`NPU_DEVICE_ALLOC_MEM_SIZE` | RO | Size of already allocated NPU DDR memory | `N/A` | `N/A` | +| `ov::intel_npu::device_total_mem_size`/
`NPU_DEVICE_TOTAL_MEM_SIZE` | RO | Size of available NPU DDR memory | `N/A` | `N/A` | +| `ov::intel_npu::driver_version`/
`NPU_DRIVER_VERSION` | RO | NPU driver version. | `N/A` | `N/A` | | `ov::intel_npu::compilation_mode_params`/
`NPU_COMPILATION_MODE_PARAMS` | RW | Set various parameters supported by the NPU compiler. (See bellow) | ``| `N/A` | | `ov::intel_npu::turbo`/
`NPU_TURBO` | RW | Set Turbo mode on/off | `YES`/ `NO`| `NO` | | `ov::intel_npu::tiles`/
`NPU_TILES` | RW | Sets the number of npu tiles to compile the model for | `[0-]` | `-1` | @@ -185,10 +184,8 @@ The following table shows the default values for the number of DPU Groups (Tiles | Performance hint | NPU Platform | Number of DPU Groups | Number of DMA Engines | | :--- | :--- | :--- | :--- | -| THROUGHPUT | 3700 | 1 | 1 | | THROUGHPUT | 3720 | 2 (all of them) | 2 (all of them) | | THROUGHPUT | 4000 | 2 (out of 5/6) | 2 (all of them) | -| LATENCY | 3700 | 4 (all of them) | 1 | | LATENCY | 3720 | 2 (all of them) | 2 (all of them) | | LATENCY | 4000 | 4 (out of 5/6) | 2 (all of them) | @@ -199,7 +196,6 @@ The following table shows the optimal number of inference requests returned by t | NPU Platform | Nr. of Inference Requests
THROUGHPUT | Nr. of Inference Requests
LATENCY | | :--- | :--- | :--- | -| 3700 | 8 | 1 | | 3720 | 4 | 1 | | 4000 | 8 | 1 | diff --git a/src/plugins/intel_npu/tests/functional/README.md b/src/plugins/intel_npu/tests/functional/README.md index a749093fee4c75..0341710097d77e 100644 --- a/src/plugins/intel_npu/tests/functional/README.md +++ b/src/plugins/intel_npu/tests/functional/README.md @@ -19,4 +19,4 @@ The following environment variables can be set up for the run of test binary `ov * `IE_NPU_TESTS_IMPORT_REF` - bool type, denotes whether to read reference values from the files matching current test case (instead of calculating them) * `IE_NPU_TESTS_RAW_EXPORT` - bool type, denotes whether to use header for exported network file or not * `IE_NPU_TESTS_LONG_FILE_NAME` - bool type, denotes whether to allow longer file names for the exported artifacts. By default shorter file names are used for all operating systems -* `IE_NPU_TESTS_PLATFORM` - string type, enable compiler config option `NPU_PLATFORM` with value from the environment. Sample value - `NPU3700`. Please refer to the documentation for more information about possible values. +* `IE_NPU_TESTS_PLATFORM` - string type, enable compiler config option `NPU_PLATFORM` with value from the environment. Sample value - `NPU3720`. For more information about possible values, refer to the [NPU plugin README file](./../../../intel_npu/README.md).