forked from openvinotoolkit/openvino
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[CPU BF16] Bfloat16 inference optimizations (openvinotoolkit#2633)
* [CPU BF16] Greedy mode was added * [IE TESTS][BF16] Added support for operations with bf16 precision in the single layer tests. * Added cpu specific bfloat16 single layer tests for the jit_eltwise primitive. * [CPU TESTS] Activation and logical single layer tests fixes. * [IE TESTS] Fix activation single layer tests run. * [IE TESTS][CPU] CPUTestBase further refactoring. * [CPU BF16] Support for Bfloat16 type was added to the MVN layer. (#3) * [CPU BF16] MVN layer bfloat16 compatibility. * [CPU BF16] MVN bfloat16 minor fixes. * [CPU BF16] MVN node exception about BF16 support replaced with precision redefinition. * [CPU BF16] MVN layer bloat16 support fixed for quantization operations and blocking layout. * [CPU] Input and output precision checks were added to MVN layer. * [IE TESTS][CPU BF16] Most of the bloat16 tests have been fixed. * Bf16 crop layer (#4) * [IE TESTS][CPU] Cpu specific test for the Crop layer has been created. * [IE TESTS][CPU] Deprecated Crop single layer test removed. * [CPU BF16] Bfloat16 precision was added to the Crop layer. * [CPU BF16] Crop layer minor code improvements. * [IE TESTS][CPU] Crop layer test added 2D tensor tests. * [IE TESTS][CPU] Crop layer test, obsolete comment removed. * [IE TESTS][CPU] Fixed CropIE include path. * Crop test fix for older gcc compiler. * [CPU BF16] Reduce layer extended with bfloat16 support. * [IE TESTS][CPU] CPU specific single layer test for Reduce operation. * BF16 optimized layers * [CPU BF16] Bfloat16 custom type added to the MKLDNN plugin. * [CPU BF16] Mem alignment to 16 bytes added to bfloat16 class union. * [IE TESTS][CPU] Permute cpu specific single layer test and minor cpu tests fixes * MVN cpu single layer tests extended with nhwc ndhwc layouts. * Mod mode removed from Eltwise cpu single layer test. * Permute cpu specific single layer test. * Smoke keyword was added to the CPU single layer tests. * Normalize node was modified for BF16 support * [CPU BF16] The RegionYolo layer has been extended with the bfloat16 type support. * Resample node was extended with BF16 * Select layer was enabled with BF16 * psroi supports bf16 (#7) * reorders replaces converts (#9) * BF16 planar pooling was enabled * [CPU BF16] Cpu_convert added to the RegionYOLO node. * [IE TESTS][CPU] Crop single layer test has been rewritten using the StridedSlice operation. * [IE TESTS][CPU] Covert layer test extended with bf16 precision. * [CPU BF16] The bfloat16 class was renamed bfloat16_t and some refactoring has been done. * [CPU BF16] RegionYOLO and Softmax were aligned with the review. * [IE TESTS CPU] CPU single layer tests refactored according to the review suggestions. * [IE TESTS CPU] The Reduce CPU single layer test was extended with different mem orders. * [IE TESTS CPU] Minor fixes after the review. * [IE TESTS CPU] Common plugin configuration has been moved to PreparePluginConfiguration function. * Minor changes after review * StridedSlice, Select, ScaleShift notes were resolved * Fixes to the Reduce operation cpu test and minor fixes related to the review. * GPU eltwise tests fix. * psroi unrolled to the primary state; code clean (#12) * PSROIPooling layer with C++ optimizations * Minor fix for compatibility with CPUTestsBase for fuse_permute_reorder test. * Code clean & psroi rollbacked Co-authored-by: Maksim Kutakov <[email protected]> Co-authored-by: Maksim Kutakov <[email protected]> Co-authored-by: Yury Gaydaychuk <[email protected]>
- Loading branch information
Showing
105 changed files
with
3,129 additions
and
900 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Empty file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.