[CPU] Deconvolution int8 support (ngraph) #63
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
antonvor
force-pushed
the
feature/deconvolution_int8_support_ngraph
branch
2 times, most recently
from
520d10f to
edfcf24
Compare
dmitry-gorokhov
force-pushed
the
feature/cpu_migration_on_ngraph
branch
from
586fd7a to
7d4fd2f
Compare
* [LPT] ConcatTransformation: fixed naming of outputs after split * [LPT][TESTS] Concat with split tests: added verification of output names
* implement argmin extractors * reconsidering argmax to topk * arg ops refactoring * rename ArgMaxToTopK * added unittests * update docs * move unittest file to new folder * conversations resolving * revert changes with argmax.py, move argmin op to a new file * rename ArgMaxSqueeze * updated BOM file * little fix * code refactoring in ArgMaxOp, updated unittests Co-authored-by: yegor.kruglov <[email protected]>
by making it template.
* Added info on DockerHub CI Framework * Feature/azaytsev/change layout (openvinotoolkit#3295) * Changes according to feedback comments * Replaced @ref's with html links * Fixed links, added a title page for installing from repos and images, fixed formatting issues * Added links * minor fix * Added DL Streamer to the list of components installed by default * Link fixes * Link fixes * ovms doc fix (openvinotoolkit#2988) * added OpenVINO Model Server * ovms doc fixes Co-authored-by: Trawinski, Dariusz <[email protected]> * Updated openvino_docs.xml * Edits to MO Per findings spreadsheet * macOS changes per issue spreadsheet * Fixes from review spreadsheet Mostly IE_DG fixes * Consistency changes * Make doc fixes from last round of review * integrate changes from baychub/master * Update Intro.md * Update Cutting_Model.md * Update Cutting_Model.md * Fixed link to Customize_Model_Optimizer.md Co-authored-by: Trawinski, Dariusz <[email protected]> Co-authored-by: baychub <[email protected]>
* Allow nagative values for batch_dims * Update formula * Update spec according to comments * clarified cases when batch_dims and axis less than zero and enhanced restriction for index types Co-authored-by: Pavel Esir <[email protected]>
…it#5437) * Add sys_platform environment marker * Update sys_platform check * Add unit tests for sys_platform marker * apply review comments * Fix typo * Update checker and tests, apply comments * Update comments parsing and tests * Fix commrnt * Resolve comments and update check logic * Update tests and fix bug with negative tests Co-authored-by: achetver <[email protected]>
* Convert op specification refactoring. * Minor readability improvements. * Fixed 'category' formatting.
* Removed constant DDR_MAX_SIZE = 512. Removed the DDR_MAX_SIZE constant as it could potentially lead to incorrect behavior of devices with a different DDR size (Prism Creek can be up to 2 GB in size). Removed the use of this constant in methods.
…penvinotoolkit#5467) * [LPT] Zero point insertion in case of zero value on FQ output high * [LPT] Change precision in test on the real default precision[0]
* Written MO classes for DFT and IDFT operations. * Added class to read TF (I)FFT operations. * Written extractors for TF operations FFT, FFT2D, FFT3D, IFFT, IFFT2D, IFFT3D. * Written MO Roll operation and TF Roll operation extractor. * Started to write needed transformations. * Written transformation StridedSlices + Complex + Roll + (i)FFTxD + Roll + (Imag, Real) + Pack -> Roll + (I)DFT + Roll. * Written transformation for Complex + ComplexAbs. * Written correction of axes of Roll. * Small fix. * Small fix. * Some fixes. * Some changes. * Now TF Roll is read as TFRoll. Written inserting Transposes before and after (I)DFT. * Small fix. * Written tests for the transformation TFRollToRoll. * Added comments to some transformations. * Deleted redundant import. * Written tests for the transformation TransposeDFT. * Fixes in MO IR Reader to read/write (I)DFT. * Fixes in the list of supported TF layers. * Started to write tests for SSliceComplexRolledFFTPackBlockReplacement transformation. * Written tests for the MO transformation SSliceComplexRolledFFTPackBlockReplacement. * Written tests for the MO transformation ComplexAbs. * Tests for transformations were moved into unit_tests directory. * All extractors for (I)FFTxD are in one file now. * Deleted redundant transformations. * Fixed extractor for TF Roll: now this operation is read as MO Roll. * Added comments to TFFFT operation. * The method insert_transpose of classes TransposeDFT and LayoutChangeForGatherND was moved into the separate function in the file model-optimizer/extensions/middle/InsertLayoutPropagationTransposes.py. * Fixed comment for the transformation TransposeDFT. * Small fix. * Some fixes. * Deleted shape infer function for the operation TFFFT. Sorted imports in complex_abs.py. * Small fixes. * Deleted redundant import. * Fixes in some asserts. * Small fix. * Added names for created nodes in the transformation ComplexAbs. * Added comments to the method canonicalize_axes. * The transformation SSliceComplexRolledFFTPackBlockReplacement was split into the sequence of transformations SSliceComplexRollReplacement -> RollRealImagPackReplacement -> TFFFTToDFT. * Written tests for the transformation SSliceComplexRollReplacement. * Written tests for the transformation RollRealImagPackReplacement. * Written tests for the transformation TFFFTToDFT. * Deleted commented code. * Fixed types of constants in the transformation ComplexAbs. * Written tests for canonicalization of signal_size value. * Deleted 'Replacement' from names of files and classes. * Used comarison of ids, not names. * replace_sub_graph was replaced with find_and_replace_pattern. * Now the transformation RollRealImagPack is executed before running transformation model-optimizer/extensions/front/Pack.py. * The body of the function create_dft_from_tffft is a part of the transformation TFFFTToDFT body now. * Now method correct_roll_axes of classes RollRealImagPack and SSliceComplexRoll is moved to the function in mo/front/tf/graph_utils.py. * Small changes. * Added comment before mark_input_as_in_correct_layout(roll, 2). * Now the functions correct_roll_axes generates sub-graph in the input port 2 of Roll. * Corrected tests for the transformation SSliceComplexRoll. * Corrected tests for the transformation RollRealImagPack. * Deleted commented code. * Some renaming. * Added decomposition of the separate operation ComplexAbs (without Complex before it). * Added comment to the transformation ComplexAbsAfterComplex. * Optimized imports for the transformation TFFFTToDFT. * The transformation SSliceComplexRoll was split into the sequence SSliceComplex -> CorrectRollAxes and disabled. * Written tests for the transformation ComplexAbs. * Written tests for the transformation SSliceComplex. * Written tests for the transformation CorrectRollAxes. * Deleted the transformation SSliceComplexRoll. * Deleted renaming nodes. * Fixed comment. * Small fixes. * Small fix. * The attribute need_correction was renamed as input_rank_changed. * Small fixes. * Deleted commented code. * Now we iterate over all complex_node.out_port(0).get_connection().get_destinations() input ports and mark the corresponding nodes with the marker attribute. * Added the attribute 'in_ports_count' into the class FFTBase. * Tests for the transformation TransposeDFT were rewritten using helper functions. * Now the transformation RollRealImagPack uses existing Roll node instead of creating new one. * Small fixes. * Fix in the documentation. * Written class to read MxNet (I)FFT operations. Written corresponding extractors. * Corrected shape infer function for MXFFT operation. Written transformation to convert MXFFT to (I)DFT. * Fixed shape infer function. * Fixed the conversion MXFFT to (I)DFT. * Written tests for the transformation MXFFTToDFT. * The function correct_roll_axes was replaced with more generic function add_constant_to_negative_values. * Fixes in classes TFFFT, FFTBase, DFT, IDFT, MXFFT. * Added asserts in constructors of operations TFFFT and MXFFT. * Refactored transformation MXFFTToDFT: conversion of DFT and IDFT were moved into separated functions. * Moved some commented code. * Fixed BOM file. * Written function convert_ifft_to_dft. * Started to rewrite tests for MXFFTToDFT transformations, in the case is_inverse=False. * Small fixes. * Fixes in the transformation RollRealImagPack. * Renaming tests class for the transformation SSliceComplex. * Fixes in the function compare_graphs. Now we get all output nodes of op node, and these output nodes are sorted by names. * Fixed tests for the transformation MXFFTToDFT. * Fix in the transformation ThresholdedReluDecomposition: added disconnect for trelu input port. * Fixes in test for the transformation TFSliceToSlice. * Small fix in the transformation ObjectDetectionAPIPreprocessor2Replacement. * Small fix in comment. * Optimized imports. * Used remove_node in the transformation ThresholdedReluDecomposition and remove_nodes_from in the transformation RollRealImagPack, instead of ports disconnection. * Deleted commented code. * Deleted test case test_slice_replacer_begin_with_2_inputs.
…toolkit#5399) * [GNA] Additional PWL segments are added to avoid saturation After design phase for PWL segments has finished, additional segments are added to avoid saturation. This commit also reduces the number of PWL segments created for some layer types. * [GNA] Make PWL unit tests take into account saturation errata
…openvinotoolkit#5541) It is a known internal issue in gtest when holding a shared_ptr to mocked object, which sometimes reports about memory leak It is recommended to use Mock::VerifyAndClearExpectations at the end of each test when mock object is not needed anymore After adding this, issue with incorrect TestThrowOnImport expectations is observed
* Exclude xbyak from install * Added automatically generated InferenceEngineConfig.cmake * Reverted a version back * Fixed issues with target aliases * Make TBB dependency private * Made ie_parallel.cmake self-sufficient * Don't expose ie_paralle.cmake to end users * Fixed compilation with TBB * Fixes for TBB * Fixed vpu_graph_transformer compilation * Fixed tests compilation * Added install of ie_parallel.cmake * Switched ENABLE_ALTERNATIVE_TEMP to OFF. Fixed COMPONENTS for TBB * Fixed file name in install rules * Added find_dependency for TBB in ie_parallel.cmake * WA for cmake bug with PACKAGE_PREFIX_DIR * Fixed no-deprecation to fix speech-library build * Reverted version from 2.1.0 to 2.1 * Revert "Reverted version from 2.1.0 to 2.1" This reverts commit 7cb5d15. * Returned custom version file back * Added InferenceEngineConfig-version.cmake to share as well * Disabled one more GPU test * Added one more WA for CI * WA for CI issue for C API * WIP
…nvolution and pooling (openvinotoolkit#5501)
* Updated list of supported OS for PyPi * merge of Helena branch * 55103: add instructions to install Microsoft* Visual C++ Redistributable Package
This reverts commit ff583ce.
* New flags for GNA trget * Add new flags to configuration * Update utest * Update speech_Sample * Add unit tests * Guard for wrong values * Use gna execution target as consistent device * Apply review
* BatchNormInference specification refactoring * Address review comments * Remove he term Transform from definition * Add title of the paper where this operation is introduced * Add missing backticks * Remove redundant information in attribute epsilon range of values * Refinement of spec Remove more mentions to transformation to avoid confusion * Corrected typos and added changes to improve readability * Use third person to express operation steps
* ConvertLike specification refactoring * Corrected typos and clean up * Changed supported types of Convert to align with ConvertLike
* Fixed attributes saving to keep tensor debug info in Parameter node. * Added comment and unit tests. * Small correction. * Small correction of unit test. * Comment corrected.
* Changed fuse_mul behaviour for proper data node connection. * Corrected the comment. * Corrected the comment. * Added permutation attribute saving. * Added comment. * Added unit tests, comments corrections.
* Revise unsqueeze op spec * Second input value boundaries fix * adjust first input description
antonvor
force-pushed
the
feature/deconvolution_int8_support_ngraph
branch
from
edfcf24 to
e065229
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Tickets:
PR in oneDNN: openvinotoolkit/oneDNN#50
PR with tests: openvinotoolkit#5348
TODO