Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update forked branch #5

Merged
merged 118 commits into from
Feb 15, 2021
Merged

Update forked branch #5

merged 118 commits into from
Feb 15, 2021

Conversation

evolosen
Copy link
Owner

No description provided.

mvafin and others added 30 commits February 5, 2021 14:26
* Extend LayerNorm pattern to support onnx bert

* Fix test

* Fix test
fix internal issue #41229
fix syntax issues
* Update install_openvino_dependencies.sh

Added python packages for CentOS 7

* Update install_openvino_dependencies.sh
* GitHub CI: Add nGraph ONNX check

* Fix job name

* Fix commands

* Enable nGraph Docker

* Fix

* Fix

* Fix

* Remove Actions

* Decrease a number of workers for executing models tests

* Enable "Docker run tests"

* Unset parallel execution

* Add cloning models

* Update model_zoo_preprocess.sh cmd

* Fix model_zoo_preprocess.sh cmd

* Add share

* ls -alR /mnt/onnxtestdata

* Change path

* move clone models

* Update script

* Add wget

* Update

* Update to master

* Update

* Update

* clone into tmp

* Enable clone

* Fix

* Use model_zoo_preprocess

* Add copy to share

* Enable tests

* Get MSFT

* Run tests

* Try 16 cores

* rub tests

* list models

* run tests

* Run tests, no --model_zoo_xfail

* Run tests, -n 8

* Run tests, -n 1

* Run tests, -n 4

* Run tests, -n 2

* Run with -n 1

* Update info

* First try to run onnx ci:
 * disable MSFT models for first try,
 * try to align onnx_models

* Enable steps

* Update cmake

* Add destination for cmake build

* Try to fix cmake build

* set ninja and instal dependencies

* Revert changes from Blaczkowski, Rafal

* Add swapfile 15 GB, run on AMD CPU 16 cores, 64 GB RAM

* Enable model_zoo_preprocess.sh

* Add reference-if-able

* Update

* test_zoo_models.py -n 8

* Fix clone

* Set LIN_VMSS_VENV_EPHEMERAL_WU2, F8s_v2

* git clone --single-branch

* test_zoo_models.py -n 6, D16as_v4

* -n 4

* clean

* -n 2

* -n 4, swap 48 GB

* E16ds_v4 (16-128), -n 8

* -n 8

* Set LIN_VMSS_VENV_ONNX_WU2

* -n 4

* del -n 16 for ut

Co-authored-by: rblaczko <[email protected]>
* EPHEMERAL_WU2, F8s_v2

* D16ds_v4

* Set LIN_VMSS_VENV_F16S_WU2
* Refactored infer function and function supported_attrs for the layer Interpolate.

* Small change.

* Deleted unneeded checks in transformations ResizeToInterpolate2D and ResizeToInterpolate3D.

* Small fix in the extractor of ONNX Resize.

* Now the extractor of TF ResizeBilinear generates Interpolate-1 again, because 'axis' in final version of Interpolate-4 specification is an input but is not attribute.

* Now the extractor of TF ResizeNearest generates Interpolate-1 again, because 'axis' in final version of Interpolate-4 specification is an input but is not attribute.

* Added static method get_axis into class Interpolate.

* Refactored class CanBeFused in the transformation InterpolateSequenceToInterpolate.

* Fixed transformation InterpolateSequenceToInterpolate according to the last version of the specification of Interpolate-4.

* Started to write support of Interpolate-4 in the transformation InterpolateWithConcat.

* Added support for Interpolate-4 into the transformation InterpolateWithConcat.

* Added support for Interpolate-4 into the transformation InterpolateConcat.

* Added support for Interpolate-4 into the transformation InterpolateReshapeWA.

* Added support for Interpolate-4 into the transformation InterpolateTranspose.

* Started to add test for opset4 case of the transformation InterpolateSequenceToInterpolate.

* Added test for InterpolateSequenceToInterpolate (test_2d_interpolate_sequence_1_opset4_case).

* Added test for InterpolateSequenceToInterpolate (test_2d_interpolate_sequence_4_opset4_case).

* Added another test for InterpolateSequenceToInterpolate (test_2d_interpolate_sequence_5_opset4_case).

* Added another test for InterpolateSequenceToInterpolate (test_3d_interpolate_sequence_1_opset4_case).

* Finished addition of tests for opset4 case of InterpolateSequenceToInterpolate.

* Small change.

* Now opset is only opset1 or opset4 in the transformation InterpolateTranspose.

* Small fixes in transformations ResizeToInterpolate2D and ResizeToInterpolate3D.

* Deleted reading of unused ONNX attributes.

* Fixed docstring of the transformation InterpolateV1ToInterpolateV4.

* Added node name in assert about axes input.

* Fixes in the definition of the operation ONNXResize11.

* Now Interpolate-4 cannot have 'extension' as opset.

* Now the transformation InterpolateV1ToInterpolateV4 uses find_and_replace_pattern but not replace_sub_graph.

* Fixed tests for transformations InterpolateReshapeWA and InterpolateConcat.

* Fixed some tests.

* Rewritten operation Interpolate-4 class according to new variant of documentation.

* Some fixes in ONNXResize11 operation class.

* Now the transformation ONNXResize11ToInterpolate generates Interpolate-4 with 4 inputs.

* Now the transformation UpsampleToResample generates Interpolate-4 with 4 inputs.

* Now the transformation NearestNeighborUpsampling generates Interpolate-4 with 4 inputs.

* Now transformations ResizeToInterpolate2D and ResizeToInterpolate3D generate Interpolate-4 with 4 inputs.

* Now the transformation SplitConcatPairToInterpolate generates Interpolate-4 with 4 inputs.

* Now the transformation UnsqueezeTileReshapeBlockToInterpolate generates Interpolate-4 with 4 inputs.

* Now the transformation InterpolateV1ToInterpolateV4 generates Interpolate-4 with 4 inputs.

* Some fixes.

* Fixed the transformation InterpolateSequenceToInterpolate according to new variant of Interpolate-4 specification.

* Fixed typos.

* Added shape_calculation_mode to supported_attrs.

* Small fixes.

* Added operation ONNXResize10 and the transformation ONNXResize10ToInterpolate4.

* Fixed function correct_scales_using_dst_shape.

* Some fixes in InterpolateSequenceToInterpolate.

* Fixed bug in the method __call__ of the class CanBeFused: now self.accumulated_axes is correctly cleared in all cases.

* Small change.

* Fixed tests for the transformation SplitConcatPairToInterpolate.

* Now transformations InterpolateWithConcat, InterpolateReshapeWA, InterpolateConcat support Interpolate-4.

* Fixed the transformation InterpolateTranspose for the case of Interpolate-4.

* Written the back transformation InterpolateV4AxesCorrection to convert 'axes' input of Interpolate-4 from NHWC to NCHW layout.

* Added PermuteInput in Interpolate-4 infer.

* Fixed typos.

* Deleted the transformation InterpolateAxesCorrection.

* Now Interpolate-4 permutes axis, not shape in input port 3.

* Small fix.

* Some fix.

* Fixed bug in the transformation UpsampleToResample.

* Added some debug prints.

* Added more debug prints.

* Now ONNX Upsample-9 operation is read as ONNXResize10.

* Small fix.

* Small fixes.

* Fixed tests for the transformation SplitConcatPairToInterpolate.

* Deleted debug prints.

* Deleted some debug prints.

* Fixes in the transformation UnsqueezeTileReshapeBlockToInterpolate and its tests.

* Small fix in the transformation InterpolateSequenceToInterpolate.

* Started to write nGraph transformation to convert Interpolate-1 to Interpolate-4.

* Deleted redundant files.

* Small fixes.

* Small fix.

* Written draft of the transformation Interpolate-1 -> Interpolate-4.

* Small fix.

* Now ONNX Importer reads Resize-10 as Interpolate-4.

* Fixes in the test onnx_model_resize10_import_only.

* Small fix in the test for the conversion Interpolate-1 -> Interpolate-4.

* Small fixes.

* Fixed NGraphReaderTests for Interpolate.

* Some fixes.

* Deleted class for Resample operation.

* Fix in the transformation NearestNeighborUpsampling: fixed precision of the input 'scales' of generated Interpolate-4.

* Fixed typo.

* Now the TF operations ResizeBilinear is readed as internal MO operation TFResizeBilinear. This internal operation is converted into Interpolate-4.

* Small fix in BOM-file.

* Added checks of existence of attributes of TF  ResizeBilinear operation.

* Small fixes in the conversion of the internal MO operation  TFResizeBilinear to Interpolate-4.

* Small fixes.

* Small fixes.

* Now the transformation ONNXResize10ToInterpolateV4 calculates sizes input as input_shape * (scales + epsilon).

* Added the internal MO operation TFResizeNearestNeighbor.

* Fixes in the transformation SplitConcatPairToInterpolate and its tests.

* Fixes in the transformation UnsqueezeTileReshapeBlockToInterpolate and its tests.

* Written the transformation that converts the internal operation TFResizeNearestNeighbor into Interpolate-4.

* Now MO reads the TF operation ResizeNearestNeighbor as the internal MO operation TFResizeNearestNeighbor.

* Small fix.

* Now the specification of Interpolate-4 clarifies that the mode linear_onnx supports only 2D or 4D input tensors.

* Small fix.

* Some fixes.

* Moved the transformation ONNXResize10ToInterpolateV4 to the front stage.

* Deleted infer function and function supported_attrs for ONNXResize10 operation.

* Deleted supported_attrs() for TFResizeBilinear and TFResizeNearestNeighbor.

* Some fixes.

* Fixes in the shape infer function of the nGraph operation Interpolate-4. Now 'axes' input can be non-constant.  In the such case, all elements of the output shape are Dimension::dynamic().

* Deleted corner cases processing in transformations TFResizeBilinearToInterpolateV4 and TFResizeNearestNeighborToInterpolateV4.

* Rewritten the function replace_resize_bilinear.

* Written inner MO operation TFResize that covers TF operations ResizeBilinear and ResizeNearestNeighbor.

* Now TF operations ResizeBilinear and ResizeNearestNeighbor are read as an internal operation TFResize in MO. Transformations TFResizeNearestNeighborToInterpolateV4 and TFResizeBilinearToInterpolateV4 are fused into one transformation TFResizeToInterpolateV4.

* Some changes in the shape infer function of nGraph op Interpolate-4.

* Small fix.

* Some changes.

* The transformation TFResizeToInterpolateV4 is moved to the front stage.

* Deleted redundant assert.

* Deleted transformations ResizeToInterpolate2D and ResizeToInterpolate3D.

* Some renaming.

* Small change.

* Deleted .copy() in the shape infer function of the internal operation TFResize.

* Small fix.

* Small fixes.

* Added comment about the case when the input 'axes' of Interpolate-4 is non-constant.

* Written test for Interpolate-4 shape infer, for the case when the input 'axes' is non-constant and shape_calculation_mode = scales.

* Some fixes.

* Small fixes.

* Small fix.

* Added yet another test for the case of non-constant 'axes' input of Interpolate-4 (when shape_calculation_mode = sizes).

* Added some comment.

* Small fix.

* Reverted changes for InterpolateWithConcat.

* Added type checks for all inputs of nGraph operation Interpolate-4.

* Added u32 and u64 to supported element types of sizes and axes inputs of nGraph operation Interpolate-4.

* Fixed some functional tests.

* Some changes.

* Added helper function float32_array.

* Now the MO transformation InterpolateV1ToInterpolate preserves names of layers.

* Small fix.

* Small fix.

* Reverted some change.

* Small fixes.

* Small fix.

* Small fix.

* Small fix.

* Small fix.

* Reverted changes in the nGraph reader tests for Interpolate-1.

* Some revert.

* Fixed some copyright year.
* Update spec

* Update outputs section

* Update rounding_type section

* Update spec

* Update input section

* add newline

* fix one xml example

* fix indentation

* Update detailed description

* Update detailed description

* Update spec

* Change reference name

* add new line

* Update spec

* fix typo

* fix style

* fix example 5 description

* Update spec

* Add Types section

* Refactor xml examples

* Update xml examples and add bfloat16 to supported types

* Update supported types
* Added attributes save modes

* Added tensor names to IR

* Reformat code

* Unit tests and code refactoring

* Fixed error

* Code refactoring

* Code refactoring

* Code refactoring

* Error fixed

* Error fixed

* Bug fixed

* Bug fixed

* Additional unit tests and comments

* Added dest mode in Fuse Mul
* Update install_prerequisites.bat

Removed warning language to show that you can optionally install protobuf to speed up model conversion. It should not be a warning.

* Update install_prerequisites.bat
* Reference implementation for Proposal, enable CPU SLT

* code style fix

* add type prop test for invalid anchor count

* add unit test

* fix shapes in attribute test

* temp workaround- disable maring end of boxes list

* Disable CPU smoke test- spec misalignment

* code style fixes

* add some details to the specification

* disable myriadx proposal slt

* review changes, using usigned int and size_t

* improve proposal op shape inference to cover dynamic too, add unit test coverage

* remove unused variable in test body

* remove batch size in tests where its not used

* add post nms topn initialization in tests where it was missing

* review comments

* style fix

* style fix 2

* add tests, remove unused variables, change shape inference checks

* style fix

* add input tensors type checks and test coverage

* align input type in attribute and ngraphreader tests to match specification

* fix wrong dimension in error message

* proposalv4 ref impl

* enable single layer and unit tests for proposalv4 ref impl

* align output termination with cpu, enable cpu slt

* custom slt compares to detect less-than-predicted number of boxes

* custom slt compares to detect less-than-predicted number of boxes

* Clarify output termination in spec

* review comments

* smaller input data for unit tests

* add check for batch_dim being static

* disable gpu slt for proposal

* test data style fix

* test data style fix 2

* add type section to specification

* shape inference improvement

* multiply expected 1st dim in tests by post_nms_topn

* add checks and testcases for dynamic ranks

* indentation, review comments

* reduce code redundancy in ref implementation

* remove comment

* Fix typo in proposal1 spec

* Fix typo in proposal4 spec
* remove cropie op from node converter

* remove eltwise from node converter, enable visitor api

* remove ceiling op from node converter

* remove powerie, reluie, fullyconnected from node converter

* remove unused node converters

* join relu and reluie specific creators

* add missing eltwise types to node conversion

* fix eltwise type

* change power ops scale parameter passing for better precision
Makes DTS for BinaryEltwise produce empty output tensor in case if at least one input is empty. As criteria for empty tensor ReduceMin is used (assuming all shape's values are non-negative).

Tests are changed accordingly. Trying to add a new test case on inference with empty input, reference version failed, so those tests are left unchanged.
…eorders that support the data type conversion. (#3498)
* DeformableConvolution specification refactoring.

* Add ticks to types and layouts.

* Removed 1D and 3D Convolution type.

At the current moment CPU plugin and MXnet implemenatations supports
only 2D case.

* Fix examples section.

* Fix offests input layout description.
* Fixed github issue #4172

* Simplified tests

* Added instances to HETERO plugin
* GroupConvolutionBackpropData: Added backend unit tests

* GroupConvolutionBackpropData: Refactor SLT and added tests for 1D

* GroupConvolutionBackpropData: Added Serialization tests

* GroupConvolutionBackpropData: Added GroupConvolutionBackpropData reference implementation

* GroupConvolutionBackpropData specification refactoring.

* GroupConvolutionBackpropData: Added validation node checks for the op

* GroupConvolutionBackpropData: Copyright year fixed

* GroupConvolutionBackpropData: Enhanced output shape inference with dynamic shapes

* GroupConvolutionBackpropData: Remove redefinition of helper variables

* Spec refactoring: add ticks to types and layouts.

* Minor refactoring.

* GroupConvolutionBackpropData: Moved backend tests from GroupConvolution to corresponding file

* GroupConvolutionBackpropData: Improved output shape inference for fully dynamic inputs

* GroupConvolutionBackpropData: Clean up type_prop tests

* Fix banner in GroupConvolution shared test class.

Co-authored-by: ggalieroc <[email protected]>
* [IE TESTS] Move ROI SLT class to the shared lib

* [IE Tests] Fix Ci

* Fix ci
* Removed redundant collectors

* Remove isea filter

* Remove the code from IntelSEAPI

* Removed shell=True

* remove asserts

* Refactored command line arguments
… implementations (#3974)

* FP16->FP32 conversion vectorization

* int8->FP16 conversion vectorization in nGraph
* Support ":" in node name for mean/scale application

* Apply review feedback
* Added onnx support for C samples

* Added wheel packaging configuration

* ADD cmake option

* Small refactoring

* Fixes for linux env

* Fixed macOS issues

* removed test code

* Added requirements file

* Added myriad plugin

* [PIP] Runtime wheel packaging v2

* Added rpath logic

* Setting rpath for bindings

* Formatting fixes

* Move target project 1 directory above

* Added target dependencies

* Added blacklist for runtime libs

* Corrected blacklist scope

* Added wheel packaging configuration

* ADD cmake option

* Small refactoring

* Fixes for linux env

* Fixed macOS issues

* removed test code

* Added requirements file

* Added myriad plugin

* [PIP] Runtime wheel packaging v2

* Added rpath logic

* Setting rpath for bindings

* Formatting fixes

* Move target project 1 directory above

* Added blacklist for runtime libs

* Changed lib exstention om macOS

* ADD cmake option

* Revert "ADD cmake option"

This reverts commit 36f98c7.

* Revert "Changed lib exstention om macOS"

This reverts commit 80086fe.

* Revert "Merge branch 'feature/wheel_pack' of https://github.com/mryzhov/openvino into feature/wheel_pack"

This reverts commit 7560d9a, reversing
changes made to c287798.

* Revert "Added onnx support for C samples"

This reverts commit 26c595a.

* Fixed merge issues

* Fixed typo in mac tool

* Code review fixes

* Simplified deps and added fatal error

code review fixes

* Removed test data

* Fixed setup.py review comments

* Removed apache 2.0 license

* Review fixes

* fixed pylint issues

* Fixed python api install directory

* Using cmake detected python binary

* Changed wheel build directory

* Renamed subdir from install to wheel

* Removed pylint log

* Made license, description and requirements configurable by cmake options

Those files may be changed in CI

* Changed variable name

* Glob instead of os.walk

* Corrected package name in description

* Added wheel building instructions to readme

* small typo fix

* Changes to support CI build

1) Setup.py can be run without cmake build
2) Wheel metadata can be set by environment variables
3) Cmake build uses configuration from .env file

* Removed unused file
…elsTransformation (#3950)

* [LPT] ConcatTransformation: supported StridedSlice

* [LPT] Concat with StridedSlice funcional tests
* Add Build Doc

* Add doxygen

* Add graphviz texlive

* Add lxml

* Add Upload doc

* ubuntu-20.04

* Build doxygen

* Fix

* exit 0

* Add nproc

* Change build dir name
generalova-kate and others added 28 commits February 12, 2021 14:28
* XmlDeserializer relay on parameter/result (input/output) index which is reported during inserting to function

Xml parameter/result order is irrelevant now.

* drop stack usage - just single class member

* try to fix CentOS build

* fix after review

* Drop std::map to custom structure

* reorder layers in TI in test IR which failed on current master

Co-authored-by: Patryk Elszkowski <[email protected]>
* Updated install_NEO_OCL_driver.sh & install_openvino_dependencies.sh with rhel8 case

* install_NEO_OCL_driver: Fixed conditional

* script: Updated with actual revisions
…ce (#4314)

This issue relates to multi-device mode.
While we are trying to allocate a graph on one of the devices we should check memory capacity only for the corresponding device, not for the last opened as far devices may have different memory capacity or the latest opened device may have still not sent its attributes (including memory capacity)
* Added result rename operation

* Optimize imports

* Added ResultRename to package_BOM

* ResultRename moved to the end of back phase, code refactoring

* Revert incorrect changes

* Optimize imports

* Added comments and optimized imports.
* DPC++ link error workaround.

OpenVINO C++ program failed to link when DPC++ compiler is used.
'make_shared_blob' causes 'unresolved external symbol' error on linking.
Commented out some __clang__ specific directives to workaround the issue in "ie_blob.h".

* DPC++ compatibility issue fix #2

1. Removed type-by-type template class definition for __clang__.
2. Modified TBlob() destructor. The 'unresolved reference' error occur again if I left 'virtual ~TBlob();' only. It seems it needs to be 'virtual ~TBlob() {};'.

* DPC++ compatibility fix #3 - Add DPC++ conditional code

Uses '__SYCL_COMPILER_VERSION' predefined macro to check if the compiler is a DPC++ or not.
Added conditional directive to switch code based of the detected compiler.
NOTE: User program must include <CL/sycl.hpp>, or the '__SYCL_COMPILER_VERSION' macro won't be defined and this fix won't take effect.

* DPC++ compatibility issue fix #4

Changed from #ifdef to #if + logical formulas.

* DPC++ compatibility issue fix #5

Added compiler check logic in src/ie_rtti.cpp

* DPC++ Compatibility issue #6 - ie_parameter.cpp

Added compiler check macro for DPC++ to ie_parameter.cpp as well.

Co-authored-by: Yasunori Shimura <[email protected]>
* Removed legacy IE shape infer

* Removed GenericIE operation

* Removed legacy shape infer tests

* Removed legacy test with legacy IE reshape

* Fixed compilation issues related to removal of GenericIE

* Fixed one more compilation issue with clDNN

* Fixed test for reading experimental ops

* Updated tests and make IR Reader to load old experimenal and extension ops as opset6

* Change opset of some ops only if they are currently experimental/extension to avoid situation like opset1::Proposal -> opset6::Proposal

* Removed more legacy code

* Returned back code removed by mistake

* Fixed issues related to incorrect merge with master

* Merge fixes

* Fixed unit tests which starts to fail because now loading the model with unknown operation is failed earlier

* Removed incorrectly added code

Co-authored-by: Evgeny Lazarev <[email protected]>
* fix comparison of constant with short float NAN values

* adjust precision, remove elvises

* more templates

* add ir serialization  test with float16 const

* remove unused prototxt
* Remove linking libonnx from unit-test

* Consider all flavors of protobuf libraries

* Avoid passing on NOTFOUND properties

* Set system deps for mac

* Revert include dirs set up
setupvars.sh is incomatible with sh shell.
* DeformablePSROIPooling spec update

* Typo update

* Description update

* xml identation

* Review changes
* Reformulated, intermediate. No positive indices.

* Indices >= 0, depth > 0.

* Added the Types section and a more complicated example.

* Behavior for negative indices is undefined

* Wrap T1 & T2 with *

* Revert mkl-dnn to cae1e0b83

* T1: int32 or int64 only
@evolosen evolosen merged commit c299e1d into evolosen:master Feb 15, 2021
evolosen pushed a commit that referenced this pull request Aug 6, 2021
* [FrontEnd]enable pdpd ops conversion part3

* Add adaptive pool2d op conversion (#1)

* param support tensor (#2)

* add missing sync_batch_norm

* Update pow.cpp

* deal empty axis (#5)

* deal empty axis

* apply review comments

* fix code style

* fix code style

* change shape to i32

* fix code in shape

* fix code style

* fix paddle code style

* remove redandent ops

* fix maxAdativePool

* fix expand_v2

* remove redandent code

Co-authored-by: Mang Guo <[email protected]>
Co-authored-by: Luo Cheng <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.