Skip to content

Commit

Permalink
[LPT] Refactoring + developer guide
Browse files Browse the repository at this point in the history
  • Loading branch information
@eshoguli
eshoguli committed Sep 14, 2021
1 parent 506b347 commit 8a5c34e
Show file tree
Hide file tree
Showing 104 changed files with 616 additions and 109 deletions.
2 changes: 1 addition & 1 deletion docs/IE_DG/Int8Inference.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ available from the Inference Engine API. For example, the part of performance co
| resnet\_model/add\_5/fq\_input\_1 | NOT\_RUN | FakeQuantize | undef | 0 | 0 |


> The `exeStatus` column of the table includes possible values:
> The `execStatus` column of the table includes possible values:
> - `EXECUTED` - layer was executed by standalone primitive,
> - `NOT_RUN` - layer was not executed by standalone primitive or was fused with another operation and executed in another layer primitive.
>
Expand Down
71 changes: 70 additions & 1 deletion docs/doxygen/ie_docs.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -311,7 +311,76 @@ limitations under the License.
</tab>
<tab type="usergroup" title="Using Low-Precision 8-bit Integer Inference" url="@ref openvino_docs_IE_DG_Int8Inference">
</tab>
<tab type="usergroup" title="Low Precision Transformations" url="@ref openvino_docs_IE_DG_lpt"/>
<tab type="usergroup" title="Low Precision Transformations" url="@ref openvino_docs_IE_DG_lpt">
<tab type="user" title="Attributes" url="@ref openvino_docs_IE_DG_lpt_attributes">
<tab type="user" title="AvgPoolPrecisionPreserved" url="@ref openvino_docs_IE_DG_lpt_AvgPoolPrecisionPreserved"/>
<tab type="user" title="IntervalsAlignment" url="@ref openvino_docs_IE_DG_lpt_IntervalsAlignment"/>
<tab type="user" title="PerTensorQuantization" url="@ref openvino_docs_IE_DG_lpt_PerTensorQuantization"/>
<tab type="user" title="PrecisionPreserved" url="@ref openvino_docs_IE_DG_lpt_PrecisionPreserved"/>
<tab type="user" title="Precisions" url="@ref openvino_docs_IE_DG_lpt_Precisions"/>
<tab type="user" title="QuantizationAlignment" url="@ref openvino_docs_IE_DG_lpt_QuantizationAlignment"/>
</tab>
<tab type="user" title="Step #1. Prerequisites transformations" url="@ref openvino_docs_IE_DG_lpt_step1_prerequisites">
<tab type="user" title="LinOpSequenceFusion" url="@ref openvino_docs_IE_DG_lpt_LinOpSequenceFusion"/>
<tab type="user" title="PullReshapeThroughDequantization" url="@ref openvino_docs_IE_DG_lpt_PullReshapeThroughDequantization"/>
<tab type="user" title="PullTransposeThroughDequantization" url="@ref openvino_docs_IE_DG_lpt_PullTransposeThroughDequantization"/>
</tab>
<tab type="user" title="Step #2. Markup transformations" url="@ref openvino_docs_IE_DG_lpt_step2_markup">
<tab type="user" title="AlignQuantizationIntervals" url="@ref openvino_docs_IE_DG_lpt_AlignQuantizationIntervals"/>
<tab type="user" title="AlignQuantizationParamters" url="@ref openvino_docs_IE_DG_lpt_AlignQuantizationParamters"/>
<tab type="user" title="CreateAttribute" url="@ref openvino_docs_IE_DG_lpt_CreateAttribute"/>
<tab type="user" title="CreatePrecisionsDependentAttribute" url="@ref openvino_docs_IE_DG_lpt_CreatePrecisionsDependentAttribute"/>
<tab type="user" title="MarkupAvgPoolPrecisionPreserved" url="@ref openvino_docs_IE_DG_lpt_MarkupAvgPoolPrecisionPreserved"/>
<tab type="user" title="MarkupCanBeQuantized" url="@ref openvino_docs_IE_DG_lpt_MarkupCanBeQuantized"/>
<tab type="user" title="MarkupPerTensorQuantization" url="@ref openvino_docs_IE_DG_lpt_MarkupPerTensorQuantization"/>
<tab type="user" title="MarkupPrecisions" url="@ref openvino_docs_IE_DG_lpt_MarkupPrecisions"/>
<tab type="user" title="PropagatePrecisions" url="@ref openvino_docs_IE_DG_lpt_PropagatePrecisions"/>
<tab type="user" title="PropagateThroughPrecisionPreserved" url="@ref openvino_docs_IE_DG_lpt_PropagateThroughPrecisionPreserved"/>
<tab type="user" title="PropagateToInput" url="@ref openvino_docs_IE_DG_lpt_PropagateToInput"/>
<tab type="user" title="UpdateSharedPrecisionPreserved" url="@ref openvino_docs_IE_DG_lpt_UpdateSharedPrecisionPreserved"/>
</tab>
<tab type="user" title="Step #3. Main transformations" url="@ref openvino_docs_IE_DG_lpt_step3_main">
<tab type="user" title="AddTransformation" url="@ref openvino_docs_IE_DG_lpt_AddTransformation"/>
<tab type="user" title="AvgPoolTransformation" url="@ref openvino_docs_IE_DG_lpt_AvgPoolTransformation"/>
<tab type="user" title="ClampTransformation" url="@ref openvino_docs_IE_DG_lpt_ClampTransformation"/>
<tab type="user" title="ConcatTransformation" url="@ref openvino_docs_IE_DG_lpt_ConcatTransformation"/>
<tab type="user" title="ConvolutionTransformation" url="@ref openvino_docs_IE_DG_lpt_ConvolutionTransformation"/>
<tab type="user" title="ConvolutionBackpropDataTransformation" url="@ref openvino_docs_IE_DG_lpt_ConvolutionBackpropDataTransformation"/>
<tab type="user" title="DepthToSpaceTransformation" url="@ref openvino_docs_IE_DG_lpt_DepthToSpaceTransformation"/>
<tab type="user" title="FakeQuantizeDecompositionTransformation" url="@ref openvino_docs_IE_DG_lpt_FakeQuantizeDecompositionTransformation"/>
<tab type="user" title="FakeQuantizeTransformation" url="@ref openvino_docs_IE_DG_lpt_FakeQuantizeTransformation"/>
<tab type="user" title="InterpolateTransformation" url="@ref openvino_docs_IE_DG_lpt_InterpolateTransformation"/>
<tab type="user" title="GroupConvolutionTransformation" url="@ref openvino_docs_IE_DG_lpt_GroupConvolutionTransformation"/>
<tab type="user" title="MatMulTransformation" url="@ref openvino_docs_IE_DG_lpt_MatMulTransformation"/>
<tab type="user" title="MaxPoolTransformation" url="@ref openvino_docs_IE_DG_lpt_MaxPoolTransformation"/>
<tab type="user" title="MultiplyTransformation" url="@ref openvino_docs_IE_DG_lpt_MultiplyTransformation"/>
<tab type="user" title="MVNTransformation" url="@ref openvino_docs_IE_DG_lpt_MVNTransformation"/>
<tab type="user" title="NormalizeL2Transformation" url="@ref openvino_docs_IE_DG_lpt_NormalizeL2Transformation"/>
<tab type="user" title="PadTransformation" url="@ref openvino_docs_IE_DG_lpt_PadTransformation"/>
<tab type="user" title="PReluTransformation" url="@ref openvino_docs_IE_DG_lpt_PReluTransformation"/>
<tab type="user" title="ReduceMaxTransformation" url="@ref openvino_docs_IE_DG_lpt_ReduceMaxTransformation"/>
<tab type="user" title="ReduceMeanTransformation" url="@ref openvino_docs_IE_DG_lpt_ReduceMeanTransformation"/>
<tab type="user" title="ReduceMinTransformation" url="@ref openvino_docs_IE_DG_lpt_ReduceMinTransformation"/>
<tab type="user" title="ReduceSumTransformation" url="@ref openvino_docs_IE_DG_lpt_ReduceSumTransformation"/>
<tab type="user" title="ReluTransformation" url="@ref openvino_docs_IE_DG_lpt_ReluTransformation"/>
<tab type="user" title="ReshapeTransformation" url="@ref openvino_docs_IE_DG_lpt_ReshapeTransformation"/>
<tab type="user" title="SqueezeTransformation" url="@ref openvino_docs_IE_DG_lpt_SqueezeTransformation"/>
<tab type="user" title="ShuffleChannelsTransformation" url="@ref openvino_docs_IE_DG_lpt_ShuffleChannelsTransformation"/>
<tab type="user" title="SplitTransformation" url="@ref openvino_docs_IE_DG_lpt_SplitTransformation"/>
<tab type="user" title="StridedSliceTransformation" url="@ref openvino_docs_IE_DG_lpt_StridedSliceTransformation"/>
<tab type="user" title="TransposeTransformation" url="@ref openvino_docs_IE_DG_lpt_TransposeTransformation"/>
<tab type="user" title="UnsqueezeTransformation" url="@ref openvino_docs_IE_DG_lpt_UnsqueezeTransformation"/>
<tab type="user" title="VariadicSplitTransformation" url="@ref openvino_docs_IE_DG_lpt_VariadicSplitTransformation"/>
</tab>
<tab type="user" title="Step #4. Cleanup transformations" url="@ref openvino_docs_IE_DG_lpt_step4_cleanup">
<tab type="user" title="FoldConvertTransformation" url="@ref openvino_docs_IE_DG_lpt_FoldConvertTransformation"/>
<tab type="user" title="FoldFakeQuantizeTransformation" url="@ref openvino_docs_IE_DG_lpt_FoldFakeQuantizeTransformation"/>
<tab type="user" title="FuseConvertTransformation" url="@ref openvino_docs_IE_DG_lpt_FuseConvertTransformation"/>
<tab type="user" title="FuseMultiplyToFakeQuantizeTransformation" url="@ref openvino_docs_IE_DG_lpt_FuseMultiplyToFakeQuantizeTransformation"/>
<tab type="user" title="FuseSubtractToFakeQuantizeTransformation" url="@ref openvino_docs_IE_DG_lpt_FuseSubtractToFakeQuantizeTransformation"/>
<tab type="user" title="MultiplyToGroupConvolutionTransformation" url="@ref openvino_docs_IE_DG_lpt_MultiplyToGroupConvolutionTransformation"/>
</tab>
</tab>
<tab type="usergroup" title="Utilities to Validate Your Converted Model" url="@ref openvino_inference_engine_tools_cross_check_tool_README">
<tab type="user" title="Using Cross Check Tool for Per-Layer Comparison Between Plugins" url="@ref openvino_inference_engine_tools_cross_check_tool_README"/>
</tab>
Expand Down
9 changes: 9 additions & 0 deletions docs/low_precision_transformations/attributes/avg_pool_precision_preserved.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# OpenVINO™ Low Precision Transformations: AvgPoolPrecisionPreserved {#openvino_docs_IE_DG_lpt_AvgPoolPrecisionPreserved}

Utility attribute which is used only during `AvgPool` operation precision preserved property definition.

| Property name | Values |
|---------------|----------------------------------------------|
| Required | Yes |
| Defined | Operation |
| Properties | value (boolean) |
9 changes: 9 additions & 0 deletions docs/low_precision_transformations/attributes/intervals_alignment.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# OpenVINO™ Low Precision Transformations: IntervalsAlignment {#openvino_docs_IE_DG_lpt_IntervalsAlignment}

The attribute defines subgraph with the same quantization intervals alignment. `FakeQuantize` operations are included. The attribute is used by quantization operations.

| Property name | Values |
|---------------|----------------------------------------------|
| Required | Yes |
| Defined | Operation |
| Properties | combined interval, minimal interval, minimal levels, preferable precisions |
9 changes: 9 additions & 0 deletions docs/low_precision_transformations/attributes/per_tensor_quantization.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# OpenVINO™ Low Precision Transformations: PerTensorQuantization {#openvino_docs_IE_DG_lpt_PerTensorQuantization}

The attribute defines if operation input port requires per-tensor quantization.

| Property name | Values |
|---------------|----------------------------------------------|
| Required | Yes |
| Defined | Operation, input ports |
| Properties | |
9 changes: 9 additions & 0 deletions docs/low_precision_transformations/attributes/precision_preserved.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# OpenVINO™ Low Precision Transformations: PrecisionPreserved {#openvino_docs_IE_DG_lpt_PrecisionPreserved}

The attribute defines precision preserved operation. If attribute is absent then an operation is not precision preserved.

| Property name | Values |
|---------------|----------------------------------------------|
| Required | Yes |
| Defined | Operation |
| Properties | value (boolean) |
9 changes: 9 additions & 0 deletions docs/low_precision_transformations/attributes/precisions.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# OpenVINO™ Low Precision Transformations: Precisions {#openvino_docs_IE_DG_lpt_Precisions}

The attribute defines precision which is required for input/output port or an operation.

| Property name | Values |
|---------------|----------------------------------------------|
| Required | Yes |
| Defined | Operation, input port, output port |
| Properties | value (boolean) |
9 changes: 9 additions & 0 deletions docs/low_precision_transformations/attributes/quantization_alignment.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# OpenVINO™ Low Precision Transformations: QuantizationAlignment {#openvino_docs_IE_DG_lpt_QuantizationAlignment}

The attribute defines subgraph with the same quantization alignment. `FakeQuantize` operations are not included. The attribute is used by quantization operations.

| Property name | Values |
|---------------|----------------------------------------------|
| Required | Yes |
| Defined | Operation |
| Properties | value (boolean) |
3 changes: 0 additions & 3 deletions docs/low_precision_transformations/img/fq_and_convolution.common.png
View file

This file was deleted.

3 changes: 0 additions & 3 deletions docs/low_precision_transformations/img/fq_and_convolution.transformed.png
View file

This file was deleted.

3 changes: 0 additions & 3 deletions docs/low_precision_transformations/img/fq_fq_and_convolution.common.png
View file

This file was deleted.

4 changes: 2 additions & 2 deletions docs/low_precision_transformations/img/low_precision_transformation_pipeline.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions docs/low_precision_transformations/img/model_fq_and_convolution.common.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
0 ...mations/img/fq_and_convolution.common.svg → ...s/img/model_fq_and_convolution.common.svg
View file
File renamed without changes
3 changes: 3 additions & 0 deletions docs/low_precision_transformations/img/model_fq_and_convolution.transformed.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
0 ...ns/img/fq_and_convolution.transformed.svg → .../model_fq_and_convolution.transformed.svg
View file
File renamed without changes
3 changes: 3 additions & 0 deletions docs/low_precision_transformations/img/model_fq_fq_and_convolution.common.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
0 ...ions/img/fq_fq_and_convolution.common.svg → ...mg/model_fq_fq_and_convolution.common.svg
View file
File renamed without changes
3 changes: 3 additions & 0 deletions docs/low_precision_transformations/img/model_qdq_and_convolution.common.png
View file
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
0 ...ations/img/qdq_and_convolution.common.svg → .../img/model_qdq_and_convolution.common.svg
View file
File renamed without changes
3 changes: 0 additions & 3 deletions docs/low_precision_transformations/img/qdq_and_convolution.common.png
View file

This file was deleted.

Loading

0 comments on commit 8a5c34e

Please sign in to comment.