Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Fast-/BC with MatMul/Gemm support #2776

Merged
merged 5 commits into from
Jul 3, 2024

Conversation

KodiaqQ
Copy link
Collaborator

@KodiaqQ KodiaqQ commented Jul 1, 2024

Changes

  • Updated FastBiasCorrection algorithm to correct work with transposed MatMul (OV) and Gemm (ONNX) layers.
  • Updated BiasCorrection algorithm to avoid recursion depth error.

Reason for changes

  • FastBiasCorrection algorithm adaptation.
  • BiasCorrection improvement for many correctable layers.

Related tickets

  • 144240

Tests

  • manual, post_training_quantization/418/ - passed

### Changes

- Updated FastBiasCorrection algorithm to correct work with transposed
MatMul layers.
- Updated BiasCorrection algorithm to avoid recursion depth error.

### Reason for changes

- FastBiasCorrection algorithm adaptation.
- BiasCorrection improvement for many correctable layers.

### Related tickets

- 144240

---------

Co-authored-by: Aleksei Kashapov <[email protected]>
(cherry picked from commit beb9c04)
@github-actions github-actions bot added NNCF PT Pull requests that updates NNCF PyTorch NNCF OpenVINO Pull requests that updates NNCF OpenVINO NNCF ONNX Pull requests that updates NNCF ONNX NNCF PTQ Pull requests that updates NNCF PTQ labels Jul 1, 2024
@KodiaqQ KodiaqQ marked this pull request as ready for review July 2, 2024 12:35
@KodiaqQ KodiaqQ requested a review from a team as a code owner July 2, 2024 12:35
@KodiaqQ KodiaqQ requested a review from alexsu52 July 3, 2024 07:16
@KodiaqQ KodiaqQ requested a review from daniil-lyakhov July 3, 2024 08:55
@KodiaqQ KodiaqQ merged commit a644a1e into openvinotoolkit:develop Jul 3, 2024
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
NNCF ONNX Pull requests that updates NNCF ONNX NNCF OpenVINO Pull requests that updates NNCF OpenVINO NNCF PT Pull requests that updates NNCF PyTorch NNCF PTQ Pull requests that updates NNCF PTQ
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants