Code

[PTQ][OV] BF16 support#2307

Code

Merged

KodiaqQ merged 38 commits intoopenvinotoolkit:developopenvinotoolkit/nncf:developfrom KodiaqQ:nm/bf16_supportKodiaqQ/nncf:nm/bf16_supportCopy head branch name to clipboardJul 12, 2024

+313-166

Commits

Commits on Dec 7, 2023

• Added BF16 & ov.Tensor support

  KodiaqQ

  committed
  26b6c73

  Copy full SHA for 26b6c73

• Add FQ params dtype conversion

  KodiaqQ

  committed
  5f02d99

  Copy full SHA for 5f02d99

• Update tests for BF16

  KodiaqQ

  committed
  2bcfca9

  Copy full SHA for 2bcfca9

• Fix tests

  KodiaqQ

  committed
  65ce6dc

  Copy full SHA for 65ce6dc

• Fix bf16 tests

  KodiaqQ

  committed
  4f91018

  Copy full SHA for 4f91018

Commits on Dec 8, 2023

• Added const with types

  KodiaqQ

  committed
  69e2297

  Copy full SHA for 69e2297

Commits on Dec 12, 2023

• Apply comment

  KodiaqQ

  committed
  de85c1d

  Copy full SHA for de85c1d

• Disable tests

  KodiaqQ

  committed
  058a6e1

  Copy full SHA for 058a6e1

• Added PrePostProcessor for FP32 outputs

  KodiaqQ

  committed
  12447d9

  Copy full SHA for 12447d9

Commits on Dec 13, 2023

• Remove BF16 from testing

  KodiaqQ

  committed
  627ff67

  Copy full SHA for 627ff67

Commits on Jan 16, 2024

• Merge remote-tracking branch 'openvinotoolkit/develop' into nm/bf16_support

  KodiaqQ

  committed
  6f011d9

  Copy full SHA for 6f011d9

• Adjust to develop

  KodiaqQ

  committed
  f3c8ed8

  Copy full SHA for f3c8ed8

• Adjust BF16 suport in tests

  KodiaqQ

  committed
  c97c616

  Copy full SHA for c97c616

Commits on Jan 18, 2024

• Added opset.constant with shared_memory option

  KodiaqQ

  committed
  ccd0b91

  Copy full SHA for ccd0b91

Commits on Jan 22, 2024

• Merge remote-tracking branch 'openvinotoolkit/develop' into nm/bf16_support

  KodiaqQ

  committed
  7f670a0

  Copy full SHA for 7f670a0

Commits on Jan 23, 2024

• Added cast to fp32

  KodiaqQ

  committed
  91bb312

  Copy full SHA for 91bb312

Commits on Apr 17, 2024

• Merge openvinotoolkit/develop into nm/bf16_support

  KodiaqQ

  committed
  ff8f0ca

  Copy full SHA for ff8f0ca

• Removed PrePostProcessor usage

  KodiaqQ

  committed
  ca6ff73

  Copy full SHA for ca6ff73

Commits on Apr 18, 2024

• Adapt F-/BC algos to BF16

  KodiaqQ

  committed
  11f4929

  Copy full SHA for 11f4929

Commits on Apr 19, 2024

• Change get_const_value data output

  KodiaqQ

  committed
  c67ee84

  Copy full SHA for c67ee84

Commits on May 27, 2024

• Merge remote-tracking branch 'openvinotoolkit/develop' into nm/bf16_support

  KodiaqQ

  committed
  833f7c9

  Copy full SHA for 833f7c9

Commits on May 28, 2024

• Change get_const_value behavior

  KodiaqQ

  committed
  097e938

  Copy full SHA for 097e938

Commits on Jun 17, 2024

• Update implementation

  KodiaqQ

  committed
  106ff8a

  Copy full SHA for 106ff8a

• Merge remote-tracking branch 'openvinotoolkit/develop' into nm/bf16_support

  KodiaqQ

  committed
  d2e5556

  Copy full SHA for d2e5556

Commits on Jun 18, 2024

• Merge remote-tracking branch 'openvinotoolkit/develop' into nm/bf16_support

  KodiaqQ

  committed
  5636d1a

  Copy full SHA for 5636d1a

• Fix pipeline tests

  KodiaqQ

  committed
  d2df92e

  Copy full SHA for d2df92e

• Tensor names set update

  KodiaqQ

  committed
  4f9cd37

  Copy full SHA for 4f9cd37

Commits on Jun 19, 2024

• Merge remote-tracking branch 'openvinotoolkit/develop' into nm/bf16_support

  KodiaqQ

  committed
  87ea12e

  Copy full SHA for 87ea12e

• Extend OutputInsertionCommand

  KodiaqQ

  committed
  1cdc747

  Copy full SHA for 1cdc747

• Apply comments

  KodiaqQ

  committed
  7dfd1c1

  Copy full SHA for 7dfd1c1

Commits on Jun 20, 2024

• Merge remote-tracking branch 'openvinotoolkit/develop' into nm/bf16_support

  KodiaqQ

  committed
  9471ac8

  Copy full SHA for 9471ac8

Commits on Jul 10, 2024

• Limit .get_data usage

  KodiaqQ

  committed
  8ffe8ae

  Copy full SHA for 8ffe8ae

• Merge remote-tracking branch 'openvinotoolkit/develop' into nm/bf16_support

  KodiaqQ

  committed
  5405bc9

  Copy full SHA for 5405bc9

• Limit shared_memory usage

  KodiaqQ

  committed
  5f4062b

  Copy full SHA for 5f4062b

• Fix WC

  KodiaqQ

  committed
  cfa7ce9

  Copy full SHA for cfa7ce9

• Fix test_get_const_value

  KodiaqQ

  committed
  f2add1f

  Copy full SHA for f2add1f

Commits on Jul 11, 2024

• Apply comment

  KodiaqQ

  committed
  5725636

  Copy full SHA for 5725636

Commits on Jul 12, 2024

• Apply minor comments

  KodiaqQ

  committed
  3e531c4

  Copy full SHA for 3e531c4