Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[xpu] multi_encoder_xpu supoort smooth quant, skip quant and local quant #61617

Merged
merged 1 commit into from
Feb 19, 2024

Conversation

NeroLoh
Copy link
Contributor

@NeroLoh NeroLoh commented Feb 5, 2024

PR types

New features

PR changes

OPs

Description

对齐ernie模型中paddle lite量化相关功能:

  1. SoftmaxMax: https://github.com/PaddlePaddle/Paddle-Lite/pull/10392/files
  2. SmoothQuant: [xpu] support SmoothQuant;test=develop Paddle-Lite#10359
  3. SkipQuant + LocalQuant: [XPU] support skip quant and xpu local quant Paddle-Lite#9399
  4. QUANT_GELU_OUT_THRESHOLD功能
  5. 默认关闭quant_dequant_xpu_pass,该pass只针对旧格式的int8模型,需要时用户自行打开

Copy link

paddle-bot bot commented Feb 5, 2024

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@paddle-bot paddle-bot bot added the contributor External developers label Feb 5, 2024
@NeroLoh NeroLoh force-pushed the support_quant branch 2 times, most recently from 115b639 to d8cb4ef Compare February 5, 2024 08:42
risemeup1
risemeup1 previously approved these changes Feb 5, 2024
Copy link
Contributor

@zhupengyang zhupengyang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@zhupengyang zhupengyang merged commit bd281c9 into PaddlePaddle:develop Feb 19, 2024
30 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
contributor External developers
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants