New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

部署的时候会考虑量化模型么? #14

Open

jiuzhuanzhuan opened this issue Jun 3, 2023 · 1 comment

jiuzhuanzhuan commented Jun 3, 2023

首先感谢大佬无私的开源, 整套工具都很全, 从训练到部署, 支持的也比较全, 但是我看没有做8bits量化,大佬请问是有尝试过么, 做量化会损失精度么?

Owner

we0091234 commented Jun 3, 2023

首先感谢大佬无私的开源, 整套工具都很全, 从训练到部署, 支持的也比较全, 但是我看没有做8bits量化,大佬请问是有尝试过么, 做量化会损失精度么?

用PTQ呗，量化肯定都会有精度损失的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment