We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
客户端请求后,服务端内存不释放,多次请求后内存一直累加。 Paddle Server版本:0.8.3 代码:https://github.com/PaddlePaddle/PaddleClas/tree/release/2.3/deploy/paddleserving
The text was updated successfully, but these errors were encountered:
Message that will be displayed on users' first issue
Sorry, something went wrong.
和paddle内存使用策略相关,推理默认是 auto_growth https://www.paddlepaddle.org.cn/documentation/docs/zh/guides/flags/memory_cn.html#flags-allocator-strategy
单个分类模型,并发数concurrency设置为大于1的数,客户端每次请求内存都不会释放,设置FLAGS_allocator_strategy=naive_best_fit,客户端请求后一直卡住无返回值。该如何设置能够让单模型实现并发且内存及时释放呢?
只是我的问题是显存的
这个问题解决了吗?遇到同样的问题
TeslaZhao
No branches or pull requests
客户端请求后,服务端内存不释放,多次请求后内存一直累加。
Paddle Server版本:0.8.3
代码:https://github.com/PaddlePaddle/PaddleClas/tree/release/2.3/deploy/paddleserving
The text was updated successfully, but these errors were encountered: