Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

内存随Pass增加而增加,请owner看下cache清空机制是否存在问题 #311

Closed
CDDB opened this issue Nov 2, 2016 · 2 comments
Assignees

Comments

@CDDB
Copy link

CDDB commented Nov 2, 2016

现象:
随着pass数目增加,内存增加(没10分钟一个pass)
image

观察:
dataprovider很多时候推荐 CacheType.CACHE_PASS_IN_MEM,怀疑每轮pass都会吃下大量内存不清理。
快速过了下代码,观察到每个batch的操作:
{ PyGuard g; cache_->drop(&data); }

但是,drop操作不清内存,droppedPool_也没有释放操作

验证:
采用 CacheType.NO_CACHE
image

@gangliao
Copy link
Contributor

gangliao commented Nov 2, 2016

#310

@reyoung
Copy link
Collaborator

reyoung commented Nov 2, 2016

@CDDB Thank you for submitting this issue. It seems to be duplicated with issue #310.

I'm trying to figure out what's going on right now. Please tracking #310 for updates.

@reyoung reyoung closed this as completed Nov 2, 2016
reyoung added a commit to reyoung/Paddle that referenced this issue Nov 2, 2016
* Forget to finishTestPeriod in testOnePeriod.
* Fix PaddlePaddle#318
* Protentially related to PaddlePaddle#310, PaddlePaddle#311
thisjiang pushed a commit to thisjiang/Paddle that referenced this issue Oct 28, 2021
wangxicoding pushed a commit to wangxicoding/Paddle that referenced this issue Dec 9, 2021
[Ready for Review] refine docs for xlnet modeling and tokenizer
AnnaTrainingG pushed a commit to AnnaTrainingG/Paddle that referenced this issue Sep 19, 2022
danleifeng added a commit to danleifeng/Paddle that referenced this issue Jun 13, 2023
danleifeng added a commit to danleifeng/Paddle that referenced this issue Sep 13, 2023
lizexu123 pushed a commit to lizexu123/Paddle that referenced this issue Feb 23, 2024
WAYKEN-TSE pushed a commit to WAYKEN-TSE/Paddle that referenced this issue Dec 6, 2024
支持文生图、图生图、inpaint_legacy、inpaint、controlnet+canny的推理
PaddlePaddle/PaddleMIX#256

aistudio 项目还在施工中。
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants