Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

some questions about caffe deconvolution #5

Open
jsjs0827 opened this issue Apr 20, 2017 · 4 comments
Open

some questions about caffe deconvolution #5

jsjs0827 opened this issue Apr 20, 2017 · 4 comments

Comments

@jsjs0827
Copy link

I operate deconv on my networks and show the feature maps,I find that the feature maps are quite white(maybe all value>0),did caffe uniformize the data before feed them to deconvolutional layer? Where can I change the mechanism?

我在我自己的网络上做反卷积,但是得到的特征图都偏白,caffe在做反卷积的时候要归一化的吗?我在源码哪能改掉这个机制?

@chengyangfu
Copy link
Owner

Hi @jsjs0827
For the first question, I don't think deconvolutional layer will change preprocessing the input before operating it.
Did you check the feature maps before feeding to deconvolutional layers? The feature maps before and after deconvolutional layers should be similar but in different resolutions.

May I ask what's your problem? More information could lead to better suggestion.
According to my experience, I will suggest to use simple bilinear upsampling to replace the learned deconvoltuional layers in detection. If you are working on high resolution images, maybe the learned deconvoltuinoal layer can give better performance.

@jsjs0827
Copy link
Author

So appreciated for your reply.
About the first question,I would check it myself right now.
I do the experiments in caffe,the deconv layer used is the inherent layer in caffe,should I follow a relu after the deconv layer?Which is the better combination for the deconv?

@chengyangfu
Copy link
Owner

I didn't use the ReLU. You can try different values for the parameter "group". I think it will be helpful.
Another thing I found is useful is adding 3x3 conv filter and BN after deconvolution.

Efficient : bilinear upsampling directly.
Better way : Deconvolution + 3x3conv + BN

@jsjs0827
Copy link
Author

Yeah, I used the combination myself before,but the feature map I get is not very good for the detection.You use the deconv for what,specific task?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants