Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Will you or did you try Group Normalization #5

Open
XCRobert opened this issue Apr 7, 2019 · 1 comment
Open

Will you or did you try Group Normalization #5

XCRobert opened this issue Apr 7, 2019 · 1 comment

Comments

@XCRobert
Copy link

XCRobert commented Apr 7, 2019

According to your paper, BN plays a critical role training from scratch. Did you try Group Normalization ? Does Group Normalization have better perfomance than some pretrained ones.
According your assumption,it may also works.
image
@KimSoybean
Copy link
Owner

@XCRobert Hello, I have tried GN on ScratchDet on mmdetection and get 1 mAP lower result than BN. Sorry I haven't found the reason but I think it is relevant to learning rate. But more details should be given in analysis with gradients. I will do that after I get my IELTS testing passed. Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@XCRobert @KimSoybean