Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

习题7-6 #57

Open
simo-an opened this issue Jan 7, 2022 · 0 comments
Open

习题7-6 #57

simo-an opened this issue Jan 7, 2022 · 0 comments

Comments

@simo-an
Copy link

simo-an commented Jan 7, 2022

题目

image
参考公式如下
image

解答

  1. 𝑓(BN(𝑾𝒂(𝑙−1) + 𝒃)) 表示线性计算之后、非线性激活之前(即净输入 𝒛(𝑙))进行 批归一化
  2. 𝑓(𝑾BN(𝒂(𝑙−1)) + 𝒃) 表示上一层的输出,即当前层线性计算之前进行 批归一化

使用第一种批归一化方式,可以避免线性计算对分布的改变

@simo-an simo-an changed the title 习题7-6(coming) 习题7-6 Jan 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant