New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

A question on stacked_lstm model for sent140 #29

Open

ddayzzz opened this issue Jul 31, 2020 · 0 comments

ddayzzz commented Jul 31, 2020

I have a question that should I add activation function, such as relu, between the lstm output and last dense layer?

leaf/models/sent140/stacked_lstm.py

Line 37 in 70b85d9

fc1 = tf.layers.dense(inputs=outputs[:, -1, :], units=128)

My change:

fc1 = tf.layers.dense(inputs=outputs[:, -1, :], units=128, activation=tf.nn.relu)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment