You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm not so sure anymore. Using the feature dim is very standard for dropout.
You might argue that we never should use this concept of default feature dim. However, it is used in many places, even e.g. nn.Linear (#75). Also, as it was discussed before (rwth-i6/returnn#586 (comment)), maybe having a feature dim is actually not too much a problem. Except for those rare cases where it can become ambiguous but then we should just require those to be non-ambiguous.
But this discussion does not really belong here but to #17 instead.
I just say, if we make use in some places, e.g. also nn.Linear, then it should be ok here as well.
Related: #69, #76
The text was updated successfully, but these errors were encountered: