You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Many modern models utilize GroupNorm, there is support for LayerNorm and InstanceNorm under tvm/relay/op/nn. It is especially helpful for training with low number of samples and more efficient than instance norm in terms of parameters. It would be valuable addition to add it to core set of operators as libraries like pytorch or mxnet already support it.
The text was updated successfully, but these errors were encountered:
Many modern models utilize GroupNorm, there is support for LayerNorm and InstanceNorm under tvm/relay/op/nn. It is especially helpful for training with low number of samples and more efficient than instance norm in terms of parameters. It would be valuable addition to add it to core set of operators as libraries like pytorch or mxnet already support it.
The text was updated successfully, but these errors were encountered: