You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As discussed in #883, grouped convolutions (i.e., groups>1) are only supported when in_channels == out_channels == groups. LowerConvsToMatMul fails with a reshape error.
New behavior
Ideally, it would be great to expand support for arbitrary grouped convolutions. In particular, it could be low hanging fruit to expand current support to allow in_channels == groups and out_channels = n*groups (where n is an integer >1) as this would simply result in individual input channels being broadcasted to multiple output channels.
Motivation
Current support handles the common case of standard depthwise-separable convolutions well, but grouped convolutions are becoming more popular as a general optimization strategy to reduce the amount of weights / ops in a given layer.
Parts of FINN affected
Certainly the LowerConvsToMatMul transform in the FINN compiler is affected. It's likely that some changed would need to be made to FINN-HLSLIB as well.
The text was updated successfully, but these errors were encountered:
Details
As discussed in #883, grouped convolutions (i.e.,
groups>1
) are only supported whenin_channels == out_channels == groups
.LowerConvsToMatMul
fails with a reshape error.New behavior
Ideally, it would be great to expand support for arbitrary grouped convolutions. In particular, it could be low hanging fruit to expand current support to allow
in_channels == groups
andout_channels = n*groups
(where n is an integer >1) as this would simply result in individual input channels being broadcasted to multiple output channels.Motivation
Current support handles the common case of standard depthwise-separable convolutions well, but grouped convolutions are becoming more popular as a general optimization strategy to reduce the amount of weights / ops in a given layer.
Parts of FINN affected
Certainly the
LowerConvsToMatMul
transform in the FINN compiler is affected. It's likely that some changed would need to be made toFINN-HLSLIB
as well.The text was updated successfully, but these errors were encountered: