Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expand support for grouped convolutions #918

Open
nickfraser opened this issue Nov 9, 2023 · 0 comments
Open

Expand support for grouped convolutions #918

nickfraser opened this issue Nov 9, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@nickfraser
Copy link
Collaborator

Details

As discussed in #883, grouped convolutions (i.e., groups>1) are only supported when in_channels == out_channels == groups. LowerConvsToMatMul fails with a reshape error.

New behavior

Ideally, it would be great to expand support for arbitrary grouped convolutions. In particular, it could be low hanging fruit to expand current support to allow in_channels == groups and out_channels = n*groups (where n is an integer >1) as this would simply result in individual input channels being broadcasted to multiple output channels.

Motivation

Current support handles the common case of standard depthwise-separable convolutions well, but grouped convolutions are becoming more popular as a general optimization strategy to reduce the amount of weights / ops in a given layer.

Parts of FINN affected

Certainly the LowerConvsToMatMul transform in the FINN compiler is affected. It's likely that some changed would need to be made to FINN-HLSLIB as well.

@nickfraser nickfraser added the enhancement New feature or request label Nov 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant