How to reduce RAM utilization in FINN?

[MFJI]

Hello,

Anybody knows what can be the ways to reduce RAM utilization in FINN implementation?

Thanks.

[Ba1tu3han]

Hello,

Anybody knows what can be the ways to reduce RAM utilization in FINN implementation?

Thanks.

Hello,

You should modify the folding configuration file (PE and SIMD parameters). As reference, look at the folding notebook in advance notebooks.

Batuhan

[MFJI]

Hello Batuhan,

Thank you for your answer. When the parallelism is already the lowest, is there still a way to reduce the RAM utilization?

[Ba1tu3han]

Indeed this kind of modifications have limits. You can try to use DSP and LUT instead of RAM by configuration file parameters. I can recommend that you should try to reduce number of parameters in your model. It effects so much.

[MFJI]

Thank you for your answer. What is the way to define which resource (LUT, BRAM, URAM?) to use as RAM in FINN?

[Ba1tu3han]

You should check this notebook and change ram_style as auto, distributed, block or ultra in custom configuration file that is created by yourself.

finn/notebooks/advanced/4_advanced_builder_settings.ipynb

Line 987 in e3087ad

"* `resType`: This is a node attribute for the MVAU layer and can be set to `lut` or `dsp`. Please note that selecting `dsp` will not enable the optimized RTL variant of the MVAU but rather generate HLS code utilizing DSPs, this is not optimal yet but can give an additional parameter for design space exploration.\n",

Please check this notebook for the folding filehttps://github.com/Xilinx/finn/blob/e3087ad9fbabcc35f21164d415ababec4f462e9f/notebooks/advanced/3_folding.ipynb

[MFJI]

Thank you so much