How to set the external mode

[sansi-zhang]

Hi everyone,

If I want to run my application using external mode, what changes do I need to make from the original mode (e.g. MVU and VVAU)

Thanks.

[fpjentzsch]

Hi,

you should be able to set mem_mode of select MVAU/VVAU nodes to external via the folding config. The ZynqBuild flow should then attach DMA IP cores to their weight stream interfaces in the block design. The FINN-generated PYNQ driver should also support this feature:

finn/src/finn/qnn-data/templates/driver/driver_base.py

Line 113 in b3bdff1

def load_external_weights(self):

However, I've not used this feature myself for a while. Hopefully someone else can chime in if I missed anything.

[sansi-zhang]

Hi,

you should be able to set mem_mode of select MVAU/VVAU nodes to external via the folding config. The ZynqBuild flow should then attach DMA IP cores to their weight stream interfaces in the block design. The FINN-generated PYNQ driver should also support this feature:

finn/src/finn/qnn-data/templates/driver/driver_base.py

Line 113 in b3bdff1

def load_external_weights(self):

However, I've not used this feature myself for a while. Hopefully someone else can chime in if I missed anything.

Thank you for your reply.

You mean that if I want to use the external mode, I need to extract the desired weights for the layer I want to set and save the.npy file. Does this automatically discard the weights written into the onnx model?

[sansi-zhang]

Hi,

you should be able to set mem_mode of select MVAU/VVAU nodes to external via the folding config. The ZynqBuild flow should then attach DMA IP cores to their weight stream interfaces in the block design. The FINN-generated PYNQ driver should also support this feature:

finn/src/finn/qnn-data/templates/driver/driver_base.py

Line 113 in b3bdff1

def load_external_weights(self):

However, I've not used this feature myself for a while. Hopefully someone else can chime in if I missed anything.

I'm sorry to bother you again.

I directly set the external mode when setting folding as you suggested, but it will report that "orig_weight_matrix" is NoneType.

By querying the error message, I tried to save the weight.npy format weight of the layer I needed to set external in a specific folder, and set "code_gen_dir_ipgen" as the corresponding folder.

However, it will affect the storage location and read location of other files are different. This causes an error that the file cannot be found.