MatMul at the input not getting Converted to MatrixVectorActivation layer after convert_to_hls step in streamlining #1073
Unanswered
shashwat1198
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello,
I had a question regarding why a MatMul node at the input of the graph is not getting Converted to MatrixVectorActivation layer after convert_to_hls step during hardware generation.
Due to this, this Matmul does not get included in the dataflow partition created by FINN and hence not included in the final hardware design.
I have attached the convert_to_hls model_ onnx file and the onnx model of dataflow_parent file step here. Any pointers to get the Matmul layer inside the partition would be very helpful.
P.S : When I set the input quantizer to INT8 then that MatMul layer gets absorbed in the dataflow partition that FINN creates but one Multithreshold node is still excluded from the partition in that implementation as well. I am attaching the onnx files for this variant here as well.
So basically what should I do to make sure all nodes that get the input are inferred as some hardware block in the convert_to_hls step?
Beta Was this translation helpful? Give feedback.
All reactions