New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请教模型是如何利用3588的npu计算的 #16

Open

YuRui997 opened this issue Oct 9, 2023 · 1 comment

YuRui997 commented Oct 9, 2023

作者要是有空，是否可以讲解一下代码是如何利用3588的npu的呢

Contributor

keveman commented Oct 10, 2023

@YuRui997 We use the matmul API from librknnrt to perform all the matrix multiplications needed in the transformer model. Have a look here https://github.com/usefulsensors/useful-transformers/blob/main/lib/matmul.cc#L107-L117 for the wrapper over matmul API and look for calls to Matmul::call in different parts of the code.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment