Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MFU Not Displaying #1038

Open
nandeeka opened this issue Nov 19, 2024 · 1 comment
Open

MFU Not Displaying #1038

nandeeka opened this issue Nov 19, 2024 · 1 comment
Labels

Comments

@nandeeka
Copy link

In the Neuron profile, the MFU seems to not be displayed correctly. Despite using a matrix multiplication kernel), in the default AMI (launched on November 12), I see an MFU of 0%:
Screenshot 2024-11-19 at 11 59 03 AM
Similarly, after updating the environment using artifacts from @aws-serina-tan , I see an MFU of NaN%:
Screenshot 2024-11-19 at 12 01 32 PM

@fayyadd
Copy link

fayyadd commented Nov 19, 2024

Thanks for filing this issue, the team is working on a fix for this and will update once the fix is released.

For now, assuming the matmul kernel doesn't have any transposes, you can rely on the HFU number.

@fayyadd fayyadd added the NKI label Nov 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants