Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] [CPU] [ARM] Paged attention optimization for aarch64 #26975

Open
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

samkitshah1262
Copy link

@samkitshah1262 samkitshah1262 commented Oct 9, 2024

@samkitshah1262 samkitshah1262 requested review from a team as code owners October 9, 2024 13:20
@github-actions github-actions bot added the category: CPU OpenVINO CPU plugin label Oct 9, 2024
@sys-openvino-ci sys-openvino-ci added the ExternalPR External contributor label Oct 9, 2024
@ashwins990
Copy link

Hi @samkitshah1262,
I am getting the following error while building the code [Aws Graviton 3E]

openvino/src/plugins/intel_cpu/src/nodes/kernels/scaled_attn/executor_pa_common.cpp:113:6: error: ‘JitMatMulVecAARCH64’ has not been declared
113 | void JitMatMulVecAARCH64::generate() {
| ^~~~~~~~~~~~~~~~~~~
openvino/src/plugins/intel_cpu/src/nodes/kernels/scaled_attn/executor_pa_common.cpp:113:6: warning: no previous declaration for ‘void ov::Extensions::Cpu::generate()’ [-Wmissing-declarations]
openvino/src/plugins/intel_cpu/src/nodes/kernels/scaled_attn/executor_pa_common.cpp: In function ‘void ov::Extensions::Cpu::generate()’:
openvino/src/plugins/intel_cpu/src/nodes/kernels/scaled_attn/executor_pa_common.cpp:115:10: error: ‘m_head_size’ was not declared in this scope

JitMatMulVecAARCH64 is not defined. Could you please check. Thanks !!

@ilya-lavrenov ilya-lavrenov added the platform: arm OpenVINO on ARM / ARM64 label Oct 31, 2024
Copy link
Contributor

This PR will be closed in a week because of 2 weeks of no activity.

@github-actions github-actions bot added the Stale label Nov 17, 2024
@mg-intel mg-intel removed the Stale label Nov 19, 2024
@samkitshah1262
Copy link
Author

Sorry @ashwins990 , couldn't work on this. Will look into this.

Copy link
Contributor

This PR will be closed in a week because of 2 weeks of no activity.

@github-actions github-actions bot added the Stale label Dec 10, 2024
@mg-intel mg-intel removed the Stale label Dec 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: CPU OpenVINO CPU plugin ExternalPR External contributor platform: arm OpenVINO on ARM / ARM64
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature Request]: Optimize PagedAttention operation on aarch64 HW
6 participants