Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Snippets] MHA combo (Transpose, Softmax) #14094

Closed
wants to merge 19 commits into from
Closed

[Snippets] MHA combo (Transpose, Softmax) #14094

wants to merge 19 commits into from

Conversation

a-sidorova
Copy link
Contributor

Details:

  • item1
  • ...

Tickets:

  • ticket-id

@a-sidorova a-sidorova force-pushed the feature/snippets/mha_common branch from be9e0a2 to 86562ff Compare November 18, 2022 13:12
@dmitry-gorokhov dmitry-gorokhov added the category: CPU OpenVINO CPU plugin label Nov 21, 2022
@a-sidorova a-sidorova force-pushed the feature/snippets/mha_common branch from 86562ff to 6fc12d4 Compare November 22, 2022 10:38
IvanNovoselov and others added 14 commits November 23, 2022 12:20
@IvanNovoselov
[Snippets] Dynamic tiles snapshot
89490ea
@IvanNovoselov
[Snippets] Explicit Tiles implementation
ebde2ea
@IvanNovoselov
[Snippets] Explicit Tiles review comments No. 1
8c84e14
@IvanNovoselov
Introduced MemoryAcess op & fixed scalar2vector Load/Store conversion…
af66a47 
… in generator
@IvanNovoselov
[Snippets] Transpose tokenization support
89605c5
@IvanNovoselov
[Snippets] Communicate plugin shapes through rt_info
d317da3
@IvanNovoselov
Review comments No 1
807dde4
@IvanNovoselov
Throw exception from TransposeDecomposition if Transpose is not after…
eda6c89 
… Parameter
@a-sidorova @IvanNovoselov
Added config parameter to disable MHA ops tokenization
ffd3573
@IvanNovoselov
Disable Transpose tokenization if internal config flag is not set
6a19837
@IvanNovoselov
Update snippets functional tests with respect to new scheduling
907a211 
communication approach
@IvanNovoselov
Revert debug changes to CMakeLists: cpuDebugFuncTests files
5d9b9e8
@IvanNovoselov
Minor cleanup + NonDefaultAcessPattern to Layout
6577147
@IvanNovoselov
Added Transpose to op_supports_only_exec_type
a153865
@a-sidorova a-sidorova force-pushed the feature/snippets/mha_common branch 2 times, most recently from 9e3b4c5 to 0fd0f94 Compare November 29, 2022 06:00
a-sidorova and others added 5 commits November 29, 2022 10:24
@a-sidorova
[Snippets] Added Softmax support
2caa808 
[Snippets] Added support for Reshape around Softmax

applied comment part

Added config parameter to disable MHA ops tokenization
@a-sidorova
[Snippets] Added Select support
cd15c2a 
[Snippets] Added Broadcast support
@a-sidorova
[Snippets] MHA Tokenization
1e25a4b 
[Snippets] Added Transpose+Softmax tests
@IvanNovoselov @a-sidorova
[Snippets] Added MatMul support
60d3ea5
@a-sidorova
Changes for MatMul
b6fe09b
@a-sidorova a-sidorova force-pushed the feature/snippets/mha_common branch from 0fd0f94 to b6fe09b Compare November 30, 2022 07:47
@a-sidorova
Copy link
Contributor Author

Closed because of merging into local branch

@a-sidorova a-sidorova closed this Dec 23, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
category: CPU OpenVINO CPU plugin
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@a-sidorova @dmitry-gorokhov @IvanNovoselov