Use auto-tuner to improve conv2d_gemm performance #6117
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
cc @FrozenGene @anijain2305 @u99127 Please note that since I will be off from Friday (for 15 days), I might turn this into a draft and pick it up when I come back (since it is self-contained it should not be an issue) |
|
Hi @anijain2305 , I just got back from holidays and ready for reviewing this ! |
added 2 commits
August 12, 2020 12:06
The following tuning entities have been introduced: - Unrolling and vectorizing input matrix transform - Reordering gemm to exploit parallel threads - Unrolling `gemm_quantized` intrinsic - Interleaving `gemm_quantized` intrinsic Change-Id: Icd3ab005663f78a80672e71ef368f6d0efa4a401
giuseros
force-pushed
the
autotuner_improvements
branch
from
f3565f2 to
07a330a
Compare
Change-Id: I77d880424c3e7ce9de67c970ddb2cf2a92b52f79
|
Hi @FrozenGene , @anijain2305 , Thanks a lot, |
anijain2305
approved these changes
Aug 18, 2020
There was a problem hiding this comment.
LGTM! @FrozenGene Please review and merge if it looks good.
|
i can not spare time in reviewing this. Will do it tomorrow. |
Change-Id: Ic58d1138ab96d58d12f5855f0e1044f10d9e6e9b
|
Hi @FrozenGene , Thanks again, |
FrozenGene
approved these changes
Aug 26, 2020
FrozenGene
reviewed
Aug 26, 2020
|
Thanks @giuseros @anijain2305 It is merged now. |
trevor-m
pushed a commit
to trevor-m/tvm
that referenced
this pull request
Aug 26, 2020
* Use auto-tuner to improve conv2d_gemm performance The following tuning entities have been introduced: - Unrolling and vectorizing input matrix transform - Reordering gemm to exploit parallel threads - Unrolling `gemm_quantized` intrinsic - Interleaving `gemm_quantized` intrinsic Change-Id: Icd3ab005663f78a80672e71ef368f6d0efa4a401 * Rebasing Change-Id: Id27b6de705b16b93df8e885868961fa0321497be * Fix python linting Change-Id: I77d880424c3e7ce9de67c970ddb2cf2a92b52f79 * Fusing batch into inner dimensions before parallelizing Change-Id: Ic58d1138ab96d58d12f5855f0e1044f10d9e6e9b
trevor-m
pushed a commit
to trevor-m/tvm
that referenced
this pull request
Aug 26, 2020
* Use auto-tuner to improve conv2d_gemm performance The following tuning entities have been introduced: - Unrolling and vectorizing input matrix transform - Reordering gemm to exploit parallel threads - Unrolling `gemm_quantized` intrinsic - Interleaving `gemm_quantized` intrinsic Change-Id: Icd3ab005663f78a80672e71ef368f6d0efa4a401 * Rebasing Change-Id: Id27b6de705b16b93df8e885868961fa0321497be * Fix python linting Change-Id: I77d880424c3e7ce9de67c970ddb2cf2a92b52f79 * Fusing batch into inner dimensions before parallelizing Change-Id: Ic58d1138ab96d58d12f5855f0e1044f10d9e6e9b
trevor-m
pushed a commit
to trevor-m/tvm
that referenced
this pull request
Aug 26, 2020
* Use auto-tuner to improve conv2d_gemm performance The following tuning entities have been introduced: - Unrolling and vectorizing input matrix transform - Reordering gemm to exploit parallel threads - Unrolling `gemm_quantized` intrinsic - Interleaving `gemm_quantized` intrinsic Change-Id: Icd3ab005663f78a80672e71ef368f6d0efa4a401 * Rebasing Change-Id: Id27b6de705b16b93df8e885868961fa0321497be * Fix python linting Change-Id: I77d880424c3e7ce9de67c970ddb2cf2a92b52f79 * Fusing batch into inner dimensions before parallelizing Change-Id: Ic58d1138ab96d58d12f5855f0e1044f10d9e6e9b
trevor-m
pushed a commit
to trevor-m/tvm
that referenced
this pull request
Sep 2, 2020
* Use auto-tuner to improve conv2d_gemm performance The following tuning entities have been introduced: - Unrolling and vectorizing input matrix transform - Reordering gemm to exploit parallel threads - Unrolling `gemm_quantized` intrinsic - Interleaving `gemm_quantized` intrinsic Change-Id: Icd3ab005663f78a80672e71ef368f6d0efa4a401 * Rebasing Change-Id: Id27b6de705b16b93df8e885868961fa0321497be * Fix python linting Change-Id: I77d880424c3e7ce9de67c970ddb2cf2a92b52f79 * Fusing batch into inner dimensions before parallelizing Change-Id: Ic58d1138ab96d58d12f5855f0e1044f10d9e6e9b
trevor-m
pushed a commit
to neo-ai/tvm
that referenced
this pull request
Sep 3, 2020
* Use auto-tuner to improve conv2d_gemm performance The following tuning entities have been introduced: - Unrolling and vectorizing input matrix transform - Reordering gemm to exploit parallel threads - Unrolling `gemm_quantized` intrinsic - Interleaving `gemm_quantized` intrinsic Change-Id: Icd3ab005663f78a80672e71ef368f6d0efa4a401 * Rebasing Change-Id: Id27b6de705b16b93df8e885868961fa0321497be * Fix python linting Change-Id: I77d880424c3e7ce9de67c970ddb2cf2a92b52f79 * Fusing batch into inner dimensions before parallelizing Change-Id: Ic58d1138ab96d58d12f5855f0e1044f10d9e6e9b
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
High level description of this contribution
The following tuning entities have been introduced:
gemm_quantizedintrinsicgemm_quantizedintrinsicMain files touched:
topi/python/topi/arm_cpu/tensor_intrin.pytopi/python/topi/arm_cpu/conv2_gemm.pyRFC
The RFC for this submission is available here
Change-Id: Icd3ab005663f78a80672e71ef368f6d0efa4a401