[WIP][Runtime]Pipeline Executor For Compute graph pipeline #7892
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
huajsj
changed the title
|
Thanks @tqchen for the follow up, I proposed a RFC(https://discuss.tvm.apache.org/t/rfc-compute-graph-pipeline-with-new-subgraph-executor/9839) to explain the motivation and solution architecture as reference. |
huajsj
changed the title
huajsj
changed the title
comaniac
requested changes
May 4, 2021
comaniac
requested changes
Jun 1, 2021
| params : dict of str to NDArray | ||
| Additional arguments | ||
| """ | ||
| if key is not None: |
There was a problem hiding this comment.
Why key and value are allowed to be None?
There was a problem hiding this comment.
Didn't see the fix? Why we need if key is not None?
huajsj
force-pushed
the
main
branch
4 times, most recently
from
6061ae2 to
1c67a87
Compare
|
I'm busy with other tasks in recent days. Will try to take another look when I got a chance. |
comaniac
requested changes
Jun 23, 2021
huajsj
force-pushed
the
main
branch
2 times, most recently
from
2947327 to
62e4d5f
Compare
|
@comaniac, if you have time , could you help for a review. thanks. |
15 tasks
huajsj
requested review from
areusch,
jroesch,
junrushao,
kazum,
liangfu,
masahi,
merrymercy,
tmoreau89,
tqchen,
vinx13,
yzhliu,
zhiics,
ZihengJiang and
a team
as code owners
masahi
reviewed
Sep 3, 2021
|
|
||
| template <typename SLOT_TYPE = SLOT> | ||
| void deleteQueue(squeue<SLOT_TYPE>* q) { | ||
| free(q); |
masahi
reviewed
Sep 3, 2021
| #include <assert.h> | ||
| #include <sched.h> | ||
| #include <string.h> | ||
| #include <sys/syscall.h> |
|
Thanks @huajsj. Please respect our coding style and standard good programming practices:
|
HungYangChang
approved these changes
Oct 1, 2021
[Finding]
the final output is same with constant value, seems like input data is
0, this is because the get input index have a '+1' operation, but the
input index already start from 0. the means when doing setinput('x',..) it
should get convert to setinput(0, ..), but the wrong logic is
setinput(1,..).
|
IIUC, this PR should be out-of-date? Should we close? |
|
@comaniac , yes we should close this PR, closed it now. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Issue:
SOC hardware plarform have multiple types compute chipset like
GPU,FPGA,APU,RPU etc, there is a requirement that use these compute
unit in parallel to reach best performance.
Solution:
In these pipeline solution, we first split the compute graph into
a group of subgraph, then run these subgraph in a pipeline module
to make the GPU/FPGA/APU/RPU parallel running become possible.
Thanks for contributing to TVM! Please refer to guideline https://tvm.apache.org/docs/contribute/ for useful information and tips. After the pull request is submitted, please request code reviews from Reviewers by @ them in the pull request thread.