[Ansor][AutoTVM v2.0] Phase 2: Evolutionary Search #6310
Conversation
comaniac
force-pushed
the
ansor_evo_search
branch
from
de6e232 to
6cf122b
Compare
comaniac
force-pushed
the
ansor_evo_search
branch
from
c4ff93f to
1eeae6a
Compare
tests/python/unittest/test_auto_scheduler_evolutionary_search.py
Outdated
Show resolved
Hide resolved
| } | ||
| } | ||
|
|
||
| *state = policy->search_task->compute_dag.InferBound(*state); |
There was a problem hiding this comment.
This InferBound is required during SampleInitPopulation. However, it introduces a redundant InferBound during EvolutionarySearch. We should remove it during EvolutionarySearch.
There was a problem hiding this comment.
Good catch. Miss this line when moving the function.
There was a problem hiding this comment.
Hmm I realized that it's hard to recognize if this is being used by initial population or mutation. Do you have any suggestions? Or should we just simply remove this mutation in the initial population as @jcf94 suggested?
There was a problem hiding this comment.
@comaniac We should not remove it. I think it is useful in SampleInitPopulation and further improvement can be done here to make the initial population better.
To solve the issue, we can create a new function for the common part and create two separate rules.
On rule only calls the common part, while the other rule calls the common part + InferBound.
comaniac
force-pushed
the
ansor_evo_search
branch
2 times, most recently
from
755d1b2 to
2b7a3f8
Compare
comaniac
force-pushed
the
ansor_evo_search
branch
from
3c24580 to
ee26b83
Compare
|
The test case looks good to me. The two remaining items:
|
|
@merrymercy comment addressed. PTAL. |
* init commit * Add rest rules * refactor * address comments * improve test * address comments
* init commit * Add rest rules * refactor * address comments * improve test * address comments
* init commit * Add rest rules * refactor * address comments * improve test * address comments
For the full upstream plan, see Ansor RFC.
This PR adds evolutionary search implementations to the auto-scheduler:
cc @merrymercy @jcf94 @tqchen. The checked 3 parts are ready to be reviewed. It's also fine if you guys prefer to put the rest mutation rules to a separate PR.