-
Notifications
You must be signed in to change notification settings - Fork 17
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
pderakhshanfar
committed
Mar 8, 2019
1 parent
c411f79
commit 8bbcf81
Showing
2 changed files
with
12 additions
and
20 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
8bbcf81
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is it really intended to reduce the trials from 50 to 5?
8bbcf81
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We noticed that using 50 trials leads to more time taking mutation operation, thereby slowing down the search process. Also, reducing the trials helps Botsing to generate and evaluate more tests without losing guidance.
8bbcf81
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ok I understand. My guess would be that it does not happen very often that a mutation loses a public call. In that case it should not come to slowing down. If it occurs frequently in a specific case and several test cases are affected, there is a risk that reducing the number of trials will lower the mutation rate. In this case, it would be interesting to know how large the proportion of non-mutated test cases is that would have mutated in 50 trials.
Btw, thanks for this commit. I only noticed the fault at the crossover operator, but together with this fix, Botsing finally achieves expected effectiveness based on your evaluations 👍