Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
Hatsunespica authored Nov 25, 2023
1 parent 3885c97 commit 0c35784
Showing 1 changed file with 4 additions and 6 deletions.
10 changes: 4 additions & 6 deletions benchmark/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,19 +28,17 @@ Instructions on benchmakring alive-mutate

# Suggsted workflow
## Fuzzing
1. Change the location of alive-mutate in run.sh if necessary
2. Execute run.sh
3. Check mutants in tmp
1. Execute run.sh
2. Check mutants in tmp
### Suggested customization
1. Add more files to tests folder and rerun run.sh. You can start with files in https://github.com/llvm/llvm-project/tree/main/llvm/test/Transforms/InstCombine . Randomly select a subset of .ll files, place them under tests folder, and rerun run.sh. You should find new mutants.
2. Change the command calling alive-mutate like add '--pass="instcombine"' for a different optimization pass. You can also type "alive-mutate --help" to see all arguments.
3. Change the command '-n 10' to '-n X' where X is the number of mutants you want to generate. Also, you can replace it with '-t 1'. This will make alive-mutate keeps running for 1 second.


## Throughput experiment
1. Change the location of alive-mutate in the global variable **ALIVE_PATH** if necessary
2. Execute bench.py
3. Check results in res.txt
1. Execute bench.py
2. Check results in res.txt
### Suggested customization
1. Add more fiels to tests folder and rerun bench.py. For example, you can randomly select a number of files from LLVM repo. You can start with files in https://github.com/llvm/llvm-project/tree/main/llvm/test/Transforms/InstCombine . Randomly select a subset of .ll files, place them under tests folder, and rerun bench.py. You should find those added tests in the final res.txt.
2. Change the global variable **COUNT** in bench.py. This variable controls the number of mutants generated for each input file.
Expand Down

0 comments on commit 0c35784

Please sign in to comment.