Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DGFuzz Testing #2000

Open
wants to merge 39 commits into
base: master
Choose a base branch
from
Open

DGFuzz Testing #2000

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
39 commits
Select commit Hold shift + click to select a range
566edb3
First attempt at integrating dgfuzz
DanBlackwell Jul 6, 2024
910f093
Fixed DGFuzz fuzzer.py (tested on libpcap only)
DanBlackwell Jul 6, 2024
8589be6
clone DGFuzz from Github
DanBlackwell Jul 7, 2024
836f2ee
Add dummy comment to make gcbrun happy
DanBlackwell Jul 8, 2024
18b6d84
Make that linter happy
DanBlackwell Jul 8, 2024
73a85d5
disable merge with main experiment
DanBlackwell Jul 8, 2024
15fc38d
Set unsupported_fuzzers correctly for dgfuzz
DanBlackwell Jul 8, 2024
7b9d958
Update DGFuzz to weight target bytes
DanBlackwell Jul 10, 2024
51dcfde
Bump DGFuzz version with tweaked parameters
DanBlackwell Jul 11, 2024
7b34460
Fix for apt related build error (missing apt-get update)
DanBlackwell Jul 11, 2024
bf9344b
Added dgfuzz_control fuzzer (dgfuzz without dataflow guidance)
DanBlackwell Jul 11, 2024
eacae1b
Added 2 alternative setups (faster, and faster + exhaustive searching)
DanBlackwell Jul 17, 2024
bc7d4df
Add alternative setups to test unpruned sancov instrumentation
DanBlackwell Jul 21, 2024
199712d
Added variant with if- to cmov optimisation disabled (more coverage f…
DanBlackwell Jul 22, 2024
750316b
added new exhaustive search algo for eval
DanBlackwell Jul 22, 2024
ec264bc
Fix bug in certain commits and add extra setup with endianness swappi…
DanBlackwell Jul 28, 2024
dfb8dba
Disable building benchmarks that do not currently compile with DFSan
DanBlackwell Jul 30, 2024
3abd7b4
Added dgfuzz_653cc9 with stable edge numbers between compilations
DanBlackwell Aug 2, 2024
305f56a
Temporarily disable merge_with_nonprivate
DanBlackwell Aug 5, 2024
17ba333
Temporarily disable harfbuzz
DanBlackwell Aug 6, 2024
15beef1
Revert "Adding local implementation for queue based measuring (#1998)"
DanBlackwell Aug 6, 2024
7f92991
Added dgfuzz_d3c951 with CmpLog filtering
DanBlackwell Aug 12, 2024
2e487ad
Added dgfuzz_83ca1e setup
DanBlackwell Aug 18, 2024
004232c
Added dgfuzz_3dfa24 with cmplog stuff reverted and some other new ideas
DanBlackwell Aug 19, 2024
4db9663
Added dgfuzz_20e7e8 with new direct neighbour computation and redone …
DanBlackwell Aug 22, 2024
a051ad7
Added dgfuzz_20e7e8 with minor fixes
DanBlackwell Aug 22, 2024
db011eb
Added dgfuzz_dc6e84_rand_sched to test random scheduler with dataflow…
DanBlackwell Aug 23, 2024
67c4f9c
Added dgfuzz_93227b with compiler fix, and new prescient cmplog imple…
DanBlackwell Aug 26, 2024
3eb1a47
Added trial setups for dgfuzz_065684_depth_(1|2|3)
DanBlackwell Aug 27, 2024
74a35d0
Added dgfuzz_8d1cc7 with new edge alignment approach
DanBlackwell Aug 29, 2024
d159f7f
Added dgfuzz_e0d055 with some performance tweaks
DanBlackwell Sep 2, 2024
784244f
Added dgfuzz_22997c with updated DFSan havoc logic and some mutation …
DanBlackwell Sep 4, 2024
c7221b4
Add extra log for retcode upon coverage measurer failure
DanBlackwell Sep 4, 2024
7040c8d
Added dgfuzz_0ebf1a9 with bug fixes
DanBlackwell Sep 5, 2024
611e73c
Added dgfuzz_7fa3ff with Bloom filtering
DanBlackwell Sep 8, 2024
3edc8c0
Added dgfuzz_e989ba with small improvements
DanBlackwell Sep 9, 2024
b4d4c20
Added setups dgfuzz_1d7283 dgfuzz_32d973 with OOM fixes
DanBlackwell Sep 11, 2024
95b7793
Added dgfuzz_49a0ef with small improvements and libafl cmplog
DanBlackwell Sep 12, 2024
09646ec
Added dgfuzz_23de6c with const cmplog built in and prescient cmplog d…
DanBlackwell Sep 15, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file modified analysis/test_data/pairwise_unique_coverage_heatmap-failed-diff.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
9 changes: 9 additions & 0 deletions benchmarks/bloaty_fuzz_target/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,3 +26,12 @@ unsupported_fuzzers:
- symqemu_aflplusplus
- fuzzolic_aflplusplus_fuzzy
- fuzzolic_aflplusplus_z3dict
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
9 changes: 9 additions & 0 deletions benchmarks/bloaty_fuzz_target_52948c/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,3 +28,12 @@ unsupported_fuzzers:
- symqemu_aflplusplus
- fuzzolic_aflplusplus_fuzzy
- fuzzolic_aflplusplus_z3dict
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
9 changes: 9 additions & 0 deletions benchmarks/curl_curl_fuzzer_http/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,3 +23,12 @@ unsupported_fuzzers:
- libfuzzer_dataflow_store
- centipede
- centipede_function_filter
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
10 changes: 10 additions & 0 deletions benchmarks/freetype2_ftfuzzer/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,3 +16,13 @@ commit: cd02d359a6d0455e9d16b87bf9665961c4699538
commit_date: 2023-01-28T16:04:38+00:00
fuzz_target: ftfuzzer
project: freetype2
unsupported_fuzzers:
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
8 changes: 8 additions & 0 deletions benchmarks/harfbuzz_hb-shape-fuzzer/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,3 +18,11 @@ fuzz_target: hb-shape-fuzzer
project: harfbuzz
unsupported_fuzzers:
- klee
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
9 changes: 9 additions & 0 deletions benchmarks/harfbuzz_hb-shape-fuzzer_17863b/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,3 +20,12 @@ project: harfbuzz
type: bug
unsupported_fuzzers:
- klee
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
9 changes: 9 additions & 0 deletions benchmarks/jsoncpp_jsoncpp_fuzzer/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,3 +26,12 @@ unsupported_fuzzers:
- symqemu_aflplusplus
- fuzzolic_aflplusplus_fuzzy
- fuzzolic_aflplusplus_z3dict
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
9 changes: 9 additions & 0 deletions benchmarks/libjpeg-turbo_libjpeg_turbo_fuzzer/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,3 +18,12 @@ fuzz_target: libjpeg_turbo_fuzzer
project: libjpeg-turbo
unsupported_fuzzers:
- aflcc
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
10 changes: 10 additions & 0 deletions benchmarks/libpng_libpng_read_fuzzer/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,3 +16,13 @@ commit: cd0ea2a7f53b603d3d9b5b891c779c430047b39a
commit_date: 2023-01-09T13:17:31+00:00
fuzz_target: libpng_read_fuzzer
project: libpng
unsupported_fuzzers:
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
10 changes: 10 additions & 0 deletions benchmarks/libxml2_xml/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,3 +16,13 @@ commit: c7260a47f19e01f4f663b6a56fbdc2dafd8a6e7e
commit_date: 2023-01-23T09:19:59+00:00
fuzz_target: xml
project: libxml2
unsupported_fuzzers:
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
10 changes: 10 additions & 0 deletions benchmarks/libxml2_xml_e85b9b/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,3 +18,13 @@ commit_date: 2022-10-19T00:47:30+0000
fuzz_target: xml
project: libxml2
type: bug
unsupported_fuzzers:
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
9 changes: 9 additions & 0 deletions benchmarks/libxslt_xpath/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -42,3 +42,12 @@ unsupported_fuzzers:
- symqemu_aflplusplus
- fuzzolic_aflplusplus_fuzzy
- fuzzolic_aflplusplus_z3dict
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
9 changes: 9 additions & 0 deletions benchmarks/mbedtls_fuzz_dtlsclient_7c6b0e/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,3 +20,12 @@ project: mbedtls
type: bug
unsupported_fuzzers:
- klee
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
9 changes: 9 additions & 0 deletions benchmarks/openh264_decoder_fuzzer/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,3 +21,12 @@ unsupported_fuzzers:
- fuzzolic_aflplusplus_fuzzy
- fuzzolic_aflplusplus_z3dict
- tortoisefuzz
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
9 changes: 9 additions & 0 deletions benchmarks/openssl_x509/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,3 +21,12 @@ unsupported_fuzzers:
- cfctx_dataflow_svf
- cfctx_dataflow_svf_llc
- tortoisefuzz
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
9 changes: 9 additions & 0 deletions benchmarks/php_php-fuzz-parser_0dbedb/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,3 +52,12 @@ unsupported_fuzzers:
- symqemu_aflplusplus
- fuzzolic_aflplusplus_fuzzy
- fuzzolic_aflplusplus_z3dict
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
10 changes: 10 additions & 0 deletions benchmarks/proj4_proj_crs_to_crs_fuzzer/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,3 +16,13 @@ commit: a7482d3775f2e346f3680363dd2d641add3e68b2
commit_date: 2023-02-06T16:46:19+0000
fuzz_target: proj_crs_to_crs_fuzzer
project: proj4
unsupported_fuzzers:
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
10 changes: 10 additions & 0 deletions benchmarks/re2_fuzzer/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,3 +16,13 @@ commit: b025c6a3ae05995660e3b882eb3277f4399ced1a
commit_date: 2023-01-30T18:31:10+0000
fuzz_target: fuzzer
project: re2
unsupported_fuzzers:
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
9 changes: 9 additions & 0 deletions benchmarks/sqlite3_ossfuzz/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,3 +20,12 @@ unsupported_fuzzers:
- symcc_afl
- symcc_afl_single
- symcc_aflplusplus
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
9 changes: 9 additions & 0 deletions benchmarks/systemd_fuzz-link-parser/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,3 +5,12 @@ project: systemd
unsupported_fuzzers:
- centipede
- wingfuzz
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
10 changes: 10 additions & 0 deletions benchmarks/woff2_convert_woff2ttf_fuzzer/benchmark.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,3 +16,13 @@ commit: 8109a2cc2b27436962ac1cfe40ad0e8a0dca26c8
commit_date: 2017-01-04T06:37:49+1100
fuzz_target: convert_woff2ttf_fuzzer
project: woff2
unsupported_fuzzers:
- dgfuzz
- dgfuzz_4aacb8
- dgfuzz_c286e5
- dgfuzz_3f8f81
- dgfuzz_0e010d
- dgfuzz_ab0800
- dgfuzz_135c90
- dgfuzz_653cc9
- dgfuzz_d3c951
Loading