Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for diffing two fuzz-introspector runs #734

Open
DavidKorczynski opened this issue Dec 29, 2022 · 2 comments
Open

Add support for diffing two fuzz-introspector runs #734

DavidKorczynski opened this issue Dec 29, 2022 · 2 comments

Comments

@DavidKorczynski
Copy link
Contributor

The goal of fuzz introspector is by and large to make it easier to improve a fuzzing set up for a given software package. At the moment fuzz introspector only focuses on a single analysis, whereas, in order to determine if an improvement was successful one has to compare two fuzz introspector runs. As such, we should have some features that make it possible to compare fuzz introspector analyses and specifically make it easy to highlight improvements/regressions.

@DavidKorczynski
Copy link
Contributor Author

The plan for doing this is exporting lots of the data generated by fuzz introspector into a json format (https://github.com/ossf/fuzz-introspector/blob/main/src/fuzz_introspector/json_report.py) and then build a diffing tool based on that.

@DavidKorczynski
Copy link
Contributor Author

DavidKorczynski commented Jan 10, 2023

A thought in this context is that it would be good to start making the code more object oriented and in particular some form of broader "Fuzz Introspector Report" class, which will make certain things such as serializing data and comparing data more intuitive from a code-level perspective. I don't think this should hold up making some initial progress in this context, but, medium term we should aim for something more object oriented.

AdamKorcz pushed a commit that referenced this issue Jan 11, 2023
* Add initial layout for report diffing

Ref: #734

Signed-off-by: David Korczynski <[email protected]>

* fix nits

Signed-off-by: David Korczynski <[email protected]>

* Add reachability diff of all functions

Signed-off-by: David Korczynski <[email protected]>

* change name of function

Signed-off-by: David Korczynski <[email protected]>

* fix soem typing

Signed-off-by: David Korczynski <[email protected]>

* nit

Signed-off-by: David Korczynski <[email protected]>

Signed-off-by: David Korczynski <[email protected]>
AlexDev08 pushed a commit to AlexDev08/fuzz-introspector that referenced this issue Nov 20, 2024
* Add initial layout for report diffing

Ref: ossf/fuzz-introspector#734

Signed-off-by: David Korczynski <[email protected]>

* fix nits

Signed-off-by: David Korczynski <[email protected]>

* Add reachability diff of all functions

Signed-off-by: David Korczynski <[email protected]>

* change name of function

Signed-off-by: David Korczynski <[email protected]>

* fix soem typing

Signed-off-by: David Korczynski <[email protected]>

* nit

Signed-off-by: David Korczynski <[email protected]>

Signed-off-by: David Korczynski <[email protected]>
shovon58 added a commit to shovon58/oss-introspector that referenced this issue Nov 21, 2024
* Add initial layout for report diffing

Ref: ossf/fuzz-introspector#734

Signed-off-by: David Korczynski <[email protected]>

* fix nits

Signed-off-by: David Korczynski <[email protected]>

* Add reachability diff of all functions

Signed-off-by: David Korczynski <[email protected]>

* change name of function

Signed-off-by: David Korczynski <[email protected]>

* fix soem typing

Signed-off-by: David Korczynski <[email protected]>

* nit

Signed-off-by: David Korczynski <[email protected]>

Signed-off-by: David Korczynski <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant