Comments (4)
We've wanted to do something like this too, since I suspect there are cases where fuzzers that find less edges are actually finding edges not found by others, and have use there as well.
During an experiment, we have data on which edges in a program are covered by each fuzzer.
However, we don't save it anywhere.
Thus the first step in implementing this feature would be saving this data somewhere. That should be pretty easy.
I think figuring out a way to present this data in a way that is understandable requires more thought.
from fuzzbench.
We have a feature that is very similar to this being implemented by #657.
Instead of listing the probability of each edge, we allow users to see how unique the coverage of one fuzzer is in relation to all other fuzzers or to another individual fuzzer.
I think this feature (although there are many ways it can be improved, like being able to answer "how unique is AFL compared to libFuzzer+Honggfuzz" for example) is a bit more useful version of the one suggested by this issue.
@roachspray do you agree?
from fuzzbench.
I see this -- I must read #657 and will respond shortly. Thank you!
from fuzzbench.
@jonathanmetzman Thank you for sharing this. One of my goals for branch probabilities was to discover/investigate roadblock branches (infrequently taken paths) across different fuzzers. If I am able to map regions, with coverage, back to code, then that is good enough, I think. I need to re-visit region definition to be sure.
from fuzzbench.
Related Issues (20)
- Experiment hanging without reports HOT 1
- Running several experiments at one time
- freetype_ftfuzzer oss-fuzz benchmark uses outdated commit
- llvm-cov show command report warning: <N> functions have mismatched data
- Allow setting `merge_with_nonprivate` in `run_experiment.py` command line params
- PyQt5 Issue HOT 2
- unknown flag: --gpus all when executing run_experiment.py
- No snapshot data when running local experiment HOT 6
- Average rank scoring
- Retire benchmarks that dont show differences HOT 1
- edges_found and edges_covered mismatch
- [docs] Outdated documentation about fuzzer configs
- Encounter problems when adding a new fuzzer HOT 3
- Why the report-data only contains the code covrage data? HOT 2
- Update `Python` dependencies to update deprecated packages and resolve conflicts HOT 3
- Some error about "run the local bug experiment". HOT 4
- Cannot pull gcr.io/fuzzbench/base-image docker image from Artifact Registry HOT 1
- local experiment issue : Local uncommitted changes found, exiting - raise ValidationError('Local uncommitted changes found, exiting.') HOT 1
- Show data and report links in `experiment` CI
- Fix/Remove `aspell_aspell_fuzzer_e8eb74` from tag `SBFT'23`
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fuzzbench.