-
Notifications
You must be signed in to change notification settings - Fork 275
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Disable incompatible benchmarks for cloud experiments #2030
Conversation
/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-08-16-2030-1 --fuzzers libfuzzer |
Experiment |
COuld you explain why they don't work? |
I did not have a chance to verify this, but it's likely due to |
Eh then this should probably be fixed instead. |
I don't object if you don't have the time though |
I am a bit inclined to merge this temporary mitigation for now and fix it after we settle down the agent work, if you don't mind. BTW, do we plan to update anything in FuzzBench recently? |
+1, let's mitigate this first, and track this as a bug for when we can get to it. |
OK I've created an issue for this and will merge the PR once the experiment finishes without any error. |
I thought I reverted this in ##2030, but apparently I did not.
Temporarily disable benchmark `stb_stbi_read_fuzzer` and `openh264_decoder_fuzzer`from cloud experiments, becaue they are [proven](google#2023 (comment)) to be incompatible in cloud build/run environment. @addisoncrump kindly confirmed that they [work in local experiments](google#2023 (comment)).
I thought I reverted this in #google#2030, but apparently I did not.
Temporarily disable benchmark `stb_stbi_read_fuzzer` and `openh264_decoder_fuzzer`from cloud experiments, becaue they are [proven](google#2023 (comment)) to be incompatible in cloud build/run environment. @addisoncrump kindly confirmed that they [work in local experiments](google#2023 (comment)).
I thought I reverted this in #google#2030, but apparently I did not.
Temporarily disable benchmark
stb_stbi_read_fuzzer
andopenh264_decoder_fuzzer
from cloud experiments, becaue they are proven to be incompatible in cloud build/run environment.@addisoncrump kindly confirmed that they work in local experiments.