google/oss-fuzz-gen issues and pull requests

#101 - Replace benchmark set `all` with `structured`

Pull Request - State: closed - Opened by DonggeLiu 10 months ago

#100 - retry on gcloud crashed (OSError)

Pull Request - State: closed - Opened by cjx10 10 months ago - 5 comments

#99 - re-select comparison benchmark set

Pull Request - State: closed - Opened by cjx10 10 months ago - 9 comments

#98 - Truncate ids to fit within max OS file name length

Pull Request - State: closed - Opened by trashvisor 10 months ago - 10 comments

#97 - Add raw function name to benchmark YAML

Pull Request - State: closed - Opened by DonggeLiu 10 months ago - 2 comments

#96 - Hide the error message when deleting temp OSS-Fuzz dir

Pull Request - State: closed - Opened by DonggeLiu 10 months ago - 1 comment

#95 - improve pre-build target function checking

Pull Request - State: closed - Opened by cjx10 10 months ago - 2 comments

#94 - Catch the error in preparing OSS-Fuzz for benchmark generation.

Pull Request - State: closed - Opened by DonggeLiu 10 months ago

#93 - Replace all function name usages with function signature

Pull Request - State: closed - Opened by DonggeLiu 10 months ago - 2 comments

#92 - Remove function name usage.

Issue - State: closed - Opened by DonggeLiu 10 months ago - 1 comment
Labels: infra

#91 - Using function signature as unique function identifier

Pull Request - State: closed - Opened by DonggeLiu 10 months ago - 4 comments

#90 - Re-select `comparison` becnhmark-set from the new benchmarks.

Issue - State: closed - Opened by DonggeLiu 10 months ago - 4 comments
Labels: infra

#89 - Capture more corner cases in benchmark name parsing

Issue - State: closed - Opened by DonggeLiu 10 months ago - 1 comment

#88 - Address the root cause of the extra line in benchmark

Issue - State: closed - Opened by DonggeLiu 10 months ago
Labels: infra

#87 - two minor changes for running all experiments

Pull Request - State: closed - Opened by sallywang147 10 months ago - 3 comments

#86 - Header for cpp

Pull Request - State: closed - Opened by trashvisor 10 months ago - 8 comments

#85 - Capture gcloud crashes and re-submit experiment

Issue - State: closed - Opened by DonggeLiu 10 months ago
Labels: infra

#84 - Enable linting and building images for all PRs

Pull Request - State: closed - Opened by DonggeLiu 10 months ago

#83 - Simplify code

Pull Request - State: closed - Opened by DonggeLiu 10 months ago

#82 - Context benchmark changes

Pull Request - State: closed - Opened by trashvisor 10 months ago

#81 - Fixer on structured benchmark

Pull Request - State: closed - Opened by cjx10 10 months ago

#80 - Add hunspell bug to trophy list

Pull Request - State: closed - Opened by jonathanmetzman 10 months ago - 1 comment

#79 - Update context_retriever.py

Pull Request - State: closed - Opened by eltociear 10 months ago

#78 - Use sub-directories to categorize reports

Pull Request - State: closed - Opened by DonggeLiu 10 months ago

#77 - Fix anchor link in usage readme

Pull Request - State: closed - Opened by marktefftech 10 months ago - 4 comments

#75 - Unittests for code fixing prompt

Issue - State: open - Opened by DonggeLiu 10 months ago
Labels: infra

#74 - Unittests for code generation prompt

Issue - State: open - Opened by DonggeLiu 10 months ago
Labels: infra

#73 - Fix web

Pull Request - State: closed - Opened by DonggeLiu 10 months ago - 1 comment

#72 - Github action to build a gcloud docker image for PR requests

Pull Request - State: closed - Opened by erfanio 10 months ago - 1 comment

#71 - Public reports that allow result comparison.

Issue - State: open - Opened by DonggeLiu 10 months ago
Labels: infra

#70 - Adapt code fixing to the new benchmark YAML

Issue - State: closed - Opened by DonggeLiu 10 months ago - 1 comment
Labels: infra

#69 - Adapt code generation to the new benchmark YAML

Issue - State: closed - Opened by DonggeLiu 10 months ago - 1 comment
Labels: infra

#68 - Distinguish `benchmark` and `project`

Issue - State: open - Opened by DonggeLiu 10 months ago
Labels: infra

#67 - Easily trigger experiment runs based on code in a PR

Issue - State: open - Opened by DonggeLiu 10 months ago - 3 comments
Labels: infra

#66 - Update benchmarks and fuzz targets bucket periodically in GKE

Issue - State: open - Opened by DonggeLiu 10 months ago
Labels: infra

#65 - Fix Github action to push to gcloud

Pull Request - State: closed - Opened by erfanio 10 months ago

#64 - Restructure benchmark YAML

Pull Request - State: closed - Opened by DonggeLiu 10 months ago - 3 comments

#63 - Fix typo in USAGE readme

Pull Request - State: closed - Opened by marktefftech 10 months ago

#62 - Refactor prompt generation and evaluation loop.

Issue - State: open - Opened by oliverchang 10 months ago - 5 comments
Labels: enhancement, infra

#61 - Fix typo in USAGE.md

Pull Request - State: closed - Opened by DonggeLiu 10 months ago

#60 - Fix command typo

Pull Request - State: closed - Opened by another-rex 10 months ago

#59 - Add missing benchmarks

Pull Request - State: closed - Opened by DonggeLiu 10 months ago

#58 - Runtime error parser

Issue - State: closed - Opened by DonggeLiu 10 months ago - 2 comments
Labels: infra

#57 - Fix broken refs to benchmark-sets/comp_benchmarks

Pull Request - State: closed - Opened by DavidKorczynski 10 months ago

#56 - Use `extern <function signature>` to import the function under test, not its header file.

Issue - State: open - Opened by DonggeLiu 10 months ago
Labels: prompt-engineering

#55 - Parse and save training data during experiments.

Issue - State: closed - Opened by DonggeLiu 10 months ago - 2 comments
Labels: infra, training

#54 - Convert functions in `benchmark.yaml` into a more structured way.

Issue - State: closed - Opened by DonggeLiu 10 months ago - 2 comments
Labels: infra

#53 - Create separate dirs for scheduled / one-off / other experiments in our bucket

Issue - State: closed - Opened by DonggeLiu 10 months ago - 1 comment
Labels: infra

#52 - Add anon client

Pull Request - State: closed - Opened by trashvisor 10 months ago

#51 - Update default benchmark for docker run

Pull Request - State: closed - Opened by erfanio 10 months ago

#50 - More informative linting

Pull Request - State: closed - Opened by DonggeLiu 10 months ago

#49 - Add a github action to automatically push to artifact registry from HEAD

Pull Request - State: closed - Opened by erfanio 10 months ago

#48 - Auto format/lint PRs

Pull Request - State: closed - Opened by DonggeLiu 10 months ago - 1 comment

#47 - Add more dependencies

Pull Request - State: closed - Opened by DonggeLiu 10 months ago

#46 - Pull latest repo in exp

Pull Request - State: closed - Opened by cjx10 10 months ago - 1 comment
Labels: infra

#45 - A helper script to find all fuzz targets that share the same error in one experiment

Issue - State: closed - Opened by DonggeLiu 10 months ago - 1 comment
Labels: infra

#44 - Investigate general code fixer improvements.

Issue - State: open - Opened by oliverchang 10 months ago
Labels: prompt-engineering

#43 - Support completely new C/C++ projects

Issue - State: open - Opened by oliverchang 10 months ago
Labels: prompt-engineering, infra

#42 - Pull repo for daily experiments

Issue - State: closed - Opened by DonggeLiu 10 months ago - 1 comment
Labels: infra

#41 - Allow more than 30 CPUs in auto-pilot GKE

Issue - State: closed - Opened by DonggeLiu 10 months ago - 1 comment
Labels: infra

#40 - Update README.md with latest results.

Pull Request - State: closed - Opened by oliverchang 10 months ago

#39 - Add uuid to ast dir generation in context retrieval to prevent race condition

Pull Request - State: closed - Opened by trashvisor 10 months ago - 1 comment

#38 - Fix coverage diff over reporting with templates.

Pull Request - State: closed - Opened by oliverchang 10 months ago - 1 comment

#37 - Coverage diffs: handle templates properly.

Issue - State: closed - Opened by oliverchang 10 months ago
Labels: bug, infra

#36 - allows fuzzy match for special chars in function names

Pull Request - State: closed - Opened by cjx10 10 months ago - 2 comments
Labels: infra

#35 - Flexible python path

Pull Request - State: closed - Opened by DonggeLiu 10 months ago

#34 - Replace `print` with the suitable `log`

Issue - State: open - Opened by DonggeLiu 10 months ago - 1 comment
Labels: infra

#33 - Update USAGE.md to include more dependencies

Pull Request - State: closed - Opened by oliverchang 10 months ago

#32 - Retry on cloud experiment failure

Pull Request - State: closed - Opened by cjx10 10 months ago - 1 comment
Labels: infra

#31 - Hide useless logs and add useful ones

Pull Request - State: closed - Opened by DonggeLiu 10 months ago

#30 - Prevent pushing code to `main` directly

Issue - State: closed - Opened by DonggeLiu 10 months ago

#29 - Use multi-thread for cloud experiments and mutli-process for local ones

Pull Request - State: open - Opened by DonggeLiu 10 months ago - 3 comments

#28 - GitHub actions for linting

Issue - State: closed - Opened by oliverchang 10 months ago
Labels: infra

#27 - Fix false negative 'function used in fuzz targets'

Issue - State: open - Opened by DonggeLiu 10 months ago - 10 comments
Labels: infra

#26 - Prepare a temp OSS-Fuzz at the beginning of introspector.py

Pull Request - State: closed - Opened by DonggeLiu 10 months ago

#25 - Remove PYTHONPATH usage in docs

Pull Request - State: closed - Opened by DonggeLiu 10 months ago

#24 - Pull code from this repo to run daily experiments

Issue - State: closed - Opened by DonggeLiu 10 months ago
Labels: infra

#23 - Remove PYTHONPATH usage in data preparation scripts / docs.

Issue - State: closed - Opened by DonggeLiu 10 months ago - 1 comment

#22 - Remove PYTHONPATH usage for web.py.

Pull Request - State: closed - Opened by oliverchang 10 months ago - 2 comments

#21 - Use anonymous client to retrieve AST from the public bucket

Issue - State: closed - Opened by DonggeLiu 10 months ago
Labels: infra

#20 - Capture and handle missing ASTs.

Issue - State: closed - Opened by DonggeLiu 10 months ago - 1 comment
Labels: infra

#19 - Temporary public AST bucket.

Issue - State: closed - Opened by DonggeLiu 10 months ago - 1 comment
Labels: infra

#18 - Fix some benchmarks.

Pull Request - State: closed - Opened by oliverchang 10 months ago

#17 - Pod ephemeral local storage usage exceeds the total limit of containers 10Gi.

Issue - State: closed - Opened by DonggeLiu 10 months ago - 1 comment
Labels: infra

#16 - Save successful compilation fixes.

Issue - State: open - Opened by oliverchang 10 months ago
Labels: infra

#15 - Save best, successful targets

Issue - State: open - Opened by oliverchang 10 months ago - 1 comment
Labels: infra

#14 - Provide runtime feedback to LLM

Issue - State: open - Opened by oliverchang 10 months ago
Labels: prompt-engineering, infra

#13 - Invalid cloud build tags for one-off experiments

Issue - State: closed - Opened by DonggeLiu 10 months ago - 2 comments
Labels: infra

#12 - Capture, log, and retry `gcloud` authentication failures

Issue - State: closed - Opened by DonggeLiu 10 months ago
Labels: infra

#11 - Initial `gcloud` authentication failure in GKE experiments

Issue - State: open - Opened by DonggeLiu 10 months ago
Labels: infra

#10 - API for providing project context

Issue - State: open - Opened by oliverchang 10 months ago - 3 comments
Labels: infra

#9 - Better detection of false positive crashes.

Issue - State: open - Opened by oliverchang 10 months ago - 1 comment
Labels: infra

#8 - Instructions for generating targets that read from files

Issue - State: open - Opened by oliverchang 10 months ago
Labels: prompt-engineering

#7 - Mitigate null terminator issues with LLVMFuzzerTestOneInput

Issue - State: open - Opened by oliverchang 10 months ago
Labels: prompt-engineering

#6 - Support languages other than C/C++

Issue - State: open - Opened by oliverchang 10 months ago
Labels: prompt-engineering, infra

#5 - Integrate into production OSS-Fuzz

Issue - State: open - Opened by oliverchang 10 months ago
Labels: infra

#4 - More reliable `target_name` determination in benchmarks

Issue - State: open - Opened by oliverchang 10 months ago
Labels: infra

#3 - Extract project context (function impls, data structure defs, usages) and include them in prompts

Issue - State: open - Opened by oliverchang 10 months ago - 1 comment
Labels: prompt-engineering

#2 - Fix email address

Pull Request - State: closed - Opened by jonathanmetzman 10 months ago - 2 comments

#1 - Fix function name regex.

Pull Request - State: closed - Opened by oliverchang 10 months ago

GitHub / google/oss-fuzz-gen issues and pull requests