Patch Validation in Automated Vulnerability Repair

Read full text Summarise with VIRAT
Authors: Anon
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

PVBench A comprehensive evaluation benchmark for **Automated Vulnerability Repair** tools. Overview - Vulnerability Dataset: Real-world bugs with ground-truth patches, test cases, and PoCs- Framework: Automated evaluation infrastructure for patch validation Repository Structure PVBench/├── PatchAgent/ # LLM-based program repair agent (submodule)├── San2Patch/ # Sanitizer-to-Patch framework (submodule)├── vuln/ # Vulnerability dataset (21 projects, 209 vulnerabilities)├── cold/ # COLD evaluation framework├── litellm/ # LiteLLM proxy for unified LLM API access├── artifacts/ # Generated evaluation artifacts├── data/ # Data directory└── docker-compose.yaml # Docker orchestration for evaluation Vulnerability Dataset Per-Vulnerability Structure Each vulnerability includes: vuln/{project}/{id}/├── config.yaml # Metadata (id, project, sanitizer, type, commits, references)├── patch.diff # Human-written ground-truth patch├── patch-rich.diff # Annotated patch with context├── test.diff # Test case changes├── test-rich.diff # Annotated test changes├── test.sh # Test script for validation├── report.txt # Sanitizer report from PoC└── input/ # Proof-of-Concept files └── poc.{bin|py} # PoC to trigger vulnerability Components Framework Evaluation infrastructure (`cold/` directory): - Actions: - `check`: Verify vulnerability reproduction and patch validation - `gentest`: Generate test cases for vulnerabilities - Features: - Concurrent processing with configurable thread pools - Patch validation pipeline: build → replay → function test → post-test - Multi-model LLM evaluation via LiteLLM proxy Configuration Vulnerability Config (`config.yaml`) id: CVE-2023-XXXXXproject: cpythonsanitizer: AddressSanitizertype: heap-buffer-overflowvulnerable_commit: abc123fixed_commit: def456references: - https://bugs.python.org/issue12345

Fields of Study & Subjects

Software Testing and Debugging Techniques Software Engineering Research Web Application Security Vulnerabilities

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
27 March 2026
Language
EN
Document type
Dataset