From Function to Repository: Towards Understanding and an Agentic Approach for Repo-Level Directed Input Generation
Summary
No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.
Summarise with VIRAT Free to try with your Science Catalogs account.Abstract
Directed Input Generation (DIG) aims to automatically construct an input that reaches a specified target program location. Although recent studies have shown promising results for Large Language Models (LLMs) in function-level DIG, it remains unclear whether such effectiveness generalizes to realistic repository-level testing scenarios. Unlike function-level settings, repository-level DIG requires reasoning over long call chains, project-specific input semantics, and complex execution conditions distributed across real software repositories. To address this gap, we present a comprehensive empirical study of repository-level directed input generation with LLMs. Specifically, we construct a benchmark, RepoEval, containing hard-to-cover target lines across mainstream programming languages, and evaluate multiple state-of-the-art LLMs under different context and output settings. Our results show that repository-level DIG remains substantially more challenging than prior simplified settings. While advanced models can cover a portion of targets (from 16.02% to 37.35%), their effectiveness is strongly compromised by repository specific semantic constraints, context settings, output formats, and external execution conditions. Based on these findings, we design AgenticDIG, an agentic workflow that integrates target-oriented analysis, intention extraction, fault injection, and iterative feedback to improve repository-level DIG. Evaluation shows that AgenticDIG improves target coverage by 43.56% relative to the best baseline.
Fields of Study & Subjects
Software Testing and Debugging Techniques
Software Engineering Research
Software System Performance and Reliability
Publication details
- Journal / source
- IEEE/ACM International Conference on Automated Software Engineering (ASE)
- Pages
- 3062–3074
- Publication date
- 7 October 2026
- Language
- EN