Can Old Tests Do New Tricks for Resolving SWE Issues?

Read full text
Authors: Yang Chen, Toufique Ahmed, Reyhaneh Jabbarvand, Martin J. Hirzel
Cited by: 0

Abstract

Test suites in real-world projects are often large and achieve high code coverage, yet they remain insufficient for detecting all bugs. The abundance of unresolved issues in open-source project trackers highlights this gap. While regression tests are typically designed to ensure past functionality is preserved in the new version, they can also serve a complementary purpose: debugging the current version. Specifically, regression tests can (1) enhance the generation of reproduction tests for newly reported issues, and (2) validate that patches do not regress existing functionality. We present TestPrune, a fully automated technique that leverages issue tracker reports and strategically reuses regression tests for both bug reproduction and patch validation. A key contribution of TestPrune is its ability to automatically minimize the regression suite to a small, highly relevant subset of tests. Due to the predominance of LLM-based debugging techniques, this minimization is essential as large test suites exceed context limits, introduce noise, and inflate inference costs. TestPrune can be plugged into any agentic bug repair pipeline and orthogonally improve overall performance. As a proof of concept, we show that TestPrune leads to a 6.2

Fields of Study & Subjects

Software Engineering Research Software Testing and Debugging Techniques Software Engineering Techniques and Practices

Publication details

Journal / source
Proceedings of the ACM on software engineering.
Volume
3
Issue
FSE
Pages
3186–3207
Publication date
30 June 2026
Language
EN