Dynamic-Static Synergistic Selection Method for Candidate Code Solutions with Generated Test Cases

Read full text
Authors: Association for Artificial Intelligence 2026, Xin-Ye Li, Ming Li, Ren-Biao Liu, Chao-Zeng Ma, Hui Sun, Jiang-Tian Xue
Cited by: 0

Abstract

Large language models (LLMs) show significant improvement in code generation. A common practice is sampling multiple candidate codes to increase the likelihood of producing an accurate solution. However, effectively identifying the best candidate from the pool is a significant challenge. Although existing code consensus methods attempt to solve this issue, they suffer from a critical problem: relying on test cases generated by LLMs, which can be flawed or provide incomplete coverage. This problem can result in erroneous validations, causing correct code to fail flawed tests and preventing the detection of functional differences in candidate code solutions. To address these issues, we present the Dynamic-Static Synergistic Selection Method, a novel framework that combines two complementary analytical approaches. First, it uses the abstract syntax tree (AST) to detect and filter candidate solutions and test cases. Second, the method statically analyzes the solutions' quality, then dynamically validates functional consistency based on execution results of extracted inputs, which neutralizes the impact of faulty tests. Extensive experiments demonstrate that this synergistic approach significantly outperforms existing methods, substantially enhancing the correctness of the selected code.

Fields of Study & Subjects

Software Engineering Research Software Testing and Debugging Techniques Teaching and Learning Programming

Publication details

Journal / source
Underline Science Inc.
Publication date
7 January 2026
Language
EN