DANTE: Data-Driven Test Case Selection and Prioritization for Long-Running Test Suites

Read full text
Authors: Simone Reale, Elisabetta Di Nitto, Luciano Baresi, Massimiliano Di Penta, Giovanni Quattrocchi
Cited by: 0

Abstract

As software systems evolve, large test suites increasingly delay developer feedback in Continuous Integration and Delivery (CI/CD). Test Case Selection and Prioritization (TCSP) mitigates this issue, and recent evidence shows that simple heuristics—--such as prioritizing recently failed or fast-running tests—--often outperform sophisticated machine learning (ML) approaches, which incur in high training costs and suffer from distribution shift. However, these simple heuristics remain rigid and fail to take advantage of the rich historical data continuously produced by the CI/CD pipelines.This paper introduces DANTE, a data-driven, yet training-free framework that evolves simple TCSP heuristics into a data-driven selection and prioritization strategy. DANTE processes historical signals through a probabilistic stickiness metric that automatically adapts to project-specific failure and fixing patterns without manual tuning. This history-aware logic is complemented by a lightweight, commit-aware component that captures the relevance between code changes and test artifacts. We evaluated DANTE on the Long-Running Test Suite (LRTS) dataset focusing on the Java projects, which constitute the vast majority in LRTS (9 over 10 in total) and comprise more than 21,000 CI builds with multi-hour test suites. The results show that DANTE consistently outperforms state-of-the-art cost-history cognizant heuristics and ML baselines in both test selection and prioritization, while remaining robust to flaky tests.

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
7 March 2026