ErrCalBench Benchmark Dataset for the paper "Self-Diagnostics and Rich Execution Feedback to Distill Models for Specific Software Engineering Tasks"
Summary
No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.
Summarise with VIRAT Free to try with your Science Catalogs account.Abstract
The ErrCalBench dataset is a benchmark dataset released in conjunction with the paper “Self-Diagnostics and Rich Execution Feedback to Distill Modelsfor Specific Software Engineering Tasks” ErrCalBench is designed to evaluate and improve the self-diagnostic capabilities of task-optimized models during the execution of complex tasks. Unlike traditional single-output evaluations, this dataset emphasizes “rich execution feedback,” recording intermediate states, error types, and calibrated feedback during multi-step reasoning, tool invocation, and code execution
Fields of Study & Subjects
Software Engineering Research
Software Testing and Debugging Techniques
Software Engineering Techniques and Practices
Publication details
- Journal / source
- Zenodo (CERN European Organization for Nuclear Research)
- Publication date
- 27 March 2026
- Language
- EN
- Document type
- Dataset