ErrCalBench Benchmark Dataset for the paper "Self-Diagnostics and Rich Execution Feedback to Distill Models for Specific Software Engineering Tasks"

Read full text Summarise with VIRAT
Authors: Anonymous
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

The ErrCalBench dataset is a benchmark dataset released in conjunction with the paper “Self-Diagnostics and Rich Execution Feedback to Distill Modelsfor Specific Software Engineering Tasks” ErrCalBench is designed to evaluate and improve the self-diagnostic capabilities of task-optimized models during the execution of complex tasks. Unlike traditional single-output evaluations, this dataset emphasizes “rich execution feedback,” recording intermediate states, error types, and calibrated feedback during multi-step reasoning, tool invocation, and code execution

Fields of Study & Subjects

Software Engineering Research Software Testing and Debugging Techniques Software Engineering Techniques and Practices

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
27 March 2026
Language
EN
Document type
Dataset