HumanEval-Sci: a verification-grounded benchmark for scientific code generation
Abstract
A benchmark of 73 scientific-code prompts across seven domains (physics, chemistry, biology, climate, mathematics, numerical methods, and engineering). Each prompt carries a reference solution, executable tests, and per-prompt verification targets (dimensional vectors, declared limits, and validation envelopes). The repository also includes the recorded evaluation runs behind the HumanEval-Sci pilot study and a dependency-free script that regenerates the study's supplementary tables from those records.
Publication details
- Journal / source
- Zenodo (CERN European Organization for Nuclear Research)
- Publication date
- 27 May 2026
- Document type
- Dataset