HumanEval-Sci: a verification-grounded benchmark for scientific code generation

Read full text
Authors: Arsalan Akhtar
Cited by: 2

Abstract

A benchmark of 73 scientific-code prompts across seven domains (physics, chemistry, biology, climate, mathematics, numerical methods, and engineering). Each prompt carries a reference solution, executable tests, and per-prompt verification targets (dimensional vectors, declared limits, and validation envelopes). The repository also includes the recorded evaluation runs behind the HumanEval-Sci pilot study and a dependency-free script that regenerates the study's supplementary tables from those records.

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
27 May 2026
Document type
Dataset