ODESSA Prometheus 25
Abstract
Pre-registration protocol for ODESSA v21.5 "Prometheus 25": A runtime-physics-based evaluation of 25 open-weight or open API language models for harmful code generation capability. Locks classification criteria (S0-S4 safety tiers), exclusion logic, and falsifiable hypotheses before full sweep data analysis. Implements Forum of Fact / Forum of Interpretation bifurcation per Archimedes Memo v2, which argues for the need for ground truth validation (LLM as Python) as a necessary precursore for LLM as Judge methodologies.
Fields of Study & Subjects
Ethics and Social Impacts of AI
Adversarial Robustness in Machine Learning
Hate Speech and Cyberbullying Detection
Publication details
- Journal / source
- Open Science Framework
- Publication date
- 1 January 2026