ODESSA Prometheus 25

Read full text
Authors: Brady, Benjamin
Cited by: 0

Abstract

Pre-registration protocol for ODESSA v21.5 "Prometheus 25": A runtime-physics-based evaluation of 25 open-weight or open API language models for harmful code generation capability. Locks classification criteria (S0-S4 safety tiers), exclusion logic, and falsifiable hypotheses before full sweep data analysis. Implements Forum of Fact / Forum of Interpretation bifurcation per Archimedes Memo v2, which argues for the need for ground truth validation (LLM as Python) as a necessary precursore for LLM as Judge methodologies.

Fields of Study & Subjects

Ethics and Social Impacts of AI Adversarial Robustness in Machine Learning Hate Speech and Cyberbullying Detection

Publication details

Journal / source
Open Science Framework
Publication date
1 January 2026