Toward Deterministic Governance of Large Language Model APIs

Read full text
Authors: Edoardo Bambini
Cited by: 0

Abstract

This preprint presents IAGA, a control-plane architecture for governing Large Language Model (LLM) API usage in enterprise environments. The system introduces deterministic cost enforcement, bounded budget guarantees, circuit-breaker-based reliability, synchronous response validation, and cryptographically scoped multi-tenant isolation. IAGA operates as an OpenAI-compatible gateway, requiring zero application-level changes while enforcing governance at request time. The paper details the full request lifecycle, cost containment model, caching architecture, reliability mechanisms, and controlled performance evaluation under simulated enterprise workloads.

Fields of Study & Subjects

Software System Performance and Reliability Cloud Computing and Resource Management Service-Oriented Architecture and Web Services

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
12 February 2026
Language
EN
Document type
Preprint