IDL Benchmark Report No. 1: 100-Turn Experimental Evaluation of the IDL 1.0 Reference Implementation

Read full text
Authors: Szabolcs Krehlik
Cited by: 4
References: 1

Abstract

This report presents the first experimental benchmark evaluation of the Interaction Dynamics Layer (IDL) 1.0 reference implementation. Rather than evaluating the reasoning capabilities of a language model, the benchmark assesses the operational behavior of the IDL continuity architecture during a continuous 100-turn interaction scenario. The evaluation examines runtime stability, synchronized multi-layer logging, structured semantic indexing, deterministic retrieval, Evolution Vector continuity, bounded FEV dynamics, interaction-state preservation, retrieval accuracy, and response latency. The benchmark was executed using the OpenAI Responses API together with the current IDL reference implementation featuring ranked retrieval, structured semantic indexing, anchor fact injection, persistent SQLite storage, and synchronized NDJSON logs. Across one hundred consecutive interactions, the implementation completed all requests successfully without runtime failures or communication errors. Complete synchronization between communication, semantic, and orientational memory layers was maintained throughout the benchmark. The evaluated implementation achieved 90% exact recall (100% effective recall), zero FEV boundary violations, and stable long-term interaction continuity. This report complements the architectural specification of Interaction Dynamics Layer (IDL) 1.0 by providing the first reproducible experimental evaluation of its reference implementation under controlled runtime conditions. Related publication Interaction Dynamics Layer (IDL) 1.0: A Model-Agnostic Continuity Architecture for Long-Term AI Systems. DOI: 10.5281/zenodo.20974299

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
4 July 2026
Language
EN