From Particles to Agents: Hallucination as a Metric for Cognitive Friction in Spatial Simulation

Read full text
Authors: Javier Argota Sánchez–Vaquerizo, Luis Borunda
Cited by: 0

Abstract

Traditional architectural simulations (e.g. Computational Fluid Dynamics, evacuation, structural analysis) model elements as deterministic physics-based "particles" rather than cognitive "agents". To bridge this, we introduce \textbf{Agentic Environmental Simulations}, where Large Multimodal generative models actively predict the next state of spatial environments based on semantic expectation. Drawing on examples from accessibility-oriented AR pipelines and multimodal digital twins, we propose a shift from chronological time-steps to Episodic Spatial Reasoning, where simulations advance through meaningful, surprisal-triggered events. Within this framework we posit AI hallucinations as diagnostic tools. By formalizing the \textbf{Cognitive Friction} ($C_f$) it is possible to reveal "Phantom Affordances", i.e. semiotic ambiguities in built space. Finally, we challenge current HCI paradigms by treating environments as dynamic cognitive partners and propose a human-centered framework of cognitive orchestration for designing AI-driven simulations that preserve autonomy, affective clarity, and cognitive integrity.

Fields of Study & Subjects

Architecture and Computational Design Interactive and Immersive Displays Virtual Reality Applications and Impacts

Publication details

Journal / source
arXiv (Cornell University)
Publication date
29 January 2026
Document type
Preprint