Autoregressive LLM user-interaction optimization strategies based on the model's probabilistic properties
Abstract
This paper explains that hallucinations can arise as a default behavior in LLMs because their autoregressive, probabilistic next-token prediction mechanism prioritizes plausibility over truth. It also points out that excessive rebuttals or constraints can contaminate the context and undermine response coherence. As solutions, it proposes an iterative “zeroing-in” approach that gradually narrows conditions, along with observation- and description-focused prompts to strengthen factual anchoring.
Publication details
- Journal / source
- Zenodo (CERN European Organization for Nuclear Research)
- Publication date
- 3 January 2026