Mitigating Sycophancy and Hallucination in Large Language Models: The LOGOS Case Study in the Era of Reasoning Models (DeepSeek-R1, Gemini 3.0, ChatGPT-5)

Read full text
Authors: Athanasios Davalas, Anna Angelaki
Cited by: 0
References: 1

Abstract

Reliability in large language models (LLMs) is constrained along two orthogonal axes: sycophancy—a social-alignment failure where the model tends to agree with user pressure—and hallucination (confabulation)—a world-alignment failure producing confident but unsupported content (Fanous et al., 2025; Sharma et al., 2023; Ji et al., 2022; Kalai et al., 2025). Building on this distinction, we introduce LOGOS, a domain-bounded Constitutional RAG system for Orthodox theology with explicit anti-sycophancy rules and strict scope boundaries. Prior to human comparison, LOGOS underwent a Phase1 theological audit: a committee of the Holy Metropolis of Nea Ionia posed 200 domain questions, finding all responses doctrinally sound. We then conducted a Phase2 human evaluation with N = 52 AI students (valid responses N=51– 52 per prompt), using five structured prompts plus one freeform redteaming task.

Fields of Study & Subjects

Topic Modeling Ethics and Social Impacts of AI Natural Language Processing Techniques

Publication details

Journal / source
International Journal of Social Science and Economic Research
Volume
11
Issue
02
Pages
109–121
Publication date
1 January 2026
Language
EN