Loki’s Dance of Illusions: A Comprehensive Survey of Hallucination in Large Language Models

Edgar Allan Poe noted, “Truth often lurks in the shadow of error,” highlighting the deep complexity intrinsic to the interplay between truth and falsehood, notably under conditions of cognitive and informational asymmetry. This dynamic is strikingly evident in large language models (LLMs). Despite their impressive linguistic generation capabilities, LLMs sometimes produce information that appears factually accurate but is, in reality, fabricated, an issue often referred to as “hallucinations.” The prevalence of these hallucinations can mislead users, affecting their judgments and decisions. In sectors such as finance, law, and healthcare, such misinformation risks causing substantial economic losses, legal disputes, and health risks, with wide-ranging consequences. In our research, we have methodically categorized and analyzed the causes, detection methods, and solutions related to LLM hallucinations. Our efforts specifically focus on elucidating the root causes of hallucinations and evaluating current strategies, thereby laying the groundwork for developing robust mitigation techniques.