Entropy, complexity and surprise
Abstract
Abstract This chapter introduces the fundamental concepts of entropy and complexity, tracing their origins from thermodynamics to information theory. It explores how these concepts serve as a natural measure of the level of surprise experienced when an event occurs. The discussion also includes Algorithmic Complexity, which provides a framework for quantifying the randomness of a sequence regardless of its source. Finally, the chapter highlights the tangible connection between information, physical processes and optimal strategies in stochastic environments, such as gambling.
Fields of Study & Subjects
Computability
Logic
AI Algorithms
Complex Systems and Dynamics
Diverse Interdisciplinary Research Studies
Publication details
- Journal / source
- Oxford University Press eBooks
- Pages
- 1–48
- Publication date
- 26 February 2026
- Language
- EN
- Document type
- Book chapter