Large language models and emergence: a complex systems perspective

Read full text
Authors: David C. Krakauer, Melanie Mitchell, John W. Krakauer
Cited by: 4
References: 74

Abstract

Emergence is a concept in complexity science that describes how many-body systems manifest novel higher-level properties, properties that can be described by replacing high-dimensional mechanisms with lower-dimensional effective variables and theories. This is captured by the idea 'More is Different'. Intelligence is a consummate emergent property manifesting increasingly efficient-cheaper and faster-uses of emergent capabilities to solve problems. This is captured by the idea 'Less is More'. In this paper, we first examine claims that Large Language Models exhibit emergent capabilities, reviewing several approaches to quantifying emergence, and secondly ask whether LLMs possess emergent intelligence. This article is part of the theme issue 'World models in natural and artificial intelligence'.

Fields of Study & Subjects

Language and cultural evolution

Publication details

Journal / source
Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences
Publisher
The Royal Society
Volume
384
Issue
2320
Publication date
14 May 2026
Language
EN