Lies, Damned Lies, and the Orthogonality Thesis

Read full text
Authors: Michael Timothy Bennett
Cited by: 0

Abstract

In AI safety, the strong orthogonality thesis is that intelligence and goals are independent. Here I refute it with a rudimentary proof and argument based on computational dualism. First I show intelligence is fundamentally tied to embodiment. I illustrate using the universal artificial intelligence AIXI. Its performance hinges upon a choice of Universal Turing Machine (UTM). This UTM is a form of embodiment. It interprets and thus determines everything AIXI does, meaning AIXI can be made to behave arbitrarily well or poorly by changing the UTM. This is the case for all agents, not just AIXI. Next, I show embodiment is not neutral but inherently goal directed. A body is biased toward some goals over others. Just as every policy can be optimal if we choose the right body, every body can be optimal if we choose the right goal. This connects intelligence to embodiment to goals. They are not ``orthogonal''. The orthogonality thesis is a case of computational dualism.

Fields of Study & Subjects

Italian Fascism and Post-war Society Law in Society and Culture

Publication details

Journal / source
Lecture notes in computer science
Pages
62–78
Publication date
1 January 2026
Language
EN