The Measure of All Minds: Evaluating Natural and Artificial Intelligence

Are psychometric tests valid for a new reality of artificial intelligence systems, technology-enhanced humans, and hybrids yet to come? Are the Turing Test, the ubiquitous CAPTCHAs, and the various animal cognition tests the best alternatives? In this fascinating and provocative book, José Hernández-Orallo formulates major scientific questions, integrates the most significant research developments, and offers a vision of the universal evaluation of cognition. By replacing the dominant anthropocentric stance with a universal perspective where living organisms are considered as a special case, long-standing questions in the evaluation of behavior can be addressed in a wider landscape. Can we derive task difficulty intrinsically? Is a universal g factor – a common general component for all abilities – theoretically possible? Using algorithmic information theory as a foundation, the book elaborates on the evaluation of perceptual, developmental, social, verbal and collective features and critically analyzes what the future of intelligence might look like.

Table of Contents

Part I A Long-Pondered Outfit
Chapter 1 Extended Nature
Chapter 2 Mind The Step: Scala Universalis

Part II The Evaluation Discordance
Chapter 3 The Evaluation Of Human Behaviour
Chapter 4 The Evaluation Of Non-Human Natural Behaviour
Chapter 5 The Evaluation Of Artificial Intelligence
Chapter 6 The Boundaries Against A Unified Evaluation

Part III The Algorithmic Confluence
Chapter 7 Intelligence And Algorithmic Information Theory
Chapter 8 Cognitive Tasks And Difficulty
Chapter 9 From Tasks To Tests
Chapter 10 The Arrangement Of Abilities
Chapter 11 General Intelligence

Part IV The Society of Minds
Chapter 12 Cognitive Development And Potential
Chapter 13 Identifying Social Skills
Chapter 14 Communication Abilities
Chapter 15 Evaluating Collective And Hybrid Systems

Part V The Kingdom of Ends
Chapter 16 Universal Tests
Chapter 17 Rooting For Ratiocentrism
Chapter 18 Exploitation And Exploration