Book contents
- Looking Ahead
- Looking Ahead
- Copyright page
- Contents
- Figures
- Preface
- Acknowledgments
- Part I Setting the Stage
- Part II Psychological Theories
- Part III Mathematical Theories
- Chapter 13 Number Crunching
- Chapter 14 Learned Activation Patterns of Simple Connected Processing Units
- Chapter 15 Reducing Surprisal and Entropy
- Chapter 16 Probabilistic Beliefs about the State of the World
- Chapter 17 Quantum Probabilities
- Part IV Neurobiological Theories
- Part V The Future of Prediction
- Notes
- Index
- References
Chapter 15 - Reducing Surprisal and Entropy
Prediction Involves Information Theory
from Part III - Mathematical Theories
Published online by Cambridge University Press: 20 March 2025
- Looking Ahead
- Looking Ahead
- Copyright page
- Contents
- Figures
- Preface
- Acknowledgments
- Part I Setting the Stage
- Part II Psychological Theories
- Part III Mathematical Theories
- Chapter 13 Number Crunching
- Chapter 14 Learned Activation Patterns of Simple Connected Processing Units
- Chapter 15 Reducing Surprisal and Entropy
- Chapter 16 Probabilistic Beliefs about the State of the World
- Chapter 17 Quantum Probabilities
- Part IV Neurobiological Theories
- Part V The Future of Prediction
- Notes
- Index
- References
Summary
Information processing is a process of uncertainty resolution. Information-theoretic constructs such as surprisal and entropy reflect the fine-grained probabilistic knowledge which people have accumulated over time. The information-theoretic constructs explain the extent of processing difficulty that people encounter, for example when comprehending language. Processing difficulty and cognitive effort in turn are a direct reflection of predictability.
Keywords
- Type
- Chapter
- Information
- Looking AheadThe New Science of the Predictive Mind, pp. 163 - 173Publisher: Cambridge University PressPrint publication year: 2025