Book contents
- Frontmatter
- Contents
- Editor's Statement
- Section Editor's Foreword
- Preface
- Special Symbols
- Mathematical Theory of Entropy
- Chapter 1 Topics from Probability Theory
- Chapter 2 Entropy and Information
- Chapter 3 Information Theory
- Chapter 4 Ergodic Theory
- Chapter 5 Topological Dynamics
- Chapter 6 Statistical Mechanics
- Bibliography
- Index
- About the Author
Chapter 1 - Topics from Probability Theory
Published online by Cambridge University Press: 05 June 2013
- Frontmatter
- Contents
- Editor's Statement
- Section Editor's Foreword
- Preface
- Special Symbols
- Mathematical Theory of Entropy
- Chapter 1 Topics from Probability Theory
- Chapter 2 Entropy and Information
- Chapter 3 Information Theory
- Chapter 4 Ergodic Theory
- Chapter 5 Topological Dynamics
- Chapter 6 Statistical Mechanics
- Bibliography
- Index
- About the Author
Summary
In this preliminary chapter we shall give an exposition of certain topics in probability theory which are necessary to understand and interpret the definition and properties of entropy. We have tried to write the chapter in such a way that a reader with a knowledge of measure theory as given in Ash [15], Halmos [55], or any other basic measure theory text can follow the arguments and understand the examples. We introduce just those parts of probability theory which are necessary for the subsequent chapters and attempt to make them meaningful by use of very simple examples. We also restrict the discussion to “nice” probability spaces, so that conditional expectation and conditional probability are more intuitive and hopefully easier to understand. These “nice” spaces also make it possible to use partitions as models for random experiments, even those experiments which are limits of sequences of experiments.
Probability Spaces
Entropy is a quantitative measurement of uncertainty associated with random phenomena. In order to define this quantity precisely, it is necessary to have a mathematical model for random phenomena which is general enough to include many different physical situations and which has enough structure to allow us to use mathematical reasoning to answer questions about the phenomena.
Such a model is given by a mathematical structure called a probability space, which is nothing more than a measure space in which the measure of the universe set is 1.
- Type
- Chapter
- Information
- Mathematical Theory of Entropy , pp. 1 - 50Publisher: Cambridge University PressPrint publication year: 1984
- 1
- Cited by