Book contents
- Multimedia Comprehension
- Multimedia Comprehension
- Copyright page
- Dedication
- Contents
- Preface
- Chapter 1 Introduction
- Chapter 2 A Short History of Multimedia Sign Systems
- Chapter 3 Basic Forms of Representations
- Chapter 4 Comprehension of Text
- Chapter 5 Comprehension of Pictures
- Chapter 6 Integrative Comprehension of Texts and Pictures
- Chapter 7 Quasi-symbiotic Relations between Text and Picture Comprehension
- Chapter 8 Beyond Comprehension
- Chapter 9 Practical Implications
- Concluding Remarks
- References
- Index
Chapter 6 - Integrative Comprehension of Texts and Pictures
Published online by Cambridge University Press: 16 February 2023
- Multimedia Comprehension
- Multimedia Comprehension
- Copyright page
- Dedication
- Contents
- Preface
- Chapter 1 Introduction
- Chapter 2 A Short History of Multimedia Sign Systems
- Chapter 3 Basic Forms of Representations
- Chapter 4 Comprehension of Text
- Chapter 5 Comprehension of Pictures
- Chapter 6 Integrative Comprehension of Texts and Pictures
- Chapter 7 Quasi-symbiotic Relations between Text and Picture Comprehension
- Chapter 8 Beyond Comprehension
- Chapter 9 Practical Implications
- Concluding Remarks
- References
- Index
Summary
Text comprehension and picture comprehension can be synthesized into a common conceptual framework which differentiates between external and internal descriptive and depictive representations. Combining this framework with the human cognitive architecture including sensory registers, working memory, and long-term memory leads to an integrated model of text and picture comprehension. The model consists of a descriptive branch and a depictive branch of processing. It includes multiple sensory modalities. Due to a flexible combination of sensory modalities and representational formats, the model covers listening comprehension, reading comprehension, visual picture comprehension, and sound comprehension. The model considers text comprehension and picture comprehension to be different routes for constructing mental models and propositional representations with the help of prior knowledge. It allows us to explain the effects of coherence, text modality, split attention, text–picture contiguity, redundancy, sequencing, and the effects of different types of visualization.
Keywords
- Type
- Chapter
- Information
- Multimedia Comprehension , pp. 123 - 146Publisher: Cambridge University PressPrint publication year: 2023