Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
  1. Home
  2. Search

Refine search

Refine search

Access:
Content type:
Publication date:
Apply   From and To filters
Subject: Show more
Journals Show more
Publishers: Show more
Societies Show more
Series: Show more
Collections: Show more

Actions for selected content:

Select all | Deselect all
  • View selected items
  • Export citations
  • Download PDF (zip)
  • Save to Kindle
  • Save to Dropbox
  • Save to Google Drive

Save Search

You can save your searches here and later view and run them again in "My saved searches".

Please provide a title, maximum of 40 characters.
Cancel
×

2 results

  • Chapter 6 - Integrative Comprehension of Texts and Pictures

  • Wolfgang Schnotz, University of Koblenz-Landau
  • Book:
    Multimedia Comprehension
    Published online:
    16 February 2023
    Print publication:
    23 February 2023, pp 123-146

  • Summary

    Text comprehension and picture comprehension can be synthesized into a common conceptual framework which differentiates between external and internal descriptive and depictive representations. Combining this framework with the human cognitive architecture including sensory registers, working memory, and long-term memory leads to an integrated model of text and picture comprehension. The model consists of a descriptive branch and a depictive branch of processing. It includes multiple sensory modalities. Due to a flexible combination of sensory modalities and representational formats, the model covers listening comprehension, reading comprehension, visual picture comprehension, and sound comprehension. The model considers text comprehension and picture comprehension to be different routes for constructing mental models and propositional representations with the help of prior knowledge. It allows us to explain the effects of coherence, text modality, split attention, text–picture contiguity, redundancy, sequencing, and the effects of different types of visualization.

Multimedia Comprehension
  • Wolfgang Schnotz
  • Published online:
    16 February 2023
    Print publication:
    23 February 2023
  • Multimedia messages use combinations of texts, pictures, maps, and graphs as tools for communication. This book provides a synthesis of theory and research about how people comprehend multimedia. It adopts the perspectives of cognitive psychology, semiotics, anthropology, linguistics, education, and art. Its central idea is that information displays can be categorized into two different but complementary forms of representations, which service different purposes in human cognition and communication. Specific interaction between these representations enhances comprehension, thinking, and problem solving, as illustrated by numerous examples. Multimedia Comprehension is written for a broad audience with no special prior knowledge. It is of interest to everyone trying to understand how people comprehend multimedia, from scholars and students in psychology, communication, and education, to web- and interface-designers and instructors.