The management of visual attention in graphic displays

doi:10.1017/CBO9780511974519.003

3 - The management of visual attention in graphic displays

Published online by Cambridge University Press: 04 February 2011

Ronald A. Rensink

Edited by

Claudia Roda

Show author details

Claudia Roda: Affiliation:
The American University of Paris, France

Book contents

Get access

Summary

This chapter presents an overview of several recent developments in vision science and outlines some of their implications for the management of visual attention in graphic displays. These include ways of sending attention to the right item at the right time, techniques to improve attentional efficiency, and possibilities for offloading some of the processing typically done by attention onto nonattentional mechanisms. In addition it is argued that such techniques not only allow more effective use to be made of visual attention but also open up new possibilities for human–machine interaction.

Introduction

Graphic displays such as maps, diagram and visual interfaces have long been used to present information in a form intended to be easy to comprehend (e.g., Massironi 2002; Tufte 2001; Ware 2008). While it is clear that such a goal is important, it is not so clear that it has always been achieved. Are current displays for the most part effective – do they enable user performance to be rapid, easy and accurate? Are they optimally so? Or are better designs possible?

These concerns are discussed here in the context of how to manage visual attention in graphic displays (including visual displays). This chapter is not directly concerned with the design of displays that respond effectively to the user (e.g., Roda and Thomas 2006; Vertegaal 2003). Rather, it focuses on the complementary perspective: how to design a display so that the user responds effectively to it. Results here apply equally well to static, dynamic and interactive displays.

Type: Chapter
Information: Human Attention in Digital Environments , pp. 63 - 92

DOI: https://doi.org/10.1017/CBO9780511974519.003 [Opens in a new window]

Publisher: Cambridge University Press

Print publication year: 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Albrecht-Buehler, C., Watson, B., and Shamma, D. A. 2005. Visualizing live text streams using motion and temporal pooling, IEEE Computer Graphics and Applications 25: 52–9CrossRef Google Scholar PubMed

Allport, D. A. 1993. Attention and control: Have we been asking the wrong questions? A critical review of twenty-five years, in Meyer, D. E. and Kornblum, S. (eds.), Attention and Performance. Cambridge, MA: MIT Press: vol. XIV: 183–218Google Scholar

Alvarez, G. A., and Scholl, B. J. 2005. How does attention select and track spatially extended objects? New effects of attentional concentration and amplification, Journal of Experimental Psychology: General 134: 461–76CrossRef Google Scholar PubMed

Ariely, D. 2001. Seeing sets: Representation by statistical properties, Psychological Science 12: 157–62CrossRef Google Scholar PubMed

Ballard, D. H., Hayhoe, M. M., Pook, P. K., and Rao, R. P. 1997. Deictic codes for the embodiment of cognition, Behavioral and Brain Sciences 20: 723–67CrossRef Google Scholar PubMed

Bang, M. 2000. Picture This: How Pictures Work. New York: Seastar BooksGoogle Scholar

Barth, H., Kanwisher, N., and Spelke, E. S. 2003. The construction of large number representations in adults, Cognition 86: 201–21CrossRef Google Scholar PubMed

Bartram, L., and Stone, M. 2007. Whisper, don't scream: Characterizing subtle grids, in Proceedings IEEE Visualization 2007. Sacramento, CAGoogle Scholar

Bartram, L., Ware, C., and Calvert, T. 2001. Filtering and integrating visual information with motion, in Proceedings on Information Visualization. Los Alamitos, CA: IEEE: 66–79

Block, B. A. 2001. The Visual Story: Seeing the Structure of Film, TV and New Media. Boston: Focal PressGoogle Scholar

Blok, C. A. 2006. Interactive animation to visually explore time series of satellite imagery, in Bres, S. and Laurini, R. (eds.), Visual Information and Information Systems. Berlin: Springer: 71–82CrossRef Google Scholar

Bruce, N., and Tsotsos, J. K. 2006. Saliency based on information maximization, Advances in Neural Information Processing Systems 18: 155–62Google Scholar

Burton, A. M., Bindemann, M., Langton, S. R., Schweinberger, S. R., and Jenkins, R. 2009. Gaze perception requires focused attention: Evidence from an interference task, Journal of Experimental Psychology: Human Perception and Performance 35: 108–18Google Scholar PubMed

Card, S. K., Mackinlay, J. D., and Shneiderman, B. 1999. Information visualization, in Card, S. K., Mackinlay, J. D., and Shneiderman, B. (eds.), Readings in Information Visualization: Using Vision to Think. San Francisco: Morgan Kaufman: 1–34Google Scholar

Chong, S. C., and Treisman, A. 2003. Representation of statistical properties, Vision Research 43: 393–404CrossRef Google Scholar PubMed

Chun, M., and Jiang, Y. 1998. Contextual cueing: Implicit learning and memory of visual context guides spatial attention, Cognitive Psychology 36: 28–71CrossRef Google Scholar PubMed

Clark, A. J. 2003. Natural-Born Cyborgs: Minds, Technologies, and the Future of Human Intelligence. Cambridge, MA: MIT PressGoogle Scholar

DeCarlo, D., and Santella, A. 2002. Stylization and abstraction of photographs, in Proceedings of SIGGRAPH 2002, San Antonio, TX: 769–76

Egeth, H. E., and Yantis, S. 1997. Visual attention: Control, representation, and time course, Annual Review of Psychology 48: 269–97CrossRef Google Scholar PubMed

Elazary, L., and Itti, L. 2008. Interesting objects are visually salient, Journal of Vision 8: 1–15CrossRef Google Scholar PubMed

Endsley, M. R. 1995. Toward a theory of situation awareness in dynamic systems, Human Factors 37: 85–104Google Scholar

Few, S. C. 2004 Show me the numbers: Designing tables and graphs to enlighten. Oakland, CA: Analytics PressGoogle Scholar

Grimes, J. 1996. On the failure to detect changes in scenes across saccades, in Akins, K. (ed.), Perception. New York: Oxford University Press: 89–110Google Scholar

Halper, N., Mellin, M., Herrmann, C. S., Linneweber, V., and Strothotte, T. 2003. Towards an understanding of the psychology of non-photorealistic rendering, Workshop on Computational Visualistics, Media Informatics and Virtual Communities (4–5 April, 2003), Wiesbaden: Deutscher Universitäts-Verlag: 67–78CrossRef Google Scholar

Hayhoe, M. M., Bensinger, D. G., and Ballard, D. H. 1998. Task constraints in visual working memory, Vision Research 38: 125–37CrossRef Google Scholar PubMed

Healey, C. G. 1996. Choosing effective colors for data visualization, in Proceedings of the 7th IEEE Conference on Visualization '96. San Francisco: 263–70Google Scholar

Healey, C. G., Booth, K. S., and Enns, J. T. 1996. High-speed visual estimation using preattentive processing, ACM Transactions on Computer–Human Interaction 3: 107–35CrossRef Google Scholar

Hochberg, J. E. 1978. Perception (2nd edn). Englewood Cliffs, NJ: Prentice–HallGoogle Scholar

Intriligator, J., and Cavanagh, P. 2001. The spatial resolution of visual attention, Cognitive Psychology 43: 171–216CrossRef Google Scholar PubMed

Itti, L. 2005. Models of bottom-up attention and saliency, in Itti, Rees and Tsotsos, : 576–82

Itti, L., Rees, G., and Tsotsos, J. K. (eds.) 2005. Neurobiology of Attention. San Diego: Elsevier

Kamba, T., Elson, S. A., Harpold, T., Stamper, T., and Sukaviriya, P. 1996. Using small screen space more efficiently, in Proceedings of ACM CHI 96, Vancouver: 383–90

Khan, A., Matejka, J., Fitzmaurice, G., and Kurtenbach, G. 2005. Spotlight: Directing users' attention on large displays, in Proceedings of ACM CHI 2005, Portland, OR: 791–98Google Scholar

Kosara, R., Miksch, S., and Hauser, H. 2002. Focus and context taken literally, IEEE Computer Graphics and its Applications 22: 22–9CrossRef Google Scholar

Kuhn, G., Amlani, A. A., and Rensink, R. A. 2008. Towards a science of magic, Trends in Cognitive Sciences 12: 349–54CrossRef Google Scholar PubMed

Laurel, B. 1993. Computers as Theatre. Reading, MA: Addison-WesleyGoogle Scholar

MacEachren, A. M. 1995. How Maps Work: Representation, Visualization, and Design. New York: Guilford Press: 51–149Google Scholar

Mack, A., and Rock, I. 1998. Inattentional Blindness. Cambridge, MA: MIT PressGoogle Scholar

Marcel, A. J. 1983. Conscious and unconscious perception: Experiments on visual masking and word recognition, Cognitive Psychology 15: 197–237CrossRef Google Scholar PubMed

Marr, D. 1982. Vision: A Computational Investigation into the Human Representation and Processing of Visual Information. San Francisco: FreemanGoogle Scholar

Massironi, M., 2002. The Psychology of Graphic Images: Seeing, Drawing, Communicating. Mahwah, NJ: Lawrence Erlbaum AssociatesGoogle Scholar

McCrickard, D. S., and Chewar, C. M. 2003. Attuning notification design to user goals and attention costs, Communications of the ACM 46: 67–72CrossRef Google Scholar

Milner, A. D., and Goodale, M. A. 1995. The Visual Brain in Action. Oxford: Oxford University PressGoogle Scholar

Moore, C. M., and Egeth, H. 1997. Perception without attention: Evidence of grouping under conditions of inattention, Journal of Experimental Psychology: Human Perception and Performance 23: 339–52Google Scholar PubMed

Mühlenen, A. von, and Lleras, A. 2007. No-onset looming motion guides spatial attention, Journal of Experimental Psychology: Human Perception and Performance 33: 1297–1310Google Scholar

Mullet, K., and Sano, D. 1995. Designing Visual Interfaces. Englewood Cliffs, NJ: Prentice HallGoogle Scholar

Nakayama, K., He, Z. J., and Shimojo, S. 1995. Visual surface representation: A critical link between lower-level and higher-level vision, in Kosslyn, S. M. and Osherson, D. N. (eds.), Visual Cognition (2nd edn). Cambridge, MA: MIT Press: 1–70Google Scholar

New, J., Cosmides, L., and Tooby, J. 2007. Category-specific attention for animals reflects ancestral priorities, not expertise, Proceedings of the National Academy of Sciences 104: 16598–603CrossRef Google Scholar

Norretranders, T. 1999. The User Illusion: Cutting Consciousness Down to Size. New York: Penguin BooksGoogle Scholar

Oliva, A. 2005. Gist of a scene, in Itti, Rees and Tsotsos, : 251–6

Palmer, S. E. 1999. Vision Science: Photons to Phenomenology. Cambridge, MA: MIT PressGoogle Scholar

Parasuraman, R. (ed.) 2000. The Attentive Brain. Cambridge, MA: MIT Press

Pashler, H. 1998. Attention. San Diego: Psychology PressGoogle Scholar

Po, B. A., Fisher, B. D., and Booth, K. S. 2003. Pointing and visual feedback for spatial interaction in large-screen display environments, in Proceedings of the 3rd International Symposium on Smart Graphics, Heidelberg: 22–38Google Scholar

Po, B. A., Fisher, B. D., and Booth, K. S. 2004. Mouse and touchscreen selection in the upper and lower visual fields, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vienna: 359–66

Pylyshyn, Z. W. 2003. Seeing and Visualizing: It's Not What You Think. Cambridge, MA: MIT PressGoogle Scholar

Pylyshyn, Z. W., and Storm, R. W. 1988. Tracking multiple independent targets: Evidence for a parallel tracking mechanism, Spatial Vision 3: 179–97CrossRef Google Scholar PubMed

Rensink, R. A. 2000. The dynamic representation of scenes, Visual Cognition 7: 17–42CrossRef Google Scholar

Rensink, R. A. 2001. Change blindness: Implications for the nature of attention, in Jenkin, M. and Harris, L. (eds.), Vision and Attention. New York: Springer: 169–88CrossRef Google Scholar

Rensink, R. A. 2002a. Change detection, Annual Review of Psychology 53: 245–77CrossRef Google Scholar PubMed

Rensink, R. A. 2002b. Internal vs. external information in visual perception, in Proceedings of the 2nd International Symposium on Smart Graphics, Hawthorne, NY: 63–70CrossRef Google Scholar

Rensink, R. A. 2003. Visual attention, in Nadel, L. (ed.), Encyclopedia of Cognitive Science. London: Nature Publishing Group: 509–15Google Scholar

Rensink, R. A. 2007. The modeling and control of visual perception, in Gray, W. D. (ed.), Integrated Models of Cognitive Systems. New York: Oxford University Press: 132–48CrossRef Google Scholar

Rensink, R. A., and Cavanagh, P. 2004. The influence of cast shadows on visual search, Perception 33: 1339–58CrossRef Google Scholar PubMed

Rensink, R. A., and Enns, J. T. 1998. Early completion of occluded objects, Vision Research 38: 2489–505CrossRef Google Scholar PubMed

Rensink, R. A., O'Regan, J. K., and Clark, J. J. 1997. To see or not to see: The need for attention to perceive changes in scenes, Psychological Science 8: 368–73CrossRef Google Scholar

Richards, W., and Kaufman, L. 1969. ‘Centre-of-gravity’ tendencies for fixations and flow patterns, Perception and Psychophysics 5: 81–4CrossRef Google Scholar

Ristic, J., Wright, A., and Kingstone, A. 2007. Attentional control and reflexive orienting to gaze and arrow cues, Psychonomic Bulletin and Review 14: 964–9CrossRef Google Scholar PubMed

Roda, C., and Thomas, J. (eds.) 2006. Attention aware systems, special issue of Computers in Human Behavior 22(4): Elsevier

Seif El-Nasr, M. 2005. Intelligent lighting for game environments, Journal of Game Development 1: 17–50Google Scholar

Sharpe, S. 1988. Conjurers' Psychological Secrets. Calgary: Hades Publications: 46–83Google Scholar

Shive, J., and Francis, G. 2008. Applying models of visual search to map display design, International Journal of Human–Computer Studies 66: 67–77CrossRef Google Scholar

Simons, D. J., and Chabris, C. 1999. Gorillas in our midst: Sustained inattentional blindness for dynamic events, Perception 28: 1059–74CrossRef Google Scholar PubMed

Solso, R. L. 1994. Cognition and the Visual Arts. Cambridge, MA: MIT PressGoogle Scholar

St John, M., Smallman, H. S., Manes, D. I., Feher, B. A., and Morrison, J. G. 2005. Heuristic automation for decluttering tactical displays, Human Factors 47: 509–25CrossRef Google Scholar PubMed

Su, S. L., Durand, F., and Agrawala, M. 2005. De-emphasis of distracting image regions using texture power maps, in Texture 2005: Proceedings of the 4th International Workshop on Texture Analysis and Synthesis, Beijing: 119–24

Tatler, B. W. 2002. What information survives saccades in the real world? in Hyönä, J., Munoz, D., Heide, W., and Radach, R. (eds.), The Brain's Eye: Neurobiological and Clinical Aspects of Oculomotor Research. Amsterdam: Elsevier: 149–63CrossRef Google Scholar

Theeuwes, J., and Godijn, R. 2002. Irrelevant singletons capture attention: Evidence from inhibition of return, Perception and Psychophysics 64: 764–70CrossRef Google Scholar PubMed

Thomas, J. J., and Cook, K. A. (eds.) 2005. Illuminating the Path: The Research and Development Agenda for Visual Analytics. Richland, WA: National Visualization and Analytics Center

Thorpe, S. J., Fize, D., and Marlot, C. 1996. Speed of processing in the human visual system, Nature 381: 520–2CrossRef Google Scholar PubMed

Tognazzini, B. 1993. Principles, techniques, and ethics of stage magic and their application to human interface design, in Proceedings of INTERCHI 96. New York: ACM: 355–62Google Scholar

Treisman, A. 1988. Features and objects: The fourteenth Bartlett memorial lecture, Quarterly Journal of Experimental Psychology 40A: 201–37CrossRef Google Scholar

Tufte, E. R. 1990. Envisioning Information. Cheshire, CT: Graphics PressGoogle Scholar

Tufte, E. R. 2001. The Visual Display of Quantitative Information (2nd edn). Cheshire, CT: Graphics PressGoogle Scholar

Vertegaal, R. (ed.) 2003. Attentive user interfaces, special issue of Communications of the ACM 46

Vishwanath, D., and Kowler, E. 2003. Localization of shapes: Eye movements and perception compared, Vision Research 43: 1637–53CrossRef Google Scholar PubMed

Ward, P. 1996. Picture Composition for Film and Television. Oxford: Butterworth-HeinemannGoogle Scholar

Ware, C. 2004. Information Visualization: Perception for Design (2nd edn). San Francisco: Morgan KaufmannGoogle Scholar

Ware, C. 2008. Visual Thinking for Design. San Francisco: Morgan KaufmannGoogle Scholar

Wickens, C. D., and McCarley, J. S. 2008. Applied Attention Theory. Boca Raton, FL: CRC PressGoogle Scholar

Wolfe, J. M. 1999. Inattentional amnesia, in Coltheart, V. (ed.), Fleeting Memories. Cambridge, MA: MIT Press: 71–94Google Scholar

Wolfe, J. M. 2000. Visual attention, in Valois, K. K. (ed.), Seeing (2nd edn). San Diego: Academic Press: 335–86CrossRef Google Scholar

Wolfe, J. M. 2005. How might the rules that govern visual search constrain the design of visual displays? Society for Information Display. Boston, MAGoogle Scholar

Wolfe, J. M., and DiMase, J. S. 2003. Do intersections serve as basic features in visual search? Perception 32: 645–56CrossRef Google Scholar PubMed

Book contents

3 - The management of visual attention in graphic displays

Summary

Access options

References

Save book to Kindle

Save book to Dropbox

Save book to Google Drive