Hostname: page-component-586b7cd67f-2plfb Total loading time: 0 Render date: 2024-11-22T14:24:14.394Z Has data issue: false hasContentIssue false
  • English
  • Français

Getting the point: The role of gesture in managing intersubjectivity in a design activity

Published online by Cambridge University Press:  11 July 2011

Jared Donovan ,
Trine Heinemann ,
Ben Matthews  and
Jacob Buur
Jared Donovan
Affiliation:
Sønderborg Participatory Innovation Research Centre, University of Southern Denmark, Sønderborg, Denmark
Trine Heinemann
Affiliation:
Sønderborg Participatory Innovation Research Centre, University of Southern Denmark, Sønderborg, Denmark Institute of Business Communication and Information Science, University of Southern Denmark, Sønderborg, Denmark
Ben Matthews
Affiliation:
Sønderborg Participatory Innovation Research Centre, University of Southern Denmark, Sønderborg, Denmark Mads Clausen Institute, University of Southern Denmark, Sønderborg, Denmark
Jacob Buur
Affiliation:
Sønderborg Participatory Innovation Research Centre, University of Southern Denmark, Sønderborg, Denmark Mads Clausen Institute, University of Southern Denmark, Sønderborg, Denmark
Get access Rights & Permissions [Opens in a new window]

Abstract

This paper illustrates the complexity of pointing as it is employed in a design workshop. Using the method of interaction analysis, we argue that pointing is not merely employed to index, locate, or fix reference to an object. It also constitutes a practice for reestablishing intersubjectivity and solving interactional trouble such as misunderstandings or disagreements by virtue of enlisting something as part of the participants’ shared experience. We use this analysis to discuss implications for how such practices might be supported with computer mediation, arguing for a “bricolage” approach to systems development that emphasizes the provision of resources for users to collaboratively negotiate the accomplishment of intersubjectivity rather than systems that try to support pointing as a specific gestural action.

Keywords

Collaborative DesignComputer-Mediated CommunicationGestureIntersubjectivityPointing
Type
Special Issue Articles
Information
AI EDAM , Volume 25 , Issue 3: The Role of Gesture in Designing , August 2011 , pp. 221 - 235
Copyright
Copyright © Cambridge University Press 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Bates, E., Bretherton, I., Shore, C., & McNew, S. (1983). Names, gestures, and objects: symbolization in infancy and aphasia. In Children's Language (Nelson, K.E., Ed.), Vol. 4, pp. 59–123. Hillsdale, NJ: Erlbaum.Google Scholar
Bekker, M.M., Olson, J.S., & Olson, G.M. (1995). Analysis of gestures in face-to-face design teams provides guidance for how to use groupware in design. Proc. 1st Conf. Designing Interactive Systems: Processes, Practices, Methods, & Techniques, pp. 157–166. Ann Arbor, MI: ACM.Google Scholar
Benford, S., Bowers, J., Fahlén, L.E., Greenhalgh, C., & Snowdon, D. (1995). User embodiment in collaborative virtual environments. Proc. SIGCHI Conf. Human Factors in Computing Systems, pp. 242–249. Denver, CO: ACM Press/Addison–Wesley.Google Scholar
Brereton, M., & McGarry, B. (2000). An observational study of how objects support engineering design thinking and communication: implications for the design of tangible media. Proc. SIGCHI Conf. Human Factors in Computing Systems, pp. 217–224. The Hague: ACM.CrossRefGoogle Scholar
Buxton, B. (2007). Sketching User Experiences: Getting the Design Right and the Right Design. San Francisco, CA: Elsevier/Morgan Kaufmann.Google Scholar
Churchill, E., & Snowdon, D. (1998). Collaborative virtual environments: an introductory review of issues and systems. Virtual Reality 3(1), 3–15.CrossRefGoogle Scholar
Clark, H.H. (2003). Pointing and placing. In Pointing: Where Language, Culture, and Cognition Meet (Kita, S., Ed.), pp. 243–268. Hillsdale, NJ: Erlbaum.Google Scholar
Clark, H.H., Schreuder, R., & Buttrick, S. (1983). Common ground at the understanding of demonstrative reference. Journal of Verbal Learning and Verbal Behavior 22(2), 245–258.CrossRefGoogle Scholar
Clayman, S. (2002). Sequence and solidarity. Group Cohesion, Trust and Solidarity 19, 229–253.Google Scholar
Dourish, P., Adler, A., Bellotti, V., & Henderson, A. (1996). Your place or mine? Learning from long-term use of audio–video communication. Computer Supported Cooperative Work 5(1), 33–62.CrossRefGoogle Scholar
Dyck, J., Gutwin, C., Subramanian, S., & Fedak, C. (2004). High-performance telepointers. Proc. 2004 ACM Conf. Computer Supported Cooperative Work, pp. 172–181. Chicago: ACM.Google Scholar
Emmertsen, S., & Heinemann, T. (2010). Realization as a device for remedying problems of affiliation in interaction. Research on Language and Social Interaction 43(2), 109–132.CrossRefGoogle Scholar
Fussell, S.R., Setlock, L.D., Yang, J., Ou, J., Mauer, E., & Kramer, A.D.I. (2004). Gestures over video streams to support remote collaboration on physical tasks. Human–Computer Interaction 19(3) 273–309.CrossRefGoogle Scholar
Garfinkel, H. (1996). Ethnomethodology's program. Social Psychology Quarterly 59(1), 5–21.CrossRefGoogle Scholar
Goodwin, C. (1979). The interactive construction of a sentence in natural conversation. In Everyday Language: Studies in Ethnomethodology (Psathas, G., Ed.), pp. 97–121. New York: Irvington.Google Scholar
Goodwin, C. (2003). Pointing as situated practice. In Pointing: Where Language, Culture, and Cognition Meet (Kita, S., Ed.), pp. 217–241. Hillsdale, NJ: Erlbaum.Google Scholar
Goodwin, C. (2006). Human sociality as mutual orientation in a rich interactive environment: multimodal utterances and pointing in Aphasia. In Roots of Human Sociality (Enfield, N.J., & Levison, S.C., Eds.), pp. 96–125. New York: Berg.Google Scholar
Gutwin, C., & Penner, R. (2002). Improving interpretation of remote gestures with telepointer traces. Proc. 2002 ACM Conf. Computer Supported Cooperative Work, pp. 49–57. New Orleans, LA: ACM.Google Scholar
Haviland, J.B. (2003). How to point in Zinacantán. In Pointing: Where Language, Culture, and Cognition Meet (Kita, S., Ed.), pp. 139–170. Hillsdale, NJ: Erlbaum.Google Scholar
Heath, C., & Luff, P. (1991). Disembodied conduct: communication through video in a multi-media office environment. Proc. SIGCHI Conf. Human Factors in Computing Systems: Reaching Through Technology, pp. 99–103. New Orleans, LA: ACM.CrossRefGoogle Scholar
Heinemann, T., Mitchell, R., & Buur, J. (2009). Co-constructing meaning with materials in innovation workshops. In Objets et Communication MEI 30–31 (Darras, B., & Belkhamsa, S., Eds.), pp. 289–304. Paris: L'Harmattan.Google Scholar
Heritage, J. (1984). Garfinkel and ethnomethodology. Cambridge: Polity Press.Google Scholar
Hindmarsh, J., Fraser, M., Heath, C., Benford, S., & Greenhalgh, C. (1998). Fragmented interaction: establishing mutual orientation in virtual environments. Proc. 1998 ACM Conf. Computer Supported Cooperative Work, pp. 217–226. Seattle, WA: ACM.Google Scholar
Hindmarsh, J., & Heath, C. (2000). Embodied reference: a study of deixis in workplace interaction. Journal of Pragmatics 32(12), 1855–1878.CrossRefGoogle Scholar
Ishii, H., & Kobayashi, M. (1992). ClearBoard: a seamless medium for shared drawing and conversation with eye contact. Proc. SIGCHI Conf. Human Factors in Computing Systems, pp. 525–532. Monterey, CA: ACM.CrossRefGoogle Scholar
Jefferson, G. (2004). Glossary of transcript symbols with an introduction. In Conversation Analysis: Studies From the First Generation (Lerner, G., Ed.), pp. 13–31. Amsterdam: John Benjamins.CrossRefGoogle Scholar
Kendon, A. (2004). Gesture: Visible Action as Utterance. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Kendon, A., & Versante, L. (2003). Pointing by hand in “Neapolitan.” In Pointing: Where Language, Culture, and Cognition Meet (Kita, S., Ed.), pp. 109–138. Hillsdale, NJ: Erlbaum.Google Scholar
Kirk, D., Crabtree, A., & Rodden, T. (2005). Ways of the hands. Proc. 9th European Conf. Computer Supported Cooperative Work, pp. 1–21. Paris: Springer–Verlag.Google Scholar
Kuzuoka, H., Oyama, S., Yamazaki, K., Suzuki, K., & Mitsuishi, M. (2000). GestureMan: a mobile robot that embodies a remote instructor's actions. Proc. 2000 ACM Conf. Computer Supported Cooperative Work, pp. 155–162. Philadelphia, PA: ACM.Google Scholar
Labov, W., & Fanshel, D. (1977). Therapeutic Discourse: Psychotherapy as Conversation. New York: Academic.Google Scholar
Liszkowski, U. (2006). Infant pointing at twelve months: communicative goals, motives, and social–cognitive abilities. In Roots of Human Sociality (Enfield, N.J., & Levison, S.C., Eds.), pp. 153–178. New York: Berg.Google Scholar
Matthews, B. (2006). Grammar, meaning and movement-based interaction. Proc. OzCHI 2006, pp. 405–408.Google Scholar
McNeill, D. (1992). Hand and Mind. Chicago: University of Chicago Press.Google Scholar
Mondada, L. (2008). Using video for a sequential and multimodal analysis of social interaction: videotaping institutional telephone calls. Forum: Qualitative Social Research 9(3), Article 39. Accessed at http://www.qualitative-research.net/index.php/fqs/article/viewArticle/1161Google Scholar
Moore, R., Ducheneaut, N., & Nickell, E. (2007). Doing virtually nothing: awareness and accountability in massively multiplayer online worlds. Computer Supported Cooperative Work 16(3), 265–305.CrossRefGoogle Scholar
Osawa, N. (2006). Aggregate pointers to support large group collaboration using telepointers. Proc. CHI ‘06 Extended Abstracts on Human Factors in Computing Systems, pp. 1169–1174. Montreal: ACM.CrossRefGoogle Scholar
Osawa, N. (2007). Pointer delegation for group collaboration using telepointers. Proc. CHI ‘07 Extended Abstracts on Human Factors in Computing Systems, pp. 2603–2608. San Jose, CA: ACM.CrossRefGoogle Scholar
Pomerantz, A. (1984). Agreeing and disagreeing with assessments: some features of preferred/dispreferred turn shapes. In Structures of Social Action (Atkinson, J.M., & Heritage, J., Eds.), pp. 57–101. Cambridge: Cambridge University Press.Google Scholar
Sacks, H. (1995). Lectures on Conversation. Oxford: Blackwell.CrossRefGoogle Scholar
Sánchez, J.A., Strazzulla, D., & Paredes, R.G. (2008). Enhancing interaction and collaboration in multimedia rooms with multilayered annotations and telepointers. Proc. 8th Brazilian Symp. Human Factors in Computing Systems, pp. 117–125. Porto Alegre, Brazil: Sociedade Brasileira de Computação.Google Scholar
Schegloff, E.A., Jefferson, G., & Sacks, H. (1977). The preference for self-correction in the organization of repair in conversation. Language 53(2), 361–382.CrossRefGoogle Scholar
Sidnell, J. (2007). “Look”-prefaced turns in first and second position: launching, interceding and redirecting action. Discourse Studies 9(3), 387–408.CrossRefGoogle Scholar
Svennevig, J. (2008). Trying the easiest solution first in other-initiation of repair. Journal of Pragmatics 40(2), 333–348.CrossRefGoogle Scholar
Tang, J.C. (1989). Toward an understanding of the use of shared workspaces by design teams. PhD Thesis. Stanford University.Google Scholar
Tang, J.C., & Leifer, L.J. (1988). A framework for understanding the workspace activity of design teams. Proc. 1988 ACM Conf. Computer-Supported Cooperative Work, pp. 244–249. Portland, OR: ACM.Google Scholar
Tang, J.C., & Minneman, S. (1991). VideoWhiteboard: video shadows to support remote collaboration. Proc. SIGCHI Conf. Human Factors in Computing Systems: Reaching Through Technology, pp. 315–322. New Orleans, LA: ACM.CrossRefGoogle Scholar
Tomasello, M. (2006). Why don't apes point? In Roots of Human Sociality (Enfield, N.J., & Levison, S.C., Eds.), pp. 506–524. New York: Berg.Google Scholar
Tory, M., Staub-French, S., Po, B.A., & Wu, F. (2008). Physical and digital artifact-mediated coordination in building design. Computer Supported Cooperative Work 17(4), 311–351.CrossRefGoogle Scholar
Visser, W. (2009). The function of gesture in an architectural design meeting. In About Designing: Analysing Design Meetings (McDonnell, J., & Lloyd, P., Eds.), pp. 269–284. London: Taylor & Francis.Google Scholar
Visser, W. (2010). Function and form of gestures in a collaborative design meeting. In Gesture in Embodied Communication and Human–Computer Interaction. Proc. 8th Int. Gesture Workshop, GW 2009 (Kopp, S., & Wachsmuth, I., Eds.), LNCS, Vol. 5934, pp. 61–72. Heidelberg: Springer.Google Scholar
Wong, N., & Gutwin, C. (2010). Where are you pointing? The accuracy of deictic pointing in CVEs. Proc. 28th Int. Conf. Human Factors in Computing Systems, pp. 1029–1038. Atlanta, GA: ACM.Google Scholar
Yamazaki, K., Yamazaki, A., Kuzuoka, H., Oyama, S., Kato, H., Suzuki, H., & Miki, H. (1999). GestureLaser and GestureLaser Car. Proc. ECSCW ‘99, pp. 239–258.CrossRefGoogle Scholar
Ylirisku, S., & Buur, J. (2007). Designing With Video, Focusing the User-Centred Design Process. London: Springer.Google Scholar