Book contents
- The Cambridge Handbook of Gesture Studies
- Cambridge Handbooks in Language and Linguistics
- The Cambridge Handbook of Gesture Studies
- Copyright page
- Contents
- Figures
- Tables
- Contributors
- Introduction
- Part I Gestural Types: Forms and Functions
- Part II Ways of Approaching Gesture Analysis
- Part III Gestures and Language
- Part IV Gestures in Relation to Cognition
- Part V Gestures in Relation to Interaction
- Index
- References
Part V - Gestures in Relation to Interaction
Published online by Cambridge University Press: 01 May 2024
Edited by
Book contents
- The Cambridge Handbook of Gesture Studies
- Cambridge Handbooks in Language and Linguistics
- The Cambridge Handbook of Gesture Studies
- Copyright page
- Contents
- Figures
- Tables
- Contributors
- Introduction
- Part I Gestural Types: Forms and Functions
- Part II Ways of Approaching Gesture Analysis
- Part III Gestures and Language
- Part IV Gestures in Relation to Cognition
- Part V Gestures in Relation to Interaction
- Index
- References
Summary
A summary is not available for this content so a preview has been provided. Please use the Get access link above for information on how to access this content.
- Type
- Chapter
- Information
- The Cambridge Handbook of Gesture Studies , pp. 577 - 682Publisher: Cambridge University PressPrint publication year: 2024
References
References
Alibali, M. W., Heath, D. C., & Myers, H. J. (2001). Effects of visibility between speaker and listener on gesture production: Some gestures are meant to be seen. Journal of Memory and Language, 44(2), 169–188. https://doi.org/10.1006/jmla.2000.2752CrossRefGoogle Scholar
Allport, G. W. (1954). The historical background of modern social psychology. In Lindzey, G. (Ed.), Handbook of Social Psychology (Vol. I, pp. 3–56). Cambridge, MA: Addison-Wesley.Google Scholar
Aronson, E., & Carlsmith, J. M. (1968). Experimentation in social psychology. In Lindzey, G. & Aronson, E. (Eds.), The handbook of social psychology (2nd ed., Vol. 2, pp. 1–79). Reading, MA: Addison-Wesley.Google Scholar
Bangerter, A., & Chevally, E. (2007). Pointing and describing in referential communication: When are pointing gestures used to communicate? In van der Sluis, I., Theune, M., Reiter, E., & Krahmer, E. (Eds.), CTIT Proceedings of the Workshop on Multimodal Output Generation (pp. 17–28). Enschede, the Netherlands: Centre for Telematics and Information Technology.Google Scholar
Bateson, G. (1951). Information and codification: A philosophical approach. In Ruesch, J. & Bateson, G. (Eds.), Communication. The social matrix of psychiatry (pp. 168–227). New York, NY: W. W. Norton & Company.Google Scholar
Bavelas, J. B. (2005). The two solitudes: Reconciling social psychology and language and social interaction. In Fitch, K. & Sanders, R. (Eds.), Handbook of language and social interaction (pp. 179–200). Mahwah, NJ: Erlbaum.Google Scholar
Bavelas, J. B. (2007). Face-to-face dialogue as a micro-social context. The example of motor mimicry. In Duncan, S., Levy, E., & Cassell, J. (Eds.), Gesture and the dynamic dimension of language (pp. 127–146). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Bavelas, J. B. (2022). Face-to-face dialogue. Theory, research, and applications. Oxford, UK: Oxford University Press.CrossRefGoogle Scholar
Bavelas, J. B., Chovil, N., Coates, L., & Roe, L. (1995). Gestures specialized for dialogue. Personality and Social Psychology Bulletin, 21(4), 394–405. https://doi.org/10.1177/0146167295214010CrossRefGoogle Scholar
Bavelas, J. B., Chovil, N., Lawrie, D. A., & Wade, A. (1992). Interactive gestures. Discourse Processes, 15(4), 469–489. https://doi.org/10.1080/01638539209544823CrossRefGoogle Scholar
Bavelas, J. B., Coates, L., & Johnson, T. (2000). Listeners as co-narrators. Journal of Personality and Social Psychology, 79(6), 941–952. https://doi.org/10.1037/0022-3514.79.6.941CrossRefGoogle ScholarPubMed
Bavelas, J., Gerwing, J., Allison, M., & Sutton, C. (2011). Dyadic evidence for grounding with abstract deictic gestures. In Stam, G. & Ishino, M. (Eds.), Integrating gestures: The interdisciplinary nature of gesture (pp. 49–60). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Bavelas, J. B., Gerwing, J., Sutton, C., & Prevost, D. (2008). Gesturing on the telephone: Independent effects of dialogue and visibility. Journal of Memory and Language, 58(2), 495–520. https://doi.org/10.1016/j.jml.2007.02.004CrossRefGoogle Scholar
Bavelas, J. B., & Healing, S. (2013). Reconciling the effects of mutual visibility on gesturing. A review. Gesture, 13(1), 63–92. https://doi.org/10.1075/gest.13.1.03bavCrossRefGoogle Scholar
Chafe, W. (1994). Discourse, consciousness, and time. Chicago, IL: University of Chicago Press.Google Scholar
Clark, H. H. (1996). Using language. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Clark, H. H., & Krych, M. A. (2004). Speaking while monitoring addressees for understanding. Journal of Memory and Language, 50(1), 62–81. https://doi.org/10.1016/j.jml.2003.08.004CrossRefGoogle Scholar
Clark, H. H., & Schaefer, E. F. (1987). Collaborating on contributions to conversations. Language and Cognitive Processes, 2(1), 19–41. https://doi.org/10.1080/01690968708406350CrossRefGoogle Scholar
Clark, H. H., & Wilkes-Gibbs, D. (1986). Referring as a collaborative process. Cognition, 22, l–39. https://doi.org/10.1016/0010-0277(86)90010-7CrossRefGoogle ScholarPubMed
Cohen, A. A. (1977). The communicative functions of hand illustrators. Journal of Communication, 27(4), 54–63.CrossRefGoogle Scholar
Cohen, A. A., & Harrison, R. P. (1973). Intentionality in the use of hand illustrators in face-to-face communication situations. Journal of Personality and Social Psychology, 28(2), 276–279.CrossRefGoogle Scholar
Danziger, K. (1990). Constructing the subject: Historical origins of psychological research. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
De Fornel, M. (1992). The return gesture: Some remarks on context, inference, and iconic gesture. In Auer, P. & di Luzio, A. (Eds.), The contextualization of language (pp. 159–176). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
De Ruiter, J. P., Bangerter, A., & Dings, P. (2012). The interplay between gesture and speech in the production of referring expressions: Investigating the tradeoff hypothesis. Topics in Cognitive Science, 4(2), 232–248. https://doi.org/10.1111/j.1756-8765.2012.01183.xCrossRefGoogle ScholarPubMed
Duncan, S., Jr. (1969). Nonverbal communication. Psychological Bulletin, 72(2), 118–137.CrossRefGoogle Scholar
Efron, D. (1972). Gesture, race, and culture: A tentative study of some of the spatio-temporaland “linguistic” aspects of gestural behavior of Eastern Jews and Southern Italians in New York City, living under similar as well as different environmental conditions. The Hague, the Netherlands: Mouton.Google Scholar
Ekman, P., & Friesen, W. V. (1969). The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica, 1(1), 49–98. https://doi.org/10.1515/semi.1969.1.1.49CrossRefGoogle Scholar
Emmorey, K., & Casey, S. (2001). Gesture, thought and spatial language. Gesture, 1(1), 35–50. https://doi.org/10.1075/gest.1.1.04emmCrossRefGoogle Scholar
Fowler, C. A. (1988). Differential shortening of repeated content words produced in various communicative contexts. Language and Speech, 31(4), 307–319.CrossRefGoogle ScholarPubMed
Galati, A., & Brennan, S. E. (2013). Speakers adapt gestures to addressees’ knowledge: Implications for models of co-speech gesture. Language and Cognitive Processes, 29(4), 435–451. https://doi.org/10.1080/01690965.2013.796397Google Scholar
Gerwing, J. (2003). The effect of immediate communicative function on the physical form of conversational hand gestures. (Unpublished Master’s thesis). University of Victoria, Victoria, B.C., Canada.Google Scholar
Gerwing, J., & Allison, M. (2011). The flexible semantic integration of gestures and words: Comparing face-to-face and telephone dialogues. Gesture, 11(3), 308–329. https://doi.org/10.1075/gest.11.3.03gerCrossRefGoogle Scholar
Gerwing, J., & Bavelas, J.B. (2004). Linguistic influences on gesture’s form. Gesture, 4(2), 157–195. https://doi.org/10.1075/gest.4.2.04gerCrossRefGoogle Scholar
Grice, H. P. (1975). Logic and conversation. In Cole, P. and Morgan, J. L. (Eds.), Syntax and semantics 3: speech acts (pp. 41–58). New York, NY: Academic Press.Google Scholar
Healing, S., & Gerwing, J. (2012, July). Spatial cohesiveness in gesture sequences: Effects of mutual visibility. Paper presented at the fifth conference of the International Society for Gesture Studies, Lund, Sweden. Abstract retrieved from https://www.gesturestudies.com/s/ISGS5_BOA_120718.pdfGoogle Scholar
Hilliard, C., & Cook, S. W. (2015). Bridging gaps in common ground: Speakers design their gestures for their listeners. Journal of Experimental Psychology: Learning, Memory, and Cognition, 42(1), 91–103. https://doi.org/10.1037/xlm0000154Google Scholar
Holler, J., & Bavelas, J. B. (2017). On the multi-modal communication of common ground – A review and examination of social functions. In Church, R. B., Alibali, M. W., & Kelly, S. (Eds.), Why gesture? How the hands function in speaking, thinking, and communicating (pp. 213–240). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Holler, J., Bavelas, J., Woods, J., Geiger, M., & Simons, L. (2022). Given-new effects on the duration of gestures and of words in face-to-face dialogue. Discourse Processes, 59(8), 619–645. https://doi.org/10.1080/0163853X.2022.2107859CrossRefGoogle Scholar
Holler, J., & Beattie, G. (2007). Gesture use in social interaction: How speakers’ gestures can reflect listeners’ thinking. Paper presented at the third conference of the International Society for Gesture Studies, Chicago, IL.Google Scholar
Holler, J., & Levinson, S. C. (2019). Multimodal language processing in human communication. Trends in Cognitive Science, 23(8), 639–652. https://doi.org/10.1016/j.tics.2019.05.006CrossRefGoogle ScholarPubMed
Holler, J., & Stevens, R. (2007). The effect of common ground on how speakers use gesture and speech to represent size information. Journal of Language and Social Psychology, 26(1), 4–27. https://doi.org/10.1177/0261927X06296428CrossRefGoogle Scholar
Holler, J., Turner, K., & Varcianna, T. (2013). It’s on the tip of my fingers: Co-speech gestures during lexical retrieval in different social contexts. Language and Cognitive Processes, 28(10), 1509–1518. https://doi.org/10.1080/01690965.2012.698289CrossRefGoogle Scholar
Holler, J., Tutton, M., & Wilkin, K. (2011). Co-speech gestures in the process of meaning coordination. In Proceedings of the 2nd GESPIN- Gesture and Speech in Interaction Conference, Bielefeld, 5–7 September 2011.Google Scholar
Holler, J., & Wilkin, K. (2011). Co-speech gesture mimicry in the process of collaborative referring during face-to-face dialogue. Journal of Nonverbal Behavior, 35(2), 133–153. https://doi.org/10.1007/s10919-011-0105-6CrossRefGoogle Scholar
Hostetter, A. B. (2011). When do gestures communicate? A meta-analysis. Psychological Bulletin, 137(2), 297–315. https://doi.org/10.1037/a0022128CrossRefGoogle ScholarPubMed
Kendon, A. (1994). Do gestures communicate? A review. Research on Language and Social Interaction, 27(3), 175–200. https://doi.org/10.1207/s15327973rlsi2703_2CrossRefGoogle Scholar
Kendon, A. (1995). Gestures as illocutionary and discourse structure markers in Southern Italian conversation. Journal of Pragmatics, 23, 247–279. https://doi.org/10.1016/0378-2166(94)00037-FCrossRefGoogle Scholar
Kendon, A. (2004). Gesture. Visible action as utterance. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Kendon, A. (2017). Pragmatic functions of gestures. Some observations on the history of their study and their nature. Gesture. 16(2), 157–175. https://doi.org/10.1075/gest.16.2.01kenCrossRefGoogle Scholar
Kok, K., Bergmann, K., Cienki, A., & Kopp, S. (2016). Mapping out the multifunctionality of speakers’ gestures. Gesture, 15(1), 37–59. https://doi.org/10.1075/gest.15.1.02kokCrossRefGoogle Scholar
Krauss, R. M., Dushay, R. A., Chen, Y., & Rauscher, F. (1995). The communicative value of conversational hand gestures. Journal of Experimental Social Psychology, 31(6), 533–552. https://doi.org/10.1006/jesp.1995.1024CrossRefGoogle Scholar
Krauss, R. M., Morrel-Samuels, P., & Colasante, C. (1991). Do conversational hand gestures communicate? Journal of Personality and Social Psychology, 61(5), 743–754. https://doi.org/10.1037/0022-3514.61.5.743CrossRefGoogle ScholarPubMed
Kuhlen, A. K., & Brennan, S. E. (2013). Language in dialogue: When confederates might be hazardous to your data. Psychonomic Bulletin and Review, 20, 54–72. https://doi.org/10.3758/s13423-012-0341-8CrossRefGoogle ScholarPubMed
McNeill, D. (1985). So you think gestures are nonverbal? Psychological Review, 92(3), 350–371. https://doi.org/10.1037/0033-295X.92.3.350CrossRefGoogle Scholar
McNeill, D. (2005). Gesture and thought. Chicago, IL: University of Chicago Press.CrossRefGoogle Scholar
McNeill, D., & Levy, E. T. (1982). Cohesion and gesture. Discourse Processes, 16(4), 363–386. https://doi.org/10.1080/01638539309544845CrossRefGoogle Scholar
Mol, L., Krahmer, E., Maes, A., & Swerts, M. (2009a). Communicative gestures and memory load. In Proceedings of the 31st Annual Conference of the Cognitive Science Society, Amsterdam, the Netherlands, 1569–1574.Google Scholar
Mol, L., Krahmer, E., Maes, A., & Swerts, M. (2009b). The communicative import of gestures. Evidence from a comparative analysis of human–human and human–machine interactions. Gesture, 9(1), 97–126. https://doi.org/10.1075/gest.9.1.04molCrossRefGoogle Scholar
Özyurek, A. (2000). The influence of addressee location on spatial language and representational gestures of direction. In McNeill, D. (Ed.), Language and gesture (pp. 64–83). Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Özyurek, A. (2002). Do speakers design their cospeech gestures for their addressees? The effects of addressee location on representational gestures. Journal of Memory and Language, 46, 688–704. https://doi.org/10.1006/jmla.2001.2826CrossRefGoogle Scholar
Pine, K. J., Burney, D. J., & Fletcher, B. (2010). The semantic specificity hypothesis: When gestures do not depend upon the presence of a listener. Journal of Nonverbal Behavior, 34(3), 169–178. https://doi.org/10.1007/s10919-010-0089-7CrossRefGoogle Scholar
Rimé, B. (1982). The elimination of visible behavior from social interactions: Effects on verbal, nonverbal and interpersonal variables. European Journal of Social Psychology, 12(2), 113–129. https://doi.org/10.1002/ejsp.2420120201CrossRefGoogle Scholar
Seyfeddinipur, M. (2004). Meta-discursive gestures from Iran: Some uses of the “Pistol Hand.” In Müller, C. & Posner, R. (Eds.), The semantics and pragmatics of everyday gestures. Proceedings of the Berlin Conference 1998. Berlin, Germany: Weidler Buchverlag.Google Scholar
Streeck, J. (2009). Gesturecraft. The manu-facture of meaning. Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Streeck, J., Goodwin, C., & LeBaron, C. (Eds.). (2011). Embodied interaction: Language and body in the material world. Cambridge, UK: Cambridge University Press.Google Scholar
References
Bavelas, J. B., Chovil, N., Lawrie, D. A., & Wade, A. (1992). Interactive gestures. Discourse Processes, 15(4), 469–489. https://doi.org/10.1080/01638539209544823CrossRefGoogle Scholar
Belhiah, H. (2013). Gesture as a resource for intersubjectivity in second-language learning situations. Classroom Discourse, 4(2), 111–129. https://doi.org/10.1080/19463014.2012.671273CrossRefGoogle Scholar
Brandom, R. (1994). Making it explicit: Reasoning, representing, and discursive commitment. Cambridge, MA: Harvard University Press.Google Scholar
Brinck, I. (2008). The role of intersubjectivity in the development of intentional communication. In Zlatev, J., Racine, T. R., & Sinha, C. (Eds.), The shared mind: Perspectives on intersubjectivity (pp. 115–140). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Bruner, J. (1983). Child’s talk: Learning to use language. New York, NY: W. W. Norton.Google Scholar
Cassell, J., & Tartaro, A. (2007). Intersubjectivity in human–agent interaction. Interaction Studies, 8(3), 391–410. https://doi.org/10.1075/is.8.3.05casCrossRefGoogle Scholar
Cooperrider, K. (2011). Review of Tim Wharton (2009). Pragmatics and non-verbal communication. Gesture, 11(1), 81–88. https://doi.org/10.1075/gest.11.1.05cooCrossRefGoogle Scholar
Cooperrider, K. (2017). Foreground gesture, background gesture. Gesture, 16(2), 176–202. https://doi.org/10.1075/gest.16.2.02cooCrossRefGoogle Scholar
Csordas, T. J. (2008). Intersubjectivity and intercorporeality. Subjectivity, 22(1), 110–121. https://doi.org/10.1057/sub.2008.5CrossRefGoogle Scholar
Cuffari, E. (2011). Mining the mismatch: An essay review. Gesture, 11(2), 219–231. https://doi.org/10.1075/gest.11.2.06cufCrossRefGoogle Scholar
Cuffari, E. (2012). Gestural sense-making: hand gestures as intersubjective linguistic enactments. Phenomenology and the Cognitive Sciences, 11(4), 599–622. https://doi.org/10.1007/s11097-011-9244-9CrossRefGoogle Scholar
Cuffari, E. C., Di Paolo, E., & De Jaegher, H. (2015). From participatory sense-making to language: There and back again. Phenomenology and the Cognitive Sciences, 14(4), 1089–1125. https://doi.org/10.1007/s11097-014-9404-9CrossRefGoogle Scholar
Cuffari, E., & Streeck, J. (2017). Taking the world by hand. In Meyer, C., Streeck, J., & Jordan, J. S. (Eds.), Intercorporeality: Beyond the body (pp. 173–201). Oxford, UK: Oxford University Press.Google Scholar
De Jaegher, H. (2018). The intersubjective turn. In Newen, A., De Bruin, L., & Gallagher, S. (Eds.), The Oxford handbook of 4E cognition (pp. 453–467). Oxford, UK: Oxford University Press.Google Scholar
De Jaegher, H., & Di Paolo, E. (2007). Participatory sense-making. Phenomenology and the Cognitive Sciences, 6(4), 485–507. https://doi.org/10.1007/s11097-007-9076-9CrossRefGoogle Scholar
Di Paolo, E. (2015). Interactive time-travel: On the intersubjective retro-modulation of intentions. Journal of Consciousness Studies, 22(1–2), 49–74.Google Scholar
Di Paolo, E. A., Cuffari, E. C., & De Jaegher, H. (2018). Linguistic bodies: The continuity between life and language. Cambridge, MA: MIT Press.CrossRefGoogle Scholar
Di Paolo, E. A., & De Jaegher, H. (2012). The interactive brain hypothesis. Frontiers in Human Neuroscience, 6, 163. https://doi.org/10.3389/fnhum.2012.00163CrossRefGoogle ScholarPubMed
Donovan, J., Heinemann, T., Matthews, B., & Buur, J. (2011). Getting the point: The role of gesture in managing intersubjectivity in a design activity. Artificial Intelligence for Engineering Design, Analysis and Manufacturing: AIEDAM, 25(3), 221–235. http://eprints.qut.edu.au/56683/CrossRefGoogle Scholar
Enfield, N. J. (2009). The anatomy of meaning: Speech, gesture, and composite utterances. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Fuchs, T., & De Jaegher, H. (2009). Enactive intersubjectivity: Participatory sense-making and mutual incorporation. Phenomenology and the Cognitive Sciences, 8(4), 465–486. https://doi.org/10.1007/s11097-009-9136-4CrossRefGoogle Scholar
Gallagher, S. (2013). The socially extended mind. Cognitive Systems Research, 25–26, 4–12. https://doi.org/10.1016/j.cogsys.2013.03.008CrossRefGoogle Scholar
Gerwing, J., & Bavelas, J. (2004). Linguistic influences on gesture’s form. Gesture, 4(2), 157–195. https://doi.org/10.1075/gest.4.2.04gerCrossRefGoogle Scholar
Glock, H. J. (2018). Critical note: Language and learning from the 4e perspective. In Newen, A., De Bruin, L., & Gallagher, S. (Eds.), Oxford handbook of 4E cognition (pp. 706–716). Oxford, UK: Oxford University Press.Google Scholar
Gómez, J. C. (2003). Are apes persons? The case for primate intersubjectivity. In Armstrong, S. J. & Botzler, R. G. (Eds.), The animal ethics reader (pp. 138–143). New York, NY: Routledge.Google Scholar
Gómez, J. C. (2010). The ontogeny of triadic cooperative interactions with humans in an infant gorilla. Interaction Studies, 11(3), 353–379. https://doi.org/10.1075/is.11.3.02gomCrossRefGoogle Scholar
Goodwin, C. (1981). Conversational organization: Interaction between speakers and hearers. New York, NY: Academic Press.Google Scholar
Goodwin, C. (2006). Human sociality as mutual orientation in a rich interactive environment: Multimodal utterances and pointing in aphasia. In Goodwin, C., Enfield, N. J., & Levinson, S. C. (Eds.), Roots of human sociality: Culture, cognition and interaction (pp. 97–125). New York, NY: Berg Publishers.Google Scholar
Grice, P. (1989). Studies in the way of words. Cambridge, MA: Harvard University Press.Google Scholar
Harrison, S. (2021). The feel of a recurrent gesture: Embedding the Vertical Palm within a gift-giving episode in China (aka the “seesaw battle”). Gesture, 20(2), 254–284. https://doi.org/10.1075/gest.21003.harCrossRefGoogle Scholar
Holler, J., & Bavelas, J. (2017). Multi-modal communication of common ground. In Breckinridge Church, R., Alibali, M., & Kelly, S. (Eds.), Why gesture? How the hands function in speaking, thinking and communicating (pp. 213–240). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Holler, J., & Stevens, R. (2007). The effect of common ground on how speakers use gesture and speech to represent size information. Journal of Language and Social Psychology, 26(1), 4–27. https://doi.org/10.1177/0261927X06296428CrossRefGoogle Scholar
Hostetter, A. B., & Alibali, M. W. (2019). Gesture as simulated action: Revisiting the framework. Psychonomic Bulletin & Review, 26(3), 721–752. https://doi.org/10.3758/s13423-018-1548-0CrossRefGoogle ScholarPubMed
Hostetter, A. B., Alibali, M. W., & Schrager, S. M. (2011). If you don’t already know, I’m certainly not going to show you! In Stam, G. & Ishino, M. (Eds.), Integrating gestures: The interdisciplinary nature of gesture (pp. 61–75). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Hougaard, A. R., & Rasmussen, G. (2013). Fused bodies: On the interrelatedness of cognition and interaction. In Müller, C., Cienki, A., Fricke, E., Ladewig, S., McNeill, D., & Teßendorf, S. (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 1, pp. 564–577). Berlin, Germany: De Gruyter Mouton.Google Scholar
Ishino, M. (2007). Intersubjectivity in gestures: the speaker’s perspective towards the addressee. In Duncan, S. D., Cassell, J., & Levy, E. T. (Eds.), Gesture and the dynamic dimension of language: Essays in honor of David McNeill (pp. 243–250). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Jacobs, N., & Garnham, A. (2007). The role of conversational hand gestures in a narrative task. Journal of Memory and Language, 56(2), 291–303. https://doi.org/10.1016/j.jml.2006.07.011CrossRefGoogle Scholar
Kendon, A. (2013). Exploring the utterance roles of visible bodily action: A personal account. In Müller, C., Cienki, A., Fricke, E., Ladewig, S., McNeill, D., & Teßendorf, S. (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 1, pp. 7–28). Berlin, Germany: De Gruyter Mouton.Google Scholar
Krueger, J. (2012). Seeing mind in action. Phenomenology and the Cognitive Sciences, 11(2), 149–173. https://doi.org/10.1007/s11097-011-9226-yCrossRefGoogle Scholar
Ladewig, S. H., & Bressem, J. (2013). New insights into the medium hand: Discovering recurrent structures in gestures. Semiotica, 2013(197), 203–231. https://doi.org/10.1515/sem-2013-0088CrossRefGoogle Scholar
Loenhoff, J. (2017). Intercorporeality as a foundational dimension of human communication. In Meyer, C., Streeck, J., & Jordan, J. S. (Eds.), Intercorporeality: Emerging socialities in interaction (pp. 25–50). Oxford, UK: Oxford University Press.Google Scholar
Maclaren, K. (2002). Intercorporeality, intersubjectivity and the problem of “Letting others be”. Chiasmi International, 4, 187–208. http://digital.casalini.it/5063051CrossRefGoogle Scholar
McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago, IL: University of Chicago Press.Google Scholar
McNeill, D. (2013). Gesture as a window onto mind and brain, and the relationship to linguistic relativity and ontogenesis. In Müller, C., Cienki, A., Fricke, E., Ladewig, S., McNeill, D., & Teßendorf, S. (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 1, pp. 28–54). Berlin, Germany: De Gruyter Mouton.Google Scholar
Majlesi, A. R. (2015). Matching gestures: Teachers’ repetitions of students’ gestures in second language learning classrooms. Journal of Pragmatics, 76, 30–45. https://doi.org/10.1016/j.pragma.2014.11.006CrossRefGoogle Scholar
Mondada, L., & Oloff, F. (2011). Gesture in overlap: the situated establishment of speakership. In Stam, G. & Ishino, M. (Eds.), Integrating gestures: The interdisciplinary nature of gesture (pp. 321–337). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Nathan, M. J., & Alibali, M. W. (2011). How gesture use enables intersubjectivity in the classroom. In Stam, G. & Ishino, M. (Eds.), Integrating gestures: The interdisciplinary nature of gesture (pp. 257–266). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Nathan, M. J., Alibali, M. W., & Breckinridge Church, R. (2017). Making and breaking common ground. In Church, R. Breckinridge, Alibali, M., & Kelly, S. (Eds.), Why gesture? How the hands function in speaking, thinking and communicating (pp. 285–316). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Özyürek, A. (2002). Do speakers design their cospeech gestures for their addressees? The effects of addressee location on representational gestures. Journal of Memory and Language, 46(4), 688–704. https://doi.org/10.1006/jmla.2001.2826CrossRefGoogle Scholar
Pika, S., Liebal, K., Call, J., & Tomasello, M. (2005). Gestural communication of apes. Gesture, 5(1–2), 41–56. https://doi.org/10.1075/gest.5.1.05pikCrossRefGoogle Scholar
Putnam, H. (1974). Meaning and reference. The Journal of Philosophy, 70(19), 699–711. https://doi.org/10.2307/2025079CrossRefGoogle Scholar
Ratcliffe, M. (2006). Rethinking commonsense psychology: A critique of folk psychology, theory of mind and simulation. London, UK: Palgrave Macmillan.CrossRefGoogle Scholar
Schubotz, L., Özyürek, A., & Holler, J. (2019). Age-related differences in multimodal recipient design: Younger, but not older adults, adapt speech and co-speech gestures to common ground. Language, Cognition and Neuroscience, 34(2), 254–271. https://doi.org/10.1080/23273798.2018.1527377CrossRefGoogle Scholar
Sikveland, R. O., & Ogden, R. (2012). Holding gestures across turns: Moments to generate shared understanding. Gesture, 12(2), 166–199. https://doi.org/10.1075/gest.12.2.03sikCrossRefGoogle Scholar
Streeck, J. (1993). Gesture as communication I: Its coordination with gaze and speech. Communications Monographs, 60(4), 275–299. https://doi.org/10.1080/03637759309376314CrossRefGoogle Scholar
Streeck, J. (1994). Gesture as communication II: The audience as co-author. Research on Language and Social Interaction, 27(3), 239–267. https://doi.org/10.1207/s15327973rlsi2703_5CrossRefGoogle Scholar
Streeck, J. (2002). A body and its gestures. Gesture, 2(1), 19–44. https://doi.org/10.1075/gest.2.1.03strCrossRefGoogle Scholar
Streeck, J. (2009). Gesturecraft: The manu-facture of meaning. Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Streeck, J. (2010). Ecologies of gesture. In Streeck, J. (Ed.), New adventures in language and interaction (pp. 223–242). Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Streeck, J. (2017). Self-making man: A day of action, life, and language. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Tomasello, M. (1996). The gestural communication of apes and human infants. Infant Behavior and Development, 19, 248. https://doi.org/10.1016/S0163-6383(96)90302-1CrossRefGoogle Scholar
Trevarthen, C. (2011). What is it like to be a person who knows nothing? Defining the active intersubjective mind of a newborn human being. Infant and Child Development, 20(1), 119–135. https://doi.org/10.1002/icd.689CrossRefGoogle Scholar
Vajrabhaya, P., & Pederson, E. (2018). Teasing apart listener-sensitivity: The role of interaction. Gesture, 17(1), 65–97. https://doi.org/10.1075/gest.00011.vajCrossRefGoogle Scholar
Wakefield, E. M., Novack, M. A., Congdon, E. L., & Howard, L. H. (2021). Individual differences in gesture interpretation predict children’s propensity to pick a gesturer as a good informant. Journal of Experimental Child Psychology, 205, 105069. https://doi.org/10.1016/j.jecp.2020.105069CrossRefGoogle Scholar
Weiss, G. (1999). The abject borders of the body image. In Weiss, G. & Haber, H. (Eds.), Perspectives on embodiment: The intersections of nature and culture (pp. 41–59). New York, NY: Routledge.Google Scholar
Wharton, T. (2009). Pragmatics and non-verbal communication. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
References
Agha, A. (2007). Language and social relations. Cambridge, UK: Cambridge University Press.Google Scholar
Bressem, J., & Müller, C. (2014a). A repertoire of recurrent gestures of German. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D. & Bressem, J. (Eds.), Body-language-communication: An international handbook on multimodality in human interaction (Vol. 2, pp. 1575–1591). Berlin, Germany: De Gruyter Mouton.Google Scholar
Bressem, J., & Müller, C. (2014b). The family of away gestures: Negation, refusal, and negative assessment. In Müller, C., Cienki, A., Fricke, E., Ladewig, S., McNeill, D., & Bressem, J. (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 2, pp. 1592–1604). Berlin, Germany: De Gruyter Mouton.Google Scholar
Bressem, J., Stein, N., & Wegener, C. (2017). Multimodal language use in Savosavo: Refusing, excluding and negating with speech and gesture. Pragmatics, 27(2), 173–206. https://doi.org/10.1075/prag.27.2.01breGoogle Scholar
Brookes, H. (2001). O clever “He’s streetwise.” When gestures become quotable: The case of the clever gesture. Gesture, 1(2), 167–184. https://doi.org/10.1075/gest.1.2.05broCrossRefGoogle Scholar
Brookes, H. (2004). A first repertoire of South African quotable gestures. Linguistic Anthropology, 14(2), 186–224. https://doi.org/10.1525/jlin.2004.14.2.186CrossRefGoogle Scholar
Brookes, H. (2014a). Gesture in the communicative ecology of a South African township. In Seyfeddinipur, M. & Gullberg, M. (Eds.), From gesture in conversation to visible action as utterance (pp. 59–74). Amsterdam, the Netherlands: John Benjamins.Google Scholar
Brookes, H. (2014b). Urban youth languages in South Africa: A case study of tsotsitaal in a South African township. Anthropological Linguistics, 56(3–4), 356–388. https://doi.org/10.1353/anl.2014.0018CrossRefGoogle Scholar
Brookes, H., & Nyst, V. (2014). Gesture in the sub-Saharan region. In Müller, C., Cienki, A., Fricke, E., Ladewig, S.H., McNeill, D. & Bressem, J. (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 2, pp. 1154–1161). Berlin, Germany: De Gruyter Mouton. .Google Scholar
Brown, A., & Gullberg, M. (2011). Bidirectional crosslinguistic influence in event conceptualization? Expressions of path among Japanese learners of English. Bilingualism: Language and Cognition, 14(1), 79–94. https://doi.org/10.1017/S1366728910000064CrossRefGoogle Scholar
Bucholtz, M. (1999). You da man: Narrating the racial other in the production of white masculinity. Journal of Sociolinguistics, 3(4), 443–460. https://doi.org/10.1111/1467-9481.00090CrossRefGoogle Scholar
Bucholtz, M., & Hall, K. (2005). Identity and interaction: A sociolinguistic approach. Discourse Studies, 7(4–5), 585–614. https://doi.org/10.1177/1461445605054407CrossRefGoogle Scholar
Bucholtz, M., & Hall, K. (2016). Embodied sociolinguistics. In Coupland, N. (Ed.), Sociolinguistics: Theoretical debates (pp. 173–200). Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Bulwer, J. (1974). Chirologia or the natural language of the hand, etc. [and] Chironomia or the art of manual rhetoric, etc. London: Henry Twyford. Edited with an introduction by Cleaty, James W.. Carbondale, IL: Southern Illinois University Press. (Original work published 1644)Google Scholar
Cameron, D., & Kulick, D. (2003). Language and sexuality. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Condillac, E. B. de (1971). An essay on the origin of human knowledge (1756); being a supplement to Mr Locke’s essay on the human understanding. Facsimile reproduction of the translation of Thomas Nugent, edited and with an introduction by Weyant, Robett G.. Delmar, NY: Scholars’ Facsimiles and Reprints. (Original work published 1746)Google Scholar
Cooperrider, K. (2019). Universals and diversity in gesture: Research past, present, and future. Gesture, 18(2), 209–238. https://doi.org/10.1075/gest.19011.cooCrossRefGoogle Scholar
Cooperrider, K., Abner, N., & Goldin-Meadow, S. (2018). The palm-up puzzle: Meanings and origins of a widespread form in gesture and sign. Frontiers in Communication, 3 (June), 1–16. https://doi.org/10.3389/fcomm.2018.00023CrossRefGoogle Scholar
Covington-Ward, Y. (2016). Gesture and power: Religion, nationalism, and everyday performance in Congo. Durham, NC: Duke University Press.Google Scholar
Covington-Ward, Y. (2019). Considerations of temporality and power in an anthropology of gesture: Cases from the precolonial Kongo Kingdom. Gesture, 18(2–3), 261–280. https://doi.org/10.1075/gest.19021.covCrossRefGoogle Scholar
Creider, C. A. (1977). Towards a description of East African gestures. Sign Language Studies, 14(1), 1–20. www.jstor.org/stable/26203193CrossRefGoogle Scholar
Creider, C. A. (1978). Intonation, tone groups and body motion in Luo conversation. Anthropological Linguistics, 20(7), 327–339. www.jstor.org/stable/30027426Google Scholar
Creider, C. A. (1986). Interlanguage comparisons in the study of the interactional use of gesture: Progress and prospects. Semiotica, 62(12), 147–164. https://doi.org/10.1515/semi.1986.62.1-2.147CrossRefGoogle Scholar
Cutler, C. (1999). Yorkville crossing: White teens, hip hop, and African American English. Journal of Sociolinguistics, 3(4), 428–442. https://doi.org/10.1111/1467-9481.00089CrossRefGoogle Scholar
De Jorio, A. (2000). Gesture in Naples and gesture in classical antiquity. A translation of La mimica degli antichi investigata nel gestire napoletano (1932), and with an introduction and notes, by Adam Kendon. Bloomington, IN: Indiana University Press.Google Scholar
Diderot, D. (1916). Letter on deaf mutes. In Diderot’s Early Philosophical Works, translated and edited by Jourdian, Margaret. Chicago, IL: Open Court Publishing. (Original work published 1751)Google Scholar
Driessen, H. (1992). Gestured masculinity: Body and sociability in rural Andalusia. In Bremmer, J. & Roodenburg, H. (Eds.), A cultural history of gesture: From antiquity to the present day (pp. 237–252). Ithaca, NY: Cornell University Press.Google Scholar
Eckert, P. (1998). Jocks and burnouts: Social categories and identity in the high school. New York, NY: Teachers College Press.Google Scholar
Eckert, P. (2012). Three waves of variation study: The emergence of meaning in the study of sociolinguistic variation. Annual Review of Anthropology, 41, 87–100. https://doi.org/10.1146/annurev-anthro-092611-145828CrossRefGoogle Scholar
Efron, D. (1972). Gesture, race and culture. The Hague, the Netherlands: Mouton and Co.Google Scholar
Ekman, P., & Friesen, W. (1969). The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica, 1(1), 49–98. https://doi.org/10.1515/semi.1969.1.1.49CrossRefGoogle Scholar
Enfield, N. J. (2005). The body as a cognitive artifact in kinship representations: Hand gesture diagrams by speakers of Lao. Current Anthropology, 46(1), 51–81. https://doi.org/10.1086/425661CrossRefGoogle Scholar
Ferré, G., & Mettouchi, A. (2020). A cultural study of open-palm hand gestures and their prosodic correlates. In Proceedings of the 10th International Conference on Speech Prosody 2020, May 25–28, 2020, Tokyo, Japan (pp. 285–289). https://doi.org/10.21437/SpeechProsody.2020-58CrossRefGoogle Scholar
Gawne, L. (2021). “Away” gestures associated with negative expressions in narrative discourse in Syuba (Kagate, Nepal) speakers. Semiotica, 2021 (239), 37–59. https://doi.org/10.1515/sem-2017-0163CrossRefGoogle Scholar
Gu, Y., Zheng, Y., & Swerts, M. (2019). Which is in front of Chinese people, past or future? The effect of language and culture on temporal gestures and spatial conceptions of time. Cognitive Science, 43(12), e12804. https://doi.org/10.1111/cogs.12804CrossRefGoogle ScholarPubMed
Hall, K., Goldstein, D., & Ingram, B. (2016). The hands of Donald Trump: Entertainment, gesture, spectacle. Journal of Ethnographic Theory, 6(2), 71–100. https://doi.org/10.14318/hau6.2.009CrossRefGoogle Scholar
Harrison, S. (2018). The impulse to gesture. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Harrison, S., & Ladewig, S. (2021). Recurrent gestures throughout bodies, languages, and cultural practices. Gesture, 20(2), 153–179. https://doi.org/10.1075/gest.21014.harCrossRefGoogle Scholar
Harrison, S., & Larrivée, P. (2016). Morphosyntactic correlates of gestures: A gesture associated with negation in French and its organisation with speech. In Larrivée, P. & Lee, C. (Eds.), Negation and polarity: Experimental perspectives (pp. 75–94). Cham, Switzerland: Springer International Publishing.CrossRefGoogle Scholar
Haviland, J. (1993). Anchoring, iconicity, and orientation in Guugu Yimithirr pointing gestures. Linguistic Anthropology, 3(1), 3–45. https://doi.org/10.1525/jlin.1993.3.1.3CrossRefGoogle Scholar
Haviland, J. (1998). Guugu Yimithirr cardinal directions. Ethos, 26(1), 25–47.CrossRefGoogle Scholar
Haviland, J. (2019). Space as space and space as grammar An anthropological journey through gesture(d) spaces. Gesture, 18(2–3), 305–342. https://doi.org/10.1075/gest.20014.havCrossRefGoogle Scholar
Hymes, D. (1974). Foundations in sociolinguistics: An ethnographic approach. Philadelphia, PA: University of Pennsylvania Press.Google Scholar
Kendon, A. (1992). Some recent work from Italy on Quotable Gestures (Emblems). Journal of Linguistic Anthropology, 2(1), 92–108. https://doi.org/10.1525/jlin.1992.2.1.92CrossRefGoogle Scholar
Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Kendon, A. (2017). Pragmatic functions of gesture: Some observations on the history of their study and their nature. Gesture, 16(2), 157–176. https://doi.org/10.1075/gest.16.2.01kenCrossRefGoogle Scholar
Kita, S. (2009). Cross-cultural variation of speech-accompanying gesture: A review. Language and Cognitive Processes, 24(2), 145–167. https://doi.org/10.1080/01690960802586188CrossRefGoogle Scholar
Kita, S., Danziger, E., & Stolz, C. (2001). Cultural specificity of spatial schemas, as manifested in spontaneous gestures. In Gattis, M. (Ed.), Spatial schemas and abstract thought (pp. 115–146). Cambridge, MA: MIT Press.CrossRefGoogle Scholar
Kita, S., & Essegby, J. (2001). Pointing left in Ghana: How a taboo on the use of the left hand influences gestural practice. Gesture, 1(1), 73–95. https://doi.org/10.1075/gest.1.1.06kitCrossRefGoogle Scholar
Kita, S., & Ide, S. (2007). Nodding, aizuchi, and final particles in Japanese conversation: How conversation reflects the ideology of communication and social relationships. Journal of Pragmatics, 39(7), 1242–1254. https://doi.org/10.1016/j.pragma.2007.02.009CrossRefGoogle Scholar
Kita, S., & Özyürek, A. (2003).What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48(1), 16–32. https://doi.org/10.1016/S0749-596X(02)00505-3CrossRefGoogle Scholar
Kulick, D. (2003). Language and desire. In Holmes, J. & Meyerhoff, M. (Eds.), The handbook of language and gender (pp. 119–141). Oxford, UK: Blackwell.CrossRefGoogle Scholar
Kunene, R. (2010). Etude interlangue du développement narratif multimodal chez l’enfant âgé de 6 à 12 ans en contexte isiZulu et Français. (Unpublished doctoral dissertation). Université Stendhal (Grenoble III).Google Scholar
Labov, W. (2006). The social stratification of English in New York City. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Ladewig, S. (2014a). Recurrent gestures. In Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Bressem, J. (Eds.), Body - language - communication: An international handbook on multimodality in human interaction (Vol. 2, pp. 1558–1575). Berlin, Germany: De Gruyter Mouton.Google Scholar
Ladewig, S. (2014b). The cyclic gesture. In Müller, C., Cienki, A., Fricke, E., Ladewig, S., McNeill, D., & Bressem, J. (Eds.), Body-language-communication: An international handbook on multimodality in human interaction (Vol. 2, pp. 1605–1618). Berlin, Germany: De Gruyter Mouton.Google Scholar
Le Guen, O. (2011). Speech and gesture in spatial language and cognition among the Yucatec Mayas. Cognitive Science, 35, 905–938. https://doi.org/10.1111/j.1551-6709.2011.01183.xCrossRefGoogle ScholarPubMed
Le Guen, O., & Balam, L. I. P. (2012). No metaphorical timeline in gesture and cognition among Yucatec Mayas. Frontiers in Psychology, 3, Article 271. https://doi.org/10.3389/fpsyg.2012.00271CrossRefGoogle ScholarPubMed
Lempert, M. (2011). Barack Obama being sharp: Indexical order in the pragmatics of precision-grip gesture. Gesture, 11(3), 241–270. https://doi.org/10.1075/gest.11.3.01lemCrossRefGoogle Scholar
Levinson, S. C. (1996). Frame of reference and Molyneux’s question: Crosslinguistic evidence. In Bloom, P., Peterson, M., Nadel, L., & Garrett, M. (Eds.), Language and space (pp. 109–169). Cambridge, MA: MIT Press.CrossRefGoogle Scholar
Levinson, S. C. (2003). Space in language and cognition: Exploration in cognitive diversity. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
McNeill, D., & Duncan, S. (2000). Growth points in thinking-for-speaking. In McNeill, D. (Ed.), Language and gesture (pp. 141–161). Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Maribe, T., & Brookes, H. (2014). Male youth talk in the construction of black lesbian identities. Southern African Linguistics and Applied Language Studies, 32(2), 199–214. https://doi.org/10.2989/16073614.2014.992641CrossRefGoogle Scholar
Mauss, M. (1973 [orig. 1935]). Techniques of the body. Economy and Society, 2(1), 70–88. https://doi.org/10.1080/03085147300000003CrossRefGoogle Scholar
Mead, M., & Bateson, G. (1942). Balinese character: A photographic analysis. New York, NY: New York Academy of Sciences.Google Scholar
Morris, D., Collett, P., Marsh, P., & O’Shaughnessy, M. (1979). Gestures: Their origins and distribution. London, UK: Jonathan Cape.Google Scholar
Müller, C. (1998). Redebegleitende Gesten: Kulturegeschichte – Theorie – Sprachvergleich. Berlin, Germany: Berlin Verlag Arno Spitz.Google Scholar
Müller, C. (2004). Forms and uses of the Palm Up Open Hand. A case of a gesture family? In Müller, C. & Posner, R. (Eds.), Semantics and pragmatics of everyday gestures (pp. 233–256). Berlin, Germany: Weidler.Google Scholar
Núñez, R., & Sweetser, E. (2006). With the future behind them: Convergent evidence from Aymara language and gesture in the crosslinguistic comparison of spatial construals of time. Cognitive Science, 30(3), 401–450. https://doi.org/10.1207/s15516709cog0000_62CrossRefGoogle ScholarPubMed
Özyürek, A., Kita, S., Allen, S., Brown, A., Furman, R., & Ishizuka, T. (2008). Development of cross-linguistic variation in speech and gesture: Motion events in English and Turkish. Developmental Psychology, 44(4), 1040–1054. https://doi.org/10.1037/0012-1649.44.4.1040CrossRefGoogle ScholarPubMed
Özyürek, A., Kita, S., Allen, S., Furman, R., & Brown, A. (2005). How does linguistic framing of events influence co-speech gestures? Insights from crosslinguistic variations and similarities. Gesture, 5, 219–240. https://doi.org/10.1075/gest.5.1.15ozyCrossRefGoogle Scholar
Payrató, L. (1993). A pragmatic view on autonomous gestures: A first repertoire of Catalan emblems. Journal of Pragmatics, 20, 193–216. https://doi.org/10.1016/0378-2166(93)90046-RCrossRefGoogle Scholar
Quintilian, M. F. (1922). The institutio oratoria of Quintilian. Translated by H. E. Butler, Vol. 4. New York, NY: G. P. Putnam and Sons. (Original work published 95 C.E.)Google Scholar
Rampton, B. (1995). Crossing: Language and ethnicity among adolescents. London, UK: Longman.Google Scholar
Rampton, B., & Charalambous, C. (2010). Crossing. In Martin-Jones, M., Blackledge, A., & Creese, A. (Eds.), The Routledge handbook of multilingualism (pp. 482–498). London, UK: Routledge.Google Scholar
Saitz, R., & Cervanka, E. (1972). Handbook of gestures: Columbia and the United States. The Hague, the Netherlands: Mouton.CrossRefGoogle Scholar
Sanders, K. W. (2015). The convergence of language and culture in Malawian gestures: Handedness in everyday rituals. In Agwuele, A. (Ed.), Body talk and cultural identity in the African world (pp. 111–132). Sheffield, UK: Equinox Publishing Ltd.Google Scholar
Schuler, E. A. (1944). V for victory: A study in symbolic social control. Journal of Social Psychology, 19, 283–299.Google Scholar
Sherzer, J. (1972). Verbal and nonverbal deixis: The pointed lip gesture among the San Bas Cuna. Language in Society, 2, 117–131. https://doi.org/10.1017/S0047404500000087CrossRefGoogle Scholar
Sherzer, J. (1991). The Brazilian thumbs-up gesture. Journal of Linguistic Anthropology, 1(2), 189–197. https://doi.org/10.1525/jlin.1991.1.2.189/CrossRefGoogle Scholar
Silverstein, M. (2003). Indexical order and the dialectics of sociolinguistic life. Language and Communication, 23(3/4), 193–229. https://doi.org/10.1016/S0271-5309(03)00013-2CrossRefGoogle Scholar
Stam, G. (2015). Changes in thinking for speaking: A longitudinal study. The Modern Language Journal, 99(Supplement), 83–99. https://doi.org/10.1111/j.1540-4781.2015.12180.xCrossRefGoogle Scholar
Sullivan, K., & Bui, L.T. (2016). With the future coming up behind them: Evidence that time approaches from behind in Vietnamese. Cognitive Linguistics, 27(2), 205–233. https://doi.org/10.1515/cog-2015-0066CrossRefGoogle Scholar
Talmy, L. J. (2007). Lexicalization patterns: semantic structure in lexical forms. In Shopen, T. (Ed.), Language typology and syntactic description, volume III: Grammatical categories and the lexicon (pp. 66–168). Cambridge, UK: Cambridge University Press. (Original work published 1985)CrossRefGoogle Scholar
Trudgill, P. (1972). Sex, covert prestige and linguistic change in the urban British English of Norwich. Language in Society, 1(2), 179–195. https://doi.org/10.1017/S0047404500000488CrossRefGoogle Scholar
Trudgill, P. (1974). The social differentiation of English in Norwich. Cambridge, UK: Cambridge University Press.Google Scholar
Tylor, E. B. (1964). Researches into the early history of mankind and the development of civilization by Edward B. Tylor. Edited and abridged with an introduction by P. Bohannan. Chicago, IL: University of Chicago Press. (Original work published 1865)Google Scholar
Wundt, W. (1973). The language of gestures. The Hague, the Netherlands: Mouton.CrossRefGoogle Scholar
References
Alexanderson, S., Henter, G. E., Kucherenko, T., & Beskow, J. (2020). Style-controllable speech-driven gesture synthesis using normalising flows. Computer Graphics Forum, 39(2), 487–496. https://doi.org/10.1111/cgf.13946CrossRefGoogle Scholar
Allen, S., Özyürek, A., Kita, S., Brown, A., Furman, R., Ishizuka, T., & Fujii, M. (2007). Language-specific and universal influences in children’s syntactic packaging of Manner and Path: A comparison of English, Japanese, and Turkish. Cognition, 102(1), 16–48. https://doi.org/10.1016/j.cognition.2005.12.006CrossRefGoogle ScholarPubMed
Allwood, J., Cerrato, L., Jokinen, K., Navarretta, C., & Paggio, P. (2007). The MUMIN coding scheme for the annotation of feedback, turn management and sequencing phenomena. International Journal of Language Resources and Evaluation, 41(3–4), 273–287. https://doi.org/10.1007/s10579-007-9061-5CrossRefGoogle Scholar
Anastasiou, D. (2011). Gestures in assisted living environments. In Efthimiou, E. & Kouroupetroglou, G. (Eds.), Lecture notes in computer science: Vol. 7206. Gesture and sign language in human-computer interaction and embodied communication (pp. 1–12). Berlin, Germany: Springer. https://doi.org/10.1007/978-3-642-34182-3_1Google Scholar
Anastasiou, D., Jokinen, K., & Wilcock, G. (2013). Evaluation of WikiTalk: User studies of human–robot interaction. In Kurosu, M. (Ed.), Lecture notes in computer science: Vol. 8007. Universal access in human-computer interaction (pp. 32–42). Berlin, Germany: Springer. https://doi.org/10.1007/978-3-642-39330-3_4Google Scholar
Aylett, R., Vannini, N., André, E., Paiva, A., Enz, S., & Hall, L. (2009). But that was in another country: Agents and intercultural empathy. Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems AAMAS-2009 Budapest, Hungary, 329–336. https://dl.acm.org/citation.cfk?id=1558013.1558058Google Scholar
Baltrušaitis, T., Ahuja, C., & Morency, L. (2019). Multimodal machine learning: A survey and taxonomy. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41(2), 423–443. https://doi.org/10.1109/TPAMI.2018.2798607CrossRefGoogle ScholarPubMed
Bartneck, C., Suzuki, T., Kanda, T., & Nomura, T. (2007). The influence of people’s culture and prior experiences with AIBO on their attitude towards robots. AI & Society: Knowledge, Culture and Communication, 21, 217–230. https://doi.org/10.1007/s00146-006-0052-7CrossRefGoogle Scholar
Bavelas, J. B., & Chovil, N. (2000). Visible acts of meaning. An integrated message model of language use in face-to-face dialogue. Journal of Language and Social Psychology, 19(2), 163–194. https://doi.org/10.1177/0261927X00019002001CrossRefGoogle Scholar
Bavelas, J. B., Chovil, N., & Roe, L. (1995). Gestures specialized for dialogue. Personality and Social Psychology Bulletin, 21(4), 394–405. https://doi.org/10.1177/0146167295214010CrossRefGoogle Scholar
Beck, A., Canamero, L., & Bard, K. A. (2010). Towards an affect space for robots to display emotional body language. Proceedings of the 19th IEEEE International Symposium in Robot and Human Interactive Communication (Ro-MAN 2010), Viareggio, Italy, 464–469. https://doi.org/10.1109/ROMAN.2010.5598649Google Scholar
Bergmann, K., & Kopp, S. (2009). GNetIc – Using Bayesian decision networks for iconic gesture generation. In Ruttkay, Z., Kipp, M., Nijholt, A. & Vilhjálmsson, H. H. (Eds.), Lecture notes in computer science: Vol. 5773. Intelligent Virtual Agents. IVA 2009 (pp. 76–89). Berlin, Germany: Springer. https://doi.org/10.1007/978-3-642-04380-2_12Google Scholar
Bergmann, K., Kopp, S. & Eyssel, F. (2010). Individualized gesturing outperforms average gesturing: Evaluating gesture production in virtual humans. In Allbeck, J., Badler, N., Bickmore, T., Pelachaud, C., & Safonova, A. (Eds.), Lecture notes in computer science: Vol. 6356: Intelligent Virtual Agents. IVA 2010 (pp. 104–117). Berlin, Germany: Springer.Google Scholar
Billard, A., Robins, B., Nadel, J., & Dautenhahn, K. (2006). Building robota, a mini-humanoid robot for the rehabilitation of children with autism. The RESNA Assistive Technology Journal, 19, 37–49. https://doi.org/10.1080/10400435.2007.10131864CrossRefGoogle Scholar
Breazeal, C. (2002). Designing sociable robots. Bradford Books. Cambridge, MA: MIT Press.Google Scholar
Cangelosi, A., & Harnad, S. (2001). The adaprive advantage of symbolc theft over sensorimotor toil: Grounding language in perceptual categories. Evolution of Communication, 4(1), 117–142. https://doi.org/10.1075/eoc.4.1.07canCrossRefGoogle Scholar
Cassell, J. (2000). Nudge nudge wink wink: Elements of face-to-face conversation for embodied conversational agents. In Cassell, J., Sullivan, J., Prevost, S., & Churchill, E. F. (Eds.), Embodied Conversational Agents (pp. 1–27). Cambridge, MA: MIT Press.CrossRefGoogle Scholar
Cassell, J., Stone, M., Douville, B., Prevost, S., Achorn, B., Steedman, M., Badler, N., & Pelachaud, C. (1994). Modeling the interaction between speech and gesture. In Ram, A., & Eiselt, K. (Eds.), Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society (pp. 153–158). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Çeliktutan, O., Skordos, E., & Gunes, H. (2017). Multimodal human–human–robot interactions (MHHRI) dataset for studying personality and engagement. IEEE Transactions on Affective Computing, 10(4), 481–497. https://doi.org/10.1109/TAFFC.2017.2737019Google Scholar
Chiu, C.-C., Morency, L-P. , & Marsella, S. (2015). Predicting co-verbal gestures: A deep and temporal modeling approach. In Brinkman, W. P., Broekens, J., & Heylen, D. (Eds.), Intelligent virtual agents. Lecture notes in computer science: Vol. 9238 (pp. 152–166). Berlin, Germany: Springer. https://doi.org/10.1007/978-3-319-21996-7_17CrossRefGoogle Scholar
Chu, M., & Kita, S. (2016). Co-thought and co-speech gestures are generated by the same action generation process. Journal of Experimental Psychology: Learning, Memory, and Cognition, 42(2), 257–270. https://doi.org/10.1037/xlm0000168Google ScholarPubMed
Cienki, A. (1998). Metaphoric gestures and some of their relations to verbal metaphoric expressions. In Koenig, J.-P. (Ed.), Discourse and cognition: Bridging the gap (pp. 189–204). Stanford, CA: Center for the Study of Language and Information.Google Scholar
Cienki, A., & Muller, C. (Eds.). (2008). Metaphor and gesture. Amsterdam, the Netherlands: John Benjamins.CrossRefGoogle Scholar
Clark, H. H., & Schaefer, E. F. (1989). Contributing to discourse, Cognitive Science, 13(2), 256–294. https://doi.org/10.1207/S15516709COG1302_7CrossRefGoogle Scholar
Csapo, A., Gilmartin, E., Grizou, J., Han, J., Meena, R., Anastasiou, D., Jokinen, K., & Wilcock, G. (2012). Multimodal conversational interaction with a humanoid robot. Proceedings of the 3rd IEEE Conference on Cognitive Infocommunications, Kosice, Slovakia, 667–672. https://doi.org/10.1109/CogInfoCom.2012.6421935Google Scholar
Endrass, B., André, E., Rehm, M., & Nakano, Y. (2013). Investigating culture-related aspects of behavior for virtual characters. Autonomous Agents and Multi-Agent Systems, 27(2), 277–304. https://doi.org/10.1007/s10458-012-9218-5CrossRefGoogle Scholar
Fujii, A., & Jokinen, K. (2022). Open source system integration towards natural interaction with robots. Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction, Sapporo, Japan, 768–772. https://dl.acm.org/doi/10.5555/3523760.3523873Google Scholar
Gebhard, P., Aylett, R., Higashinaka, R., Jokinen, K., Tanaka, H. & Yoshino, K. (2021). Modeling trust and empathy for socially interactive robots. In Miehle, J., Minker, W., Andre, E., & Yoshino, K. (Eds.), Multimodal agents for ageing and multicultural societies (pp. 21–60). Singapore: Springer. https://doi.org/10.1007/978-981-16-3476-5_2CrossRefGoogle Scholar
Glowinski, D., Dael, N., Camurri, A., Volpe, G., Mortillaro, M., & Scherer, K. (2011). Toward a minimal representation of affective gestures. IEEE Transactions in Affective Computing, 2(2), 106–118. https://doi.org/10.1109/T-AFFC.2011.7CrossRefGoogle Scholar
Goldin-Meadow, S. (2003). Hearing Gesture: How our hands help us to think. Cambridge, MA: The Belknap Press of Harvard University Press.Google Scholar
Graziano, M. & Gullberg, M. (2018). When speech stops, gesture stops: Evidence from developmental and crosslinguistic comparisons. Frontiers in Psychology, 9, Article 879. https://doi.org/10.3389/fpsyg.2018.00879CrossRefGoogle ScholarPubMed
Gullberg, M. (2008). Gestures and second language acquisition. In Ellis, N. C. & Robinson, P. (Eds.), Handbook of cognitive linguistics and second language acquisition (pp. 276–305). London, UK: Routledge.Google Scholar
Harnad, S. (1990). The symbol grounding problem. Physica D: Nonlinear Phenomena, 42(1–3), 335–346. https://doi.org/10.1016/0167-2789(90)90087-6CrossRefGoogle Scholar
Heimerl, A., Baur, T., Lingenfelser, F., Wagner, J., & André, E. (2019). NOVA – A tool for explainable cooperative machine learning. Proceedings of the 8th International Conference on Affective Computing and Intelligent Interaction (ACII), Cambridge, UK, 109–115. https://doi.org10.1007/s13218-020-00632-3Google Scholar
Heinrich, S., Yao, Y., Hinz, T., Liu, Z., Hummel, T., Kerzel, M., Weber, C. & Wermter, S. (2020). Cross-modal language grounding in an embodied neurocognitive model. Frontiers in Neurorobotics, 14, Article 52. https://doi.org/10.3389/fnbot.2020.00052CrossRefGoogle Scholar
Heylen, D., Krenn, B., & Payr, S. (Eds.). (2010). Companions, virtual butlers, assistive robots: Empirical and theoretical insights for building long-term social relationships. In Trappl, R. (Ed.), Cybernetics and systems 2010 (pp. 539–570). Vienna, Austria: Austrian Society for Cybernetic Studies.Google Scholar
Inoue, K., Milhorat, P., Lala, D., Zhao, T., & Kawahara, T. (2016). Talking with ERICA, an autonomous android. Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue, 212–215. https://doi.org/10.18653/v1/W16-3625CrossRefGoogle Scholar
Ishi, C. T., Machiyashiki, D., Mikata, R., & Ishiguro, H. (2018). A speech-driven hand gesture generation method and evaluation in android robots. IEEE Robotics and Automation Letters, 3(4), 3757–3764. https://doi.org/10.1109/LRA.2018.2856281CrossRefGoogle Scholar
Jokinen, K. (2009). Constructive dialogue modelling: Speech interaction and rational agents. Chichester, UK: John Wiley & Sons.CrossRefGoogle Scholar
Jokinen, K. (2010). Pointing gestures and synchronous communication management. In Esposito, A., Campbell, N., Vogel, C., Hussain, A., & Nijholt, A. (Eds.), Lecture notes in computer science: Vol. 5967. Development of multimodal interfaces: Active listening and synchrony (pp. 33–49). Heidelberg, Germany: Springer. https://doi.org/10.1007/978-3-642-12397-9_3Google Scholar
Jokinen, K. (2018). Dialogue models for socially intelligent robots. In Ge, S. S., Cabibihan, J.-J., Salichs, M. A., Broadbent, E., He, H., Wagner, A. R., & Castro-González, Á (Eds.), Lecture notes in computer science: Vol 11357. Social robotics (pp. 127–138). Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-030-05204-1_13Google Scholar
Jokinen, K. & Pelachaud, C. (2013). From annotation to multimodal behaviour. In Rojc, M. & Campbell, N. (Eds.), Co-verbal synchrony in human-machine interaction. New York, NY: CRC Press. https://doi.org/10.1201/b15477Google Scholar
Jokinen, K., & Wilcock, G. (2014). Multimodal open-domain conversations with the Nao robot. In Mariani, J., Rosset, S., Garnier-Rizet, M., & Devillers, L. (Eds.), Natural interaction with robots, knowbots and smartphones: Putting spoken dialog systems into practice (pp. 213–224). New York, NY: Springer. https://doi.org/10.1007/978-1-4614-8280-2_19CrossRefGoogle Scholar
Jokinen, K., & Wilcock, G. (Eds.). (2017). Dialogues with social robots: Enablements, analyses, and evaluation. Singapore: Springer.CrossRefGoogle Scholar
Jokinen, K., & Wilcock, G. (2021). Do you remember me? Ethics in long-term social robot interactions. The 30th IEEE International Conference on Robot and Human Interactive Communication (ROMAN-2021). https://doi.org/10.1109/RO-MAN50785.2021.9515399CrossRefGoogle Scholar
Kabashima, K., Nishida, M., Jokinen, K., & Yamamoto, S. (2012). Multimodal corpus of conversations in mother tongue and second language by same interlocutors. Proceedings of The 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction: Eye Gaze and Multimodality, Santa Monica, California, USA, 1–5. https://doi.org/10.1145/2401836.2401845Google Scholar
Kanda, T. & Ishiguro, H. (2013). Human-robot interaction in social robotics (eBook Published 2017). Boca Raton, FL: CRC Press. https://doi.org/10.1201/b13004Google Scholar
Kanda, T., Ishiguro, H., Ono, T., Imai, M., & Nakatsu, R. (2002). Development and evaluation of an interactive humanoid robot “Robovie”. Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292), 2, 1848–1855.Google Scholar
Kanda, T., Sato, R., Saiwaki, N., & Ishiguro, H. (2007). A two-month field trial in an elementary school for long-term human-robot interaction. IEEE Transactions on robotics, 23(5), 962–971. https://doi.org/10.1109/TRO.2007.904904CrossRefGoogle Scholar
Kendon, A. (1980). Gesticulation and speech: Two aspects of the process of utterance. In Key, M. R. (Ed.), The relationship of verbal and nonverbal communication (pp. 207–227). The Hague, the Netherlands: Mouton and Co. https://doi.org/10.1515/9783110813098.207CrossRefGoogle Scholar
Kendon, A. (1986). Some reasons for studying gesture, Semiotica, 62(1–2), 3–28. https://doi.org/10.1515/semi.1986.62.1-2.3CrossRefGoogle Scholar
Kendon, A. (1995). Gestures as illocutionary and discourse structure markers in Southern Italian conversation. Journal of Pragmatics, 23(3), 247–279. https://doi.org/10.1016/0378-2166(94)00037-FCrossRefGoogle Scholar
Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Kipp, M., Neff, M., & Albrecht, I. (2007). An annotation scheme for conversational gestures: How to economically capture timing and form. Language Resources and Evaluation Journal, 41, 325–339. https://doi.org/10.1007/s10579-007-9053–5CrossRefGoogle Scholar
Kita, S., Alibali, M. W., & Chu, M. (2017). How do gestures influence thinking and speaking? The gesture-for-conceptualization hypothesis. Psychological Review, 124(3), 245–266. https://doi.org/10.1037/rev0000059CrossRefGoogle ScholarPubMed
Kopp, S., Bergmann, K., & Wachsmuth, I. (2008). Multimodal communication from multimodal thinking: Towards an integrated model of speech and gesture production. International Journal of Semantic Computing, 2(1), 115–136. https://doi.org/10.1142/S1793351X08000361CrossRefGoogle Scholar
Kucherenko, T., Jonell, P., van Waveren, S., Henter, G.E., Alexanderson, S., … & Kjellström, H. (2020). Gesticulator: A framework for semantically-aware speech-driven gesture generation. Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI ’20), 242–250. https://doi.org/10.1145/3382507.3418815CrossRefGoogle Scholar
Kwak, S. S., Kim, Y., Kim, E., Shin, C., & Cho, K. (2013). What makes people empathize with an emotional robot?: The impact of agency and physical embodiment on human empathy for a robot. Proceedings of the IEEE RO-MAN Conference, 180–185. https://doi.org/10.1109/ROMAN.2013.6628441CrossRefGoogle Scholar
Leite, I., Martinho, C., & Paiva, A. (2013). Social robots for long-term interaction: A survey. International Journal of Social Robotics, 5(2), 291–308. https://doi.org/10.1007/s12369-013-0178-yCrossRefGoogle Scholar
Lim, A., Ogata, T., & Okuno, H.G. (2012). Towards expressive musical robots: A cross-modal framework for emotional gesture, voice and music. Journal of Audio, Speeech and Music PROC, 3(2012). https://doi.org/10.1186/1687-4722-2012-3Google Scholar
Lis, M. & Navarretta, C. (2014). Classifying the form of iconic hand gestures from the linguistic categorization of co-occurring verbs. The 1st European Symposium on Multimodal Communication. University of Malta, Valletta, October 17–18, 2013, pp. 41–50.Google Scholar
McNeill, D. (2005). Gesture and thought. Chicago, IL: University of Chicago Press.CrossRefGoogle Scholar
McNeill, D., & Duncan, S. (2011). Gestures and growth points in language disorders. In Guendouzi, J., Loncke, F., & Williams, M. J. (Eds.), The handbook of psycholinguistic and cognitive processes: Perspectives in communication disorders (pp. 663–685). New York, NY: Psychology Press.Google Scholar
Melinger, A., & Levelt, W. (2004). Gesture and the communicative intention of the speaker. Gesture, 4(2), 119–141. https://doi.org/10.1075/gest.4.2.02melCrossRefGoogle Scholar
Mitra, S., & Acharya, T. (2007). Gesture recognition: A Survey. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 37(3), 311–324. https://doi.org/10.1109/TSMCC.2007.893280CrossRefGoogle Scholar
Mori, M. (2012). The Uncanny Valley [From the Field] (K. F. MacDorman & N. Kageki, Trans.). IEEE Robotics & Automation Magazine, 19(2), 98–100. (Original work published 1970). https://doi.org/10.1109/MRA.2012.2192811CrossRefGoogle Scholar
Mori, T., Jokinen, K., & Den, Y. (2020). Analysis of body behaviours in human–human and human–robot interactions. Proceedings of the International LREC Workshop on people in language, vision and the mind. European Language Resources Association (ELRA), 7–14.Google Scholar
Mutlu, B., Shiwa, T., Kanda, T., Ishiguro, H., & Hagita., N. (2009). Footing in human–robot conversations: How robots might shape participant roles using gaze cues. Proceedings of the 4th ACM/IEEE International Conference on Human Robot Interaction (HRI ‘09) (pp. 61–68). New York, NY: Association for Computing Machinery. https://doi.org/10.1145/1514095.1514109Google Scholar
Navarretta, C., Ahlsén, E., Allwood, J., Jokinen, K., & Paggio, P. (2012). Feedback in Nordic first-encounters: A comparative study. Proceedings of the Language Resources and Evaluation Conference (LREC-2012), Istanbul, Turkey, 2494–2499.Google Scholar
Neßelrath, R., Lu, C., Schulz, C. H., Frey, J., & Alexandersson, J. (2011). A gesture based system for context – sensitive interaction with smart homes. In Wichert, R. & Eberhardt, B. (Eds.), Proceedings of the Fourth Ambient Assisted Living (pp. 209–222). Berlin, Germany: Springer. https://doi.org/10.1007/978-3-642-18167-2_15CrossRefGoogle Scholar
Nishio, S., Ogawa, K., Kanakogi, Y., Itakura, S. & Ishiguro, H. (2012). Do robot appearance and speech affect people’s attitude? Evaluation through the Ultimatum Game. In 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication, Paris, France, 809–814. https://doi.org/10.1109/ROMAN.2012.6343851CrossRefGoogle Scholar
Noroozi, F., Kaminska, D., Corneanu, C., Sapinski, T., Escalera, S., & Anbarjafari, G. (2018). Survey on emotional body gesture recognition. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 37(3), 311–324. https://doi.org/10.1109/TAFFC.2018.2874986Google Scholar
Rau, P.P., Li, Y., Li, D. (2009). Effects of communication style and culture on ability to accept recommendations from robots. Computers in Human Behavior, 25(2), 587–595. https://doi.org/10.1016/j.chb.2008.12.025CrossRefGoogle Scholar
Rehm, M., Nakano, Y., André, E., Nishida, T., Bee, N., … & Huang, H-H. (2009). From observation to simulation: Generating culture-specific behavior for interactive systems. AI & Society, 24, 267–280. https://doi.org/10.1007/s00146-009-0216-3CrossRefGoogle Scholar
Robins, B., Dickerson, P., Hyams, P., & Dautenhahn, K.. (2004). Robot-mediated joint attention in children with autism: A case study in robot–human interaction. Interaction Studies 5, 161–198. https://doi.org/10.1075/is.5.2.02rob.CrossRefGoogle Scholar
Romeo, M., Hernandez Garcia, D., Han, T., Cangelosi, A., & Jokinen, K. (2021). Predicting apparent personality from body language: Benchmarking deep learning architectures for adaptive social human–robot interaction. Journal of Advanced Robotics, 35(19), 1167–1179. https://doi.org/10.1080/01691864.2021.1974941CrossRefGoogle Scholar
Saunderson, S., & Nejat, G. (2019). How robots influence humans: A survey of nonverbal communication in social human-robot interaction. International Journal of Social Robotics, 11, 575–608. https://doi.org/10.1007/S12369-019-00523-0CrossRefGoogle Scholar
Sidner, C., Rich, C., Shayganfar, M., Bickmore, T., Ring, L., & Zhang, Z. (2015). A robotic companion for social support of isolated older adults. Proceedings of the Tenth Annual ACM/IEEE International Conference on Human–Robot Interaction Extended Abstracts (HRI’15 Extended Abstracts), New York, NY, USA, 289–289. https://doi.org/10.1145/2701973.2702103Google Scholar
Sowa, T., & Wachsmuth, I. (2001). Interpretation of shape-related iconic gestures in virtual environments. In I. Wachsmuth & T. Sowa (Eds.), Lecture notes in computer science: Vol. 2298. Gesture and sign language in human-computer interaction (pp. 21–33).Google Scholar
Spezialetti, M., Placidi, G., & Rossi, S. (2020). Emotion recognition for human–robot interaction: Recent advances and future perspectives. Frontiers in Robotics and AI, 7. https://doi.org/10.3389/frobt.2020.532279CrossRefGoogle ScholarPubMed
Streeck, J. (2009). Forward-gesturing. Discourse Processes, 46(2–3), 161–179. https://doi.org/10.1080/01638530902728793CrossRefGoogle Scholar
Vels, M., & Jokinen, K. (2015). Detecting body, head, and speech signals for conversational engagement. Proceedings of the IVA Workshop Engagement in Social Intelligent Virtual Agents (ESIVA-2015) (23–32). August 25, 2015, Delft, the Netherlands.Google Scholar
Wagner, P., Malisz, Z., & Kopp, S. (2014). Gesture and speech in interaction: An overview. Speech Communication, 57, 209–232. https://doi.org/10.1016/j.specom.2013.09.008CrossRefGoogle Scholar
Wilcock, G. (2012). WikiTalk: A spoken Wikipedia-based open-domain knowledge access system. Proceedings of the COLING 2012 Workshop on Question Answering for Complex Domains, Mumbai, 57–70.Google Scholar
Yoon, Y., Ko, W. R., Jang, M., Lee, J., Kim, J., & Lee, G. (2019). Robots learn social skills: End-to-end learning of co-speech gesture generation for humanoid robots. Proceedings of the IEEE International Conference on Robotics and Automation, 4303–4309. https://doi.org/10.48550/arXiv.1810.12541CrossRefGoogle Scholar
References
Ahlström, D., Hasan, K., & Irani, P. (2014). Are you comfortable doing that?: Accept-ance studies of around-device gestures in and for public settings. In Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services, 193–202. ACM. https://doi.org/10.1145/2628363.2628381CrossRefGoogle Scholar
All About, UX. (2020, February 1). UX White Paper. www.allaboutux.org/files/UX-WhitePaper.pdfGoogle Scholar
Amazon Go. (2020, February 1). Amazon.com: Amazon Go. www.amazon.com/b?ie=UTF8&node=16008589011Google Scholar
Apple. (2018). US Patent No. 10,048,765 B2. Multi media computing or entertainment system for responding to user presence and activity. https://patentimages.storage.googleapis.com/83/81/93/6026ab7a8f9419/US10048765.pdfGoogle Scholar
Bakker, S., Hausen, D., & Selker, T. (Eds.). (2016). Peripheral Interaction: Challenges and Opportunities for HCI in the Periphery of Attention. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-319-29523-7CrossRefGoogle Scholar
Bargas-Avila, J. A., & Hornbæk, K. (2011). Old wine in new bottles or novel challenges? A critical analysis of empirical studies of user experience. In Proceedings of CHI 2011, 2689–2698. ACM. https://doi.org/10.1145/1978942.1979336Google Scholar
Beşevli, C., Buruk, O. T., Erkaya, M., & Özcan, O. (2018). Investigating the effects of legacy bias: User elicited gestures from the end users perspective. In Proceedings of the 2018 ACM Conference Companion Publication on Designing Interactive Systems, 277–281. ACM. https://doi.org/10.1145/3197391.3205449CrossRefGoogle Scholar
Beyer, H., & Holtzblatt, K. (1997). Contextual design: A customer-centered approach to systems designs. Morgan Kaufmann Series in Interactive Technologies. San Francisco, CA: Morgan Kaufmann Publishers, Inc. eBook ISBN: 9780080503042.Google Scholar
Bixi. (2020, February 1). Add gesture control to any smart device!. IndieGoGo. www.indiegogo.com/projects/bixi-add-gesture-control-to-any-smart-device#/Google Scholar
Bolt, R. A. (1980). “Put-that-there”: Voice and gesture at the graphics interface. ACM SIGGRAPH Computer Graphics, 14(3), 262–270. https://doi.org/10.1145/800250.807503CrossRefGoogle Scholar
Bressem, J., Ladewig, S., & Müller, C. (2013). Linguistic annotation system for gestures. In Müller, C., Cienki, A., Fricke, E., Ladewig, S., McNeill, D., & Teßendorf, S. (Eds.), Body–language–communication: An international handbook on multimodality in human interaction (Vol. 1, pp. 1098–1124). Berlin. Germany: De Gruyter.Google Scholar
Broadcom (2020, February 19). Braodcom APDS-9960. www.broadcom.com/products/optical-sensors/integrated-ambient-light-and-proximity-sensors/apds–9960Google Scholar
Cabreira, A. T., & Hwang, F. (2015). An analysis of mid-air gestures used across three platforms. In Proceedings of the 2015 British HCI Conference, pp. 257–258. ACM. http://dx.doi.org/10.1145/2783446.2783599CrossRefGoogle Scholar
Cabreira, A. T., & Hwang, F. (2016). How do novice older users evaluate and perform mid-air gesture interaction for the first time? In Proceedings of the 9th Nordic Conference on Human–Computer Interaction, 122, pp. 1–6. ACM. https://doi.org/10.1145/2971485.2996757Google Scholar
Chattopadhyay, D., & Bolchini, D. (2014). Touchless circular menus: Toward an intuitive UI for touchless interactions with large displays. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces, 33–40. ACM. https://doi.org/10.1145/2598153.2598181CrossRefGoogle Scholar
Crum, P. (2020, February 3.). When the walls can talk – space is the next frontier in personalization. Wired. www.wired.co.uk/article/smart-home-technology-trackingGoogle Scholar
Freeman, E., Brewster, S., & Lantz, Y. (2016) Do that, there: An interaction technique for addressing in-air gesture systems. In Proceedings of CHI ’ 16, 2319–2331. ACM. https://doi.org/10.1145/2858036.2858308Google Scholar
Frutos-Pascual, M., Creed, C., & Williams, I. (2019). Head mounted display interaction evaluation: Manipulating virtual objects in augmented reality. In Lamas, D. et al. (Eds.), Human–Computer Interaction – INTERACT 2019. Lecture Notes in Computer Science, 11749. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-030-29390-1_16Google Scholar
Gaver, W. (1991). Technology affordances. In CHI ‘91: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 79–84. ACM. https://doi.org/10.1145/108844.108856CrossRefGoogle Scholar
Grandhi, S. A., Joue, G., & Mittelberg, I. (2011). Understanding naturalness and intuitiveness in gesture production: Insights for touchless gestural interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 821–824. ACM. https://doi.org/10.1145/1978942.1979061CrossRefGoogle Scholar
Groenewald, C., Anslow, C., Islam, J., Rooney, C., Passmore, P., & Wong, W. (2016). Understanding 3D mid-air hand gestures with interactive surfaces and displays: A systematic literature review. In Proceedings of the 30th British HCI Conference. ACM. http://dx.doi.org/10.14236/ewic/HCI2016.43CrossRefGoogle Scholar
Hassemer, J. (2016). Towards a theory of gesture form analysis. Imaginary forms as part of gesture conceptualisation, with empirical support from motion-capture data. (Unpublished doctoral dissertation). Rheinische-Westfälische Technische Hochschule Aachen, Germany.Google Scholar
Havlucu, H., Ergin, M. Y., Bostan, İ. , Buruk, O. T., Göksun, T., & Özcan, O. (2017). It made more sense: Comparison of user-elicited on-skin touch and freehand gesture sets. In International Conference on Distributed, Ambient, and Pervasive Interactions, 159–171. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-319-58697-7_11Google Scholar
Henze, N., Löcken, A., Boll, S., Hesselmann, T., & Pielot, M. (2010). Free-hand gestures for music playback: Deriving gestures with a user-centred process. In Proceedings of MUM ’ 10, 1–10. ACM. https://doi.org/10.1145/1899475.1899491Google Scholar
Hoff, L., Hornecker, E., & Bertel, S. (2016). Modifying gesture elicitation: Do kinaesthetic priming and increased production reduce legacy bias?. In Proceedings of the TEI ’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction, 86–91. ACM. https://doi.org/10.1145/2839462.2839472CrossRefGoogle Scholar
Holmes, K. (2018). Mismatch: How inclusion shapes design. Cambridge, MA: MIT Press. https://doi.org/10.7551/mitpress/11647.001.0001CrossRefGoogle Scholar
HoloLens 2. (2020, February 1). HoloLens 2. Microsoft. www.microsoft.com/en-us/hololens/buyGoogle Scholar
Hoonhout, J., Law, E. L., Roto, V., & Vermeeren, A. (2011). Dagstuhl Seminar Proceedings 10373 Demarcating User eXperience. LZI. http://drops.dagstuhl.de/opus/volltexte/2011/2949Google Scholar
ISO. (2020, February 1). ISO 9241–210. Ergonomics of human-system interaction – Part 110: Dialogue principles. www.iso.org/standard/38009.htmlGoogle Scholar
Karam, M., & schraefel, m. c. (2005). A taxonomy of gestures in human–computer interaction. Retrieved from https://eprints.soton.ac.uk/261149/Google Scholar
Kelley, J. (1984). An iterative design methodology for user-friendly natural language office information applications. In ACM Transactions on Information Systems (TOIS) TOIS Homepage archive, 2(1), 26–41. ACM. https://doi.org/10.1145/357417.357420CrossRefGoogle Scholar
Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge, UK: Cambridge University Press. http://doi.org/10.1080/15427580701340790CrossRefGoogle Scholar
Kinect. (2020, February 1). Microsoft Kinect manuals. https://support.xbox.com/en-IN/xbox-360/console/manual-specsNovember2019Google Scholar
Kymera. (2020, February 1). The Kymera Magic Wand. The wand company. www.thewandcompany.com/kymera-wand/Google Scholar
Langacker, R. W. (2008). Cognitive grammar: A basic introduction. Oxford, UK: Oxford University Press.CrossRefGoogle Scholar
Lee, M., Billinghurst, M., Baek, W., Green, R., & Woo., W. (2013). A usability study of multimodal input in an augmented reality environment. Virtual Reality, 17, 293–305. https://doi.org/10.1007/s10055-013-0230-0CrossRefGoogle Scholar
Li, , Y., Huang, J., Tian, F., Wang, H.-A., & Dai, G.-Z. (2019). Gesture interaction in virtual reality. Virtual Reality & Intelligent Hardware, 1(1), 84–112 https://doi.org/10.3724/SP.J.2096-5796.2018.0006CrossRefGoogle Scholar
Loehmann, S., Knobel, M., Lamara, M., & Butz, A. (2013). Culturally independent gestures for in-car interactions. In Proceedings of Interact, Part III, LNCS. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-642-40477-1_34Google Scholar
McAweeney, E., Zhang, H., & Nebeling, M. (2018). User-driven design principles for gesture representation. In Proceedings of CHI 2018. ACM. https://doi.org/10.1145/3173574.3174121Google Scholar
McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago, IL: University of Chicago Press.Google Scholar
Magrofuoco, N., & Vanderdonckt, J. (2019). Gelicit: A cloud platform for distributed gesture elicitation studies. In Proceedings of the ACM on Human-Computer Interaction, 3(EICS), 1–41. ACM. https://doi.org/10.1145/3331148CrossRefGoogle Scholar
Mann, S. (1998). Reconfigured self as basis for humanistic intelligence. In ATEC ‘98 Proceedings of the annual conference on USENIX Annual Technical Conference. Berkeley, CA: USENIX Association.Google Scholar
Mehler, A., vor der Brück, T., & Lücking, A. (2014). Comparing hand gesture vocabularies for HCI. In Kurosu, M. (Ed.), Human–Computer Interaction. Advanced Interaction Modalities and Techniques. HCI 2014. Lecture Notes in Computer Science, 8511(81–92). Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-319-07230-2_8CrossRefGoogle Scholar
Meier, A., Goto, K., & Wörmann, M. (2014). Thumbs up to gesture controls? A cross-cultural study on spontaneous gestures. In International Conference on Cross-Cultural Design, 211–217. Cham: Springer. https://doi.org/10.1007/978-3-319-07308-8_21CrossRefGoogle Scholar
Meta 2. (2020, March 10). Metavision AR headset (discontinued). https://meta.reality.news/how-to/set-up-meta-2-head-mounted-display-0180826/Google Scholar
Moorthy, A. E., & Vu, K. P. L. (2015). Privacy concerns for use of voice activated personal assistant in the public space. International Journal of Human-Computer Interaction, 31(4), 307–335. https://doi.org/10.1080/10447318.2014.986642CrossRefGoogle Scholar
Morris, M. R., Danielescu, A., Drucker, S., Fisher, D., Lee, B., & Wobbrock, J. O. (2014). Reducing legacy bias in gesture elicitation studies. Interactions, 21(3), 40–45. https://doi.org/10.1145/2591689CrossRefGoogle Scholar
Movea. (2018). US Patent No. US 9,927,876 B2. Remote Control with 3D pointing and Gesture Recognition Capabilities. https://patentimages.storage.googleapis.com/f1/51/f8/d09f8212091955/US9927876.pdfGoogle Scholar
Müller, C. (2017). How recurrent gestures mean: Conventionalized contexts-of-use and embodied motivation. Gesture, 16(2), 277–304. https://doi.org/10.1075/gest.16.2.05mulCrossRefGoogle Scholar
Nacenta, M. A., Kamber, Y., Qiang, Y., & Kristensson, P. O. (2013). Memorability of pre-designed and user-defined gesture sets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1099–1108. ACM. https://doi.org/10.1145/2470654.2466142CrossRefGoogle Scholar
Nielsen, J. (1993). Usability engineering. San Francisco, CA: Morgan Kaufman Publishers.CrossRefGoogle Scholar
Nielsen, S., Nellemann, N., Larsen, L., & Stec, K. (2020). The social acceptability of peripheral interaction with 3D gestures in a simulated setting. In Kurosu, M. (Ed.), Human–computer interaction. Multimodal and natural interaction (pp. 77–95). Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-030-49062-1_5CrossRefGoogle Scholar
Norman, D. (2010). Natural user interfaces are not natural. ACM Interactions, 17(3), 6–10. https://doi.org/10.1145/1744161.1744163CrossRefGoogle Scholar
Oculus. (2020a, February 1). The Oculus Quest VR headset. https://www.oculus.com/quest/?locale=en_USGoogle Scholar
Oculus. (2020b, February 1). The Oculus Rift VR headset. https://www.oculus.com/rift/#oui-csl-rift-games=robo-recallGoogle Scholar
Panasonic. (2020, February 1). Kitchen of the Future at IFA 2018 Berlin. www.youtube.com/watch?v=OWvzDq8SFko (restricted access)Google Scholar
Rekik, Y., Vatavu, R. D., & Grisoni, L. (2014). Understanding users’ perceived difficulty of multi-touch gesture articulation. In Proceedings of ICMI ’ 14, 232–239. ACM. http://dx.doi.org/10.1145/2663204.2663273Google Scholar
Rico, J., & Brewster, S. (2009). Gestures all around us: User differences in social acceptability perceptions of gesture-based interfaces. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, 64, 1–2. ACM. https://doi.org/10.1145/1613858.1613936Google Scholar
Rico, J., & Brewster, S. (2010a). Usable gestures for mobile interfaces: Evaluating social acceptability. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 887–896. ACM. https://doi.org/10.1145/1753326.1753458CrossRefGoogle Scholar
Rico, J., & Brewster, S. (2010b). Gesture and voice prototyping for early evaluations of social acceptability in multimodal interfaces. In International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, 16, 1–9. ACM. https://doi.org/10.1145/1891903.1891925Google Scholar
Rose, D. (2018). Why gesture is the next big thing in design. IDEO Blog. https://www.ideo.com/blog/why-gesture-is-the-next-big-thing-in-designGoogle Scholar
Samsung. (2020, February 1). John Lewis & Partners: Samsung Gesture controlled TV. Youtube. https://youtu.be/xHFXE6R60VE?feature=sharedGoogle Scholar
Snyder, C. (2003). Paper prototyping: The fast and easy way to design and refine user interfaces. San Francisco, CA: Morgan Kaufmann Publishers.Google Scholar
Stec, K., & Larsen, L. B. (2018). Gestures for controlling a moveable TV. In Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video, 5–14. ACM. https://doi.org/10.1145/3210825.3210831CrossRefGoogle Scholar
Taniberg, A., Botin, L., & Stec, K. (2018). Context of use affects the social acceptability of gesture interaction. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction, 731–735. ACM. https://doi.org/10.1145/3240167.3240250CrossRefGoogle Scholar
Tscharn, R., Löffler, D., Latoschik, M. E., & Hurtienne, J. (2017). ”Stop over there”: Natural gesture and speech interaction for non-critical spontaneous intervention in autonomous driving. In Proceedings of ICMI’17, November, 2017, 91–100). ACM. https://doi.org/10.1145/3136755.3136787CrossRefGoogle Scholar
Vatavu, R. D., & Wobbrock, J. O. (2016). Between-subjects elicitation studies: Formalization and tool support. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 3390–3402. ACM. https://doi.org/10.1145/2858036.2858228CrossRefGoogle Scholar
Wensveen, S., Djajadiningrat, J., & Overbeeke, C. (2004). Interaction frogger: A design framework to couple action and function through feedback and feedforward. In Proceedings of the 5th Conference on Designing Interactie Systems: Processes, Practices, Methods, and Techniques, 177–184. Cambridge, MA. ACM. https://doi.org/10.1145/1013115.1013140Google Scholar
Wobbrock, J. O., Aung, H. H., Rothrock, B., & Myers, B. A. (2005). Maximizing the guessability of symbolic input. In CHI’05 Extended Abstracts on Human Factors in Computing Systems, 1869–1872). ACM. https://doi.org/10.1145/1056808.1057043CrossRefGoogle Scholar
Zaiţi, I. A., Pentiuc, Ş. G., & Vatavu, R. D. (2015). On free-hand TV control: Experimental results on user-elicited gestures with Leap Motion. Personal and Ubiquitous Computing, 19(5–6), 821–838. https://doi.org/10.1007/s00779-015-0863-yCrossRefGoogle Scholar