Book contents
- Frontmatter
- Contents
- List of contributors
- 1 Introduction
- Part I Joint construction
- Part II Reference
- Part III Handling uncertainty
- Part IV Engagement
- 9 Data-driven methods for linguistic style control
- 10 Integration of cultural factors into the behavioral models of virtual characters
- 11 Natural language generation for augmentative and assistive technologies
- Part V Evaluation and shared tasks
- Author index
- Subject index
- References
11 - Natural language generation for augmentative and assistive technologies
from Part IV - Engagement
Published online by Cambridge University Press: 05 July 2014
Book contents
- Frontmatter
- Contents
- List of contributors
- 1 Introduction
- Part I Joint construction
- Part II Reference
- Part III Handling uncertainty
- Part IV Engagement
- 9 Data-driven methods for linguistic style control
- 10 Integration of cultural factors into the behavioral models of virtual characters
- 11 Natural language generation for augmentative and assistive technologies
- Part V Evaluation and shared tasks
- Author index
- Subject index
- References
Summary
Introduction
Many people are not able to communicate easily, because of diversity in their physical and/or intellectual abilities. For example, someone with cerebral palsy may not have enough control over their vocal tract and mouth to speak (or enough manual dexterity control to use sign language); and someone with autism may be physically capable, but unable to speak because of their cognitive profile.
Augmentative and alternative communication (AAC) is a sub-field of assistive technology focusing on tools to help people with major motor and/or cognitive impairments communicate better. Traditionally, AAC has used technology to provide speech output for non-speaking users, either by converting text to speech or speaking out pre-stored phrases. The initial focus of computer-based AAC systems was on giving users access to a broad set of symbols/pictures (by using some kind of menu or search system), and on using speech synthesis to automatically speak out phrases corresponding to the selected symbols. However, computers can in principle do much more than this.
In particular, since many AAC systems are intended to help users produce utterances, there seems to be a natural role for Natural Language Generation (NLG) to play, as it is after all a technology for producing language. However, the use of NLG in AAC is somewhat different from most uses of NLG. Since the goal of AAC is to help the user communicate, the NLG system must be used interactively, under the user’s control; we want to assist the user in communication, not replace the user with an automatic communicator. Also, since most human communication is social, NLG AAC systems often need to generate texts whose communicative goal is social interaction. Hence, NLG AAC systems are very different from systems that summarize information in a task-oriented context, which has been the focus of most NLG research for interactive systems.
- Type
- Chapter
- Information
- Natural Language Generation in Interactive Systems , pp. 252 - 278Publisher: Cambridge University PressPrint publication year: 2014
References
American Speech-Language-Hearing Association (2002). Augmentative and alternative communication: Knowledge and skills for service delivery [knowledge and skills]. Available from http://www.asha.org/policy. Accessed on 11/24/2013.
, , and (1998). BlissWord – full access to Blissymbols for all users. In Proceedings of the Biennial Conference of the International Society for Augmentative and Alternative Communication, pages 167-168, Dublin, Ireland. International Society for Augmentative and Alternative Communication.Google Scholar
and (1998). Augmentative and Alternative Communication: Management of Severe Communication Disorders in Children and Adults. Brookes Publishing Company, Baltimore, MD, 2nd edition.Google Scholar
(2006). A flexible approach to natural language generation for disabled children. In Proceedings of the International Conference on Computational Linguistics and the Annual Meeting of the Association for Computational Linguistics (COLING-ACL), pages 1-6, Sydney, Australia. Association for Computational Linguistics.Google Scholar
and (2008). Friend: A communication aid for persons with disabilities. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 16(2):205-209.CrossRefGoogle ScholarPubMed
, , , , and (2010). Using NLG and sensors to support personal narrative for children with complex communication needs. In Proceedings of the NAACL HLT Workshop on Speech and Language Processing for Assistive Technologies, pages 1-9, Los Angeles, CA. Association for Computational Linguistics.Google Scholar
and (2000). Affective natural language generation. In , editor, Affective Interactions, pages 204-218. Springer LNCS, Berlin, Germany.Google Scholar
and (1992). Generating text from compressed input: An intelligent interface for people with severe motor impairments. Communications of the ACM, 35(5): 68-78.CrossRefGoogle Scholar
, , and (2011). Summarizing information graphics textually. Computational Linguistics, 38(3):527-574.Google Scholar
(2008). Using natural language generation to encourage effective communication in non-speaking people. In Proceedings of the Young Researchers Consortium at the International Conference on Computers Helping People with Special Needs, Linz, Austria.Google Scholar
, , and (2010). Automatic generation of conversational utterances and narrative for augmentative and alternative communication: A prototype system. In Proceedings of the NAACL HLT Workshop on Speech and Language Processing for Assistive Technologies, pages 10-18, Los Angeles, CA. Association for Computational Linguistics.Google Scholar
, , and (2011). Single-case and Small-n Experimental Designs: A Practical Guide To Randomization Tests. Routledge, New York, NY, USA, 2nd edition.Google Scholar
, , and (2013). Evaluating a tool for improving accessibility to charts and graphs. ACM Transactions on Computer-Human Interaction (TOCHI), 20(5).CrossRefGoogle Scholar
and (2009). SimpleNLG: A realisation engine for practical applications. In Proceedings of the European Workshop on Natural Language Generation (ENLG), pages 90-93, Athens, Greece. Association for Computational Linguistics.Google Scholar
(2010). The Big Book of Storysharing. Special Educational Needs Joint Initiative for Training (SENJIT), Institute of Education, University of London, London, UK.Google Scholar
and (2007). AAC technologies for young children with complex communication needs: State of the science and future research directions. Augmentative and Alternative Communication, 23(3):204-216.Google ScholarPubMed
, , , and (2007). A software client for wi-fi based realtime location tracking of patients. In Proceedings of the International Conference on Medical Imaging and Informatics, pages 141-150, Beijing, China. Springer.Google Scholar
and (1991). Getting the story: A longitudinal study of parental styles in eliciting narratives and developing narrative skill. In and , editors, Developing Narrative Structure, pages 217-253. Lawrence Erlbaum Associates, Hillsdale, NJ.Google Scholar
, , and (2010). Implications of pragmatic and cognitive theories on the design of utterance-based AAC systems. In Proceedings of the NAACL HLT Workshop on Speech and Language Processing for Assistive Technologies, pages 19-27, Los Angeles, CA. Association for Computational Linguistics.Google Scholar
and (1998). Evaluation in the context of natural language generation. Computer Speech & Language, 12(4):349-373.CrossRefGoogle Scholar
, , , , and (2008). Information technology for cognitive support. In and , editors, The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, pages 811-828. Lawrence Erlbaum Associates, Mahwah, NJ, 2nd edition.Google Scholar
, , and (2010). Click on bake to get cookies: Guiding word-finding with semantic associations. In Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility (ASSETS), pages 155-162, Orlando, FL. Association for Computing Machinery.Google Scholar
(1995). Narrative configuration in qualitative analysis. In and , editors, Life History and Narrative, pages 5-24. Taylor & Francis, Bristol, PA.Google Scholar
, , , , , , and (2009). Automatic generation of textual summaries from neonatal intensive care data. Artificial Intelligence, 173(7-8):789-816.CrossRefGoogle Scholar
and (1982). What makes a good story? Towards the production of conversational narratives. In and , editors, Discourse Processing. North-Holland Publishing Company, Amsterdam.Google Scholar
and (2011). Automatically generating stories from sensor data. In Proceedings of the International Conference on Intelligent User Interfaces (IUI), pages 407-410, Palo Alto, CA. Association for Computing Machinery.Google Scholar
(2007). An architecture for data-to-text systems. In Proceedings of the European Workshop on Natural Language Generation (ENLG), pages 97-104, Saarbrücken, Germany. Association for Computational Linguistics.Google Scholar
and (2009). An investigation into the validity of some metrics for automatically evaluating NLG systems. Computational Linguistics, 35(4):529-558.CrossRefGoogle Scholar
, , , and (2008). The importance of narrative and other lessons from an evaluation of an NLG system that summarises clinical data. In Proceedings of the International Conference on Natural Language Generation (INLG), pages 147-156, Salt Fork, OH. Association for Computational Linguistics.Google Scholar
, , , and (2010). Scanning methods and language modeling for binary switch typing. In Proceedings of the NAACL HLT Workshop on Speech and Language Processing for Assistive Technologies, pages 28-36, Los Angeles, CA. Association for Computational Linguistics.Google Scholar
and (2005). Story creation in virtual game worlds. Commununications of the ACM, 48(1):61-65.CrossRefGoogle Scholar
and (2008). What's in a message? Interpreting geo-referenced data for the visually-impaired. In Proceedings of the International Conference on Natural Language Generation (INLG), pages 113-120, Salt Fork, OH. Association for Computational Linguistics.Google Scholar
and (2003). Modelling conversational pragmatics in communication aids. Journal of Pragmatics, 35(4):523-538.CrossRefGoogle Scholar
, , , and (2008). Whole utterance approaches in AAC. Augmentative and Alternative Communication, 24(3):235-254.CrossRefGoogle ScholarPubMed
(2006). Personal narrative and AAC: From transactional to interactional conversation. In Proceedings of the International Society for Augmentative and Alternative Communication (ISAAC) Research Symposium, Dtlsseldorf, Germany. International Society for Augmentative and Alternative Communication.Google Scholar
, , , and (1998a). Evaluating the use of TalksBac, a predictive communication device for nonfluent adults with aphasia. International Journal of Language & Communication Disorders, 33(1):45-70.Google ScholarPubMed
, , , , , , and (1998b). The future development of TalksBac: A predictive augmentative communication system for adults with nonfluent aphasia. International Journal of Language & Communication Disorders, 33(1):45-70.Google Scholar
, , , , and (1999). The WriteTalk project: Story-based interactive communication. In and , editors, Assistive Technology on the Threshold of the New Millennium, pages 180-184. IOS Press, Amsterdam, The Netherlands.Google Scholar
and (1997). Towards a narrative-based communication systems. European Journal of Disorders of Communication, 32(S3):289-306.CrossRefGoogle Scholar
, , , , and (2005). Facilitating user feedback in the design of a novel joke generation system for people with severe communication impairment. In Proceedings of the International Conference on Human-Computer Interaction (HCII), Las Vegas, NV. Lawrence Erlbaum Associates.Google Scholar
, , , , , and (2001). Using written stories to support the use of narrative in conversational interactions: Case study. Augmentative and Alternative Communication, 17(4):221-232.CrossRefGoogle Scholar
, , , , , , and (2008). ModelTalker Voice Recorder (MTVR) - a system for capturing individual voices for synthetic speech. In Proceedings of the ISAAC Biennial Conference, Montreal, Canada. International Society for Augmentative and Alternative Communication.Google Scholar