Hostname: page-component-78c5997874-j824f Total loading time: 0 Render date: 2024-11-19T15:21:08.235Z Has data issue: false hasContentIssue false

Regular expressions for language engineering

Published online by Cambridge University Press:  01 December 1996

L. KARTTUNEN
Affiliation:
Rank Xerox Research Centre (RXRC), 6 Chemin de Maupertuis, 38240 Meylan, France. e-mail: [email protected], [email protected], [email protected], [email protected]
J-P. CHANOD
Affiliation:
Rank Xerox Research Centre (RXRC), 6 Chemin de Maupertuis, 38240 Meylan, France. e-mail: [email protected], [email protected], [email protected], [email protected]
G. GREFENSTETTE
Affiliation:
Rank Xerox Research Centre (RXRC), 6 Chemin de Maupertuis, 38240 Meylan, France. e-mail: [email protected], [email protected], [email protected], [email protected]
A. SCHILLE
Affiliation:
Rank Xerox Research Centre (RXRC), 6 Chemin de Maupertuis, 38240 Meylan, France. e-mail: [email protected], [email protected], [email protected], [email protected]

Abstract

Many of the processing steps in natural language engineering can be performed using finite state transducers. An optimal way to create such transducers is to compile them from regular expressions. This paper is an introduction to the regular expression calculus, extended with certain operators that have proved very useful in natural language applications ranging from tokenization to light parsing. The examples in the paper illustrate in concrete detail some of these applications.

Type
Research Article
Copyright
1997 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)