Hostname: page-component-77c89778f8-cnmwb Total loading time: 0 Render date: 2024-07-16T17:46:33.099Z Has data issue: false hasContentIssue false

High-performance bilingual text alignment using statistical and dictionary information

Published online by Cambridge University Press:  01 March 1997

MASAHIKO HARUNO
Affiliation:
NTT Communication Science Laboratories, 1-1 Hikarinooka Yokosuka Kanagawa 239, Japan
TAKEFUMI YAMAZAKI
Affiliation:
NTT Communication Science Laboratories, 1-1 Hikarinooka Yokosuka Kanagawa 239, Japan

Abstract

This paper describes an accurate and robust text alignment system for structurally different languages. Among structurally different languages such as Japanese and English, there is a limitation on the amount of word correspondences that can be statistically acquired. The main reason for this is the systems of functional (closed) words are quite different in the two languages. The proposed method makes use of two kinds of word correspondences in aligning bilingual texts. One is a bilingual dictionary of general use. The other is the word correspondences that are statistically acquired in the alignment process. Our method gradually determines sentence pairs (anchors) that correspond to each other by relaxing parameters. The method, by combining two kinds of word correspondences, achieves adequate word correspondences for complete alignment. As a result, texts of various length and of various genres in structurally different languages can be aligned with high precision. Experimental results show our system outperforms conventional methods for various kinds of Japanese–English texts.

Type
Research Article
Copyright
1997 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)