Knowledge and Data Management White Papers

Unsupervised Learning of Dependency Structure for Language Modeling

Overview This paper presents a Dependency Language Model (DLM) that captures linguistic constraints via a dependency structure, i.e., a set of probabilistic dependencies that express the relations between headwords of each phrase in a sentence by an acyclic, planar, undirected graph. The contributions are three-fold. First, the authors incorporate the dependency structure into an n-gram language model to capture long distance word dependency. Second, the authors present an unsupervised learning method that discovers the dependency structure of a sentence using a bootstrapping procedure. Finally, the authors evaluate the proposed models on a realistic application (Japanese Kana-Kanji conversion).

Further White Paper Details
PublisherMicrosoft File FormatPDF
Date PublishedMay 2003
FormatWhite Papers   
Topics

Quick Sitemap Links: