Data Compression White Papers
Quantization-based Language Model Compression
Overview This paper describes two techniques for reducing the size of statistical back-off N-gram language models in computer memory. Language model compression is achieved through a combination of quantizing language model probabilities and back-off weights and the pruning of parameters that are determined to be unnecessary after quantization. The recognition performance of the original and compressed language models is evaluated across three different language models and two different recognition tasks. The results show that the language models can be compressed by up to 60% of their original size with no significant loss in recognition performance. Moreover, the techniques that are described provide a principled method with which to compress language models further while minimising degradation in recognition performance.
| Publisher | Mitsubishi Electric Research Laboratories (MERL) | File Format | PDF, requires Acrobat Rdr 5 |
|---|---|---|---|
| Date Published | December 2001 | Downloads | 100 |
| Format | White Papers | ||
| Topics | |||
-
Did you find this white paper useful?
White Paper RSS
Download
Register
