Decoupling Word-Pair Distance and Co-occurrence Information for Effective Long History Context Language Modeling

In this paper, we propose the use of distance and co-occurrence information of word-pairs to improve language modeling. We have empirically shown that, for history-context sizes of up to ten words, the extracted information about distance and co-occurrence complements the n-gram language model well,...

Ausführliche Beschreibung