GloVe: Global Vectors for Word Representation, Jeffrey Pennington, Richard Socher, Christopher Manning, 2014Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) (Association for Computational Linguistics)DOI: 10.3115/v1/D14-1162 - 提出了GloVe模型,结合了全局矩阵分解和局部上下文窗口方法来学习词表示。
Enriching Word Vectors with Subword Information, Piotr Bojanowski, Edouard Grave, Armand Joulin, Tomas Mikolov, 2017Transactions of the Association for Computational Linguistics (TACL), Vol. 5 (MIT Press)DOI: 10.1162/tacl_a_00051 - 描述了fastText,Word2Vec的扩展,它结合了子词(字符n-gram)信息,从而更好地处理罕见词和未登录词。