User Tools

Site Tools


private:word_embeddings_for_class_lms

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

private:word_embeddings_for_class_lms [2018/08/10 11:24] (current)
Line 1: Line 1:
 +Q:  It is sensible to use clustered word embeddings as classes for language modelling?
 +
 +Take one of the fasttest style clusterings,​ generate word embeddings, VQ to get classes and then train a conventional LM on classes. ​  
 +
 +It may work, or it may be that RNNLMs are an end-to-end solution and so are better
  
private/word_embeddings_for_class_lms.txt ยท Last modified: 2018/08/10 11:24 (external edit)