This shows you the differences between two versions of the page.
private:word_embeddings_for_class_lms [2018/08/10 11:24] (current)
|Line 1:||Line 1:|
|+||Q: It is sensible to use clustered word embeddings as classes for language modelling?|
|+||Take one of the fasttest style clusterings, generate word embeddings, VQ to get classes and then train a conventional LM on classes. |
|+||It may work, or it may be that RNNLMs are an end-to-end solution and so are better|