private:word_embeddings_for_class_lms
Differences
This shows you the differences between two versions of the page.
| — |
private:word_embeddings_for_class_lms [2018/08/10 11:24] (current) |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| + | Q: It is sensible to use clustered word embeddings as classes for language modelling? | ||
| + | |||
| + | Take one of the fasttest style clusterings, generate word embeddings, VQ to get classes and then train a conventional LM on classes. | ||
| + | |||
| + | It may work, or it may be that RNNLMs are an end-to-end solution and so are better | ||
private/word_embeddings_for_class_lms.txt ยท Last modified: 2018/08/10 11:24 (external edit)
Page Tools
