This repository has been archived by the owner on Mar 19, 2024. It is now read-only.
the number of words in a one-million-token corpus is only 15173? #1355
Comments
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
when I use
fasttext.train_unsupervisedfunction to learn word vectors, it shows that the number of words is 15173.However, there are more than one million tokens in my training texts.
I don't know why.
The text was updated successfully, but these errors were encountered: