Does Matlab Text Analytics toolbox contain the Fasttext Pre-trained word vectors from Common Crawl (600B tokens)
2 ビュー (過去 30 日間)
古いコメントを表示
Does Matlab Text Analytics toolbox contain the Fasttext pre-trained word vectors from Common Crawl (600B tokens)? It seems to have pertained vectors from a 16billion token data set from fastext. I am wondering if it has the Common Crawl (6000B tokens) Pre-trained word vectors, or if there is a Matlab scrip the add this to the Matlab word embedding model. The vectors are here https://fasttext.cc/docs/en/english-vectors.html
Actually just a Matlab script that would read the Common Crawl 600B file and output a the vectors and string of the corresponding words would be sufficient.
Thanks in advance!
0 件のコメント
回答 (1 件)
MathWorks Text Analytics Toolbox Team
2020 年 4 月 16 日
Text Analytics Toolbox does not itself include this embedding, but you can download it (as you said in your question) and load it into MATLAB as follows:
>> emb = readWordEmbedding("crawl-300d-2M.vec.zip")
emb =
wordEmbedding with properties:
Dimension: 300
Vocabulary: [1×1999995 string]
0 件のコメント
参考
カテゴリ
Help Center および File Exchange で Characters and Strings についてさらに検索
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!