GitHub - sanyam5/skip-thoughts: An implementation of Skip-Thought Vectors in PyT...
source link: https://github.com/sanyam5/skip-thoughts
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
skip-thoughts
An implementation of Skip-Thought Vectors in PyTorch.
Here's a blog explaining the subtleties of Skip-Thoughts
Instructions
Training
- Download BookCorpus or any other data-set and concatenate all sentences into one file and put it in
./data/directory - Modify the following line in
Train.ipynbnotebook accordingly:d = DataLoader("./data/dummy_corpus.txt") - There is no early stopping.
- The
Trainnotebook runs at the rate of 1 epoch / 2 days on an Nvidia 1080 Ti. - Your model is saved when
./saved_modelswhen the average training loss in the last 20 iterations dips below the previous best.
Evaluation
Only implemented on classification tasks
- Download the movie review dataset and put
rt-polarity.negandrt-polarity.posin the./tasks/mr_datadirectory. - You may also test on other classification tasks by downloading the datasets and providing their path and tasks type in
Evaluate.ipynb
Recommend
-
34
README.md Word2Bits - Quantized Word Vectors Word2Bits extends the Word2Vec algorithm to output high quality quantized word vectors that take 8x-16x less storage/memory than regular word vector...
-
263
README.md Chinese Word Vectors 中文词向量 This project provides 100+ Chinese Word Vectors (embeddings) trained with different representations (dense and sparse), contex...
-
63
README.md LMDB Embeddings Query word vectors (embeddings) very quickly with very little querying time overhead and far less memory usage than gensim or...
-
44
There is a science joke that goes, “Geology rocks, but Geography is where it’s at.” At Elastic, we understand that location matters. That’s why we created theElastic Maps Service. The Elastic Maps Service (EMS) provides...
-
46
A week or so I discovered that Android P has DNS over TLS support! It piqued my curiousity - could it finally be that...
-
50
The ability to build robust array type abstractions without overhead is one of the most fantastic features of Julia. It can be surprising how much one can do with the idea of an array to end up with better code. In this b...
-
4
README.md 这是我用于学习 Skip-gram 的笔记。 文中会有一些公式，如果 github 出现公式乱码问题，请通过我的博客查看：h...
-
6
fsharp-vectors Type-safe vectors in F#. What? let l1 = [ 1 ; 2 ] let l2 = [ 3 ] List.zip l1 l2 |> ignore Oh no! Lists aren't safe! let v1 = 1 ** 2 ** -() let v2 = 1 ** () Vector....
-
6
Implementation divergence on swapping bools within vectors
-
4
One Pragmatic Thought: How to Assess the Value of Skip-Level Meetings
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK