88

GitHub - sanyam5/skip-thoughts: An implementation of Skip-Thought Vectors in PyT...

 6 years ago
source link: https://github.com/sanyam5/skip-thoughts
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client

skip-thoughts

An implementation of Skip-Thought Vectors in PyTorch.

Here's a blog explaining the subtleties of Skip-Thoughts

blog

blog

Instructions

Training

  • Download BookCorpus or any other data-set and concatenate all sentences into one file and put it in ./data/ directory
  • Modify the following line in Train.ipynb notebook accordingly: d = DataLoader("./data/dummy_corpus.txt")
  • There is no early stopping.
  • The Train notebook runs at the rate of 1 epoch / 2 days on an Nvidia 1080 Ti.
  • Your model is saved when ./saved_models when the average training loss in the last 20 iterations dips below the previous best.

Evaluation

Only implemented on classification tasks

  • Download the movie review dataset and put rt-polarity.neg and rt-polarity.pos in the ./tasks/mr_data directory.
  • You may also test on other classification tasks by downloading the datasets and providing their path and tasks type in Evaluate.ipynb

report

Recommend

About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK