Covers: theory of Retrofitting
Estimated time needed to finish: 30 minutes
Questions this item addresses:
  • What is retrofitting?
  • How does retrofitting work?
How to use this item?

Explanation of the process

Author(s) / creator(s) / reference(s)
Manaal Faruqui Jesse Dodge Sujay K. Jauhar Chris Dyer Eduard Hovy Noah A. Smith
0 comment
Recipe
publicShareStar

Improving Word Embeddings with Retrofit

Collaborators
Total time needed: ~2 hours
Objectives
Learn about how word embeddings can be improved by using knowledge base, a technique called retrofitting
Potential Use Cases
Improve the domain-specific word vectors you use by incorporating semantics.
Who is this for ?
INTERMEDIATENLP Developers who understand Word Embeddings and want to improve them in their own use cases.
Click on each of the following annotated items to see details.
REPO 1. Fun exercises to recap Word Vectors
  • How does Word Vectors work?
  • How to build your own Word Vectors?
  • How to use pre-trained Word Vectors?
40 minutes
BOOK_CHAPTER 2. Embeddings in Natural Language Processing
  • What are knowledge base?
10 minutes
PAPER 3. The Retrofitting Paper
  • What is retrofitting?
  • How does retrofitting work?
30 minutes
ARTICLE 4. A short guide on how to implement Retrofitting with Pre-trained Word Vectors and Paraphrase database
  • How retrofitting is done?
15 minutes

Concepts Covered

0 comment