Recipe
publicShareStar

Effective Approaches to Attention-based Neural Machine Translation

Collaborators
Reviewers
Total time needed: ~2 hours
Learning Objectives
Local and global attention in machine translation
Potential Use Cases
attention based neural translation
Target Audience
INTERMEDIATE
Go through the following annotated items in order:
ARTICLE 1. How Does Attention Work in Encoder-Decoder Recurrent Neural Networks
  • 1- What is alignment?
  • How is alignment different from translation?
3 minutes
ARTICLE 2. Global vs. Local Attention
  • 1- What's the difference between global and local attention?
2 minutes
ARTICLE 3. Effective Approaches to Attention-based Neural Machine Translation
  • 1- What is global attention?
  • 2- What are the implementation problems with global attention?
  • 3- What is local attention and how does it differ from local attention?
  • 4- What are practical alignment functions and how do they perform with attention?
60 minutes

Concepts Covered