Covers: theory of recurrent neural network (RNN)
Questions this item addresses:
  • What is RNN?
How to use this item?

Watch the whole video

Author(s) / creator(s) / reference(s)
Andrew Ng
0 comment

Attention Mechanism

Total time needed: ~2 hours
, a neural attention mechanism equips a neural network with the ability to focus on a subset of its inputs (or features): it selects specific inputs.
Potential Use Cases
The introduction of the Attention Mechanism in deep learning has improved the success of various models in recent years, and continues to be an omnipresent component in state-of-the-art models. Therefore, it is vital that we pay Attention to Attention and how it goes about achieving its effectiveness.
Who is This For ?
Click on each of the following annotated items to see details.
VIDEO 1. Introduction to RNN
  • What is RNN?
10 minutes
LIBRARY 2. RNN from scratch
  • How to implement RNN in python from scratch?
20 minutes
ARTICLE 3. What is NLP?
  • What is Natural Language Processing (NLP)?
20 minutes
VIDEO 4. Attention model
  • What is attention model and what is the math behind it?
10 minutes
ARTICLE 5. How does attention model work?
  • How does attention model work?
10 minutes
LIBRARY 6. How to implement attention model in python using Keras
  • How to implement attention model in python using Keras?
30 minutes

Concepts Covered

0 comment