Covers: theory of recurrent neural network (RNN)
0
Questions this item addresses:
  • What is RNN?
How to use this item?

Watch the whole video

Author(s) / creator(s) / reference(s)
Andrew Ng
0 comment
Recipe
publicShare
Star0

Attention Mechanism

Contributors
Total time needed: ~2 hours
Objectives
, a neural attention mechanism equips a neural network with the ability to focus on a subset of its inputs (or features): it selects specific inputs.
Potential Use Cases
The introduction of the Attention Mechanism in deep learning has improved the success of various models in recent years, and continues to be an omnipresent component in state-of-the-art models. Therefore, it is vital that we pay Attention to Attention and how it goes about achieving its effectiveness.
Who is This For ?
INTERMEDIATE
Click on each of the following annotated items to see details.
VIDEO 1. Introduction to RNN
  • What is RNN?
10 minutes
LIBRARY 2. RNN from scratch
  • How to implement RNN in python from scratch?
20 minutes
ARTICLE 3. What is NLP?
  • What is Natural Language Processing (NLP)?
20 minutes
VIDEO 4. Attention model
  • What is attention model and what is the math behind it?
10 minutes
ARTICLE 5. How does attention model work?
  • How does attention model work?
10 minutes
LIBRARY 6. How to implement attention model in python using Keras
  • How to implement attention model in python using Keras?
30 minutes

Concepts Covered

0 comment