, a neural attention mechanism equips a neural network with the ability to focus on a subset of its inputs (or features): it selects specific inputs.
Potential Use Cases
The introduction of the Attention Mechanism in deep learning has improved the success of various models in recent years, and continues to be an omnipresent component in state-of-the-art models. Therefore, it is vital that we pay Attention to Attention and how it goes about achieving its effectiveness.
Who is this for ?
Click on each of the following annotated items to see details.
VIDEO 1. Introduction to RNN
What is RNN?
LIBRARY 2. RNN from scratch
How to implement RNN in python from scratch?
ARTICLE 3. What is NLP?
What is Natural Language Processing (NLP)?
VIDEO 4. Attention model
What is attention model and what is the math behind it?
ARTICLE 5. How does attention model work?
How does attention model work?
LIBRARY 6. How to implement attention model in python using Keras
How to implement attention model in python using Keras?