Back Propagation Through Time (BPTT)

Total time needed: ~2 hours
Learning Objectives
Mathematical foundations behind Deep Learning
Potential Use Cases
Backpropagation in RNN where there is Hidden-Hidden recurrence
Target Audience
INTERMEDIATEPeople interested in knowing how to use deep learning for modeling sequences.
Go through the following annotated items in order:
ARTICLE 1. Back Propagation Through Time
  • What is BPTT?
20 minutes
BOOK_CHAPTER 2. Gradient Computation using BPTT
  • How to calculate gradient using BPTT?
30 minutes
BOOK_CHAPTER 3. Meaning of Hidden-Hidden recurrence
  • What does mean to have Hidden-Hidden recurrence relation?
30 minutes

Concepts Covered