BOOK_CHAPTERGradient Computation using BPTT

Covers: theory of BackPropagation Through Time
Estimated time needed: 30 minutes
Questions this item adddesses:
  • How to calculate gradient using BPTT?
How to use this item?

Read the section 10.2.2

URL: https://www.deeplearningbook.org/contents/rnn.html
Author(s) / creator(s) / reference(s)
Deep Learning book
Shortlist
publicShare

Back Propagation Through Time (BPTT)

Hardik SahiTotal time needed: ~2 hours
Learning Objectives
Mathematical foundations behind Deep Learning
Potential Use Cases
Backpropagation in RNN where there is Hidden-Hidden recurrence
Target Audience
INTERMEDIATEPeople interested in knowing how to use deep learning for modeling sequences.
Go through the following annotated items in order:
ARTICLE 1. Back Propagation Through Time
  • What is BPTT?
20 minutes
BOOK_CHAPTER 2. Gradient Computation using BPTT
  • How to calculate gradient using BPTT?
30 minutes
BOOK_CHAPTER 3. Meaning of Hidden-Hidden recurrence
  • What does mean to have Hidden-Hidden recurrence relation?
30 minutes

Concepts Convered