Covers: theory of Gradient Descent

Provides intuitive understanding of gradient descent as first order optimization algorithm

Read till Description section.

Wikipedia

0 comment

Contributors

- Objectives
- This list will help you understand gradient descent for optimization of functions
- Potential Use Cases
- Mathematical foundations behind Gradient descent
- Who is This For ?
- INTERMEDIATE

Click on each of the following **annotated items** to see details.

Resources5/6

ARTICLE 1. Need for optimization in Deep Learning

It explains why Deep learning algorithms use optimization.5 minutes

ARTICLE 2. Gradient Descent Explained

Provides intuitive understanding of gradient descent as first order optimization algorithm20 minutes

VIDEO 3. Multivariate calculus

It provides intuitive understanding of multivariate calculus60 minutes

VIDEO 4. Optimization

Application of multivariable calculus to optimization problem 60 minutes

ARTICLE 5. Jacobian matrix

Explains what Jacobian captures for multivariable functions.20 minutes

BOOK_CHAPTER 6. Second derivative as indication of curvature

Explains how to understand the impact of curvature on performance of gradient descent30 minutes

0 comment