AI-Accelerated Product Development
...
Recipe
public
Share
Star
Gradient Descent
Collaborators
Reviewers
Total time needed:
~4 hours
See details (learning objective, target audience, etc)...
Learning Objectives
This list will help you understand gradient descent for optimization of functions
Potential Use Cases
Mathematical foundations behind Gradient descent
Target Audience
INTERMEDIATE
Go through the following
annotated items
in order
:
ARTICLE
1. Need for optimization in Deep Learning
It explains why Deep learning algorithms use optimization.
5 minutes
ARTICLE
2. Gradient Descent Explained
Provides intuitive understanding of gradient descent as first order optimization algorithm
20 minutes
VIDEO
3. Multivariate calculus
It provides intuitive understanding of multivariate calculus
60 minutes
VIDEO
4. Optimization
Application of multivariable calculus to optimization problem
60 minutes
ARTICLE
5. Jacobian matrix
Explains what Jacobian captures for multivariable functions.
20 minutes
BOOK_CHAPTER
6. Second derivative as indication of curvature
Explains how to understand the impact of curvature on performance of gradient descent
30 minutes
Concepts Covered
Previewing stream
Math and Foundations
Upcoming Live Sessions
Videos
Learning Packages
Past Capstones
People
Search for a tag:
Tags list
AI Sustainability
Founders Stream
Careers in ML
ML in Cybersecurity
Recommender Systems
ML in Neuroscience
Quantum Tech and Quantum Machine Learning
IOT and Edge Security
Synthetic Data
ML in Biochemistry and Drug Discovery
Natural Language Processing
ML Interpretability
ML in Aerospace
AI Products
ML in Physics
Investment in Emerging Tech
ML for Time Series
ML in Biology
AI Ethics
Science of Science
ML in Economics
ML in Marketing
ML in Material Science
ML Engineering and Ops
Network Analysis
ML in Climate Science
Reinforcement Learning
ML in Chemistry
Generative Adversarial Networks
Computer Vision
Math and Foundations
Graph Neural Nets
ML in Health