AI-Accelerated Product Development
Total time needed:
Learning about RMSprop concept, math behind it and code it in python
Potential Use Cases
RMSprop is a gradient based optimization technique used in training neural networks
Who is This For ?
Click on each of the following
to see details.
1. Intro to mathematical optimization
What is mathematical optimization?
Why do we need to optimize a cost function in ML algorithms?
2. Gradient Descent
What is Gradient Decent(GD)?
How does GD work in python?
3. Gradient Descent in Python
How to implement Gradient Descent in Python?
What is RMSprop?
How does this algorithm work?
5. RMSprop: Divide the gradient by a running average of its recent magnitude
Why rprop does not work with mini-batches
Further developments of rmsprop
6. RMSprop from scratch in Python
how to code RMSprop in python from scratch?
7. Implement RMSprop in Keras
How to implement RMSprop in Keras?