Covers: theory of Activation Function
Estimated time needed to finish: 9 minutes
Questions this item addresses:
  • Why do we need an activation function?
  • Which Activation Function Should I Use?
  • Which are the most common activation functions?
  • How to program the most common activation functions in Python?
How to use this item?

Watch the video to understand better the concept

Fail to play? Open the link directly: https://www.youtube.com/watch?v=-7scQpJT7uo
Author(s) / creator(s) / reference(s)
Siraj Raval
0 comment
Recipe
publicShare
Star0

Activation Function

Contributors
Total time needed: ~20 minutes
Objectives
Understand the concept of an active function
Potential Use Cases
Mathematical foundations for Deep Learning
Who is This For ?
BEGINNERDeep Learning practitioners new to Mathematical foundations
Click on each of the following annotated items to see details.
VIDEO 1. Activation Functions
  • What is an activation function?
  • Which activation function could work better?
  • What are the most common activation functions?
  • Which activation function should I use for the output layer?
  • When to use the most common activation functions?
11 minutes
VIDEO 2. Which Activation Function Should I Use?
  • Why do we need an activation function?
  • Which Activation Function Should I Use?
  • Which are the most common activation functions?
  • How to program the most common activation functions in Python?
9 minutes
ARTICLE 3. Activation Functions in Neural Networks
  • What is an activation function?
  • Why we use activation functions in Neural Networks?
  • Which types of activation functions exist?
  • What are the most common activation functions?
10 minutes

Concepts Covered

0 comment