Covers: theory of Activation Function
Estimated time needed to finish: 11 minutes
Questions this item addresses:
  • What is an activation function?
  • Which activation function could work better?
  • What are the most common activation functions?
  • Which activation function should I use for the output layer?
  • When to use the most common activation functions?
How to use this item?

Watch Andrew Ng's video

Author(s) / creator(s) / reference(s)
Andrew Ng
0 comment
Recipe
publicShareStar

Activation Function

Collaborators
Total time needed: ~20 minutes
Objectives
Understand the concept of an active function
Potential Use Cases
Mathematical foundations for Deep Learning
Who is this for ?
BEGINNERDeep Learning practitioners new to Mathematical foundations
Click on each of the following annotated items to see details.
VIDEO 1. Activation Functions
  • What is an activation function?
  • Which activation function could work better?
  • What are the most common activation functions?
  • Which activation function should I use for the output layer?
  • When to use the most common activation functions?
11 minutes
VIDEO 2. Which Activation Function Should I Use?
  • Why do we need an activation function?
  • Which Activation Function Should I Use?
  • Which are the most common activation functions?
  • How to program the most common activation functions in Python?
9 minutes
ARTICLE 3. Activation Functions in Neural Networks
  • What is an activation function?
  • Why we use activation functions in Neural Networks?
  • Which types of activation functions exist?
  • What are the most common activation functions?
10 minutes

Concepts Covered

0 comment