Recipe
publicShareStar

Activation Function

Collaborators
Reviewers
Total time needed: ~20 minutes
Learning Objectives
Understand the concept of an active function
Potential Use Cases
Mathematical foundations for Deep Learning
Target Audience
BEGINNERDeep Learning practitioners new to Mathematical foundations
Go through the following annotated items in order:
VIDEO 1. Activation Functions
  • What is an activation function?
  • Which activation function could work better?
  • What are the most common activation functions?
  • Which activation function should I use for the output layer?
  • When to use the most common activation functions?
11 minutes
VIDEO 2. Which Activation Function Should I Use?
  • Why do we need an activation function?
  • Which Activation Function Should I Use?
  • Which are the most common activation functions?
  • How to program the most common activation functions in Python?
9 minutes
ARTICLE 3. Activation Functions in Neural Networks
  • What is an activation function?
  • Why we use activation functions in Neural Networks?
  • Which types of activation functions exist?
  • What are the most common activation functions?
10 minutes

Concepts Covered