VIDEOWhich Activation Function Should I Use?

Covers: theory of Activation Function
Estimated time needed: 9 minutes
Questions this item adddesses:
  • Why do we need an activation function?
  • Which Activation Function Should I Use?
  • Which are the most common activation functions?
  • How to program the most common activation functions in Python?
How to use this item?

Watch the video to understand better the concept

Fail to play? Open the link directly: https://www.youtube.com/watch?v=-7scQpJT7uo
Author(s) / creator(s) / reference(s)
Siraj Raval
Shortlist
publicShare

Activation Function

Sandra Lopez-ZamoraTotal time needed: ~20 minutes
Learning Objectives
Understand the concept of an active function
Potential Use Cases
Mathematical foundations for Deep Learning
Target Audience
BEGINNERDeep Learning practitioners new to Mathematical foundations
Go through the following annotated items in order:
VIDEO 1. Activation Functions
  • What is an activation function?
  • Which activation function could work better?
  • What are the most common activation functions?
  • Which activation function should I use for the output layer?
  • When to use the most common activation functions?
11 minutes
VIDEO 2. Which Activation Function Should I Use?
  • Why do we need an activation function?
  • Which Activation Function Should I Use?
  • Which are the most common activation functions?
  • How to program the most common activation functions in Python?
9 minutes
ARTICLE 3. Activation Functions in Neural Networks
  • What is an activation function?
  • Why we use activation functions in Neural Networks?
  • Which types of activation functions exist?
  • What are the most common activation functions?
10 minutes

Concepts Convered