Covers: theory of Activation Function

- What is an activation function?
- Why we use activation functions in Neural Networks?
- Which types of activation functions exist?
- What are the most common activation functions?

Read the online article

Sagar Sharma

Sandra Lopez-Zamora**Total time needed: **~20 minutes

- Learning Objectives
- Understand the concept of an active function
- Potential Use Cases
- Mathematical foundations for Deep Learning
- Target Audience
- BEGINNERDeep Learning practitioners new to Mathematical foundations

Go through the following **annotated items** *in order*:

VIDEO 1. Activation Functions

- What is an activation function?
- Which activation function could work better?
- What are the most common activation functions?
- Which activation function should I use for the output layer?
- When to use the most common activation functions?

11 minutes

VIDEO 2. Which Activation Function Should I Use?

- Why do we need an activation function?
- Which Activation Function Should I Use?
- Which are the most common activation functions?
- How to program the most common activation functions in Python?

9 minutes

ARTICLE 3. Activation Functions in Neural Networks

- What is an activation function?
- Why we use activation functions in Neural Networks?
- Which types of activation functions exist?
- What are the most common activation functions?

10 minutes

Previewing stream ** Math and Foundations**

Upcoming Live Sessions

Videos

Learning Packages

Past Capstones

People

Search for a tag: