Covers: theory of Activation Function

- What is an activation function?
- Which activation function could work better?
- What are the most common activation functions?
- Which activation function should I use for the output layer?
- When to use the most common activation functions?

This video will walk you through the concept of activation function, the most common ones and tips on the decision of which activation function you should use.

Andrew Ng

Sandra Lopez-Zamora**Total time needed: **~52 minutes

- Learning Objectives
- The user of this shortlist will be able to understand the concept of hidden layers and the most common activation functions
- Potential Use Cases
- You are looking to understand the mathematical foundations for Deep Learning
- Target Audience
- BEGINNERDeep Learning practitioners interested in Mathematical foundations

Go through the following **annotated items** *in order*:

ARTICLE 1. An Introduction to Neural Networks

- What are neurons?
- How to code a neuron?
- How to combine neurons in a neural network?
- How to train a neural network?

15 minutes

ARTICLE 2. Overview of Neurons and Activation Functions

- What is an Artificial Neural Network?
- What is a neuron?
- What is an Activation Function?
- What are the most common activation functions?

5 minutes

VIDEO 3. Activation Function

- What is an activation function?
- Which activation function could work better?
- What are the most common activation functions?
- Which activation function should I use for the output layer?
- When to use the most common activation functions?

11 minutes

ARTICLE 4. Activation Functions in Neural Networks

- What is Activation Function?
- Why we use Activation functions with Neural Networks?
- Sigmoid or Logistic Activation Function
- Tanh or hyperbolic tangent Activation Function
- ReLU (Rectified Linear Unit) Activation Function
- Leaky ReLU
- Derivatives of activation functions

10 minutes

VIDEO 5. Layers in a Neural Network explained

- What are the type of layers in ANN?
- What kind of calculations occur within a hidden layer?
- How to build a hidden layer in Keras?

6 minutes

ARTICLE 6. Simplified Guide to Hidden Layer Neural Networks by DL Practitioner

- What is a multilayer perceptron (MLP)?
- What's the role of Feedforward and back propagation algorithms?
- Chain rule
- Gradient Descend Algorithm

15 minutes

Previewing stream ** Math and Foundations**

Upcoming Live Sessions

Videos

Learning Packages

Past Capstones

People

Search for a tag: