Recipe
publicShareStar

Rectified Linear Units (ReLU)

Collaborators
Reviewers
Total time needed: ~30 minutes
Learning Objectives
Understand the concept of rectified linear units
Potential Use Cases
Mathematical foundations for Deep Learning
Target Audience
BEGINNERDeep Learning practitioners new to Mathematical foundations
Go through the following annotated items in order:
ARTICLE 1. Rectified Linear Units (ReLU) in Deep Learning
  • What is ReLU?
  • Why It Works?
  • How ReLU captures Interactions and Non-Linearities?
15 minutes
BOOK_CHAPTER 2. Rectified Linear Units and Their Generalizations
  • What is a Rectified Linear Unit?
10 minutes
OTHER 3. ReLu(x)
  • How is ReLU function represented ?
10 minutes
ARTICLE 4. A Gentle Introduction to the Rectified Linear Unit (ReLU)
  • What is ReLU?
  • How to code ReLU activation function?
  • What's are the advantages or ReLU?
15 minutes
ARTICLE 5. Intuitive explanation of why ReLU works
  • Why ReLU works?
10 minutes

Concepts Covered