AI-Accelerated Product Development
Activation Functions for Neural Networks in Natural Language Processing
Total time needed:
You will learn about activation functions in general, and about how they are used in neural networks for NLP.
Potential Use Cases
Creating an NLP neural network, or experimenting with different activation functions for an NLP neural network.
Who is This For ?
This list would be useful for someone new to NLP or neural networks.
Click on each of the following
to see details.
1. Fundamentals of Deep Learning – Activation Functions and When to Use Them?
What are the different types of activation functions?
2. Neural Network Methods for Natural Language Processing
What activation functions are used in NLP neural networks?
3. A Primer on Neural Network Models for Natural Language Processing
What are the activation functions used within a neural network for NLP, and for the output layer?
4. 7 types of Artificial Neural Networks for Natural Language Processing
What types of neural networks are used for NLP?
5. Is it Time to Swish? Comparing Deep Learning Activation Functions Across NLP tasks
When should you use alternative types of activation functions?