AI-Accelerated Product Development
...
Recipe
public
Share
Star
Understand the paper : Learning Longformer:The Long-Document Transformer
Collaborators
Reviewers
Total time needed:
~2 hours
See details (learning objective, target audience, etc)...
Learning Objectives
With this list you can learn about Longformer and how to implement it.
Potential Use Cases
Long text summarization, Long text question answering.
Target Audience
ADVANCED
NLP Data scientist from all audience levels
Go through the following
annotated items
in order
:
ARTICLE
1. Introduction to Transformer Encoder Decoder Model
What is transformer and how it works?
10 minutes
ARTICLE
2. Attentions Mechanism In Neural Machine Translation
What is attention and type of attention mechanisms?
20 minutes
PAPER
3. Longformer : The Long-Document Transformer (Original Paper)
What is long former and attention mechanism to process long sequence?
20 minutes
ARTICLE
4. Understanding Transformer-Based Self-Supervised Architectures - LongFormer
How can we reduce the computational cost of the attention calculations, which grow quadratically with sequence length?
7 minutes
REPO
5. Longformer : The Long-Document Transformer Github Repo
How longformer is implemented?
10 minutes
ARTICLE
6. Train a Longformer for Detecting Hyper-partisan News
How to train a longformer?
7 minutes
ARTICLE
7. Train a Longformer for the Question Answering
How to implement longformer for question answering task?
7 minutes
Concepts Covered
Previewing stream
Natural Language Processing
Upcoming Live Sessions
Videos
Learning Packages
Past Capstones
People
Search for a tag:
Tags list
ML Engineering and Ops
ML in Cybersecurity
ML for Time Series
ML in Biology
Graph Neural Nets
ML in Marketing
ML Interpretability
AI Sustainability
Generative Adversarial Networks
Natural Language Processing
ML in Health
Synthetic Data
Founders Stream
Investment in Emerging Tech
ML in Economics
IOT and Edge Security
Quantum Tech and Quantum Machine Learning
ML in Physics
AI Ethics
Science of Science
ML in Neuroscience
ML in Aerospace
ML in Material Science
ML in Climate Science
Careers in ML
Recommender Systems
ML in Chemistry
Network Analysis
Reinforcement Learning
Computer Vision
AI Products
ML in Biochemistry and Drug Discovery
Math and Foundations