AI-Accelerated Product Development
Understand the paper : Learning Longformer:The Long-Document Transformer
Total time needed:
With this list you can learn about Longformer and how to implement it.
Potential Use Cases
Long text summarization, Long text question answering.
Who is This For ?
NLP Data scientist from all audience levels
Click on each of the following
to see details.
1. Introduction to Transformer Encoder Decoder Model
What is transformer and how it works?
2. Attentions Mechanism In Neural Machine Translation
What is attention and type of attention mechanisms?
3. Longformer : The Long-Document Transformer (Original Paper)
What is long former and attention mechanism to process long sequence?
4. Understanding Transformer-Based Self-Supervised Architectures - LongFormer
How can we reduce the computational cost of the attention calculations, which grow quadratically with sequence length?
5. Longformer : The Long-Document Transformer Github Repo
How longformer is implemented?
6. Train a Longformer for Detecting Hyper-partisan News
How to train a longformer?
7. Train a Longformer for the Question Answering
How to implement longformer for question answering task?