BOOK_CHAPTERIntroduction to language model

Covers: theory of Introduction to N-gram
Estimated time needed: 5 minutes
Questions this item adddesses:
  • What is a language model?
How to use this item?

This is chapter 3 of the book. Read page 1 and 2.

URL: https://web.stanford.edu/~jurafsky/slp3/3.pdf
Author(s) / creator(s) / reference(s)
Daniel Jurafsky
Shortlist
publicShare

Introduction to N-gram model

Luan NguyenTotal time needed: ~42 minutes
Learning Objectives
Provides background information about a type of NLP model called N-gram model.
Potential Use Cases
Allows users to further understand advanced/in-depth N-gram topics.
Target Audience
BEGINNERData scientists who are new to NLP
Go through the following annotated items in order:
BOOK_CHAPTER 1. Introduction to language model
  • What is a language model?
5 minutes
VIDEO 2. Chain rule of prob basic
  • How to use chain rule to calculate probability of a sequence?
6 minutes
VIDEO 3. Introduction to N-gram model
  • What is a N-gram model?
4 minutes
VIDEO 4. Estimate N-gram probability
  • How to estimate the probability of a word in N-gram model?
10 minutes
VIDEO 5. A simple bi-gram text generation model
  • How to apply Markov assumption to make a bi-gram text generation model?
17 minutes

Concepts Convered