Bias in Word embedding and mitigating through debiasing.

Total time needed: ~2 hours
Learning Objectives
Learn types of word embeddings and danger of amplifying inherent bias in data and algorithms.
Potential Use Cases
It is important to learn bias in word embedding o develop more ethical and debiased NLP application.
Target Audience
BEGINNERData Scientist new to NLP
Go through the following annotated items in order:
ARTICLE 1. Word Embedding in NLP
  • What is word embedding?
10 minutes
ARTICLE 2. Static and Dynamic pre-trained Word Embedding
  • What are the available word embedding models?
23 minutes
PAPER 3. Bias in Word embedding
  • What is bias in Word embedding ?
10 minutes
ARTICLE 4. Types of bias in word embedding
  • What are the biases in word embedding?
10 minutes
ARTICLE 5. Measuring. Bias in word embedding
  • how to measure bias in word embedding ?
10 minutes
ARTICLE 6. Reviewed methods to measure and remove bias from word embedding.
  • How to identify bias in pretrained word embedding?
15 minutes
PAPER 7. Recent debiasing methods review
  • How to debias pretrained word embedding?
15 minutes
REPO 8. Implementing debiasing method
  • How to do debiasing of word embedding?
10 minutes

Concepts Covered